Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix minor issues found by LLMs #192

Merged
merged 1 commit into from
Feb 5, 2025
Merged

Fix minor issues found by LLMs #192

merged 1 commit into from
Feb 5, 2025

Conversation

erikdubbelboer
Copy link
Member

I used the following command to concatenate everything into one big blob:

npx repomix --ignore ".github/,.parcel-cache/,dist/,docs/,node_modules/,TODO.md,yarn.lock,LISENCE,features/,.dockerignore,.gitignore"

Then I pasted it into various LLMs with this prompt:

Find any potential bugs or issues in this code:

<big blob here>

OpenAI O1: https://chatgpt.com/share/67a2f13f-eed4-8000-a7c5-2b3194a6bd42
Google Gemini: https://gist.github.com/erikdubbelboer/529ba1ab62e7c9603a84b454be595da9
DeepSeek R1: https://gist.github.com/erikdubbelboer/9487f4262a6aae9bcc3ae765b3e7d8b6

The prompt was too big for Claude 3.5 Sonnet.

Most "bugs" or issues it find are either wrong or irrelevant. For example any concurrency or security issue in testproxy. Some things are even wrong such as Gemini seeing a unicode character that isn't there.

I used the following command to concatenate everything into one big
blob:

    npx repomix --ignore ".github/,.parcel-cache/,dist/,docs/,node_modules/,TODO.md,yarn.lock,LISENCE,features/,.dockerignore,.gitignore"

Then I pasted it into various LLMs with this prompt:

    Find any potential bugs or issues in this code:

    <big blob here>

OpenAI O1: https://chatgpt.com/share/67a2f13f-eed4-8000-a7c5-2b3194a6bd42
Google Gemini: https://gist.github.com/erikdubbelboer/529ba1ab62e7c9603a84b454be595da9
DeepSeek R1: https://gist.github.com/erikdubbelboer/9487f4262a6aae9bcc3ae765b3e7d8b6

The prompt was too big for Claude 3.5 Sonnet.

Most "bugs" or issues it find are either wrong or irrelevant. For
example any concurrency or security issue in testproxy. Some things are
even wrong such as Gemini seeing a unicode character that isn't there.
Copy link
Member

@ErikSom ErikSom left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice, its good that it didnt find anything to big, solid lib.

Copy link
Collaborator

@koenbollen koenbollen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🤷‍♀️

@erikdubbelboer erikdubbelboer merged commit 7510b99 into main Feb 5, 2025
6 checks passed
@erikdubbelboer erikdubbelboer deleted the minor-issues-llm branch February 5, 2025 09:21
if err == stores.ErrNoSuchTopic {
util.ReplyError(ctx, p.conn, &MissingRecipientError{
Recipient: routing.Recipient,
Cause: err,
})
} else if err != nil {
if err != nil {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This behaviour does not look exactly the same, are we supposed to return the error even when it's ErrNoSuchTopic? If so, nice catch from the lib.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

5 participants