Copilot in GitHub.com Feedback

[eshwer]

Looking for Product Feedback

Copilot in GitHub.com is now available to Copilot Individual and Business users. And for those with access a preview of OpenAI o1-preview and o1-mini is coming soon to GitHub.com too.

How to access Copilot in GitHub.com

If you're part of an organization with Copilot Enterprise, you're already familiar with these features. For those on Copilot Individual or Copilot Business plans, see below on how to get access to Copilot in GitHub.com.

• For Copilot Individual users: If you have a license for Copilot Individual, you're all set! Visit github.com and you'll see the Copilot icon or go directly to github.com/copilot.
• For Copilot Business users: If you have a Copilot Business license through an organization, you'll need to ask your organization administrator to enable Copilot in GitHub.com. Learn how to do this.

[adamcstephens]

I have an individual license, but I can't seem to disable this feature. How can I remove Copilot buttons and search integrations? I disabled the preview feature, but no difference.

[meneguzzi]

Bump this one. I want no copilot whatsoever in any of my repositories. But it seems, regardless of my choice, people can now ask copilot to "explain" code in my repo. In my experience, ChatBots are actually counterproductive for anything other that stuff you'd find by googling anyway. Moreover, I have a blanket robots.txt that is meant to deny access to my code to all chatbots, but obviously GitHub is ignoring this.

[andreszs]

@meneguzzi Agreed. Instead of adding dubious AI that nobody asked for they could instead add the missing CHANGE LOG tab to the repositories, which would be easy and very helpful to get rid of change logs from READMEs once and for all.

[l4u532]

It is unclear to me if this will solely be enabled for the org members whom we have enabled CoPilot for, and whether there are any other pricing implications for enabling this. Kindly elaborate :)

[andreszs]

The fact that it's a Microsoft product you are required a license to use it is more than enough to avoid it like the plague.

[nathanheffley]

Could the Single sign-on to see results in the [ORG] organization note be dismissible? Or an option somewhere to hide it? I'm not SSO'd on any of my personal devices which is where I mostly use Copilot.

[zwalden]

Everytime I try to have the copilot chat actually do something (e.g, make a PR), it bombs out.

It keeps asking me to click on "Index Repository", which there is no such button, so I tell the bot that. The bot says, no worries, I can index for you, and that i'm indexed. Only to tell me that i'm not indexed and I need to click on index repositroy on subsequent interaction.
When opening a new prompt (after deleting all existing prompts I had been toying with) -- I now see the green button to "index"

[zwalden]

I asked it to do a couple of things; but primarily create PRs, is when I seen that specific error!

[eshwer]

Ah yes, Copilot in GitHub.com cannot do any "tasks" for you today. It primarily has awareness of the pages you are on and can answer questions about them.

But, if that is something you are interested in it being able to do, I will track it as feedback!

[zwalden]

Ahh.. I totally misunderstood this feature (probably getting ahead of myself more than the marketing, I'd wager) -- so this is strictly for communicating with llm regarding the repository? I seen folks suggesting this could help make bug PRs and stuff, so clearly I missed the memo here !

So this isn't much different then working with copilot chat in the IDE?

[eshwer]

Correct

[C1ph3rPhr3ak]

Every time I try to ask Copilot a question, it tells me that the answer goes against community standards. So.... It is unable to answer any question I have about my coding?

[itbeard]

Hey folks,
Is it possible to obtain a license as an open-source contributor? I canceled my paid Copilot subscription one month ago (I did not use Copilot last month because I switched to Cursor IDE), but now I want to try this new feature.

[Hamzaqtr-313]

No but I am trying

[gpertea]

I thought I can ask specific function questions about a code base using Copilot. But even though it apparently indexed the repository I was exploring, it started blatantly hallucinating non-existent functions and functionality (unacceptable!), while then also complaining that I should do something that not only seemed contradictory to the indexing message below, but the directions did not make much sense - how to confirm the prompt in copilot chat, I was there, I just did it.. So, was it indexed or not?

[eshwer]

@gpertea if you ask the same question to the smaller assistive chat (accessed by screenshotted button) -- is the response quality similar?

[eshwer]

Also it looks like the referenced repo is indexed!

[gustavomassa]

Copilot is having issues listing/reading files inside an organization. I'm a member of that organization and I have full access and a Copilot Individual license.

What I'm trying to do:

• Search for repositories inside that organization that have a "-xyz" suffix
• Based on the results, find all repositories missing the file "example.yaml"

Some of the errors returned by Copilot:
I was unable to retrieve the file list due to a limitation in the functions available to me
I don't have the capability to directly list the files inside a repository

[eshwer]

These two specific use cases are not well supported today. The opposite of both are though! For example:

• you should be able to search for repos starting with "abc-"
• you should be able to search for files within repos

[eshwer]

I did put this on our backlog to research and add support for, so thank you for reporting!

[wioniqle-q]

I cannot delete indexed project indexing

[eshwer]

Is this on the smaller assisted chat on the right of the page or in github.com/copilot?

[wioniqle-q]

Yes

[Predidit]

I can't find the button to delete index. I telled copilot to delete index, and copilot said he met an error when progressing delete.

[akiselev]

The instructions for semantic indexing are unclear:

What does that mean? What prompt do I need to confirm to get my codebase indexed?

---

On a public repo (KDAB/cxx-qt) I get the following error when asking "What does this repository do?":

---

When asking "Can you tell me about this repository?" (in a private repo), it depends way too much on the README. For example, if you don't delete or update the readme from some skeleton/template you used to initialize the repo, Copilot Chat will use that as the basis for the answer, even if the repo has completely diverged from the readme.

[eshwer]

What does that mean? What prompt do I need to confirm to get my codebase indexed?
-The prompt here is in reference to the Green "Index this Repo" button you may see in the the chat box. You can see a screenshot in our docs here.
On a public repo (KDAB/cxx-qt) I get the following error when asking "What does this repository do?":

• Looks like you uncovered a bug! Thank you! Our team is working to resolve this but if you try again, it should behave now! If not, let me know.

Re: you last point of feedback about the README - that's super helpful feedback! I share it back with the team. We tend to be a bit non-deterministic with this question so I've seen a bit of variety when that question is called.

[ArtemGoutsoul]

It would be nice if the conversation list was synchronized across sessions, both browser and mobile and eventually hopefully extensions like the PhpStorm Copilot plugin.

[eshwer]

Yeah that's a great point! I'll share this feedback back to the team!

[TheCedarPrince]

I don't want to be too much a nuisance but would it be possible to disable or hide Copilot completely from my interface? Thanks!

[sethmlarson]

The addition of Copilot where the notifications button previously was is not a welcome change. This might seem like a nitpick, but you're throwing away years of muscle memory just to push this brand new product. There are already 3 mentions of Copilot in the UI when I open github.com, could 2 or god-forbid, 1 of those locations suffice?

[Mogost]

This! In fact, this comment is one of the most valuable!

[eshwer]

We have moved it!

[jlleblanc]

I am failing to understand what this product offers beyond what you can already do with Copilot chat in VS Code. Even after indexing one of my repositories, I am getting function errors on at least every other response I get back.

When I finally got back a response for one of the tasks I had it do (generate a sitemap.xml file), I asked it to create a pull request. This was met with “sorry, can’t create branches or pull requests.”

🤷

[eshwer]

Makes sense and definitely aligned to a future we envision!

[tedsecretsource]

Isn't it true that this version of copilot is more of a RAG solution while Copilot in VS Code simply uses the currently active document for context?

[eshwer]

Sort of, that used to be the case but we've actually shipped @github to VS Code which supports the same functionality as chat in github.com. Check out the changelog here.

[tedsecretsource]

OMG that's crazy awesome. Do I need to index the repo in order to be able to use @github? If not, what is the benefit of indexing?

[eshwer]

I don't believe you need to index the repo to use @github -- indexing is specifically helpful for semantic code search like when you aren't sure the exact name of a function or symbol (see docs)

[hugovk]

Please remove (or add an option to remove) the floating button at the bottom right of every page:

It's sometimes in the way of other buttons, like the comment button right now, especially on mobile.

[eshwer]

If you open the panel and then select the ellispsis, a dropdown appears and you can hide the button.

[gmagana]

Asked a question, it started to formulate and answer, and then:

[khenckel]

Thank you for the report! This will be fixed in the next deployment of the safety filter.

[lennver]

I got a link as part of a reply in the chat, and it didn't open up a new tab when I clicked it, but instead navigated away from github. I think the default should be to open a new tab to not disrupt the chat while checking out some linked documentation or similar.

[aaron-trout]

When clicking the "Ask Copilot" button on a pull request, it would make sense to feed the model the contents of the PR as context.

I just tried this in a PR and asked a question about one of the functions which was modified, but Copilot just answered based on what is in the master branch, rather than the content of the PR. It would be great to be able to ask it questions about what the PR is doing.

[lennver]

As a business user of copilot, it would be nice to be able to index one or a few private repositories (without making them belong to the organization), since experimenting and trying things out in the same way as when working helps out.

I fully understand this might be because you're supposed to get personal copilot as well, but still think it could benefit by learning to use the features when experimenting.

[vblagoje]

Can we add the ability to automatically describe PRs according to some prompt. I've done this via https://github.com/vblagoje/pr-auto Github Action but why not have it built-in for opened/updated PRs. 🙏

[eshwer]

@vblagoje have you used our PR summary tool and if so, any feedback on it?

[vblagoje]

@eshwer excellent - didn't see it - now I do!! It is nice, works well, it would be even better if, in the future, a bit of prompt customization is allowed. I was able to achieve precisely what I want with Copilot chat and a custom prompt.

[0xdevalias]

I would like a 'copy reply' button so I can easily grab answers as markdown to add to issues/etc. I've noticed this shows up sometimes (not sure of specifics), but at least while using the chat in the context of a PR, it doesn't seem to be giving me the button to copy anymore.

[eshwer]

We want this too! It's on our roadmap 😉

[nikcio]

If you ask a question in the overlay chat while on the homepage of a repository and try to navigate to a file in the repository before it's done responding, it will cancel the question in the chat.

Example:

1. Go to https://github.com/reactjs/react.dev
2. Press one of the default questions
3. Navigate to a file or folder before it finishes answering
4. The question will be canceled

[nikcio]

Same thing happens if you create a new conversation and press the "Take conversation to immersive" (Fullscreen) button while copilot is answearing.

[timmonse]

Often I want to reference or continue a past conversation without starting a new one. However I can't find a way to access "Chat History" without first starting a new conversation.

Default View:

After Starting A Conversation

[timmonse]

Coincidentally a new UI rolled out where this is no longer an issue. Thanks!

[javl]

I think this will not really be possible, but it would be great if "policy violation" errors could be more descriptive. I read you can get a free Copilot subscription if you're the maintainer of a popular, open source repo. So I tried to ask if a repo with 160+ forks and 550 stars would be considered popular enough (guess not?), but I get a "Violates content policy" error, which seems out of place?

I've had similar vague errors in the past while working in VS Code. In those instances I think the error occurred because I was asking about "finding faces" in the context of 3d models (as in, a collection of connected vertices) but I guess Copilot though I was talking about finding people. But this is just a guess, as there is no context information whatsoever.

[Johnserf-Seed]

In the Chinese path of the GitHub Copilot documentation has incorrectly loaded tags
https://docs.github.com/zh/copilot/about-github-copilot/what-is-github-copilot

[cafenroy]

There is one thing that LLMs are very excellent at doing, and it is fixing grammatical errors in plain English or other language. I would like to have the option to fix my text writing in every input box, like in the issue title and content.

[sondreb]

Please make it possible to disable the Responsible AI Service. I am working on some apps that is in Norwegian and Serbian, and I keep getting these errors, not because there is any real bad language in there, it's just that this Responsible AI Service probably recognize some patterns in other languages, as bad content in English.

Sorry, the response was filtered by the Responsible AI Service. Please rephrase your prompt and try again.

[okineadev]

See https://github.com/orgs/community/discussions/145206

[corneliusroemer]

It doesn't have access to issues but it doesn't admit it either, just replying with files that it found. You should definitely index issues as well. The current issue search is a pain, it's where LLMs could shine:

corneliusroemer
2 minutes ago
is there an issue that talked about problems with submission? something like there's a maximum that we support

Copilot
2 minutes ago
There are no issues in the repository that mention problems with submission or a maximum limit.

corneliusroemer
2 minutes ago
are you sure? is there no limit on how many sequences one can submit? no crash? nothing been reported?

Copilot
1 minute ago
7 references
There are mentions of submission limits and crashes in the following files within the repository:

[ena-submission-deployment.yaml](https://github.com/loculus-project/loculus/blob/da17da5120b46bfe25858c062f1795d4deb84987/kubernetes/loculus/templates/ena-submission-deployment.yaml)
[SubmissionDatabaseService.kt](https://github.com/loculus-project/loculus/blob/da17da5120b46bfe25858c062f1795d4deb84987/backend/src/main/kotlin/org/loculus/backend/service/submission/SubmissionDatabaseService.kt)
[SubmitModel.kt](https://github.com/loculus-project/loculus/blob/da17da5120b46bfe25858c062f1795d4deb84987/backend/src/main/kotlin/org/loculus/backend/model/SubmitModel.kt)
You can explore more details by following the links to these files.

corneliusroemer
1 minute ago
i mean issues!

Copilot
1 minute ago
I wasn't able to find specific issues mentioning submission limits or crashes in the repository. You can explore the issues directly [here](https://github.com/loculus-project/loculus/issues).

corneliusroemer
1 minute ago
nothign about HTTP 500 errors? or timeouts?

Copilot
1 minute ago
12 references
I found several references to HTTP 500 errors and timeouts in the repository. You can explore them in the following files:

[LapisClient.ts](https://github.com/loculus-project/loculus/blob/da17da5120b46bfe25858c062f1795d4deb84987/website/src/services/lapisClient.ts)
[CrossRefService.kt](https://github.com/loculus-project/loculus/blob/da17da5120b46bfe25858c062f1795d4deb84987/backend/src/main/kotlin/org/loculus/backend/service/crossref/CrossRefService.kt)
[getOrganismStatistics.ts](https://github.com/loculus-project/loculus/blob/da17da5120b46bfe25858c062f1795d4deb84987/website/src/components/IndexPage/getOrganismStatistics.ts)
These results may be incomplete. You can view more results in the GitHub UI by performing a code search.