Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve language detection for small inputs #137104

Closed
JacksonKearl opened this issue Nov 13, 2021 · 3 comments
Closed

Improve language detection for small inputs #137104

JacksonKearl opened this issue Nov 13, 2021 · 3 comments
Assignees
Labels
feature-request Request for new features or functionality insiders-released Patch has been released in VS Code Insiders languages-guessing Language guessing issues on-testplan
Milestone

Comments

@JacksonKearl
Copy link
Contributor

The current language detection model typically is unable to provide high-confidence results for small inputs. It'd be nice if we could develop a model that excelled at guessing languages based on limited tokens.

@JacksonKearl JacksonKearl self-assigned this Nov 13, 2021
@JacksonKearl JacksonKearl added this to the November 2021 milestone Nov 13, 2021
@JacksonKearl JacksonKearl added languages-guessing Language guessing issues feature-request Request for new features or functionality labels Nov 13, 2021
@Igorgro
Copy link

Igorgro commented Feb 25, 2022

@JacksonKearl Excuse me, where the source code of 'vscode-regexp-languagedetection' can be found?

@JacksonKearl
Copy link
Contributor Author

I have not received approval from legal to release the model I developed publicly at the moment. I can try to answer any questions you might have about it.

@Igorgro
Copy link

Igorgro commented Apr 1, 2022

@JacksonKearl Thank you. I'm just disappointed that this repository claims to be open-source but depends on proprietary blobs like this 😕

@github-actions github-actions bot locked and limited conversation to collaborators Apr 7, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
feature-request Request for new features or functionality insiders-released Patch has been released in VS Code Insiders languages-guessing Language guessing issues on-testplan
Projects
None yet
Development

No branches or pull requests

3 participants
@JacksonKearl @Igorgro and others