Support language features for other languages when using cell magics

[DonJayamanne]

I would like to run bash scripts in a cell.
I use cell magics for this.
I would like the langauge of the cell to be automatically set to bash

Similarly when using %html, %%svg, etc...
%%script julia
%%html
%%kql

Provides intellisense, syntax highlighting & the like (ie. use VS Code features to improving cell editing experience for non-python & non-markdown cells)

Additionally we should make sure all of the languages supported by magics. This includes things like:

• Q# Q# notebook magic command syntax highlighting support #10772

[greazer]

Related to microsoft/vscode#140147.

[ahmed2m]

I hope you're planning for sql too, it's so annoying as of the current state, yesterday I changed every cell. When I opened the same notebook today all the types are reset to Python!

[Photonico]

I expect this feature will be realized soon. :)
Could you tell me any progress?

[rchiodo]

Sorry this isn't on our radar at the moment.

[Photonico]

Sorry this isn't on our radar at the moment.

Hi,

Do you have a plan to fix this problem?

For example, I use both Python and Julia in one Jupyter notebook. I found that clicking the lower right button of the cell can demonstrate the menu which controls the syntax highlighting. I guess that If Julia option would be added to the menu, the problem gets solved.

However, I prefer the feature that allows multiple kernels on one notebook can be native of Jupyter extension.

[rchiodo]

This issue is about autodetecting cell magics that change the language. The plan is to make the language change automatically as you type a cell magic. It's not a high priority at the moment but will likely be addressed eventually.

What you're describing is more of a polyglot kernel. The jupyter extension has no plans for a polyglot kernel. However .NET interactive does. A polyglot kernel would likely support ALL languages in that dropdown. @DonJayamanne also mentioned another polyglot kernel in your discussion of this topic.

The IPython kernel supports only a subset of languages based on known cell magics that can change the language from python to something else. It seems julia is possible in that list though with the julia.magic extension:
https://stackoverflow.com/questions/24091373/best-way-to-run-julia-code-in-an-ipython-notebook-or-python-code-in-an-ijulia-n. So when we implement this feature, we should add julia to the list.

[Photonico]

This issue is about autodetecting cell magics that change the language. The plan is to make the language change automatically as you type a cell magic. It's not a high priority at the moment but will likely be addressed eventually.

What you're describing is more of a polyglot kernel. The jupyter extension has no plans for a polyglot kernel. However .NET interactive does. A polyglot kernel would likely support ALL languages in that dropdown. @DonJayamanne also mentioned another polyglot kernel in your discussion of this topic.

The IPython kernel supports only a subset of languages based on known cell magics that can change the language from python to something else. It seems julia is possible in that list though with the julia.magic extension: https://stackoverflow.com/questions/24091373/best-way-to-run-julia-code-in-an-ipython-notebook-or-python-code-in-an-ijulia-n. So when we implement this feature, we should add julia to the list.

Thanks a lot for your reply!!!

Julia language should be added to the menu. However, I still need to change the cell language every time I open the notebook.
It is better that the cell can identify the language of the cell automatically according to the statement: %%script julia, and change the syntax highlights.

I wish that Julia code can be demonstrated perfectly in Python kernel Jupyter notebook.
Other language support like C/C++, Go, Rust, etc is also great!

Sincerely
Lu

[RafalSkolasinski]

One more use case that seems not mentioned,

If there would be for example

%%writefile myfile.yaml
some: field
other: field

it'd be nice if it could be detected that this is yaml syntax.

[nicocanali]

This issue is about autodetecting cell magics that change the language

Instead of autodetecting, which might be tricky, would it be possible to allow a custom mapping? For example, I have a Kusto syntax highlighting extension that would be great to autoswitch when %%kql appears in a cell. Similarly, there may be non-standard names (like %%bigquery) that would nicely map to SQL, but might be tricky to do it automatically...so letting the user map it through a setting could work...? WDYT?

[leifwalsh]

I also think this would be useful, whether it's done automatically or at least exposed in the api such that a motivated extension author could make it happen

[DonJayamanne]

Created an upstream issue microsoft/pylance-release#4969
That would be a better solution, as pylance natively supports notebooks

[DonJayamanne]

Closing in favour of upstream issue microsoft/pylance-release#4969