engine.eval without assigned stdout does not handle Unicode correctly

[allefeld]

Example: The Unicode character '→' (U+2192) appears in the output as U+001A.

That does not happen if the stdout argument is assigned to a StringIO instance.

However, the disadvantage is that output assigned to stdout is heavily buffered. If I have a long-running computation which continuously produces output, I have to choose between proper Unicode output and immediate feedback.

I though this might be a property of StringIO, and tried to intercept write calls.

But from the result it is clear that stdout.write is only called once. I also tried to induce flushing by inserting newline characters in the output, with no success.

[allefeld]

Just tested with R2023b and matlabengine 23.2.1, and the bug remains.

@alanfmw, not sure whether these issues are actually monitored?

[alanfmw]

@allefeld, we will look into this.

[allefeld]

Are there any news on this?

[alanfmw]

R2024a contains a fix. On Linux and Mac, with UTF-8 display, you will now see the Unicode character displayed correctly. On Windows, it depends on the machine locale. On a Chinese machine, we saw the Unicode output written to the Windows console correctly, but on a US machine, the Unicode output to the Windows console was swallowed, and changing the code page with chcp didn't help. Which platform are you using?

[allefeld]

Great, I'll check it out!

I'm on Linux, Debian 12.5.

Edit: Can confirm it is fixed with R2024a on Linux.