How do I get my MATLAB editor to read UTF-8 characters? UTF-8 characters in blank squares in editors, but in the command window and workspace works fine.

Question

Yohahn Jo 2016-4-26

15
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/280988-how-do-i-get-my-matlab-editor-to-read-utf-8-characters-utf-8-characters-in-blank-squares-in-editors

评论： Simon Diehl 2023-11-30

I have a project, which is commented in UTF-8 characters.

I tried changing the system locale on my Windows 10, however MATLAB editor is not recognizing UTF-8 characters(in blank squares). I'm not sure what to do here.

If I open the same .m file in text editor, it works fine.

How do I get my MATLAB editor to read UTF-8? Thank you

feature('DefaultCharacterSet')
feature('locale')
ans =
UTF-8
ans = 
                 ctype: 'en_US.windows-1252'
               collate: 'en_US.windows-1252'
                  time: 'en_US.windows-1252'
               numeric: 'en_US_POSIX.windows-1252'
              monetary: 'en_US.windows-1252'
              messages: 'en_US.windows-1252'
              encoding: 'windows-1252'
      terminalEncoding: 'windows-949'
           jvmEncoding: 'Cp1252'
                status: 'MathWorks locale management system initialized.'
               warning: 'System locale setting, ko_KR, is different from user locale setti…'

3 个评论
显示 1更早的评论隐藏 1更早的评论

Hongyu Shi 2016-5-1

I'm having the same issue for a long time. It seems that sometimes it can handle Chinese characters when I change my system into Chinese default language. But in English system they just becomes a lot of question marks.

Keith Hooks 2016-8-30

I'm having the same problem. It seems that editing the lcdata.xml file to change the encoding of en_US has no effect at all. It stays windows-1252 no matter what I change it to in the file.

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Jinghao Lei 2016-10-20

14
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/280988-how-do-i-get-my-matlab-editor-to-read-utf-8-characters-utf-8-characters-in-blank-squares-in-editors#answer_239883

在 MATLAB Online 中打开

I have a very tricky way to solve this problem. And it seems works. In my case, (windows matlab 2016b x64)

feature('locale')

always output below even I have modified lcdata.xml

ctype: 'zh_CN.GBK'
...

so, I delete this in lcdata.xml (in codeset)

<encoding name="GBK">
    <encoding_alias name="936">
</encoding>

then I change following

<encoding name="UTF-8">
    <encoding_alias name="utf8"/>
</encoding>

to

<encoding name="UTF-8">
    <encoding_alias name="utf8"/>
    <encoding_alias name="GBK"/>
</encoding>

The point is cheat matlab GBK is just alias of utf8

9 个评论
显示 7更早的评论隐藏 7更早的评论

Isidora Timkov-Glumac 2023-9-14

@Jinghao Lei I have the same version of MatLab as you, but my ctype is 'en_US_POSIX.US-ASCII'. How should I modify the lcdata file so that this hack works for me? Thank you!

Simon Diehl 2023-11-30

在 MATLAB Online 中打开

This solution worked for me as welll. I'm using Matlab R2023b on Windows Server 2019. My encoding was windows-1252.

This is not necessary on newer operating systems. I don't experience this problem with R2023b on Windows 10.

My steps where:

Go to Program Files\MATLAB\R2023b\bin
Rename lcdata.xml to lcdata_old.xml
Copy lcdata_utf8.xml and rename it to lcdata.xml
Open the file and go to section codeset
Comment out <encoding name="windows-1252" ...
Go to <encoding name="UTF-8"> and add the alias <encoding_alias name="1252">

The final sections look like this:

<!-- <encoding name="windows-1252" jvm_encoding="Cp1252">
    <encoding_alias name="1252"/>
</encoding> -->
<encoding name="UTF-8">
    <encoding_alias name="utf8"/>
    <encoding_alias name="1252"/>
</encoding>

And the result is:

feature("locale")
ans = 
  struct with fields:
               ctype: 'de_DE.UTF-8'
             collate: 'de_DE.UTF-8'
                time: 'de_DE.UTF-8'
             numeric: 'en_US_POSIX.UTF-8'
            monetary: 'de_DE.UTF-8'
            messages: 'de_DE.UTF-8'
            encoding: 'UTF-8'
    terminalEncoding: 'IBM850'
         jvmEncoding: 'UTF-8'
              status: 'MathWorks locale management system initialized.'
             warning: ''
             

The editor now works as expected. Thank you very much for the solution @Jinghao Lei

请先登录，再进行评论。

Answer 2

Michael Cappello 2017-10-31

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/280988-how-do-i-get-my-matlab-editor-to-read-utf-8-characters-utf-8-characters-in-blank-squares-in-editors#answer_288740

编辑：Rik 2023-3-30

在 MATLAB Online 中打开

% read in the file
fID = fopen(filename, 'r', 'n', 'UTF-8');
bytes = fread(fID);
fclose(fID);

The data read from the file can then be converted into Unicode characters, like so:

unic = native2unicode(bytes, 'UTF-8');

if you want, clear the Carriage Returns, set the Line Feeds to a space

unic(unic == 10) = []; unic(unic == 13) = ' ';
disp(unic'); % display the Unicode text

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

How do I get my MATLAB editor to read UTF-8 characters? UTF-8 characters in blank squares in editors, but in the command window and workspace works fine.

3 个评论
显示 1更早的评论隐藏 1更早的评论

采纳的回答

9 个评论
显示 7更早的评论隐藏 7更早的评论

更多回答（1 个）

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

另请参阅

类别

标签

Community Treasure Hunt

How do I get my MATLAB editor to read UTF-8 characters? UTF-8 characters in blank squares in editors, but in the command window and workspace works fine.

3 个评论 显示 1更早的评论隐藏 1更早的评论

采纳的回答

9 个评论 显示 7更早的评论隐藏 7更早的评论

更多回答（1 个）

0 个评论 显示 -2更早的评论隐藏 -2更早的评论

另请参阅

类别

标签

Community Treasure Hunt

3 个评论
显示 1更早的评论隐藏 1更早的评论

9 个评论
显示 7更早的评论隐藏 7更早的评论

0 个评论
显示 -2更早的评论隐藏 -2更早的评论