How to read 16-bit text with Matlab

15 次查看（过去 30 天）

Frank 2016-3-1

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/270857-how-to-read-16-bit-text-with-matlab

编辑： Les Beckham 2022-5-20

I have an Agilent 34970A data logger with their BenchLink software. This puts out a .csv file that Excel reads with no trouble. But Matlab cannot import it because it's 16 bit text. The first two bytes are 0xFF 0xFE, then after that every text byte is followed by a NULL (0x00). I wrote a function to read it, but I was hoping for the ability to read it directly, without having to programmatically skip the NULLs.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

采纳的回答

Walter Roberson 2016-3-1

6
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/270857-how-to-read-16-bit-text-with-matlab#answer_211879

MATLAB does not handle UTF-16LE files. You might wish to use the source code I posted in http://uk.mathworks.com/matlabcentral/answers/267176-read-and-seperate-csv-data#answer_209938 which reads csv files from any of the UTF-8 / UTF-16 / UTF-32 encodings

9 个评论
显示 7更早的评论隐藏 7更早的评论

Walter Roberson 2016-3-2

在 MATLAB Online 中打开

After a bunch more programming, the solution turns out to be not bad at all.

If you have a UTF* encoded file you want to read with csvread or dlmread or textscan, you cannot do that directly. Instead:

fopen() the file with 'rt' (read text), and 'n' (native encoding), and specify the UTF encoding to the fopen(). For example,

fid = fopen('test.csv', 'rt', 'n', 'UTF16LE')

If you specify a UTF encoding other than UTF8, then you will probably get a warning about the UTF encoding not be supported. It turns out you can ignore that warning since R2006a when you are reading a file.

Now, fread() from the file enough bytes to consume any Byte Order mark that is at the beginning of the file. For example, UTF16LE starts with the byte pair 255 254 so tell it to read those (you can throw them away)

fread(fid, 2, '*uint8'); %adjust the 2 to fit the UTF encoding

Now, read the entire rest of the file as a string:

filecontent = fread(fid, [1 inf], '*char');

and now you can fclose(fid)

This string will already have the UTF decoded.

With that string that is the entire file in hand, you can proceed to textscan() the string buffer, such as

datacell = textscan(filecontent, '%s%f%f%f', 'Delimiter', ',', 'HeaderLines', 1);

keldstefan 2022-5-20

在 MATLAB Online 中打开

Very nice Walter ;)

Does anybody know how to deactivate the warning?

"Warning: The encoding 'XXXXXXX' is not supported.
See the documentation for FOPEN."

I am reading several hundreds of these files, I'd like to remove this output from the console...

Les Beckham 2022-5-20

编辑：Les Beckham 2022-5-20

在 MATLAB Online 中打开

@keldstefan

To disable the warning, issue the following command after you receive that warning:

[msg, id] = lastwarn;

Then, disable the warning as follows:

warning('off', id)

请先登录，再进行评论。

类别

MATLAB Data Import and Analysis Data Import and Export Low-Level File I/O

在 Help Center 和 File Exchange 中查找有关 Low-Level File I/O 的更多信息

产品

MATLAB

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by

How to read 16-bit text with Matlab

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

采纳的回答

9 个评论
显示 7更早的评论隐藏 7更早的评论

更多回答（0 个）

另请参阅

类别

标签

产品

Community Treasure Hunt

How to read 16-bit text with Matlab

0 个评论 显示 -2更早的评论隐藏 -2更早的评论

采纳的回答

9 个评论 显示 7更早的评论隐藏 7更早的评论

更多回答（0 个）

另请参阅

类别

标签

产品

Community Treasure Hunt

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

9 个评论
显示 7更早的评论隐藏 7更早的评论