Problem with using readtable:

2 次查看（过去 30 天）
Ilter Onat Korkmaz
Ilter Onat Korkmaz 2021-4-18
回答： Aghamarsh Varanasi 2021-4-21
Here is the code:
opts = detectImportOptions("C:\Users\Onat\Desktop\392\vocab.txt");
opts.VariableTypes=["string", "double"];
opts.LineEnding = ["\n"];
vocab = readtable('C:\Users\Onat\Desktop\392\vocab.txt',opts);
I'am working on an NLP application in which I need the vocabulary and frequency of those words in vocabulary. Naturally, the corpus contains tokens such as single apostrophe. It seems that this is a major problem for MATLAB since it detects it as a special char. Notice that in the output given below, after apostrophe the frequencies are seen as comments to MATLAB. Can anyone help with this issue?
vocab.txt is as follows:
..... (i.e. this is not the beginning)
and 699333
in 603607
" 538122
to 504540
a 476836
was 304423
...... (i.e continues)
the output is as follows:
...... (i.e. this is not the beginning)
"and" 6.9933e+05
"in" 6.0361e+05
" 538122↵to 504540↵a 476836↵was 304423↵The 246510↵- 229901↵is 225721↵for 198733↵)

请先登录，再回答此问题。

采纳的回答

Aghamarsh Varanasi
Aghamarsh Varanasi 2021-4-21
Hi,
The quotes in a text file are used to import strings that contain any charater (even with delimiters). That is why you are seeing this behavior. You can specify the 'Format' of the file you are importing by using the 'Format' Name-Value pair input to the function readtable.
Example:
vocab = readtable('data.txt', 'Format' ,'%s %f');
This would import the data as expected.
For more info on how strings are imported from text documents, refer to this Community post.

更多回答（1 个）

Cris LaPierre
Cris LaPierre 2021-4-21
Ran in:
I would take a different approach. I would use readlines and string manipulation to create the table.
str = readlines("vocab.txt")
str = 6×1 string array
"and 699333" "in 603607" "" 538122" "to 504540" "a 476836" "was 304423"
T = array2table(split(str),'VariableNames',["Word","Freq"]);
T.Freq = str2double(T.Freq)
T = 6×2 table
Word Freq _____ __________ "and" 6.9933e+05 "in" 6.0361e+05 """ 5.3812e+05 "to" 5.0454e+05 "a" 4.7684e+05 "was" 3.0442e+05

类别

在 Help Center 和 File Exchange 中查找有关 Characters and Strings 的更多信息

标签

产品

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by