remove duplicate rows from text file
显示 更早的评论
回答（1 个）
Guillaume
2018-7-19
lines = strsplit(fileread(yourtextfile), '\n')); %read file and split into lines
lines = unique(lines, 'stable'); %remove duplicate lines
fid = fopen(newfilename, 'w'); %open file for writing
fwrite(fid, strjoin(lines, '\n'), 'char'); %merge lines and write
fclose(fid);
4 个评论
michael
2018-7-19
Paolo
2018-7-19
@Michael, if its not possible for you to share the file, could you show a sample of what the text file looks like?
Guillaume
2018-7-19
Matlab version R14 SP3
Wow! You're only 25 versions behind the current version, soon to be 26.
While it's probably fairly easy to write a version of strsplit using regexp that would work with your version and strjoin is probably not too complicated either, you'd also have to write your own unique function since the 'stable' option didn't even exist back then. That's a more complicated task particularly as I'd have to pore over the online documentation to find out what was possible or not back then.
I'm sorry you're on your own there. At some point you've got to let go of legacy code.
Walter Roberson
2018-7-20
lines = strsplit(fileread(yourtextfile), '\n')); %read file and split into lines
[ulines, ia] = unique(lines);
lines = ulines(sort(ia));
fid = fopen(newfilename, 'w'); %open file for writing
fprintf(fid, '%s\n', lines{:});
fclose(fid)
Together with
function S = fileread(filename)
fid = fopen(filename, 'rt');
if fid < 0
error('file does not exist');
end
S = fread(fid, [1 inf], '*char');
fclose(fid);
function C = strsplit(S, delim)
C = regexp(S, delim, 'split');
类别
在 帮助中心 和 File Exchange 中查找有关 Characters and Strings 的更多信息
2018-7-20
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!
Translated by 
