How do I read data (from a .dat file) seperated by lines of text into individual vectors

8 次查看(过去 30 天)
Hi there,
I am struggling to read in a .dat file correctly. The file has a bunch of headers starting with #s at the beginning followed by data (2 columns) followed by another header and then more data etc. The data I wish to read into matlab is over 2 million lines so you can imagine that having to go back and delete these headers to load chunks of data in individually will take some time.
Is there a way for Matlab to read in a file like this and seperate the data into seperate vectors each time there's a line of text/ a gap (if I have to go through and delete all the headers). It will not 'load' the data as it contains text that over runs the amount of columns of data at the start. I have tried using the import tool in matlab and I have tried fscanf but not had much luck either.
Any advice would be much much appreciated.
Many thanks


Walter Roberson
Walter Roberson 2019-3-2
编辑:Walter Roberson 2019-3-2
S = regexp(fileread('YourFileName.dat'), '\r?\n', 'split');
if isempty(S{end}); S(end) = []; end %regexp split leaves empty at bottom if file ended in \n which is common
nonheader = cellfun(@isempty, regexp(S, '^\s*#')); %permit space before #
starts = strfind([false nonheader], [false true]);
stops = strfind([nonheader false], [true false]);
num_blocks = length(starts);
blocks = cell(num_blocks, 1);
for K = 1 : num_blocks
fields = regexp(S(starts(K):stops(K)), '\s+', 'split');
lens = cellfun(@length, fields);
if any(lens ~= 2)
error('data that does not have exactly two fields is present between lines %d and %d', starts(K), stops(K));
temp = vertcat(fields{:});
blocks{K} = str2double(temp);
Now blocks will be a cell array consisting of numeric arrays with two columns each.
  3 个评论
Walter Roberson
Walter Roberson 2019-3-2
hold on
cellfun(@(B) plot(B(:,1), B(:,2)), blocks);
hold off
You can omit the hold commands if hold is already in effect. However, you need hold to be in effect when the second plot() is executed, or else each plot() will end up removing the previous lines.
You could potentially have problems with xlim and ylim not ending up set nicely.
If you want to loop through the blocks then,
for K = 1 : length(blocks)
x = blocks{K}(:,1);
y = blocks{K}(:,2);
..... do things
P_L 2019-3-4
编辑:P_L 2019-3-4
Hi Walter, thank you so much. You are a genius!!!
I have used the 1st suggestion you gave me after trying both. This is because the first attempt runs much more quickly as you can imagine. I have also managed to secure the axis using axis([xmin xmax ymin ymax]).
I am now trying to set the colour of the plots as black by using both 'k-' and 'MarkerColor', 'k'. Both of these attempts don't seem to work. I have also seen online that you could use:
as my plot has around 1500 "blcoks", is that what I need to reference in this command? e.g.
set(h(1:1500),'-','MarkerFaceColor','k') but that too has also been unsuccessful.
Please see attached. I would just like my lines to be a uniform colour.
I appreciate all your help so far. If you would be so kind to help with my last request, that really would be amazing.
Many thanks


更多回答(0 个)


Help CenterFile Exchange 中查找有关 Standard File Formats 的更多信息

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by