How do I point at certain columns in a .csv file and then run calculations on it?

Question

Lucas 2024-10-1，14:23

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2156745-how-do-i-point-at-certain-columns-in-a-csv-file-and-then-run-calculations-on-it

评论： Lucas 2024-10-1，21:20

Hello all, I currently have the code below that runs calculations and exports a matrix for my .csv files. Right now this is assuming my data is a clean 3Xwhatever matrix in my .csv files. Within my .csv files I only want to look at data in columns starting at B10, C10, and D10 and then running ot the end of those columns. Can matlab point to certain data within a .csv? I am assumning I need to tweak the M = readmatrix(fullfile(fn(ii).folder,fn(ii).name)) line or M = readmatrix(fullfile(fn(ii).folder,fn(ii).name)) line.

Any help is much appreciated! Thank you.

% appropriate dir() call that returns info 
% about the files you want to process:
fn = dir('*.csv'); % this call returns info about .csv files in the current directory;
                   % you may need to modify it to work for your file locations
                   % (see dir documentation)
% number of files:
N_files = numel(fn);
% pre-allocate results matrix (one row per file, 3 columns):
results = zeros(N_files,3);
% read and process each file:
for ii = 1:N
    % read the file:
    M = readmatrix(fullfile(fn(ii).folder,fn(ii).name));
    % process the file's data:
    S = sum(abs(diff(M,1,1)),1);
    % store the result:
    results(ii,:) = S;
end
% write the results file (can be located anywhere):
writematrix(results,'results.csv')

3 个评论
显示 1更早的评论隐藏 1更早的评论

Voss 2024-10-1，14:43

@Caleb: Using

'Range', 'B10:D10'

will read from row 10 only, but I believe @Lucas wants to read from row 10 to the last row of data.

@Lucas: Please upload a sample csv file (using the paperclip button) so that someone can determine how to modify the code for your files.

Lucas 2024-10-1，14:48

THESISv1 - 0.csv

@Voss @Caleb thank you for the help. I attache the file here, Voss is correct, I would like to read columns B10, C10, and D10 within this .csv all the way to the end of them (they are all the same length). Thanks!

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Voss 2024-10-1，14:59

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2156745-how-do-i-point-at-certain-columns-in-a-csv-file-and-then-run-calculations-on-it#answer_1525440

在 MATLAB Online 中打开

You can modify the code as follows (specifying 9 header lines, and using only columns 2-4 of the matrix read):

% appropriate dir() call that returns info 
% about the files you want to process:
fn = dir('*.csv'); % this call returns info about .csv files in the current directory;
                   % you may need to modify it to work for your file locations
                   % (see dir documentation)
% number of files:
N_files = numel(fn);
% pre-allocate results matrix (one row per file, 3 columns):
results = zeros(N_files,3);
% read and process each file:
for ii = 1:N_files
    % read the file starting from line 10:
    M = readmatrix(fullfile(fn(ii).folder,fn(ii).name),'NumHeaderLines',9);
    % process columns 2-4 of the file's data:    
    S = sum(abs(diff(M(:,2:4),1,1)),1); 
    % store the result:
    results(ii,:) = S;
end
% write the results file (can be located anywhere):
writematrix(results,'results.csv')

Also note that N had to be changed to N_files in the for line (that was a mistake in my original code, sorry about that).

3 个评论
显示 1更早的评论隐藏 1更早的评论

Voss 2024-10-1，20:53

You're welcome!

Lucas 2024-10-1，21:20

snip of calc.png

I appreciate it @Voss! I have had the chance to look at some of this distance data and it looks great. I want to tweak my main calculation slightly. Where I have S = sum(abs(diff(M(:,2:4),1,1)),1).

I would like to continue this method of subtracting the second line from the first and moving down. But I need an intermediate step (or 2) where the values are subtracted values are squared. The that row of values would be added up and the sqrt of that would be taken.That end value would be added to the end values of that operation perfromed down the rows. This is starting to hurt my head. I am going to try and implement it as well.

I have attached an image that explains this clearer (I hope). Its a way of doing the distance formula. I just need to loop it for 500 x y and z coordinates.

I appreciate you.

请先登录，再进行评论。

Answer 2

dpb 2024-10-1，15:05

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2156745-how-do-i-point-at-certain-columns-in-a-csv-file-and-then-run-calculations-on-it#answer_1525445

编辑：dpb 2024-10-1，19:53

在 MATLAB Online 中打开

" only want to look at data in columns starting at B10, C10, and D10 and then running ot the end of those columns. Can matlab point to certain data within a .csv? "

... 
nHdr=9;             % header lines to skip
C=["B";"D"];        % start, ending column (adjacent) --> "B:D" here...change to suit
range=join(C,":");  % build a range expression
for ii=1:numel(fn)
  M = readmatrix(fullfile(fn(ii).folder,fn(ii).name), ...
                'NumHeaderLines',nHdr,'Range',range);
...

See the doc for readmatrix and friends; also look into detectImportOptions to fine tune import even further such as returning noncontiguous ranges.

One could make a couple other minor adjustments to the calculational code; @Voss left yours untouched other than to select the specific columns to operate over from the whole array whereas the above only returns the desired columns.

...
nFiles=numel(fn);                       % number files to read
nCols=numel(char(C(1)):char(C(2)));     % number of columns to read (try it, you'll like it!!! :))
S=zeros(nFiles,nCols);                  % only have on total sum by nCols wide
for ii=1:nF
  M = readmatrix(fullfile(fn(ii).folder,fn(ii).name), ...
                'NumHeaderLines',nHdr,'Range',range);
  S(ii,:)=sum(abs(diff(M,1,1)));       
end
writematrix(S, ...)                     % save results as desired...

@Voss is correct if there were only one row; was not a case I figured would occur, but code should account for. agreed...I initially was thinking it was only the overall summation that was wanted, not the individual sums...looking back at the original I see I had misread it...

3 个评论
显示 1更早的评论隐藏 1更早的评论

dpb 2024-10-1，19:41

编辑：dpb 2024-10-1，19:59

在 MATLAB Online 中打开

I mixed old and new code and the Submit button quit working so I went away for awhile, @Voss.

I thought originall the overall total was all that was wanted and was going to compute it that needs only a single row for output but rereading I see I missed there.

Agreed; I didn't consider the possibility of there being only a single row but the code should handle just in case.

It's interesting that

M = [8 -4 10];
abs(diff(M,1,1))
ans =

  0x3 empty double matrix

is empty but

sum(abs(diff(M,1,1)))
ans = 1×3
     0     0     0
<mw-icon class=""></mw-icon>
<mw-icon class=""></mw-icon>

gets converted to the zeros vector. I don't know that I had ever noticed that behavior before.

It did let me correct now. I've been having lots of trouble with the forum with latest release of Firefox over last couple of weeks or so -- it brings up the window but have to manually refresh multiple times or close and try again before can get access to do anything....don't know if TMW changed something or Firefox introduced a bug...

Lucas 2024-10-1，20:50

Thank you @dpb. I appreciate your help on this as well!

take care.

Lucas

请先登录，再进行评论。

How do I point at certain columns in a .csv file and then run calculations on it?

3 个评论
显示 1更早的评论隐藏 1更早的评论

采纳的回答

3 个评论
显示 1更早的评论隐藏 1更早的评论

更多回答（1 个）

3 个评论
显示 1更早的评论隐藏 1更早的评论

另请参阅

类别

标签

产品

版本

Community Treasure Hunt

How do I point at certain columns in a .csv file and then run calculations on it?

3 个评论 显示 1更早的评论隐藏 1更早的评论

采纳的回答

3 个评论 显示 1更早的评论隐藏 1更早的评论

更多回答（1 个）

3 个评论 显示 1更早的评论隐藏 1更早的评论

另请参阅

类别

标签

产品

版本

Community Treasure Hunt

WeChat

3 个评论
显示 1更早的评论隐藏 1更早的评论

3 个评论
显示 1更早的评论隐藏 1更早的评论

3 个评论
显示 1更早的评论隐藏 1更早的评论