Hi,
It seems like you have a couple of issues when handling the data between Matlab and Python.
1: Reading the CSV File
The error you are encountering is due to the presence of extra lines at the beginning of the file, which are not part of the actual data. A good approach is to handle this preprocessing step in Python before passing the data to Matlab.
2: Manipulating the DataFrame
You are having trouble manipulating the DataFrame in Matlab after loading it from Python. This can be due to the way Matlab handles Python objects.
Solution
We can write a Python script to preprocess the file, and then use Matlab to read and manipulate the cleaned data. Below are the steps:
- Preprocess the CSV file in Python
- Load and manipulate the cleaned data in Matlab
Step 1: Preprocess the CSV File in Python
Create a Python script to clean the CSV file by removing the first 8 lines.
# preprocess_csv.py
import pandas as pd
import sys
def preprocess_csv(input_file, output_file):
with open(input_file, 'r') as file:
lines = file.readlines()
# Remove the first 8 lines
cleaned_lines = lines[8:]
with open(output_file, 'w') as file:
file.writelines(cleaned_lines)
df = pd.read_csv(output_file, delimiter='\t')
return df
if __name__ == "__main__":
input_file = sys.argv[1]
output_file = sys.argv[2]
df = preprocess_csv(input_file, output_file)
print(df)
Run this script from Matlab using the "system" command or manually from the command line.
Step 2: Load and Manipulate Data in Matlab
After preprocessing the file, you can load the cleaned CSV file in Matlab and manipulate the data.
input_file = 'path/to/your/input_file.txt';
output_file = 'path/to/your/output_file.txt';
system(['python preprocess_csv.py ', input_file, ' ', output_file]);
fileData = py.pandas.read_csv(output_file, '\t');
data = double(fileData.values);
elapsed_time = data(:, 1);
Hope it helps.
