Very large Matlab data file (q-table)

2 次查看(过去 30 天)
Hi,
I have a code to run a training of q-learning based model. This code save the q-table and learning variables in a file using this statement:
save([filename '.mat'],... 'trial', 'QT','QTableEnterMap','all_steps','all_accuracy','all_timespent');
I run the code in remote server and after completing the training, I try to download the generated file and it was very large (1.09 GB) and took long time to be downloaded. Then, when I try load the file, I got error that said Error using load Unable to read MAT-file batch1_e.mat. Not a binary MAT-file. Try load -ASCII to read as text.
My questions are: 1- Is it possible to get very large file after during training q-learning model or there is a problem in the code?
2- How to load this very large file?
Thank you.

采纳的回答

ahmed nebli
ahmed nebli 2018-9-1
编辑:Image Analyst 2018-9-1
1- First question: I'm not sure, but I do think yes it's possible because 1 GB is not a big file compared to other files generated after training.
2- Second question,: There is a function called matfile. This function accesses the data without loading it into the memory (used especially for big data). For further information take a look at this https://www.mathworks.com/help/matlab/ref/matfile.html

更多回答(0 个)

类别

Help CenterFile Exchange 中查找有关 Image Processing and Computer Vision 的更多信息

产品

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by