Very large Matlab data file (q-table)

Question

Hend Abdul 2018-9-1

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/417104-very-large-matlab-data-file-q-table

编辑： Image Analyst 2018-9-1

Hi,

I have a code to run a training of q-learning based model. This code save the q-table and learning variables in a file using this statement:

save([filename '.mat'],... 'trial', 'QT','QTableEnterMap','all_steps','all_accuracy','all_timespent');

I run the code in remote server and after completing the training, I try to download the generated file and it was very large (1.09 GB) and took long time to be downloaded. Then, when I try load the file, I got error that said Error using load Unable to read MAT-file batch1_e.mat. Not a binary MAT-file. Try load -ASCII to read as text.

My questions are: 1- Is it possible to get very large file after during training q-learning model or there is a problem in the code?

2- How to load this very large file?

Thank you.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

ahmed nebli 2018-9-1

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/417104-very-large-matlab-data-file-q-table#answer_335013

编辑：Image Analyst 2018-9-1

1- First question: I'm not sure, but I do think yes it's possible because 1 GB is not a big file compared to other files generated after training.

2- Second question,: There is a function called matfile. This function accesses the data without loading it into the memory (used especially for big data). For further information take a look at this https://www.mathworks.com/help/matlab/ref/matfile.html