Importing .mat files with text also
1 次查看(过去 30 天)
显示 更早的评论
Hi, I'm trying to import large tables saved as a .mat file, but MATLAB won't load the file. The table is set up as a column matrix with ['str',#,#,#,#,#,#]. The str is a date file which could be converted to date, but takes a long time to do. (3.5million rows). I'm looking for a way to get this to import into matlab, but load won't work, and textscan doesn't either. Load is trying to pick it up as a ASCII file (due to the string) and textscan won't pick it up because it isn't a text file. Any suggestions?
Edit: Doing more research, could this also be related to my version of everything being 32bit rather than 64? The .mat file is only 36MB, so it didn't occur to me until I kept crashing the program doing some sidework.
11 个评论
José-Luis
2014-7-14
load will read binary .mat files, unless you pass it the -ascii flag, in which case it will read text. What does your command look like?
Have you read the documentation:
doc load
Mike Beacham
2014-7-14
编辑:Mike Beacham
2014-7-14
Hey Jose,
Short version - If I'm understanding correctly, for load to work, it has to be an entirely binary file, and for ASCII to work, it needs to be a text file?
Longer Version - I have tried load, load( ,-mat) and load( ,-ascii). They all keep giving errors. Just load gives error "Can't read file filename.mat." If I try adding -mat tag, I get the same thing, which makes sense. If I try as an -ascii, "Unknown text on line number 1 of ASCII file filename.mat "MATLAB"." And I've read through the documentation a few times, but it wasn't helping me too much. I was just getting on here to mention I might be overloading the 32 version I'm running, but it's nowhere near the 4G limit on file size. If I use some other data of about 10% the size, MATLAB crashed halfway through my script.
Star Strider
2014-7-14
Please post relevant parts of your code. Without it we can only guess.
Also, what version of MATLAB was the .mat file saved with? Do you have access to the script that saved it?
Mike Beacham
2014-7-14
The files were saved by converting a CSV to .mat file through MATLAB on R2014a 64bit, then they were given to me. I'm running R2014a 32bit.
I don't even have the load portion written into the script. I'm currently just trying to get the thing to load. I'm trying to load various files, and then the script picks columns out and does calculations.
>> load('filename.mat','-ascii');
Error using load
Unknown text on line number 1 of ASCII file filename.mat
"MATLAB".
>> load('filename.mat')
Error using load
Can't read file filename.mat.
>> load('filename.mat','-mat')
Error using load
Can't read file filename.mat.
>>
José-Luis
2014-7-14
.mat can also be a "Microsoft Access Table". Are you sure you have the right files? Further sanity check: Are the files located in your current directory, or a directory that's in the path?
Mike Beacham
2014-7-14
good checks, They are MATLAB files, so not Access Tables, and I checked my paths, the folder was a few down the list, but when I moved it to the top, same problems.
dpb
2014-7-14
编辑:dpb
2014-7-14
...The files were saved by converting a CSV to .mat file through MATLAB on R2014a 64bit, then they were given to me. I'm running R2014a 32bit....
I don't have a 64-bit system to check on so can't answer whether there's a compatibility issue there or not. Official TMW support should be able to tell or the supplier of the files to check the doc for the 64-bit version for any caveats listed there or for any switches can use if known need them to be 32-bit compatible.
ADDENDUM
Are MAT-files compatible between the 32-bit and 64-bit versions of MATLAB?
MAT-files created with 32-bit versions and 64-bit versions of MATLAB are compatible with each other.
Note: With large data sets that use the -7.3 MAT-file format, it is possible for the 64-bit version of MATLAB to produce a MAT-file that is too large for the 32-bit version of MATLAB.
That implies other than the overall file size should be compatible if save was how files were actually created.
END ADDENDUM
Other than that, we're still guessing -- if can post the segment of code that did the save to create the files and the relevant information for the variables within, then could have something to go on to know what the files really are.
It would be of interest to see what
whos -file 'filename.mat'
returns and if could get it from both machines that would be even better.
Mike Beacham
2014-7-14
编辑:Mike Beacham
2014-7-14
The file was saved using te import data function on the command window, not actually writen code. It started as a CSV file. I wanted it to export as a table, so I chose that option, labeled the headings, and then saved as a .mat file. It opens just fine on the 64 bit machine. If I enter in whos there I get
>> whos('-file','siws01.mat')
Name Size Bytes Class Attributes
siws01 - 562714480 table
Running on my 32 bit system, I get a warning that says unknown MAT-file error.
>> whos('-file','siws01.mat')
Warning: Unable to read some of the variables due to unknown MAT-file error.
Hmmm. I think that means my problem is more related to file type as opposed to text vs binary inputs. Thanks everyone. I'll figure this out and then see if I still have the importing problem.
dpb
2014-7-14
Indeed your surmise is correct. I don't have a version with the table type so can't test. I'd suggest after you read the data in if the point is to transport the data to the other machine, use
save filename txtvar numericvars
will be more compact and you can then just load the variables and create the table on the target machine.
Mike Beacham
2014-7-15
It turns out my whole MATLAB install was corrupt, I re-installed and it started loading them. Thanks for all the help guys!
回答(0 个)
另请参阅
类别
在 Help Center 和 File Exchange 中查找有关 Data Type Conversion 的更多信息
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!发生错误
由于页面发生更改,无法完成操作。请重新加载页面以查看其更新后的状态。
您也可以从以下列表中选择网站:
如何获得最佳网站性能
选择中国网站(中文或英文)以获得最佳网站性能。其他 MathWorks 国家/地区网站并未针对您所在位置的访问进行优化。
美洲
- América Latina (Español)
- Canada (English)
- United States (English)
欧洲
- Belgium (English)
- Denmark (English)
- Deutschland (Deutsch)
- España (Español)
- Finland (English)
- France (Français)
- Ireland (English)
- Italia (Italiano)
- Luxembourg (English)
- Netherlands (English)
- Norway (English)
- Österreich (Deutsch)
- Portugal (English)
- Sweden (English)
- Switzerland
- United Kingdom (English)
亚太
- Australia (English)
- India (English)
- New Zealand (English)
- 中国
- 日本Japanese (日本語)
- 한국Korean (한국어)