We can't suggest much without seeing your code. A million datasets with 8 fields is not large. I deal regularly with data (images) that have more than 8 million numbers in them and usually the operations take a few seconds or less, not hours. So I would think that your data, which is much smaller than most digital images these days, should not take long. But it depends on how much stuff you were doing on each element. Maybe you're doing something that can be vectorized for a tremendous speed up. We can't tell until we see the code.
Scanning through a large Data
3 次查看(过去 30 天)
显示 更早的评论
I am trying to scan through a large dataset to obtain information as well as pattern discovery. The dataset consist of 8 fields with different data types. i wrote a for loop and an inner for loop with a conditional if statement for conditioning. It is not displaying any errors, but it is taking long time to execute with the size set to 1,000,000, its ltaking hours. So what do i do, i need these to perform analysis on the dataset.
0 个评论
回答(1 个)
另请参阅
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!