I work with large datasets (> 2TB) and have matrices often larger than 1,000,000 x 1,000,000 rows/cols. Computation times are on the order of weeks, and the time it take me to create plot animation (gifs) are on the order of hours. I am building a PC that will be able to do computations and plotting (contouring and texture mapping primarily) much faster. I use lots of for loops and if statements since most of the operations I do are heavily dependent on the previous iteration. Some functions that appear frequently in my script are: permute, reshape, regionsprops, labelmatrix, concatenation, indexing, max/mean/sum. I have the paralel computing toolbox and will use GPU computing (GTX 1070) for simple, but long operations. The PC will also have 64GB ram.
My question is, besides optimizing the script, what CPU is most optimized for heavy computations in MATLAB? 16 cores and 32 threads with the Threadripper 2950x but only a 4.4GHz clock speed, or 8 cores and 16 threads with up to 5GHz clock speed for the i9-9900k? MATLAB has very little documentation on selecting hardware and I am looking for any advice. Has MATLAB become better optimized for AMD, or should I stick with Intel? Also, are there any benchmarks from MATLAB that compare CPUs for different operations with different toolboxes? I use 2017a, would upgrading to latest release benefit me if I chose AMD over Intel?
