How many files are we talking about, and how big is each file?
If you have R2014b, you may want to check out the new datastore capability as a more elegant approach to what you're doing. It may not help with your performance issue, though.
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!