Storing large matrix to file

I need to store several 2000x1,000,000 matrices to a file. Is this feasible? I used the method outlined here and nearly crashed my computer (I can tell it's not an efficient way... but thought I'd try).
Do I need to partition the data and then rebuild it?
Thanks

5 Comments

First are you able to create such a big matrix? You are creating matrix at once? Or by parts?
It's a dynamical system simulation. 2000 initial conditions, 1M iterations. I can probably do with 500K iterations but would like to do more if possible.
The matrix is generated 1 row at a time.
Ok so I should be able to average along each column without loss of information... Still curious if it's feasible to do.
Then you can write matrix row by row.....to a text file..or to a netcdf file. No worries...
Turns out I couldn't average the data. I ended up using the save function, it's quite fast. I don't understand why we bother with fprintf.

Sign in to comment.

Answers (0)

Asked:

on 17 Apr 2018

Commented:

on 17 Apr 2018

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!