Info

This question is closed. Reopen it to edit or answer.

What to do when you really ARE out of memory?

1 view (last 30 days)
Robert Jenkins
Robert Jenkins on 4 Aug 2015
Closed: MATLAB Answer Bot on 20 Aug 2021
What is the solution for optimizing code when you really are just working with too large of a dataset?
Currently I need to perform triscatteredinterp using 3 vectors all (100,000,000 x 1).
scatteredInterpolant does not work any better in this instance.

Answers (3)

the cyclist
the cyclist on 4 Aug 2015
Edited: the cyclist on 4 Aug 2015
For very large datasets, processing a random sample of the data will often give satisfactory results.

Walter Roberson
Walter Roberson on 4 Aug 2015
Store the data in hierarchies such as octrees that allow you to extract a subset that fits within working memory to do the fine-grained work on.

Robert Jenkins
Robert Jenkins on 7 Aug 2015
The solution I used in the end was to break up each of my vectors into manageable chunks and execute TriScatteredInterp on each of them.
The interpolant is valid on the new grid but only gives solutions inside of the block from which it came. I then simply stitched these back together.
Thank you both for your input!

This question is closed.

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!