Out of Memory using fgetl
3 views (last 30 days)
Show older comments
I would like to read each line of a huge text file (.txt). The text file has 3 columns of floating point number like below (about 8 million such lines in text file)
-0.02500000 -0.02450000 -0.02400000
-0.02350000 -0.02300000 -0.02250000
-0.02200000 -0.02150000 -0.02100000
My objective is to read each line at a time. Hence, I thought of using fgetl. But I get an Out of memory error when fgetl is executed for the first time
fid=fopen('allnrncoords.txt','r');
tline=fgetl(fid);
It seems fgetl is trying to read the whole file when it should just read one line. Can someone explain me what could be an issue
1 Comment
Accepted Answer
More Answers (1)
Kevin Holst
on 3 Feb 2012
Just throwing out ideas here, is your error coming at the first call to fgetl or after calling fopen?
Could it be that matlab is not recognizing an eol character in your text file and attempting to get the whole file as a line?
3 Comments
Kevin Holst
on 3 Feb 2012
If you know that each line will always consist of 3 numbers, you could do something like:
fid=fopen('allnrncoords.txt','r');
tline=textscan(fid,'%f %f %f',1);
That will get one line of data, so you could just do that as many times as you needed.
Walter Roberson
on 3 Feb 2012
Opening with 'rt' should make end of line recognition better. Unless, that is, the file happens to have been written on Mac OS (before OS-X) using only CR without LF as the line breaks.
See Also
Categories
Find more on Data Import and Export in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!