Convert a non uniform cell array of cell arrays to matrix
Show older comments
I have the following code:
%% Loading the data
rhoPart = 2540;
files = dir(fullfile(uigetdir,'\**\*.data*'));
[~,Index] = natsort({files.name});
files = files(Index);
folders = {files.folder};
folder_groups = findgroups(folders);
k = 1;
for i = 1:length(files)
fid = fopen(fullfile(files(i).folder,files(i).name),'r');
%% Reading the data
% Read all the data from the file
dataRead = textscan(fid,'%f %f %f %f %f %f %f %f %f %f %f %f %f %f','HeaderLines',1);
frewind(fid);
% Write headerline N, time, xmin, ymin, zmin, xmax, ymax, zmax
runData{k} = strsplit(fgetl(fid), ' ');
% Write only the x, y, and z components of the particles, particle radius,
% z component+ particle radius and volume of the particle
expData{k} = [dataRead{1}(:,1) dataRead{2}(:,1) dataRead{3}(:,1) dataRead{7}(:,1) dataRead{3}(:,1)+dataRead{7}(:,1) rhoPart*(4/3)*pi*(dataRead{7}(:,1).^3)];
% Write only the vx,vy,vz of the particles and magnitude
velData{k} = [dataRead{4}(:,1) dataRead{5}(:,1) dataRead{6}(:,1) sqrt(dataRead{4}(:,1).^2 + dataRead{5}(:,1).^2 + dataRead{6}(:,1).^2)];
fclose(fid);
k = k + 1;
end
%% Classify (into a structure)
runData_struc = splitapply(@(x) {x}, runData, folder_groups);
expData_struc = splitapply(@(x) {x}, expData, folder_groups);
velData_struc = splitapply(@(x) {x}, velData, folder_groups);
This will give me the following cell array of runData_struct (see pictures)

As you can see this is a cell array in a cell array. I want to convert the 1x9 cell into a 1x9 double. For example:
runData_struc{1,1}
row 1: 1x9 double
row 2 :1x9 double
row 3: 1x9 double
...
row 2741: 1x9 double
runData_struc{1,2}
row 1: 1x9 double
row 2 :1x9 double
row 3: 1x9 double
...
row 2745: 1x9 double
I tried the following, but it gave me NaN as result:
9 Comments
Matt J
on 20 Sep 2020
I suggest attaching a .mat file with runData_struc, so we can work with it directly.
Sindar
on 20 Sep 2020
I may be misunderstanding, but shouldn't this work:
A1 = cell2mat(runData_struc{1});
A2 = cell2mat(runData_struc{2});
if that doesn't work, something like this might (but I'm not the cellfun expert)
A1 = cell2mat(cellfun(@cell2mat,runData_struc{1},'UniformOutput',false));
A2 = cell2mat(cellfun(@cell2mat,runData_struc{2},'UniformOutput',false));
Tessa Kol
on 21 Sep 2020
Sindar
on 21 Sep 2020
Ah, sorry, I missed that the innermost cells contained chars not doubles. That changes things a little. But, before altering the solution, is there a reason that you use this line:
runData{k} = strsplit(fgetl(fid), ' ');
instead of something that will read that line as numbers?
If not, it appears something like this should work to get you numbers directly
runData{k} = textscan(fgetl(fid),'%f %f %f %f %f %f %f %f ','HeaderLines',0);
which should then work better later.
In fact, if that works (and you always have the same number of columns), you can probably avoid storing each row in a cell, and pre-sort them by folder
%% Loading the data
rhoPart = 2540;
files = dir(fullfile(uigetdir,'\**\*.data*'));
[~,Index] = natsort({files.name});
files = files(Index);
folders = {files.folder};
folder_groups = findgroups(folders);
% pre-allocate one cell for each folder group
for ind=1:max(folder_groups)
runData{ind} = [];
expData{ind} = [];
velData{ind} = [];
end
% why have i and k separately?
for k = 1:length(files)
fid = fopen(fullfile(files(k).folder,files(k).name),'r');
%% Reading the data
% Read all the data from the file
dataRead = textscan(fid,'%f %f %f %f %f %f %f %f %f %f %f %f %f %f','HeaderLines',1);
frewind(fid);
% Read headerline N, time, xmin, ymin, zmin, xmax, ymax, zmax
C = textscan(fgetl(fid),'%f %f %f %f %f %f %f %f ','HeaderLines',0);
% add the row to the matrix for the correct folder group
% .' transposes. If this errors or creates 1xN matrices, remove .'
runData{folder_groups(ind)}(:,end+1) = C{1}.';
% Read only the x, y, and z components of the particles, particle radius,
% z component+ particle radius and volume of the particle
% add the rows to the matrix for the correct folder group
expData{folder_groups(ind)}(:,end+1) = [dataRead{1}(:,1) dataRead{2}(:,1) dataRead{3}(:,1) dataRead{7}(:,1) dataRead{3}(:,1)+dataRead{7}(:,1) rhoPart*(4/3)*pi*(dataRead{7}(:,1).^3)];
velData{folder_groups(ind)}(:,end+1) = [dataRead{4}(:,1) dataRead{5}(:,1) dataRead{6}(:,1) sqrt(dataRead{4}(:,1).^2 + dataRead{5}(:,1).^2 + dataRead{6}(:,1).^2)];
fclose(fid);
end
% no post classification needed
(it may also be worth looking at Matlab tables, but that transition should be straightforward here and can be done after loading in the matrices, with array2table)
Tessa Kol
on 21 Sep 2020
Sindar
on 23 Sep 2020
Yes, that answer was if the header line contained text, e.g.:
time position velocity
1 0 1
2 1 3
So you want to extract the numbers from the body and the words from the header.
Depending on how much time you'll be using this code, I'd suggest checking out my further suggestions - layers of cells tend to be more expensive and tedious to use than other data storage
If you reverse the order then you do not need to call frewind, giving simpler and more efficient code.
Simply read the header first and then the rest of the file data (the 1 specifies how many lines to read:
% Read headerline N, time, xmin, ymin, zmin, xmax, ymax, zmax
Headerline = textscan(fid,'%f%f%f%f%f%f%f%f%f',1);
% Read all the data from the file
dataRead = textscan(fid,'%f%f%f%f%f%f%f%f%f%f%f%f%f%f');
Tessa Kol
on 25 Sep 2020
Accepted Answer
More Answers (0)
Categories
Find more on Large Files and Big Data in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!

