How to compare elements with above and below element in a column?

5 views (last 30 days)
Masoud Taleb on 30 Apr 2020
Commented: Masoud Taleb on 30 Apr 2020
Hello
I have a matrix of 4 columns. I would like to compare each element in 4th column with previous and next element in the same column. If the difference is more than 50, the elemnt should turn to 0. (This is to eliminate unexpectedly high or low values inside 4th column. Other columns should not change at all)
My written code does not work, so I will be glad if some one can help in this. I expect the result look like this:
A = [15 2 7 36
20 3 14 41
25 4 21 0
30 5 28 22]
A = [15 2 7 36
20 3 14 41
25 4 21 567
30 5 28 22]
M = length (A(:,4)),
i = A(1,4) %first element of the column
k = A(M,4) %last element of the column
for T = 2:M-1
idx = A(T,4)
if idx> 'A(T+1,4)'+200
A(idx,4) = 0;
if idx < 'A(T-1,4)'-200
A(idx,4) = 0;
end
end
fname = sprintf('new.csv');
csvwrite (fname,A); % Write to CSV file
end

James Tursa on 30 Apr 2020
Is this what you want?
for T = 2:M
if( abs(A(T,4) - A(T-1,4)) > 50 )
A(T,4) = 0;
end
end
3 CommentsShow 1 older commentHide 1 older comment
James Tursa on 30 Apr 2020
You need to tell us what your conditions are for the outliers, if it is not a simple test for difference > 50.
Masoud Taleb on 30 Apr 2020
Oh James.... I found the problem. My values in example matrix were below 50 and in real data file are below 100. Then, many of data turned to 0.
Then, this works.... Thanks.

Guillaume on 30 Apr 2020
Rather than coming up with your own code, I'd recommend using the filloutliers method. It doesn't have a detection method for 'more than 50 away from the two nearest neighbours' but the many detections methods are probably a lot more robust than this anyway.
A(:, 4) = filloutliers(A(:, 4), 0); %replace outliers by 0
It also has better fill methods than replacing outliers by 0.
Masoud Taleb on 30 Apr 2020
Dear Guillaume
This is so nice way. I did not know there is so short and effective command. I replace above solution with this :) Thanks