Smoothing/splining data with a limit to the slope of the smooth fit

2 views (last 30 days)
I have noisy data with erroneous measurements which I'm trying to smooth and remove outliers to better approximate the underlying "true" value that the data represent. I have a priori knowledge that the magnitude of the slope of the underlying true values cannot be more than a given value, i.e.
In the attached example, there's a series of measurements which are erroneous around 16:25 which violate this condition. I want a way to automatically remove those points before using pchip to smooth and interpolate the data. Is there a MATLAB function already in existence which can do something like this?
  2 Comments
John D'Errico
John D'Errico on 13 Sep 2022
Be careful, as it is not always perfectly clear what is an outlier from merely the data, when viewed by an automatic scheme. It can be especially difficult when you have blocks of points that you perceive as outliers. It would help if you add a .mat file with some sample data, attached to a comment or to your original question, please.
Eric Snyder
Eric Snyder on 13 Sep 2022
Thanks for the response. These data are from a localization project, and the "outliers" aren't just noise or erroneous data -- they are most likely the algorithm locking on to a different source for a period of time. Ideally I'd be able to separate them and fit two separate lines to each source, but removing the source with fewer detections would be OK, too.
I've attached the data I used in the above plot to the original question.

Sign in to comment.

Answers (1)

Bruno Luong
Bruno Luong on 13 Sep 2022
Edited: Bruno Luong on 13 Sep 2022
Using this File Exchange, its is not easy to find a combination of parameters to make it "works". I think it is difficult and the fit is fragile.
load('C:\Users\bruno\Downloads\example.mat')
ti=linspace(min(t),max(t),500);
pp=BSFK(t,x,3,200,[],struct('KnotRemoval','none','sigma',0,'lambda',1e-10));
plot(ti,ppval(pp,ti),'k',t,x,'.r')

Categories

Find more on Creating and Concatenating Matrices in Help Center and File Exchange

Products


Release

R2021b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!