feature selection for regression

5 views (last 30 days)
Hello everyone
To do my PhD thesis, I desperately need MATLAB code to select the effective features in the regression problem (time series forecasting) that takes into account the relationship between the features and works as well as possible. Thanks for helping me.

Accepted Answer

Sulaymon Eshkabilov
Sulaymon Eshkabilov on 6 Nov 2021
  2 Comments
sahar rezaei
sahar rezaei on 7 Nov 2021
Hello Sulaymon
Thank you very much for your answer, but in my research I have compared several time series prediction methods that the accuracy of these methods strongly depends on the type of feature selection method. Accordingly, I need more precise methods to select effective features that not only consider the relationship between the relevant feature and the target, but also the relationship between the features. I ask all my friends if anyone has access to an accurate feature selection method to share it with me.
Thank you very much for guiding me in this direction.
Sulaymon Eshkabilov
Sulaymon Eshkabilov on 8 Nov 2021
Most Welcome! Good luck with your studies.

Sign in to comment.

More Answers (4)

Image Analyst
Image Analyst on 8 Nov 2021
I don't know what you tried already but have you tried the Regression Learner app on the apps tab? If you don't know how, I can show you if you upload your data - both the measurements/predictors, and the ground truth/true answer you're trying to predict with some model. I can try out many models and find the one with the least errors.
  2 Comments
sahar rezaei
sahar rezaei on 8 Nov 2021
Thank you very much for your help. I will definitely try your suggested method. I have used a combination of the Non-dominated Sorting Genetic Algorithm II (NSGA- ӀӀ) and the MLP Neural network, but this method works very slowly. I think a combination of optimization algorithms and a filter methods like mutual-information method or a combination of filter and wrapper methods can work well. Does anyone have access to a matlab code that can be used for regression?
Image Analyst
Image Analyst on 8 Nov 2021
Yes, almost all of us have regression code of some sort or another.
So. . . did the Regression Learner work for you?

Sign in to comment.


sahar rezaei
sahar rezaei on 14 Nov 2021
Hello
I apologize for the delay in responding. I have not tried the Regression Learner App yet but I have used methods such as correlation analysis, mutual-information and PCA. Filter methods are not very suitable for my work because these methods in the feature selection process only consider the relationship between the desired feature and the target and ignore the relationship between the selected features.I think that a combination of optimization algorithms with filter and wrapper methods or a combination of filter and wrapper methods bring more accuracy to the feature selection process. These methods have been mentioned in some authoritative articles. Thanks for guiding me on this.
Sincerely
  2 Comments
Image Analyst
Image Analyst on 14 Nov 2021
So, try it. If you don't know how, attach your data and I'll do it.

Sign in to comment.


David Willingham
David Willingham on 15 Nov 2021
Hi, if you're looking to perform feature engineering with machine learning models, have you tried automl? If not, check out this page for more information:
  1 Comment
sahar rezaei
sahar rezaei on 18 Nov 2021
Hi,
Thank you very much
The following page provides a feature selection method for classification problems. Can anyone guide me on how I can use this method for regression problems?
https://www.mathworks.com/matlabcentral/fileexchange/14608-mrmr-feature-selection-using-mutual-information-computation?s_tid=srchtitle

Sign in to comment.


sahar rezaei
sahar rezaei on 2 Dec 2021
Hello everyone
I got the answer to this question. The proposed method can be used for both classification and regression problems.

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!