what is the value for L2 regularization coeff, by default,while training?

14 views (last 30 days)
while trainig a deep learning network in MATLAB, what is the trainingOptions for setting L2 regularization coeff.?
Like if adam optimizer is used how to set this parameter?
more clearly like in optim.Adam in pytorch , weight_decay option is given.how to set it here in MATLAB?

Answers (1)

Adam Danz
Adam Danz on 21 Oct 2020
I think you're looking for the L2Regularization Solver Option.
Adam Danz
Adam Danz on 22 Oct 2020
Edited: Adam Danz on 27 Oct 2020
If it were me, I'd step through the process in debug mode to study and compare the two methods. Perhaps there's more detail in Matalb's (and PyTorch's) documentation that would shed light on the differences.
Maybe the difference is caused by a small difference in one of the optional parameters, as you mentioned.

Sign in to comment.


Find more on Deep Learning Toolbox in Help Center and File Exchange

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!