RL Water Tank example by MATLAB does not converge

11 views (last 30 days)
Alp
Alp about 9 hours ago
Edited: Alp about 6 hours ago
I am following the RL water tank control tutorial by MATLAB: https://www.mathworks.com/help/reinforcement-learning/ug/control-water-level-using-ddpg-agent.html (MATLAB R2025b)
However, even the model is learning at the beginning, towards the end of the training, Q0 value explodes and the reward drops from almost maximum to below zero. I need to obtain stable and good results with the official DDPG water tank control to use it as a baseline in my research, and hence, I prefer not to modify hyperparameters of the network, the reward function and the stopping criteria.
Is anyone able to reproduce good results using the given RL water tank example? Or is it okay if it is not stable in its default configuration?=
Here are my results:
And this is the start of the training, before Q value explodes:
Thank you.

Answers (0)

Products


Release

R2025b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!