Answered
reinforcement learning agent simulation is not same with training agent
Hello, Please see this post that explains why simulation results may differ during training and after training. One thing to c...

2 months ago | 0

Answered
Epsilon-greedy Algorithm in RL DQN
Hello, First off, RL typically solves a complex nonlinear optimization problem. So at the end of the day, you will most certain...

2 months ago | 1

| accepted

Answered
reinforcement learning, 3D simulink model
There is nothing specific you need to do for a 3d Simulink model. You can follow any other Simulink example from Reinforcement L...

2 months ago | 0

Answered
How to use GA in Reinforcement Learning instead of Gradient descent?
Hello, Evolutionary RL is not provided out of the box as of now. To use it you would have to implement a custom training loop (...

2 months ago | 0

| accepted

Answered
Error using rl.env.SimulinkEnvWithAgent>localHandleSimoutErrors (line 689) (By RL toolbox)
Hello, Based on the attached files, it seems like you are creating a PPO agent but you are creating a Q network for a critic. I...

2 months ago | 0

Answered
Custom RL environment creation
Hello, Based on the updated files you sent on this post, you are setting this.IsDone, however this is a class variable which is...

2 months ago | 0

| accepted

Answered
Confusion in Critic network architecture design in DDPG
Hello, Does this paper use DDPG as well? Any images that show the network architecture? If it's another algorithm, the critic m...

2 months ago | 0

| accepted

Answered
Deep reinforcement learning for multi-agents
Hello, The policies you will get from RL training change depending on the amount of time the agents spend exploring. Usually, i...

2 months ago | 1

| accepted

Answered
How to implement multi-agent RL training with custom MATLAB environment function?
Hello, Currently multi-agent training is only supported in Simulink. If you have an environment created in MATLAB you could cop...

2 months ago | 1

| accepted

Answered
Reinforcement learning DDPG action fluctuations
Hello, During training, DDPG explores the action space by adding noise to the output of the actor (see step 1 here). That expla...

2 months ago | 0

| accepted

Answered
Import patternnet into deep Q network
Hello, By 'patternnet' are you referring to this function? If yes, then this does not use the deep learning layer objects that ...

2 months ago | 0

| accepted

Answered
how to change the reward parameter in RL toolbox every time step?
One way is to implement your logic in your reward subsystem using a MATLAB Fcn block. Execute the MATLAB Fcn block every Ts time...

2 months ago | 0

| accepted

Answered
Training a neural network in a real world system (inverted pendulum)
Hello, I am not sure why you get zero values consistently, but since you say this works when you don't have the agent block in ...

2 months ago | 0

| accepted

Answered
Invalid input argument type or size such as observation, reward, isdone or loggedSignals. (Reinforcement learning toolbox)
Hello, It's challenging to reproduce this without having access to a reproduction model (including the environment definition)....

2 months ago | 0

| accepted

Answered
Reinforcement learning actions using DDPG
Hi Jason, In the documentation link you provided it's mentioned "Variance*sqrt(Ts) be between 1% and 10% of your action range"....

3 months ago | 0

| accepted

Answered
DDPG Not getting any reward? Using the example from MathWorks
Hi Jun, The IsDone input to the agent block is always true, so all episodes end prematurely. This is why you don't see any chan...

3 months ago | 0

Answered
Timestep problems using Reinforcement Learning with EnergyPlus
Hello, I am not familiar with EnergyPlus so I am not sure about the error you are getting (although it seems like you are tryin...

3 months ago | 0

Answered
The reward is reduced after certain episode on the DQN
Hello, There is no guarantee that the reward will keep going up always when using RL (after all there is certain stochastisity ...

3 months ago | 0

Answered
Error on Specifying observation using rlFiniteSetSpec(Reinforcement Learning)
Hello, The way you called rlFiniteSetSpec basically says that you have two observations and that they are both equal to 1. The ...

3 months ago | 1

| accepted

Answered
How to log/record signal data from a reinforcement learning (RL) agent/environment over multiple training episodes using Simulink?
If you call 'train' with an output argument, you will get many useful statistics from training (see here). Would this work?

3 months ago | 1

| accepted

Answered
How to make simulink function block interact with RL Agents by updating states and other environment parameters?
I think you can just read the workspace params if you set an additional variable as a parameter in the MATLAB Fcn block. In the ...

3 months ago | 0

Answered
invalid input argument during training of custom rl-environment
It seems this is a problem with how you step function populates the states and outputs, or maybe you need to transpose somewhere...

3 months ago | 0

Answered
What is the best activation function to get action between 0 and 1 in DDPG network?
Hello, With DDPG, a common thing to do in the final 3 layers of the actor is to use a fully connected layer, a tanh layer and a...

3 months ago | 0

| accepted

Answered
Expected reward blows up while training (DDPG agent, reinforcement learning)
Hello, This answer may be helpful. I would make sure your reward signal outputs values that make sense, and also possibly simp...

4 months ago | 0

Answered
parts of Walking Robots from Sebastian Castro
Hello, Is the video you are looking for listed here perhaps?

4 months ago | 0

Answered
Dynamically change a block input during Deep Reinforcement Learning after each episode. How To?
Hello, Please have a look at this example, and in particular the 'localResetFcn' at the bottom ('setBlockParameter'in the reset...

4 months ago | 0

Answered
Use saved reinforcement learning DDPG agent
Hello, Please see my response here. In short, the behavior you see during training and after training are not expexted to match...

4 months ago | 0

Answered
warning in reinforcement training
Seems the reset function has not been defined properly. Have a look at this example for some ideas.

4 months ago | 0

| accepted

Answered
Is it practicable to train multiple agents simutaneously using RL Toolbox´╝č
As of R2020b release, Reinforcement Learning Toolbox lets you train multiple agents simultaneously in Simulink. Please see follo...

4 months ago | 0

Answered
Reinforcement learning toolbox multiple agents training
As of R2020b release, Reinforcement Learning Toolbox lets you train multiple agents simultaneously in Simulink. Please see follo...

4 months ago | 4

Load more