Control Design Automation

Answered

Deep Deterministic Policy Gradient Agents (DDPG at Reinforcement Learning), actor output is oscilating a few times then got stuck on the minimum.

A few points I have identified with your original script You should include the action bounds when defining action specificatio...

Deep Deterministic Policy Gradient Agents (DDPG at Reinforcement Learning), actor output is oscilating a few times then got stuck on the minimum.

A few points I have identified with your original script You should include the action bounds when defining action specificatio...

2 months ago | 0

| accepted

Answered

Create custom policy function for a RL DQN.

Currently there I do not see any workaround to modify DQN policy directly with buit-in rlDQNAgent. A possible workaround is to r...

Create custom policy function for a RL DQN.

Currently there I do not see any workaround to modify DQN policy directly with buit-in rlDQNAgent. A possible workaround is to r...

2 months ago | 0

Answered

how to use GPU for actor and critic while env simulation happens on multiple cores for RL training

We are continuously improving GPU training performance with parallel computing in future releases. For now, I would recommend th...

how to use GPU for actor and critic while env simulation happens on multiple cores for RL training

We are continuously improving GPU training performance with parallel computing in future releases. For now, I would recommend th...

2 months ago | 0

Answered

rlTable using multiple element in rlFiniteSetSpec

This is a current limitation with rlTable in MATLAB R2020a. To work with multiple observation channels, you can try a neural net...

rlTable using multiple element in rlFiniteSetSpec

This is a current limitation with rlTable in MATLAB R2020a. To work with multiple observation channels, you can try a neural net...

2 months ago | 0

Answered

How can I extract a trained RL Agent's network's weights and biases?

You can get the parameters from the trained's critic representation for DQN agent. In MATLAB R2020a, see getLearnableParameters ...

How can I extract a trained RL Agent's network's weights and biases?

You can get the parameters from the trained's critic representation for DQN agent. In MATLAB R2020a, see getLearnableParameters ...

2 months ago | 0

| accepted

Answered

How to deploy Trained Reinforcement Learning Policy with a NN having two input layer?

As of R2020a, you can create a DQN agent with Q(s) value function. Q(s) takes observation as input and output Q(s,a) for each po...

How to deploy Trained Reinforcement Learning Policy with a NN having two input layer?

As of R2020a, you can create a DQN agent with Q(s) value function. Q(s) takes observation as input and output Q(s,a) for each po...

3 months ago | 0

| accepted

Answered

load multiple trained reinforcement agents into MATLAB workspace

It is not neccessary to load all 2000 agents into MATLAB (consume memory and tricky to assign unique name) to evaluate their per...

load multiple trained reinforcement agents into MATLAB workspace

It is not neccessary to load all 2000 agents into MATLAB (consume memory and tricky to assign unique name) to evaluate their per...

3 months ago | 0

| accepted

Answered

number of look ahead steps in DDPG Agent Options

I am not sure what does reward sampling mean. "NumStepsToLookAhead" in rlDDPGAgentOptions changes the critic's target values in ...

number of look ahead steps in DDPG Agent Options

I am not sure what does reward sampling mean. "NumStepsToLookAhead" in rlDDPGAgentOptions changes the critic's target values in ...

3 months ago | 1

Answered

how can I display the trained network weights in reinforcement learning agent?

Hi Ru SeokHun, In MATLAB R2019b and below, there is a 2-step process: Use getActor, getCriitic functions to gather the actor a...

how can I display the trained network weights in reinforcement learning agent?

Hi Ru SeokHun, In MATLAB R2019b and below, there is a 2-step process: Use getActor, getCriitic functions to gather the actor a...

3 months ago | 0

Answered

How to TRAIN further a previously trained agent?

I will answer again, hopefully clear your confusion. % Train the agent trainingStats = train(agent, env, trainOpts); After th...

How to TRAIN further a previously trained agent?

I will answer again, hopefully clear your confusion. % Train the agent trainingStats = train(agent, env, trainOpts); After th...

3 months ago | 0

Answered

Clean up Simulink block diagram

From MATLAB R2019b, you can improve your diagram layout and appearance by opening the FORMAT tab on the toolstrip and click on A...

Clean up Simulink block diagram

From MATLAB R2019b, you can improve your diagram layout and appearance by opening the FORMAT tab on the toolstrip and click on A...

4 months ago | 0

Answered

Implementing A Siamese Architecture With Matlab

You can refer to the answer in this thread https://www.mathworks.com/matlabcentral/answers/399825-how-to-construct-a-siamese-ne...

Implementing A Siamese Architecture With Matlab

You can refer to the answer in this thread https://www.mathworks.com/matlabcentral/answers/399825-how-to-construct-a-siamese-ne...

8 months ago | 0

| accepted

Answered

How to construct a Siamese network using Matlab Neural Network Toolbox?

You can refer to these new examples to construct Siamese network: https://www.mathworks.com/help/deeplearning/examples/train-a-...

How to construct a Siamese network using Matlab Neural Network Toolbox?

You can refer to these new examples to construct Siamese network: https://www.mathworks.com/help/deeplearning/examples/train-a-...

8 months ago | 0

Answered

Is there a way to set specific regions on an image for OCR?

You can specify region of interest, <https://www.mathworks.com/help/vision/ref/ocr.html#bt548t1-1-roi ROI>, as the second argume...

Is there a way to set specific regions on an image for OCR?

You can specify region of interest, <https://www.mathworks.com/help/vision/ref/ocr.html#bt548t1-1-roi ROI>, as the second argume...

2 years ago | 0

| accepted

Answered

I want to adapt Fuzzy Logic Toolbox to be able to use the output of one system as the input of another

The current version of Fuzzy Logic Toolbox does not support internal looping of input and output variables. The simplest soluti...

I want to adapt Fuzzy Logic Toolbox to be able to use the output of one system as the input of another

The current version of Fuzzy Logic Toolbox does not support internal looping of input and output variables. The simplest soluti...

2 years ago | 0

Answered

How to provide Negative Samples to trainACFObjectDetector() when using a Ground Truth file

(3) is correct. You do not have to add negative samples because trainACFObjectDetector automatically generates negative samples ...

How to provide Negative Samples to trainACFObjectDetector() when using a Ground Truth file

(3) is correct. You do not have to add negative samples because trainACFObjectDetector automatically generates negative samples ...

2 years ago | 0

| accepted

Answered

The battery models in simscape are to complex. Is there a simple one?

You may want to try <https://www.mathworks.com/help/physmod/elec/ref/battery.html Simple battery model> block. You can right-cli...

The battery models in simscape are to complex. Is there a simple one?

You may want to try <https://www.mathworks.com/help/physmod/elec/ref/battery.html Simple battery model> block. You can right-cli...

2 years ago | 0

Answered

How do i calculate the winding R & L as well as magnetizing Rm & Lm of the linear transformer block?

You do not need to calculate these values but rather set them based on your application specification. All the parameters are de...

How do i calculate the winding R & L as well as magnetizing Rm & Lm of the linear transformer block?

You do not need to calculate these values but rather set them based on your application specification. All the parameters are de...

2 years ago | 0

| accepted

Answered

Train data for Semantic segmentation using existing Nets (e,g.Segnet) for different classes

The <https://www.mathworks.com/help/vision/examples/semantic-segmentation-using-deep-learning.html example> starts with training...

Train data for Semantic segmentation using existing Nets (e,g.Segnet) for different classes

The <https://www.mathworks.com/help/vision/examples/semantic-segmentation-using-deep-learning.html example> starts with training...

2 years ago | 0

Answered

filtfilt provides excessive transient

The transients observed are due to a combination of using a marginally stable filter coupled with the initial condition matching...

filtfilt provides excessive transient

The transients observed are due to a combination of using a marginally stable filter coupled with the initial condition matching...

2 years ago | 2

Answered

How to count the number of objects within an area after simulink simulation ends

Yes, of course. After looking at <https://www.mathworks.com/help/simulink/examples/spiral-galaxy-formation-simulation-using-matl...

How to count the number of objects within an area after simulink simulation ends

Yes, of course. After looking at <https://www.mathworks.com/help/simulink/examples/spiral-galaxy-formation-simulation-using-matl...

2 years ago | 1

| accepted

Answered

HDL coder for Kalman filter does not simulate

Hi Reddy, Are you referring to this <https://www.mathworks.com/help/hdlcoder/examples/fixed-point-type-conversion-and-refinem...

HDL coder for Kalman filter does not simulate

Hi Reddy, Are you referring to this <https://www.mathworks.com/help/hdlcoder/examples/fixed-point-type-conversion-and-refinem...

2 years ago | 0

Answered

How to insert a curve stemming from a measure in Simulink to use the parameter estimation?

Hi Frank, It seems that you are trying to input a vector into Simulink scope block. Simulink will treat each element of your ...

How to insert a curve stemming from a measure in Simulink to use the parameter estimation?

Hi Frank, It seems that you are trying to input a vector into Simulink scope block. Simulink will treat each element of your ...

2 years ago | 0

| accepted

Answered

Is it possible to toggle visibility of signals in (floating) scope during simulation?

I was not able to find information on how to toggle which input signals are shown on the scope programmatically. I will create a...

Is it possible to toggle visibility of signals in (floating) scope during simulation?

I was not able to find information on how to toggle which input signals are shown on the scope programmatically. I will create a...

2 years ago | 0

Answered

Is it possible to toggle visibility of signals in (floating) scope during simulation?

I tried a simple test to check if setting scope configuration in runtime is possible or not: 1. Open shipped demo 'vdp' >> v...

Is it possible to toggle visibility of signals in (floating) scope during simulation?

I tried a simple test to check if setting scope configuration in runtime is possible or not: 1. Open shipped demo 'vdp' >> v...

2 years ago | 0

Answered

having trouble with the drag on my rocket projectile

Hi Fiona, You should not expect the MATLAB Answers community to give you an answer to your homework assignment. You may w...

having trouble with the drag on my rocket projectile

Hi Fiona, You should not expect the MATLAB Answers community to give you an answer to your homework assignment. You may w...

2 years ago | 0

Answered

How to set which variable to update in an iterative loop?

HI Valerio, My understanding is you just want to find a value of 'a_D1(z)' that makes 'c_x_av_D1' and 'c_x_av1_D1' have equal...

How to set which variable to update in an iterative loop?

HI Valerio, My understanding is you just want to find a value of 'a_D1(z)' that makes 'c_x_av_D1' and 'c_x_av1_D1' have equal...

2 years ago | 0

Answered

Error: cannot find space for target scope (R2016b)

Hi Stefano, The maximum number of target scope is 9, as stated in the <https://www.mathworks.com/help/xpc/ug/target-scope-res...

Error: cannot find space for target scope (R2016b)

Hi Stefano, The maximum number of target scope is 9, as stated in the <https://www.mathworks.com/help/xpc/ug/target-scope-res...

2 years ago | 1

| accepted

Answered

How does the intlinprog algorithm deals with unused variables in your x vector?

Hi Peter, Can you elaborate on what is your "x-vector" (is it the coefficient vector 'f', the vector of integer constraints 'in...

How does the intlinprog algorithm deals with unused variables in your x vector?

Hi Peter, Can you elaborate on what is your "x-vector" (is it the coefficient vector 'f', the vector of integer constraints 'in...

2 years ago | 0

Answered

Write a function called spiral_diag_sum that takes an odd positive integer n as an input and computes the sum of all the elements in the two diagonals of the n-by-n spiral matrix.

There are many ways to solve this coding problem. The most common way is to divide the spiral matrix into layers, find a pattern...

Write a function called spiral_diag_sum that takes an odd positive integer n as an input and computes the sum of all the elements in the two diagonals of the n-by-n spiral matrix.

There are many ways to solve this coding problem. The most common way is to divide the spiral matrix into layers, find a pattern...

2 years ago | 1

| accepted