Does setting BiasLearnRateFactor=0 prevent bias updates in a fullyConnectedLayer?
    4 views (last 30 days)
  
       Show older comments
    
actorNet = [
    featureInputLayer(prod(obsInfo.Dimension))
    fullyConnectedLayer(64, Bias=zeros(64,1), BiasLearnRateFactor=0)
    reluLayer
    fullyConnectedLayer(64, Bias=zeros(64,1), BiasLearnRateFactor=0)
    fullyConnectedLayer(prod(actInfo.Dimension))
    scalingLayer(Scale=5000, Bias=0)
    ];
actorOptions = rlOptimizerOptions( ...
    LearnRate=1e-4, ...
    GradientThreshold=1, ...
    L2RegularizationFactor=1e-4);
I constructed an actor network and set the optimizer options as shown above.
My question is:
If I set BiasLearnRateFactor=0 in the fullyConnectedLayer, does this mean that the bias will not be updated at all during training?
0 Comments
Answers (1)
See Also
Categories
				Find more on Matrix Computations in Help Center and File Exchange
			
	Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!
