Is it possible to make 2 stream CNN by using Matlab?

Is it possible to make 2 stream CNN by using Matlab? Like this papers.

http://dl.acm.org/citation.cfm?id=2749406

I am thinking of The first network is

layers1 = [imageInputLayer([60 60 1],'Name','radar');
          convolution2dLayer(5,20);
          reluLayer;
          maxPooling2dLayer(2,'Stride',2);
          fullyConnectedLayer(1);
          regressionLayer];

The second network is

layers2 = [imageInputLayer([120 120 1]);
           convolution2dLayer(5,20);
           reluLayer;
           maxPooling2dLayer(2,'Stride',2);
           convolution2dLayer(5,20);
           reluLayer;
           maxPooling2dLayer(2,'Stride',2);
           fullyConnectedLayer(1);
           regressionLayer];

The I wanna fusion these streams by using fullyConnectedLayer ( input : result of each streams ) and regressionLayer

Answer 1

[Kenta]

As of 2019b, a new system called "custom training loop" which enables you to implement multi-input CNN is available.

For example, you can refer to the example below.

Hope it will help you and potential users who would like to do the similar task.

https://jp.mathworks.com/matlabcentral/fileexchange/74760-image-classification-using-cnn-with-multi-input

https://jp.mathworks.com/matlabcentral/answers/503820-dag　(written in Japanese)

2019b以降ではカスタムループとよばれる新たな枠組みが利用可能となり、複数入力のCNNも実装可能です。

また、カスタムループ以外にも方法があります。上のリンクをご参照ください。

[Rd]

Dear Kenta,

Can you able to explain it in english? Hope you can.

Thanks,

Ramasenthil