How to create Seq2Seq Attention regression model with Matlab?

How can I create a Seq2Seq regression model with multi-head attention? Thanks in advance!

Answer 1

[Ranjeet]

Hi Shan,

You may refer to the following example presenting sequence to sequence regression using attention mechanism –

Sequence-to-Sequence Translation using Attention

Have a look at the parameter ‘numHeads’ in the example for multi-head attention.