Transformers Architecture Quiz

Quiz covering Deep Learning Basics

Questions in this quiz

A preview of the 5 questions covered. Start the quiz above to answer them, check your score, and read the explanations.

1. 1

   What is the primary purpose of the 'Self-Attention' mechanism in a Transformer model?

2. 2

   In the original Transformer architecture, why are 'Positional Encodings' added to the input embeddings?

3. 3

   Which component of the Transformer architecture is specifically responsible for mapping the output of the attention layers to a higher-dimensional space and then back to the original dimension?

4. 4

   What is the role of 'Multi-Head Attention' in a Transformer?

5. 5

   In a Transformer decoder, why is 'Masked Multi-Head Attention' used during training?