Context Windows Quiz

Quiz covering Foundation Model Design

Questions in this quiz

A preview of the 5 questions covered. Start the quiz above to answer them, check your score, and read the explanations.

1. 1

   What is the primary definition of a 'context window' in the context of Large Language Models?

2. 2

   If a user provides an input prompt that exceeds the model's defined context window, what is the most common behavior of a standard Transformer-based model?

3. 3

   When building an application that requires referencing a massive legal document (e.g., 500 pages), which strategy is most effective if the document exceeds the context window?

4. 4

   Why does doubling the context window in a Transformer model often lead to a non-linear increase in computational cost?

5. 5

   In the context of 'Lost in the Middle' phenomena, what does this concept imply for long-context model performance?