Pre-Training Quiz

Quiz covering GenAI Model Lifecycle

Questions in this quiz

A preview of the 5 questions covered. Start the quiz above to answer them, check your score, and read the explanations.

1. 1

   What is the primary goal of the pre-training phase in a Large Language Model's lifecycle?

2. 2

   During the pre-training process, what is the most common objective used to train Transformer-based models?

3. 3

   Which of the following best describes the data requirements for pre-training a foundation model?

4. 4

   Why is 'data deduplication' a critical step during the pre-training data preparation phase?

5. 5

   When pre-training a model on a distributed cluster, which factor is most likely to cause a 'bottleneck' that limits the scaling of training throughput?