Instruction Tuning Quiz

Quiz covering Fine-Tuning and Customization

Questions in this quiz

A preview of the 5 questions covered. Start the quiz above to answer them, check your score, and read the explanations.

1. 1

   What is the primary goal of instruction tuning in large language models?

2. 2

   When performing instruction tuning, what is the most significant risk associated with using a very small, biased dataset?

3. 3

   Which of the following describes the 'PEFT' (Parameter-Efficient Fine-Tuning) approach in the context of instruction tuning?

4. 4

   Why is it common practice to format instruction-tuning data using specific templates (e.g., '### Instruction:', '### Response:')?

5. 5

   If you are fine-tuning a model on a domain-specific dataset (e.g., legal documents) and notice the model starts performing well on legal tasks but loses its ability to summarize general text, what phenomenon are you observing?