Q18 — AWS AIF-C01 Ch.1

Question 18 of 100 | ← Chapter 1

In generative AI models, what is a token?

• A. A token is the fundamental unit of input and output that generative AI models operate on, representing words, subwords, or other linguistic units. ✓
• B. A pronoun is the mathematical representation of words or concepts used in generative AI models.
• C. A token is the pre-trained weight of a generative AI model fine-tuned for a specific task.
• D. A token is a specific prompt or instruction used by a generative AI model to generate output.

Correct Answer: A. A token is the fundamental unit of input and output that generative AI models operate on, representing words, subwords, or other linguistic units.

Explanation

This question tests understanding of the concept of 'token' in generative AI models. In this domain, a token is a foundational element. Option A correctly defines a token as the basic unit of input and output—representing words, subwords, or other linguistic units—on which generative AI models operate. Option B incorrectly refers to 'pronouns', which is unrelated. Options C and D mischaracterize tokens as weights or prompts, respectively. Thus, option A is correct.