Subject
Computer Science
Topic
Artificial Intelligence
In an autoregressive language model, how is a sequence generated?
In an autoregressive language model, how is a sequence generated?
a)
One token at a time conditioned on earlier tokensb)
All tokens independently with no contextc)
Only by nearest-neighbour votingd)
By minimax search over imagesExplanation
Autoregressive generation repeatedly predicts the next-token distribution from the preceding context.Related questions
A support bot must answer from a company’s current policy documents and cite them. Which design best reduces unsupported answers?A text generator should produce more varied outputs from the same prompt. Which decoding change usually helps?A generated medical answer sounds confident but has no supporting evidence. What is the safest response?What is the main role of self-attention in a transformer?A pretrained model is further trained on labelled examples for one task. What process is this?Untrusted retrieved text tells a support bot to ignore its system rules. What security problem is this?Why should generated citations be checked before publication?ChatGPT, released to the public in November 2022, was developed by ____.