Next Concept Modeling: Generating Text from Coarse to Fine
Published:
Most language models generate text autoregressively: one token after another. Each new token depends on the tokens already generated. This is effective, but it imposes a sequential dependency even on hardware capable of substantial parallel computation.
