Dancing Tokens on the Vocabulary Network from LLM Generation
Summary
Starting from the geometry of the vocabulary network, the study explains how a specific LLM output, generated word by word, connects back to pre-training.
Why this matters
Covers model and LLM · Relevant to this topic
Source: arXiv cs.AI · arxiv.org