fill

Efficient training of language models to fill in the center

We show that autoregressive language models can learn to infill text after we apply a simple transformation to the dataset, which simply moves a span of text from the center of a document to...

Recent posts

Popular categories

ASK ANA