Meta's new BLT architecture replaces tokens to make LLMs more efficient and versatile

Byte latent transformer (BLT) uses a special architecture to learn directly from raw bytes as opposed to tokenized chunks of text.