transformers

2 articles · All tags

• The Transformer Architecture
  The attention-based architecture behind modern language models: self-attention, positional encoding, and why it replaced recurrence.
• Large Language Models
  Models trained on enormous text corpora that generate and understand language: how they work, what they can and cannot do.