Flashcards

Machine Learning · Module 2

Question

What is a Transformer?

Review

  • Self-attention mechanism
  • Processes sequences in parallel (not sequentially)
  • Encoder-decoder architecture
  • Multi-head attention
  • Positional encoding
1 of 7