P
I
XEL
BANK
v9.1.0
Learn
Practice
Research
Explore
About
Pricing
Paper Club
Sign In
Sign Up
P
I
XEL
BANK
v9.1.0
Menu
Learn
Practice
Research
Saved Items
Explore
About
Pricing
Paper Club
Sign In
Loading...
LLM 1: Foundations — all 15 problems
Tokenization, embeddings, attention mechanisms, and transformer components.
Attention Mechanisms
Scaled Dot-Product Attention
Easy
Causal Attention Mask
Medium
Multi-Head Attention
Medium
KV-Cache Attention
Hard
Embeddings & Positional Encoding
Token Embedding Lookup
Easy
Embedding Cosine Similarity
Easy
Sinusoidal Positional Encoding
Medium
Rotary Position Embedding
Hard
Tokenization Algorithms
BPE Merge Step
Easy
Character-Level Tokenizer
Easy
BPE Trainer
Medium
WordPiece Tokenizer
Medium
Transformer Components
Layer Normalization
Easy
Feed-Forward Network
Easy
Transformer Block Forward Pass
Hard
