Solve two classic grid worlds with tabular Q-learning. Inspect FrozenLake's spaces and transition table, measure a random-policy baseline, implement Q-learning with a decaying epsilon-greedy schedule, and watch the success rate climb. Visualize the learned policy as arrows over a value-function heatmap, evaluate the greedy policy on the slippery lake, then reuse the exact same agent on Taxi-v4. No downloads, runs in about a minute.
Environment Setup
Exploring the Environment
Q-Learning
Evaluation & Transfer
Premium Project
This guided, GPU-powered project is available to Premium members. Upgrade to train models end-to-end in an interactive notebook.