Adam lr=1e-3, 60 steps: loss = 20.04 (still crawling, it moves 0.001 per step) Adam lr=0.1, 60 steps: loss = 0.0146 plain SGD lr=0.01, 30 steps: loss ≈ 0