ML Debugging Skill
When debugging an ML issue, work through these checks in order. Stop at the first check that reveals the problem.
1. Shape Verification
Trace tensor shapes through the computation:
- Print shapes at every function boundary:
print(f"input: {x.shape}, output: {y.shape}") - Verify batch dimension is preserved through all operations
- Check that reshape/view operations don't silently permute data
- Verify attention mask shapes match query/key dimensions
2. Dtype and
[Description truncada. Veja o README completo no GitHub.]