Circuit Complexity of Hierarchical Knowledge Tracing and Implications for Log-Precision Transformers

This research paper investigates the circuit complexity of hierarchical knowledge tracing, revealing why log-precision transformers struggle with deep concep...

Level: expert

By Naiming Liu, Richard Baraniuk, Shashank Sonkar

Category: research