Real-Time Introspective Compression for Transformers By Jeffrey Emanuel (and various collaborators of the electronic persuasion) Written on April 1st, 2025 Introduction: Two Intertwined Problems Transformer-based large language models (LLMs) face two significant limitations that restrict their capabilities: Lack of Introspection: Unless specifically instrumented, transformer-based LLMs have no ability to explicitly access their own internal states—the activations in their feed-forward layers, at...