GitHub - labmlai/inspectus: LLM Analytics
Inspectus
Inspectus is a versatile visualization tool for large language models.
It runs smoothly in Jupyter notebooks via an easy-to-use Python API. Inspectus provides multiple views, offering diverse insights into language model behaviors.
Preview
Click a token to select it and deselect others. Clicking again will select all again.
To change the state of only one token, do shift+click
Components
Attention Matrix:
Visualizes the attention scores between tokens, highlighting how each token focus...
Read more at github.com