🧀 BigCheese.ai

Social

Show HN: We've open-sourced our LLM attention visualization library

🧀

Inspectus is a visual tool for large language models, smooth in Jupyter Notebooks, and easy to install via pip. It offers diverse views into language model behaviors with features like Attention Matrix and Heatmaps for query tokens, key tokens, and dimensions.

  • Easy to use with Jupyter notebooks
  • Attention Matrix for token focus visualization
  • Supports sum visualizations in heatmaps
  • MIT licensed
  • Has tutorials for custom and huggingface models