🧀 BigCheese.ai

Social

Show HN: Opik, an open source LLM evaluation framework

🧀

Opik, an open-source end-to-end Large Language Model (LLM) Development Platform by Comet, designed for evaluating, testing and monitoring LLM applications is available on GitHub. It includes features such as tracking all LLM calls and traces, annotations, dataset management and experiments, multiple integration options, and more.

  • Has an Apache-2.0 license
  • Offers integrations like OpenAI, LangChain
  • Available on GitHub with 602 stars
  • Latest release 0.1.14 on Sep 17, 2024
  • Written in Java, Python, TypeScript