Laminar

Open-source all-in-one platform for engineering AI products

Productivity

Developer Tools

Artificial Intelligence

GitHub

Hey there 👋, I’m Robert, co-founder and CEO of Laminar (YC S24) -> https://www.ycombinator.com/comp... Good AI engineering is all about data and it boils down to three things – collect data, analyze data, use data. Laminar enables teams to do all of that in a single platform. > Unbelievable alpha in looking at data ©️ Hamel Husain (https://x.com/HamelHusain/status...) Collect data – Tracing - Trace every execution step of your LLM application by adding just 2 lines of code. - Laminar automatically traces common LLM SDKs (OpenAI, Anthropic …), and popular LLM frameworks (Langchain …) - We support images, and soon audio! Analyze data – Labeling - Laminar provides tools for your team to efficiently label the data and analyze human labels distribution. - Use this labeled data to better align LLM-as-a-judge with your app requirements. - Use labels as filters to separate “good” and “bad” data. Use data – Evaluations and Datasets - Run custom evaluations locally, from terminal, code, or as part of CI/CD. Visualize and compare results in Laminar UI. - Run hosted online evaluators (LLM-as-a-judge or Python scripts) as production traces come in. - Store golden datasets in Laminar and run evaluations on them. - Collect “good” examples in datasets and then retrieve most relevant ones via API to use as few-shot examples in your prompts. Laminar is fully open-source, built for scale, and production-ready. You can easily self-host it or use our managed version for production. Laminar is extremely fast, reliable, and built on top of a modern stack. Our frontend is in Next.js, backend is written in Rust🦀, trace ingestion is done over gRPC, messages are sent across services through RabbitMQ and analytics is managed by ClickHouse. Join the ranks of our contributors and star ⭐ our repo here → https://github.com/lmnr-ai/lmnr (we have lots of exciting things to do!) Get started with a managed version today → https://www.lmnr.ai (use our ProductHunt discount to get 3 months free of pro version).