This product was not featured by Product Hunt yet. It will not be visible on their landing page and won't be ranked (cannot win product of the day regardless of upvotes).
LLMSlim
Semantic prompt compression that never drops instructions.
Open-source Python package cutting LLM token costs by 40–70% in 1 line of code. Surgically compresses prompts, RAG document contexts, and multi-turn chat logs with guaranteed 100% instruction fidelity.
Hey Product Hunt! I'm Yash, a CS/AI undergrad currently doing an AI research internship, and LLMSlim is something I built because I kept hitting the same problem in my own RAG pipelines: most of what I was sending to the API was filler.
LLMSlim runs a deterministic, offline pipeline, no LLM calls, no telemetry, that scores every sentence on centrality, entity density, and instruction presence, then hard-locks anything matching an imperative ("must," "never"), a role marker, or a code fence before it's ever eligible to be cut. Everything else gets ranked and trimmed to hit your target ratio.
It's early v0.2.0, MIT-licensed, 93%+ test coverage, and the benchmarks on the site are the actual numbers from the CI-gated benchmark suite in the repo, not rounded up. Latency ranges from ~24ms on short prompts to ~340ms on 12K-token documents, I'd rather you see the real range than a single best-case number.
What's next: streaming compression (compress_stream), native ONNX embeddings for sub-5ms scoring, and async batch helpers, all tracked on the roadmap in the repo.
I'd genuinely like feedback on where the compression gets it wrong. If you paste a prompt into the playground and it drops something it shouldn't have, that's exactly the kind of report that makes v0.3.0 better. Thanks for taking a look.
honestly i'm pretty impressed with how simple it was to drop in, basically one line and my prompts got way more compact without breaking anything. the fact that it holds onto the actual instructions matters a lot for my stuff.
About LLMSlim on Product Hunt
“Semantic prompt compression that never drops instructions.”
LLMSlim was submitted on Product Hunt and earned 0 upvotes and 2 comments, placing #7 on the daily leaderboard. Open-source Python package cutting LLM token costs by 40–70% in 1 line of code. Surgically compresses prompts, RAG document contexts, and multi-turn chat logs with guaranteed 100% instruction fidelity.
LLMSlim was featured in Open Source (68.6k followers), Developer Tools (515.9k followers), Artificial Intelligence (473.7k followers), GitHub (41.3k followers) and Vercel Day (26 followers) on Product Hunt. Together, these topics include over 223.3k products, making this a competitive space to launch in.
Who hunted LLMSlim?
LLMSlim was hunted by Yashvardhan Thanvi. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
Want to see how LLMSlim stacked up against nearby launches in real time? Check out the live launch dashboard for upvote speed charts, proximity comparisons, and more analytics.
Yashvardhan Thanvi