This product was not featured by Product Hunt yet. It will not be visible on their landing page and won't be ranked (cannot win product of the day regardless of upvotes).
Umbra
OpenAI-compatible API for models nobody else hosts
Most useful open-weight models still don’t have a hosted API. You either rent a GPU, leave a Mac running overnight, or send prompts somewhere that can read them. Umbra is my experiment: an OpenAI-compatible endpoint (Anthropic-compatible too) where Apple Silicon owners host public Hugging Face GGUFs they approve. You swap base_url, keep your existing client, pay per token. Try it: https://tryumbra.dev Quickstart: https://tryumbra.dev/docs/quickstart Host a Mac: https://tryumbra.dev/setup
Hey Product Hunt — I’m Thomas. I built Umbra.
I kept hitting the same wall: a model I wanted only existed as a GGUF on Hugging Face. No API. Options were rent a GPU, self-host, or trust a random endpoint with my prompts.
So I built a boring interface for that. Swap base_url, mint a key, hit Macs that are code-attested. Privacy isn’t “we pinky-promise we don’t log.” The design is: decrypt in-process, don’t persist, fail closed if trust checks fail.
Honest alpha limits: two live models, HK-only cash-out for providers, no production SLA. I’m not pretending this is Together with a different logo.
I’ll be in the comments all day. If you try it, I’d rather hear:
does the API behave like a real OpenAI-compatible provider under stress?
is the trust story clear or hand-wavy?
which public GGUF should be next?
Quickstart: https://tryumbra.dev/docs/quicks...
the OpenAI and Anthropic compat layer is a nice touch, means i can swap base_url and actually use my existing client instead of writing a wrapper. love that you sidestepped the GPU rental trap
About Umbra on Product Hunt
“OpenAI-compatible API for models nobody else hosts”
Umbra was submitted on Product Hunt and earned 6 upvotes and 2 comments, placing #147 on the daily leaderboard. Most useful open-weight models still don’t have a hosted API. You either rent a GPU, leave a Mac running overnight, or send prompts somewhere that can read them. Umbra is my experiment: an OpenAI-compatible endpoint (Anthropic-compatible too) where Apple Silicon owners host public Hugging Face GGUFs they approve. You swap base_url, keep your existing client, pay per token. Try it: https://tryumbra.dev Quickstart: https://tryumbra.dev/docs/quickstart Host a Mac: https://tryumbra.dev/setup
Umbra was featured in API (98.4k followers), Developer Tools (515.9k followers) and Artificial Intelligence (473.7k followers) on Product Hunt. Together, these topics include over 194.1k products, making this a competitive space to launch in.
Who hunted Umbra?
Umbra was hunted by Thomas Suen. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
Want to see how Umbra stacked up against nearby launches in real time? Check out the live launch dashboard for upvote speed charts, proximity comparisons, and more analytics.
Thomas Suen