Dashboard
Signal #143575POSITIVE

Show HN: I built a hypervisor and client for inference on consumer compute

100

I'm the founder of Scalattice, this is my second company, third total product. I'm a 2x founder building some challenging software, some easy software, and some curiosity based tools that I've just always wanted to be a part of!So here is Scalattice.Scalattice is an OpenAI-compatible inference API. You keep the OpenAI SDK, swap base_url + API key, and call open models (Qwen3, Llama 3.3 70B, Gemma 3, DeepSeek R1, etc.). Inference is performed by a provider node on our distributed network of consumer hosted inference machines, we run an open source agent (https://github.com/scalattice/scalattice-agent) which works in Rust to run the inference and get the provider paid.In short, anyone can become a provider, offer up their machine with our Windows/Linux Rust agent, and earn some extra cash, or start a farm of machines to make big bucks.I decided to build some innovative behavioural traits to the API for higher performance/security: 1. output vetting - Scalattice Cloud vets the response ag...

HackerNews AI Launchesabout 4 hours ago
Read Full Article

Explore with AI-Powered Tools

View All Signals

Explore more AI intelligence

Want to discover more AI signals like this?

Explore Steek
Show HN: I built a hypervisor and client for inference on consumer compute | Steek AI Signal | Steek