Signal #92934NEUTRAL

Show HN: Smile-Serve – Inference Server for ML, ONNX, and LLM

100

SMILE Serve is a production-ready inference server built on [Quarkus](https://quarkus.io/) that brings together three complementary inference capabilities on the JVM: - **Classic ML**: `/api/v1/models` for serialized SMILE models (`.sml`) - **ONNX Runtime**: `/api/v1/onnx` for any model in the ONNX open format (`.onnx`) - **LLM Chat**: `/api/v1/chat` for Llama 3 chat completions A React-based web UI is bundled and served from the same process. Comments URL: https://news.ycombinator.com/item?id=48015597 Points: 1 # Comments: 0

HackerNews Show AIabout 4 hours ago
Read Full Article

Explore with AI-Powered Tools

View All Signals

Explore more AI intelligence

Want to discover more AI signals like this?

Explore Steek
Show HN: Smile-Serve – Inference Server for ML, ONNX, and LLM | Steek AI Signal | Steek