Dashboard
Signal #173291NEUTRAL

Show HN: A local alternative to Jev – 94% on Banking77

80

I’ve been experimenting with a local approach to some of the classification tasks people are using Jev for. This approach uses text embeddings + logistic regressionOn Banking77, which contains 77 categories of banking support questions, I get 94.25% using bge-large-en-v1.5 for embeddings, and 93.28% with all-MiniLM-L6-v2 (only the classifier gets trained, the embeddings model stays unchanged). For comparison: Model Accuracy Size/training time - IntenDD (SOTA): 94.86% (~350M params, hours on GPU) - This script: 94.25% (642 KB classifier, 3s on CPU) - ModernBERT fine-tuned: 93.99% (149M params, minutes on GPU) - BERT fine-tuned: 92.76% (110M params, minutes on GPU) - Jev (zero-shot): 87.0% (closed API) - Laya (zero-shot): 42.5% (421M params) MiniLM’s encoder is roughly 91 MB in FP32, BGE is about 1.2 GB, the classifier and scaler are only 642 KBThe linked gist evaluates all 3,080 official test examples. Running python banking77_gist.py uses MiniLM by default, and you can choose the large...

HackerNews AI Launchesabout 3 hours ago
Read Full Article

Explore with AI-Powered Tools

View All Signals

Explore more AI intelligence

Want to discover more AI signals like this?

Explore Steek
Show HN: A local alternative to Jev – 94% on Banking77 | Steek AI Signal | Steek