GLiNER2.5-Decide: a 340M decision model that runs on your CPU

Skip the LLM call for routing and guardrails. Plus the 119x price gap that makes routing beat model choice — and China prices tokens as damages.

Nowline SEP 28 7:00 PM banner

Top AI stories from the last hour

Top AI stories from the last hour

Copy markdown

  • A CPU classifier that can replace your routing LLM

    Fastino's GLiNER2.5-Decide (340M, Apache 2.0) takes text plus a schema of typed questions and returns structured answers with confidence scores — for routing, triage, tool selection and guardrails, with no token generation. It runs in ~167ms on a CPU (40ms on a V100), even air-gapped, and its joint decoding enforces constraints across answers, so a guardrail can't return 'unsafe' while leaving the harm type blank. pip install gliner2 and point it at the calls where you're paying a frontier model just to pick a branch.

  • The price gap is 119x — routing beats picking a model

    The current pricing landscape runs from ~$0.10 per million blended tokens (Meta's Muse Spark, and GPT-6 Luna's new $0.10/$0.50 floor) up to $11.90 for Claude Fable 5.1 — a 119x spread, while the top models cluster within 1.6 intelligence points. The takeaway: your real cost lever is now cache strategy, effort tiers and task routing, not chasing the top-ranked model. And keep a calendar — Gemini 3.8 Flash TTS promo pricing doubles on Jan 1, 2027.

  • China is pricing your tokens into copyright damages

    A Wuhan court (Jiang'an District, Sept 23) folded token-consumption and AI-tool licensing costs into the damages for a 47-episode AI-made drama that was ripped and monetized — awarding ¥20,000 and affirming AI works are protectable where a human made a 'substantive intellectual contribution.' It lands weeks after the Supreme People's Court's first national AI-dispute rules, which put the burden on developers to produce training-data and process records to prove non-infringement. If you ship AI-generated content, keep your prompts, generation logs and compute receipts — they are now both your copyright proof and a recoverable cost.