Topics / topic

Huggingface

1 item across 1 edition. First seen Tue 17 Nov, last seen Tue 17 Nov.

Tuesday, 17 November 2026

Hugging Face moves inference routing to OpenRouter and reports open-weight models at 71.7% of tokens served Company claim

  • Hugging Face says it is moving Inference Providers language-model requests from its own router to OpenRouter's, which selects a provider per request and retries on another on failure. It cites OpenRouter measurements that the new routing cut capacity errors by 46% and improved time to first token by 16.9% and throughput by 16.3%.
  • On OpenRouter, Hugging Face says open-weight models went from 26.8% of tokens served in October 2025 to 71.7% at the end of September 2026, after peaking at 77.5% in July, with weekly open-weight volume growing more than 60-fold against almost tenfold for closed models. It says the most-used model this week is DeepSeek V4.1 Flash 1017 at 59.2 trillion tokens.
  • Hugging Face gives average prices of $0.28 per million input tokens and $1.62 per million output tokens for open-weight models, against $1.27 and $6.36 for closed models. On the Artificial Analysis Intelligence Index it says Kimi K3.1 Pro, the best open-weight model, scores 46 against 65 for Claude Fable 5.2, at $3.68 against $26.54 per task.
  • The token-share and routing figures are OpenRouter's own and cover traffic through that one marketplace, not the market overall. Hugging Face has a commercial interest in the arrangement it is describing.