Latest in Local & On-Device AI

Local & On-Device AI at a glance

The 10 latest articles on Local & On-Device AI come from 9 sources, published between Nov 2 and Nov 20. Most come from note(ノート) (2).

People in these stories: Ollama (2)

Organizations: Apple (3), GitHub (2), Claris (2), LM Studio (2), GPU (2)

Places: Ollama (3), Harbor (2)

47 words

Turning an MMLU gap into a compute gap

Claude 1.3 (Lark) scored 77.0% and Claude 3 Opus 88.2% on Anthropic's MMLU test. To ask how much extra compute Lark's recipe would have needed to reach 88.2%, the chart borrows the rate at which Llama 3.1's score climbs with compute and extends it from…

Local & On-Device AI

Private AI: offline models, quantization, GPU/NPU acceleration, and local tooling.

  • 17 Tracked terms
  • Last 30 days Feed window

What this topic collects on

An article joins this feed when it matches these terms. Each one is also a search of its own.