Shawn Ng
Log inJoin me

Topic

Inference

1 deep dive tagged Inference — real systems, real numbers, no hand-waving.

Local Models vs Frontier APIs: An Honest Accounting

· 11 min read

What it actually takes to run LLMs on your own hardware, why memory bandwidth is the real bottleneck, and when the economics flip in favor of the API.

  • llms
  • local-models
  • inference

Browse all topics · All articles