Shawn NgTopic
ML Systems
3 deep dives tagged ML Systems, newest first.
What Is Jev? TypeSafe AI's System One Model, and Why It Refuses to Talk
Jev is TypeSafe AI's System One model: a non-autoregressive transformer that returns typed, calibrated decisions instead of text. How it differs from LLMs.
Recommendation Is Vector Search With a Query You Never Typed
Search and recommendation run the same engine: encode a query as a vector, return the nearest items. Only the query's origin differs. Here is the geometry.
How YouTube Decides What You Watch
How YouTube's recommendation system works: two-stage retrieval and ranking, watch-time prediction, and multi-task MMoE models, per the published research.