Tag: Systems
All the articles with the tag "Systems".
-
From Tool Calls to Policy Updates: A Reproducible Agent RL Stack
· 45 min readA reproducible blueprint for Agent RL: environment snapshots, verifier contracts, credit assignment, three-policy semantics, asynchronous generation and training, partial rollouts, and runnable smoke tests.
-
Beyond 49 ms: Where VM Resume Latency Actually Goes in Agentic RL
· 21 min readA measurement-first look at fast sandbox resume, speculative tool execution, and action-observation co-speculation—and why time-to-useful-work matters more than boot time.
-
Optimizing Inference for Router Looped Transformers
Updated: · 20 min readA research note on serving router looped transformers: why normal KV cache semantics break, what latency data says so far, and how vLLM or SGLang could be adapted with route-template batching and virtual-step KV cache.