Tag: Agents
All the articles with the tag "Agents".
-
From Long CoT to Agent Swarms: The Documented Evolution of Kimi's Reinforcement Learning
· 15 min readA source-grounded history of Kimi's reinforcement-learning stack, from Kimi k1.5's long-context outcome RL and partial rollouts to K2's general RL and K2.5's multimodal GRMs and Parallel-Agent RL.
-
Reproducing CompactionRL: From the GLM-5.2 Algorithm to a Live slime E2E
· 13 min readA source-grounded reproduction of CompactionRL: the algorithm, missing recipe details, a 96-step multi-seed causal experiment, and a live Qwen actor-critic update through THUDM/slime on four A10 GPUs.
-
Training the Critic Without Crashing the Reward: A Practical Guide to Agentic RL
· 20 min readA practical framework for critic training and credit assignment in long-horizon LLM agents: IQL, pairwise advantage, hindsight and counterfactual critics, privileged information, turn-level MDPs, chain-of-thought monitoring, and reward-crash diagnosis.
-
Scaling RL for White-Collar Work: The Environment Foundry
· 20 min readA practical framework for turning common white-collar workflows into RL environments: spreadsheets, CRM tasks, customer support, web research, dashboards, and other software-mediated work.
-
How to Arbitrarily Increase the Difficulty of Agent Evaluation Sets
· 18 min readA practical framework for making agent benchmarks harder in a controlled way: treat difficulty as trajectory-graph complexity, not prompt wording. Covers deterministic scoring, capability facets, harness effects, and systematic data generation.
-
Improving LLM Internationalization: Bridging the Gap in Tool Use and Agency
· 17 min readLLMs achieve 57% tool-calling accuracy in English but only 34% across 52 languages — and 6.8% for the worst. This post covers the full playbook for closing the multilingual gap: training-time techniques, agentic architecture patterns, failure mode analysis, and RL-based approaches for i18n.