Tag: ML Engineering
All the articles with the tag "ML Engineering".
-
Improving LLM Internationalization: Bridging the Gap in Tool Use and Agency
Updated: · 18 min readA practical multilingual agent playbook, updated with task-specific evidence from MASSIVE-Agents, GAIA-v2-LILT, and SEATauBench, with explicit limits on what transfers to current frontier models.
-
When Does Model Souping Work for LLMs?
Updated: · 21 min readA practical guide to when LLM weight averaging and model merging work, why they fail, how methods such as Task Arithmetic, TIES, DARE, and LoRA merging differ, and how to evaluate a merge before deployment.
-
What Makes an Agent Swarm Work? Simple Rules, Information Boundaries, and the Value of Verification
· 37 min readA theory-and-experiment study of agent swarm organization: operational roles, marginal-contribution incentives, selective information sharing, and why verification remains the limiting assumption.
-
A Repair Can Save a Trajectory Without Teaching the Agent
· 18 min readAn eight-seed counterfactual-replay experiment found that high-value one-action repairs reliably rescue failed agent trajectories—but a repair-value-dominant SFT selector did not beat simpler rules and recovered only 25% of matched-RL improvement.
-
A Looped Transformer Router Shows Its First Replicated Gain
· 11 min readA small-budget BPE language-model experiment where a sparse late-final-loop token-feedback router becomes the first route-looped Transformer candidate to beat matched fixed-loop baselines across several controlled checks.
-
Scaling RL for White-Collar Work: The Environment Foundry
· 20 min readA practical framework for turning common white-collar workflows into RL environments: spreadsheets, CRM tasks, customer support, web research, dashboards, and other software-mediated work.