Tag: RLHF

All the articles with the tag "RLHF".

• Training the Critic Without Crashing the Reward: A Practical Guide to Agentic RL

  12 Jul, 2026 · 20 min read

  A practical framework for critic training and credit assignment in long-horizon LLM agents: IQL, pairwise advantage, hindsight and counterfactual critics, privileged information, turn-level MDPs, chain-of-thought monitoring, and reward-crash diagnosis.

• From GRPO Outcome Rewards to Token-Level Advantage

  8 Jul, 2026 · 20 min read

  A practical framework for turning GRPO-style sequence rewards into token-level advantages, including GAE-style estimators, credit assignment routes, and multi-reward training design.

• The Mercor Breach: What 4TB of Stolen Data Reveals About How Frontier AI Labs Actually Train Models

  12 Apr, 2026 · 22 min read

  A $10B AI data vendor was breached, exposing 84 Airtable workspaces of training data for OpenAI, Anthropic, Apple, Amazon, and Meta. This post analyzes what the public reporting reveals about each lab's evaluation methodology — rubric design, RLHF pipelines, and quality control — and what it means for the industry.

• The Unverifiable Reward Problem: The Real Frontier of RL for LLMs

  7 Mar, 2026 · 11 min read

  Deep research on tasks with unverifiable rewards in RL — the key bottleneck for scaling RL beyond math and code. Covers JEPO, NRT, RLNVR, self-play methods, GenRM, Constitutional AI, reward hacking mitigation, and more.

• Adding Ads in LLM/Chatbot: Character Training for Monetization

  1 Jan, 2026 · 4 min read

  Exploring how to integrate ads in LLMs through character training—making recommendations genuinely helpful rather than annoyingly promotional.

• Post-Training Is Not 'One Algorithm': Objective Functions and Implementation Essentials for PPO / DPO / GRPO

  30 Dec, 2025 · 12 min read

  Reading notes on RLHF covering PPO, DPO, and GRPO—understanding post-training as an engineering pipeline rather than a single algorithm.