Posts
All the articles I've posted.
-
Ad Formats in LLM Products: What's Live vs. What's Research
· 7 min readA survey of advertising formats in LLM products—separating what's deployed in production from what remains in research.
-
Adding Ads in LLM/Chatbot: Character Training for Monetization
· 4 min readExploring how to integrate ads in LLMs through character training—making recommendations genuinely helpful rather than annoyingly promotional.
-
Generative UI Doesn't Move the Needle—Steering Does
· 10 min readAfter shipping multiple generative UI features, I've concluded that the sophistication of AI-generated interfaces often doesn't translate to user benefit—but steering does.
-
RLHF from an Engineering Perspective: PPO, GRPO, DPO, and Tool-Use Implementation
· 12 min readA practical engineering guide to RLHF implementation—covering PPO, GRPO, DPO, and tool-use training with code snippets and debugging tips.
-
Post-Training Is Not 'One Algorithm': Objective Functions and Implementation Essentials for PPO / DPO / GRPO
· 12 min readReading notes on RLHF covering PPO, DPO, and GRPO—understanding post-training as an engineering pipeline rather than a single algorithm.
-
What Worked (and What Didn't) When Training AEs and VAEs for Embedding Compression
· 4 min readPractical lessons from training autoencoders and VAEs for embedding compression—covering dimension choice, KL scheduling, contrastive signals, and evaluation metrics.