Itai Shapira
I'm a PhD Candidate in Computer Science at Harvard. I am privileged to be advised by Prof. Ariel D. Procaccia.
I’m interested in AI alignment. I study how human goals and values become training objectives, and how optimization toward those objectives shapes AI behavior. I’m interested in understanding the limitations of current alignment methods and developing better ones. I think about how AI can learn from our judgments (i) without inheriting their flaws (e.g., sycophancy), (ii) when those judgments conflict (pluralistic alignment), and (iii) when what we approve of differs from what ultimately serves us (multi-turn alignment).
I am a Siebel Scholar (Class of 2027) and a recipient of the 2025 JPMorgan Chase PhD Fellowship. I am affiliated with the NSF AI Institute for Societal Decision Making and serve on its Student Leadership Council.
Selected Publications
How RLHF Amplifies Sycophancy
AI Alignment From Social Choice Perspectives
July 2026
Pairwise Calibrated Rewards for Pluralistic Alignment
SOAP: Improving and Stabilizing Shampoo using Adam
Axioms for AI Alignment from Human Feedback
(α) Authors listed alphabetically. † Equal contribution.
