Binfeng Xu

I’m a researcher at NVIDIA with a current focus on Agentic RL. I popularized LLM-Harness co-training with Polar, and am solving the open challenges of Agentic AI from data, infra, recipe to harness as a whole.

Formerly, I was a researcher at Samsung Research (SRA) where I led LLM post-training + distillation infra. I enjoy training large neural nets, building open-source projects and competing on Kaggle, where I rank top 1% globally.

Papers

• FlashREINFORCE: Critic-Free Single-Rollout Asynchronous RL for Agentic Language Models
  Jian Hu, Yifan Zhang, Hao Zhang, Binfeng Xu, Shaokun Zhang, Hongqing Peng, Zhiding Yu, Pavlo Molchanov, Jan Kautz, Yi Dong

• Molt: A Scalable PyTorch-Native Training Framework for Agentic Reinforcement Learning
  Jian Hu, Huiying Li, Hao Zhang, Binfeng Xu, Yifan Zhang, Shaokun Zhang, Hemil Desai, Michael Demoret, Pavlo Molchanov, Jan Kautz, Yi Dong

• Polar: Agentic RL on Any Harness at Scale
  Binfeng Xu, Hao Zhang, Shaokun Zhang, Songyang Han, Mingjie Liu, Jian Hu, Shizhe Diao, Zhenghui Jin, Yunheng Zou, Michael Demoret, Jan Kautz, Yi Dong

• Gentopia: A Collaborative Platform for Tool-Augmented LLMs
  Binfeng Xu, Xukun Liu, Hua Shen, Zeyu H, Yuhan L, Murong Y, Zhiyuan P, Yuchen L, Ziyu Y, Dongkuan Xu

• ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Models
  Binfeng Xu, Zhiyuan Peng, Bowen Lei, Subhabrata Mukherjee, Yuchen Liu, Dongkuan Xu

• Dynamic Noise Preference Optimization for LLM Self-Improvement
  Haoyan Yang, Ting Hua, Shangqian Gao, Binfeng Xu, Zheng Tang, Jie Xu, Hongxia Jin, Vijay Srinivasan

• Efficient Computation of Tucker Decomposition of Correlation-Based Tensors
  Binfeng Xu, Grey Ballard, Robert Lyday, Paul Laurienti

Misc

I play all games by Hidetaka Miyazaki, who motivated me once into indie Game Dev. Photography @Instagram; I enjoy Art. Minimalist.