I’m a Research Scientist at Apple MLR working on self-improving LLMs.
My broader interest is in how models can learn from their own outputs and feedback, and interact with people in real time. I’ve developed methods for data-efficient pretraining (corpus rephrasing), LLM post-training (self-distillation and self-training from test-time scaling), and real-time speech agents (speech tokenization, streaming speech generation, and on-device conversation).
I received my PhD in Computer Science from UWaterloo, advised by Ming Li, and my Master’s from UCAS, advised by Chengqing Zong.
Released RSI-Inference, a benchmark for coding agents that improve real LLM inference systems.
Recognized as a Top Area Chair at NeurIPS 2026.
Two papers accepted to NeurIPS 2026: DuST on self-training for code from test-time scaling, and TRACER on verifiable provenance for multimodal tool-using agents.
dMel was featured in Thinking Machines’ Interaction Models as the audio input representation.
Our SSD work on simple self-distillation for code generation reached #1 on Hacker News.
ChipChat, our low-latency on-device voice agent, won the Best Demo Paper Award at IEEE ASRU 2025.
CLaRa: Bridging Retrieval and Generation with Continuous Latent Reasoning — COLM 2026
From Past To Path: Masked History Learning for Next-Item Prediction in Generative Recommendation — ACL 2026
Closing the Gap Between Text and Speech Understanding in LLMs — ICLR 2026
Area Chair at NeurIPS 2026
Workshop Organizer: WideningNLP at EMNLP 2026
SpeakStream: Streaming Text-to-Speech with Interleaved Data — ICML 2026
Workshop Organizer: WideningNLP at EMNLP 2025
Workshop Organizer: VLM4RWD at NeurIPS 2025
Workshop Organizer: Embodied AI Workshop at CVPR 2025
Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling — ACL 2024
Divide-or-Conquer? Which Part Should You Distill Your LLM? — EMNLP 2024
How Far Are We from Intelligent Visual Deductive Reasoning? — COLM 2024
Construction of Paired Knowledge Graph-Text Datasets Informed by Cyclic Evaluation — COLING 2024
KGLens: Towards Efficient and Effective Knowledge Probing of Large Language Models with Knowledge Graphs — ACL 2024 Workshop (KnowLLM)
dMel: Speech Tokenization made Simple — Preprint, 2024
Workshop Organizer: Embodied AI Workshop at CVPR 2024
Joined Apple MLR as Machine Learning Researcher
PhD Defense at the University of Waterloo
XRICL: Cross-lingual Retrieval-Augmented In-Context Learning for Cross-lingual Text-to-SQL Semantic Parsing — Findings of EMNLP 2022
A3T: Alignment-Aware Acoustic and Text Pretraining for Speech Synthesis and Editing — ICML 2022 (spotlight)
Better Language Model with Hypernym Class Prediction — ACL 2022
Received the Outstanding Reviewer Award at ICML 2022.
Area Chair for ACL Rolling Review
Segatron: Segment-aware Transformer for Language Modeling and Understanding — AAAI 2021
Cross-Lingual Training with Dense Retrieval for Document Retrieval — Preprint, 2021
Semantics of the Unwritten: The Effect of End of Paragraph and Sequence Tokens on Text Generation — ACL 2021
Memory Consolidation for Contextual Spoken Language Understanding with Dialogue Logistic Inference — ACL 2019