Alibaba Tongyi Lab · Research Intern
About Me
Hello! I’m Yunzhi Yao (姚云志), a final-year Ph.D. student (expected to graduate in June 2026) at the College of Computer Science and Technology, Zhejiang University. I am fortunate to be advised by Prof. Huajun Chen and Prof. Ningyu Zhang.
I earned my Bachelor’s degree in Software Engineering and Dual Degree in Finance from Shandong University in 2021.
Btw, I’m interested in Astrology. If you are interested in talking about research and life with me, please feel free to reach out!
Experience
Ant Group, Ling Team · Research Intern
University of California, Los Angeles (UCLA) · Visiting Research Scholar
Microsoft Research Asia (MSRA) · Research Intern
Research Interest
My primary research interests lie in machine learning for natural language processing, with a particular focus on the knowledge mechanisms underpinning large language models (LLMs). I am actively exploring the following topics:
- Knowledge Mechanisms and Editing: Investigating how LLMs acquire, store, and utilize knowledge for reasoning. My goal is to develop concise and precise methods for model editing that enhance these capabilities.
- Model Merging: Exploring connections between models with diverse architectures and modalities, enabling them to communicate and integrate information beyond traditional text-based interactions.
Selected Publications
Rethinking Knowledge Editing in Reasoning Era.
Reflection on Knowledge Editing: Charting the Next Steps.
CaKE: Circuit-aware Editing Enables Generalizable Knowledge Learners.
EMNLP 2025, ACL 2025 KnowFM, Oral @ NENLP 2025
Knowledge Circuits in Pretrained Transformers.
In Proceedings of the 38th Neural Information Processing Systems (NeurIPS 2024)
Editing Large Language Models: Problems, Methods, and Opportunities.
In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023)
Knowledge Rumination for Pre-trained Language Models.
In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023)
Schema-aware Reference as Prompt Improves Data-efficient Knowledge Graph Construction.
In Proceedings of the 46th International ACM SIGIR Conference (SIGIR 2023)
Kformer: Knowledge Injection in Transformer Feed-forward Layers.
In Proceedings of the 11th Natural Language Processing and Chinese Computing (NLPCC 2022)
Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains.
In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 (ACL 2021)
Honors and Awards
- Notable Reviewer (2025), ICLR
- Scholar Award (2024), NeurIPS
- Best Paper Award, Workshop LLM+KG @ VLDB 2024
- National Scholarship (2024), Zhejiang University
- Star of Tomorrow (2021), Microsoft Research Asia
- Excellent Graduate (2021), Shandong University
- National Scholarship (2018), Shandong University
Professional Services
- Area Chair: ACL, EMNLP
- Reviewer: TKDE, ACL ARR, NeurIPS, ICML, ICLR, TASLP, COLM, AAAI, ACM MM, AISTATS, NLPCC
- Volunteer: AI TIME