Publication

(*: Equal contribution). See full list in Google Scholar

2025

  • CaKE: Circuit-aware Editing Enables Generalizable Knowledge Learners.

    Yunzhi Yao, Jizhan Fang, Jia-Chen Gu, Ningyu Zhang, Shumin Deng, Huajun Chen, Nanyun Peng.

  • How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Training.

    Yixin Ou, Yunzhi Yao, Ningyu Zhang, Hui Jin, Jiacheng Sun, Shumin Deng, Zhenguo Li, Huajun Chen.

2024

  • Knowledge Circuits in Pretrained Transformers.

    Yunzhi Yao, Ningyu Zhang, Zekun Xi, Mengru Wang, Ziwen Xu, Shumin Deng, Huajun Chen.
    In Proceedings of the 38th Neural Information Processing Systems (Neurips 2024)

  • Exploring Model Kinship for Merging Large Language Models.

    Yedi Hu, Yunzhi Yao, Ningyu Zhang, Shumin Deng, Huajun Chen.

  • Benchmarking Chinese Knowledge Rectification in Large Language Models.

    Jizhan Fang*, Tianhe Lu*, Yunzhi Yao*, Xin Xu, Ningyu Zhang, Huajun Chen.

  • Knowledge mechanisms in large language models: A survey and perspective.

    Mengru Wang*, Yunzhi Yao*, Ziwen Xu, Shuofei Qiao, Shumin Deng, Peng Wang, Xiang Chen, Jia-Chen Gu, Yong Jiang, Pengjun Xie, Fei Huang, Huajun Chen.
    In Findings of the 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP 2024)
    PDF

  • A comprehensive study of knowledge editing for large language models.

    Ningyu Zhang*, Yunzhi Yao*, Bozhong Tian*, Peng Wang*, Shumin Deng*, Mengru Wang, Zekun Xi, Shengyu Mao, Jintian Zhang, Yuansheng Ni, Siyuan Cheng, Ziwen Xu, Xin Xu, Jia-Chen Gu, Yong Jiang, Pengjun Xie, Fei Huang, Lei Liang, Zhiqiang Zhang, Xiaowei Zhu, Jun Zhou, Huajun Chen.

2023

  • Unveiling the pitfalls of knowledge editing for large language models.

    Zhoubo Li, Ningyu Zhang, Yunzhi Yao, Mengru Wang, Xi Chen, Huajun Chen.
    In Proceedings of the 12th International Conference on Learning Representations (ICLR 2023)

  • Editing Large Language Models: Problems, Methods, and Opportunities.

    Yunzhi Yao*, Peng Wang*, Bozhong Tian, Siyuan Cheng, Zhoubo Li, Shumin Deng, Huajun Chen, Ningyu Zhang.
    In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023)

  • Knowledge Rumination for Pre-trained Language Models.

    Yunzhi Yao, Peng Wang, Shengyu Mao, Chuanqi Tan, Fei Huang, Huajun Chen, Ningyu Zhang.
    In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023)

  • Schema-aware reference as prompt improves data-efficient knowledge graph construction.

    Yunzhi Yao*, Shengyu Mao*, Ningyu Zhang, Xiang Chen, Shumin Deng, Xi Chen, Huajun Chen.
    In Proceedings of the 46th International ACM SIGIR Conference (SIGIR 2023)

Before 2022

  • Kformer: Knowledge injection in transformer feed-forward layers.

    Yunzhi Yao, Shaohan Huang, Li Dong, Furu Wei, Huajun Chen, Ningyu Zhang.
    In Proceedings of the 11th Natural Language Processing and Chinese Computing (NLPCC 2022)

  • Adapt-and-distill: Developing small, fast and effective pretrained language models for domains.

    Yunzhi Yao, Shaohan Huang, Wenhui Wang, Li Dong, Furu Wei.
    In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 (ACL 2021)