Hi!

I am currently a PhD student at School of College of Computer Science and Engineering, Southeast University, Nanjing, China, supervised by Prof. Peng Wang. Before that, I received my B.Eng. degree from Dalian University of Technology.

Currently, I am a Ph.D. student in the Department of Computer Science and Engineering of Southeast University. I am a member of the KGCODE Group, advised by Prof. Peng Wang and A.P. Wenjun Ke. Before that, I finished my M.S. career of Computer Technology at Southeast University in 2023. I obtained my B.S. degree of Computer Science and Technology from Dalian University of Technology in 2021.

Find me on Google Scholar, and Github!

Email: jiajliu@seu.edu.cn

📚 Research

My current research interests lie in large language models (LLMs) and Knowledge Graph (KGs). Currently, I am focused on Knowledge Distillation and Model Compression for LLMs.

📖 Education

  • Southeast University, Nanjing, China. Mar. 2024 – Now.
    Ph.D. student of Computer Science and Technology, advised by Prof. Peng Wang

  • Southeast University, Nanjing, China. Sep. 2021 - Jun. 2024
    M.S. student of Computer Technology, advised by Prof. Peng Wang and A.P. Wenjun Ke
    Avg-Score: 86.69, Ranking: 1/160.

  • Dalian University of Technology, Dalian, China. Sep. 2017 - Jun. 2021
    B.S. degree of Computer Science and Technology
    Avg-Score: 89.50, Ranking: 11/125.

📝 Publications

  • [IJCAI 2024] Fast and Continual Knowledge Graph Embedding via Incremental LoRA. [paper] [code]
    Jiajun Liu, Wenjun Ke, Peng Wang, Ziyu Shang, et al.
  • [AAAI 2024, Oral] Towards Continual Knowledge Graph Embedding via Incremental Distillation. [paper] [code]
    Jiajun Liu*, Wenjun Ke*, Peng Wang, Jiahao Wang, et al.
  • [AAAI 2023] IterDE: An Iterative Knowledge Distillation Framework for Knowledge Graph Embeddings. [paper] [code]
    Jiajun Liu, Peng Wang, Ziyu Shang, Chenxiao Wu.
  • [NeurIPS 2024] Unveiling LoRA Intrinsic Ranks via Salience Analysis.
    Wenjun Ke, Jiahao Wang, Peng Wang, Jiajun Liu, Dong Nie, Guozheng Li, Yining Li.
  • [ACL 2024] Boosting Textural NER with Synthetic Image and Instructive Alignment. [paper]
    Jiahao Wang, Wenjun Ke, Peng Wang, Hang Zhang, Dong Nie, Jiajun Liu, Guozheng Li, Ziyu Shang
  • [IJCAI 2024] Domain-Hierarchy Adaptation via Chain of Iterative Reasoning for Few-shot Hierarchical Text Classification.[paper]
    Ke Ji, Peng Wang, Wenjun Ke, Guozheng Li, Jiajun Liu, Jingsheng Gao, Ziyu Shang
  • [IJCAI 2024] Meta In-Context Learning Makes Large Language Models Better Zero and Few-Shot Relation Extractors. [paper]
    Guozheng Li, Peng Wang, Jiajun Liu, Yikai Guo, Ke Ji, Ziyu Shang, Zijie Xu
  • [IJCAI 2024] Recall, Retrieve and Reason: Towards Better In-Context Relation Extraction. [paper]
    Guozheng Li, Peng Wang, Wenjun Ke, Yikai Guo, Ke Ji, Ziyu Shang, Jiajun Liu, Zijie Xu
  • [IJCAI 2024] Empirical Analysis of Dialogue Relation Extraction with Large Language Model [paper]
    Guozheng Li, Zijie Xu, Ziyu Shang, Jiajun Liu, Ke Ji, Yikai Guo
  • [IJCAI 2024] Learning Multi-Granularity and Adaptive Representation for Knowledge Graph Reasoning [paper]
    Ziyu Shang, Peng Wang, Wenjun Ke, Jiajun Liu, Hailang Huang, Guozheng Li, Chenxiao Wu, Jianghan Liu, Xiye Chen, Yining Li
  • [IJCAI 2024] Incorporating Schema-Aware Description into Document-Level Event Extraction [paper][code]
    Zijie Xu, Peng Wang, Wenjun Ke, Guozheng Li, Jiajun Liu, Ke Ji, Xiye Chen, Chenxiao Wu
  • [IJCAI 2024] Ontofact: Unveiling fantastic fact-skeleton of llms via ontology-driven reinforcement learning [paper][code]
    Ziyu Shang, Wenjun Ke, Nanna Xiu, Peng Wang, Jiajun Liu, Yanhui Li, Zhizhao Luo, Ke Ji

🎖 Honors and Awards

  • Scholarship for New PhD Students, 2024.10

  • National Scholarship, 2023.12

  • Academic Scholarship of Southeast University, 2023.10

  • Merit Student of Southeast University, 2022-2023

  • Outstanding Undergraduate Thesis of Dalian University of Technology, 2021.06

  • Outstanding Graduate of Dalian University of Technology, 2021.06

  • Huawei Scholarship, 2020.04

  • Spiritual Civilization Scholarship of Dalian University of Technology, 2018-2019

  • Merit Student of Dalian University of Technology, 2018-2019

  • First-Class Outstanding Student Scholarship of Dalian University of Technology, 2018.10

💻 Technique Competition

National First Prize of 2023 National Big Data and Computational Intelligence Challenge (1/193) 2023.08

  • Members: Jiajun Liu (captain), Ke Ji, Ziyu Shang, Yikai Guo, Peng Wang.
  • Track: Data-To-Text Controlled Text Generation under Hard Constraints
  • My work: Researching the model, code implementation, evaluating the effect of the model, reporting and defense.

National Third Prize of 2022 National Big Data and Computational Intelligence Challenge (4/418) 2022.08

  • Members: Zijie Xu (captain), Ziyu Shang, Jiajun Liu, Guozheng Li, Peng Wang.
  • Track: Field Event Detection Tasks under High Robustness Requirements
  • My work: Designing model, writing codes, writing technical summary reports.