📝 Biography

🔥 News

• Oct, 2024. We release an efficient long-context alignment method LOGO — Long cOntext aliGnment via efficient preference Optimization  
  Paper:

   

  Project:

   

  Zhihu:


• Oct, 2024. We release a new multi-task long-context understanding with citation benchmark L-CiteEval: Do Long-Context Models Truly Leverage Context for Responding?  
  Paper:

   

  Project:

   

  Zhihu:


• Oct, 2024. I gave a tutorial about Long Context Modeling in LLMs: Advances and Challenges in NLPCC2024 (Hangzhou, China, Nov 1, 2024)   [Slides]

📒 Selected Publication  

Check my Google Scholar for more information! (* stands for equal contribution)

2024

• [EMNLP 2024 (CCF B)] CMD: a framework for Context-aware Model self-Detoxification
  Zecheng Tang, Keyan Zhou, Juntao Li, Yuyang Ding, Pinzheng Wang, Yan Bowen, Renjie Hua, Min Zhang
  
   

   

   
• [ACL 2024 Findings] Rethinking Negative Instances for Generative Named Entity Recognition
  Yuyang Ding, Juntao Li, Pinzheng Wang, Zecheng Tang, Bowen Yan, Min Zhang
  
   

   

   
• [ICML 2024 (CCF A)] StrokeNUWA: Tokenizing Strokes for Vector Graphic Synthesis
  Zecheng Tang, Chenfei Wu, Zekai Zhang, Mingheng Ni, Shengming Yin, Yu Liu, Zhengyuan Yang, Lijuan Wang, Zicheng Liu, Juntao Li, Nan Duan
  
   

   

   
• [SCIS 2024 (CCF A)] OpenBA: An Open-sourced 15B Bilingual Asymmetric seq2seq Model Pre-trained from Scratch
  Juntao Li*, Zecheng Tang*, Yuyang Ding*, Pinzheng Wang*, Pei Guo, Wangjie You, Dan Qiao, Wenliang Chen, Guohong Fu, Qiaoming Zhu, Guodong Zhou, Min Zhang
  
   

   

   
• [ICLR 2024 (CAAI A)] LayoutNUWA: Revealing the hidden layout expertise of large language models
  Zecheng Tang, Chenfei Wu, Juntao Li, Nan Duan
  
   

   

   
• [WSDM 2024 (CCF B)] Towards Better Chinese Spelling Check for Search Engines: A New Dataset and Strong Baseline
  Yue Wang, Zilong Zheng, Zecheng Tang, Juntao Li, Zhihui Liu, Kunlong Chen, Jinxiong Chang, Qishen Zhang, Zhongyi Liu, Min Zhang
  
   

   

   

2023

• [ACL 2023 (CCF A)] Open-ended long text generation via masked language modeling
  Xiaobo Liang*, Zecheng Tang*, Juntao Li, Min Zhang
  
   

   

   
• [ACL 2023 Findings] Bridging the Gap between Training and Inference for Diffusion Model
  Zecheng Tang, Pinzheng Wang, Keyan Zhou, Juntao Li, Ziqiang Cao, Min Zhang
  
   

   

   

2022

• [EMNLP 2022 (CCF B)] Improving temporal generalization of pre-trained language models with lexical semantic change
  Zhaochen Su*, Zecheng Tang*, Xinyan Guan, Juntao Li, Lijun Wu, Min Zhang
  
   

   

   

📜 Preprint  

• [Oct 2024] LOGO — Long cOntext aliGnment via efficient preference Optimization
  Zecheng Tang, Zechen Sun, Juntao Li, Qiaoming Zhu, Min Zhang
  
   

   

   
• [Oct 2024] Revealing and Mitigating the Local Pattern Shortcuts of Mamba
  Wangjie You, Zecheng Tang*, Juntao Li, Lili Yao, Min Zhang
  
   

   

   
• [Oct 2024] L-CiteEval: Do Long-Context Models Truly Leverage Context for Responding?
  Zecheng Tang, Keyan Zhou, Juntao Li, Baibei Ji, Jianye Hou, Min Zhang
  
   

   

   
• [Aug 2024] MemLong: Memory-Augmented Retrieval for Long Text Modeling
  Weijie Liu*, Zecheng Tang*, Juntao Li, Kehai Chen, Min Zhang
  
   

   

   
• [Oct 2023 & NLPCC 2023 (CCF C)] Beyond Hard Samples: Robust and Effective Grammatical Error Correction with Cycle Self-Augmenting
  Zecheng Tang, Kaiqi Feng, Juntao Li, Min Zhang
  
   

   

   
• [Mar 2023] Visual chatgpt: Talking, drawing and editing with visual foundation models
  Chenfei Wu, Shengming Yin, Weizhen Qi, Xiaodong Wang, Zecheng Tang, Nan Duan
  
   

   

   
• [CCL 2021] Chinese grammatical error correction enhanced by data augmentation from word and character levels
  Zecheng Tang, Yixin Ji, Yibo Zhao, Junhui Li
  
   

🎖️ Scholarship & Honors

• Star of Tomorrow, MSRA, Feb 2024.
  
• Outstanding Graduate and Honorary Graduate, Soochow University, Jun 2022.
  Rank 1/380, School of Computer Science and Technology
• Huawei Scholarship, Huawei, Jun 2022.
  Top 5% Undergraduate

🎤 Talk

• Leveraging Large Language Models for Tool Invocation, OPPO Seminar, Apr 2023.
• Long Context Modeling in LLMs: Advances and Challenges, NLPCC2024 Tutorial (CCF C), Nov 2024. [Slides]

💻 Service

• Conference Reviewing : ACL 2023, 2024; NeurIPS 2024; ICLR 2024; EMNLP 2023, 2024; AAAI 2023; ACL ARR

Template From © 2024 Huanxuan Liao