2026

Xetrieval: Mechanistically Explaining Dense Retrieval
Xetrieval: Mechanistically Explaining Dense Retrieval

Zhixin Cai*, Jun Bai*, Yang Liu*, Jiaqi Li, Yichi Zhang, Taichuan Li, Zhuofan Chen, Zixia Jia, Zilong Zheng, Wenge Rong (* equal contribution)

Preprint 2026

[Paper] [Code] [Website]

Xetrieval: Mechanistically Explaining Dense Retrieval

Zhixin Cai*, Jun Bai*, Yang Liu*, Jiaqi Li, Yichi Zhang, Taichuan Li, Zhuofan Chen, Zixia Jia, Zilong Zheng, Wenge Rong (* equal contribution)

Preprint 2026

[Paper] [Code] [Website]

Native Parallel Reasoner: Reasoning in Parallelism via Self-Distilled Reinforcement Learning
Native Parallel Reasoner: Reasoning in Parallelism via Self-Distilled Reinforcement Learning

Tong Wu*, Yang Liu*, Jun Bai*, Zixia Jia, Shuyi Zhang, Ziyong Lin, Yanting Wang, Song-Chun Zhu, Zilong Zheng (* equal contribution)

ICML 2026

[Paper] [Website] [Code] [Model]

Native Parallel Reasoner: Reasoning in Parallelism via Self-Distilled Reinforcement Learning

Tong Wu*, Yang Liu*, Jun Bai*, Zixia Jia, Shuyi Zhang, Ziyong Lin, Yanting Wang, Song-Chun Zhu, Zilong Zheng (* equal contribution)

ICML 2026

[Paper] [Website] [Code] [Model]

OneMillion-Bench: How Far are Language Agents from Human Experts?
OneMillion-Bench: How Far are Language Agents from Human Experts?

Qianyu Yang*, Yang Liu*, Jiaqi Li*, Jun Bai*, Hao Chen, Kaiyuan Chen, Tiliang Duan, Jiayun Dong, Xiaobo Hu, Zixia Jia, Yang Liu, Tao Peng, Yixin Ren, Ran Tian, Zaiyuan Wang, Yanglihong Xiao, Gang Yao, Lingyue Yin, Ge Zhang, Chun Zhang, Jianpeng Jiao, Zilong Zheng, Yuan Gong (* equal contribution)

Preprint 2026

[Paper] [Data] [Code]

OneMillion-Bench: How Far are Language Agents from Human Experts?

Qianyu Yang*, Yang Liu*, Jiaqi Li*, Jun Bai*, Hao Chen, Kaiyuan Chen, Tiliang Duan, Jiayun Dong, Xiaobo Hu, Zixia Jia, Yang Liu, Tao Peng, Yixin Ren, Ran Tian, Zaiyuan Wang, Yanglihong Xiao, Gang Yao, Lingyue Yin, Ge Zhang, Chun Zhang, Jianpeng Jiao, Zilong Zheng, Yuan Gong (* equal contribution)

Preprint 2026

[Paper] [Data] [Code]

2025

Understanding and Leveraging the Expert Specialization of Context Faithfulness in Mixture-of-Experts LLMs
Understanding and Leveraging the Expert Specialization of Context Faithfulness in Mixture-of-Experts LLMs

Jun Bai, Minghao Tong, Yang Liu, Zixia Jia, Zilong Zheng

EMNLP 2025 Top 2%

[Paper] [Code] [Jiqizhixin]

Understanding and Leveraging the Expert Specialization of Context Faithfulness in Mixture-of-Experts LLMs

Jun Bai, Minghao Tong, Yang Liu, Zixia Jia, Zilong Zheng

EMNLP 2025 Top 2%

[Paper] [Code] [Jiqizhixin]

Reinforced Query Reasoners for Reasoning-intensive Retrieval Tasks
Reinforced Query Reasoners for Reasoning-intensive Retrieval Tasks

Xubo Qin, Jun Bai, Jiaqi Li, Zixia Jia, Zilong Zheng

EMNLP 2025

[Paper] [Code]

Reinforced Query Reasoners for Reasoning-intensive Retrieval Tasks

Xubo Qin, Jun Bai, Jiaqi Li, Zixia Jia, Zilong Zheng

EMNLP 2025

[Paper] [Code]

CogAtom: From Cognitive Atoms to Olympiad-level Mathematical Reasoning in Large Language Models
CogAtom: From Cognitive Atoms to Olympiad-level Mathematical Reasoning in Large Language Models

Zhuofan Chen, Jiyuan He, Yichi Zhang, Xing Hu, Haoxing Wen, Jun Bai, Wenge Rong

EMNLP Findings 2025

[Paper] [Code]

CogAtom: From Cognitive Atoms to Olympiad-level Mathematical Reasoning in Large Language Models

Zhuofan Chen, Jiyuan He, Yichi Zhang, Xing Hu, Haoxing Wen, Jun Bai, Wenge Rong

EMNLP Findings 2025

[Paper] [Code]

Selecting Text Classification Model through Maximizing Posterior Evidence over Informative Sub-space
Selecting Text Classification Model through Maximizing Posterior Evidence over Informative Sub-space

Zhiwei Sun, Jun Bai#, Zhuofan Chen, Chen Li, Wenge Rong, Zhang Xiong (# corresponding author)

Frontiers of Computer Science 2025

[Paper]

Selecting Text Classification Model through Maximizing Posterior Evidence over Informative Sub-space

Zhiwei Sun, Jun Bai#, Zhuofan Chen, Chen Li, Wenge Rong, Zhang Xiong (# corresponding author)

Frontiers of Computer Science 2025

[Paper]

Selecting Demonstrations for Many-Shot In-Context Learning via Gradient Matching
Selecting Demonstrations for Many-Shot In-Context Learning via Gradient Matching

Jianfei Zhang, Bei Li, Jun Bai, Rumei Li, Yanmeng Wang, Chenghua Lin, Wenge Rong

ACL Findings 2025

[Paper] [Code]

Selecting Demonstrations for Many-Shot In-Context Learning via Gradient Matching

Jianfei Zhang, Bei Li, Jun Bai, Rumei Li, Yanmeng Wang, Chenghua Lin, Wenge Rong

ACL Findings 2025

[Paper] [Code]

Rectifying and Discriminating Hard Negatives for Biomedical Retrieval Question Answering
Rectifying and Discriminating Hard Negatives for Biomedical Retrieval Question Answering

Jun Bai, Zhenzi Li, Bo Zhao, Chen Li, Chenghua Lin, Wenge Rong

IEEE Transactions on Computational Biology and Bioinformatics 2025

[Paper] [Code]

Rectifying and Discriminating Hard Negatives for Biomedical Retrieval Question Answering

Jun Bai, Zhenzi Li, Bo Zhao, Chen Li, Chenghua Lin, Wenge Rong

IEEE Transactions on Computational Biology and Bioinformatics 2025

[Paper] [Code]

Disentangling Preference Representation and Text Generation for Efficient Individual Preference Alignment
Disentangling Preference Representation and Text Generation for Efficient Individual Preference Alignment

Jianfei Zhang, Jun Bai, Bei Li, Yanmeng Wang, Rumei Li, Chenghua Lin, Wenge Rong

COLING 2025

[Paper] [Code]

Disentangling Preference Representation and Text Generation for Efficient Individual Preference Alignment

Jianfei Zhang, Jun Bai, Bei Li, Yanmeng Wang, Rumei Li, Chenghua Lin, Wenge Rong

COLING 2025

[Paper] [Code]

2024

Leveraging Estimated Transferability over Human Intuition for Model Selection in Text Ranking
Leveraging Estimated Transferability over Human Intuition for Model Selection in Text Ranking

Jun Bai, Zhuofan Chen, Zhenzi Li, Hanhua Hong, Jianfei Zhang, Chen Li, Chenghua Lin, Wenge Rong

EMNLP 2024

[Paper] [Code]

Leveraging Estimated Transferability over Human Intuition for Model Selection in Text Ranking

Jun Bai, Zhuofan Chen, Zhenzi Li, Hanhua Hong, Jianfei Zhang, Chen Li, Chenghua Lin, Wenge Rong

EMNLP 2024

[Paper] [Code]

2023

How to Determine the Most Powerful Pre-trained Language Model without Brute Force Fine-tuning? An Empirical Survey
How to Determine the Most Powerful Pre-trained Language Model without Brute Force Fine-tuning? An Empirical Survey

Jun Bai, Xiaofeng Zhang, Chen Li, Hanhua Hong, Xi Xu, Chenghua Lin, Wenge Rong

EMNLP Findings 2023

[Paper] [Code]

How to Determine the Most Powerful Pre-trained Language Model without Brute Force Fine-tuning? An Empirical Survey

Jun Bai, Xiaofeng Zhang, Chen Li, Hanhua Hong, Xi Xu, Chenghua Lin, Wenge Rong

EMNLP Findings 2023

[Paper] [Code]

Multisource Soft Labeling and Hard Negative Sampling for Retrieval Distractor Ranking
Multisource Soft Labeling and Hard Negative Sampling for Retrieval Distractor Ranking

Jiayun Wang, Wenge Rong, Jun Bai, Zhiwei Sun, Yuanxin Ouyang, Zhang Xiong

IEEE Transactions on Learning Technologies 2023

[Paper]

Multisource Soft Labeling and Hard Negative Sampling for Retrieval Distractor Ranking

Jiayun Wang, Wenge Rong, Jun Bai, Zhiwei Sun, Yuanxin Ouyang, Zhang Xiong

IEEE Transactions on Learning Technologies 2023

[Paper]

Permutation Invariant Training for Paraphrase Identification
Permutation Invariant Training for Paraphrase Identification

Jun Bai, Chuantao Yin, Hanhua Hong, Jianfei Zhang, Chen Li, Yanmeng Wang, Wenge Rong

ICASSP 2023 Oral

[Paper] [Code]

Permutation Invariant Training for Paraphrase Identification

Jun Bai, Chuantao Yin, Hanhua Hong, Jianfei Zhang, Chen Li, Yanmeng Wang, Wenge Rong

ICASSP 2023 Oral

[Paper] [Code]

Enhancing Biomedical Reqa with Adversarial Hard In-batch Negative Samples
Enhancing Biomedical Reqa with Adversarial Hard In-batch Negative Samples

Bo Zhao, Jun Bai, Chen Li, Jianfei Zhang, Wenge Rong, Yuanxin Ouyang, Zhang Xiong

IEEE/ACM Transactions on Computational Biology and Bioinformatics 2023

[Paper]

Enhancing Biomedical Reqa with Adversarial Hard In-batch Negative Samples

Bo Zhao, Jun Bai, Chen Li, Jianfei Zhang, Wenge Rong, Yuanxin Ouyang, Zhang Xiong

IEEE/ACM Transactions on Computational Biology and Bioinformatics 2023

[Paper]

2022

Improving Variational Autoencoders with Density Gap-based Regularization
Improving Variational Autoencoders with Density Gap-based Regularization

Jianfei Zhang, Jun Bai, Chenghua Lin, Yanmeng Wang, Wenge Rong

NeurIPS 2022

[Paper] [Code]

Improving Variational Autoencoders with Density Gap-based Regularization

Jianfei Zhang, Jun Bai, Chenghua Lin, Yanmeng Wang, Wenge Rong

NeurIPS 2022

[Paper] [Code]

Goal-oriented Conditional Variational Autoencoders for Proactive and Knowledge-aware Conversational Recommender System
Goal-oriented Conditional Variational Autoencoders for Proactive and Knowledge-aware Conversational Recommender System

Cen Yan, Jun Bai, Yanmeng Wang, Wenge Rong, Yuanxin Ouyang, Zhang Xiong

Computer Speech & Language 2022

[Paper]

Goal-oriented Conditional Variational Autoencoders for Proactive and Knowledge-aware Conversational Recommender System

Cen Yan, Jun Bai, Yanmeng Wang, Wenge Rong, Yuanxin Ouyang, Zhang Xiong

Computer Speech & Language 2022

[Paper]

Improving Biomedical ReQA with Consistent NLI-transfer and Post-whitening
Improving Biomedical ReQA with Consistent NLI-transfer and Post-whitening

Jun Bai, Chuantao Yin, Zimeng Wu, Jianfei Zhang, Yanmeng Wang, Guanyi Jia, Wenge Rong, Zhang Xiong

IEEE/ACM Transactions on Computational Biology and Bioinformatics 2022

[Paper] [Code]

Improving Biomedical ReQA with Consistent NLI-transfer and Post-whitening

Jun Bai, Chuantao Yin, Zimeng Wu, Jianfei Zhang, Yanmeng Wang, Guanyi Jia, Wenge Rong, Zhang Xiong

IEEE/ACM Transactions on Computational Biology and Bioinformatics 2022

[Paper] [Code]

Adversarial Knowledge Distillation based Biomedical Factoid Question Answering
Adversarial Knowledge Distillation based Biomedical Factoid Question Answering

Jun Bai, Chuantao Yin, Jianfei Zhang, Yanmeng Wang, Yi Dong, Wenge Rong, Zhang Xiong

IEEE/ACM Transactions on Computational Biology and Bioinformatics 2022

[Paper] [Code]

Adversarial Knowledge Distillation based Biomedical Factoid Question Answering

Jun Bai, Chuantao Yin, Jianfei Zhang, Yanmeng Wang, Yi Dong, Wenge Rong, Zhang Xiong

IEEE/ACM Transactions on Computational Biology and Bioinformatics 2022

[Paper] [Code]

2021

Enhancing Dual-encoders with Question and Answer Cross-embeddings for Answer Retrieval
Enhancing Dual-encoders with Question and Answer Cross-embeddings for Answer Retrieval

Yanmeng Wang, Jun Bai, Ye Wang, Jianfei Zhang, Wenge Rong, Zongcheng Ji, Shaojun Wang, Jing Xiao

EMNLP Findings 2021

[Paper]

Enhancing Dual-encoders with Question and Answer Cross-embeddings for Answer Retrieval

Yanmeng Wang, Jun Bai, Ye Wang, Jianfei Zhang, Wenge Rong, Zongcheng Ji, Shaojun Wang, Jing Xiao

EMNLP Findings 2021

[Paper]

Paragraph Level Multi-perspective Context Modeling for Question Generation
Paragraph Level Multi-perspective Context Modeling for Question Generation

Jun Bai, Wenge Rong, Feiyu Xia, Yanmeng Wang, Yuanxin Ouyang, Zhang Xiong

ICASSP 2021

[Paper] [Code]

Paragraph Level Multi-perspective Context Modeling for Question Generation

Jun Bai, Wenge Rong, Feiyu Xia, Yanmeng Wang, Yuanxin Ouyang, Zhang Xiong

ICASSP 2021

[Paper] [Code]