Publications
Google Scholar (opens new window) Semantic Scholar (opens new window)
RAGChecker: A Fine-grained Framework for Diagnosing Retrieval-Augmented Generation
Dongyu Ru*, Lin Qiu*, Xiangkun Hu*, Tianhang Zhang*, Peng Shi*, Shuaichen Chang*, Cheng Jiayang, Cunxiang Wang, Shichao Sun, Huanyu Li, Zizhao Zhang, Binjie Wang, Jiarong Jiang, Tong He, Zhiguo Wang, Pengfei Liu, Yue Zhang, Zheng Zhang (* shared first author)
NeurIPS, 2024 [PDF (opens new window)] [Code (opens new window)] [LlamaIndex (opens new window)]
PRACTIQ: A Practical Conversational text-to-SQL dataset with Ambiguous and Unanswerable Queries
Mingwen Dong, Nischal Ashok Kumar, Yiqun Hu, Anuj Chauhan, Chung-Wei Hang, Shuaichen Chang, Lin Pan, Wuwei Lan, Henghui Zhu, Jiarong Jiang, Patrick Ng, Zhiguo Wang
Preprint, 2024 [PDF (opens new window)]
You Only Read Once (YORO): Learning to Internalize Database Knowledge for Text-to-SQL
Hideo Kobayashi, Wuwei Lan, Peng Shi, Shuaichen Chang, Jiang Guo, Henghui Zhu, Zhiguo Wang, Patrick Ng
Preprint, 2024 [PDF (opens new window)]
Selective Demonstrations for Cross-domain Text-to-SQL
Shuaichen Chang, Eric Fosler-Lussier
EMNLP findings, 2023 [PDF (opens new window)] [Code (opens new window)] [Video (opens new window)]
How to Prompt LLMs for Text-to-SQL: A Study in Zero-shot, Single-domain, and Cross-domain Settings
Shuaichen Chang, Eric Fosler-Lussier
NeurIPS TRL, 2023 [PDF (opens new window)] [Code (opens new window)]
Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL Robustness
Shuaichen Chang, Jun Wang, Mingwen Dong, Lin Pan, Henghui Zhu, Alexander Hanbo Li, Wuwei Lan, Sheng Zhang, Jiarong Jiang, Joseph Lilien, Steve Ash, William Yang Wang, Zhiguo Wang, Vittorio Castelli, Patrick Ng, Bing Xiang
ICLR, 2023 (Top 5% Paper (Oral)) [PDF (opens new window)] [Blog (opens new window)] [Data (opens new window)] [Slides (opens new window)][Video (opens new window)]
MapQA: A Dataset for Question Answering on Chorpleth Maps
Shuaichen Chang*, David Palzer*, Jialin Li, Eric Fosler-Lussier, Ningchuan Xiao (* equal contribution)
NeurIPS TRL, 2022 [PDF (opens new window)] [Code (opens new window)]
Explainaboard: An Explainable Leaderboard for NLP
Pengfei Liu, Jinlan Fu, Yang Xiao, Weizhe Yuan, Shuaichen Chang, Junqi Dai, Yixin Liu, Zihuiwen Ye, Zi-Yi Dou, Graham Neubig
ACL, 2021 (Best Demo Paper) [PDF (opens new window)] [Demo (opens new window)]
Prefix-to-SQL: Text-to-SQL Generation from Incomplete User Questions
Naihao Deng, Shuaichen Chang, Peng Shi, Tao Yu, Rui Zhang
Arxiv, 2021 [PDF (opens new window)]
Did You Ask a Good Question? A Cross-Domain Question Intention Classification Benchmark for Text-to-SQL
Yusen Zhang, Xiangyu Dong, Shuaichen Chang, Tao Yu, Peng Shi, Rui Zhang
EMNLP IntEx-SemPar workshop, 2020 [PDF (opens new window)]
Zero-shot Text-to-SQL Learning with Auxiliary Task
Shuaichen Chang, Pengfei Liu, Yun Tang, Jing Huang, Xiaodong He, Bowen Zhou
AAAI, 2020 [PDF (opens new window)]
Contextualized Non-local Neural Networks for Sequence Learning
Pengfei Liu, Shuaichen Chang, Xuanjing Huang, Jian Tang, Jackie Chi Kit Cheung
AAAI, 2019 [PDF (opens new window)]