My name is Liyan Tang (唐立言 in Chinese). I’m a fourth-year Ph.D. student in Computer Science from the TAUR Lab (Text Analysis, Understanding, and Reasoning) at UT Austin advised by Greg Durrett. I have been fortunate to work with Ying Ding from UT iSchool, Yifan Peng from Weill Cornell Medicine and Justin F. Rousseau from UT Southwestern Medical Center (alphabetical order). My research focuses on text generation and evaluation (especially on hallucination evaluation), as well as their applications in the clinical domain.

I’m having a research internship at Bespoke Labs (startup). Check out our SOTA fact-checking model Bespoke-MiniCheck-7B on the LLM-AggreFact leaderboard across 11 hulluciantion detection datasets and the real-time demo based on my MiniCheck paper.

---

Publications

2024

MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents
Liyan Tang, Philippe Laban, Greg Durrett
Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024.

TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarization
Liyan Tang, Igor Shalyminov, Amy Wing-mei Wong, Jon Burnsky, Jake W. Vincent, Yu’an Yang, Siffi Singh, Song Feng, Hwanjun Song, Hang Su, Lijia Sun, Yi Zhang, Saab Mansour, Kathleen McKeown
Proceedings of the North American Chapter of the Association for Computational Linguistic (NAACL), 2024.

2023

Evaluating Large Language Models on Medical Evidence Summarization
Liyan Tang, Zhaoyi Sun, Betina Idnay, Jordan G Nestor, Ali Soroush, Pierre A. Elias, Ziyang Xu, Ying Ding, Greg Durrett, Justin Rousseau, Chunhua Weng, Yifan Peng
npj Digital Medicine, 2023

Less Likely Brainstorming: Using Language Models to Generate Alternative Hypotheses
Liyan Tang, Yifan Peng, Yanshan Wang, Ying Ding, Greg Durrett and Justin F. Rousseau
Findings of the Annual Meeting of the Association for Computational Linguistics (ACL), 2023.

Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors
Liyan Tang, Tanya Goyal, Alexander R. Fabbri, Philippe Laban, Jiacheng Xu, Semih Yavuz, Wojciech Kryściński, Justin F. Rousseau, Greg Durrett
Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), 2023.

Evaluating GPT4 on Impressions Generation in Radiology Reports
Zhaoyi Sun, Hanley Ong, Patrick Kennedy, Liyan Tang, Shirley Chen, Jonathan Elias, Eugene Lucas, George Shih, Yifan Peng
Radiology, 2023

2022

EchoGen: Generating Conclusions from Echocardiogram Notes
Liyan Tang, Shravan Kooragayalu, Yanshan Wang, Ying Ding, Greg Durrett, Justin F. Rousseau, Yifan Peng
Proceedings of the Workshop on Biomedical Language Processing (BioNLP) @ ACL, 2022.

Trustworthy Assertion Classification through Prompting
Song Wang, Liyan Tang, Akash Majety, Justin F. Rousseau, George Shih, Ying Ding, Yifan Peng
Journal of Biomedical Informatics, 2022.

Prior Knowledge Enhances Radiology Report Generation
Song Wang, Liyan Tang, Mingquan Lin, George Shih, Ying Ding, Yifan Peng
Proceedings of American Medical Informatics Association (AMIA) Informatics Summit, 2022.

2021

Making Document-Level Information Extraction Right for the Right Reasons
Liyan Tang, Dhruv Rajan, Suyash Mohan, Abhijeet Pradhan, R. Nick Bryan, Greg Durrett

RadBERT-CL: Factually-Aware Contrastive Learning For Radiology Report Classification
Ajay Jaiswal, Liyan Tang, Meheli Ghosh, Justin Rousseau, Yifan Peng, and Ying Ding
Proceedings of Machine Learning for Health, 2021.

Using Radiomics as Prior Knowledge for Abnormality Classification and Localization in Chest X-rays
Yan Han, Chongyan Chen, Liyan Tang, Mingquan Lin, Ajay Jaiswal, Ying Ding, Yifan Peng
Proceedings of American Medical Informatics Association (AMIA) Annual Symposium, 2021.

---

News

06/03/2023: Research Internship at Bespoke Labs (startup).
12/16/2023: Completed my Master of Science degree in Computer Science at UT Austin.
05/15/2023: Applied Scientist Internship at Amazon, WA.
08/25/2021: Started my PhD at UT Austin.
05/14/2021: Completed my Bachelor of Science degree in Mathematics at UT Austin.