Bingsheng Arthur Yao

Associate Research Scientist at Northeastern University

profile-square.jpeg

I am an associate research scientist in the Khoury College of Computer Sciences at Northeastern University (PI: Prof. Dakuo Wang). I received my PhD from Rensselaer Polytechnic Institute, advised by Prof. Jim Hendler.

My research lies at the intersection of Human-Computer Interaction (HCI) and Natural Language Processing (NLP), with two primary interests:

I. Design, Develop, and Evaluate Human-Centered NLP Systems
Particularly in medical and healthcare, we engage multi-stakeholders to design and validate AI/LLM-driven multi-modal intelligent systems for remote patient monitoring (RPM), patient-provider communication, and clinical decision-makings [1, 2, 3, 4].

II. Design LLM/AI Agents To Effectively Establish Mutual Human-Agent Collaboration
I envision a near future where AI agents will work with us, not for us, becoming functionally indistinguishable from any other remote human collaborator. The research roadmap in this direction is bifolds: 1) design and evaluate AI agents to think and behave collaboratively; 2) design interface and interaction patterns to establish mutual human-agent collaboration through the lens of remote collaboration with decades of knowledge about what makes remote teams trust each other, share context, and coordinate effectively [1, 2, 3].

Our Human-Centered AI (NEU-HAI) Lab is actively recruiting self-motivated research assistants, Ph.D. students, and postdocs. Please check our lab website. If you are interested in working with me directly, please email me with a description of your skills, research interest, and attach your cv.

Note

Please refer to my Google Scholar page for the most up-to-date publication record.

The best way to reach out is through emails: b [dot] yao [at] northeastern [dot] edu.


News

2025.02 Co-first authored paper Survey of LLM Role-Playing Agent Evaluation is now publically available on arXiv
2025.01 Five papers were accepted to CHI 2025. Thanks for the hard working by collaborators and mentees!
2024.10 Our paper StorySparkQA Dataset with Real-World Knowledge for Children Education was accepted to EMNLP 2024
2024.09 Our paper Secret Use of Large Language Models was accepted to CSCW 2025
2024.07 Our paper Early Sepsis Prediction with Uncertainty Quantification and Active Sensing was accepted to KDD 2024
2024.04 Our paper LLM-based Voice Assistant for Asynchronous Older Adults-Care Provider Communication and Mental-LLM were accepted to IMWUT 2024
2024.03 First-authored paper In-Context Sampling Strategy for Reliable LLM Prompting was accepted to NAACL 2024 Findings
2024.03 Guest talk at USC titled “Bridging AI Research and Real-world Scenarios”. Thanks Prof. Yao Du for the invitation!
2024.02 I am joining Prof. Dakuo Wang’s Human-Centered AI Lab at Northeastern University as a postdoc associate!
2024.01 Two of our papers, Human-AI Collaboration in Sepsis Diagnosis and User’s Sensitive Disclosure with LLM were accepted to CHI 2024
2024.01 I passed the Ph.D. dissertation defense. My deepest gratitude to all those who supported and helped me, especially Prof. Jim Hendler and Prof. Dakuo Wang
2023.10 Our paper, Discourse Framework for Science Journalism, was accepted to EMNLP 2023, and another first-authored paper, Active Learning Empowered by Natural Language Explanations, was accepted to EMNLP 2023 Findings
2023.07 First-authored paper Objective Evaluation of Human Explanations was accepted to ACL 2023 for Oral Presentation
2022.05 Two first-authored papers, QA-Pair Generation for Story Books and FairytaleQA Dataset were accepted to ACL 2022
2022.04 Our paper StoryBuddy was accepted to CHI 2022
2021.09 Our paper Narrative Open-Domain QA Techniques was accepted to TACL (2021) 9
2020.03 Our paper Trust in AutoML was accepted to IUI 2020