XIAOYU ZHANG 张晓雨

CV

I am an Assistant Professor at the School of Creative Media, City University of Hong Kong. Prior to that, I was a Postdoc Research Fellow at the ETH AI Center (Zurich, Switzerland), working with Prof. Mrinmaya Sachan and Prof. Torbjörn Netland. I received my Ph.D. degree from the University of California Davis, supervised by Prof. Kwan-Liu Ma; my Master's degree from the State Key Lab of CAD&CG, Zhejiang University, supervised by Prof. Kun Zhou and Prof. Zhong Ren; and my Bachelor’s degree from Xiamen University. My research interests lie broadly in data visualization, human-computer interaction (HCI) and human-AI collaboration. More specifically, I combine visual analysis techniques and natural language processing to explore and exploit knowledge for education, smart manufacturing, and human well-being.
E-mail: xybzhang AT ucdavis.edu
NEWS
[2024.08] I joined the School of Creative Media at City University of Hong Kong as a tenure-track Assistant Professor.
[2023.08] I joined ETH AI Center as a Postdoc Research Fellow!
[2023.06] I graduated from UC Davis with a Ph.D. degree in Computer Science!
[2022.06] Our work, "SliceTeller : A Data Slice-Driven Approach for Machine Learning Model Validation", won the Best Paper Honorable Mention Award on IEEE VIS 2021!
[2022.05] I received the "2022 GGCS Best Gradaute Researcher Award" from Department of Computer Science, UCDavis.
[2022.05] I will intern at Meta this summer. See you in Seattle!
[2021.06] I will intern at Bosch Research this summer.
[2020.12] I passed my qualifying exam and became a Ph.D. candidate now.
PROFESSIONAL EXPERIENCE
PostDoc Fellow: ETH AI Center, ETH Zurich
Aug. 2023 - July 2024
Research Intern: Visual Analytics & eXplainable AI Group, Bosch Research
Sep. 2022 - June 2023
Research Data Scientist Intern: Data Infrastructure Group, Meta
May 2022 - Aug 2022
Research Intern: Visual Analytics & eXplainable AI Group, Bosch Research
June 2021 - Apr. 2022
Research Intern: Visual Computing Group, Microsoft Research Asia
May 2018 - Aug 2018
Senior Research & Development Intern: Game Engine Group, NetEase Games Inc.
Jan. 2017 - Mar. 2017
Visiting Scholar: Surgical Simulation Research Lab, University of Alberta
Mar. 2016 - Sep. 2016
Research Assistant: Department of Computer Science, Hong Kong University
July 2014 - Sep. 2014
PUBLICATIONS
2024
Harmonizing Assistance: Moderating Visual and Textual Aids in AI-Enhanced Textbook Reading with IRead
Xiaoyu Zhang*, Vincent Dörig*, Peng Cui, Vilém Zouhar, Torbjörn Netland, Mrinmaya Sachan
(* equally contributed)
Preprint
Preprint Live Demo Project Page
How to Engage Your Readers? Generating Guiding Questions to Promote Active Reading
Peng Cui, Vilém Zouhar, Xiaoyu Zhang, Mrinmaya Sachan
The 62nd Annual Meeting of the Association for Computational Linguistics (ACL), 2024.
PDF Project Page
Slicing, Chatting, and Refining: A Concept-Based Approach for Machine Learning Model Validation with ConceptSlicer
Xiaoyu Zhang, Jorge Ono, Wenbin He, Liang Gou, Mrinmaya Sachan, Kwan-Liu Ma, Liu Ren
In Proceedings of ACM Conference on Intelligent User Interfaces (IUI), 2024.
PDF
2023
ZoombaTogether: A Video Conference Add-on for Generating Interactive Visual Feedback for Online Group Exercise Through Real-Time Pose Tracking
Qingxiaoyang Zhu*, Xiaoyu Zhang*, Shuyan Dai, Noriko Satake, Hao-Chuan Wang
(* equally contributed)
Companion Publication of the 2023 ACM Designing Interactive Systems Conference (DIS), 2023.
PDF Demo Video
ConceptEVA: Concept-Based Interactive Exploration and Customization of Document Summaries
Xiaoyu Zhang, Kelvin Li, Po-Wei Chi, Senthil Chandrasegaran, Kwan-Liu Ma
In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems.
PDF Preview Presentation
LabelVizier: Interactive Validation and Relabeling for Technical Text Annotations from Weak Supervision
Xiaoyu Zhang, Xiwei Xuan, Alden Dima, Thurston Sexton, and Kwan-Liu Ma
In Proceedings of IEEE Pacific Visualization Symposium (PacificVis), 2023.
PDF Demo Video
2022
SliceTeller: A Data Slice-Driven Approach for Machine Learning Model Validation
🏆 Best Paper Honorable Mentioned
Xiaoyu Zhang*, Jorge Piazentin Ono*, Huan Song, Liang Gou, Kwan-Liu Ma, Liu Ren
(* equally contributed)
IEEE Transactions on Visualization and Computer Graphics (also in Proc. IEEE VIS 2022).
IEEE Xplore
VAC-CNN: A Visual Analytics System for Comparative Studies of Deep Convolutional Neural Networks
Xiwei Xuan, Xiaoyu Zhang, Oh-Hyun Kwon, Kwan-Liu Ma
IEEE Transactions on Visualization and Computer Graphics (also in Proc. PacificVis 2022).
IEEE Xplore
2021
ConceptScope: Organizing and Visualizing Knowledge in Documents based on Domain Ontology
Xiaoyu Zhang, Senthil Chandrasegaran, Kwan-Liu Ma
In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems.
PDF Demo Video Presentation
A Visual Analytics Approach for the Diagnosis of Heterogeneous and Multidimensional Machine Maintenance Data
Xiaoyu Zhang, Takanori Fujiwara, Senthil Chandrasegaran, Michael P. Brundage, Thurston Sexton, Alden Dima, and Kwan-Liu Ma
In Proceedings IEEE Pacific Visualization Symposium (PacificVis), 2021.
IEEE Xplore PDF Demo Video
2020
Using Text Visualization to Aid Analysis of Machine Maintenance Logs
Senthil Chandrasegaran, Xiaoyu Zhang, Kwan-Liu Ma
Model-Based Enterprise Summit (MBE 2020).
PDF
2019
Text-to-viz: Automatic generation of infographics from proportion-related natural language statements
Weiwei Cui, Xiaoyu Zhang, Yun Wang, He Huang, Bei Chen, Lei Fang, Haidong Zhang, Jian-Guan Lou, Dongmei Zhang
IEEE Transactions on Visualization and Computer Graphics (also in Proc. IEEE VIS 2019).
IEEE Xplore PDF
2017
Define Interior Structure for Better Liver Segmentation Based on CT Images
Xiaoyu Zhang, Yixiong Zheng, Bin Zheng
CCF Chinese Conference on Computer Vision, 2017.
Springer PDF
2016
The Approach of Micro-blog Explosive Events Detection and Analysis in Real-time
Yingying She, Qian Wang, Xiaoyu Zhang, Wenyong Zheng, Yao Fu, Qingqiang Wu
In Proceeding of International Conference on Computer Engineering and Information Systems, 2016.
PDF
TEACHING
Instructor (CityU): SM2705 Creative Coding
Undergraduate, Spring 2025
Instructor (CityU): SM1103 Introduction to Media Computing
Undergraduate, Fall 2024
Lecturer (ETH Zurich): 263-5051-00L AI Center Projects in Machine Learning Research
Graduate, Spring 2024
Guest Lecturer (UC Davis): ECS273 Visual Analytics
Graduate, Winter 2023
Guest Lecturer (UC Davis): ECS272 Information Visualization
Graduate, Fall 2022
Instructor (UC Davis): ECS32B Introduction to Data Structures
Undergraduate, Summer 2022
Co-Instructor (UC Davis): ECS289H AI for Visualizing Data
Graduate, Win 2022
Teaching Assistant (UC Davis): ECS32B Introduction to Data Structures
Undergraduate, Fall 2019
Teaching Assistant (UC Davis): ECS36C Data Structures
Undergraduate, Spring 2019
Teaching Assistant (UC Davis): ECS32B Introduction to Data Structures
Undergraduate, Win 2019
SERVICE
Organization member: AI and the Future Factory at AI House Davos 2024
2024
Organizer: VIS Meetup for 6th Workshop on Visualization for AI Explainability
2023
Reviewer: IEEE Visualization Conference (VIS)
2022, 2023
Reviewer: ACM CHI Conference on Human Factors in Computing Systems
2022, 2023, 2024, 2025
Reviewer: EG/VGTC Conference on Visualization (EuroVis)
2024
Reviewer: ACM Conference on Intelligent User Interfaces (IUI)
2022
Reviewer: ACM Transactions on Interactive Intelligent Systems
2022
Volunteer: Bay Area Science Festival 2022
2022
President: ZJU Toastmasters Speech Club, Toastmasters International
2017
Volunteer: Siggraph Asia 2016
2016
INVITED TALKS
Use of Color in Reporting Academic Results
Oct. 2024
KLIC Academic Seminar
Interactive Human-AI Collaboration for Knowledge Exploration and Exploitation
Aug. 2024
Digital Doman x CityU Faculty Symposium
Fight or Friend? Unraveling the New Evolution of Education with VISxLLM
Oct. 2023
Lightning Talk at 6th Workshop on Visualization for AI Explainability, VIS 2023
NLP x Visualization for Interactive Knowledge Exploration and Exploitation
Sep. 2023
Meta x ETH AI Center Fellow Symposium
Visual Analytics for Knowledge Exploration and Exploitation in Industry 4.0
Aug. 2023
VAT Valves x ETH AI Center Fellow Symposium
Visual Text Analytics
Jan. 2023
Guest Lecture for ECS273 Visual Analytics, University of California, Davis
Visual Analytics for Knowledge Exploration and Exploitation
Nov. 2022
Lab Tour for San Joaquin Delta College Student, University of California, Davis
Visual Analytics for Knowledge Exploration and Exploitation
Oct. 2022
Center of Digital Media Computation, Xiamen University
Text Data Visualization
Oct. 2022
Guest Lecture for ECS272 Information Visualization, University of California, Davis
Visual Analytics for Knowledge Exploration and Exploitation
Oct.2022
Envision UC Davis, University of California, Davis
Text Data Visualization
Feb. 2022
Guest Lecture for ECS289H AI for Visualizing Data, University of California, Davis
All Rights Reserved © Xiaoyu Zhang, Takanori Fujiwara