Ziyi Kou

Ph.D., Computer Science and Egnineering, University of Notre Dame

I am a research scientist at Meta Reality Lab. I obtained my Ph.D. degree from Computer Science and Engineering (CSE) department at University of Notre Dame. My advisor is Dr. Xiangliang Zhang. My research focuses on multimodal foundational AI, visual-language-action learning and 3D generative computer vision. I received my master's degree of Computer Science from University of Rochester and my bachelor's degree of Software Engineering from Chongqing University.

Linkedin: ziyi-kou-087200176
Google Scholar: Ziyi Kou - Google Scholar
Github: github.com/arxrean
Email: [email protected]

Education

Aug. 2020 - May 2024

University of Notre Dame
Ph.D., Computer Science and Engineering Courses: Text Mining, Algorithm and Complexity, Operating System, Computer Graphic
Aug. 2018 - May 2020

University of Rochester
M.S. Computer Science Courses: Artificial Intelligence, Adv. Topic of Computer Vision, Intro. of Statistics, Machine Learning
Sept. 2014 - Jun. 2018

Chongqing University, China
B.S. Software Engineering Courses: Java Programming, Data Mining with Python, Web Development, Database Design, Android Programming

Recent Work Experience

June. 2024 - Present

Research Scientist
Meta Multi-Modal Foundational Computer Vision
Dec. 2023 - Mar. 2024

Research Scientist Intern
Meta Visual Knowledge Transfer for 3D Glove Tracking in VR
June. 2023 - Aug. 2023

Applied Scientist Intern
Amazon Graph Neural Network Based Customer Insotck Value Estimation. Received return incline offer.
Oct. 2022 - Feb. 2023

Machine Learning Engineer Intern
Instacart Graph Based Next-Basket Recommendation. Published at CIKM2023.
May. 2022 - Aug. 2022

Machine Learning Engineer Intern
Godaddy Inc. Multi-relational Graph Based Recommendation. Received return intern offer.

My Skills

Programming

Machine Learning

Technical App.

Awards

Notre Dame CSE Outstanding Research Award, 2023
3rd Winner of Ebay University Machine Learning Competition - Simi-Supervised Name Entity Recognition, 2023
Winner of Sequential Dynamic Molecular Prediction AI Competition, Argonne US National Lab, 2022
Bronze Medal for H&M Fashion Recommendations, Kaggle 2022
PhD Student Travel Grants, IEEE INFOCOM and IEEE BigData
Graduate Tuition Scholarship, University of Rochester 2018

Main Publications

RAt: Injecting Implicit Bias for Text-To-Image Prompt Refinement Models, 1st Author, EMNLP'24
FaDE: A Face Segment Driven Identity Anonymization Framework For Fair Face Recognition, 1st Author, CIKM'24
LeMon: Automating Portrait Generation for Zero-Shot Story Visualization with Multi-Character Interactions, 1st Author, KDD'24
Modeling Sequential Collaborative User Behaviors for Seller-aware Next Basket Recommendation, 1st Author, CIKM'23
A Controllable Prompt Adversarial Attacking Framework for Black-Box Text Guided Image Generation Models, 1st Author, IJCAI'23
A Crowd-AI Duo Relational Graph Learning Framework Towards Social Impact Aware Photo Classification, 2nd Author, AAAI'23
A Web Crowdsourcing Based Face Partition Approach Towards Privacy-Aware Face Recognition, 1st Author, WWW'22
A Duo-Generative Approach to Explainable Multimodal COVID-19 Misinformation Detection, co-1st Author, WWW'22
Human-AI Interaction Towards Natural Language Explanation based COVID-19 Misinformation Detection, 1st Author, IJCAI'22
A Crowdsourcing Multi-Modal Knowledge Graph Approach to Explainable Fauxtography Detection, 1st Author, CSCW'22
A Hierarchical Crowdsource Knowledge Graph Approach to Explainable COVID-19 Misinformation Detection, 1st Author, GROUP'22
Improve CAM with Auto-adapted Segmentation and Co-supervised Augmentation, 1st Author, WACV'21
ExgFair: A Crowdsourcing Data Exchange Approach To Fair Human Face Datasets Augmentation, 1st Author, BigData'21
Faircrowd: Fair human face dataset sampling via batch-level crowdsourcing bias inference, 1st Author, IWQOS'21
What comprises a good talking-head video generation, co-1st Author, CVPRW'20
Exfaux: A weakly supervised approach to explainable fauxtography detection, 1st Author, BigData'20

Ziyi Kou

Ph.D., Computer Science and Egnineering, University of Notre Dame

Education

University of Notre Dame

University of Rochester

Chongqing University, China

Recent Work Experience

Research Scientist

Research Scientist Intern

Applied Scientist Intern