Research

Our pioneering research has been recognized in top-tier publications across AI (TPAMI, IJCV, NeurIPS, ICLR, CVPR, ICCV, ECCV), robotics (ICRA, IROS), and interdisciplinary fields (Cell Patterns, CACIE, BIB), reflecting our commitment to advancing science through impactful and innovative contributions.

Highlighted

X-Fi: A Modality-Invariant Foundation Model for Multimodal Human Sensing

Xinyan Chen, Jianfei Yang

ICLR 2025  ·  22 Jan 2025  ·  arXiv:2410.10167

Paper

Github

Website

multimodal-learning foundation-model

REI-Bench: Can Embodied Agents Understand Vague Human Instructions in Task Planning?

Chenxi Jiang, Chuhao Zhou, Jianfei Yang

arXiv 2025  ·  19 May 2025  ·  arXiv:2505.10872

Paper

Github

Website

robot-task-planning vagueness llms

HoloLLM: Multisensory Foundation Model for Language-Grounded Human Sensing and Reasoning

Chuhao Zhou, Jianfei Yang

NeurIPS 2025  ·  23 May 2025  ·  arXiv:2505.17645

Paper

Github

Website

multisensory-foundation-model human-perception-and-reasoning

All

2025

HoloLLM: Multisensory Foundation Model for Language-Grounded Human Sensing and Reasoning

Chuhao Zhou, Jianfei Yang

NeurIPS 2025  ·  23 May 2025  ·  arXiv:2505.17645

Paper

Github

Website

multisensory-foundation-model human-perception-and-reasoning

REI-Bench: Can Embodied Agents Understand Vague Human Instructions in Task Planning?

Chenxi Jiang, Chuhao Zhou, Jianfei Yang

arXiv 2025  ·  19 May 2025  ·  arXiv:2505.10872

Paper

Github

Website

robot-task-planning vagueness llms

Latte++: Spatial-Temporal Voxel-based Test-Time Adaptation for Multi-Modal Segmentation

Haozhi Cao, Yuecong Xu, Pengyu Yin, Xingyu Ji, Shenghai Yuan, Jianfei Yang, Lihua Xie

European Conference on Computer Vision (ECCV), 2024  ·  27 Feb 2025  ·  arxiv:2403.06461

Paper

Github

Website

multimodal-learning test-time-adaptation

X-Fi: A Modality-Invariant Foundation Model for Multimodal Human Sensing

Xinyan Chen, Jianfei Yang

ICLR 2025  ·  22 Jan 2025  ·  arXiv:2410.10167

Paper

Github

Website

multimodal-learning foundation-model

2024

Video Unsupervised Domain Adaptation with Deep Learning: A Comprehensive Survey

Yuecong Xu, Haozhi Cao, Lihua Xie, Xiao-li Li, Zhenghua Chen, Jianfei Yang

ACM Computing Surveys  ·  01 Oct 2024  ·  doi:10.1145/3679010

Paper

Github

video-domain-adaptation survey

MoPA: Multi-Modal Prior Aided Domain Adaptation for 3D Semantic Segmentation

Haozhi Cao, Yuecong Xu, Jianfei Yang, Pengyu Yin, Shenghai Yuan, Lihua Xie

2024 IEEE International Conference on Robotics and Automation (ICRA)  ·  13 May 2024  ·  doi:10.1109/ICRA57147.2024.10610316

Arxiv

Github

multimodal-learning domain-adaptation 3d-semantic-segmentation

Can We Evaluate Domain Adaptation Models Without Target-Domain Labels?

Jianfei Yang, Hanjie Qian, Yuecong Xu, Kai Wang, Lihua Xie

ICLR 2024  ·  01 Jan 2024  ·  doi:10.48550/arXiv.2305.18712

Github

Website

Paper

domain-adaptation unsupervised-evaluation model-selection

2023

Going Deeper into Recognizing Actions in Dark Environments: A Comprehensive Benchmark Study

Yuecong Xu, Haozhi Cao, Jianxiong Yin, Zhenghua Chen, Xiaoli Li, Zhengguo Li, Qianwen Xu, Jianfei Yang

International Journal of Computer Vision  ·  08 Nov 2023  ·  doi:10.1007/s11263-023-01932-5

Arxiv

Multi-Modal Continual Test-Time Adaptation for 3D Semantic Segmentation

Haozhi Cao, Yuecong Xu, Jianfei Yang, Pengyu Yin, Shenghai Yuan, Lihua Xie

2023 IEEE/CVF International Conference on Computer Vision (ICCV)  ·  01 Oct 2023  ·  doi:10.1109/ICCV51070.2023.01724

Paper

Website

multimodal-learning test-time-adaptation

MetaFi++: WiFi-Enabled Transformer-Based Human Pose Estimation for Metaverse Avatar Simulation

Yunjiao Zhou, He Huang, Shenghai Yuan, Han Zou, Lihua Xie, Jianfei Yang

IEEE Internet of Things Journal (IoT-J)  ·  15 Aug 2023  ·  doi:10.1109/JIOT.2023.3262940

Paper

Github

human-pose-estimation wifi-sensing

MM-Fi: Multi-Modal Non-Intrusive 4D Human Dataset for Versatile Wireless Sensing

Jianfei Yang, He Huang, Yunjiao Zhou, Xinyan Chen, Yuecong Xu, Shenghai Yuan, Han Zou, Chris Xiaoxuan Lu, Lihua Xie

NeurIPS 2023 Datasets and Benchmarks Track  ·  11 May 2023  ·  arxiv:2305.10345

The world-first multi-modal non-intrusive 4D human dataset (RGB, Depth, LiDAR, mmWave, WiFi).

Paper

Github

Website

multimodal-dataset 4d-human-sensing human-pose-estimation non-intrusive-sensing

SenseFi: A library and benchmark on deep-learning-empowered WiFi human sensing

Jianfei Yang, Xinyan Chen, Han Zou, Chris Xiaoxuan Lu, Dazhuo Wang, Sumei Sun, Lihua Xie

Patterns, Cell Press  ·  10 Mar 2023  ·  doi:10.1016/j.patter.2023.100703

The world-first open-source benchmark on deep learning-empowered WiFi sensing.

Paper

Github

wifi-sensing benchmark

Divide to Adapt: Mitigating Confirmation Bias for Domain Adaptation of Black-Box Predictors

Jianfei Yang, Xiangyu Peng, Kai Wang, Zheng Zhu, Jiashi Feng, Lihua Xie, Yang You

ICLR 2023  ·  01 Jan 2023  ·  arXiv:2205.14467

Paper

Github

domain-adaptation trustworthy-ai