Wentong Li 李文通

PhD Student

Zhejiang University
Email: liwentong@zju.edu.cn

About me

I am a Ph.D. student at College of Computer Science and Technology, Zhejiang University, fortunately supervised by Prof. Jianke Zhu and Prof. Lei Zhang (PolyU, HK). My recent research interests are multimodal large language models, vision-language models and open-world segmentation. Before, I mainly focus on the field of the techniques for object detection, image segmentaion under minimal human supervision, including label-efficient /weakly-supervised /un-supervised approaches. Besides, I am also interested in autonomous driving tasks (HD-Map, 3D-Occupancy, etc.) and 3D reconstruction tasks.

Publications

Osprey: Pixel Understanding with Visual Instruction Tuning🔥

Yuqian Yuan*, Wentong Li*, Jian Liu, Dongqi Tang, Xinjie Luo, Chi Qin, Lei Zhang, Jianke Zhu

CVPR2024, welcome to try our online demo.

[paper] [code] [online demo] [video demo] [中文解读]

Box2Mask: Box-supervised Instance Segmentation via Level-set Evolution

Wentong Li, Wenyu Liu, Jianke Zhu, Miaomiao Cui, Risheng Yu, Xiansheng Hua, Lei Zhang

T-PAMI, 2024

[paper] [code(BoxInstSeg)] [code]

Label-efficient Segmentation via Affinity Propagation

Wentong Li*, Yuqian Yuan*, Song Wang, Wenyu Liu, Dongqi Tang, Jian Liu, Jianke Zhu, Lei Zhang

NeurIPS, 2023

[paper] [code] [project page] [中文解读]

Point2Mask: Point-supervised Panoptic Segmentation via Optimal Transport

Wentong Li, Yuqian Yuan, Song Wang, Jianke Zhu, Jianshu Li, Jian Liu, Lei Zhang

ICCV, 2023

[paper] [code]

H2RBox: Horizontal Box Annotation is All You Need for Oriented Object Detection

Xue Yang, Gefan Zhang, Wentong Li, Xuehui Wang, Yue Zhou, Junchi Yan

ICLR, 2023

[paper] [code(MMRotate)] [code(Jittor)]

Box-supervised Instance Segmentation with Level Set Evolution

Wentong Li, Wenyu Liu, Jianke Zhu, Miaomiao Cui, Xiansheng Hua, Lei Zhang

ECCV, 2022

[paper] [code]

Oriented RepPoints for Aerial Object Detection

Wentong Li, Yijie Chen, Kaixuan Hu, Jianke Zhu

CVPR, 2022

[paper] [code(MMDetection)] [code(MMRotate)]

Multi-scale Object Detection in Satellite Imagery Based on YOLT

Wentong Li, Wanyi Li, Feng Yang, Peng Wang

IGARSS, 2019

[paper]

MGMap: Mask-Guided Learning for Online Vectorized HD Map Construction

Xiaolu Liu, Song Wang, Wentong Li, Ruizi Yang, Junbo Chen, Jianke Zhu

CVPR, 2024

[paper] [code]

Not All Voxels Are Equal: Hardness-Aware Semantic Scene Completion with Self-Distillation

Song Wang, Jiawei Yu, Wentong Li, Wenyu Liu, Junbo Chen, Jianke Zhu

CVPR, 2024

[paper] [code]

Fine-Grained Multi-View Hand Reconstruction Using Inverse Rendering

Qiqun Gan, Wentong Li, Jinwei Ren, Jianke Zhu

AAAI, 2024

[paper] [code]

LiDAR2Map: In Defense of LiDAR-Based Semantic Map Construction Using Online Camera Distillation

Song Wang, Wentong Li, Wenyu Liu, Xiaolu Liu, Jianke Zhu

CVPR, 2023

[paper] [code]

Improving Nighttime Driving-Scene Segmentation via Dual Image-adaptive Learnable Filters

Wenyu Liu, Wentong Li, Jianke Zhu, Miaomiao Cui, Xuansong Xie, Lei Zhang

T-CSVT, 2023

[paper] [code]

Translational Symmetry-Aware Facade Parsing for 3-D Building Reconstruction

Hantang Liu, Wentong Li, Jianke Zhu

IEEE MultiMedia, 2022

[paper]

Honors

Tencent Scholarship, 2023
Five-A Postgraduate Student, 2023
Outstanding Postgraduate Student, 2020-2023
Longhu Scholarship, 2022
First-class Academic Scholarship, 2018-2023
National Scholarship, 2016

Research Intern

AntGroup | HangZhou | Dec.2022 - Present
Topic: Label-efficient Segmentation, MLLM
DAMO Academy | HangZhou | July.2020 - Oct.2020
Topic: Oriented Object Detection, Instance Segmentation
Institution of Automation, CAS | Beijing | July.2018 - June.2019
Topic: Object Detection, Remote Sensing Image

Academic Services

Conference Reviewer:
CVPR2024, ICLR2024, ICML2024, ECCV2024, ACM MM2024
CVPR2023, ICCV2023, NeurIPS2023, ACM MM2023
Journal Reviewer:
Pattern Recognition
Transactions on Circuits and Systems for Video Technology
Transactions on Geoscience and Remote Sensing
ACM Computing Surveys
ISPRS Journal of Photogrammetry and Remote Sensing
Neurcomputing

Tech. Talks

AI TIME-大模型嘉年华, Osprey:Pixel Understanding with Visual Instruction Tuning, Video, slides, 2024/01.

Teaching Assistant

Teaching Assistant, Police Brain of Zhejiang Province, Image Processing and Analysis, Fall 2022.
Teaching Assistant, FDS2021: Foundation of Data Structure, Fall 2021.