Zudi Lin

Amazon AGI
55 Pier 4 Boulevard
Boston, MA 02210

About Me

I am an Applied Scientist at Amazon AGI. I obtained my Ph.D. degree in Computer Science in 2022 from the John A. Paulson School of Engineering and Applied Sciences at Harvard University, advised by Prof. Hanspeter Pfister. I also worked closely with Prof. Jeff W. Lichtman. I obtained M.S. in Computer Science from Harvard University in 2020 and B.S. in Biological Science from Tsinghua University in 2017.

I am interested in deep learning, with applications in audio, computer vision, and neuroscience. My current work focuses on understanding speech and acoustic events. My previous research topics include semantic and instance segmentation, active learning, unsupervised learning, and the analysis of comprehensive neuron connectivity in microscopy images of animal brains. I am the author of PyTC PyTorch Connectomics.

Experience

Applied Scientist II | Amazon AGI
Time: Jun 2022 - Present.

Research Assistant | School of Engineering and Applied Sciences, Harvard University
Time: Aug 2017 - Jun 2022. Advisor: Prof. Hanspeter Pfister

Applied Scientist Intern | Amazon Web Services (AWS)
Time: May 2021 - Sep 2021. Mentor: Dr. Erhan Bas

Research Intern | Mitsubishi Electric Research Laboratories (MERL)
Time: May 2019 - Aug 2019. Mentor: Dr. Ziming Zhang

Publications [Google Scholar] [DBLP]

Multiplexed Volumetric CLEM enabled by scFvs Provides Insights into the Cytology of Cerebellar Cortex
Xiaomeng Han, Xiaotang Lu, Peter H Li, Shuohong Wang, Richard Schalek, Yaron Meirovitch, Zudi Lin, Jason Adhinarta, Karl D Murray, Leah M MacNiven, Daniel R Berger, Yuelong Wu, Tao Fang, Elif Sevde Meral, Shadnan Asraf, Hidde Ploegh, Hanspeter Pfister, Donglai Wei, Viren Jain, James S Trimmer, Jeff W. Lichtman
Nature Communications, 2024
[Paper] [bioRxiv] - [Harvard Gazette]

A Petavoxel Fragment of Human Cerebral Cortex Reconstructed at Nanoscale Resolution
Alexander Shapson-Coe, Michał Januszewski, Daniel R Berger, Art Pope, Yuelong Wu, Tim Blakely, Richard L Schalek, Peter H Li, Shuohong Wang, Jeremy Maitin-Shepard, Neha Karlupia, Sven Dorkenwald, Evelina Sjostedt, Laramie Leavitt, Dongil Lee, Jakob Troidl, Forrest Collman, Luke Bailey, Angerica Fitzmaurice, Rohin Kar, Benjamin Field, Hank Wu, Julian Wagner-Carena, David Aley, Joanna Lau, Zudi Lin, Donglai Wei, Hanspeter Pfister, Adi Peleg, Viren Jain, and Jeff W. Lichtman
Science, 2024
[Paper] [Dataset] - [CNN] [Nature] [Google AI Blog] [MIT Tech Review] [Scientific American]

Structure-Preserving Instance Segmentation via Skeleton-Aware Distance Transform
Zudi Lin, Donglai Wei, Aarush Gupta, Xingyu Liu, Deqing Sun, and Hanspeter Pfister
Medical Image Computing and Computer Assisted Interventions (MICCAI), 2023
[Paper] [arXiv] [Code]
Oral Presentation

Dense 4D Nanoscale Reconstruction of Living Brain Tissue
Philipp Velicky, Eder Miguel, Julia M. Michalska, Julia Lyudchik, Donglai Wei, Zudi Lin, Jake F. Watson, Jakob Troidl, Johanna Beyer, Yoav Ben-Simon, Christoph Sommer, Wiebke Jahr, Alban Cenameri, Johannes Broichhagen, Seth G. N. Grant, Peter Jonas, Gaia Novarino, Hanspeter Pfister, Bernd Bickel, and Johann G. Danzl
Nature Methods, 2023
[Paper] [bioRxiv] [Code] - [The Medical News] [Bioengineer.org]

Current Progress and Challenges in Large-scale 3D Mitochondria Instance Segmentation
Daniel Franco-Barranco, Zudi Lin, Won-Dong Jang, Xueying Wang, Qijia Shen, Wenjie Yin, Yutian Fan, Mingxing Li, Chang Chen, Zhiwei Xiong, Rui Xin, Hao Liu, Huai Chen, Zhili Li, Jie Zhao, Xuejin Chen, Constantin Pape, Ryan Conrad, Jozefus De Folter, Luke Nightingale, Martin Jones, Yanling Liu, Dorsa Ziaei, Stephan Huschauer, Ignacio Arganda-Carreras, Hanspeter Pfister, and Donglai Wei
IEEE Transactions on Medical Imaging (TMI), 2023
[Paper] [TechRxiv] [Code] - [Grand Challenge]

Domain-Scalable Unpaired Image Translation via Latent Space Anchoring
Siyu Huang, Jie An, Donglai Wei, Zudi Lin, Jiebo Luo, and Hanspeter Pfister
IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), 2023
[Paper] [Code]

3D Domain Adaptive Instance Segmentation via Cyclic Segmentation GANs
Leander Lauenburg, Zudi Lin, Ruihan Zhang, Márcia dos Santos, Siyu Huang, Ignacio Arganda-Carreras, Edward S. Boyden, Hanspeter Pfister, and Donglai Wei
IEEE Journal of Biomedical and Health Informatics (J-BHI), 2023
[Paper] [arXiv] [Project Page] [Code]

CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusion
Zixiang Zhao, Haowen Bai, Jiangshe Zhang, Yulun Zhang, Shuang Xu, Zudi Lin, Radu Timofte, and Luc Van Gool
Computer Vision and Pattern Recognition (CVPR), 2023
[Paper] [arXiv] [Code]

Relaxing Contrastiveness in Multimodal Representation Learning
Zudi Lin, Erhan Bas, Kunwar Yashraj Singh, Gurumurthy Swaminathan, and Rahul Bhotika
Winter Conference on Applications of Computer Vision (WACV), 2023
[Paper] [Amazon Science]

MST++: Multi-stage Spectral-wise Transformer for Efficient Spectral Reconstruction
Yuanhao Cai, Jing Lin, Zudi Lin, Haoqian Wang, Yulun Zhang, Hanspeter Pfister, Radu Timofte, and Luc Van Gool
Computer Vision and Pattern Recognition Workshops (CVPRW), 2022
[Paper] [arXiv] [Code] [Challenge Paper]
Winner of NTIRE 2022 Challenge on Spectral Reconstruction

Texture-based Error Analysis for Image Super-Resolution
Salma Abdel Magid, Zudi Lin, Donglai Wei, Yulun Zhang, Jinjin Gu and Hanspeter Pfister
Computer Vision and Pattern Recognition (CVPR), 2022
[Paper]

YouMVOS: An Actor-centric Multi-shot Video Object Segmentation Dataset
Donglai Wei, Siddhant Kharbanda, Sarthak Arora, Roshan Roy, Nishant Jain, Akash Palrecha, Tanav Shah, Shray Mathur, Abhijay Kemkar, Ritik Mathur, Anirudh Chakravarthy, Zudi Lin, Won-Dong Jang, Yansong Tang, Song Bai, James Tompkin, Philip Torr and Hanspeter Pfister
Computer Vision and Pattern Recognition (CVPR), 2022
[Paper] [Project Page]

Discrete Cosine Transform Network for Guided Depth Super-Resolution
Zixiang Zhao, Jiangshe Zhang, Shuang Xu, Zudi Lin and Hanspeter Pfister
Computer Vision and Pattern Recognition (CVPR), 2022
[Paper] [arXiv] [Code]
Oral Presentation

PyTorch Connectomics: A Scalable and Flexible Segmentation Framework for EM Connectomics
Zudi Lin, Donglai Wei, Jeff Lichtman and Hanspeter Pfister
arXiv preprint arXiv:2112.05754, 2021
[arXiv] [Code] - [Documentation]

Dynamic High-Pass Filtering and Multi-Spectral Attention for Image Super-Resolution
Salma Abdel Magid, Yulun Zhang, Donglai Wei, Won-Dong Jang, Zudi Lin, Yun Fu and Hanspeter Pfister
International Conference on Computer Vision (ICCV), 2021
[Paper] [Code]

Asymmetric 3D Context Fusion for Universal Lesion Detection
Jiancheng Yang, Yi He, Kaiming Kuang, Zudi Lin, Hanspeter Pfister and Bingbing Ni
Medical Image Computing and Computer Assisted Interventions (MICCAI), 2021
[Paper] [arXiv] [Code]

NucMM Dataset: 3D Neuronal Nuclei Instance Segmentation at Sub-Cubic Millimeter Scale
Zudi Lin, Donglai Wei, Mariela D. Petkova, Yuelong Wu, Zergham Ahmed, Krishna Swaroop K, Silin Zou, Nils Wendt, Jonathan Boulanger-Weill, Xueying Wang, Nagaraju Dhanyasi, Ignacio Arganda-Carreras, Florian Engert, Jeff Lichtman and Hanspeter Pfister
Medical Image Computing and Computer Assisted Interventions (MICCAI), 2021
[Paper] [arXiv] [Code] [Project Page]
Student Travel Award

AxonEM Dataset: 3D Axon Instance Segmentation of Brain Cortical Regions
Donglai Wei, Kisuk Lee, Hanyu Li, Ran Lu, J. Alexander Bae, Zequan Liu, Lifu Zhang, Márcia dos Santos, Zudi Lin, Thomas Uram, Xueying Wang, Ignacio Arganda-Carreras, Brian Matejek, Narayanan Kasthuri, Jeff Lichtman and Hanspeter Pfister
Medical Image Computing and Computer Assisted Interventions (MICCAI), 2021
[Paper] [arXiv] [Code] [Project Page]

The Wood Image Analysis and Dataset (WIAD): Open-access Visual Analysis Tools to Advance the Ecological Data Revolution
Tim Rademacher, Bijan Seyednasrollah, David Basler, Jian Cheng, Tessa Mandra, Elise Miller, Zudi Lin, David A Orwig, Neil Pederson, Hanspeter Pfister, Andrew D Richardson, Donglai Wei and Li Yao
Methods in Ecology and Evolution, 2021
[Paper] [bioRxiv]

Two-Stream Active Query Suggestion for Active Learning in Connectomics
Zudi Lin, Donglai Wei, Won-Dong Jang, Siyan Zhou, Xupeng Chen, Xueying Wang, Richard Schalek, Daniel Berger, Adi Suissa-Peleg, Brian Matejek, Lee Kamentsky, Toufiq Parag, Thouis Jones, Daniel Haehn, Jeff Lichtman and Hanspeter Pfister
European Conference on Computer Vision (ECCV), 2020
[Paper] [Supp.] [Code]

MitoEM Dataset: Large-scale 3D Mitochondria Instance Segmentation from EM Images
Donglai Wei, Zudi Lin, Daniel Barranco, Nils Wendt, Xingyu Liu, Wenjie Yin, Xin Huang, Aarush Gupta, Won-Dong Jang, Xueying Wang, Ignacio Arganda-Carreras, Jeff Lichtman, Hanspeter Pfister
Medical Image Computing and Computer Assisted Interventions (MICCAI), 2020
[Paper] [Code] [Tutorial] - [Grand Challenge]

A Topological Nomenclature for 3D Shape Analysis in Connectomics
Abhimanyu Talwar, Zudi Lin, Donglai Wei, Yuesong Wu, Bowen Zheng, Jinglin Zhao, Won-Dong Jang, Xueying Wang, Jeff Lichtman, and Hanspeter Pfister
Computer Vision and Pattern Recognition Workshops (CVPRW), 2020
[Paper] [Code]

White-Box Adversarial Defense via Self-Supervised Data Estimation
Zudi Lin, Hanspeter Pfister and Ziming Zhang
arXiv preprint arXiv:1909.06271, 2019
[arXiv] [Code]

FDive: Learning Relevance Models using Pattern-based Similarity Measures
Frederik Dennig, Tom Polk, Zudi Lin, Tobias Schreck, Hanspeter Pfister, and Michael Behrisch
IEEE Conference on Visual Analytics Science and Technology (VAST), 2019
[Paper] [arXiv]

Awards

  • First Place, CVPR NTIRE Challenge on Spectral Reconstruction. 2022
  • MICCAI Student Travel Award. 2021
  • Award for Distinction in Teaching, Harvard University. 2019
  • Graduate Student Fellowships, Harvard University. 2017-2018
  • Award for Excellence in Research and Innovation, Tsinghua University. 2016
  • Excellent Students Research Training (SRT) Project, Tsinghua University. 2016
  • Tsinghua Xuetang Talents Program Scholarship. 2015-2017

Services

  • Conference and Journal Reviewer,
     Conference on Computer Vision and Pattern Recognition (CVPR)
     European Conference on Computer Vision (ECCV)
     International Conference on Computer Vision (ICCV)
     Medical Image Computing and Computer Assisted Interventions (MICCAI)
     Winter Conference on Applications of Computer Vision (WACV)
     IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
     IEEE Transactions on Medical Imaging (TMI)
     IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
     IEEE Transactions on Computational Imaging (TCI)
  • Challenge and Workshop Organizer,
     IEEE-ISBI 2021: MitoEM Challenge for 3D Mitochondria Instance Segmentation
  • Associate Director, Social Entrepreneurship Initiative, Harvard GSAS Business Club. 2020-2022
  • Student Committee Member, The Mind Brain Behavior (MBB) Initiative, Harvard University. 2019-2020