Huzheng Yang

📍Penn

PhD student at University of Pennsylvania, advised by Jianbo Shi and James C. Gee.

My research:

Mechanistic analysis of VLM/LLM representations (e.g., probing information flow across layers/attention).
Brain-guided understanding via neural prediction/encoding (e.g., Algonauts; model–brain alignment).

Generative modeling: improving CLIP-conditioned diffusion via better feature manifolds for controllable sampling.
Inference Efficiency: attention-sink analysis → structured Nyström-style approximations for faster attention inference.

I also build open-source tools, including ncut-pytorch for fast spectral embedding with deployable demos.

Contact: huze.yann@gmail.com

Softwares

ncut-pytorch: Nyström Normalized Cuts PyTorch

[Huggingface Demo]
[Python Package]
[Website]
[Slides]
[Paper (coming)]

	Vibe Spaces for Creatively Connecting and Expressing Visual Concepts Huzheng Yang, Katherine Xu, Andrew Lu, Michael D. Grossberg, Yutong Bai, Jianbo Shi preprint [Paper] [Webpage] [GitHub] [Demo]
	AlignedCut: Visual Concepts Discovery on Brain-Guided Universal Feature Space Huzheng Yang, James Gee, Jianbo Shi May. 2024 arxiv, rejected by NeurIPS [Paper] [Slides]
	Brain Decodes Deep Nets Huzheng Yang, James Gee, Jianbo Shi Nov. 2023 CVPR'24, *highlight* [Paper] [Webpage] [GitHub] [Slides] [Talk online]
	Memory Encoding Model Huzheng Yang, James Gee, Jianbo Shi Aug. 2023 arxiv, *Algonauts 2023 challenge winner* [Paper] [Webpage] [GitHub] [Slides] [Talk CCN'23]
	Retinotopy Inspired Brain Encoding Model and the All-for-One Training Recipe Huzheng Yang, Jianbo Shi, James Gee May. 2023 arxiv, rejected by NeurIPS [Paper] [Openreview]
	Upgrading Voxel-wise Encoding Model via Integrated Integration over Features and Brain Networks Yuanning Li, Huzheng Yang, Shi Gu Nov. 2022 Science Bulletin [Paper] [GitHub]
	Effective Ensemble of Deep Neural Networks Predicts Neural Responses to Naturalistic Videos Huzheng Yang, Shanghang Zhang, Yifan Wu, Yuanning Li, Shi Gu Aug. 2021 bioRxiv, *Algonauts 2021 challenge winner* [Paper] [GitHub] [Talk CCN'21]

	Vibe Spaces for Creatively Connecting and Expressing Visual Concepts Huzheng Yang, Katherine Xu, Andrew Lu, Michael D. Grossberg, Yutong Bai, Jianbo Shi preprint [Paper] [Webpage] [GitHub] [Demo]
	AlignedCut: Visual Concepts Discovery on Brain-Guided Universal Feature Space Huzheng Yang, James Gee, Jianbo Shi May. 2024 arxiv, rejected by NeurIPS [Paper] [Slides]
	Brain Decodes Deep Nets Huzheng Yang, James Gee, Jianbo Shi Nov. 2023 CVPR'24, *highlight* [Paper] [Webpage] [GitHub] [Slides] [Talk online]
	Memory Encoding Model Huzheng Yang, James Gee, Jianbo Shi Aug. 2023 arxiv, *Algonauts 2023 challenge winner* [Paper] [Webpage] [GitHub] [Slides] [Talk CCN'23]
	Retinotopy Inspired Brain Encoding Model and the All-for-One Training Recipe Huzheng Yang, Jianbo Shi, James Gee May. 2023 arxiv, rejected by NeurIPS [Paper] [Openreview]
	Upgrading Voxel-wise Encoding Model via Integrated Integration over Features and Brain Networks Yuanning Li, Huzheng Yang, Shi Gu Nov. 2022 Science Bulletin [Paper] [GitHub]
	Effective Ensemble of Deep Neural Networks Predicts Neural Responses to Naturalistic Videos Huzheng Yang, Shanghang Zhang, Yifan Wu, Yuanning Li, Shi Gu Aug. 2021 bioRxiv, *Algonauts 2021 challenge winner* [Paper] [GitHub] [Talk CCN'21]