Han Shi

han.jpg

I am currently a principal researcher at Huawei Noah’s Ark Lab (Hong Kong). I obtained my Ph.D. degree from Department of Computer Science and Engineering (CSE) in Hong Kong University of Science and Technology (HKUST), supervised by Prof. James T. Kwok. Before my Ph.D. journey, I obtained my Bachelor degree in Electronic Engineering from Tsinghua University.

My current research interests are Generative Models, Neural Architecture Design and Automated Machine Learning (AutoML). Always looking for self-motivated research interns, please feel free to drop me an email if interested.

news

Sep 26, 2024 Two papers were accepted by NeurIPS 2024.

selected publications

  1. arXiv
    SepLLM: Accelerate Large Language Models by Compressing One Segment into One Token
    Guoxuan Chen, Han Shi‡, Jiawei Li, and 7 more authors
    Preprint arXiv:2412.12094, 2024
  2. NeurIPS
    DAPE: Data-Adaptive Positional Encoding for Length Extrapolation
    Chuanyang Zheng, Yihang Gao, Han Shi, and 8 more authors
    In Neural Information Processing Systems, 2024
  3. ICLRSpotlight
    MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models
    Longhui Yu, Weisen Jiang, Han Shi‡, and 7 more authors
    In International Conference on Learning Representations, 2024
  4. arXiv
    Accelerating Auto-regressive Text-to-Image Generation with Training-free Speculative Jacobi Decoding
    Yao Teng, Han Shi, Xian Liu, and 5 more authors
    Preprint arXiv:2410.01699, 2024