Lei Li

Carnegie Mellon University

Language Technology Institute
Assistant Professor

Research area: natural language processing, machine learning.

Topics:

  • Large Language Models
    • LLM agent: code generation, tool use, cooperation, reasoning
    • Security, Privacy, Copyright of LLMs 
    • Efficient LLM Systems
  • Multilingual NLP
    • machine translation
    • speech translation
  • AI for Science
    • AI for Drug Discovery
    • Protein Design

Bio

  • CGMH: A method for controllable text generation from specified keywords. [arxiv]
  • Analyzing anisotropic sentence embeddings from pre-trained language models. [arxiv]
  • Data-efficient methods for many-to-many neural machine translation. [mRASP, mRASP2]
  • Glancing Transformer (GLAT): non-autoregressive translation models are equally good as autoregressive Transformer. [arxiv]
  • VOLT: Learning vocabulary via optimal transport (ACL 2021 Best Paper). [arxiv]
  • SOLO: Fast and accurate object instance segmentation. [SOLO, SOLOv2]