Haoda Li

Software Engineer in Graphics / ML Systems

I’m skillful and passionate in developing new innovations and real-world solutions for parallel computing applications in machine learning and 3D graphics.

Currently, I’m a ML compiler engineer who works on accelerating and optimizing GenAI models on cutting-edge ML chips. Previously, I completed my Master of Engineering in EECS at UC Berkeley, where I worked on large-scale scene reconstructions, supervised by Prof. Avideh Zakhor, and I obtained my Bachelor of Science degree at U of Toronto, with a focus on artificial intelligence and computer vision.

Experience

  • 2024 -

    Toronto, ON, Canada

    Software Engineer II - ML Compiler
    Amazon Web Services
    Annapurna Labs, AWS Neuron Accelerator
    • Brought up LLM model inferences on AWS Neuron accelerator, and optimized the inference system to achieve 8-9 times of the original throughput.
    • Analyzed performance bottlenecks and developed high-performance, resuable kernels to accelerate common computations across models.
    • Maintained the compilation stack tracing feature for quicker profiling and debugging.
  • 2023 - 2024

    Montreal, QC, Canada

    Machine Learning Engineer
    AniML, Inc.
    Founding engineer, built end-to-end solutions for monocular camera 3D reconstruction.
    • Implemented CUDA algorithms for accelerating neural rendering and generative vision models.
    • Researched on combining neural rendering and 3D generative AI for high-fidelity object reconstruction.
  • 2020 - 2021

    Markham, ON, Canada

    Research Engineer
    Huawei Canada Inc.
    Noah’s Ark Lab, supervised by Juwei Lu
    • Engineered on video understanding algorithms and created prototypes for AI video editing applications.
    • Maintained the automated pipeline for clustered model training and cloud deployment using Docker.
    • Used OpenCV and C++ to create test systems for hand tracking and action recognition.

Education

  • 2022 - 2023

    Berkeley, CA, US

    Master of Engineering
    University of California, Berkeley
    Electrical Engineering and Computer Sciences
    • Supervised by Avideh Zakhor on end-to-end drone systems for high quality indoor 3D reconstruction and measurements.
  • 2017 - 2022

    Toronto, ON, Canada

    Honours Bachelor of Science
    University of Toronto
    Computer Science and Data Science
    • Focused on 3D computer vision and robotics.

Teaching

  • CSC417H1/CSC2549H Physics based Animation - Teaching Assistant, University of Toronto (2021 Fall)
  • CSC311H5 Introduction to Machine Learning - Teaching Assistant, University of Toronto (2021 Fall)
  • CSC317H1 Computer Graphics - Teaching Assistant, University of Toronto (2022 Winter)