Work at a Portfolio Company

AI Infrastructure Engineer



Software Engineering, Other Engineering, Data Science
Los Angeles, CA, USA · San Francisco, CA, USA
Posted on Monday, May 20, 2024

The mission at HeyGen is to make visual storytelling accessible to all. HeyGen is the fastest-growing generative AI platform for anyone who wants to create videos for their business. Come join our team in revolutionizing the way videos are created.
Learn more at www.heygen.com

About HeyGen

HeyGen stands at the forefront of cutting-edge AI-powered platforms, revolutionizing the realm of video creation.

Position Summary:

At HeyGen, we are at the forefront of developing applications powered by our cutting-edge AI research. As an AI Infrastructure Engineer, you will lead the development of fundamental AI systems and infrastructure. These systems are essential for powering our innovative applications, including Photo Avatar, Instant Avatar, Streaming Avatar, and Video Translation. Your role will be crucial in enhancing the efficiency and scalability of these systems, which are vital to HeyGen's success.

Key Responsibilities:

  • Design, build, and maintain the AI infrastructure and systems needed to support our AI applications. Examples include
    • AI workflow scheduling system to improve GPU efficiency and throughput of our batch inference systems
    • Model optimization to improve inference performance
    • Auto Train systems to power our avatar models
    • Large scale model evaluation systems
    • Online model serving systems
  • Collaborate with data scientists and machine learning engineers to understand their computational and data needs and provide efficient solutions.
  • Stay up-to-date with the latest industry trends in AI infrastructure technologies and advocate for best practices and continuous improvement.
  • Assist in budget planning and management of cloud resources and other infrastructure expenses.


  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
  • 5+ years of experience
  • Proven experience in managing infrastructure for large-scale AI or machine learning projects
  • Excellent problem-solving skills and the ability to work independently or as part of a team.
  • Proficiency in Python and C++
  • Experience with GPU computing and optimizing computational workflows
  • Familiarity with AI and machine learning frameworks like TensorFlow or PyTorch.

Preferred Qualifications:

  • Experience with CUDA
  • Experience optimizing large deep learning model performance
  • Experience building large scale batch inference system
  • Prior experience in a startup or fast-paced tech environment.

What HeyGen Offers

  • Competitive salary and benefits package.
  • Dynamic and inclusive work environment.
  • Opportunities for professional growth and advancement.
  • Collaborative culture that values innovation and creativity.
  • Access to the latest technologies and tools.

HeyGen is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.