Work at a Portfolio Company

AI Backend Engineer



Software Engineering, Data Science
San Francisco, CA, USA
Posted on Wednesday, September 6, 2023

About Replit
We’re building the world’s most ubiquitous programming environment. We focus on inspiring creativity and generating value for creators through community, and we design simple yet scalable infrastructure primitives for the next generation of creators. We want to blur the line between learning and making– a place where you can hang out, tinker with ideas, learn new concepts, and launch a business all in the same day.

About the role:

Replit is seeking a highly skilled and motivated Backend Engineer with a passion for AI to join the team. As a Backend Engineer - AI, you will play a key role in developing and maintaining the AI infrastructure that powers our platform. You'll work closely with a talented cross-functional team of engineers and researchers to build innovative AI features that will enhance the overall user experience.

You will…:

  • Design, develop, and maintain the backend systems that support AI features on the Replit platform.

  • Collaborate with AI researchers and engineers to integrate AI models and algorithms into our platform.

  • Optimize and scale Large Language Model serving infrastructure to ensure the platform can handle increasing user demands.

  • Implement monitoring and logging solutions to proactively identify and address performance issues.

  • Work closely with cross-functional teams, including front-end engineers, product managers, and data scientists, to deliver high-quality AI features.

  • Create and maintain technical documentation to ensure knowledge sharing and onboarding of new team members.

Required skills and experience:

  • Proven experience (3+ years) as a Backend Engineer with a focus on AI or Machine Learning projects.

  • Strong proficiency in Python and Go

  • Experience with AI frameworks and libraries

  • Knowledge of MLOps (and LLMOps) best practices

  • Knowledge of distributed computing, cloud platforms (e.g., AWS, GCP, Azure), and containerization (e.g., Docker, Kubernetes).

  • Strong problem-solving and troubleshooting skills.

Bonus Points:

  • Experience working at a DevTools company or product

Full-Time Employee Benefits Include:

🧑‍💻 Flexible Work Hours

💰 Competitive Salary & Equity

🖥 Home Office Set-Up Stipend

⚕️ Health, Dental, Vision and Life Insurance

🩼 Short Term and Long Term Disability

📱 Monthly Expenses Stipend

🚼 Parental and Baby Bonding Leave

🏝 Flexible Time Off (FTO) + Holidays

🚀 Annual company/team offsites (4/year)

Want to Learn More?

To achieve our mission of making programming more accessible around the world, we need our team to be representative of the world. We welcome your unique perspective and experiences in shaping this product. We encourage people from all kinds of backgrounds to apply, including and especially candidates from underrepresented and non-traditional backgrounds.

The overall market range of base compensation for roles in this area of Replit is typically $180,000 - $260,000. Compensation offered will be determined by additional factors such as location and experience.

This is a hybrid role with an in-office requirement of Tuesdays and Thursdays.