Work at a Portfolio Company

Data Engineer



Software Engineering, Data Science
Posted on Thursday, December 14, 2023

You.com is an AI Assistant that makes you more productive, creative, and extraordinary.

About The Role:

Are you passionate about data engineering, analytics, and driving insights to support important business decisions? Do you thrive in a collaborative and fast-paced environment? If so, we have an exciting opportunity for you to join our team as a Data Engineer, leading our data engineering efforts for analytics.


  • Lead data engineering projects that drive collaboration across the company to obtain insights from data sources including clickstream, marketing, product funnels, etc., and use that to support important business decisions

  • Help build data architectural patterns and ETL processes that are scalable and extensible to understand our growing user base

  • Contribute to a healthy and supportive culture of code review and strong coding practices

  • Efficiently operate and manage resources in an Azure or AWS environment using tools like Terraform

  • Add new sources, build new tools, and produce new metrics that empower Product, Marketing, and Data Scientists

  • Implement feature engineering and data enrichment techniques for a large-scale consumer and business-to-business product

  • Optimize data pipelines for performance, scalability, and reliability


  • A BS in Computer Science or equivalent 3+ years of professional experience as a Data Engineer or in a similar role

  • Experience working with distributed processing frameworks: Databricks/Spark and stream processing, event-driven technologies such as Kafka, and are happy working with these systems via REST and Python APIs

  • Strong experience with Python, Spark, including Spark SQL, DataFrames, Spark Streaming, RDD caching, Spark MLib and the ability to write, debug, and optimize Spark code

  • Proficiency in using Terraform for infrastructure as code

  • A strong DataOps mindset and opinions on next-generation warehousing tools and ETL processes

  • Experience working with cloud platforms such as Azure and AWS

  • Strong problem-solving and analytical skills

  • Excellent written and verbal communication skills, capable of translating complex technical subjects into clear and concise terms.

  • You have a passion for engineering excellence and tolerance for ambiguity in a fast-paced setting

  • Experience with schema design and data modeling, with a passion for elegant and intuitive dataset design

If you are an ambitious and skilled Data Engineer seeking an exciting and challenging role, we would love to hear from you. Join our team and contribute to our data-driven success!

About You.com:

You.com is personalized, truthful, accurate, and transparent. It can provide the best answers to your questions and help you achieve tasks, from everyday queries to complex challenges.

You.com was founded by leading AI research scientists Richard Socher, the former Chief Scientist of Salesforce and the third most-cited researcher in natural language processing and one of the TIME100 AI honorees for 2023, and Bryan McCann, a lead research scientist at Salesforce Research specializing in deep learning and NLP.

Named one of Time’s “Best Inventions” in 2022 and one of Fortune’s 50 AI Innovators in 2023, You.com was the first search engine to offer a consumer-facing LLM with real-time internet access for factual, verifiable, and up-to-date responses.

Recognized as one of the most popular generative AI tools globally, You.com extends these advancements to other LLMs and AI chatbots, bringing trust, accuracy, and transparency with real-time web access and news through its YOU API offering — the first full web index built for LLMs — as well as a production-ready YOU LLM OS.