Machine Learning Engineer
Clara
Software Engineering
Brazil
Posted on Friday, October 27, 2023
Clara is the leading spend management platform for companies in Latin America. Our end-to-end solution includes our locally-issued corporate cards, a Bill Pay product, financing solutions, and our highly-rated software platform; already being used by thousands of the most successful companies across the region.
Clara is backed by top global and regional investors such as GGV Capital, Coatue, DST Global Partners, General Catalyst, monashees, Acrew Capital, Kaszek, Citius, Canary, Citi Ventures, Picus Capital, Avid Ventures, ICONIQ Growth, Endeavor Catalyst, Goldman Sachs, Accial Capital, and prominent angel investors.
CLARA’s Data Team is looking for a highly professional and experienced Machine Learning (ML) Engineer to join us and take an active role in the ML -data architectural design alongside our teams of data engineers and data scientists to create, deploy and maintain complex ML systems and services with the responsibilities and challenges that accompanies an environment like this.Responsibilities
Your primary focus will be to develop data pipelines for ML, design, implement and deploy the ML models and infrastructure, improve existing processes, and create data models. You will also be responsible for the maintenance and operation of all these models and data pipelines, and collaborate with other teams in order to provide high-quality and fast-delivery ML models for the company.The main challenges and responsibilities you will face are:
Your primary focus will be to develop data pipelines for ML, design, implement and deploy the ML models and infrastructure, improve existing processes, and create data models. You will also be responsible for the maintenance and operation of all these models and data pipelines, and collaborate with other teams in order to provide high-quality and fast-delivery ML models for the company.The main challenges and responsibilities you will face are:
- Build, integrate and maintain ML feature data pipelines following reliability, scalability, and maintainability principles.
- Deploy, monitor, and operate ML model lifecycle (ML Ops).
- Collaborate with data scientists in the implementation of ML models.
- Ensuring and monitoring the data quality, and understanding/resolving any issue detected.
- Consume data from Data Vaults and Star Schema lakehouse.
- Be able to collaborate with teams remotely, not only locally.
- Stay up to date with the latest technologies and look for ways to implement them.
- Collaborate with our data scientists and data engineers to better understand their requirements and meet the company’s goals.
- Document your work to have a solid foundation of it for new team members or future references.
- Code review and peer programming activities.
- Enforce team best practices and DevOps as a culture within the team.
- Enforce Data Security and Data Privacy best practices.
Our requirements for this position are:
- Proficiency in Python and SQL.
- ML Algorithms experience, both theoretical and practical.
- Experience with CI/CD tools (GitHub Actions, GitLab CI, Jenkins, etc.).
- Experience using Github flow.
- Docker container experience.
- Experience implementing the feature store paradigm.
- Experience deploying streaming ML models with common ML frameworks (e.g. xgboost, scikit-learn, catboost).
- High-level understanding of Distributed Systems, and Spark Architecture.
- Experience integrating data from Databases, APIs, and Event Streams (kinesis, kafka).
- Experience developing complex data pipelines (ETL/ELT) with orchestration tools (e.g. Apache Airflow, AWS Glue Workflow, AWS Step Functions, etc.)
- Experience with AWS services: Redshift, Glue, Sagemaker, Lambda, Athena, S3, Kinesis. Or other cloud equivalent services.
- Experience with big data technologies and frameworks (e.g. (py)Spark, Scala, Hive, Kafka, etc.)
Nice to have:
- Databrick platform usage and administration
- MLflow
The way we do things is as important as what we do. That is why we operate on a set of carefully-identified values. They are what we expect from ourselves and each other in our day-to-day.
We value
* Clarity - Open and direct communication
* Simplicity - Pare things down to the essential
* Ownership - We're all owners and act like it
* Pride - Make quality products we're proud of
* Always Be Changing (ABC) - Continuous self-improvement
* Inclusivity - Every voice counts; we value each other for our shared mission and contributions
We are
* Shaping business finances in Latin America
* Driven by our 6 core values
* Proud of our inclusive and caring culture
* Certified as Top LinkedIn Startup
We offer
* Competitive salary & a robust stock ownership plan
* 100% flexible work model
* A set of benefits that are adaptable to your needs & way of life
* Opportunities for growth in a fast-paced environment
* A chance to shape B2B payments in Latin America and increase the region’s economic competitiveness