Job Description

Eightfold was founded with a vision to solve for employment in our society. For decades, the connection between individuals and opportunities has been based on who the individuals are and the strength of their network, vs. their potential. Eightfold leverages artificial intelligence to transform how to think about skills and capabilities for individuals as well as how jobs and career decisions are made. Eightfold offers the industry’s first AI-powered Talent Intelligence Platform to transform how organizations plan, hire, develop and retain a diverse workforce, enabling individuals to transform their careers.

To date, Eightfold AI has received more than $410 million in funding and a valuation of over $2B from leading investors to further our mission of finding the right career for everyone in the world. If you are passionate about solving one of the most fundamental challenges of our society - employment, working on hard business problems, and being part of an amazing growth story - Eightfold is the place to be!

You may want to refer to the media coverage on TechCrunch and Reuters.

Eightfold.ai is led by Ashutosh Garg, a PhD in Machine Learning/IIT Delhi alumni who managed Search and Personalization at Google, and Varun Kacholia-IIT Bombay alumni, who led the News Feed Ranking team at Facebook and developed YouTube Search at Google.
Our customers
We are looking for a seasoned Staff Data Engineer to lead the design and optimization of our data infrastructure. Expertise in Databricks and Amazon Redshift is essential, along with a proven ability to build scalable data pipelines and deliver actionable insights.

Key Responsibilities

• Design and maintain scalable data architectures using Databricks and Amazon Redshift, ensuring alignment with business needs.
• Develop and optimize ETL/ELT pipelines for efficient data processing.
• Enhance the performance and reliability of data pipelines and databases.
• Partner with data scientists and stakeholders to deliver high-quality data solutions.
• Ensure data consistency and accuracy across platforms.
• Quickly diagnose and resolve data-related issues.
• Maintain clear, comprehensive documentation for data processes.
• Implement and uphold best practices in data governance, security, and compliance.

Requirements

• 8+ years of experience in data engineering with strong expertise in Databricks and Amazon Redshift.
• Proficiency in SQL, Python, and ETL tools.
• Familiarity with big data technologies like Apache Spark or Hadoop.
• Strong problem-solving skills and ability to work in a fast-paced environment.
• Excellent communication skills, especially in conveying technical concepts to non-technical teams.

Nice To Have

• Certifications in Databricks, AWS, or related technologies.
• Experience with Azure, Google Cloud, or advanced analytics.