Job Description

We are seeking a highly experienced Staff Engineer to join our team and lead the development for Atlan’s Data Quality module. This is a 0-1 initiative that will play a critical role in enhancing data quality and data contracts within our platform. An ideal candidate will bring prior experience with solution architecture along with building Data SaaS products/ platforms.

What will you do? 🤔

• Architect, design, and implement backend systems for the new Data Quality module, focusing on data quality and data contracts (ODCS)
• Develop and standardize frameworks for integrating Atlan connectors with Data Quality tools (e.g., Soda, Monte Carlo, Anomalo, etc) to ensure seamless data integration and metadata synchronization
• Enhance the developer experience by improving tools, libraries, and processes for internal and external engineers
• Optimize backend systems to improve user experience for customers, ensuring the system is reliable, scalable, and user-friendly
• Mentor junior engineers, providing guidance on best practices and helping them grow technically
• Maintain high standards of code quality through reviews, testing, and continuous integration
• Work closely with cross-functional teams to deliver features and enhancements that align with the product roadmap
• Drive innovation within the backend team by staying updated with the latest technologies and industry trends

What makes you a great match for us? 😍

• Proven data & Backend engineering experience, with a track record of building scalable systems and integrating with data quality and profiling tools
• Prior experience as a customer-facing solutions architect is highly preferred
• Experience contributing to open-source projects is highly preferred
• Experience with Data Quality tools such as Soda, Monte Carlo, or Anomalo is preferred
• Exposure to Data Contracts (ODCS) is advantageous
• Hands-on experience with Java, Deequ, Spark, and Kafka
• Experience with search stores like Elastic, Solr, or Typesense is a plus
• Understanding of Data Lineage is a significant advantage
• Strong problem-solving skills and the ability to drive complex technical projects from inception to completion