Job Description

• Pune

What You'll Do

We are looking for a talented, highly motivated Lead Cloud Data Engineer to join our team! 

Responsibilities: 

• Design, develop, and maintain data pipelines for collecting, processing, and analysing security-related data from various sources; apply best practices for data integrity, reliability, and scalability in the security data pipeline. 
• Work closely with partner security teams, leadership, and engineering to design and implement security solutions that measurably reduce risk in Avalara’s cloud environments.  
• Engineer automated solutions “as code” for multiple hyperscale cloud providers  
• Ensure that the security data pipeline complies with relevant security standards, regulations, and industry best practices; collaborate with compliance teams to implement necessary controls and reporting mechanisms. 
• Performing code and design reviews of internal and customer-facing software products and solutions 
• Maintain comprehensive documentation of the security data pipeline architecture, configurations, and processes; generate regular reports on the performance of the pipeline, data quality, and incidents detected. 

Job Duties

Qualifications:

• Bachelor’s Engineering degree in computer science, information security, or relevant experience.  
• Minimum of 8+ years of relevant professional experience in design and development role. 
• Expert level experience in SQL. 
• Experience architecting complex data marts leveraging dbt and Airflow. 
• Demonstrated ability to architect and build data solutions that leverage data quality and anomaly detection best practices. 
• Experience building production analytics using the Snowflake data platform. 
• Experience in DevOps or DataOps, using Git, or Terraform. 
• Understanding of common container and orchestration technologies such as Docker, Container, CI/CD and Kubernetes. 

• Excellent experience in AWS data engineering ecosystem, Snowflake tools and implement data security domain. 
• Experience designing secure cloud architectures in a hyper-scale cloud service provider (AWS, GCP or Azure or OCI)  
• Advanced knowledge of common cloud security services and tools such as Identity and Access Management (IAM), RBAC Automation and other data security practices. 
• Strong understanding of data governance and data security best practices. .

Good to have:  

• Understand global data security requirements such as GDPR, SOC 2, US State by State privacy requirements, PII 
• Experience analysing website traffic data and network data 
• Ability to drive program maturity by evangelizing modern secure architectures and services.  
• AWS or any professional data security certification. 
• Experience in data Modelling 
• Experience with data visualization (PowerBI/Tableau/Hex/R-shiny, etc.) and data storytelling