Job Description

Location: Remote Access

Seeking a skilled and motivated AKS (Azure Kubernetes Service) Data Engineer to join our dynamic team (can be open for GKS exp in place of AKS too). The ideal candidate will have a strong background in data engineering, experience with Azure services, and proficiency in managing Kubernetes clusters. This role will primarily focus on designing, implementing, and maintaining data pipelines, ensuring scalability, reliability, and performance for our data-driven applications.

Must have – AKS, Python and SQL

Good to have – Data Modeling Exp.

Responsibilities:

• One of this role need to have Data modeling experience. Team uses- Erwin tool for data modeling and database design.
• Strong in SQL and Python (must)
• Design, develop, and deploy scalable data pipelines on AKS for processing and analyzing large volumes of data.
• Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.
• Implement best practices for data ingestion, transformation, and storage using Azure services and Kubernetes.
• Optimize data pipelines for performance, reliability, and cost-effectiveness.
• Monitor and troubleshoot data pipelines to ensure smooth operation and timely resolution of issues.
• Implement security measures and compliance standards to protect sensitive data.
• Stay updated with the latest technologies and trends in data engineering and AKS ecosystem.
• Document technical designs, processes, and procedures for knowledge sharing and future reference.
• Work directly with business

Requirements:

• Proven experience as a Data Engineer with hands-on experience in designing and implementing data pipelines.
• Proficiency in Azure services, including Azure Kubernetes Service (AKS)
• Strong knowledge of Kubernetes concepts and experience in managing Kubernetes clusters.
• Experience with containerization technologies such as Docker.
• Proficiency in programming languages such as Python for data processing and automation.
• Strong communication and interpersonal skills with the ability to collaborate effectively in a team environment.