Job Description

Job Overview:

We are seeking a skilled Data Engineer with expertise in Azure Cosmos DB and SQL to join our team. The ideal candidate will be responsible for designing, developing, and managing data solutions that leverage Cosmos DB to ensure high availability, scalability, and performance. You will work closely with cross-functional teams to integrate and optimize data workflows and support data-driven decision-making.

Key Responsibilities:

• Data Management: Design and implement data solutions using Azure Cosmos DB, SQL, including schema design, indexing strategies, and data partitioning.
• ETL Processes: Develop and maintain ETL pipelines to move and transform data into Cosmos DB from various sources.
• Performance Optimization: Monitor and optimize the performance of Cosmos DB databases to ensure efficient query execution and minimal latency.
• Integration: Collaborate with application developers and data scientists to integrate Cosmos DB with other data systems and applications.
• Data Security: Implement security best practices to ensure data integrity and compliance with regulatory requirements.
• Troubleshooting: Identify and resolve data issues, such as inconsistencies and performance bottlenecks.
• Documentation: Create and maintain technical documentation for data processes, system configurations, and best practices.
• Collaboration: Work with cross-functional teams to understand data requirements and provide data solutions that meet business needs.

Qualifications:

• Education: Bachelor’s degree in Computer Science, Engineering, or a related field. Advanced degree preferred.
• Experience: 3+ years of experience as a Data Engineer, with significant experience in Azure Cosmos DB.

Technical Skills:

Must have

• Proficiency in Azure Cosmos DB (Document Database), including data modeling, query optimization, and API usage.
• Strong SQL skills (Query writing, DB Modeling, Performance Optimization)
• Knowledge of NoSQL databases.

Good to have

• Experience with Azure Data Factory, Azure Synapse Analytics, or other Azure data services.
• Familiarity with programming languages such as Python (Preferable), C#, or Java.
• Familiarity with Snowflake.
• Problem-Solving: Excellent analytical and problem-solving skills with the ability to troubleshoot complex data issues.
• Communication: Strong verbal and written communication skills, with the ability to convey technical concepts to non-technical stakeholders.

Teamwork: Ability to work effectively in a collaborative environment and manage multiple priorities.

Preferred Qualifications:

• Certifications in Azure or related data technologies.
• Experience with other cloud-based data platforms or big data technologies.
• Knowledge of data governance and data warehousing concepts.