Job Description

Dear Aspirants,

Greetings From ValueLabs!!!

We have an urgent requirement for an "Lead Data Engineer position" for the Hyderabad location. Please find below the job description for your reference.

Experience: 7+ years

Notice Period: Immediate

Job Location: Hyderabad (Work from office)

Job Description:

The Lead Data Engineer is responsible for the design, development, and maintenance of data pipelines, data warehouses, and data lakes for the organization. This role requires strong technical skills in "ADF, SQL Server, Databricks Notebooks, Data Pipelines, SPROCs, Data Warehouse, and Databricks DataLake".

Key Responsibilities:

1. Design and develop data pipelines using ADF, SQL Server, and Databricks Notebooks to efficiently ingest, transform, and load data from various sources.

2. Develop and maintain data warehouses and data lakes using SQL Server and Databricks DataLake to store and manage large volumes of structured and unstructured data.

3. Create and optimize SPROCs (Stored Procedures) to improve database performance and efficiency.

4. Collaborate with cross-functional teams to understand business requirements, data needs, and provide data engineering solutions.

5. Develop and implement data quality checks, validation, and monitoring processes to ensure data accuracy and integrity.

6. Lead a team of data engineers, providing guidance, mentorship, and support for their professional growth.

7. Stay up-to-date with industry trends, best practices, and new technologies in data engineering, and implement them to improve the organization's data infrastructure.

8. Participate in project planning, estimation, and resource allocation to ensure timely delivery of data engineering projects.

9. Troubleshoot and resolve complex data engineering issues, and provide technical support to other teams as needed.

10. Contribute to the continuous improvement of the organization's data engineering processes and methodologies.

Good to Have skills:

• PowerBl, Data modeling