Image Loading

LEAD DATA ENGINEER

Job Description

  • Hyderabad/ Bengaluru, India

About the role:

Are you interested in solving complex business problems with the help of data and insights? Would you like business-focused data engineering experience in data & analytics? Do you want to be a part of the change transforming the business environment today? If yes, join us.

In this job, you will:

  • experience working on large data volume data engineering problems.
  • focus on business first and technology second.
  • or might be required to travel to end-client sites. 

To join us, you should:

  • lead the design, development, and maintenance of the data infrastructure for the enterprise.
  • collaborate with data scientists, analysts, and other stakeholders to understand data needs and requirements. 
  • develop and implement data pipelines to ingest, transform, and store data. 
  • build and maintain data lakes and data warehouses. 
  • ensure the data infrastructure is scalable, reliable, and secure. 
  • mentor and coach team members to help them grow their skills and capabilities.
  • Identify and address technical challenges and roadblocks in data engineering projects. 
  • Communicate technical concepts and project progress to non-technical stakeholders. 
  • Build and maintain relationships with key partners and stakeholders within the organization.

You must have the following:

  • BTech/ Master’s degree or equivalent in Computer Science/Computer Engineering/IT, Technology, or related fields
  • 5 to 8 years of experience in data engineering
  • Excellent verbal and written communication skills 
  • Experience in building and maintaining data pipelines using technologies such as Cloud Data Fusion, Cloud Dataflow, AWS, Azure Data Factory, Azure Stream Analytics, and Dell Boomi. (Any 2) 
  • Experience in storing and processing data using technologies such as Big Query, Cloud Dataproc, AWS, Azure Synapse Analytics, Snowflake, Redshift, Cosmos DB. (Any 3) 
  • Knowledge of managing data storage and access using technologies such as Cloud Storage, AWS, Azure Blob Storage, or Azure Data Lake Storage. (Any 1) 
  • Knowledge of managing and deploying data infrastructure on GCP or Azure using technologies such as Cloud Composer, Azure Kubernetes Service, or Azure Container Instances (Any 2) 
  • Knowledge of implementing security and access controls for data such as Cloud Identity and Access Management, AWS, Azure Active Directory, or Azure Private Link 
  • Well-versed with data services, integration, ingestion, ELT/ETL, and data governance. 
  • Experience in Security and Meta-driven Development. 
  • Expertise on RDBMS (relational database management system) – writing complex SQL logics, DB/Query optimisation, Data Modelling, able to manage high data volume for mission critical applications. 
  • Strong grip on programming using Python and PySpark. 
  • Data pipeline lifecycle management and DataOps. 
  • Expertise on using AWS, Azure DevOps or Google Cloud Build. (Any 1). 
  • Preference to the candidates having Azure or GCP data engineer certification. (Any 1) 

Good to have:

  • Application development understanding (Full Stack) 
  • Experience in open-source tools like Kafka, Spark, Splunk, Superset etc. 
  • Good understanding of analytics platform landscape that includes AI/ML 
  • Experience in any Data Visualization tool like PowerBI / Tableau / Qlik /Quick Sight, etc.   

About us

Gramener is a design-led data science company. We build custom Data & AI solutions that help solve complex business problems with actionable insights and compelling data stories. We partner with enterprise data and digital transformation teams to improve the data-driven decision-making culture across the organization. Our open standard low-code platform, Gramex, rapidly builds engaging Data & AI solutions across multiple business verticals and use cases. Our solutions and technology have been recognized by analysts such as Gartner and Forrester and have won several awards.

We offer you:

  • A first-hand experience with complex and interesting, purpose-driven data problems.
  • An opportunity to make deep industry connections with data science experts, client teams, and domain champions and be part of the change that is transforming the business environment today.  
  • A chance to try things, and take risks. 
  • Meaningful problems you’ll be proud of solving. 
  • People you will be comfortable working with. 

Skills

  • AWS
  • BigQuery
  • Azure Data Factory
  • ETL
  • Python
  • AI/ML

Education

  • Master's Degree
  • Bachelor's Degree

Job Information

Job Posted Date

Dec 05, 2023

Experience

5 to 9 Years

Compensation (Annual in Lacs)

₹ Market Standard

Work Type

Permanent

Type Of Work

8 hour shift

Category

Information Technology

Copyright © 2022 All Rights Reserved. Saas Talent