Job Description

Data Engineer – Fresher

Role & Responsibilities:

• Develop complex SQL database structure, schema and models to achieve data processing needs.
• Develop, Test and optimize SQL Queries, Triggers and Functions for functional requirements
• Learn and experiment the ETL, ELT and data pipelines, data processing using Rabbit MQ, Apache Airflow, Kafka, Spark and Kudu.
• Develop complex batch jobs using python, celery and pyspark to handle data matching, merging and manipulations.
• Create a deployment structured for various environments according to the Cloud infra.
• Develop procedures and scripts for data migration, backup and restore
• Open to test the data engineering deliverables from others.
• Willing to work in Manufacturing Domain.

Qualification Required:

• 0 -1 years of experience in data engineering with experience in developing data processing.
• Should Open to work in both SQL, Triggers and Python development.
• Strong knowledge in Python, PySpark, Pandas, Numpy etc.
• Exposure in any No-SQL database would be added advantage.
• Prior experience in IoT projects will be added value.
• Strong communication required.
• Must be a Team Player to lead the junior developers to growth.
• Immediate joiner is preferred.