Job Description

Software Engineer / Senior Software Engineer

Job Description:

• 1-5 years of good hands on exposure with Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and Hive
• Good hands on experience of python and Bash Scripts
• Able to write Glue jobs
• Hands-on experience with using Cloud Platform provided Big Data technologies (i.e. Glue, EMR, RedShift, S3, Kinesis)
• Good understanding of SQL and data warehouse tools like (Redshift)
• Strong analytical, problem-solving, data analysis and research skills
• Demonstrable ability to think outside of the box and not be dependent on readily available tools
• Excellent communication, presentation and interpersonal skills are a must
• Able to implement business using Python and pySpark.
• Writing python scripts to support the solution.
• Participate in code peer reviews to ensure our applications comply with best practices.
• Provide estimates for development Task.
• Can perform integration testing of developed infrastructure.