7 Years of Experience
Pune, Maharashtra, India
91705*******
-
-
60 Days
➤ Working experience in various domains like
6sense, SaaS/Cloud Product, Computer Software
Slintel
Qualys
6sense, Slintel, Qualys, Tapnomy Solutions (OPC) Pvt. Ltd, Innoplexus, Innoplexus, Innoplexus, Ideate Systems India, Vyom Labs Pvt. Ltd., Walchand Linux Users Group
Job Title : Lead Bigdata Engineer
Company name : 6sense
Period : September 2021 - Present
Location : Bengaluru, Karnataka, India
Job Title : Senior Bigdata Engineer
Company name : Slintel
Period : June 2021 - August 2021
Location : Bengaluru, Karnataka, India
Job Title : Bigdata Engineer
Company name : Qualys
Period : February 2020 - June 2021
Summary : ✦ Design and develop next-generation platform and middleware products using Big data technologies.
➢ 150 ElasticSearch Clusters with 1075 data nodes & 7 Trillion searchable data points with 170 TB storage.
➢ 20 Cassandra Clusters with 250 nodes and 150 TB data with 1 Million writes/s at peak.
➢ 100+ Kafka clusters with 120 servers and 18 Billion massages/day with 1.2 PB data stored.
➢ 8 Billion keys in Redis cached.
✦ Create high-performance APIs, libraries and micro services that scale to meet/exceed the demands of processing over a 100 million transactions and terabytes of data per day.
✦ Building and deploying applications with CI/CD pipeline.
✦ Company's stack currently includes:
➢ Elasticsearch-Logstash-Kibana, Spark, Kafka, Cassandra, Redis, Kafka, Flink, Datalake, Oracle DB
➢ Docker, Kubernetes, Ansible, Jenkins, Bamboo, Terraform, Hashicorp Vault
➢ AWS, GCP
Location : Pune, Maharashtra
Job Title : Bigdata Engineer
Company name : Tapnomy Solutions (OPC) Pvt. Ltd
Period : June 2019 - February 2020
Summary : ✦ Provides Bigdata Services to CHARTBOOST (San Francisco-based organization) which working on mobile game discovery and monetization platform.
✦ Automate the pipeline and build the DAG-builder library.
✦ Building and deploying jobs over EMR clusters and monitoring their execution.
✦ Migrated over 200+ Airflow DAGs from Hive+HDFS+Cloudera to Spark+S3+AWS_EMR
✦ Migrated over 20+ Airflow DAGs from Spark+S3+AWS_EMR to BigQuery+GCS+Dataflow
✦ Company's stack currently includes:
➢ Hive, HDFS, Spark, Livy, Kafka, Airflow, Scala, Python, MySQL, MongoDB, Presto, Qubole, Cloudera, datadog, Kubernetes
➢ AWS: EMR, S3, Lambda, Cloudwatch, Cloudtrail
➢ GCP: GCS, Cloud_composer, Bigquery, Bigtable, Dataflow, Cloud Spanner
Location : Pune, India
Job Title : Member Of Technical Staff (data engineer)
Company name : Innoplexus
Period : March 2019 - May 2019
Summary : ✦ Building data pipeline for huge amount of data (in Terabytes)
✦ POC on Cassandra+ElasticSearch=Elassandra for storing huge & gradually increasing data and `near real-time` search
Location : Pune, India
Job Title : Associate Software Engineer (data engineer)
Company name : Innoplexus
Period : July 2018 - February 2019
Summary : Working on building data-pipeline, ETL process and data operations :-
✦ Databases: MongoDB, MySQL, Hive, ElasticSearch, Redis
✦ Data streaming using Apache Kafka
✦ Processing data using spark (PySpark)
✦ Crawling data using BeautifulSoup and Selenium
✦ Data analysis using pandas and numpy library
Location : Pune, India
Job Title : Trainee Software Engineer (Jr. data scientist)
Company name : Innoplexus
Period : April 2018 - June 2018
Summary : Working on Data operations and Artificial Intelligence :-
✦ Databases: MongoDB, MySQL, ElasticSearch, Redis
✦ Machine learning (ML), Deep learning (DL), Natural Language Processing (NLP)
✦ Scraping websites using BeautifulSoup and Selenium
Location : Pune, India
Job Title : Jr Software Engineer (data engineer)
Company name : Ideate Systems India
Period : May 2017 - March 2018
Summary : Working on backend operations; manage the databases and build optimized SQL & MongoDB queries to achieve fast performance over websites.
Location : Pune, Maharashtra, India
Job Title : Intern (data engineer)
Company name : Vyom Labs Pvt. Ltd.
Period : December 2016 - April 2017
Summary : Working on VyomLabs's product Automation_Edge which provides:
✦ Best of breed IT Automation solutions (Service Desk Automation, Password Reset automation, NOC automation)
✦ Best of breed Business Process Automation solutions (Banking, Insurance, Manufacturing, Retail, Media)
✦ Technologies : Java language, REST API, SQL Database
Location : Pune, India
Job Title : Chief Technical Advisor
Company name : Walchand Linux Users Group
Period : June 2016 - April 2017
Location : Sangli, Maharashtra, India
Title : Big Data 101
Period : October 2016 - Present
Summary : bigdatauniversity.com, https://courses.bigdatauniversity.com/certificates/user/516732/course/course-v1:BigDataUniversity+BD0101EN+2016
Issuing Authority : Big Data University
Title : Hadoop 101
Period : October 2016 - Present
Summary : bigdatauniversity.com, https://courses.bigdatauniversity.com/certificates/user/516732/course/course-v1:BigDataUniversity+BD0111EN+2016
Issuing Authority : Big Data University
Organization name : Walchand Linux Users' Group Position : Senior Technical Advisor Period : May 2015 - Present
English , Hindi (Native Or Bilingual), Marathi (Native Or Bilingual)
Award : Best Dress Award on Navratri festival (Dandiya-Garba Night)
Issuer : HR Department of Innoplexus
Date : 10 2018
Award : Best Project Award
Issuer : Dept of Information Technology
Date : 1 2014
Summary : Best project award in BTECH Second year for "BrainRush" project.
Award : Best Employee of the Year
Issuer : FS team of Innoplexus Consulting Services
Show More