Company Overview
It is a global technology company providing commerce solutions that power billions
of transactions. Clients around the world, including 90 percent of the Fortune 500
We are sorry!
This job has been closed. You will find bellow the job description as a reminder. It is not possible to apply anymore.
Job Description
As Big Data Engineer who is keen on diving deep into big data using Big Data Ecosystem to perform Data
aggregations, Data curation, data ETL to be consumed by data analytics, data science and BI Analytics
solutions.
This person will work with a highly integrated, cross-discipline agile team and will be responsible for building
and supporting modern Big Data Engineering solutions
Requirements
Must have:
• Big Data Ecosystem with core competency in SQL optimization efficient Joins – Hive and
MySQL.
• Expertise with Snowflake Database, optimization, best practices.
• Good exposure to AWS data streaming and big data technologies such as Lambda, Amazon
Kinesis, Amazon Simple Queue Service (Amazon SQS), Amazon Simple Notification
Service (Amazon SNS), EMR, AWS Data Pipeline, AWS Aurora, S3.
• Real time data processing experience with snowflake is added advantage
• Hands on experience working on Java Enterprise technical stack.
• Automation of ETL Jobs and orchestration using scripts, pipelines, workflows.
• Good Exposure to Big Data framework like Hadoop, Hive, Sqoop.
• Hands on experience working on Production Solutions with understanding on Scalability,
Reliability, Uptime, Cost Optimization of a solution.
• Data governess & Security
• Some exposure to GitLab, Jenkins, Jira tools for Agile development & CI/CD
• Good to have Basic JavaScript and Python knowledge
• AWS Infra basic understanding like Instance creation and Cloud formation.
• Participate in design review sessions and ensure all solutions are aligned to pre-defined
architectural specifications
• Work with distributed teams to design and develop frameworks, solution accelerators, proofs of
concept, and external customer facing products
• Evaluate and incorporate new technologies into new and existing frameworks and solutions as
applicable
• Collaborate with and mentor members of the team and other coworkers
• Be agile and embrace change
Additional Information
Qualifications
• UG - B.Tech/B.E. OR PG – M.S. / M.Tech from REC or any other reputed institute
• 4 to 6 years' experience in an AWS/Big Data/Realtime data processing Tech Stack development
environment with experience working with hands on experience designing and implementing
solutions.