Location: Pune
Salary: Open
Sub-industry: IT Solutions, IT Solutions
Function: Technology

Company Overview

Opportunity with a US based Analytics Company based out in Pune for BigData Engineer -Azure

Job Description

JD-Title: Big Data Engineer with cloud
Location –Pune, Baner
Key Responsibilities:
• Selecting and integrating any Big Data tools and frameworks required to provide requested
• Implementing the Ingestion & ETL/ELT processes
• Monitoring performance and advising any necessary infrastructure changes
• Required Experience, Skills and Qualifications:
• MUST have HANDS-ON experience on Hadoop tools/technologies like Spark (Strong in Spark),
Map Reduce, Hive, HDFS.
• HANDS-ON expertise and excellent understanding of big data toolset such as Sqoop,
Spark-streaming, Kafka, NiFi
• Proficiency in any of the programming language: Scala, Python or Java with total of 4years
• Must have experience in Cloud infrastructures like MS Azure, data lake, data bricks etc
Good working knowledge in NoSQL DB (Mongo, HBase, Casandra)
• Must have experience of designing, developing and deploying big data project/s into
• Implemented complex projects dealing with the considerable data size (TB/ PB) and with
high complexity in the production environment.
• Hortonworks (HDPCA/HDPCD/HDPCD-Spark) or Cloudera certification is an added
• Bachelor's degree or higher in a quantitative/technical field (e.g. Computer Science,
Statistics, Engineering) and software development experience with proven hands-on
experience in Big Data technologies
• Experience in developing/architecting environments in the Hadoop ecosystem using HDP
and HDF
• Demonstrated strength in data modelling, ETL development, and Data.
Experience in designing and implementing an enterprise data lake
• Experience in Big Data Management and Big Data Governance
• Some experience with Kubernetes, Docker containers etc.
• Additional Skills:
• Exposure to 1 or more big data management tools like Talend, Informatica (IBD), Zaloni
Data Platform etc.
• Exposure to data cleansing/data wrangling tools like Trifecta etc.
• Exposure to Big Data Visualization tools like Tableau, Qlik etc

Job reference: JO-201014-227264

Need Help?

Let us take a look at your profile and give you extra advice.
Send us your CV

Job application

You are about to apply to the following job: Bigdata Eng-AZURE . Applying a job is not a commitment, it gives us the authorization to show your CV to the employer

Upload from Computer
Application confirmed!
Thank you for applying! We shall be in touch with you.

Jobs you might be interested in