Bigdata Engineer

Experience: Min 5 Years Must have good technical experience and should be able to understand and develop the modules and bring the task to closure on time. At least 4+ years of development work experience in Hadoop programming (HDFS) using PySpark/Scala/Java with Hive-based Data warehouse projects.

And, with good Shell Scripting experience. Able to Understand the requirements and ingest the data into the Bigdata platform using Spark with HIVE. Should be able to write the SQL scripts and write few complex SQL Scripts to process the data with SCD handling exposure.

Responsible for meeting the quality, and scope as per the project plans must be able to meet the stringent timelines. Flexible to work as per the regional timing.

Excellent communication and documentation skills Very good at team playing and flexibility to work with the Offshore team in different time zones based on project needs. Willingness to do Certification in Databricks Certified Developer: Apache Spark 3. X Nice to Have Autosys, Bit bucket, Jenkin, etc.

Proactive, and have good communication skills to articulate technical issues. Exposure to is Confluence/JIRA Should be able to work independently Prior Experience to any Databases like Oracle/SQL Server/ETL will be added advantage.

At least 1+ years of Module Lead Experience Hands-on experience in data analysis and debugging the issues in SQL. Performance tuning the Hive QLs and the Cluster nodes Functional Testing Functional Test plan and execution experience. Originally posted on Himalayas