Senior Data Engineer (contract)

Our client, one of Asia-Pacific’s leading organizations is looking for: Senior Data Engineer (contract)

Responsibilities

Perform data extraction, cleaning, transformation, and flow. Web scraping may be also a part of the work scope in data extraction.

Design, build, launch and maintain efficient and reliable large-scale batch and real-time data pipelines with data processing frameworks Collaborate with Project Manager, Visualisation Developer, Data Scientist, UX Designers and Data Analyst to build scalable data-driven products Work in an Agile Environment that practices Continuous Integration and Delivery Support and advise best practices in data management standards, policies and procedures Work closely with fellow developers through pair programming and code review process Requirements: Interest in being the bridge between engineering and analytics Knowledge about system design, data structure and algorithms Familiar with data modelling, data access, and data storage infrastructure like Data Mart, Data Lake, and Data Warehouse Proficient in general data cleaning and transformation (e.

g. SQL, pandas, R, etc) Familiar with rest API and web requests/protocols in general Proficient with processing data from open-standard file format or data interchange format (e. g. XML, JSON) Good in building ETL pipeline (eg.

Talend Data Integration, Informatica PowerCenter, IBM DataStage, SAS Data Integration) Good in database design and various databases (e. g. MS SQL Server, Oracle RDBMS, IBM DB2, Postgres etc) Comfortable in at least one scripting language (eg.

Python) ----------------------------------------------------------------------------------------------------------------------------------- Interested applicants can also email CV at harry@nsearchglobal.

com (for faster processing, please state the exact job / position title applied “Senior Data Engineer” Only shortlisted candidates will be notified. --------------------------------------------------------------------------