Senior Big Data Engineer

Location:
Discipline:
Salary:
Contact: Angie Wakefield
Email: email Angie
Posted: over 4 years ago

Are you up for a challenge ? Can you handle HUGE data sets ? Well, then you’ve come to the right place because we need someone who can tackle traffic of over 10 million users for a webpage, a month !
You would have to help engineer the data in a way that extracts the right information, transforms it and then loads it onto relevant pipelines. If you are up for the challenge and working at a product-based, engineering firm, we’d be keen to have a chat with you.

The team you’d be working with is a lean data engineering team within a wider technology firm that is currently leading Asia’s market. The culture of this firm is very open and multinational, emulating a start-up with the flexibility to work remotely and even take unlimited leave!

Responsibilities

  • Be able to work with real-time data, in large data sets, writing out good quality code
  • Design, build and deploy big data solutions that can handle the load at which the data flows into the company.
  • Capable of handling and building scalable ETL pipelines that can ingest and manage the data points which are varied and of a great number.
  • Work with a team of functioning engineers, able to pick up a pipeline of projects that need to be deployed
  • Have a strong communication style and ability to work in a multi-national environment

Requirements

  • Hold at least 5 years of experience in Data Engineering, preferably 3 of which are handling Big Data volumes
  • Must have experience with ETL scripting, preferably on PySpark
  • Proficient in Big Data tools Hadoop and Spark, previously building out the architecture of applications and pipelines
  • Handling of real-time data tracking tools, Kibana highly preferred
  • Proficient in Python coding
  • Good to have Java or Scala experience
  • Also good to have exposure to Cloud technologies AWS or Google Cloud Platform

Reaching out

For a confidential discussion on this or any other opportunities available in the market please contact Angie Wakefield at angie.wakefield@next-wavepartners.com - Direct Line: +65 6340 1949

EA License No: 16S8303 - EA Registration No: R1781517