Data Engineer

Location: Singapore
Job Type: Permanent
Contact: Chelsea Phan
Email: email Chelsea
Posted: 18 days ago

​We are currently working with a client to build an AI and data team to drive sustainability impacts. They are looking for high performing data engineers to join their team to build scalable and reliable data infrastructures for customers from various industries.


  • Design and build scalable infrastructures to crawl high volume of data from various sources

  • Use Optical Character Recognition technology to scrape structured and unstructured data

  • Extract, process and store large sets of data from open-standard file format and data interchange format such as XML and JSON

  • Use relevant tools such as Apache Beam and Apache Spark to build data pipelines that enable batch and stream data processing or concurrency

  • Build data tools to assist data scientists in building and optimizing AI initiatives

  • Prepare and maintain detailed documentation on data pipeline and infrastructure


  • At least 2 years of relevant working experience in building data pipelines and performing web scraping

  • Highly skilled in data crawling tools and approach such as BeautifulSoup, CasperJS, PhantomJS, Selenium and Nodejs

  • Experienced with data orchestration tools such as Apache Airflow, and rest APIs and relevant web requests

  • Excellent coding skills in one or many different languages ( eg: C++, Javascript, C#, .Net, Python)

  • Strong understanding of NoSQL databases

  • Great to have knowledge in cloud platforms such as GCP, AWS and Microsoft Azure

  • Great to have some experience in tools such as ElasticSearch, Outsystems, Graph Database and Snowflake

  • Ideally a self-motivated individual who is passionate about driving sustainable impacts


For a confidential discussion on this or any other opportunities available in the market please contact Chelsea Phan at - Direct Line:+65 6914 9946

EA License No: 16S8303 - EA Registration No: R2199999