Data Engineer
Location: | Singapore |
Job Type: | Permanent |
Discipline: | |
Salary: |
Contact: | Chelsea Phan |
Email: | email Chelsea |
Posted: | over 2 years ago |
We are currently working with a client to build an AI and data team to drive sustainability impacts. They are looking for high performing data engineers to join their team to build scalable and reliable data infrastructures for customers from various industries.
Responsibilities
Design and build scalable infrastructures to crawl high volume of data from various sources
Use Optical Character Recognition technology to scrape structured and unstructured data
Extract, process and store large sets of data from open-standard file format and data interchange format such as XML and JSON
Use relevant tools such as Apache Beam and Apache Spark to build data pipelines that enable batch and stream data processing or concurrency
Build data tools to assist data scientists in building and optimizing AI initiatives
Prepare and maintain detailed documentation on data pipeline and infrastructure
Requirements
At least 2 years of relevant working experience in building data pipelines and performing web scraping
Highly skilled in data crawling tools and approach such as BeautifulSoup, CasperJS, PhantomJS, Selenium and Nodejs
Experienced with data orchestration tools such as Apache Airflow, and rest APIs and relevant web requests
Excellent coding skills in one or many different languages ( eg: C++, Javascript, C#, .Net, Python)
Strong understanding of NoSQL databases
Great to have knowledge in cloud platforms such as GCP, AWS and Microsoft Azure
Great to have some experience in tools such as ElasticSearch, Outsystems, Graph Database and Snowflake
Ideally a self-motivated individual who is passionate about driving sustainable impacts
Contact
For a confidential discussion on this or any other opportunities available in the market please contact Chelsea Phan at chelsea.phan@next-wavepartners.com - Direct Line:+65 6914 9946
EA License No: 16S8303 - EA Registration No: R2199999
Job has Expired