Data Engineer (AI Sustainability)
We are currently working with a client to build an AI and data team to drive sustainability impacts. They are looking for high performing data engineers to join their team to build scalable and reliable data infrastructures for customers from various industries.
Responsibilities
In charge of setting up of ETL process using a multitude of tools and developing a good infrastructure for the product
Be an expert in transforming structured and unstructured data from various sources and formats
Be the technical leader and strategic thinker to decide the technology stacks used in the process
Work well independently but also in teams, with technical software engineers who can help with infrastructure set up, but be the expert on data related matters
Ensure security of data across different regions through multiple data centers
Ensure proper documentation of data infrastructure design
Requirements
Possess a bachelor’s degree in mathematics, Statistics, Computer Science or any relevant fields of study
Have at least 2+ years of experience in building data pipelines and database management
Have strong exposure to working with big data in relational databases (MSSQL, MySQL) and NoSQL databases (MongoDB, datastore)
Have experience in building data pipelines for batch processing and real-time data streaming using Apache Beam, Apache Speak or concurrency using threading and multiprocessing
Have working experience with data orchestration tools (eg: Airflow)
Strong software development background in one or more coding languages such as Java, C++, Python, C#, .Net, Scala
Ideally should have advanced knowledge in SQL
Excellent communication skills to work well with business and technical stakeholders
Good to have knowledge in cloud platform (eg: AWS, GCP or Microsoft Azure)
Good to have knowledge in Elasticsearch, Outsystems, Graph Database and Snowflake
Ideally a self-motivated individual who is passionate about driving sustainable impacts
Contact
For a confidential discussion on this or any other opportunities available in the market please contact Chelsea Phan at chelsea.phan@next-wavepartners.com - Direct Line:+65 6914 9946
EA License No: 16S8303 - EA Registration No: R2199999
Job has Expired