Big Data Engineer
Location: | |
Job Type: | Permanent |
Discipline: | |
Salary: |
Contact: | Angie Wakefield |
Email: | email Angie |
Posted: | almost 3 years ago |
We are working with a great Energy Tech company – helping to redefine digitalization and work on nationwide initiatives that help make our buildings, companies, and cities smarter.
The business is in a stage of immense growth, having beaten its competitors in winning a large and exciting project. We now need those talented individuals to come on board and make this project a reality.
Join a specialist team that looks at harnessing ways to better optimize energy storage systems through data and network-driven technology. Work with some of the leading pioneers in the Renewable Energy world within a team of highly talented individuals.
Responsibilities
- Be able to manage, deploy, optimize and monitor corporate big data platforms making sure that the systems are stable at all times
- Have an in-depth understanding of enterprise big data platform architecture being able to solve problems and address growth within the business and data storages.
- Develop scripts that allow automation of big data operations and maintenance, helping to monitor alarms and troubleshoot when required.
- Be responsible for cluster services including Hadoop, HBase, Spark, Kafka, and other related tools to ensure continuous delivery, emergency response, and planning.
Requirements
- Holding at least 7 years of experience in software engineering across Technology, Internet, or Network companies – ideally focused on Big Data Platform Architecture in the last 5 years
- Proficient in working within Big Data ecosystems – specifically Hadoop, including but not limited to, HBase, Hive, HDFS, Spark, MySQL, and Redis
- Know principals and implementation for each component of Hadoop with experience maintaining and managing large-scale data platforms
- Experienced in using Kafka, Zookeeper, Elasticsearch, or Eagle
- Proficiency in more than one scripting language (e.g. Python, Shell, java)
- Experience using Linux systems – both software and hardware environments for system management and optimization. Be proficient in deploying and optimizing various services
- Experience using containerized environments, ideally with Kubernetes experience
- Know the common operation and maintenance monitoring tools e.g. Nagios, ganglia, Zabbix, grafana, open-falcon; and related plug-ins.
- Be a good team player with great communication skills – being aware and proactive in the work environment
- Ideally speak Mandarin and English fluently to converse with international teams
Reaching out
For a confidential discussion on this or any other opportunities available in the market please contact Angie Wakefield at angie.wakefield@next-wavepartners.com - Direct Line: +65 6922 4573
EA License No: 16S8303 - EA Registration No: R1781517
Job has Expired