We’re partnering with an exciting AdTech company who has a strong engineering culture and awesome product. You’d get to work on a product that chooses whether to display
ads within the matter of milliseconds, engineering some of the greatest pipelines and algorithms you’ve created to date. Working with an immense amount of data, you’d help process hundreds of terabytes a day and make sure that even within this split second, the machine is making the best decision it can.

Working with a mixed team of top engineers, from product managers to software engineers, you’d help scale and maintain the data pipelines for the platform. Help analyze solutions, design, and architect better ones, integrate and test the solutions and maintain these once they’ve been created. You’d work with a great multi-national and expert team of engineers, all with the same goal to create the best engineering culture possible.

Responsibilities

• Be able to scale up data pipelines, workflows and batch processing through the AWS stack, Airflow, Spark and other tools alike
• Analyze the performance of your chosen pipelines to make sure that the processing of data is optimal and capable of handling the heavy load
• Look at business opportunities, be able to debug and report back to management should things need to be improved
• Work end-to-end with the engineering and product teams to come up with wholesome solutions
• Be able to rapidly fix any bug issues
• Strong comradery and able to work with a diverse team of experts, capable of holding your own while working with many thoughts and walks of life

Requirements

• Preferred Masters in Computer Science, Mathematics, Engineering or related fields
• Minimally 5 years of work experience, preferably all in data engineering where you developed data pipelines and workflows end-to-end
• Have worked on a project and handled terabytes worth of data in the past
• Be strong in using Big Data tools: Spark, Hadoop and/or other Map Reduce systems
• Familiar with AWS cloud stack (e.g. Athena, EMR, Kinesis, S3, Lambda, DynamoDB, ElasticSearch etc.) is preferred, though other familiarity with cloud is welcome
• Programming abilities in Java, Scala and/or Python
• Bonus to have worked in Ad industry in the past
• Bonus to have worked with tools that are high performing, low latency and process in real-time (e.g. Flink, Storm, Kafka)

Reaching out