We’re partnering with an exciting AdTech company who have a strong engineering culture and awesome product. You’d get to work on a product which chooses whether to display ads within the matter of milliseconds, engineering some of the greatest pipelines and algorithms you’ve created to date. Working with an immense amount of data, you’d help process over hundreds of terabytes a day and make sure that even within this split second, the machine is making the best decision it can.

Working with a mixed team of top engineers, from product managers to software engineers, you’d help scale and maintain the data pipelines for the platform while guiding junior engineers. Help analyze solutions, design and architect better ones, integrate and test the solutions and maintain these once they’ve been created. You’d work with a great multi- national and expert team of engineers, all with the same goal to create the best engineering culture possible.

Responsibilities

• Work on complicated problems and be able to come up with results even within time pressures
• Deliver great solutions to make sure data access is first class through your design of the system
• Work end-to-end with the engineering and product teams to come up with wholesome solutions
• Be able to scale up data pipelines, workflows and batch processing through the AWS stack, Airflow, Spark and other tools alike
• Analyze the performance of your chosen pipelines to make sure that the processing of data is optimal and capable of handling the heavy load
• Lead analysis initiatives to make sure your designs are performing at optimal manner and able to uncover new business opportunities and report relevant KPIs
• Mentor junior engineers to work within a team and collaborative environment, giving advice in areas to improve

Requirements

• Preferred Masters or PhD in Computer Science, Mathematics, Engineering or related fields
• Minimally 8 years of work experience, preferably all in data engineering where you developed data pipelines and workflows end-to-end
• Holding management responsibilities of small team
• Have worked on a project and handled terabytes worth of data in the past
• Be strong in using Big Data tools: Spark, Hadoop and/or other Map Reduce systems
• Familiarity with AWS cloud stack (e.g. Athena, EMR, Kinesis, S3, Lambda, DynamoDB, ElasticSearch etc.) is preferred, though other familiarity with cloud is welcome
• Programming abilities in Java, Scala and/or Python
• Bonus to have worked in Ad industry in the past
• Bonus to have worked with tools that are high performing, low latency and process in real-time (e.g. Flink, Storm, Kafka)

Reaching out