AWS Data Engineer

• Be part of a high performing team
• Location: Sydney
• Initial 6 months contract
• Hybrid

The opportunity                                                                                   

The AWS Data Engineer role that involves development activities across the software development lifecycle and production support activities, with technical accountability for our Data Fabric Platform and associated CICD /DevOps systems.

Description of division and business unit

We’re building the new AMP Bank: a fully digital bank with new products, delivered via a mobile app with killer features, to make banking easy for everyday Australians and small businesses. No paperwork. No red tape. No complicated processes or confusing financial chat. Just simple, smart banking; a tap away. The way banking should be. We’ve got the tech. We’ve got the approach. We just need the team to help us take AMP Bank to market and make it the best digital banking experience Australia’s ever seen

About the role:

Proficiency in writing Spark jobs using Python:

• Strong understanding of Apache Spark framework
• Ability to develop efficient PySpark code for data processing and analysis
• Experience with Spark SQL and Data Frames API

Database skills, particularly in SQL:

• Expertise in writing complex SQL queries, including various types of joins (INNER, LEFT, RIGHT, FULL, CROSS)
• Ability to optimize SQL queries for performance
• Understanding of data modeling and schema design

DevOps skills:

• Understanding of CI/CD pipelines for data engineering projects
• Experience with version control systems (e.g., Git)
• Familiarity with infrastructure-as-code practices
• Familiarity with infrastructure-as-code practices (e.g., AWS CloudFormation, AWS CDK)
• Experience with workflow automation tools (e.g., Apache Airflow, AWS Step Functions)

AWS and Glue expertise:

• Proficiency in working with AWS Glue for ETL processes
• Experience with other relevant AWS services (e.g., S3, Redshift, EMR)
• Ability to design and implement data pipelines using AWS Glue
• Understanding of AWS Glue’s serverless architecture and its benefits

Modern Data Platforms

• Experience with modern data platforms, including:
• Data lakes (e.g., Amazon S3, lake house architectures using Delta lake or Apache Hudi)
• Data warehouses (e.g., Amazon Redshift)
• Lakehouses (e.g., Delta Lake)
• Familiarity with data cataloging and governance tools

Working at AMP

We are transforming our business. We are looking for people with courage, accountability and integrity who inspire the same in others. If you are comfortable challenging the status-quo and perform at your best in an evolving and complex environment – we need you.

Wellbeing & Benefits

We invest in the health, wellbeing, and development of all our people including our contingent professionals, by offering a range of great benefits to support you be your best, professionally, and personally:

• Finance & investment assistance and opportunities.
• Salary packaging and novated vehicle leases
• Employee Assistance Program – Benestar.
• Access to discounted health and wellbeing initiatives through Medibank.
• Access to a range of discounted offerings via an extra’s benefits program.
• Networking / professional development opportunities and events

We review applications as soon as we receive them and if we find our ideal person, we may close the role earlier than the advertised close date. If you are interested in expanding your skills with AMP as a contingent professional, then please click on the apply link.

Agencies should note that unsolicited resumes will not be accepted for this position and AMP will not pay any fees related to resumes that are submitted directly to hiring managers and not through our approved process. Where appropriate, the AMP Team will work with our preferred panel of agencies to source candidates for roles.