Banner

Data Engineer- Airflow

Back to job search

Job Description

The Company

Our client is one of Australia's leading life Insurers for decades. They remain committed to continually evolving their products and customer experience to meet and exceed the needs of the Australian community, now and in the future.

The Opportunity

This Data Engineer role assists the Senior Manager - Member Insights & Data Science in building and operationalising data pipelines supporting membership, new business, underwriting and claims data models that provide a platform for insights and machine learning projects.

Key Accountabilities

  • Build data pipelines in Python and SQL

  • Conceptual modelling - able to build the right data pipeline to support the problem

  • Design, implement and maintain scalable data orchestration code

  • Efficient data structure and software framework choices

  • Work effectively with data structures and algorithms e.g., Pandas, numpy, etc.

  • Conversant in relational databases, SQL, and query databases

  • Experience working with cloud provider tooling e.g., Azure, Databricks, Synapse

  • Comfortable working with Linux and/or VS Code in a remote server environment

  • Can work with JSON and Application Programming Interfaces (API's)

  • Good understanding of database design and architecture principles

  • Implement Data quality and validation routines

The ideal candidate for this role will have

  • Experience with data engineering and building data pipelines

  • Experience with AIRFLOW is a must, must be able to work with modern 'DAG'-based data orchestration tools e.g., Dagster, Airflow

  • Experience with collaborative software tooling e.g., GIT

  • Exposure to test-driven workflows

  • Experience working with Dagster

  • Prior experience working as a Data Analyst and/or Data Scientist

  • Knowledge of Big Data technologies and distributed computing tools (Azure, Spark,

Why Apply?

  • Be part of a high-performing, market-leading, and dynamic organisation

  • Inclusive Work Culture

  • Flexible work arrangement

Your next steps

If you would like to work for a company that places enormous value on its employees, then please apply now. Alternatively, please call Hima Arafath on 0452089967 for a confidential conversation.

Whether you are a sports fanatic, shopaholic, or part-time antique collector, we celebrate your uniqueness.

Parity Consulting works with clients who embrace diverse and inclusive environments and empower their teams to bring their authentic whole self to work. We encourage people with different beliefs, abilities, backgrounds, and life experiences to contact us

Other Roles Like This

Marketing & Communications Recruitment, Data Science, Data Analytics & Data Engineering Recruitment

Marketing Data and Insights Analyst / Specialist

Sydney CBD
Negotiable

The Company Our client is a boutique investment firm with a clear vision: to deliver high-quality strategies that dri...

Read more Apply now
Marketing & Communications Recruitment

Expressions of Interest - Marketing, Comms & Digital roles

Sydney CBD
Negotiable

Submit a proactive Expression of Interest to be considered for future opportunities. At Parity, we're passionate abou...

Read more Apply now
Product Management & Development Recruitment

Expression of Interest - Product, Governance & Data roles

Sydney CBD
Negotiable

Submit a proactive Expression of Interest to be considered for future opportunities. At Parity, we're passionate abou...

Read more Apply now
Marketing & Communications Recruitment

Marketing Admin Support - Immediate Start

Sydney
Negotiable

Temporary Marketing Admin Support - Immediate Start The Company Our client is an Australian based company specialisin...

Read more Apply now
Transformation Recruitment

IT Customer Support Representative (Service Desk Level 2)

Sydney CBD
Negotiable

The Company Our client is a mid-sized industry super fund recognised for its collaborative culture and unwavering com...

Read more Apply now
Product Management & Development Recruitment

Senior Product Manager, Mortgages

Sydney CBD
Negotiable

The Company Our client is a well-regarded financial services organisation known for delivering innovative lending sol...

Read more Apply now
Marketing & Communications Recruitment

Project Marketing Manager

Sydney CBD
Negotiable

The Company Our client is an Australian based company specialising in the development, management and operation of ac...

Read more Apply now
Marketing & Communications Recruitment

Internal Communications Manager

North Sydney
Negotiable

Internal Communications Manager Looking to drive meaningful connection across a growing organisation? Here's your cha...

Read more Apply now