Banner

Data Engineer- Airflow

Back to job search

Job Description

The Company

Our client is one of Australia's leading life Insurers for decades. They remain committed to continually evolving their products and customer experience to meet and exceed the needs of the Australian community, now and in the future.

The Opportunity

This Data Engineer role assists the Senior Manager - Member Insights & Data Science in building and operationalising data pipelines supporting membership, new business, underwriting and claims data models that provide a platform for insights and machine learning projects.

Key Accountabilities

  • Build data pipelines in Python and SQL

  • Conceptual modelling - able to build the right data pipeline to support the problem

  • Design, implement and maintain scalable data orchestration code

  • Efficient data structure and software framework choices

  • Work effectively with data structures and algorithms e.g., Pandas, numpy, etc.

  • Conversant in relational databases, SQL, and query databases

  • Experience working with cloud provider tooling e.g., Azure, Databricks, Synapse

  • Comfortable working with Linux and/or VS Code in a remote server environment

  • Can work with JSON and Application Programming Interfaces (API's)

  • Good understanding of database design and architecture principles

  • Implement Data quality and validation routines

The ideal candidate for this role will have

  • Experience with data engineering and building data pipelines

  • Experience with AIRFLOW is a must, must be able to work with modern 'DAG'-based data orchestration tools e.g., Dagster, Airflow

  • Experience with collaborative software tooling e.g., GIT

  • Exposure to test-driven workflows

  • Experience working with Dagster

  • Prior experience working as a Data Analyst and/or Data Scientist

  • Knowledge of Big Data technologies and distributed computing tools (Azure, Spark,

Why Apply?

  • Be part of a high-performing, market-leading, and dynamic organisation

  • Inclusive Work Culture

  • Flexible work arrangement

Your next steps

If you would like to work for a company that places enormous value on its employees, then please apply now. Alternatively, please call Hima Arafath on 0452089967 for a confidential conversation.

Whether you are a sports fanatic, shopaholic, or part-time antique collector, we celebrate your uniqueness.

Parity Consulting works with clients who embrace diverse and inclusive environments and empower their teams to bring their authentic whole self to work. We encourage people with different beliefs, abilities, backgrounds, and life experiences to contact us

Other Roles Like This

Product Management & Development Recruitment

Senior Manager - Platforms - CONTRACT

Sydney
Negotiable

The Company Our client is a renowned financial services organisation committed to helping Australians build better fi...

Read more Apply now
Marketing & Communications Recruitment

Customer Lifecycle Manager - Retention and Engagement

Sydney CBD
Negotiable

The Company Our client is a reputable mutual bank, where profit for purpose is their business model and are 100% owne...

Read more Apply now
Data Science, Data Analytics & Data Engineering Recruitment

Senior Data Strategy Manager/Analyst - Contract

Sydney
Negotiable

The Company Our client is a long-standing financial services provider operating in Australia and New Zealand, offerin...

Read more Apply now
Marketing & Communications Recruitment

Marketing Specialist

Sydney CBD
Negotiable

The Company Our client is an industry leader in the private credit space, offering a range of listed and unlisted pro...

Read more Apply now
Marketing & Communications Recruitment

Digital Marketing and Data Associate

Sydney CBD
Negotiable

The Company Our client is an industry leader in the financial services space and due to growth are looking to add to ...

Read more Apply now
Marketing & Communications Recruitment

Senior Marketing and Communications Manager

Sydney CBD
Negotiable

The Company Our client is an industry leader in the financial services space and due to growth are looking to add to ...

Read more Apply now
Marketing & Communications Recruitment

Senior Marketing Manager

Sydney CBD
Negotiable

The Company Our client is a trusted leader in the lending space with the goal of breaking the mould of traditional le...

Read more Apply now
Transformation Recruitment

Azure Cloud Engineer

Sydney CBD
Negotiable

The Company Our client is a mid-sized industry super fund recognised for its collaborative culture and unwavering com...

Read more Apply now