Data Engineer

Job Title: Data Engineer
Contract Type: Contract
Location: Sydney, New South Wales
Salary: Negotiable
Reference: CR/010457_1647583201
Contact Name: Dylan Delgado
Contact Email:
Job Published: March 18, 2022 19:00

Job Description

Data Engineer

Roles and Responsibilities:

  • Perform various activities including requirements gathering, solution development and the project implementation throughout the phases of Agile methodology
  • ELT Engineer / Developer will be responsible for the design, implementation and maintenance of a ELT process to support Cloud Enterprise Data Warehouse (CEDW) and data platform. This includes using cloud-based technologies, establishing best practices and procedures for ETL development, implementing ETL processes
  • Design, Feature, Test Case, Test Completion report documentation
  • The ETL Developer will collaborate with the Systems and Operations teams on a day-to-day basis and receive technical guidance from the DSO Manager or Lead Delivery Engineer
  • Peer Reviews and System testing
  • Demo the solution to various stakeholders (technical and non-technical)
  • Deploying the solution using CI/CD pipelines
  • Leverage standard toolset and develop ETL/ELT code to move data from various internal and external sources into the analytics platform
  • Participate in agile ceremonies

Skills and Experience Required:

  • Hands on experience in Large Data Warehouse projects (at least 3+ years)
  • Strong ELT/ ETL designer/developer experience (5+ years)
  • Ability to select and implement the appropriate ETL or ELT techniques
  • Data modelling experience (3NF and Dimension modelling)
  • Strong SQL & Python Expert level (5+ years)
  • Performance tuning with SQL
  • Cloud environment development & operations experience (AWS)

Preference for candidates experienced with:

  • Airflow (scheduler), git, AWS Redshift, Teradata, DataStage, IWS