The Data Engineer position at NCS Australia is an exciting opportunity to work within a cross-functional squad, designing, building, and maintaining high-quality data assets. This job plays a crucial role in supporting reporting, analytics, and operational workflows, ensuring that data integrity and performance are prioritized. The team thrives on innovation, collaboration, and a commitment to making a meaningful impact together.
You'll be responsible for
🛠️
Designing data pipelines
Owning the end‑to‑end lifecycle of data pipelines, focusing on designing and maintaining Databricks (Spark/Delta) pipelines for batch and near real‑time ingestion.🔍
Implementing data transformations
Implementing transformations, conformance logic, and curated datasets for reporting and analytics.🔒
Establishing data quality processes
Establishing robust data quality processes, addressing data integrity and performance issues, and supporting release validation.