Karbon is on an exciting journey to revolutionize its data platform, and as a Data Engineer, you will play a crucial role in this transformation. This job is all about building a unified data platform that powers AI tools and insights, making a significant impact on the Karbon platform. The team thrives on collaboration, innovation, and a shared commitment to excellence.
You'll be responsible for
🔗
Developing a unified data platform
Develop our new unified data platform on Databricks, establishing the Medallion Architecture using DLT for data modeling and transformations.🚀
Developing data pipelines
Create and manage resilient data pipelines for batch and real-time processing from various sources in our Azure data ecosystem.✅
Championing data quality and governance
Establish best practices for data quality, integrity, and observability, building automated quality checks and monitoring for all data assets.Skills you'll need
🛠️
Data engineering
Proven track record of building and scaling data platforms, with 5+ years of relevant work experience.☁️
Databricks
Experience with Databricks for developing a unified data platform and implementing Medallion Architecture.🐍
Python
Strong proficiency in Python for building data solutions and pipelines.View more