Role Overview

We are looking for a skilled Azure Databricks Data Engineer with 3-4 years of experience to join our data engineering team. The ideal candidate will be proficient in building and optimizing data pipelines, leveraging Azure Databricks, and collaborating with cross-functional teams to drive data-driven insights.

Job Responsibilities

• Develop, implement, and maintain robust data pipelines using Azure Databricks.
• Collaborate with data scientists and analysts to gather requirements and ensure data integrity.
• Optimize ETL processes for efficiency and performance, utilizing best practices in data engineering.
• Monitor and troubleshoot data workflows to ensure data accuracy and availability.
• Implement data governance and quality measures across data sets.
• Create documentation for data processes, architecture, and workflows.
• Stay informed on industry trends and emerging technologies in data engineering.