Role

We are seeking a skilled Cloud Data Engineer (Azure) to join our growing data team. As a Cloud Data Engineer, you will design, develop, and maintain scalable data solutions on Microsoft Azure. Your expertise in Azure data services, data pipelines, and data architecture will be essential in enabling our organization to make data-driven decisions.

Responsibilities

• Design and implement end-to-end data pipelines on Azure using services like Azure Data Factory, Azure Synapse, Databricks, Azure Data Lake, and Azure SQL.
• Build scalable, reliable, and secure data ingestion, transformation, and storage solutions.
• Develop and maintain data models, data warehouses, and data lakes to support analytics and reporting.
• Collaborate with data analysts, data scientists, and business stakeholders to understand data needs and translate them into technical solutions.
• Ensure data quality, data governance, and compliance with data security policies.
• Monitor and troubleshoot data pipeline performance and issues.
• Automate workflows and integrate with CI/CD pipelines using tools like Azure DevOps.
• Optimize data storage and processing costs on Azure.

Profile

• Minimum Bachelors Degree in Computer Science, Engineering or other relevant fields
• Minimum 6- 7 years of experience in Azure Solutions support
• Experience with Azure, PowerShell, Bicep, Azure DevOps
• Good Communication both written and spoken in English

Azure Infrastructure Deployment and Management

• Familiarity with Infrastructure as Code (IaC) tools in Azure
• Experienced with PowerShell and Bicep scripting for automating infrastructure deployment and management.

Platform Lifecycle Management with DevOps

• Strong knowledge of DevOps practices and tools, including Azure DevOps and Git (must have)
• Platform lifecycle management with DevOps
• Experienced implement and manage of CI/CD pipelines using Azure DevOps and Git to ensure smooth deployment and integration processes

Other Technologies/Process

• Specific Technologies: ADLS Gen2, Parquet & Delta tables, Azure Data Factory, Synapse Serverless SQL…
• Strong technical expertise in: (Azure) Databricks, unity catalog, Databricks pipelines, Databricks SQL Warehouse, DLT, Notebooks (python) , Databricks Serverless implementation.
• Strong understanding of “big data” / “Lakehouse” architecture
• Ideally, knowledge of Azure FinOps