Azure BI Developer

Role Purpose :

We are seeking a highly skilled Azure BI Developer to join our team. The ideal candidate will bring deep expertise in Azure Synapse Analytics, Databricks, Python, PySpark, Azure Data Factory (ADF), and Azure cloud services. In this role, you will be responsible for designing, developing, and maintaining scalable data solutions while ensuring optimal ETL/ELT processing, data governance, and performance optimization.

Job Description:

• Design, build, and maintain data pipelines and solutions using Azure technologies.
• Develop and optimize scalable data solutions using Azure Synapse Analytics, Databricks, Python, PySpark, and Azure Data Factory (ADF).
• Design, develop, and maintain ETL/ELT pipelines for efficient data processing and transformation.
• Implement Data Lake architecture and Delta Lake best practices for managing structured and unstructured data.
• Enforce and manage data security, governance, and compliance measures within Azure cloud environments.
• Collaborate with cross-functional teams to integrate data insights and deliver impactful solutions that support business goals.
• Implement Azure DevOps processes for automating CI/CD pipelines to streamline development workflows.
• Leverage expertise in Synapse Analytics for data integration and analytics.
• Work hands-on with Databricks for big data processing, analytics, and machine learning workflows.
• Provide guidance on best practices for performance optimization, monitoring, and troubleshooting.

Skills Required;

• Proficiency in Python for data processing, automation, and transformation.
• Extensive experience with PySpark for distributed data processing.
• Strong knowledge of SparkSQL for querying and managing big data.
• Proven hands-on expertise with Azure Synapse Analytics, Databricks, and Azure Data Factory (ADF) for developing ETL/ELT pipelines.
• Strong understanding of Data Lake architecture and Delta Lake principles for managing large-scale data.
• Knowledge of data security, governance, and compliance standards in cloud environments.
• Expertise in Azure DevOps for setting up CI/CD pipelines and automating workflows.
• Experience implementing automated data engineering processes with Azure DevOps.
• 6+ years of experience in Data Engineering, with a strong focus on Azure technologies and cloud-based data solutions.
• Azure certifications (e.g., Azure Data Engineer or Azure AI Engineer Associate) are a plus.
• Ability to work onsite.