Let's take your Data Engineering career to the next level!

We are looking for a skilled Python Data Engineer to join our client's dynamic team. If you are passionate about building scalable data solutions and optimizing performance in a cloud-based environment, this role is for you! You will play a crucial role in designing and implementing data processing workflows, integrating APIs, and working with cutting-edge technologies like Azure Databricks and Apache Spark.

Key Responsibilities

• Develop, optimize, and maintain data pipelines using Python and Apache Spark.
• Work with Azure Databricks to manage clusters, workflows, and asset bundles.
• Implement and manage CI/CD pipelines in Azure DevOps, including YAML pipelines and release management.
• Build and expose REST APIs for seamless data integration with other applications.
• Optimize Spark jobs for performance and scalability.
• Collaborate with cross-functional teams to translate business requirements into technical solutions.
• Ensure data quality, security, and governance best practices are followed.

Required Experience & Skills

• Proven experience as a Data Engineer.
• Strong programming skills in Python, including experience with REST APIs and data processing libraries (PySpark, Requests, Pandas).
• Hands-on experience with Azure Databricks (clusters, workflows, Databricks asset bundles, and frameworks).
• Experience implementing CI/CD pipelines using Azure DevOps.
• Strong knowledge of Apache Spark and the ability to optimize Spark jobs.
• Ability to design and expose APIs for application integration.
• Experience in an industrial B2B market is a plus.
• Strong problem-solving skills and attention to detail.
• Effective communication skills and the ability to work collaboratively in cross-functional teams.

Nice to Have

• Knowledge of Azure MLflows.
• Experience with Scala (ability to read and understand existing code).
• Familiarity with Agile methodologies, including implementing design and testing strategies.

Our client offers a stimulating work environment where innovation and collaboration are key. They foster an open and diverse company culture and prioritize flexibility to ensure a healthy work-life balance. This is an exciting opportunity to work with cutting-edge technologies while continuously developing your skills in a supportive environment.

About the Client

Our client offers a stimulating work environment where you can continuously develop your skills. They foster an open and diverse company culture that prioritizes innovation and collaboration. Additionally, they offer flexibility to help maintain a healthy work-life balance.

If this sounds like the perfect next step for you, let's connect!

Send me a message or apply now.
0471 38 86 98