Data Engineer, Glasgow (Remote Working)

Day Rate: £450 Per Day

Duration: 3 months (extension possible)

IR35 Status: Outside IR35

Overview

We are seeking an experienced Data Engineer Contractor to deliver a robust, scalable data integration pipeline on the Azure platform. This role requires hands-on expertise in API ingestion, orchestration, and transformation into a well-designed data warehouse structure, including star schema design for downstream analytics.

You’ll play a key role in building end-to-end data flow from source APIs to a SQL-based DWH, ensuring data is clean, reliable, and analytics-ready.

Key Responsibilities

• Develop Python-based ETL scripts to extract data from external REST APIs
• Implement incremental loading strategies using watermarking or change detection
• Orchestrate workflows using Azure Function Apps or Docker containers
• Integrate processes into Azure Data Factory (ADF) pipelines
• Design and implement star schemas suitable for reporting and analytics use cases
• Write and optimize T-SQL stored procedures for transformation
• Establish monitoring, logging, and alerting for pipeline reliability
• Contribute to CI/CD pipelines for deployment automation
• Maintain clear and concise technical documentation throughout

Essential Skills & Experience

• Advanced Python skills for building data extraction and transformation workflows
• Solid experience across Azure data services, particularly:
• Azure Function Apps or Docker
• Azure Data Factory (ADF)
• Azure SQL / Synapse
• Strong experience in designing star schemas and dimensional modelling for analytics
• Strong SQL development skills (stored procedures, indexing, performance tuning)
• Experience with incremental data loading patterns (e.g. watermarking)
• Proven ability to build and support reliable, production-grade data pipelines
• Working knowledge of CI/CD tools (e.g. Azure DevOps, Git)