BTI Executive Search

Senior Data Engineer

Federal Territory of Kuala Lumpur, MY

4 days ago
Save Job

Summary

Key Responsibilities

  • Lead the end-to-end migration of data warehouse workloads from on-prem SQL Server to Azure.
  • Design, develop, and maintain robust ETL/ELT pipelines using Azure Data Factory (ADF), SSIS, and Databricks.
  • Perform data transformation, cleansing, and validation to ensure high data quality and consistency.
  • Implement and optimize data models for analytical and reporting needs on Azure (e.g., Synapse, Delta Lake).
  • Develop automation scripts in Python and SQL to support data ingestion and processing.
  • Monitor and troubleshoot data pipeline performance and resolve issues as they arise.
  • Document data flows, processes, and technical designs.

Requirements

  • Bachelor's degree in Computer Science, Engineering, or related field.
  • 5+ years of experience in data engineering or related field.
  • Proven experience migrating data warehouses from on-premise SQL Server to Azure cloud.
  • Strong hands-on experience with:
  • SQL Server (including SSIS and SSRS)
  • Azure Data Factory (ADF)
  • Databricks and/or Azure Synapse
  • Python and SQL for scripting and data manipulation
  • Solid understanding of data warehousing concepts, data modeling (star/snowflake), and performance tuning.
  • Strong analytical and problem-solving skills.
  • Excellent communication and stakeholder management skills.

Preferred Skills

  • Experience with Delta Lake, Azure Synapse Analytics, or Azure Data Lake Storage.
  • Knowledge of version control systems (e.g., Git) and Agile methodologies.

How strong is your resume?

Upload your resume and get feedback from our expert to help land this job