Job Summary

We are looking for an experienced Lead Data Engineer to drive data engineering initiatives, architect scalable data solutions, and lead a team of engineers. The ideal candidate will have 10+ years of experience, specializing in Snowflake, Matillion, and Cloud platforms (Azure/AWS) and expertise in BI tools like Power BI, Tableau. This role requires strong SQL skills, analytical capabilities, excellent communication, and leadership abilities. The candidate should be able to scope projects, interact with clients, and deliver efficient data solutions.

Key Responsibilities

• Data Architecture & Engineering: Design and develop scalable, high-performance data solutions using Snowflake, Matillion, and cloud environments (Azure/AWS).
• ETL/ELT Development: Build and optimize ETL/ELT pipelines leveraging Matillion, Snowflake native capabilities, dbt, and other data integration tools.
• BI & Data Visualization: Use Power BI, Tableau, and DOMO to develop insightful reports and dashboards, ensuring seamless data flow from the backend to visualization layers.
• SQL Development & Optimization: Write and optimize complex SQL queries for performance tuning, data transformation, and analytics.
• Cloud Data Management: Implement data lakes, data warehouses, and data marts on Azure/AWS, ensuring security, scalability, and cost efficiency.
• Data Modeling & Data Warehousing: Design and implement dimensional models, star/snowflake schemas, and data warehouse best practices.
• Project Scoping & Client Engagement: Collaborate with stakeholders to understand business requirements, define project scope, and deliver tailored data solutions.
• Team Leadership: Lead a team of data engineers, conduct code reviews, mentor junior engineers, and establish best practices.
• Automation & Performance Optimization: Automate workflows, monitor system performance, and optimize data processes for efficiency.
• Data Governance & Security: Ensure compliance with industry best practices, data privacy laws, and security protocols.
• Workflow Orchestration: Implement and manage orchestration tools like Apache Airflow, Prefect, or Dagster for automated data workflows.
  
  

Required Skills & Qualifications

• 10+ years of experience in data engineering and cloud-based data solutions.
• Expertise in Snowflake, including performance tuning, data sharing, and security management.
• Strong experience with Matillion for ETL/ELT development.
• Proficiency in Azure or AWS Cloud Services (e.g., AWS Redshift, S3, Glue, Azure Synapse, Data Factory).
• Hands-on experience with BI tools such as Power BI, Tableau.
• Exceptional SQL skills for query optimization and data modeling.
• Strong analytical and problem-solving skills to translate business needs into technical solutions.
• Proven ability to lead teams, mentor engineers, and manage projects effectively.
• Excellent communication skills to collaborate with clients, stakeholders, and cross-functional teams.
• Experience with Python or other scripting languages for data processing is a plus.
• Experience with dbt for data transformation and modeling.
• Knowledge of workflow orchestration tools like Apache Airflow, Prefect, or Dagster.