Job Summary:

We are seeking a highly skilled Data Engineer to join our dynamic team. The ideal candidate will have strong experience in Data Engineering practices with expertise in Pentaho PDI, Airbyte, Power BI with DAX, Power Automate, Azure Administration, Python, API integration, SQL query optimization, data modeling, DBT, and Airflow orchestration. This role involves designing, developing, and maintaining data pipelines, optimizing performance, and ensuring the seamless flow of data across platforms.

Key Responsibilities:

• Design, develop, and maintain data pipelines using Azure Data Services (Azure Data Factory, Azure Synapse, Azure SQL, etc.).
• Implement ETL processes using Pentaho PDI and Airbyte for data ingestion and transformation.
• Develop and optimize SQL queries for performance improvement and efficient data retrieval.
• Build data models that support analytical and business intelligence (BI) needs.
• Develop reports and dashboards in Power BI, Paginated reporting, including advanced DAX calculations and visualization techniques.
• Automate workflows using Power Automate for data processing and reporting.
• Manage and maintain Azure infrastructure with hands-on experience in Azure Administration (security, monitoring, and performance tuning).
• Develop API, Python scripts for automation, data transformation, and analytics.
• Utilize DBT (Data Build Tool) for transformation and orchestration of ELT workflows.
• Implement Airflow for workflow orchestration and monitoring of data pipelines.
• Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver solutions.
• Ensure data quality, governance, and security across all data platforms.

Required Skills & Experience:

• 5+ years of experience as a Data Engineer working in Azure Cloud environments.
• Strong expertise in Azure Data Services (ADF, Synapse, Azure SQL, etc.).
• Proficiency in ETL tools, particularly Pentaho PDI and Airbyte.
• Advanced SQL skills with a deep understanding of query optimization and performance tuning.
• Strong experience with Power BI, paginated report, including DAX and report development.
• Experience in workflow automation using Power Automate.
• Hands-on experience in Azure administration, including managing resources, security, and performance.
• Proficiency in Python for scripting, automation, and data manipulation.
• Experience with DBT (Data Build Tool) for data transformations.
• Hands-on experience with Apache Airflow for job orchestration.
• Strong understanding of data modeling concepts (dimensional modeling, star schema, snowflake schema).
• Excellent problem-solving skills and the ability to work in an agile environment.

Preferred Qualifications:

• Experience with DevOps practices for CI/CD in data engineering.
• Knowledge of Big Data technologies like Databricks or Spark.
• Experience in Finance and operational reporting.
• Experience with Data Governance & Compliance (GDPR, HIPAA, etc.)
• Previous experience in manufactured housing and property management is a plus.