As a Data Engineer at GoodHabitz, you’ll be part of an exciting journey as we migrate to AWS, enhancing our data infrastructure to support our growing business. In our scale-up environment, adaptability and problem-solving are key. This role is crucial in designing, building, and optimizing our data architecture to meet evolving needs. With expertise in data pipeline stacks (both open-source and AWS), you’ll develop scalable, high-performance solutions that drive efficiency and reliability. Collaborating closely with engineering teams, you’ll help shape robust data pipelines that align with our business objectives. If you're eager to make a real impact and be part of this transformation, we’d love to hear from you.

Key Responsibilities:

• Data pipeline Design: Robust design experience in follow and implement scalable, high-performance data architectures using AWS services and OLAP databases (Clickhouse/ Snowflake).
• Data Pipeline Development: Design, build, and maintain robust ETL pipelines that efficiently handle large-scale data ingestion, transformation, and storage using solutions like Databricks.
• Cloud Infrastructure: Combine open-source data stack and AWS technologies to build and optimize data workflows.
• Data Governance & Quality: Ensure data accuracy and consistency through best practices in data governance, lineage, and monitoring.
• Performance Optimization: Optimize data storage, retrieval, and processing to support high-performance analytical workloads using partitioning, indexing, and query optimization techniques.
• Collaboration & Leadership: Work closely with data analysts, and software engineers to understand requirements and deliver data-driven solutions, mentoring junior engineers.
• Automation & CI/CD: Implement automated data pipeline deployment and monitoring strategies.

Requirements:

• 5+ years of experience in data engineering with solid experience on open-source data stack, and cloud native experiences.
• Deep understanding of ETL processes, data modeling, and data warehousing (experience with medallion architecture and delta lake).
• Strong experience in designing and architecting large-scale data systems.
• Proficiency in programming languages like PySpark, Python, or productivity libraries scripting languages for data processing and pipeline development.
• Experience with orchestration tools such as Apache Airflow, Step Functions, or Dragster.
• Hands-on experience with infrastructure-as-code (Terraform, CloudFormation, CDK).
• Strong problem-solving skills and ability to work in a fast-paced environment.
• Knowledge of SQL query performance tuning, materialized views, and sharding strategies for large datasets.

Nice to have:

• Expertise in ClickHouse or Snowflake, or similar OLAP databases is a plus.
• Familiarity with containerization and serverless computing (Docker, Kubernetes) is a plus.
• Experience with monitoring and observability tools such as Prometheus, Grafana, AWS CloudWatch is a plus.

Here's a glimpse of what's waiting for you:

• A competitive salary package that rewards your hard work.
• 25 paid vacation days. And if that's not enough, you can purchase up to 10 more.
• A world of growth and development opportunities to enhance your skills. You'll have unlimited access to our treasure trove of GoodHabitz resources and MyAcademy .
• Access to mental coaching through our partner, OpenUp, to keep your mind in top shape.
• An annual do-good-day, fully paid, so you can contribute to a cause you're passionate about.
• Travel and expense reimbursement because we've got your journey covered.
• Pension and disability insurance, securing your financial well-being in the long run.
• A hybrid way of working .
• Working in a company that welcomes artificial intelligence and uses it to improve internal processes and push AI-powered features quickly .
• MacBook Pro.