About The Role

We are looking for a proactive and independent Data Engineer to join our team and take ownership of automating data loading processes into our databases. This role is critical in establishing and enforcing strict data standards, with the new hire playing a key role in defining and building out these processes. The ideal candidate will be hands-on, able to work independently, and trusted to write clean, maintainable code.

Key Responsibilities

• Automate data loading processes into our databases using task automation tools (e.g., Prefect, Airflow).
• Define, implement, and enforce data standards and validation processes.
• Scrape data from various sources, investigate data issues, and ensure clean, properly formatted data is ingested.
• Write reliable, well-tested Python code, including using frameworks like Pandas and pytest.
• Collaborate with the team to improve data pipelines and troubleshoot issues as needed.
  
  

Required Skills

• Strong Python programming skills.
• Experience with task automation tools such as Prefect or Airflow.
• Hands-on experience with Pandas and testing frameworks like pytest.
• Strong SQL skills with the ability to work across complex datasets.
• Experience in data scraping and cleaning, with attention to data quality and integrity.
  
  

Nice To Have

• Familiarity with Pydantic, FastAPI, and mocking libraries.
• Experience building and optimizing APIs or related services.
  
  

Who You Are

• A mid-level engineer who can work independently and take full ownership of tasks.
• Detail-oriented with a strong sense of responsibility toward data accuracy and quality.
• Comfortable writing clean, tested code and contributing to process improvements.
  
  

Skills:- Python, Apache Airflow, pandas, pytest, SQL and Data engineering