Data Engineer with Python

3 to 8 years Remote

Role Overview:

As a Data Engineer with 3 to 8 years of experience, you will be responsible for building, optimizing, and managing data pipelines using AWS/Azure technologies. You will play an integral role in ensuring seamless data flow, efficient processing, and optimal performance across various cloud services. Your technical expertise will enable the organization to maximize the value of its data infrastructure and contribute to impactful data solutions.

• Experience:
• 3 to 8 years of hands-on experience as a Data Engineer, Cloud Engineer, or in a similar role with a focus on AWS/ AZure
• Expertise in building and maintaining data pipelines using AWS/Azure like BigQuery, Cloud Dataflow, Pub/Sub, Cloud Functions, Dataproc, Cloud Storage, and Cloud SQL.
• Strong experience in ETL/ ELT processes, data integration, and data processing within the cloud.
• Proficiency in programming languages such as Python, SQL, and experience with Apache Beam and Apache Airflow for orchestration.
• Cloud Architecture: Deep understanding of cloud-based architectures, particularly within AWS/Azure, and experience with designing and optimizing data solutions.
• Data Security: Strong knowledge of cloud security practices, particularly in managing data security, identity, and access management on AWS/Azure.
• Collaboration & Communication: Excellent interpersonal and communication skills to work effectively with both technical teams and business stakeholders.

Preferred Skills:

• AWS/Azure Certifications: AWS/Azure Certified – Professional Data Engineer or similar certifications.
• Additional Tools: Experience with tools like Apache Kafka, Spark, Hadoop, or Kubernetes is a plus.
• Machine Learning: Familiarity with ML concepts or services in GCP, such as Vertex AI, is a bonus.
• Data Governance: Understanding of data governance practices for maintaining data quality, lineage, and traceability.