Responsibilities and Duties

• Design, develop, and optimize scalable data architectures in AWS environments.
• Implement and manage data pipelines for real-time and batch data ingestion, processing, and transformation.
• Model relational and non-relational databases, ensuring efficiency and scalability.
• Manage and optimize databases in AWS using services such as Amazon RDS, Aurora, DynamoDB, S3, Glue, EMR, Lambda, Kinesis, and others.
• Develop and optimize ETLs/ELTs using tools like AWS Glue, Apache Spark, dbt, and Airflow.
• Ensure data quality, security, and governance through best practices and tools like Lake Formation and AWS IAM.
• Collaborate with Data Science, Analytics, and Development teams to optimize data access and processing.
• Implement data quality testing and automated validations.
  
  

Education

Required Experience, Skills, and Qualifications

• Bachelor’s degree in Systems Engineering, Computer Science, Mathematics, Statistics, or related fields.
• AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect certification (preferred).
  
  

Experience

• 3 to 5 years of experience in data engineering in cloud-first environments.
• Experience working with large-scale data (Big Data) and scalable architectures.
• Experience integrating data from multiple sources in structured and unstructured environments.
  
  

Skills And Competencies

• Data Modeling: Experience in designing SQL and NoSQL databases optimized for performance and scalability.
• Cloud & AWS Data Services: Advanced knowledge of Redshift, RDS, DynamoDB, Glue, Kinesis, Lambda, EMR, S3, and other AWS data tools.
• Data Processing: Experience with Apache Spark, PySpark, Pandas, SQL, dbt, and Apache Airflow.
• Programming Languages: Strong proficiency in Python, SQL, Scala, or Java.
• Automation & DevOps: Experience with Terraform, Docker, and CI/CD for deploying data infrastructures.
• Optimization & Performance: Expertise in SQL query performance tuning, storage, and data processing optimization.
• Data Security & Governance: Implementation of access policies, auditing, and regulatory compliance (GDPR, HIPAA).