Working on EMR, good knowledge of CDK and setting up ETL and Data pipeline
Coding - Python
AWS EMR, Athina, Supergule, Sagemaker, Sagemaker Studio
Data security & encryption
ML / AI
Pipeline
Redshift
AWS Lambda
Expectations/Responsibility:
Industry experience in Data Engineering on AWS cloud with glue, redshift , Athena experience.
Ability to write high quality, maintainable, and robust code, often in SQL, Scala and Python.
3+ Years of Data Warehouse Experience with Oracle, Redshift, PostgreSQL, etc. Demonstrated strength in SQL, python/pyspark scripting, data modeling, ETL development, and data warehousing
Extensive experience working with cloud services (AWS or MS Azure or GCS etc.) with a strong understanding of cloud databases (e.g. Redshift/Aurora/DynamoDB), compute engines (e.g. EMR/Glue), data streaming (e.g. Kinesis), storage (e.g. S3) etc.
Experience/Exposure using big data technologies (Hadoop, Hive, Hbase, Spark, EMR, etc.)
AWS engineer provides comprehensive systems administration functions on Amazon Web Services (AWS) infrastructure to include support of AWS products such as: AWS Console root user administration, Key Management, EC2 Compute, S3 Storage, Relational Database Service (RDS), AWS Networking & Content delivery (VPC, Route 53, ELB, etc.) Identity & Access Management, CloudWatch, CloudTrail, Cloud Formation, Auto Scaling, Cost and Usage Reports, and more.
Train and guide the company’s HR engineering team on developing with aforementioned AWS tools, while also executing on specific deliverables (ingestion, Storage, integration, warehouse, visualization)
Coach and mentor other technical resources on the team on AWS technologies
Create ETL piplelines that are highly optimized with very large data sets
Solve issues with data models and come up with solutions
Developing and directing software system testing and validation procedures, programming and documentation
Analyzing user needs and requirements to determine feasibility of design within time and cost constraints
Provide technology expertise, direction, coordination, and consultation, in the development, integration, launch, scaling, and maintenance of new and existing products and solutions
Establishes infrastructure technology architectures, standards, test plans, design templates and governance
Works with the team to define standards and frameworks with regards to coding, programming, and the general development of applications for multiple platforms
Work with business teams to understand customer issues and to investigate, prototype and deliver new and innovative solutions
Kind Regards,
Priyankha M
How strong is your resume?
Upload your resume and get feedback from our expert to help land this job
How strong is your resume?
Upload your resume and get feedback from our expert to help land this job