As a Data Engineer, you'll focus on solving problems and creating value for business by building solutions that are reliable and scalable to work with the size and scope of the company. You will be tasked with creating a custom-built pipeline on GCP stack, and you will be part of teams that implement vendor sourced enterprise software, configuring that software, customizing it, and integrating with other internal systems.

Required Skills:

• 4+ years of industry experience in software development, data engineering, business intelligence, or related field with experience in manipulating, processing, and extracting value from datasets.
• Expertise in using BigQuery for data warehousing + GCP Mandate+Dataflow for stream and batch processing using Apache Beam
• Design, build and deploy internal applications to support our technology life cycle, collaboration and spaces, service delivery management, data and business intelligence among others.
• Building Modular code for multi usable pipeline or any kind of complex Ingestion Framework used to ease the job to load the data into Datalake or Data Warehouse from multiple sources.
• Work closely with analysts and business process owners to translate business requirements into technical solutions.
• Coding experience in scripting and languages (Python, SQL, PySpark).
• Expertise in Google Cloud Platform (GCP) technologies in the data warehousing space (BigQuery, Dataproc, GCP Workflows, Dataflow, Cloud Scheduler, Secret Manager, Batch, Cloud Logging, Cloud SDK, Google Cloud Storage, IAM, Vertex AI).
• Maintain highest levels of development practices including: technical design, solution development, systems configuration, test documentation/execution, issue identification and resolution, writing clean, modular and self-sustaining code, with repeatable quality and predictability.
• Understanding CI/CD Processes using Pulumi, Github, Cloud Build, Cloud SDK, Docker
• Experience with SAS/SQL Server/SSIS is an added advantage.

Additional Job Description

Qualifications:

• Bachelor's degree in Computer Science or related technical field, or equivalent practical experience.
• GCP Certified Data Engineer (preferred)
• Excellent verbal and written communication skills with the ability to effectively advocate technical solutions to research scientists, engineering teams and business audiences.

Email - [email protected]