Role Description

• As a DevOps Engineer, you will play a crucial role in our data engineering and DevOps initiatives.
• You will work closely with data analysts, data scientists, and developers to design, implement, and maintain data pipelines and infrastructure.
• Your expertise in Airflow, Kubernetes, SQL, and CI/CD will be essential to your success.
  
  

Responsibilities

• Design, develop, and maintain data pipelines using Apache Airflow.
• Orchestrate complex data workflows and dependencies.
• Monitor and troubleshoot data pipeline performance and reliability.
• Deploy and manage applications and services on Kubernetes.
• Ensure the scalability, reliability, and security of our Kubernetes infrastructure.
• Implement and maintain containerization and orchestration strategies.
• Design, build, and maintain CI/CD pipelines using GitLab.
• Automate software build, test, and deployment processes.
• Integrate automated testing and security scanning into CI/CD pipelines.
• Write and optimize SQL and PL/SQL scripts for data manipulation and analysis.
• Develop and maintain Python, Node.js, and shell scripts for automation and data processing (a plus).
• Apply techno-functional expertise in ETL and analytics tools to support data integration and analysis.
• Collaborate with data analysts and data scientists to understand data requirements.
• Work closely with cross-functional teams to understand data and deployment requirements.
• Communicate technical concepts clearly and concisely to both technical and non-technical stakeholders.
• Participate in code reviews and ensure code quality.
  
  

Must Have Skills

Apache Airflow : 2+ years of hands-on experience.

Kubernetes : 2.

5+ years of hands-on experience.

SQL/PL/SQL: 2+ years of hands-on experience.

GitLab: Experience with GitLab for version control and CI/CD.

CI/CD Pipelines: Proficiency in building and maintaining CI/CD pipelines.

Overall Experience: 4+ years of relevant experience

(ref:hirist.tech)