We are looking for a skilled Lead Data Software Engineer to architect and guide the development of robust data pipelines for our cutting-edge data platform.

You will take responsibility for technical leadership, strategy, and mentoring the team while actively transforming raw data into usable states. Your hands-on expertise with Python, Apache Airflow, and AWS, coupled with your ability to lead and influence, will drive impactful solutions.

Responsibilities

• Lead the development of data software engineering solutions and set technical direction for the team
• Own the end-to-end design, implementation, and optimization of scalable data pipelines and ETL processes
• Develop and guide the creation and maintenance of Apache Airflow DAGs for data transformation, processing, and orchestration
• Mentor and provide technical leadership to junior and mid-level engineers, sharing best practices and fostering growth
• Collaborate closely with cross-functional teams to align development efforts with organizational goals
• Define and enforce coding standards, architectural principles, and documentation for long-term maintainability
• Establish advanced monitoring, debugging, and fault-tolerant capabilities to ensure pipeline performance and data quality
• Advocate for and implement performance optimizations and reliability improvements in a cloud-based infrastructure
• Drive knowledge sharing and adoption of emerging tools and methods for modern data engineering practices
  
  
  

Requirements

• 5+ years of hands-on experience in data software engineering
• At least 1 year of relevant leadership experience
• Extensive experience using Python to develop scalable data transformation and processing logic
• Advanced expertise in Apache Airflow for designing, managing, and optimizing ETL/ELT processes
• Comprehensive knowledge of Amazon Web Services and its services for data engineering
• Strong understanding of scalable, distributed systems and modern cloud-based architectures
• Substantial experience with PostgreSQL, SQL-based data manipulation, and advanced database design
• Demonstrated ability to design and implement systems for monitoring, performance optimization, and fault tolerance
• Proficiency in applying agile methodologies and fostering collaborative development practices within teams
• Proven ability to lead by example, inspire technical teams, and align with long-term strategies
• Strong verbal and written communication skills in English, at least at a B2+ level, with the ability to present technical concepts to non-technical stakeholders
  
  
  

Nice to have

• Extensive knowledge of OpenSearch for indexing and searching large datasets
  
  
  

We offer

• International projects with top brands
• Work with global teams of highly skilled, diverse peers
• Healthcare benefits
• Employee financial programs
• Paid time off and sick leave
• Upskilling, reskilling and certification courses
• Unlimited access to the LinkedIn Learning library and 22,000+ courses
• Global career opportunities
• Volunteer and community involvement opportunities
• EPAM Employee Groups
• Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn