Experience: 5+ years

Good to Have Skills:

• Complex SQLs
• Programming knowledge in JAVA
• Automation of workflows CI/CD
• Nifi streaming and transformation
• Informatica workflow migration

Job Description:

• Spark development with batch and streaming experience
• Experience with Pyspark and Data Engineering, Data Modelling and Data Analytics.
• ETL implementation and migration to spark
• Programming knowledge on scala, java & python
• Experience with Hive, HDFS, Kafka and Spark streaming (Dstream and Structured Streaming)
• Experience with using Jupyter notebooks or any other developer tool
• Experience with Airflow or other workflow engines
• Flink and Kudu streaming
• Big Data Engineering on-premises systems [preferred]