Responsibilities:
Develop in Big Data architecture, Hadoop stack including HDFS cluster, Hive, Spark and Scala
Write processes in Ni-Fi, Spark to Ingest data from various sources including sftp, mainframe, RDBMS, Kafka etc.
Write Spark/Scala code to transform data using business rules provided
Load...