Job Description: Developer with strong technical ability with 5-8 years of experience in Java/J2EE design and development Experienced in working on medium to large enterprise projects, preferably in financial services Should have knowledge on Apache Spark framework. Must have knowledge on HBase Should have basic knowledge on Bigdata Cluster and operations Person should have worked in Agile/DevOps Environment Good communication skills Key Responsibilities: Experience with developing software that processes, persist and distributes data via relational and non-relational technologies • Employ standards, frameworks and patterns while designing and developing components Develop high quality code employing software engineering and testing best practices Converse with various data provider and consumer applications in their languages/terminologies Partner with database developers to implement ingestion, orchestration, quality/reconciliation and distribution services Skills Required: Experience with developing software that processes, persists and distributes data via relational and non-relational technologies: o Strong Spark/Java Skills o Experience in design and development of batch/real time Spark processing pipelines. o Knowledge of Spark framework – Core Spark, Spark Data Frames, Spark streaming o Knowledge of Bigdata Cluster and operations. Good to Have: Have basic experience in Data Preparation Tools Spark Experience on other programming language like Scala, Python etc. Experience with CI/CD build pipelines and toolchain – Git, BitBucket, TeamCity, Artifactory, Jira Experience with testing concepts (TDD, BDD) and frameworks (Cucumber, Selenium, FluentLenium, Junit) Experience with container technologies (Docker, Pivotal Cloud Foundry) and supporting frameworks (Kubernetes, OpenShift, Mesos) Knowledge of Operating Systems and familiar with shell scripting Skills Required: Core Spark, Spark Data Frames, Spark streaming, Java Job Type: Full-time Pay: ₹2,000,000.00 - ₹3,000,000.00 per year Schedule: Monday to Friday Experience: Informatica: 1 year (Required) SQL: 1 year (Required) Data warehouse: 1 year (Required)