Data Engineer (Azure/Oracle)

Location: Offshore

Experience:5+Yrs

Duration Long-Term

Job Summary

We are seeking an experienced Data Engineer with expertise in Azure, Oracle, and Big Data technologies to design, develop, and maintain large-scale data systems. The ideal candidate will have strong analytical skills, experience with data architecture, and proficiency in programming languages such as Python, Scala, and SQL.

Key Responsibilities

• Design and implement data architectures for large-scale data systems
• Develop and maintain data pipelines using Azure Databricks, ADLS, and other big data tools
• Work with relational and NoSQL databases (Postgres, Oracle)
• Implement data processing and analytics solutions using Python, PySpark, and SQL
• Collaborate with cross-functional teams to identify and prioritize data requirements
• Ensure data quality, security, and compliance
  
  

Mandatory Skills

• Data Architecture
• Azure Databricks
• Python (PySpark, Pandas, NumPy, SciPy)
• SQL (relational databases)
• Experience with object-oriented/object function scripting languages (Scala)
• Shell script and Linux commands
• Big Data tools (Hadoop, Spark)
• Relational and NoSQL databases (Postgres, Oracle)
• Azure cloud services (ADLS, Key Vaults, ADF, Log Analytics)
• Stream-processing systems (Spark-Streaming)
  
  

Desirable Skills

• Experience with message queuing and highly scalable big data stores
• Knowledge of data governance and data quality best practices
• Familiarity with Agile methodologies
• Certification in Azure or Oracle technologies
  
  

Education

• Bachelor's degree in Computer Science, Information Technology, or related field
  
  

Skills: python,azure,adf,postgres,shell script,oracle,data architecture,scipy,log analytics,azure databricks,big data,sql,pandas,numpy,scala,adls,linux commands,skills,databases,spark,data,analytics,architecture,key vaults,spark-streaming,pyspark,hadoop