Technical Lead (SAP HANA, Databricks, Azure Data Factory)

Location: San Jose, CA 95110 / Santa Clara, CA 95054 (Onsite)

Direct-Hire ( 1st Preference) / Contract (C2C/W2- 2nd Preference)

Salary: Market/DOE/Negotiable

Client: Pharma

We are looking for a skilled Technical Lead to oversee the design and implementation of large-scale data engineering and migration projects. The ideal candidate will have hands-on expertise in SAP HANA, Databricks, Azure Data Factory, and related technologies, with a proven track record of leading at least 3 successful data projects.

Experience/Skills

• Minimum of 8 years of experience in data engineering/architecture roles
• Must have led 3 or more end-to-end enterprise data projects involving SAP HANA, Databricks, and Azure technologies
• Deep knowledge of SAP HANA architecture and complex data models
• Extensive experience with Databricks, PySpark, Spark SQL, and Delta Lake
• Strong command over ETL tools such as SAP Data Services and Azure Data Factory
• Proficient in programming languages: Python, Java, or Scala
• Hands-on with Azure cloud services, including networking and security configurations
• Bachelor’s degree in Computer Science, Information Systems, or a related field

Key Responsibilities

• Lead the design and implementation of ETL solutions using SAP Data Services and Azure Data Factory
• Guide and mentor team members on data engineering best practices
• Develop and maintain complex ETL pipelines using Python, Java, or Scala
• Ensure high-quality, secure, and performant data migrations using Azure Blob Storage and Spark JDBC
• Drive collaboration across teams to implement advanced analytics and ML models in Databricks
• Identify and resolve performance bottlenecks and network-related issues
• Ensure adherence to data governance and compliance standards across all data flows
• Analytical Skills: Strong analytical and problem-solving skills, with the ability to interpret complex data sets and derive meaningful insights
• Communication Skills: Excellent verbal and written communication skills, with the ability to convey technical information to non-technical stakeholders
• Leadership Skills: Proven ability to lead and manage teams, with a track record of successful project delivery
• Presentation Skills: Effectively presenting project updates and outcomes to stakeholders and executives

Secondary Skills / Good To have

• Understanding of Databricks ML and analytics tools; Experience resolving networking/VPN issues related to data flow
• Familiarity with data governance, security, and compliance frameworks; setting up CI/CD pipelines and using DevOps tools is a plus