Check similar jobs, what people also searched, or create a job alert for Azure Data Fabric Engineer jobs in Bengaluru, Karnataka, India
HireRight
Azure Data Fabric Engineer
Bengaluru, Karnataka, India
11 days ago
Save Job
Summary
About HireRight
HireRight is the premier global background screening and workforce solutions provider. We bring clarity and confidence to vetting and hiring decisions through integrated, tailored solutions, driving a higher standard of accuracy in everything we do. Combining in-house talent, personalized services, and proprietary technology, we ensure the best candidate experience possible. PBSA accredited and based in Nashville, TN, we offer expertise from our regional centers across 200 countries and territories in The Americas, Europe, Asia, and the Middle East. Our commitment to get it right every time, everywhere, makes us the trusted partner of businesses and organizations worldwide.
Overview
The EDM data engineer will implement and oversee data pipeline systems that collect, convert and integrate raw data into refinement zones that will apply appropriate business rules. This will make the data more easily consumable by data scientists and business analysts.
Responsibilities
Design, build, test and deploy new data pipelines within On Prem or Cloud Data Eco-Systems
Improve existing data pipelines by simplifying and increasing performance.
Follow best practices and execute architected techniques and solutions for data collection, management and usage to aid in company-wide data governance and management framework.
Work closely with the data analysts and scientists, and database and systems administrators to create data solutions.
Evaluate new data sources for quality and attribution to support product requirements.
Documents new/existing pipelines, Data Sets and Data Sets lineage.
The work activity includes processing complex data sets, leveraging technologies used to process these disparate data sets and understanding the correlations as well as patterns that exist between these different complex data sets.
Qualifications
Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required.
Ability to develop, implement and optimize code using procedural languages such as PL/SQL, T-SQL, etc..
Experience with SSIS and C# development
Experience with data normalization and denormalization techniques
Experience in implementing largescale event based streaming architectures
Experience data transformation and data processing techniques
Knowledge of API and Microservice development
Experience in Agile methodology and/or pair programming
Strong communication skills
Strong writing and documentation skills
Experience in working with cross functional teams, building alignment and collaboration
Preferred Skills And Qualifications
Knowledge of AI/ML concepts and technologies
Experience with Stream-processing systems
Working knowledge of cloud architectures on Azure or GCP
Certification Azure Data Engineering Associate (DP203) and Implementing Analytic Solutions Using Microsoft Fabric (DP600).
Education and Experience:
BA/BS in Computer Science or related field, or equivalent experience.
5+ years of experience in data management and/or data curation.
5+ years development experience with Oracle and/or SQL Server.
5+ years of Experience with Python/Pyspark frameworks/libraries.
What Do We Offer
HireRight does not accept unsolicited resumes through or from search firms or staffing agencies. All unsolicited resumes will be considered the property of HireRight and HireRight will not be obligated to pay a placement fee.
How strong is your resume?
Upload your resume and get feedback from our expert to help land this job
How strong is your resume?
Upload your resume and get feedback from our expert to help land this job