We are seeking a skilled Data Engineer with strong technical knowledge in Azure Databricks, PySpark, and SQL. The ideal candidate will be responsible for collaborating with client partners and product owners to understand requirements, assess their feasibility, and drive the design and development of data solutions. You will work closely with cross-functional teams to ensure that tasks are completed effectively and on time, guiding junior team members to deliver high-quality software.
Key Responsibilities
Collaborate with client partners and product owners to gather clear and comprehensive requirements.
Analyze the feasibility and impact of the requirements to develop detailed interface designs.
Break down requirements into tasks and create user stories for implementation.
Participate in the development and deployment of solutions, ensuring adherence to best practices and project timelines.
Assign tasks to junior team members and provide guidance to ensure the delivery of quality software.
Ensure the overall success of data engineering initiatives by maintaining clear communication with the team and stakeholders.
Technical Skills Required
Azure Databricks (ADB): In-depth knowledge of Azure Databricks for developing scalable data engineering solutions.
PySpark: Expertise in working with PySpark to process and analyze large datasets.
SQL: Strong proficiency in writing optimized SQL queries to handle data-related tasks.
Azure Data Factory (ADF): Experience in building data pipelines using Azure Data Factory.
MongoDB: Knowledge of MongoDB for managing NoSQL databases in data engineering projects.
Skills
Adb,Adf,Pyspark,Sql
How strong is your resume?
Upload your resume and get feedback from our expert to help land this job
How strong is your resume?
Upload your resume and get feedback from our expert to help land this job