Job Title: Data Engineer

No of Years: 5+ exp

Location: Remote

Notice Period: Immediate

Shift Timing: Night shift

Job Description-

Note: we will need strong Snowflake data engineers here who have worked earlier on building CDP platforms providing customer insights ... which might be used for various upselling/ cross selling opportunities etc.

Snowflake & Microsoft Dynamics 365 Customer Insights Essential Duties and Responsibilities

• Build the data pipelines and integrate data for various Microsoft customer insights s ources (like Dynamics 365, Power BI, Azure) into Snowflake
• Construct and maintain enterprise level integrations using the Snowflake platform, Azure Synapse, Azure SQL and SQL Server.
• Create data tools for data analytics and data science team members that assist them in building and optimizing our product into an innovative industry leader.
• Clean, standardize, and transform customer data within Snowflake using SQL and other data manipulation techniques to prepare it for analysis
• Troubleshoot issues helping to drive root-cause analysis, and work with infrastructure teams to resolve incidents and arrive at a permanent resolution.
• Create automated data pipelines using tools like Azure Data Factory to efficiently move and process data between Microsoft systems and Snowflake
• Provide direction and coordination for development, and support teams, including globally located resources.
• Understand the layout and working of existing integrations that send and receive data between Oracle, Concur, JDE, Corporate Data Platform and other systems.
  
  

Required

• A relevant technical BS Degree in Information Technology
• 5+ years writing SQL queries against any RDBMS with query optimization
• 5 years of data engineering experience leveraging technologies such as Snowflake, Microsoft Customer Insights, Azure Data Factory, ADLS Gen 2, Logic Apps, Azure Functions, Apache Spark, Scala, Synapse, SQL Server
• Experience with scripting tools such as Power Shell, Python, Scala, Java and XML
• Understanding the pros and cons, and best practices of implementing Data Lake, using Microsoft Azure Data Lake Storage
• Experience implementing ETL for Data Warehouse and Business intelligence solutions
• Strong analytical, problem solving, and troubleshooting abilities
• Experience working within an agile team