Dice is the leading career destination for tech experts at every stage of their careers. Our client, InterSec Inc., is seeking the following. Apply via Dice today!

Data Engineer

Houston, TX/Spring TX- Onsite

Skills Required: Python, Databricks (SQL/Data Engineering), Apache Spark

Responsibilities:

• Design, develop, and maintain scalable data pipelines using Python, Databricks, and Apache Spark.
• Collaborate with data scientists and analysts to understand data requirements and deliver efficient solutions.
• Implement and optimize ETL processes to ensure data quality and integrity.
• Develop and maintain SQL queries and scripts for data extraction, transformation, and loading.
• Monitor and troubleshoot data workflows to ensure high availability and performance.
• Work with large datasets to perform data cleaning, transformation, and analysis.
• Stay up-to-date with the latest industry trends and technologies to continuously improve our data infrastructure
  
  

Required Skills -

• Solid skills in Python, SQL
• Working experience in Databricks (SQL/Data Engineering), Apache Spark
• GitHub (Actions)
• RestAPl's
• Experience in Databricks & PowerApps Dataverse integration
• ADX / Kusto
• Working experience with dashboarding (one of PowerBI, Databricks, ADX, Spotfire)