Note: The job is a remote job and is open to candidates in USA. Dice is seeking a Senior Data Engineer (AI) to join their team, offering a contract position through the end of 2026. The role involves building and maintaining enterprise-scale data pipelines, leveraging Azure data services and Databricks for data processing and integration.

Responsibilities

• Strong hands-on experience with Azure data services, including: Azure Data Lake Storage (ADLS), Azure Data Factory and/or Synapse Pipelines
• Deep experience with Databricks, including Spark / PySpark development and performance optimization
• Proven experience building and maintaining enterprise-scale data pipelines
• Experience integrating data from diverse enterprise systems (databases, APIs, cloud platforms)
• Solid understanding of data architecture principles, data modeling, and ETL/ELT patterns
• Experience with pipeline orchestration, automation, and monitoring
• Working knowledge of MLOps concepts, including supporting data workflows for model training and deployment
• Strong troubleshooting and performance tuning skills in distributed environments
• Familiarity with data governance, security, and access control frameworks
• Proficiency in Python and SQL
• Strong collaboration and communication skills

Skills

• 7+ years of professional experience (post-graduate) in data engineering or related field
• Strong hands-on experience with Azure data services, including: Azure Data Lake Storage (ADLS), Azure Data Factory and/or Synapse Pipelines
• Deep experience with Databricks, including Spark / PySpark development and performance optimization
• Proven experience building and maintaining enterprise-scale data pipelines
• Experience integrating data from diverse enterprise systems (databases, APIs, cloud platforms)
• Solid understanding of data architecture principles, data modeling, and ETL/ELT patterns
• Experience with pipeline orchestration, automation, and monitoring
• Working knowledge of MLOps concepts, including supporting data workflows for model training and deployment
• Strong troubleshooting and performance tuning skills in distributed environments
• Familiarity with data governance, security, and access control frameworks
• Proficiency in Python and SQL
• Strong collaboration and communication skills

Company Overview

Company H1B Sponsorship