Job Description:

Data Engineer / Senior Data Engineer

Experience: 5 + Years
Technologies: Microsoft Fabric, Databricks, Data Modeling

Role Overview

We are looking for an experienced Data Engineer with strong expertise in Microsoft Fabric, Databricks, and enterprise data modeling to design and build scalable data platforms. The candidate will be responsible for developing modern data pipelines, implementing Lakehouse architectures, and ensuring reliable data delivery for analytics and business intelligence.

⸻

Key Responsibilities

Data Platform & Architecture
• Design and implement modern data architectures using Microsoft Fabric Lakehouse and Databricks Lakehouse.
• Build scalable data pipelines for batch and real-time processing.
• Develop data integration frameworks to ingest data from multiple enterprise sources.

Data Engineering
• Develop and maintain ETL/ELT pipelines using Databricks, PySpark, and Fabric Data Factory.
• Implement data ingestion frameworks from structured, semi-structured, and streaming sources.
• Optimize Spark workloads and distributed data processing for performance and scalability.

Data Modeling
• Design conceptual, logical, and physical data models for analytics platforms.
• Implement dimensional models (Star & Snowflake schemas) for enterprise data warehouses.
• Develop Lakehouse data models using Delta tables.

Microsoft Fabric
• Build Lakehouse and Warehouse solutions in Microsoft Fabric.
• Develop data pipelines using Fabric Data Factory.
• Implement Power BI semantic models and datasets within Fabric.

Databricks
• Develop scalable Spark-based transformations using PySpark / SQL.
• Manage Delta Lake architecture for reliable data processing.
• Implement Databricks workflows and job orchestration.

Data Governance & Quality
• Implement data validation, lineage, and monitoring frameworks.
• Ensure data security, governance, and compliance across the platform.

Collaboration
• Work closely with data architects, BI developers, and business stakeholders.
• Translate business requirements into scalable data solutions.

⸻

Required Skills

Core Technologies
• Microsoft Fabric
• Azure Databricks
• PySpark / Spark SQL
• SQL (Advanced)

Data Engineering
• ETL / ELT pipeline development
• Data Lake / Lakehouse architecture
• Distributed data processing

Data Modeling
• Dimensional Modeling
• Data Warehouse design
• Star & Snowflake schema

Cloud & Tools
• Azure Data Lake Storage
• Delta Lake
• Git / CI/CD
• Power BI (integration with Fabric)

⸻

Preferred Skills
• Experience with Data Governance tools.
• Knowledge of real-time streaming (Kafka / Event Hub).
• Experience with DataOps / DevOps pipelines.
• Understanding of medallion architecture (Bronze, Silver, Gold).

Get empowered by NTT DATA Business Solutions!

We transform. SAP® solutions into Value

Recruiter Name: Srinija Adapa

Recruiter Email ID: Srinija.Adapa@bs.nttdata.com

NTT DATA Business Solutions is a fast-growing international IT company and one of the world’s leading SAP partners. We are a full service provider delivering everything from business consulting to implementation of SAP solutions, including hosting services and support.