Senior Data Engineer

The Opportunity

KPIT is seeking a highly skilled Senior Data Engineer to spearhead a heavy‑scale data analytics initiative. This is a mission‑critical role designed for an engineer who excels at the intersection of high‑performance data engineering and deep business analytics. You will be responsible for designing and implementing the architectures that power our most complex analytical use cases—transforming massive, raw datasets into high‑fidelity, business‑critical metrics. If you thrive on solving complex aggregation challenges and optimizing large‑scale distributed processing, this is your platform.

Technical Leadership & Data Architecture

• High‑Performance Pipeline Engineering: Architect, develop, and productionize sophisticated ETL/ELT pipelines using Spark (PySpark/Scala) . You will implement advanced optimization techniques, including partitioning, caching, shuffle tuning, and Delta Lake optimization to handle massi...