Confluent Kafka Data Engineer

Key Responsibilities
 Design, develop, and maintain robust, scalable data pipelines using Azure Data Factory (ADF) and Databricks
 Implement batch and real-time data ingestion frameworks leveraging Confluent Kafka
 Build and optimize data models, transformations, and ETL/ELT pipelines using SQL and Spark
 Develop and manage data storage solutions in Azure Data Lake Storage (ADLS)
 Ensure high data quality, integrity, and governance standards
 Support data integration across systems including core banking and CRM
 Optimize performance of large-scale datasets
 Collaborate with stakeholders to translate requirements into solutions
 Ensure compliance with banking regulations and data privacy
 Troubleshoot production issues
Required Skills & Experience
 Strong expertise in SQL (complex queries, tuning, modeling)
 Hands-on experience with Databricks, Spark, PySpark
 Experience with Confluent Kafka and event-driven architect...