Opportunity Description
Advance your career as a Databricks Developer specializing in Azure at Kumaran Systems. Leverage your skills in Apache Spark to build scalable data solutions and optimize data pipelines.
In this role, you will take charge of developing and maintaining ETL/ELT pipelines using Databricks and SQL. The position requires extensive experience in Azure Databricks and strong capabilities in data integration and modeling. You'll also be involved in optimizing Spark workloads and developing data lakehouse solutions to meet enterprise needs.
Key Responsibilities:
• Design and maintain scalable ETL/ELT pipelines using Databricks
• Optimize batch and streaming pipelines with PySpark and Auto Loader
• Develop enterprise data lakehouse solutions utilizing Delta Lake
• Implement SCD Type 1, Type 2, and CDC processes effectively
• Ensure adherence to security policies and operational standards
Requirements:
• Hands-on experience...
In this role, you will take charge of developing and maintaining ETL/ELT pipelines using Databricks and SQL. The position requires extensive experience in Azure Databricks and strong capabilities in data integration and modeling. You'll also be involved in optimizing Spark workloads and developing data lakehouse solutions to meet enterprise needs.
Key Responsibilities:
• Design and maintain scalable ETL/ELT pipelines using Databricks
• Optimize batch and streaming pipelines with PySpark and Auto Loader
• Develop enterprise data lakehouse solutions utilizing Delta Lake
• Implement SCD Type 1, Type 2, and CDC processes effectively
• Ensure adherence to security policies and operational standards
Requirements:
• Hands-on experience...
Interested in this opportunity? Apply now through Expertini.
Apply for this Position