A
Azure Data Engineer (ETL/ELT, Spark SQL)
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Opportunity Description
Take the next step as an Azure Data Engineer focused on ETL/ELT processes, Spark SQL, and Databricks. Create and optimize data pipelines that drive impactful business insights.
As part of your responsibilities, you will design and manage Azure-based data pipelines, employing ADF and Databricks to improve data flow and integration. You will tackle challenges in pipeline execution and cluster performance, collaborating with DevOps units using Azure DevOps and CI/CD practices to ensure maximum efficiency. Monitoring tools will also play a critical role in your day-to-day activities.
Key Responsibilities:
• Create efficient data pipelines utilizing ADF and Databricks
• Implement and manage ETL/ELT workflows effectively
• Troubleshoot and resolve issues in data processing
• Collaborate with DevOps for CI/CD implementation
• Monitor system performance and optimize data delivery
Requirements:
• Expertise in Azure Data ...
As part of your responsibilities, you will design and manage Azure-based data pipelines, employing ADF and Databricks to improve data flow and integration. You will tackle challenges in pipeline execution and cluster performance, collaborating with DevOps units using Azure DevOps and CI/CD practices to ensure maximum efficiency. Monitoring tools will also play a critical role in your day-to-day activities.
Key Responsibilities:
• Create efficient data pipelines utilizing ADF and Databricks
• Implement and manage ETL/ELT workflows effectively
• Troubleshoot and resolve issues in data processing
• Collaborate with DevOps for CI/CD implementation
• Monitor system performance and optimize data delivery
Requirements:
• Expertise in Azure Data ...
Interested in this opportunity? Apply now through Expertini.
Apply for this Position