Opportunity Description
Capgemini is hiring a Data Engineer skilled in Databricks, Python, and Apache Airflow to innovate data pipelines. This role focuses on ensuring data quality and operational excellence.
As a Senior Data Engineer, your role involves designing, implementing, and maintaining data pipelines using advanced technologies like PySpark. You will collaborate with various stakeholders to optimize data solutions for analytical needs, playing a key role in driving strategic data initiatives. Your expertise will support critical decision-making processes across organizations.
Key Responsibilities:
• Create scalable ETL/ELT pipelines and data architectures
• Optimize workflows with Apache Airflow
• Leverage Databricks for data processing
• Solve performance and reliability challenges
• Document processes to maintain transparency
Requirements:
• Strong programming skills in Python
• Expertise in PySpark for data processing
• Extensive use of Apache Airflow for schedulin...
As a Senior Data Engineer, your role involves designing, implementing, and maintaining data pipelines using advanced technologies like PySpark. You will collaborate with various stakeholders to optimize data solutions for analytical needs, playing a key role in driving strategic data initiatives. Your expertise will support critical decision-making processes across organizations.
Key Responsibilities:
• Create scalable ETL/ELT pipelines and data architectures
• Optimize workflows with Apache Airflow
• Leverage Databricks for data processing
• Solve performance and reliability challenges
• Document processes to maintain transparency
Requirements:
• Strong programming skills in Python
• Expertise in PySpark for data processing
• Extensive use of Apache Airflow for schedulin...
Interested in this opportunity? Apply now through Expertini.
Apply for this Position