Data Bricks & Spark Migration Specialist

Join as a Data Bricks and Spark Migration Specialist in Montreal, responsible for transforming complex regulatory reporting systems. This contract role focuses on modern data engineering practices.
Your role involves designing and implementing production data pipelines, migrating legacy systems to Databricks and Snowflake on Azure. Strong skills in Scala, SQL, and performance tuning will be crucial to ensure compliance throughout the migration process.
Key Responsibilities:
• Design production pipelines for regulatory compliance
• Lead migration of ETL processes to Databricks and Snowflake
• Analyze and write complex SQL queries
• Ensure data quality through automated checks
• Execute testing strategies with TDD and BDD methods
Requirements:
• Experience with Scala/Spark and Databricks environments
• Familiarity with Snowflake schema design and performance evaluation
• Understanding of Azure networking and service interactions
• Experience with CI/CD...