Senior Data Engineering Specialist - Databricks

Embark on a challenging contract as a Senior Data Engineering Specialist focused on Databricks, Scala, and Spark in Montreal. Play a pivotal role in migrating advanced regulatory reporting pipelines.
This hands-on role requires expertise in designing, implementing, and reconciling production pipelines on the Databricks and Snowflake platforms. Your knowledge of Scala, Spark applications, and SQL fluency will be essential for ensuring strict parity compliance during the migration of complex regulatory reports.
Key Responsibilities:
• Design and implement production pipelines for regulatory reporting
• Migrate legacy ETL pipelines to Databricks and Snowflake
• Write complex SQL queries and analyze requirements
• Perform testing using TDD and write unit tests
• Conduct data quality checks and reconciliation processes
Requirements:
• Proven experience with Scala/Spark and Databricks
• Familiarity with Snowflake schema design and performance tuning
• Knowled...