Opportunity Description
Airswift is seeking a Data Engineer to work a 12-month contract with one of our major clients in Calgary, AB.
Key Responsibilities
- Design, build, and optimize ETL/ELT workflows using KNIME Analytics Platform
- Integrate data from relational databases, APIs, and cloud storage
- Automate and productionize workflows using KNIME Business Hub
- Develop and scale data pipelines using Databricks (Apache Spark)
- Implement data quality checks, anonymization, and governance controls
- Document workflows, data pipelines, and operational processes
- Lead the design and delivery of scalable Databricks data pipelines using Spark, Delta Lake, and PySpark
- Drive Lakehouse architecture across ingestion, transformation, and curated data layers
- Define technical standards and best practices for batch and streaming data engineering
- Optimize performance and cost...
Interested in this opportunity? Apply now through Expertini.
Apply for this Position