Data Engineer - Intermediate
Remote
Remote
Job Type: Contract
Work Arrangement: Primarily Remote | Must be available for onsite meetings in Edmonton (up to 3–4 times per month as required)
Working Hours: Monday to Friday, 08:15 AM – 04:30 PM (Alberta Time)
Project: Digital Regulatory Assurance System (DRAS)
Overview
We are seeking an Intermediate Data Engineer to support a large-scale digital modernization initiative focused on building secure, scalable, and analytics-ready data platforms. The successful candidate will design and develop modern Azure-based data solutions, build enterprise data pipelines, ensure data quality and governance, and enable trusted data products for analytics and reporting.
Key Responsibilities
- Design and develop scalable data architectures on Microsoft Azure.
- Build and maintain ETL/ELT pipelines using Azure Databricks, Azure Data Factory, Azure Synapse Analytics, and Delta Lake.
- Develop data workflows using Python (PySpark) and SQL.
- Integrate data from multiple enterprise systems using APIs and cloud services.
- Design analytics-ready datasets, semantic layers, and data products.
- Implement data governance, metadata management, security, and data quality controls.
- Develop secure data services and REST APIs.
- Monitor, troubleshoot, and optimize enterprise data pipelines.
- Utilize AI-assisted development tools for code generation, automation, testing, and documentation.
- Collaborate with architects, analysts, and cross-functional teams to deliver high-quality data solutions.
Must Have
- Post-secondary degree, diploma, or certificate in Computer Science or a related field.
- 5+ years of hands-on experience with Python (including PySpark) and SQL for enterprise ETL/ELT development.
- 4+ years of experience using GitHub/Git for version control and collaborative development.
- 3+ years of experience building scalable data pipelines using Azure Databricks, Delta Lake, Workflows, Jobs, and Notebooks.
- 3+ years of experience designing analytics-ready data platforms, semantic layers, data marts, and trusted datasets.
- 3+ years of experience with Azure services including Storage, SQL, Synapse, networking, and authentication (Service Principals, Managed Identities).
- 2+ years of experience with data governance, security, and metadata management in Databricks environments.
- 1+ year of experience using AI for code generation, automation, data analysis, and productivity improvement in data engineering workflows.
Nice to Have
- Experience with Microsoft Fabric and Azure Synapse Analytics integration.
- Experience with Microsoft SQL Server administration and optimization.
- Experience building scalable ETL pipelines using Talend.
- Experience designing and integrating secure RESTful APIs.
- Experience integrating ServiceNow with Azure-based data platforms.
- Experience with message queueing technologies such as ActiveMQ or Azure Service Bus.
- Experience performing business requirement analysis for data transformation and cleansing.
- Experience building data products in a Government of Alberta cloud environment.
- Experience working with cross-functional teams to build enterprise data products.
Additional Information
- Candidates must be authorized to work from within Canada.
- Candidates must provide their own computer (Windows preferred for Azure Virtual Desktop compatibility).
- Criminal record check will be required prior to project start.
- Mandatory security and privacy training must be completed upon onboarding.
- Resume should clearly include project dates in MMM/YYYY – MMM/YYYY format and demonstrate all required experience.
- Three professional references are required.