The Senior Azure Data Engineer is responsible for managing and organizing data and creating and maintaining architecture and databases using a Data First approach. This position will process raw data into meaningful information for various data analytics methods. Experience with Microsoft Azure tools is a key requirement as well as expert knowledge in data management and analytical skills. Exposure to CRMs such as MS Dynamics 365 and Salesforce and their corresponding data models are highly desirable.
Key Responsibilities:
- Work alongside senior team members to define and implement migration strategies
- Creation of Data Lakes, migrating SQL Databases to Data Lake and ELT/ETL transformations
- Design, construct, install, test and maintain data management systems
- Ensure all systems meet business and performance requirements
- Create and maintain optimal data pipeline architecture
- Assemble large, complex datasets that meet functional and non-functional business requirements
- Develop and implement data flows to connect operational systems, data for analytics and BI (Business Intelligence) systems
- Design, implement and optimize data models on Azure data platforms
- Implement effective metrics and monitoring processes
- Drive the collection, cleaning, processing, and analysis of new and existing data sources
- Work with data and analytics experts to strive for greater functionality in data systems
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, redesigning infrastructure for greater scalability.
- Ensure seamless integration with Power BI reports, exposure to Tableau.
- Other duties as assigned.
Basic Qualifications:
- 7+ years of experience in data engineering with a focus on cloud data platforms
- Experience with data migrations and CRMs such as Salesforce and MS Dynamics 365 and their corresponding data models
- Extensive experience with T-SQL, including query optimization, stored procedures, and performance tuning for efficient data processing
- Hands on experience with Azure Data Lake, Azure Data Factory, Azure SQL Database
- Hands on experience building and optimizing data ingestion, transformation, and processing workflows
- Strong understanding of data governance, security, and access controls in an Azure environment
- Hands on experience with Power BI and ability to modify DAX Measures and data models to align with data lake integration.
- Experience with Tableau is an asset
- Strong analytical and problem-solving skills to troubleshoot data ingestion and transformation issues
- Experience in the creation and maintenance of Disaster Recovery plans
- Experience with Index Maintenance
- Experience with Microsoft Fabric an asset
- The ability to work independently without supervision and with a team effectively