OBJECTIVE

Design, develop, maintain, test, and deliver ETL / ELT using MS Azure Data Factory via an Agile approach the requested business value.
Coach, train and educate internal staff on MS Azure, MS Azure Data Factory, and other used technology

Overall Responsibilities

As a MS Azure Developer / Engineer, you are responsible for the data integration of the various data sources. For this purpose, you will develop, using the MS Azure Data Factory tools, the necessary data flows, ETL / ELT’s, triggers, control flows, and so on to deliver the requested business value. Furthermore, you will suggest improvements in the do- mains of the Azure Data Lake, Azure Databricks, and so on.

You coach, train and educate the internal staff on the used MS Azure technology, components, and software. Addition- ally, you suggest beneficial training the internal staff can follow.

Executes following tasks

  • Assist with and execute programming, modeling, and data integration, supporting task automation and DevOps practices
  • Based on the requested data & functionality, design the necessary data flows
  • Develop and maintain the required ETL’s and ELT’s using Azure Data Factory
  • Unit test the flows, and ensure the required performance through large scale testing
  • Document the implementation like catalog data sources
  • Perform/support the deployments to other environments using the Azure tooling
  • Provides on the job mentoring to the internal staff and allow them to grow; recommend beneficial training and certification
  • Ensure best practices are used

CRITERIA

  • A development background and experience in Data Warehousing concepts and design (+ 5 years)
  • Practical experience as a developer/engineer in a MS Azure environment using Data Factory and DevOps. Certification is considered a plus

 

  • Experience with
  • Data Warehouse/Business Intelligence concepts and design (+5 years)
  • Development tools like SQL, Python/C# is a must and modelling technique like Data Vault is considered a plus
  • Azure Data Lake Analytics, Dataset and integrating Pipelines (end to end) in Azure Data Factory is considered a plus
  • Troubleshooting of issues and problems in MS Azure environment including Data Factory and DevOps
  • MS products like SSIS, SSAS, SSRS, and other data warehousing tools
  • Knowledge of reporting tools in a Microsoft environment is considered a plus
  • Strong knowledge of performance tuning to define Azure code artefacts for optimal performance
  • Worked and experience in an Agile environment is key

 

Sufficient knowledge of French, Dutch and English language is a must