Research and develop new technologies and features to create solutions in azure cloud services.
such technologies include data factory, stream analytics, data lake store, data lake analytics and azure ml studio.
the main activities of are data engineer are:
- develop, construct, test and maintain data architectures.
- align architecture with business requirements.
- develop data acquisition processes.
- identify ways to improve data reliability, efficiency and quality.
- use large data sets to address business issues.
- prepare data for predictive and prescriptive modeling.
- use data to discover tasks that can be automated.
- deliver updates to stakeholders based on analytics
- sql server
- any of:
- azure data factory
- integration services
- azure data lake
- azure data bricks
- azure synapse
- python
- machine learning