Goal of position
data engineering covers the collection, modeling, storage, processing and evaluation of extremely large (e.g. social media), rapidly changing (e.g. sensor data) and complex (e.g. ecological systems) data sets. Etl: extract, transform, load (data). Data sets may origin and/or concern all information processes in business. The term complex refers to massive, interrelated and dynamic nature of data sets to be analyzed.
your qualifications
* graduate degree in computer science or information systems, applied statistics or mathematics, software engineering.
* 3 to 5 years of working experience.
your key responsibilities
* develop data pipelines and apply methods and tools to collect, store, process and analyze complex data sets, globally for assigned operations or functions.
* design, govern, build and operate solutions for large-scale data architectures and applications across businesses and functions.
* select, manage and work hands-on with big data tools and frameworks, and implement etl (extract, transform, load) tools and processes as well as data virtualization and federation services.
* engineer data integration pipelines and reusable data services using cross-functional data models, semantic technologies and data integration solutions.
* define, implement and apply data governance policies for all data flows of data architectures with focus on the digital platform and data lake.
* define and implement policies for data ingestion, retention, lineage, access, data service api management and usage, in collaboration with data management and it functions.
* contribution towards the continuous improvement of our data capabilities.
* conduct business meetings with stakeholders to determine project requirements and milestones.
* enable user self-service on data transformation and data visualization using power bi.
* collaborate with other it teams to develop end-to-end custom data science solutions under agile framework.
* design and implement large-scale data solutions using cloud technologies providing reliable data services for reporting, self-service bi or custom solutions taking data plausibility and performance into account.
#j-18808-ljbffr