Job description
the successful candidate will be responsible for designing and implementing a cutting-edge data platform architecture that enables seamless data collection, transformation, and visualization. This role requires ensuring the technological evolution of the architecture and data infrastructure over the data lakehouse to support business objectives.
key responsibilities:
* design, deploy, evolve, and ensure the integrity of the organization's official data platform layer with a roadmap for its capabilities.
* develop and document the roadmap for the data architecture evolution, coordinating with technical areas to gather improvement requirements.
* establish standards and guidelines for data architecture in projects.
* define the framework, guidelines, standards, and principles of data architecture platform, including modeling, metadata, security, backup, and reference data.
* continuously update data guidelines and standards, publishing and promoting them to relevant teams for a unified and high-quality data design approach across the organization.
* identify improvement opportunities in data ingestion, evaluating and proposing new technologies based on market best practices like real-time and near-real-time data.
* identify roles and responsibilities within the data architecture and define the interaction model between roles to ensure a proper data lifecycle.
* collaborate with the chapters of data engineering chapter lead, dataops lead, data modeling lead, data governance, and it to implement and maintain data pipelines supporting dataops practices.
* design comprehensive solutions such as the implementation of data marketplace, data sharing, and similar initiatives.
required skills and qualifications
* significant experience in similar positions.
additional experience required
* experience with ci/cd: github actions.
* experience with python for data ingestion.
* experience with apis for data ingestion and availability.
* experience with sql and nosql databases.
* experience in data modeling (data warehouse/data lake).
* experience using visualization tools (looker - quicksight - power bi).
nice to have
* experience in machine learning and artificial intelligence projects.