Job description
location: any state of mexico
requirements
* 3+yoe in data engineering and working with gcp, gcp big query
* knowledge on data warehouse
* experienc working with data forms
* excellent data engineering skills including expert sql, data modeling, and query optimization
* strong experience with big data stack (spark, pyspark, hadoop, hive, bigquery, pub/sub) in building scalable etl pipelines
* excellent programming skills (python) including production level coding techniques (testing, oop structures, optimization, etc)
* data visualization and dashboarding experience
* great at debugging, troubleshooting, designing, and implementing solutions to complex technical issues
* aptitude to independently learn new technologies, prototype, and propose solutions
* advanced english level
responsibilities
* design a cloud-based data warehouse using bigquery to support analytical workloads. Define fact and dimension tables, apply appropriate partitioning and clustering strategies, and document the data model.
* build a scalable etl pipeline using pyspark on gcp that ingests raw data, applies transformations, and writes curated data to bigquery. Implement error handling, logging, unit tests, and modular oop-based code.
* design and implement a real-time data ingestion solution using pub/sub and dataflow to process streaming events and store aggregated results in bigquery.
* use dataform to build, version, and manage sql-based transformations in bigquery. Define dependencies, apply data quality assertions, and automate pipeline execution.
* create a dashboard using bigquery as the data source (e.g., looker or looker studio). Optimize queries for performance and explain metrics, kpis, and design decisions to stakeholders.
benefits
* excellent compensation and benefits
* career path, trainings and real growth opportunities
* engaging and challenging projects.
* excellent work environment and culture.
* open and effective management.
* highly professional and collaborative teams.
eeo statement
at capgemini mexico, we aim to attract the best talent and are committed to creating a diverse and inclusive work environment, so there is no discrimination based on race, sex, sexual orientation, gender identity or expression, or any other characteristic of a person. All applications welcome and will be considered based on merit against the job and/or experience for the position.
#j-18808-ljbffr