Empleo
Mis anuncios
Mis alertas
Conectarse
Encontrar un trabajo Tips empleo Fichas empresas
Buscar

Senior data pipeline engineer

Guadalajara, Jal
Pentangle Tech Services | P5 Group
Publicada el 28 noviembre
Descripción

Job title: senior data pipeline engineer (python/airflow)location: guadalajara, mexicoduration: long termresponsibilitiesdesign, build, and maintain airflow dags using taskflow, dynamic dags,deferrable operators, providers, and the secrets backend; manage cross‑dag dependencies and slas.develop python etl/elt code to ingest from apis, object storage, message buses, and databases; package code as reusable libraries.operate airflow on managed or self‑hosted platforms (e.g., azure, kubernetes deployments); implement blue/green or canary dag releases.implement data quality and testing with unit tests for operators/hooks, and dag validation in ci.build event‑driven pipelines for near‑real‑time processing; manage schemas and compatibility.model and manage data stores across sql and blob storage; design partitioning, clustering, and retention.observability & lineage: instrument metrics/logs, set slas/alerts, drive post‑incident reviews and reliability improvements.security & governance: apply least‑privilege iam, secrets management, piihandling, and data contracts; enforce rbac in airflow and warehouses.ci/cd & iac: build pipelines to lint/test/deploy dags and python packages;provision infra with terraform/helm; containerize with docker.cost & performance: tune task parallelism, autoscaling, storage formats, and compute footprints to optimize cost/perf.collaboration: work closely with android/backend teams to define interfaces and data contracts; document decisions and operational runbooks.skills and qualifications8+ years in data engineering or backend engineering with strong python expertise.2+ years airflow 2.x expertise (operators, hooks, sensors, taskflow, schedulertuning).proven experience designing reliable etl/elt at scale (batch and streaming) withrobust testing and monitoring.strong sql and data modeling skills; hands‑on with one or more data warehouses(bigquery, redshift, snowflake) and relational systems (postgresql/mysql).familiarity with security best practices (rbac, oauth2/oidc for serviceintegrations), api gateways, and secrets management (vault/aws secrets manager/gcp secret manager).comfortable operating in production: monitoring, troubleshooting, and performance tuning.excellent written and verbal communication; clear trade‑off communication andautonomous execution with well‑documented decisions. approach to problem solving.

Aplicar
Crear una alerta
Alerta activada
Guardada
Guardar
Ofertas similares
Empleo Guadalajara, Jal
Empleo Jalisco
Inicio > Empleo > Senior data pipeline engineer

Jobijoba

  • Tips empleo
  • Opiniones Empresas

Ofertas de empleo

  • Ofertas de empleo por ocupaciones
  • Búsqueda de empleo por categorías
  • Empleos por empresas
  • Empleos para localidad

Contacto / Asociados

  • Contacto
  • Publique sus ofertas en Jobijoba

Menciones legales - Términos y condiciones de uso - Política de Privacidad - Gestionar mis cookies - Accesibilidad: No conforme

© 2025 Jobijoba - Todos los derechos reservados

Aplicar
Crear una alerta
Alerta activada
Guardada
Guardar