Job description
build scalable etl pipelines with big data stack
we are seeking a highly skilled senior cloud data engineer to join our team. As a key member of our data engineering group, you will be responsible for designing and implementing scalable etl pipelines using big data technologies such as spark, pyspark, hadoop, hive, bigquery, and pub/sub.
the ideal candidate will have excellent programming skills in python, including production level coding techniques such as testing, oop structures, optimization, etc. You should also have strong experience with data modeling, query optimization, and data visualization.
required skills and qualifications
* 5-7 years of experience in data engineering with a focus on cloud-native technologies
* expertise in big data stack including spark, pyspark, hadoop, hive, bigquery, and pub/sub
* strong programming skills in python including production level coding techniques
* excellent data modeling, query optimization, and data visualization skills
* experience with cloud platforms such as google cloud platform or azure
benefits
we offer a competitive compensation package, opportunities for career growth and professional development, and a collaborative work environment that embodies values such as honesty, boldness, trust, freedom, team spirit, modesty, and fun.
others
you will work alongside technical, functional, and industry specialists to assist with the development, implementation, and integration of innovative system solutions. You will contribute to client satisfaction by providing timely and responsive value-added services and work products.