We are looking for a skilled* remote lead big data engineer with databricks* experience to join our team.
Your primary responsibility will be to lead the development of our etl pipelines on databricks using spark/scala, databricks, and aws. You must have extremely strong experience with databricks, aws, python, and elastic.
*responsibilities*
- lead the development of etl pipelines on databricks using spark/scala, databricks, and aws
- work closely with cross-functional teams to define data requirements
- develop and maintain scalable data infrastructure
- ensure the reliability, efficiency, and scalability of data pipelines
- coach and mentor other members of the team
*requirements*:
- at least 5 years of experience in big data engineering
- 1+ years of relevant leadership experience
- expertise in databricks, aws, python, and elastic
- deep understanding of spark/scala and data architecture principles
- knowledge of data models, etl design, implementation, and maintenance
- strong communication skills and ability to collaborate with cross-functional teams
- b2+ english level
*nice to have*
- experience with apache airflow
- familiarity with agile methodologies and sdlc practices
*we offer*
- international projects with top brands
- work with global teams of highly skilled, diverse peers
- healthcare benefits
- employee financial programs
- paid time off and sick leave
- upskilling, reskilling and certification courses
- unlimited access to the linkedin learning library and 22,000+ courses
- global career opportunities
- volunteer and community involvement opportunities
- epam employee groups
- award-winning culture recognized by glassdoor, newsweek and linkedin
epam is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.