EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
We are seeking a skilled Senior Data Software Engineer to join our remote team, working with a leading European online retailer of shoes, fashion, and beauty. In this role, you will be responsible for developing, monitoring, and operating the most critical curated data pipeline at our Client's website. This pipeline processes hundreds of millions of records to provide high-quality datasets for analytical and machine learning use-cases. You will leverage and improve a cloud-based tech stack that includes AWS, Databricks, Kubernetes, Spark, Airflow, Python.
Responsibilities
- Develop, monitor, and operate the most critical curated data pipeline at the customer's website, ensuring high-quality datasets for analytical and machine learning use-cases
- Consult with analysts, data scientists, and product managers to build and continuously improve the customer's platform
- Contribute to the development of data engineering best practices and standards, ensuring high-quality data processing and storage
- Collaborate with cross-functional teams to identify and solve complex data engineering challenges
Requirements
- A minimum of 3 years of experience in Data Software Engineering, demonstrating your expertise in data management and software engineering
- Expertise in Python, Apache Spark, Databricks, showcasing your proficiency in the latest data engineering technologies
- Experience with Amazon Web Services (AWS), Kubernetes, and other cloud-based technologies, highlighting your understanding of cloud-based data processing and storage
- Strong analytical and problem-solving skills, enabling you to identify and solve complex data engineering challenges
- Fluent spoken and written English at an Upper-Intermediate level or higher
Nice to have
- Experience with other programming languages and technologies, such as Scala, Java, or SQL
- Experience with data governance and security best practices
We offer
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn
#J-18808-Ljbffr
📌 Senior Data Software Engineer
🏢 Epam Systems
📍 México