*responsibilities*
- data pipeline creation:create data pipelines to onboard a variety of new datasets using your technical skillset
improve existing processes to reduce data pipeline error counts and increase automation of data onboarding processes
- data curation:create data quality scripts to identify and remediate poor quality data
wrangle / manipulate data to make datasets fit for usage by client’s front office teams
curate disparate datasets into well-defined and cross-mapped datasets
*requirements*:
- sound sql skillset for data interrogation and manipulation
- expert python skillset for data analysis and automation - experience pandas, numpy, etc
- code management tools and experience of working from a checked-in code base
- industry knowledge / experience
- experience in the financial market (nice to have)
- knowledge of apache spark
- experience working with microsoft azure
- data engineering / data wrangling / data cleaning / data architecture experience
- experience with industry vendors e.g., bloomberg, refinitiv, ihs markit
- experience in agile projects, working knowledge of jira and confluence
- the right attitude to navigate uncertainty and / or complexity whilst retaining a positive outlook
- clear and concise communication skills, and the ability to transfer knowledge efficiently
- attention to detail and strive for continual improvement
- ability to form sound, honest, and mutually respectful relationships with the key client, visiting their london office as required
- data lake / delta lake / data mesh methodologies. Inmon vs kimball, staging areas, scd and other dimension types, advanced and hybrid-data modeling approaches: data vault, nosql structures
- advanced knowledge of data integration tools (azure data factory, aws glue, gcp dataflow, talend, informatica, pentaho, apache nifi, knime, ssis, etc.)
- advanced knowledge of relational databases sql
*we offer*
- career plan and real growth opportunities
- unlimited access to linkedin learning solutions
- international mobility plan within 25 countries
- constant training, mentoring, online corporate courses, elearning and more
- english classes with a certified teacher
- support for employee’s initiatives (algorithms club, toastmasters, agile club and more)
- enjoyable working environment (gaming room, napping area, amenities, events, sport teams and more)
- flexible work schedule and dress code
- collaborate in a multicultural environment and share best practices from around the globe
- hired directly by epam & 100% under payroll
- law benefits (imss, infonavit, 25% vacation bonus)
- major medical expenses insurance: life, major medical expenses with dental & visual coverage (for the employee and direct family members)
- 13 % employee savings fund, capped to the law limit
- grocery coupons
- 30 days december bonus
- employee stock purchase plan
- 12 vacations days plus 3 floating days
- official mexican holidays, plus 5 extra holidays (maundry thursday and friday, november 2nd, december 24th & 31st)
- relocation bonus: transportation, 2 weeks of accommodation for you and your family and more
- monthly non-taxable amount for the electricity and internet bills
*salary*: $1,000.00 per day
work location: one location