Overviewas part of the data engineer team, you will be responsible for design, development and operations of large-scale data systems operating at petabytes scale. You will be focusing on real-time data pipelines, streaming analytics, distributed big data and machine learning infrastructure. You will interact with the engineers, product managers, qa, bi developers and architects to provide scalable robust technical solutions.responsibilitiesdesign, develop, implement and tune large-scale distributed systems and pipelines that process large volume of data; focusing on scalability, low-latency, and fault-tolerance in every system built.provide and support the implementation and operations of the data pipelines and analytical solutionsexperience in rest api data service – data consumptionexperience in managing work teamsadvanced project managementmandatory skills8 to 10 years in technology project implementationenglish conversational (advanced)demonstrates up-to-date expertise in data engineering, complex data pipeline developmentexperience in agile modelsexperience with python, java to write data pipelines and data processing layersexperience in advanced pipelines with airflowexperience with continuous integration, devops, githubperformance tuning experience of systems working with large data setsproven working expertise with big data technologies hadoop, hive, kafka, presto, sparkhighly proficient in sqlexperience with cloud technologiesgcp – dataproc, bigquery, cloud functionsexperience with relational models, memory data stores desirable (sql server, oracle, cassandra, druid)knowledge in implementing advanced analytics models using ml/ai (desirable)knowledge of bi tools (power bi, tableau, looker, etc.) Desirableretail experience is a huge plusbenefitslegal benefits and superior legal benefitstraining and learning pathsseniority levelassociateemployment typefull-timejob functioninformation technologyindustriesit system data services and data infrastructure and analytics
#j-18808-ljbffr