Overview:
*senior data engineer - python*
*overview*
appen is the global leader in data for the ai lifecycle. With over 25 years of experience in data sourcing, data annotation, and model evaluation by humans, we enable organizations to launch the world's most innovative artificial intelligence systems. Our expertise includes a global crowd of over 1 million skilled contractors who speak over 235 languages, in over 70,000 locations and 170 countries, and the industry's most advanced ai-assisted data annotation platform. Our products and services give leaders in technology, automotive, financial services, retail, healthcare, and governments the confidence to launch world-class ai products. Founded in 1996, appen has customers and offices globally.
*responsibilities*
- build scalable and reliable infrastructure that supports feature engineering, service deployment, and performance monitoring in the cloud and on prem.
- design solutions for machine learning infrastructure that will support machine learning api services to be able to handle very large volume of audio/image/video data processing at scale
- partner with data scientists to containerize machine learning models into scalable ml api services
- build data logging, tracking, analyzing, monitoring and reporting pipelines in cloud computing environments
- lead architecture and implementation of batch and real-time data pipelines with instrumentation
- conduct design and code reviews to deliver production quality code
*qualifications*
- bs or ms in computer science or related technical discipline (or equivalent).
- excellent understanding of computer science fundamentals, data structures, and algorithms.
- excellent problem solving skills
- 6+ years' work experience in software development area with at least 4+ years' experience in backend api service development
- 3+ years of experience in docker, api, git, ci/cd, and aws cloud tech stacks
- strong hands-on coding skills and can write and maintain high-quality production code
- proficient in python. Have deep knowledge of linux operating system and proficient in bash
- experience in aws ecs (or kubernetes), kafka, redis, elastic search, airflow, and aws cloud
- great communication skills, both written and oral; comfortable presenting findings and recommendations to non-technical audiences
*about appen*:
appen is the global leader in data for the ai lifecycle. With over 25 years of experience in data sourcing, data annotation, and model evaluation by humans, we enable organizations to launch the world's most innovative artificial intelligence systems. Our expertise includes a global crowd of over 1 million skilled contractors who speak over 235 languages, in over 70,000 locations and 170 countries, and the industry's most advanced ai-assisted data annotation platform. Our products and services give leaders in technology, automotive, financial services, retail, healthcare, and governments the confidence to launch world-class ai products. Founded in 1996, appen has customers and offices globally.
*#li-remote