Education and experience
* bachelor's degree in computer science of related degree
* previous experience working with aws data lake technologies.
* knowledge of programming languages such as python, java, or scala.
* familiarity with etl tools and data processing platforms like apache spark or hadoop.
* solid understanding of sql and nosql databases.
* fundamental aws knowledge:
* basic aws services: familiarity with key aws services such as ec2 (elastic compute cloud), s3 (simple storage service), rds (relational database service), vpc (virtual private cloud), iam (identity and access management), and lambda., cloudformation, dms, glue, emr; kinesis, iceberg aws
* aws architecture: understanding the principles of aws architecture and design patterns to build scalable and secure solutions.
* infrastructure as code (iac)
* iac tools: practical knowledge of tools like aws cloudformation, terraform, and aws cli. This includes the ability to write and maintain iac templates to define and manage infrastructure.
* configuration management and automation
* aws systems manager: familiarity with aws systems manager for automating tasks, managing configurations, and administering instances.
* automation scripts: ability to write scripts in bash, python, or powershell to automate administrative and configuration tasks.
* knowledge of configuration management systems, such as ansible or related systems.
* networking and security
* networking fundamentals: understanding basic networking concepts such as subnets, ip addresses, routing, and gateways, as well as configuring vpcs and subnets in aws.
* aws security: knowledge of identity and access management (iam) and best security practices to protect infrastructure and data. This includes using policies, roles, and groups.
* monitoring and maintenance
* aws cloudwatch: ability to configure and use amazon cloudwatch to monitor resources, create alarms, and generate logs.
* aws cloudtrail: understanding how to use aws cloudtrail to audit activity in the account and ensure compliance with policies.
* experience in monitoring frameworks such as splunk, grafana, dynatrace, or similar.
* database management
* rds and dynamodb: knowledge of aws databases, including amazon rds for relational databases and amazon dynamodb for nosql databases.
* backups and recovery: understanding backup and recovery strategies for cloud databases.
* implementation and operation
* software development life cycle (sdlc): familiarity with sdlc principles, including continuous integration (ci) and continuous deployment (cd) to implement changes efficiently.
* change management and versioning: understanding change management practices and using version control systems like git to manage iac code.
* experience in three-tier architectures: web (apache), apache spark, engine (tomcat/spring) and databases (mysql, postgresql, oracle and nosql databases).
* troubleshooting and support
* diagnosis and troubleshooting: skills to diagnose problems and perform troubleshooting on deployed infrastructure.
* documentation: ability to document configurations, processes, and changes made to the infrastructure.
* best practices and architecture patterns
* resilience patterns: understanding architectural patterns like high availability, disaster recovery, and scalability.
* cost optimization: knowledge of practices to optimize costs when deploying and operating resources in aws
* strong experience in systems automation and linux administration