Culture:
- Breaking down a high-level problem as a team upfront and delivering the core value first
- Delivering individual business benefits to production, rather than bundling tasks together
- Collaboration, communication, regular pairing and thoughtful course-correction
- Taking the time to write simple and easy to maintain code
- Willingness to make and participate in improvements for the greater good
- Working cross-discipline rather than adhering to tightly defined roles.
Knowledge & experience:
- Extensive AWS suite experience
- Comfortable with Site Reliability Engineering and support
- Build & running data pipelines
- Skilled at returning services to good states in outage situations
- Infrastructure as code, repeatedly building platforms across environments
- Understands the importance of testing and automation
- Working in a lean, agile environment
- Working in a “you build it you run it” team
- Experience coding in continuous integration context
Skills & technologies:
- AWS EMR, EKS, Lambda, EC2, IAM, RDS, ECR, S3, KMS, Secrets Manager, Cloudwatch
- Distributed SQL query engine ie Trino
- Terraform
- Scala & Spark
- Linux & Docker
- Knowledge of Iceberg/Hudi table formats
- Kafka
- Kubernetes
- Advanced SQL
Desirable:
- Jenkins
- Kibana
- Grafana
- Airflow