Скачать или смотреть Topeaks #5 CI Runners, Secrets, SSM, GitLab, GitHub

In this episode of DevOps Topeaks, we discussed how we think CI runners should be handled, where they should run, how, and ways to secure, scale, and manage them efficiently.

As usual, we drifted into other topics like cleaning container images, saving disk space, efficient use of a cache, secure connection to instances with SSM rather than a VPN, and lots more!

Terraform GitLab runners open source project: https://github.com/npalm/terraform-aw...

00:00 - Today's topic (topeak 😉)

00:39 - Types of CI/CD runners (Part 1 of 2) - Intro
GitLab Runners - https://docs.gitlab.com/runner/
GitHub Actions - GitHub-hosted (shared) runners - https://docs.github.com/en/actions/us...
GitHub Actions - Self-Hosted runners - https://docs.github.com/en/actions/ho...

00:53 - When to use a shared runner and when to avoid it?

02:35 - Types of CI/CD runners (Part 2 of 2) - Having a conversation about on-premise runners
AWS GA of macOS EC2 machines in November 2020 - https://aws.amazon.com/about-aws/what...
AWS GA of macOS M1 EC2 machines in December 2021 - https://aws.amazon.com/blogs/aws/use-...

06:38 - Building for different architectures and operating systems
GoLang 😎 GOOS, GOARCH - https://go.dev/doc/install/source
Docker buildx - https://docs.docker.com/build/buildin...
Docker containers and BuildKit - https://github.com/microsoft/Windows-...

09:18 - Managing the infrastructure of self-hosted runners in the cloud for GitLab CI
Terraform module for GitLab auto-scaling runners on AWS spot instances - https://github.com/npalm/terraform-aw...

13:00 - Managing the infrastructure of self-hosted runners in the cloud for GitHub Actions
GitHub Actions Runner Controller - https://github.com/actions-runner-con...
Karpenter - https://karpenter.sh/
AWS EKS - https://aws.amazon.com/eks/
Terraform VPC module - https://registry.terraform.io/modules...
Terraform EKS module - https://registry.terraform.io/modules...

18:22 - Omer's recap so far and a great tip!

20:04 - How to rotate CI/CD runners Docker images? Prune! (Part 1 of 2)
docker system prune - https://docs.docker.com/engine/refere...
Setting up SSM for AWS EC2 machines - https://docs.aws.amazon.com/systems-m...

26:17 - Double-clicking on Docker images cleanup
docker image prune - filter by labels - https://docs.docker.com/engine/refere...
docker images grep - https://gist.github.com/garystafford/...

28:47 - How do you cache packages and dependencies of an application during build time?
GitLab CI Caching - https://docs.gitlab.com/ee/ci/caching/
GitHub Actions cache - https://github.com/actions/cache

31:13 - Another option for caching packages and dependencies - Docker layers!
Docker cache-from - https://docs.docker.com/build/buildin...
Reducing Docker image build time using an external cache - https://aws.amazon.com/blogs/devops/r...
AWS S3 VPC Endpoint for ECR - https://docs.aws.amazon.com/AmazonECR...

37:52 - Summary and final conclusions (sort of)

==========================================

Topeak's is also a podcast!
Find all the episodes at https://topeaks.buzzsprout.com
Also, on Spotify! https://open.spotify.com/show/4XuDu63...
Or add our feed to your favorite podcasts app using this link: https://feeds.buzzsprout.com/2088995.rss

==========================================

Meir's blog: https://meirg.co.il
Omer's blog: https://omerxx.com
Telegram channel: https://t.me/espressops

==========================================

#devops #ops #engineering #session #theoretical #technical #podcast #talks #aws #cloud #kubernetes #k8s #containers #podcast #conversation