Spotlight

Scaling Dagster on Kubernetes: Best Practices for 50+ Code Locations

Maciej Lopalewski

This article discusses scaling Dagster to 50+ code locations on Kubernetes and covers architectural considerations for resource isolation, deployment strategies, and managing large-scale data pipeline orchestration.

More articles →

Tools and utilities

More projects →

Events starting soon

Discover more events onn Kube Events →

A Journey Through Kafkian SplitDNS in a Multitenant Kubernetes
A Journey Through Kafkian SplitDNS in a Multitenant Kubernetes

Fabián Sellés Rosa, Tech Lead of the Runtime team at Adevinta, walks through a real engineering investigation that started with a simple request: allowing tenants to use third-party Kafka services. What seemed straightforward turned into a complex DNS resolution problem that required testing seven different approaches before a working solution was found.

You will learn:

  • Why Kafka's multi-step DNS resolution creates unique challenges in multi-tenant environments, where bootstrap servers and dynamic broker lists complicate standard DNS approaches
  • The iterative debugging process from Route 53 split DNS through Kubernetes native pod DNS config, custom DNS servers, Kafka proxies, and CoreDNS solutions
  • How to implement the final solution using node-local DNS and CoreDNS templating with practical details including ndots configuration and Kyverno automation
  • Platform engineering evaluation criteria for assessing solutions based on maintainability, self-service capability, and evolvability in multi-tenant environments

Learn from production

More case studies →

Matching jobs

    • DevOps Engineer with PlayStation Global

    • Salary: CA$116.6K to CA$166.6K a year

    • Location: remote from

    • Tech stack: Kubernetes, AWS, Docker, Javascript, Typescript, Jenkins, GitHub Actions, Grafana, Prometheus, Loki

    • DevOps Engineer with The Options Clearing Corporation

    • Salary: $158.1K to $194.8K a year

    • Location: remote from

    • Tech stack: Kubernetes, AWS, Shell, Python, SQL, Javascript, Java, Typescript, Go, C#

    • Platform Engineer with LE018 Zelis Healthcare, LLC

    • Salary: $139K to $186K a year

    • Location: based in the office in Atlanta, GA, USA

    • Tech stack: Kubernetes, AWS, Python, Javascript, Typescript, CDK, AWS CloudWatch

    • Site Reliability Engineer with SpaceX

    • Salary: $120K to $170K a year

    • Location: remote from

    • Tech stack: Kubernetes, On-premise, Helm, Docker, Shell, Python, RabbitMQ, Kafka, Ansible

    • Software Engineer with Red Hat, LLC

    • Salary: $189.6K to $312.73K a year

    • Location: remote from

    • Tech stack: Kubernetes, Bare-metal, OpenShift, Helm, Python, Go, Rust, Terraform, GitHub Actions, Istio

Discover more Kubernetes jobs on Kube Careers →

Subscribe to Learn Kubernetes Weekly

Trusted by 77K engineers. Delivered 165 issues and counting.

or subscribe via

Build something

More tutorials →

Call for Papers closing soon

  1. 6

    days

    Devopsdays Atlanta

    The Call For Paper is open until 19 January 2026 at GMT+8. More info →
    • Location: Atlanta, GA, USA

    • In-person conference organized by Devopsdays.

    • The conference starts on the 21 April 2026.

    • Apply here
  2. 13

    days

    Observability Summit North America

    The Call For Paper is open until 26 January 2026 at GMT+8. More info →
    • Location: Minneapolis, MN, USA

    • In-person conference organized by Linux Foundation.

    • The conference starts on the 22 May 2026.

    • Apply here
  3. 19

    days

    Devopsdays Zurich

    The Call For Paper is open until 1 February 2026 at GMT+8. More info →
    • Location: Zurich, CH

    • In-person conference organized by Devopsdays.

    • The conference starts on the 6 May 2026.

    • Apply here
  4. 19

    days

    Devopsdays Prague

    The Call For Paper is open until 1 February 2026 at GMT+8. More info →
    • Location: Prague, CZ

    • In-person conference organized by Devopsdays.

    • The conference starts on the 29 April 2026.

    • Apply here
  5. 19

    days

    Devopsdays Copenhagen

    The Call For Paper is open until 1 February 2026 at GMT+8. More info →
    • Location: Copenhagen, DK

    • In-person conference organized by Devopsdays.

    • The conference starts on the 28 April 2026.

    • Apply here
  6. 20

    days

    KubeCon + CloudNativeCon India 2026

    The Call For Paper is open until 2 February 2026 at GMT+8. More info →
    • Location: Mumbai, IN

    • In-person conference organized by CNCF.

    • The conference starts on the 19 June 2026.

    • Apply here
  7. 20

    days

    Web Days Convention

    The Call For Paper is open until 2 February 2026 at GMT+8. More info →
    • Location: Aix-en-Provence, FR

    • In-person conference organized by Web Days.

    • The conference starts on the 6 February 2026.

    • Apply here

Thanks to our sponsors who make Kube Today possible

Find out more about being a sponsor →

More articles

Even more articles →