Spark Kubernetes Operator

A Kubernetes operator from the Apache Software Foundation that extends cluster resource management to deploy and manage Apache Spark applications via the…

  • Automation
  • Infrastructure
  • Tools & Utilities
A Kubernetes operator from the Apache Software Foundation that extends cluster resource management to deploy and manage Apache Spark applications via the Operator pattern, giving data engineers and cluster operators a native Kubernetes workflow for Spark workloads.

Platform availability

Available on 1 of 10 platforms

  • Unraid (not listed)
  • TrueNAS (not listed)
  • Umbrel (not listed)
  • ZimaOS (not listed)
  • Proxmox (not listed)
  • Helm
  • Mac (not listed)
  • Windows (not listed)
  • Linux (not listed)
  • Any server (not listed)

Health score?A 0-100 score computed nightly from four factors: maintained (40%: recent commits and steady activity), popular (25%: GitHub stars, log scale), easy to install (20%: platforms, install notes, setup guides, Docker image) and light to run (15%: minimum RAM, ARM support). When the source code has been checked, a fifth factor, security check (20%: automated scan for committed secrets, unsafe desktop-app settings, known-vulnerable dependencies and project hygiene; any serious finding caps it at 20), is added. Factors without data are left out and the rest are rescaled.

68/100 Good

Maintained
100last commit 14 days ago
Popular
50327 GitHub stars
Easy to install
251 install platform, install notes
Light to run
304 GB minimum RAM
Security check
95no serious findings, CI, tests

Availability: platform listings confirmed today

GitHub stars
327
Open issues
6
Last commit
2026-11-07
Latest release
1.0.0
License
Apache-2.0
Activity
declining

Checked 14 days ago - source: GitHub (apache/spark-kubernetes-operator)

Resources & Compatibility

Minimum requirements: 4 GB RAM, 3 CPU core(s).

Checked 3 days ago - source: Docker Hub image tags and published docs

First-install notes

  • Install Install the operator with its official Helm chart; the helm commands are in the repository README under 'Install Helm Chart'. The project requires Apache Spark 4.0+. source

Fetched 3 days ago - each note links to its source

Alternatives (3)

  • Zdog - Zdog is a 3D JavaScript engine for and SVG.
  • p5.js - p5.js a JS client-side library for creating graphic and interactive experiences, based on the core principles of Processing.
  • spark - Apache Spark is a high-performance engine for large-scale computing tasks, such as data processing, machine learning and real-time data str…

Checked 40 days ago - source: AlternativeTo

Common questions

Is the operator suitable for interactive Spark clusters or notebooks?

Community reports say it is mainly good for batch jobs. Working with the cluster interactively seems to be a problem.

Why might exec pods not use all available node capacity?

The operator may not utilize node resources completely, spinning only one pod on a node when two could fit. After execs scale down and up again, pods can end up on separate nodes.

What can cause a Spark job to stop recovering after Kubernetes kills a pod?

Kubernetes can kill processing pods that exceed their memory limits. One report says that, once Kubernetes killed the pod, Spark could not recover.

Answers sourced from www.reddit.com, www.reddit.com, www.redditmedia.com

Community

Collected 48 days ago - public community threads