Spark Kubernetes Operator
A Kubernetes operator from the Apache Software Foundation that extends cluster resource management to deploy and manage Apache Spark applications via the…
Platform availability
Available on 1 of 10 platforms
- Unraid (not listed)
- TrueNAS (not listed)
- Umbrel (not listed)
- ZimaOS (not listed)
- Proxmox (not listed)
- Helm
- Mac (not listed)
- Windows (not listed)
- Linux (not listed)
- Any server (not listed)
Health score?A 0-100 score computed nightly from four factors: maintained (40%: recent commits and steady activity), popular (25%: GitHub stars, log scale), easy to install (20%: platforms, install notes, setup guides, Docker image) and light to run (15%: minimum RAM, ARM support). When the source code has been checked, a fifth factor, security check (20%: automated scan for committed secrets, unsafe desktop-app settings, known-vulnerable dependencies and project hygiene; any serious finding caps it at 20), is added. Factors without data are left out and the rest are rescaled.
68/100 Good
- Maintained
- 100last commit 14 days ago
- Popular
- 50327 GitHub stars
- Easy to install
- 251 install platform, install notes
- Light to run
- 304 GB minimum RAM
- Security check
- 95no serious findings, CI, tests
Availability: platform listings confirmed today
- GitHub stars
- 327
- Open issues
- 6
- Last commit
- 2026-11-07
- Latest release
- 1.0.0
- License
- Apache-2.0
- Activity
- declining
Checked 14 days ago - source: GitHub (apache/spark-kubernetes-operator)
Resources & Compatibility
Minimum requirements: 4 GB RAM, 3 CPU core(s).
Checked 3 days ago - source: Docker Hub image tags and published docs
First-install notes
- Install Install the operator with its official Helm chart; the helm commands are in the repository README under 'Install Helm Chart'. The project requires Apache Spark 4.0+. source
Fetched 3 days ago - each note links to its source
Variants
Alternatives (3)
- Zdog - Zdog is a 3D JavaScript engine for and SVG.
- p5.js - p5.js a JS client-side library for creating graphic and interactive experiences, based on the core principles of Processing.
- spark - Apache Spark is a high-performance engine for large-scale computing tasks, such as data processing, machine learning and real-time data str…
Checked 40 days ago - source: AlternativeTo
Common questions
Is the operator suitable for interactive Spark clusters or notebooks?
Community reports say it is mainly good for batch jobs. Working with the cluster interactively seems to be a problem.
Why might exec pods not use all available node capacity?
The operator may not utilize node resources completely, spinning only one pod on a node when two could fit. After execs scale down and up again, pods can end up on separate nodes.
What can cause a Spark job to stop recovering after Kubernetes kills a pod?
Kubernetes can kill processing pods that exceed their memory limits. One report says that, once Kubernetes killed the pod, Spark could not recover.
Answers sourced from www.reddit.com, www.reddit.com, www.redditmedia.com
Community
- Running apache spark on K8s? : r/kubernetes - Reddit (reddit)
- Passing argument on SparkKubernetesOperator - Stack Overflow (forum)
- Running Spark on kubernetes. How to understand the Spark-operator? (reddit)
Collected 48 days ago - public community threads