# Spark

Spark is a self-hosted ai app. Apache Spark is a high-performance engine for large-scale computing tasks, such as data processing, machine learning and real-time data streaming. It is open source and self-hosted, installable on Kubernetes (Helm).

Canonical page: https://ourlocalhost.com/app/4691/spark

## Description

Apache Spark is a high-performance engine for large-scale computing tasks, such as data processing, machine learning and real-time data streaming. It includes APIs for Java, Python, Scala and R.

## Platform availability

Available on 1 of 10 platforms: Helm.

## Health score

78/100 (Good), based on 3 of 4 factors.
- Maintained: 100 (last commit 14 days ago)
- Popular: 93 (44,429 GitHub stars)
- Easy to install: 15 (0 install platforms, install notes)

## Links

- GitHub: https://github.com/apache/spark
- Official website: https://spark.apache.org/
- Kubernetes (Helm): https://artifacthub.io/packages/helm/bitnami/spark

## Common questions

### How can self-hosters build a basic data lakehouse around Spark?

A basic self-hosted data lakehouse can be set up using Kubernetes, MinIO, and Spark.

### What file is required when launching a Spark standalone cluster with the launch scripts?

Create conf/workers in the Spark directory and list the hostnames of all machines where Spark workers should start, one per line.

### Can self-hosted Spark process data from Hadoop-based stores?

Spark can process data in HDFS, HBase, Cassandra, Hive, and any Hadoop InputFormat. It can run in Hadoop clusters through YARN or Spark's standalone mode.

### Are there reliable Docker guides for setting up a standalone Spark server?

Self-hosters looking for a standalone Apache Spark instance on Docker report that comprehensive guides are hard to find, with steps missing.

## Alternatives

- Zdog: Zdog is a 3D JavaScript engine for and SVG.
- p5.js: p5.js a JS client-side library for creating graphic and interactive experiences, based on the core principles of Processing.

---
Source: Our Local Host (https://ourlocalhost.com/app/4691/spark), the self-hosted and open-source app directory.
