# spark-nomad

spark-nomad is a tool that allows you to process large amounts of data efficiently. It is open source and self-hosted, installable on Docker Hub.

Canonical page: https://ourlocalhost.com/app/5666/spark-nomad

## Description

Spark-nomad is a tool that allows you to process large amounts of data efficiently. It combines Spark’s powerful data-handling capabilities with Nomad’s organisation features. You can use it to manage complex computing tasks across multiple servers, ensuring your data projects run smoothly and reliably.

## Platform availability

Available on 0 of 10 platforms.

## Health score

6/100 (Low), based on 3 of 4 factors.
- Maintained: 0 (last commit 2584 days ago)
- Popular: 0 (0 GitHub stars)
- Easy to install: 25 (0 install platforms, install notes, Docker image)

## Links

- GitHub: https://github.com/lgfa29/nomad-spark
- Docker Hub: https://hub.docker.com/r/hashicorp/spark-nomad

## Common questions

### What spark-submit settings do I need to run a job on Nomad with spark-nomad?

Use --master nomad and --deploy-mode cluster, and set executor options such as spark.executor.instances. You also need to point spark.nomad.sparkDistribution to a Nomad-enabled Spark distribution.

### Do the Spark driver and executors run as Nomad tasks?

The Spark executors run as Nomad tasks in a Nomad job. The application driver can also run as a Nomad task when you choose that deployment setup.

### Can the Nomad cluster supporting spark-nomad run with high availability and multiple datacenters?

Yes. Nomad supports high availability and multi-datacenter federation out of the box.

### Can I use service discovery or secret management with the Nomad cluster for Spark workloads?

Nomad integrates with Consul and Vault.

## Alternatives

- Zdog: Zdog is a 3D JavaScript engine for and SVG.
- p5.js: p5.js a JS client-side library for creating graphic and interactive experiences, based on the core principles of Processing.
- spark: Apache Spark is a high-performance engine for large-scale computing tasks, such as data processing, machine learning and real-time data str…

---
Source: Our Local Host (https://ourlocalhost.com/app/5666/spark-nomad), the self-hosted and open-source app directory.
