Beam_python3.8_sdk
Apache Beam Python 3.8 worker container that provides the software development kit runtime for running batch and streaming data pipelines on container-based…
Platform availability
Available on 0 of 10 platforms
- Unraid (not listed)
- TrueNAS (not listed)
- Umbrel (not listed)
- ZimaOS (not listed)
- Proxmox (not listed)
- Helm (not listed)
- Mac (not listed)
- Windows (not listed)
- Linux (not listed)
- Any server (not listed)
Health score?A 0-100 score computed nightly from four factors: maintained (40%: recent commits and steady activity), popular (25%: GitHub stars, log scale), easy to install (20%: platforms, install notes, setup guides, Docker image) and light to run (15%: minimum RAM, ARM support). When the source code has been checked, a fifth factor, security check (20%: automated scan for committed secrets, unsafe desktop-app settings, known-vulnerable dependencies and project hygiene; any serious finding caps it at 20), is added. Factors without data are left out and the rest are rescaled.
76/100 Good
- Maintained
- 100last commit 16 days ago
- Popular
- 798,709 GitHub stars
- Easy to install
- 250 install platforms, install notes, Docker image
- Light to run
- No data
Based on 3 of 4 factors.
- GitHub stars
- 8,709
- Open issues
- 3868
- Last commit
- 2026-11-05
- Latest release
- v2.77.0
- License
- Apache-2.0
- Activity
- rising
Checked 16 days ago - source: GitHub (apache/beam)
Resources & Compatibility
ARM (e.g. Raspberry Pi) is supported.
Checked 54 days ago - source: Docker Hub image tags and published docs
First-install notes
- Set up Beam CLI with your API token Install the Beam CLI (a terminal program) by running `uv tool install beam-client` (`uv` is a Python package installer), then run `beam configure default --token YOUR_TOKEN` using your Beam API token (your account's secret key). This saves your login locally so Beam commands can start sandboxes; without it, they will not know which account to use. source
- Install the chat example's Python package Clone the Beam examples repo, then in the `vllm` folder run `pip install openai` (`pip` is Python's package installer) before running `python chat.py`. This installs the OpenAI library the chat script needs; without it, the program will stop before it can connect. source
- Expose the app port so you can reach it If your Beam Pod runs a web service, add that port to the `ports` list (for example, `ports=[8000]`). This tells Beam to open a path to the container (a small isolated running app), so you can get a URL; without it, the app may start but you cannot connect to it. source
- Getting started Follow the Apache Beam Python Quickstart to create a pipeline and run it on a Beam runner. source
Fetched 42 days ago - each note links to its source
Variants
Alternatives
No alternatives collected yet.
Common questions
How do I run a Beam Python SDK pipeline with the local Universal Launcher Reference runner?
Run the Python SDK pipeline with the local Universal Launcher Reference runner. Build the Python SDK container with the Gradle commands, then start the ULR job server.
Why can a Beam Python job submission fail because of a Python runtime version mismatch?
It can fail when the Python version used to submit the job does not match the Python version used to build the worker container. This mismatch is a common unrecoverable error.
What dill issue can occur with Beam pipelines on Dataflow when using Python 3.8?
With Python 3.8 and Beam 2.44.0, dill may not work well on Dataflow. The issue notes that upgrading dill to 0.3.3 is a possible fix, but it cannot be manually set.
Answers sourced from beam.apache.org, github.com, stackoverflow.com
Community
- Apache Beam Question : r/dataengineering - Reddit (reddit)
- bigdata - Python + Beam + Flink - Stack Overflow (forum)
- How do I use a custom version of the apache beam python SDK on DataFlow ... (forum)
Collected 48 days ago - public community threads