GenAI
This app provides a private, all-in-one toolkit for running your own Artificial Intelligence.
Platform availability
Available on 0 of 10 platforms
- Unraid (not listed)
- TrueNAS (not listed)
- Umbrel (not listed)
- ZimaOS (not listed)
- Proxmox (not listed)
- Helm (not listed)
- Mac (not listed)
- Windows (not listed)
- Linux (not listed)
- Any server (not listed)
Health score?A 0-100 score computed nightly from four factors: maintained (40%: recent commits and steady activity), popular (25%: GitHub stars, log scale), easy to install (20%: platforms, install notes, setup guides, Docker image) and light to run (15%: minimum RAM, ARM support). When the source code has been checked, a fifth factor, security check (20%: automated scan for committed secrets, unsafe desktop-app settings, known-vulnerable dependencies and project hygiene; any serious finding caps it at 20), is added. Factors without data are left out and the rest are rescaled.
58/100 Fair
- Maintained
- 100last commit 1 day ago
- Popular
- 724,081 GitHub stars
- Easy to install
- 250 install platforms, install notes, Docker image
- Light to run
- 208 GB minimum RAM, runs on ARM
- Security check
- 201 serious finding, 15 minor, CI, tests
Security check: 1 serious finding
- Uses certifi 2024.8.30, which has a known critical vulnerability (PyPI)
Automated checks on commit 4c1abcc, 20 Oct 2026. Not an audit.
- GitHub stars
- 4,081
- Open issues
- 364
- Last commit
- 2026-11-20
- Latest release
- v3.6.1
- License
- Apache-2.0
- Activity
- steady
Checked yesterday - source: GitHub (googleapis/python-genai)
Resources & Compatibility
Minimum requirements: 8 GB RAM, 10 GB disk. ARM (e.g. Raspberry Pi) is supported.
Checked 54 days ago - source: Docker Hub image tags and published docs
First-install notes
- Install MLflow genai and start the server Use the MLflow genai install command, then start the server before using the app. This server stores and displays your model traces and monitoring data, so the app will not work without it. source
- Set your OpenAI API key before launch Put your OpenAI API key in the OPENAI_API_KEY environment variable before starting the agent server. Without it, the server cannot call OpenAI models and your requests will fail. source
- Keep port 5000 open for MLflow Start MLflow on port 5000 or make sure that port is available. The example setup commands and dashboard expect http://localhost:5000, so a blocked or used port will prevent tracing from connecting. source
Fetched 53 days ago - each note links to its source
Variants
Alternatives
No alternatives collected yet.
Common questions
Do I need to run a separate tracing server for GenAI?
Yes. Use the MLflow genai install command, then start the server before using the app. The server stores and displays model traces and monitoring data, and the app will not work without it.
Which port must be available for GenAI tracing?
Start MLflow on port 5000 or make sure that port is available. The example setup commands and dashboard expect the local MLflow dashboard on port 5000, so a blocked or used port will prevent tracing from connecting.
Is an OpenAI API key required?
Set your OpenAI API key in the OPENAI_API_KEY environment variable before starting the agent server. Without it, the server cannot call OpenAI models and your requests will fail.
Should I pin the Google Gen AI SDK version?
Yes, pin the SDK version to avoid unexpected updates. The docs also warn that Automatic Function Calling behavior changes in the next major version.
Answers sourced from github.com, mlflow.org, mlflow.org, mlflow.org
Community
- Discussion | OpenAI Forum (forum)
- Newest Questions - GenAI Stack Exchange (forum)
- GenAI Meta Stack Exchange (forum)
- r/generativeAI - Reddit (reddit)
Collected 48 days ago - public community threads