Installation
Requirements
- Python ≥ 3.11
- pip ≥ 23.0
Install Options
Core (no GPU required)
Includes: manifests, evaluation, governance, CLI, REST API framework. All optional features degrade gracefully to stub implementations.
Training Stack
Adds: TRL ≥ 0.9.0, Transformers ≥ 4.40.0, PEFT ≥ 0.10.0, Accelerate ≥ 0.30.0, Datasets ≥ 2.20.0, PyTorch ≥ 2.3.0.
Feature Groups
| Group | Command | What it adds |
|---|---|---|
train |
pip install "provenir[train]" |
SFT, DPO, LoRA, QLoRA via TRL |
distributed |
pip install "provenir[distributed]" |
FSDP, DeepSpeed multi-GPU |
serve |
pip install "provenir[serve]" |
REST API server (FastAPI + uvicorn) |
hub |
pip install "provenir[hub]" |
HuggingFace Hub push / pull |
merge |
pip install "provenir[merge]" |
SLERP / TIES / DARE adapter merging |
semantic |
pip install "provenir[semantic]" |
Embedding-based decontamination |
benchmarks |
pip install "provenir[benchmarks]" |
MMLU, HellaSwag, ARC, … |
judge-anthropic |
pip install "provenir[judge-anthropic]" |
LLM-as-judge via Claude |
judge-openai |
pip install "provenir[judge-openai]" |
LLM-as-judge via GPT-4o |
all |
pip install "provenir[all]" |
Everything |
Multiple Groups
Development Install
Run the quality gate:
All 456 tests pass with just .[dev] — optional features degrade to stubs
automatically when their packages are absent.
Verifying the Install
usage: provenir [-h] {train,eval,audit,model-card,reproduce,sweep,compare,
benchmark,merge,hub,serve,rlaif} ...
Docker
FROM python:3.11-slim
RUN pip install "provenir[serve]"
EXPOSE 8000
CMD ["provenir", "serve", "--host", "0.0.0.0", "--port", "8000"]
Troubleshooting
ImportError: No module named 'torch'
Optional — install provenir[train] if you need the TRL backend.
ImportError: No module named 'huggingface_hub'
Optional — install provenir[hub] to enable Hub push/pull.
ImportError: No module named 'lm_eval'
Optional — install provenir[benchmarks] to enable benchmark evaluation.
All optional imports are guarded — missing packages produce clear error messages rather than silent failures.