Hugging Face Accelerate

E435889

Hugging Face Accelerate is a lightweight library that simplifies running and scaling PyTorch and Transformers models across CPUs, GPUs, and distributed hardware with minimal code changes.

All labels observed (1)

Label Occurrences
Hugging Face Accelerate canonical 1

How this entity was disambiguated

Statements (51)

Predicate Object
instanceOf Python library ⓘ
open-source project ⓘ
software library ⓘ
developer Hugging Face ⓘ
documentation https://huggingface.co/docs/accelerate ⓘ
goal minimize code changes for scaling models ⓘ
provide hardware-agnostic training code ⓘ
simplify distributed training ⓘ
integratesWith Comet ML ⓘ
DeepSpeed ⓘ
Hugging Face Datasets ⓘ
Hugging Face Transformers ⓘ
PyTorch Lightning (via adapters) ⓘ
TensorBoard ⓘ
Weights & Biases ⓘ
license Apache License 2.0 ⓘ
programmingLanguage Python ⓘ
provides Accelerator API ⓘ
command-line interface ⓘ
configuration utilities ⓘ
repository https://github.com/huggingface/accelerate ⓘ
supportsBackend DeepSpeed ⓘ
Fully Sharded Data Parallel ⓘ
Megatron-LM ⓘ
PyTorch Distributed Data Parallel ⓘ
XLA ⓘ
supportsFeature BF16 training ⓘ
CPU offload ⓘ
FP16 training ⓘ
automatic batch splitting ⓘ
automatic device placement ⓘ
checkpointing ⓘ
distributed evaluation ⓘ
experiment tracking integration ⓘ
gradient accumulation ⓘ
gradient clipping ⓘ
logging integration ⓘ
mixed precision training ⓘ
multi-GPU training ⓘ
multi-node training ⓘ
zero redundancy optimization via DeepSpeed ⓘ
supportsFramework PyTorch ⓘ
Transformers ⓘ
supportsHardware CPU ⓘ
GPU ⓘ
TPU ⓘ
distributed hardware ⓘ
multi-GPU ⓘ
useCase distributed inference ⓘ
fine-tuning Transformer models ⓘ
training large language models ⓘ

How these facts were elicited

Referenced by (1)

Full triples — surface form annotated when it differs from this entity's canonical label.

Hugging Face Transformers → compatibleWith → Hugging Face Accelerate ⓘ