Ray Serve

E438347

Ray Serve is a scalable model serving library built on the Ray framework that enables deploying and managing machine learning models in production.

All labels observed (1)

Label Occurrences
Ray Serve canonical 2

How this entity was disambiguated

Statements (54)

Predicate Object
instanceOf distributed system ⓘ
model serving library ⓘ
open-source software ⓘ
builtOnFramework Ray ⓘ
developedBy Anyscale ⓘ
domain MLOps ⓘ
machine learning infrastructure ⓘ
feature Python decorator-based deployment definitions ⓘ
built-in HTTP server ⓘ
deployment configuration via YAML or Python APIs ⓘ
dynamic scaling based on load ⓘ
metrics and logging support ⓘ
observability hooks ⓘ
replica management ⓘ
request batching ⓘ
versioned deployments ⓘ
goal simplify scalable model serving ⓘ
unify batch and online inference on a single platform ⓘ
integratesWith ASGI applications ⓘ
FastAPI ⓘ
Kubernetes operators for Ray ⓘ
Ray Core ⓘ
linked to: Ray

Ray Data ⓘ
Ray Train ⓘ
Ray Tune ⓘ
Starlette ⓘ
license Apache License 2.0 ⓘ
partOf Ray ecosystem ⓘ
programmingLanguage Python ⓘ
supports CPU-based serving ⓘ
DAG-based inference pipelines ⓘ
GPU acceleration ⓘ
Kubernetes deployment ⓘ
Python function deployment ⓘ
REST APIs ⓘ
autoscaling ⓘ
canary deployments ⓘ
cloud deployment ⓘ
deployment graphs ⓘ
deployment of ML models as services ⓘ
gRPC ⓘ
multi-tenant model serving ⓘ
on-premise deployment ⓘ
rolling updates ⓘ
traffic splitting ⓘ
supportsLanguage Java ⓘ
Python ⓘ
other Ray-supported languages ⓘ
useCase A/B testing of models ⓘ
batch inference ⓘ
machine learning model serving ⓘ
model deployment to production ⓘ
multi-model serving ⓘ
online inference ⓘ

How these facts were elicited

Referenced by (2)

Full triples — surface form annotated when it differs from this entity's canonical label.

RLlib → integratesWith → Ray Serve ⓘ
Ray → hasComponent → Ray Serve ⓘ