TensorFlow Serving

E457353

TensorFlow Serving is a flexible, high-performance system for deploying and serving machine learning models in production, particularly those built with TensorFlow.

All labels observed (2)

Label Occurrences
TensorFlow Serving canonical 6
ModelServer 1

How this entity was disambiguated

Statements (51)

Predicate Object
instanceOf TensorFlow ecosystem component ⓘ
machine learning infrastructure software ⓘ
model serving system ⓘ
open-source software ⓘ
architecture servable-based modular architecture ⓘ
component Loader ⓘ
Manager ⓘ
ModelServer ⓘ
linked to: TensorFlow Serving

Servable ⓘ
Source ⓘ
deploymentModel Docker container ⓘ
Kubernetes ⓘ
cloud virtual machines ⓘ
on-premises servers ⓘ
developer Google ⓘ
documentation https://www.tensorflow.org/tfx/guide/serving ⓘ
feature A/B testing support via multiple model versions ⓘ
CPU-only serving support ⓘ
GPU acceleration support ⓘ
batching of inference requests ⓘ
canary model deployment ⓘ
dynamic model configuration ⓘ
high-performance inference serving ⓘ
hot model swapping without downtime ⓘ
model lifecycle management ⓘ
model rollback ⓘ
monitoring hooks via custom servables ⓘ
multi-model serving ⓘ
production model deployment ⓘ
versioned model management ⓘ
goal provide flexible, high-performance serving of machine learning models in production ⓘ
license Apache License 2.0 ⓘ
optimizedFor TensorFlow models in SavedModel format ⓘ
partOf TensorFlow ⓘ
programmingLanguage C++ ⓘ
Python ⓘ
repository https://github.com/tensorflow/serving ⓘ
supportsFramework Keras ⓘ
TensorFlow ⓘ
supportsLanguageBinding REST ⓘ
gRPC ⓘ
supportsModelFormat SavedModel ⓘ
TensorFlow Hub module (via SavedModel) ⓘ
linked to: TensorFlow Hub
supportsPlatform Docker-compatible platforms ⓘ
Linux ⓘ
supportsProtocol HTTP/JSON ⓘ
gRPC binary protocol ⓘ
useCase large-scale production ML systems ⓘ
microservice-based ML APIs ⓘ
online prediction ⓘ
real-time inference ⓘ

How these facts were elicited

Referenced by (7)

Full triples — surface form annotated when it differs from this entity's canonical label.

TensorFlow Extended → usesLibrary → TensorFlow Serving ⓘ
TensorFlow Estimators → compatibleWith → TensorFlow Serving ⓘ
TensorFlow ecosystem → includesComponent → TensorFlow Serving ⓘ
TFX → integratesWith → TensorFlow Serving ⓘ
Transform → supports → TensorFlow Serving ⓘ
InfraValidator → relatedTo → TensorFlow Serving ⓘ
TensorFlow Serving → component → ModelServer ⓘ
linked to: TensorFlow Serving