Large-Scale Distributed Deep Networks

E238233

Large-Scale Distributed Deep Networks is a seminal research work that introduced methods for training deep neural networks efficiently across large-scale distributed computing infrastructure, enabling breakthroughs in modern large-scale AI systems.

All labels observed (4)

How this entity was disambiguated

Statements (37)

Predicate Object
instanceOf deep learning method ⓘ
research paper ⓘ
scientific publication ⓘ
aimsTo reduce training time for deep neural networks ⓘ
scale deep learning to very large datasets ⓘ
scale deep learning to very large models ⓘ
appliedIn industry-scale machine learning systems ⓘ
large-scale computer vision systems ⓘ
large-scale recommendation systems ⓘ
large-scale speech recognition systems ⓘ
characteristic highly scalable training architecture ⓘ
support for very large datasets ⓘ
support for very large models ⓘ
contribution demonstrated scalability of deep learning to large datasets and models ⓘ
introduced methods for training deep networks across distributed infrastructure ⓘ
enables efficient training of deep neural networks on large clusters ⓘ
modern large-scale AI systems ⓘ
scaling deep learning beyond single-machine limits ⓘ
training on distributed clusters of machines ⓘ
field deep learning ⓘ
distributed computing ⓘ
machine learning ⓘ
focusesOn large-scale distributed training ⓘ
scalable deep learning ⓘ
training deep neural networks ⓘ
impact enabled practical training of deep models on industrial-scale data ⓘ
influenced design of large-scale AI training systems ⓘ
recognizedAs foundational for modern large-scale AI training frameworks ⓘ
seminal work in large-scale deep learning ⓘ
relatedTo cluster-based neural network training ⓘ
distributed stochastic gradient descent ⓘ
large-scale AI infrastructure ⓘ
parallel deep learning ⓘ
uses data parallelism ⓘ
distributed computing infrastructure ⓘ
model parallelism ⓘ
parallelization of neural network training ⓘ

How these facts were elicited

Referenced by (5)

Full triples — surface form annotated when it differs from this entity's canonical label.

Jeff Dean → notablePublication → Large-Scale Distributed Deep Networks ⓘ
Quoc V. Le → coAuthorOf → Building High-level Features Using Large Scale Unsupervised Learning ⓘ
linked to: Large-Scale Distributed Deep Networks
AlexNet → introducedInPaper → ImageNet Classification with Deep Convolutional Neural Networks ⓘ
linked to: Large-Scale Distributed Deep Networks
DistBelief → notablePublication → Building High-level Features Using Large Scale Unsupervised Learning ⓘ
linked to: Large-Scale Distributed Deep Networks
DistBelief → notablePublication → Large Scale Distributed Deep Networks ⓘ
linked to: Large-Scale Distributed Deep Networks