IMPALA

E428323

IMPALA is a scalable deep reinforcement learning architecture designed for efficient distributed training of agents across many tasks and environments.

All labels observed (1)

Label Occurrences
IMPALA canonical 2

How this entity was disambiguated

Statements (47)

Predicate Object
instanceOf deep reinforcement learning architecture ⓘ
distributed reinforcement learning system ⓘ
scalable RL architecture ⓘ
affiliation DeepMind Technologies ⓘ
linked to: DeepMind
architectureType actor-critic ⓘ
citationVenue ICML 2018 ⓘ
linked to: ICML
comparedWith A2C ⓘ
A3C ⓘ
contribution demonstrated scalable distributed deep RL with stable learning ⓘ
designedFor distributed training of agents ⓘ
multi-task reinforcement learning ⓘ
scalable deep reinforcement learning ⓘ
developedBy DeepMind ⓘ
enables training with thousands of actors ⓘ
evaluationDomain Atari ⓘ
linked to: Atari, Inc.

DeepMind Lab ⓘ
multi-task environments ⓘ
field artificial intelligence ⓘ
deep learning ⓘ
reinforcement learning ⓘ
fullName Importance Weighted Actor-Learner Architectures ⓘ
handles large-scale distributed training ⓘ
off-policy data ⓘ
policy lag between actors and learner ⓘ
hasAlgorithm V-trace ⓘ
improves data efficiency ⓘ
scalability ⓘ
throughput ⓘ
keyIdea decouple acting from learning via distributed actors and a central learner ⓘ
use importance weighting to correct for policy lag ⓘ
language implemented primarily in TensorFlow in the original work ⓘ
notableComponent V-trace off-policy correction algorithm ⓘ
optimizationMethod policy gradient ⓘ
value-based learning ⓘ
outperforms A2C on large-scale multi-task benchmarks ⓘ
A3C on large-scale multi-task benchmarks ⓘ
paperTitle IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures ⓘ
publishedIn International Conference on Machine Learning ⓘ
linked to: ICML
supports large-scale experiments ⓘ
many tasks and environments ⓘ
multi-task learning ⓘ
uses V-trace ⓘ
actor-learner architecture ⓘ
centralized learner ⓘ
distributed actors ⓘ
off-policy correction ⓘ
yearIntroduced 2018 ⓘ

How these facts were elicited

Referenced by (2)

Full triples — surface form annotated when it differs from this entity's canonical label.