Asynchronous Advantage Actor-Critic

E428319

Asynchronous Advantage Actor-Critic is a deep reinforcement learning algorithm that trains multiple parallel agents to learn both policy and value functions efficiently and stably.

All labels observed (4)

How this entity was disambiguated

Statements (47)

Predicate Object
instanceOf deep reinforcement learning algorithm ⓘ
reinforcement learning algorithm ⓘ
abbreviation A3C ⓘ
appliedTo Atari 2600 domain ⓘ
linked to: Atari 2600

continuous control tasks ⓘ
belongsToFamily actor-critic methods ⓘ
category model-free reinforcement learning ⓘ
comparedTo Deep Q-Network ⓘ
linked to: Deep Q-Learning
goal efficient learning ⓘ
stable learning ⓘ
handles continuous action spaces ⓘ
discrete action spaces ⓘ
hasComponent actor network ⓘ
critic network ⓘ
inspired A2C ⓘ
introducedBy Adrià Puigdomènech Badia ⓘ
Alex Graves ⓘ
David Silver ⓘ
Koray Kavukcuoglu ⓘ
Mehdi Mirza ⓘ
Tim Harley ⓘ
Timothy P. Lillicrap ⓘ
Volodymyr Mnih ⓘ
introducedByOrganization DeepMind ⓘ
introducedInPaper Asynchronous Methods for Deep Reinforcement Learning ⓘ
introducedInYear 2016 ⓘ
networkType deep neural network ⓘ
optimizationMethod RMSProp ⓘ
stochastic gradient descent ⓘ
optimizes policy function ⓘ
value function ⓘ
outperformsOn many Atari 2600 games ⓘ
parallelism multi-threaded workers ⓘ
multiple parallel agents ⓘ
reduces correlation between updates ⓘ
need for experience replay ⓘ
training instability ⓘ
trainingStyle asynchronous ⓘ
on-policy ⓘ
updateFrequency multi-step updates ⓘ
updateType asynchronous gradient updates ⓘ
uses advantage function ⓘ
entropy regularization ⓘ
n-step returns ⓘ
policy gradient ⓘ
shared model parameters ⓘ
value-based baseline ⓘ

How these facts were elicited

Referenced by (7)

Full triples — surface form annotated when it differs from this entity's canonical label.

A3C → fullName → Asynchronous Advantage Actor-Critic ⓘ
A3C → abbreviationOf → Asynchronous Advantage Actor-Critic ⓘ
A2C → fullName → Advantage Actor-Critic ⓘ
linked to: Asynchronous Advantage Actor-Critic
Asynchronous Methods for Deep Reinforcement Learning → proposedAlgorithm → Asynchronous Advantage Actor-Critic ⓘ
Asynchronous Methods for Deep Reinforcement Learning → influenced → A2C (Advantage Actor-Critic) ⓘ
linked to: Asynchronous Advantage Actor-Critic
IMPALA → outperforms → A3C on large-scale multi-task benchmarks ⓘ
linked to: Asynchronous Advantage Actor-Critic
Adrià Puigdomènech Badia → knownFor → Asynchronous Advantage Actor-Critic ⓘ