Dueling DQN

E98474

Dueling DQN is a deep reinforcement learning algorithm that separates state-value and advantage estimations within its neural network architecture to improve learning efficiency and stability over standard DQN.

All labels observed (4)

How this entity was disambiguated

Statements (44)

Predicate Object
instanceOf Deep Q-Network variant
deep reinforcement learning algorithm
value-based reinforcement learning method
actionSpaceType discrete
aimsToImprove learning efficiency
training stability
basedOn Q-learning
citationVenue Proceedings of the 33rd International Conference on Machine Learning
linked to: ICML
combinesStreamsToEstimate Q-values
commonlyEvaluatedOn Atari 2600 games
linked to: Atari 2600
controlType off-policy
domain artificial intelligence
especiallyHelpsWhen many actions have similar value
only a few actions affect the value of the state
extends Deep Q-Network
field reinforcement learning
hasComponent advantage stream
value stream
hasFullName Dueling Deep Q-Network
linked to: Dueling DQN
hasKeyIdea decouple representation of state value from representation of advantages for each action
implementedIn DeepMind Atari agent
improvesOver standard DQN
influenced Rainbow DQN
introducedBy Hado van Hasselt
Marc Lanctot
Matteo Hessel
Nando de Freitas
Tom Schaul
Ziyu Wang
introducedInPaper Dueling Network Architectures for Deep Reinforcement Learning
linked to: Dueling DQN
learningParadigm model-free
normalizesAdvantageStream by subtracting mean advantage
oftenCombinedWith Double DQN
Prioritized Experience Replay
publishedAtConference ICML 2016
linked to: ICML
separatesEstimationOf advantage function
state-value function
sharesFeatureExtractor between value and advantage streams
usesFunctionApproximator deep neural network
usesLossFunction temporal-difference loss
usesOptimizationMethod Adam optimizer
stochastic gradient descent
usesTargetNetwork yes
yearIntroduced 2016

How these facts were elicited

Referenced by (7)

Full triples — surface form annotated when it differs from this entity's canonical label.

Dueling DQN hasFullName Dueling Deep Q-Network
linked to: Dueling DQN
Dueling DQN introducedInPaper Dueling Network Architectures for Deep Reinforcement Learning
linked to: Dueling DQN
Double DQN influenced Dueling Double DQN
linked to: Dueling DQN
Rainbow DQN improvesOver Dueling DQN