Dueling DQN

E98474

Deep Q-Network variant deep reinforcement learning algorithm value-based reinforcement learning method

Dueling DQN is a deep reinforcement learning algorithm that separates state-value and advantage estimations within its neural network architecture to improve learning efficiency and stability over standard DQN.

Try in SPARQL Jump to: Surface forms Disambiguation Statements Elicitation Referenced by

AI illustration

All labels observed (7)

Label	Occurrences
Dueling DQN canonical	10
Dueling Network Architectures for Deep Reinforcement Learning	7
Dueling DQN architecture	1
Dueling DQN architecture for deep reinforcement learning	1
Dueling Deep Q-Network	1
Dueling Double DQN	1
Dueling Network Architectures	1

How this entity was disambiguated

This entity first appeared as the object of triple T824084 — resolving that mention is where its identity was fixed. The disambiguator weighed these candidate entities and picked the highlighted one (or “None”, minting a new entity). This is how homonymy is resolved: the same surface form can point to different entities.

NED1 Entity disambiguation (via context triple) gpt-5-mini-2025-08-07

Target entity: Dueling DQN
Context triple: [OpenAI Baselines, implementsAlgorithm, Dueling DQN]

A. Atari deep Q-network
The Atari deep Q-network is a pioneering deep reinforcement learning system that learned to play a wide range of Atari 2600 video games directly from raw pixels at human-level or better performance.
B. MuZero
MuZero is a DeepMind reinforcement learning algorithm that learns to plan and master complex games like Go, chess, and Atari without being given the rules in advance.
C. DRL
DRL is the U.S. State Department bureau responsible for promoting democracy, protecting human rights, and advancing labor rights worldwide.
D. Arcade Learning Environment
Arcade Learning Environment is a widely used research platform that provides a suite of Atari 2600 games for developing and evaluating reinforcement learning algorithms.
E. OpenAI Baselines
OpenAI Baselines is a collection of high-quality reference implementations of reinforcement learning algorithms released by OpenAI for research and benchmarking.
F. None of above. chosen
G. Unsure - the case is ambiguous/there is not enough information to decide.

NED2 Entity disambiguation (via description) gpt-5-mini-2025-08-07

Target entity: Dueling DQN
Target entity description: Dueling DQN is a deep reinforcement learning algorithm that separates state-value and advantage estimations within its neural network architecture to improve learning efficiency and stability over standard DQN.

A. Atari deep Q-network
The Atari deep Q-network is a pioneering deep reinforcement learning system that learned to play a wide range of Atari 2600 video games directly from raw pixels at human-level or better performance.
B. MuZero
MuZero is a DeepMind reinforcement learning algorithm that learns to plan and master complex games like Go, chess, and Atari without being given the rules in advance.
C. DRL
DRL is the U.S. State Department bureau responsible for promoting democracy, protecting human rights, and advancing labor rights worldwide.
D. Arcade Learning Environment
Arcade Learning Environment is a widely used research platform that provides a suite of Atari 2600 games for developing and evaluating reinforcement learning algorithms.
E. OpenAI Baselines
OpenAI Baselines is a collection of high-quality reference implementations of reinforcement learning algorithms released by OpenAI for research and benchmarking.
F. None of above. chosen

Statements (44)

Predicate	Object
instanceOf	Deep Q-Network variant ⓘ deep reinforcement learning algorithm ⓘ value-based reinforcement learning method ⓘ
actionSpaceType	discrete ⓘ
aimsToImprove	learning efficiency ⓘ training stability ⓘ
basedOn	Q-learning ⓘ
citationVenue	Proceedings of the 33rd International Conference on Machine Learning ⓘ linked to: ICML
combinesStreamsToEstimate	Q-values ⓘ
commonlyEvaluatedOn	Atari 2600 games ⓘ linked to: Atari 2600
controlType	off-policy ⓘ
domain	artificial intelligence ⓘ
especiallyHelpsWhen	many actions have similar value ⓘ only a few actions affect the value of the state ⓘ
extends	Deep Q-Network ⓘ linked to: Atari deep Q-network
field	reinforcement learning ⓘ
hasComponent	advantage stream ⓘ value stream ⓘ
hasFullName	Dueling Deep Q-Network ⓘ linked to: Dueling DQN
hasKeyIdea	decouple representation of state value from representation of advantages for each action ⓘ
implementedIn	DeepMind Atari agent ⓘ
improvesOver	standard DQN ⓘ linked to: Atari deep Q-network
influenced	Rainbow DQN ⓘ
introducedBy	Hado van Hasselt ⓘ Marc Lanctot ⓘ Matteo Hessel ⓘ Nando de Freitas ⓘ Tom Schaul ⓘ Ziyu Wang ⓘ
introducedInPaper	Dueling Network Architectures for Deep Reinforcement Learning ⓘ linked to: Dueling DQN
learningParadigm	model-free ⓘ
normalizesAdvantageStream	by subtracting mean advantage ⓘ
oftenCombinedWith	Double DQN ⓘ Prioritized Experience Replay ⓘ linked to: Prioritized Experience Replay DQN
publishedAtConference	ICML 2016 ⓘ linked to: ICML
separatesEstimationOf	advantage function ⓘ state-value function ⓘ
sharesFeatureExtractor	between value and advantage streams ⓘ
usesFunctionApproximator	deep neural network ⓘ
usesLossFunction	temporal-difference loss ⓘ
usesOptimizationMethod	Adam optimizer ⓘ stochastic gradient descent ⓘ
usesTargetNetwork	yes ⓘ
yearIntroduced	2016 ⓘ

How these facts were elicited

Referenced by (22)

Full triples — surface form annotated when it differs from this entity's canonical label.

OpenAI Baselines → implementsAlgorithm → Dueling DQN ⓘ

Atari deep Q-network → inspiredAlgorithm → Dueling DQN ⓘ

Dueling DQN → hasFullName → Dueling Deep Q-Network ⓘ

linked to: Dueling DQN

Dueling DQN → introducedInPaper → Dueling Network Architectures for Deep Reinforcement Learning ⓘ

linked to: Dueling DQN

Prioritized Experience Replay DQN → compatibleWith → Dueling DQN ⓘ

Double DQN → influenced → Dueling Double DQN ⓘ

linked to: Dueling DQN

Rainbow DQN → improvesOver → Dueling DQN ⓘ

Ziyu Wang → knownFor → Dueling DQN ⓘ

Ziyu Wang → coDeveloperOf → Dueling DQN ⓘ

Ziyu Wang → notableWork → Dueling Network Architectures for Deep Reinforcement Learning ⓘ

linked to: Dueling DQN

Matteo Hessel → notableWork → Dueling Network Architectures for Deep Reinforcement Learning ⓘ

linked to: Dueling DQN

Hado van Hasselt → knownFor → Dueling DQN ⓘ

Hado van Hasselt → notableWork → Dueling Network Architectures for Deep Reinforcement Learning ⓘ

linked to: Dueling DQN

Hado van Hasselt → coDeveloped → Dueling DQN architecture ⓘ

linked to: Dueling DQN

Marc Lanctot → knownFor → Dueling DQN ⓘ

Marc Lanctot → notableWork → Dueling DQN architecture for deep reinforcement learning ⓘ

linked to: Dueling DQN

Nando de Freitas → coAuthorOf → Dueling Network Architectures for Deep Reinforcement Learning ⓘ

linked to: Dueling DQN

Deep Q-Learning → inspired → Dueling DQN ⓘ

Tianshou → supportsAlgorithm → Dueling DQN ⓘ

Tom Schaul → notableWork → Dueling Network Architectures for Deep Reinforcement Learning ⓘ

linked to: Dueling DQN

Tom Schaul → coAuthorOf → Dueling Network Architectures for Deep Reinforcement Learning ⓘ

linked to: Dueling DQN

Rainbow DQN → combinesMethod → Dueling Network Architectures ⓘ

subject linked to: Dan Horgan

linked to: Dueling DQN

All labels observed (7)

How this entity was disambiguated Show

Statements (44)

How these facts were elicited Show

Referenced by (22)

How this entity was disambiguated

How these facts were elicited