Atari deep Q-network

E39543

The Atari deep Q-network is a pioneering deep reinforcement learning system that learned to play a wide range of Atari 2600 video games directly from raw pixels at human-level or better performance.

All labels observed (10)

How this entity was disambiguated

Statements (50)

Predicate Object
instanceOf deep Q-network
deep reinforcement learning algorithm
model-free reinforcement learning method
off-policy reinforcement learning method
value-based reinforcement learning method
achievedPerformanceLevel human-level control on many Atari 2600 games
actionSpace discrete actions
basedOnAlgorithm Q-learning
coAuthor Alex Graves
Daan Wierstra
David Silver
Ioannis Antonoglou
Koray Kavukcuoglu
Martin Riedmiller
developedBy DeepMind
doesNotUse game-specific prior knowledge
hand-crafted features
domain Atari 2600 video games
environmentFramework Arcade Learning Environment
evaluationMetric average score over episodes
evaluationSetting same network architecture across games
single set of hyperparameters across games
firstAuthor Volodymyr Mnih
inputFrameSize 84x84 grayscale images
inputFrameStack 4 consecutive frames
inputSource Atari 2600 games
inputType raw pixel images
inspiredAlgorithm Double DQN
Dueling DQN
Prioritized Experience Replay
Rainbow DQN
introducedInPaper Playing Atari with Deep Reinforcement Learning
introducedInYear 2013
journalPublicationYear 2015
learningParadigm trial-and-error learning
notableContribution demonstrated deep learning can learn control policies directly from high-dimensional sensory input
introduced target networks for stabilizing deep Q-learning
popularized experience replay in deep reinforcement learning
observationType screen images only
outputType Q-values for discrete actions
action-value function
publishedInJournal Nature
rewardSignal game score changes
trainingSignal game score reward
usesExplorationStrategy epsilon-greedy policy
usesFunctionApproximator convolutional neural network
usesLossFunction temporal-difference error
usesOptimizationMethod stochastic gradient descent
usesStabilizationTechnique experience replay
target network

How these facts were elicited

Referenced by (23)

Full triples — surface form annotated when it differs from this entity's canonical label.

DeepMind knownFor Atari deep Q-network
DeepMind developed Deep Q-Network
linked to: Atari deep Q-network
OpenAI Baselines implementsAlgorithm Deep Q-Network
linked to: Atari deep Q-network
OpenAI Baselines implementsAlgorithm DQN
linked to: Atari deep Q-network
Atari deep Q-network introducedInPaper Playing Atari with Deep Reinforcement Learning
linked to: Atari deep Q-network
TF-Agents supportsAlgorithmFamily DQN
linked to: Atari deep Q-network
A3C comparedWith DQN
linked to: Atari deep Q-network
Dueling DQN extends Deep Q-Network
linked to: Atari deep Q-network
Dueling DQN improvesOver standard DQN
linked to: Atari deep Q-network
Prioritized Experience Replay DQN basedOn Deep Q-Network
linked to: Atari deep Q-network
DDPG inspiredBy Deep Q-Network
linked to: Atari deep Q-network
DDPG contrastWith DQN (which handles discrete actions)
linked to: Atari deep Q-network
Volodymyr Mnih knownFor human-level control through deep reinforcement learning
linked to: Atari deep Q-network
Volodymyr Mnih coAuthorOf Human-level control through deep reinforcement learning
linked to: Atari deep Q-network
Volodymyr Mnih authorOf Human-level control through deep reinforcement learning
linked to: Atari deep Q-network
Volodymyr Mnih notableWork Human-level control through deep reinforcement learning
linked to: Atari deep Q-network
Volodymyr Mnih notableWork Playing Atari with deep reinforcement learning
linked to: Atari deep Q-network
Volodymyr Mnih coAuthorOf Playing Atari with deep reinforcement learning
linked to: Atari deep Q-network
Daan Wierstra coAuthorOf “Playing Atari with Deep Reinforcement Learning”
linked to: Atari deep Q-network
Ioannis Antonoglou knownFor Atari deep Q-network
Ioannis Antonoglou knownFor DQN
linked to: Atari deep Q-network
Ioannis Antonoglou coAuthorOf Playing Atari with Deep Reinforcement Learning
linked to: Atari deep Q-network
Ioannis Antonoglou coAuthorOf Human-level control through deep reinforcement learning
linked to: Atari deep Q-network