Differentiable Neural Computers

E736824

Differentiable Neural Computers are a type of neural network architecture that augments traditional networks with an external, differentiable memory module, enabling them to learn algorithmic and reasoning tasks end-to-end.

All labels observed (3)

How this entity was disambiguated

Statements (49)

Predicate Object
instanceOf differentiable memory system ⓘ
memory-augmented neural network ⓘ
neural network architecture ⓘ
alsoKnownAs DNCs ⓘ
canLearn algorithmic tasks ⓘ
copying sequences ⓘ
graph reasoning tasks ⓘ
pathfinding in graphs ⓘ
question answering over structured data ⓘ
sorting sequences ⓘ
coAuthor Greg Wayne ⓘ
Malcolm Reynolds ⓘ
comparedTo Neural Turing Machines ⓘ
recurrent neural networks ⓘ
controllerType recurrent neural network ⓘ
designedFor handling long-term dependencies ⓘ
learning algorithms from data ⓘ
developedBy DeepMind ⓘ
extends Neural Turing Machines ⓘ
field deep learning ⓘ
machine learning ⓘ
neural computation ⓘ
firstAuthorOfOriginalPaper Alex Graves ⓘ
hasComponent controller network ⓘ
external memory matrix ⓘ
read heads ⓘ
write heads ⓘ
hasProperty differentiable memory access ⓘ
end-to-end trainable ⓘ
supports gradient-based learning ⓘ
improvesOn Neural Turing Machines memory addressing ⓘ
introducedInPaper "Hybrid computing using a neural network with dynamic external memory" ⓘ
memoryAddressing soft attention over memory locations ⓘ
memoryStructure 2D memory matrix ⓘ
optimizationObjective task-specific loss function ⓘ
publicationYear 2016 ⓘ
publishedIn Nature ⓘ
readOperation weighted sum of memory rows ⓘ
supports one-shot learning ⓘ
relational reasoning ⓘ
trainedWith backpropagation through time ⓘ
stochastic gradient descent ⓘ
typicalControllerImplementation LSTM ⓘ
usesMechanism content-based addressing ⓘ
differentiable attention ⓘ
dynamic memory allocation ⓘ
location-based addressing ⓘ
temporal link matrix ⓘ
writeOperation erase and add vectors ⓘ

How these facts were elicited

Referenced by (5)

Full triples — surface form annotated when it differs from this entity's canonical label.

Alex Graves → notableWork → Differentiable Neural Computers ⓘ
Alex Graves → knownFor → Differentiable Neural Computers ⓘ
Alex Graves → coAuthorOf → Differentiable Neural Computers paper ⓘ
linked to: Differentiable Neural Computers
Neural Turing Machines → inspired → Differentiable Neural Computer ⓘ
linked to: Differentiable Neural Computers
Neural Turing Machines → hasSuccessor → Differentiable Neural Computer ⓘ
linked to: Differentiable Neural Computers