Google MapReduce

E185683

Google MapReduce is a programming model and processing framework developed by Google for large-scale distributed data processing across clusters of commodity hardware.

All labels observed (2)

Label Occurrences
Google MapReduce canonical 3
MapReduce 1

How this entity was disambiguated

Statements (50)

Predicate Object
instanceOf data processing framework ⓘ
distributed computing framework ⓘ
programming model ⓘ
abstractsFromProgrammer details of data distribution ⓘ
details of fault tolerance ⓘ
details of parallelization ⓘ
basedOn map function ⓘ
reduce function ⓘ
category big data technology ⓘ
distributed data processing ⓘ
dataLocalityStrategy moving computation to data ⓘ
designedFor batch processing ⓘ
distributed data processing ⓘ
large-scale data processing ⓘ
developer Google ⓘ
executionModel map phase followed by reduce phase ⓘ
faultToleranceMechanism re-execution of failed tasks ⓘ
firstPublicationYear 2004 ⓘ
handles automatic task scheduling ⓘ
data partitioning ⓘ
intermediate data shuffling ⓘ
load balancing ⓘ
re-execution of failed tasks ⓘ
influenced Apache Hadoop MapReduce ⓘ
linked to: Hadoop

Apache Spark programming model ⓘ
linked to: Apache Spark

Dryad ⓘ
FlumeJava ⓘ
inputDataModel key-value pairs ⓘ
inspiredBy functional programming ⓘ
notableFeature automatic handling of machine failures ⓘ
simple programming interface for large clusters ⓘ
operatesOn clusters of commodity hardware ⓘ
outputDataModel key-value pairs ⓘ
paperAuthors Jeffrey Dean ⓘ
Sanjay Ghemawat ⓘ
paperTitle MapReduce: Simplified Data Processing on Large Clusters ⓘ
linked to: MapReduce
publishedBy Google ⓘ
schedulingUnit map task ⓘ
reduce task ⓘ
supports automatic parallelization ⓘ
data locality optimization ⓘ
fault tolerance ⓘ
scalability across thousands of machines ⓘ
usedFor data mining ⓘ
indexing web pages ⓘ
log analysis ⓘ
machine learning preprocessing ⓘ
usedWithin Google indexing systems ⓘ
Google log processing pipelines ⓘ
Google search infrastructure ⓘ

How these facts were elicited

Referenced by (4)

Full triples — surface form annotated when it differs from this entity's canonical label.

Hadoop → initiallyInspiredBy → Google MapReduce ⓘ
Sanjay Ghemawat → knownFor → MapReduce ⓘ
linked to: Google MapReduce
FlumeJava → relatedTo → Google MapReduce ⓘ
GFS → usedBy → Google MapReduce ⓘ