Google File System

E185682

Google File System is a distributed file system developed by Google to reliably store and process massive amounts of data across clusters of commodity hardware.

All labels observed (4)

How this entity was disambiguated

Statements (48)

Predicate Object
instanceOf distributed file system
proprietary software
alsoKnownAs GFS
architectureFeature multiple chunkservers
single master server
chunkSize 64 MB
consistencyModel relaxed consistency
designedBy Google engineers
designedFor clusters of commodity hardware
large-scale data-intensive applications
developer Google
ensuresReliabilityBy replicating chunks across multiple servers
faultToleranceMechanism master state recovery from operation log
replication of chunk data
handles frequent component failures
influenced design of modern distributed file systems
inspired Hadoop Distributed File System
linked to: HDFS
license closed source
masterDataStructure in-memory metadata
masterPersistence operation log and checkpoints
optimizedFor appending writes
large streaming reads
paperAbbreviation SOSP 2003
paperAuthors Howard Gobioff
Sanjay Ghemawat
Shun-Tak Leung
paperPublicationYear 2003
paperPublishedIn ACM Symposium on Operating Systems Principles
linked to: SOSP
paperTitle The Google File System
linked to: Google File System
stores access control information
file namespace
locations of chunk replicas
mapping from files to chunks
storesFileDataOn chunkservers
storesMetadataOn master server
supports data replication
fault tolerance
high throughput
scalability
supportsOperation record append
snapshot
targetEnvironment Google production clusters
usedFor indexing web pages
large-scale data processing at Google
uses heartbeat messages between master and chunkservers
large fixed-size chunks
leases for mutation control
version numbers for chunk management

How these facts were elicited

Referenced by (8)

Full triples — surface form annotated when it differs from this entity's canonical label.

Hadoop initiallyInspiredBy Google File System
Jeffrey Dean knownFor Google File System
Jeffrey Dean workedOn Google File System (GFS)
linked to: Google File System
Jeffrey Dean coAuthorOf The Google File System
linked to: Google File System
Bigtable basedOn Google File System
MapReduce commonlyUsedWith Google File System
Google File System paperTitle The Google File System
linked to: Google File System
Google infrastructure hasComponent Colossus distributed file system
linked to: Google File System