FlumeJava

E702188

FlumeJava is a Java-based library from Google for building, optimizing, and running large-scale data-parallel pipelines, later inspiring systems like Apache Beam.

All labels observed (1)

Label Occurrences
FlumeJava canonical 2

How this entity was disambiguated

Statements (47)

Predicate Object
instanceOf Java library ⓘ
data-parallel programming framework ⓘ
software library ⓘ
abstractionLevel high-level API over MapReduce ⓘ
basedOn MapReduce programming model ⓘ
category big data framework ⓘ
parallel data processing library ⓘ
designGoal enable automatic optimization of data pipelines ⓘ
separate logical pipeline description from physical execution ⓘ
simplify writing data-parallel code in Java ⓘ
developer Google ⓘ
domain big data processing ⓘ
parallel computing ⓘ
executionEnvironment cluster computing environments ⓘ
distributed systems ⓘ
executionModel dataflow-style pipelines ⓘ
influenced Apache Beam ⓘ
inspirationFor Google Cloud Dataflow model ⓘ
inspired Apache Beam ⓘ
introducedBy Google researchers ⓘ
mainPurpose building data-parallel pipelines ⓘ
optimizing data-parallel pipelines ⓘ
running large-scale data-parallel pipelines ⓘ
optimizationStrategy combining multiple operations into fewer passes over data ⓘ
fusion of pipeline stages ⓘ
reordering of operations ⓘ
programmingLanguage Java ⓘ
provides PCollection abstraction ⓘ
parallel operations on collections ⓘ
relatedTo Apache Beam ⓘ
Google MapReduce ⓘ
dataflow programming ⓘ
supports automatic optimization of execution plans ⓘ
combine operations ⓘ
groupBy operations ⓘ
join operations ⓘ
lazy evaluation of pipelines ⓘ
map operations ⓘ
parallel collections ⓘ
pipeline abstraction ⓘ
reduce operations ⓘ
targetUseCase large-scale batch data processing ⓘ
targetUser Java developers ⓘ
usedFor ETL pipelines ⓘ
analytics pipelines ⓘ
data aggregation ⓘ
log processing ⓘ

How these facts were elicited

Referenced by (2)

Full triples — surface form annotated when it differs from this entity's canonical label.

MapReduce → influenced → FlumeJava ⓘ
Google MapReduce → influenced → FlumeJava ⓘ