Tungsten execution engine

E705280

Tungsten execution engine is a low-level, memory- and CPU-optimized execution backend in Apache Spark designed to significantly improve performance of data processing workloads.

All labels observed (1)

Label Occurrences
Tungsten execution engine canonical 2

How this entity was disambiguated

Statements (47)

Predicate Object
instanceOf Spark execution backend ⓘ
query execution engine ⓘ
basedOn project Tungsten ⓘ
benefits better hardware utilization ⓘ
higher throughput ⓘ
lower latency ⓘ
componentOf Spark SQL Catalyst optimizer pipeline ⓘ
designedBy Apache Spark community ⓘ
linked to: Apache Spark

Databricks engineers ⓘ
developedFor Apache Spark Core ⓘ
linked to: Apache Spark

Apache Spark SQL ⓘ
linked to: Spark SQL engine
goal improve performance of data processing workloads ⓘ
implements whole-stage Java code generation for query plans ⓘ
improves CPU utilization ⓘ
memory utilization ⓘ
query execution speed ⓘ
introducedIn Apache Spark 1.4 ⓘ
linked to: Apache Spark
language Java ⓘ
Scala ⓘ
manages off-heap memory pages ⓘ
nameOrigin named after metal tungsten ⓘ
nameReason emphasizes performance and efficiency ⓘ
optimizationFocus CPU efficiency ⓘ
cache locality ⓘ
memory efficiency ⓘ
partOf Apache Spark ⓘ
reduces Java object allocation ⓘ
garbage collection overhead ⓘ
interpretive query execution overhead ⓘ
relatedTo Spark SQL Catalyst optimizer ⓘ
Spark physical execution layer ⓘ
replaces row-based interpreted execution in Spark SQL ⓘ
runsOn Java Virtual Machine ⓘ
storesDataAs compact binary rows ⓘ
supports DataFrame API ⓘ
Dataset API ⓘ
Spark SQL queries ⓘ
targetEnvironment distributed data processing ⓘ
targetWorkloads ETL pipelines ⓘ
batch processing ⓘ
interactive SQL queries ⓘ
uses binary row format ⓘ
cache-friendly data structures ⓘ
expression code generation ⓘ
off-heap memory management ⓘ
runtime code generation ⓘ
whole-stage code generation ⓘ

How these facts were elicited

Referenced by (2)

Full triples — surface form annotated when it differs from this entity's canonical label.

Apache Spark → provides → Tungsten execution engine ⓘ
Structured Streaming → uses → Tungsten execution engine ⓘ