Triple

T18204368
Position Surface form Disambiguated ID Type / Status
Subject XLNet E435866 entity
Predicate achievedStateOfTheArtOn P1518 FINISHED
Object RACE dataset
The RACE dataset is a large-scale reading comprehension benchmark derived from English exams for Chinese middle and high school students, designed to evaluate advanced language understanding and reasoning in machine learning models.
 E1312418 NE FINISHED

How this triple was built (4 steps)

Every LLM step that produced this triple, in pipeline order — named-entity classification, the disambiguation choices (the exact options shown, with the pick highlighted), and the generated description. The batch + timestamp of each is in the Provenance table below.

NER Named-entity recognition gpt-5-mini
Instruction
Given a phrase, classify it is english named entity (e.g., persons, organizations, works of art) in Latin script, or not (e.g., literals, dates, URLs, verbose phrases). For disambiguation, the statement where the phrase occurs as object is also given. Please return a JSON object with `phrase` (string, the phrase being analyzed) and `is_ne` (boolean, indicating whether the phrase is a Named Entity).
Input
Phrase: RACE dataset | Statement: [XLNet, achievedStateOfTheArtOn, RACE dataset]
NED1 Entity disambiguation (via context triple) gpt-5-mini-2025-08-07 
Target entity: RACE dataset
Context triple: [XLNet, achievedStateOfTheArtOn, RACE dataset]
  • A. RACE project
    The RACE project was a European research initiative focused on advancing telecommunications and information technologies, within which the RIPEMD-160 cryptographic hash function was originally developed.
  • B. RACE
    RACE is the stock ticker symbol for Ferrari N.V., the renowned Italian luxury sports car manufacturer listed on major stock exchanges.
  • C. New Race
    New Race was a short-lived early 1980s punk rock supergroup formed by ex-Stooges guitarist Ron Asheton and Radio Birdman members, known for its raw, high-energy sound and cult status.
  • D. RAC
    RAC is the abbreviation for the Royal African Company, a 17th- and 18th-century English trading company heavily involved in the transatlantic slave trade.
  • E. RAC
    RAC is Oracle's clustering technology that allows multiple servers to run a single database instance for high availability and scalability.
  • F. None of above. chosen
  • G. Unsure - the case is ambiguous/there is not enough information to decide.
NEDg Description generation gpt-5.1
Instruction
Generate a one-sentence description of the target entity. 
You are given a context triple in the form (subject, predicate, object), where the object is the target entity. 
# Instructions
Use the triple to infer relevant information about the entity. Describe the entity based on what is most defining, well-known. 
Avoid repeating the information from the triple, unless really essential.
# Response Format
Return only the sentence: "Description: [one-sentence description of the target entity]"
Input
Entity: RACE dataset
Triple: [XLNet, achievedStateOfTheArtOn, RACE dataset]
Generated description
The RACE dataset is a large-scale reading comprehension benchmark derived from English exams for Chinese middle and high school students, designed to evaluate advanced language understanding and reasoning in machine learning models.
NED2 Entity disambiguation (via description) gpt-5-mini-2025-08-07 
Target entity: RACE dataset
Target entity description: The RACE dataset is a large-scale reading comprehension benchmark derived from English exams for Chinese middle and high school students, designed to evaluate advanced language understanding and reasoning in machine learning models.
  • A. RACE project
    The RACE project was a European research initiative focused on advancing telecommunications and information technologies, within which the RIPEMD-160 cryptographic hash function was originally developed.
  • B. RACE
    RACE is the stock ticker symbol for Ferrari N.V., the renowned Italian luxury sports car manufacturer listed on major stock exchanges.
  • C. New Race
    New Race was a short-lived early 1980s punk rock supergroup formed by ex-Stooges guitarist Ron Asheton and Radio Birdman members, known for its raw, high-energy sound and cult status.
  • D. RAC
    RAC is the abbreviation for the Royal African Company, a 17th- and 18th-century English trading company heavily involved in the transatlantic slave trade.
  • E. RAC
    RAC is Oracle's clustering technology that allows multiple servers to run a single database instance for high availability and scalability.
  • F. None of above. chosen

Provenance (5 batches)

The batch behind each pipeline step, in order, with when it ran. Timestamps are batch-level — stages were processed in waves, so the object chain (NER → NED1 → NEDg → NED2) reads in order, but predicate / elicitation batches can sit in a different wave.

Step Stage Batch ID Status When
creating Elicitation batch_69d8b90dba6481908e119eb9aa4ca0cb completed April 10, 2026, 8:47 a.m.
NER Named-entity recognition batch_69e4e222831081908f7d5500424e3acb completed April 19, 2026, 2:09 p.m.
NED1 Entity disambiguation (via context triple) batch_6a039f0e52108190913cc5c667619d89 completed May 12, 2026, 9:43 p.m.
NEDg Description generation batch_6a039fdd9c4c819083b450657d0ece43 completed May 12, 2026, 9:47 p.m.
NED2 Entity disambiguation (via description) batch_6a03a0d6de8c8190b1f94c7de0856143 completed May 12, 2026, 9:51 p.m.
Created at: April 10, 2026, 10:32 a.m.