Resource: TAC Relation Extraction Dataset

Reference TAC Relation Extraction Dataset
Date of Submission Dec. 18, 2018, 6:35 p.m.
Status accepted
ISLRN 927-859-759-915-2
Resource Type Primary Text
Media Type Text
Source
Language English
Format/MIME Type text/plain
Size 295320 KB
Access Medium Web Download
Description

*Introduction*

TAC Relation Extraction Dataset (TACRED) was developed by The Stanford NLP Group and is a large-scale relation extraction dataset with 106,264 examples built over English newswire and web text used in the NIST TAC KBP English slot filling evaluations during the period 2009-2014. The annotations were derived from TAC KBP relation types (see the guidelines), from human annotations developed by the Linguistic Data Consortium and from crowdsourcing using Mechanical Turk.

*Data*

In each year of the slot filling evaluation, 100 entities (people or organizations) were given as queries (i.e., subjects), for which participating systems should find associated relations and object entities. All sentences judged in the TAC KBP evaluation and a sampling of other sentences that contain the query entities in the evaluation corpus form TACRED. Each sentence was crowd-annotated using Mechanical Turk, where each turk annotator was asked to annotate the subject and object entity spans and the corresponding relation.

Data is presented in both CoNLL and JSON format, both encoded in UTF-8. Scoring tools and gold relation labels are also included. Source corpora used for this dataset were TAC KBP Comprehensive English Source Corpora 2009-2014 (LDC2018T03) and TAC KBP English Regular Slot Filling - Comprehensive Training and Evaluation Data 2009-2014 (LDC2018T22).

For detailed information about the dataset and benchmark results, please refer to the TACRED paper.

Version 1.0
Creator Victor Zhong , Yuhao Zhang , Danqi Chen , Gabor Angeli , Christopher Manning
Distributor Linguistic Data Consortium
Rights Holder Portions © 1994-1997, 2001-2010 Agence France Presse, © 2005 Aljazeera, © 1996-1997 American Broadcasting Corporation, © 1994-2010 The Associated Press, © 1994-1997 Cable News Network, LP, LLLP, © 1997-1999, 2001, 2003-2010 Central News Agency (Taiwan), © 2005 Dubai TV, © 2005-2006 National Broadcasting Company, Inc., © 1996-1997 National Cable Satellite Corporation, © 1994-1998, 2003-2009 Los Angeles Times - Washington Post News Service, Inc., © 1994-2010 New York Times, © 1996-1997 Public Radio International, © 1994-1995 Reuters America, Inc., © 1996 The University of California, USC Radio and Marketplace, © 2010 The Washington Post Service with Bloomberg News, © 1995-2010 Xinhua News Agency, © 2018 The Board of Trustees of the Leland Stanford Junior University, © 1996-1998, 2007, 2008, 2009, 2011, 2014, 2018 Trustees of the University of Pennsylvania