TAC KBP English Entity Linking - Comprehensive Training and Evaluation Data 2009-2013

<h3>Introduction</h3><br>
<p>TAC KBP English Entity Linking - Comprehensive Training and Evaluation Data 2009-2013 was developed by the Linguistic Data Consortium (LDC) and contains training and evaluation data produced in support of the TAC KBP English Entity Linking tasks in <a href="http://pmcnamee.net/kbp.html">2009</a>, <a href="https://tac.nist.gov/2010/KBP/index.html">2010</a>, <a href="http://tac.nist.gov/2011/KBP/index.html">2011</a>, <a href="http://tac.nist.gov/2012/KBP/index.html">2012</a>, and <a href="http://tac.nist.gov/2013/KBP/index.html">2013</a>. It includes queries and gold standard entity type information, Knowledge Base links, and equivalence class clusters for NIL entities. Also included are the source documents for the queries, specifically, English newswire, discussion forum and web data. The corresponding knowledge base is available as TAC KBP Reference Knowledge Base (<a href="../../../LDC2014T16">LDC2014T16</a>). Also included in this package are the results of an Entity Linking IAA (Inter-Annotator Agreement) study conducted in 2010.</p><br>
<p>Text Analysis Conference (<a href="https://tac.nist.gov/">TAC</a>) is a series of workshops organized by the National Institute of Standards and Technology (<a href="https://www.nist.gov/">NIST</a>). TAC was developed to encourage research in natural language processing and related applications by providing a large test collection, common evaluation procedures, and a forum for researchers to share their results. Through its various evaluations, the Knowledge Base Population (KBP) track of TAC encourages the development of systems that can match entities mentioned in natural texts with those appearing in a knowledge base and extract novel information about entities from a document collection and add it to a new or existing knowledge base.</p><br>
<p>English Entity Linking was first conducted as part of the 2009 TAC KBP evaluations. Its goal is to measure systems' ability to determine whether an entity, specified by a query, has a matching node in a reference knowledge base (KB) and, if so, to create a link between the two. If there is no matching node for a query entity in the KB, EL systems are required to cluster the mention together with others referencing the same entity. More information about the TAC KBP Entity Linking task and other TAC KBP evaluations can be found on the <a href="https://tac.nist.gov/">NIST TAC website</a>.</p><br>
<h3>Data</h3><br>
<p>All source documents were originally released as XML but have been converted to text files for this release. This change was made primarily because the documents were used as text files during data development but also because some fail XML parsing.</p><br>
<h3>Acknowledgement</h3><br>
<p>This material is based on research sponsored by Air Force Research Laboratory and Defense Advance Research Projects Agency under agreement number FA8750-13-2-0045. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright notation thereon. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of Air Force Research Laboratory and Defense Advanced Research Projects Agency or the U.S. Government.</p><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC2018T16.txt">sample</a>.</p><br>
<h3>Updates</h3><br>
<p>None at this time.</p></br>
Portions © 1994-1997, 2001-2010 Agence France Presse, © 1995-1998, 2000-2010 The Associated Press, © 1999, 2005-2010 Central News Agency (Taiwan), © 1995-1997, 2003-2009 Los Angeles Times - Washington Post News Service, Inc., © 1994-2010 New York Times, © 2010 The Washington Post Service with Bloomberg News, © 1995-2001, 2003-2010 Xinhua News Agency, © 2018 Trustees of the University of Pennsylvania