TAC KBP English Sentiment Slot Filling -- Comprehensive Training and Evaluation Data 2013-2014

<h3>Introduction</h3></br>
<p>TAC KBP English Surprise Slot Filling -- Comprehensive Training and Evaluation Data 2010 was developed by LDC and contains training and evaluation data produced in support of the <a href="https://tac.nist.gov/2013/KBP/SentimentSF/index.html">2013</a> and <a href="https://tac.nist.gov/2014/KBP/Sentiment/index.html">2014</a> TAC KBP Sentiment Slot Filling tracks.</p></br>
<p>Text Analysis Conference (<a href="https://tac.nist.gov/">TAC</a>) is a series of workshops organized by the National Institute of Standards and Technology (<a href="https://www.nist.gov/">NIST</a>). TAC was developed to encourage research in natural language processing and related applications by providing a large test collection, common evaluation procedures, and a forum for researchers to share their results. Through its various evaluations, the Knowledge Base Population (KBP) track of TAC encouraged the development of systems to match entities mentioned in natural texts with those appearing in a knowledge base, to extract novel information about entities from a document collection, and to add it to a new or existing knowledge base.</p></br>
<p>The regular English Slot Filling track involved mining information about entities from text using a specified set of "slots", or attributes. The goal of the Sentiment Slot Filling task was to evaluate the quality of detectors for positive and negative sentiment. More information about the TAC KBP Sentiment Slot Filling track and other TAC KBP evaluations can be found on the <a href="http://www.nist.gov/tac/"> NIST TAC website</a>.</p></br>
<h3>Data</h3></br>
<p>The data in this release includes queries, "manual runs" (human-produced responses to the queries), and assessment results for both human- and system-produced responses to the queries (some of which were dually assessed).</p></br>
<p>The corresponding source document collections cover English newswire and web text. These documents are included in <a href="../../../LDC2018T03"> TAC KBP Comprehensive English Source Corpora 2009-2014 (LDC2018T03)</a>. The corresponding Knowledge Base (KB) for much of the data - a 2008 snapshot of Wikipedia - is contained in <a href="../../../LDC2014T16"> TAC KBP Reference Knowledge Base (LDC2014T16)</a>.</p></br>
<p>All text data is encoded as UTF-8. Validator and scoring tools are also included in this release.</p></br>
<h3>Sponsorship</h3></br>
<p>This material is based on research sponsored by Air Force Research Laboratory and Defense Advance Research Projects Agency under agreement number FA8750-13-2-0045. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright notation thereon. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of Air Force Research Laboratory and Defense Advanced Research Projects Agency or the U.S. Government.</p></br>
<h3>Samples</h3></br>
<p>Please view these samples:</p></br>
<ul></br>
<li><a href="desc/addenda/LDC2021T08.query.xml">Query Sample (XML)</a></li></br>
<li><a href="desc/addenda/LDC2021T08.mrun.tab">Manual Run Sample (TAB)</a></li></br>
<li><a href="desc/addenda/LDC2021T08.asses.tsv">Assessment Sample (TSV)</a></li></br>
</ul></br>
<h3>Updates</h3></br>
<p>None at this time.</p></br>
Portions © 2009 -2010 Agence France Presse, © 2009-2010 The Associated Press, © 2009 -2010 Central News Agency (Taiwan), © 2009 Los Angeles Times - Washington Post News Service, Inc., © 2009-2010 New York Times, © 2010 The Washington Post Service with Bloomberg News, © 2009-2010 Xinhua News Agency, © 2009, 2010, 2014, 2018, 2021 Trustees of the University of Pennsylvania