Summary of the paper
| Title | The DARPA Machine Reading Program - Encouraging Linguistic and Reasoning Research with a Series of Reading Tasks |
|---|---|
| Authors | Stephanie Strassel, Dan Adams, Henry Goldberg, Jonathan Herr, Ron Keesing, Daniel Oblinger, Heather Simpson, Robert Schrag and Jonathan Wright |
| Abstract | The goal of DARPA’s Machine Reading (MR) program is nothing less than making the world’s natural language corpora available for formal processing. Most text processing research has focused on locating mission-relevant text (information retrieval) and on techniques for enriching text by transforming it to other forms of text (translation, summarization) ― always for use by humans. In contrast, MR will make knowledge contained in text available in forms that machines can use for automated processing. This will be done with little human intervention. Machines will learn to read from a few examples and they will read to learn what they need in order to answer questions or perform some reasoning task. Three independent Reading Teams are building universal text engines which will capture knowledge from naturally occurring text and transform it into the formal representations used by Artificial Intelligence. An Evaluation Team is selecting and annotating text corpora with task domain concepts, creating model reasoning systems with which the reading systems will interact, and establishing question-answer sets and evaluation protocols to measure progress toward this goal. We describe development of the MR evaluation framework, including test protocols, linguistic resources and technical infrastructure. |
| Topics | LR national/international projects, organizational/policy issues, Corpus (creation, annotation, etc.), Evaluation methodologies |
Full paper |
The DARPA Machine Reading Program - Encouraging Linguistic and Reasoning Research with a Series of Reading Tasks |
Slides |
- |
| Bibtex | @InProceedings{STRASSEL10.862, author = {Stephanie Strassel and Dan Adams and Henry Goldberg and Jonathan Herr and Ron Keesing and Daniel Oblinger and Heather Simpson and Robert Schrag and Jonathan Wright}, title = {The DARPA Machine Reading Program - Encouraging Linguistic and Reasoning Research with a Series of Reading Tasks}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |