Title |
Kitten: a tool for normalizing HTML and extracting its textual content |
Authors |
Mathieu-Henri Falco, Véronique Moriceau and Anne Vilnat |
Abstract |
The web is composed of a gigantic amount of documents that can be very useful for information extraction systems. Most of them are written in HTML and have to be rendered by an HTML engine in order to display the data they contain on a screen. HTML file thus mix both informational and rendering content. Our goal is to design a tool for informational content extraction. A linear extraction with only a basic filtering of rendering content would not be enough as objects such as lists and tables are linearly coded but need to be read in a non-linear way to be well interpreted. Besides these HTML pages are often incorrectly coded from an HTML point of view and use a segmentation of blocks based on blank space that cannot be transposed in a text filewithout confusing syntactic parsers. For this purpose, we propose the Kitten tool that first normalizes HTML file into unicode XHTML file, then extracts the informational content into a text filewith a special processing for sentences, lists and tables. |
Topics |
Corpus (creation, annotation, etc.), Tools, systems, applications |
Full paper |
Kitten: a tool for normalizing HTML and extracting its textual content |
Bibtex |
@InProceedings{FALCO12.467,
author = {Mathieu-Henri Falco and Véronique Moriceau and Anne Vilnat}, title = {Kitten: a tool for normalizing HTML and extracting its textual content}, booktitle = {Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12)}, year = {2012}, month = {may}, date = {23-25}, address = {Istanbul, Turkey}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Mehmet Uğur Doğan and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-7-7}, language = {english} } |