Title |
Towards Electronic SMS Dictionary Construction: An Alignment-based Approach |
Authors |
Cédric Lopez, Reda Bestandji, Mathieu Roche and Rachel Panckhurst |
Abstract |
In this paper, we propose a method for aligning text messages (entitled AlignSMS) in order to automatically build an SMS dictionary. An extract of 100 text messages from the 88milSMS corpus (Panckhurst el al., 2013, 2014) was used as an initial test. More than 90,000 authentic text messages in French were collected from the general public by a group of academics in the south of France in the context of the sud4science project (http://www.sud4science.org). This project is itself part of a vast international SMS data collection project, entitled sms4science (http://www.sms4science.org, Fairon et al. 2006, Cougnon, 2014). After corpus collation, pre-processing and anonymisation (Accorsi et al., 2012, Patel et al., 2013), we discuss how raw anonymised text messages can be transcoded into normalised text messages, using a statistical alignment method. The future objective is to set up a hybrid (symbolic/statistic) approach based on both grammar rules and our statistical AlignSMS method. |
Topics |
Information Extraction, Information Retrieval, Acquisition |
Full paper |
Towards Electronic SMS Dictionary Construction: An Alignment-based Approach |
Bibtex |
@InProceedings{LOPEZ14.753,
author = {Cédric Lopez and Reda Bestandji and Mathieu Roche and Rachel Panckhurst}, title = {Towards Electronic SMS Dictionary Construction: An Alignment-based Approach}, booktitle = {Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)}, year = {2014}, month = {may}, date = {26-31}, address = {Reykjavik, Iceland}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Hrafn Loftsson and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-8-4}, language = {english} } |