| Title | Out in the Open: Finding and Categorising Errors in the Lexical Simplification Pipeline | 
  
  | Authors | Matthew Shardlow | 
  
  | Abstract | Lexical simplification is the task of automatically reducing the complexity of a text by identifying difficult words and replacing them with simpler alternatives. Whilst this is a valuable application of natural language generation, rudimentary lexical simplification systems suffer from a high error rate which often results in nonsensical, non-simple text. This paper seeks to characterise and quantify the errors which occur in a typical baseline lexical simplification system. We expose 6 distinct categories of error and propose a classification scheme for these. We also quantify these errors for a moderate size corpus, showing the magnitude of each error type. We find that for 183 identified simplification instances, only 19 (10.38%) result in a valid simplification, with the rest causing errors of varying gravity. | 
  
  | Topics | Natural Language Generation, Summarisation | 
  
  | Full paper  | Out in the Open: Finding and Categorising Errors in the Lexical Simplification Pipeline | 
  
  | Bibtex | @InProceedings{SHARDLOW14.479, author =  {Matthew Shardlow},
 title =  {Out in the Open: Finding and Categorising Errors in the Lexical Simplification Pipeline},
 booktitle =  {Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)},
 year =  {2014},
 month =  {may},
 date =  {26-31},
 address =  {Reykjavik, Iceland},
 editor =  {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Hrafn Loftsson and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis},
 publisher =  {European Language Resources Association (ELRA)},
 isbn =  {978-2-9517408-8-4},
 language =  {english}
 }
 |