Activate Activate Activate
contact  
Hello. Sign in to personalize your visit. New user? Register now.  

In
By author
Computational Linguistics

Quarterly (March, June, September, December)
160 pp. per issue
6 3/4 x 10
Founded: 1974
ISSN 0891-2017
E-ISSN 1530-9312
2008 ISI Impact Factor: 2.656

Computational Linguistics

December 2006, Vol. 32, No. 4, Pages 471-484
Posted Online November 21, 2006.
(doi:10.1162/coli.2006.32.4.471)
© 2006 Massachusetts Institute of Technology
Automatic Evaluation of Information Ordering: Kendall's Tau

Mirella Lapata*

* School of Informatics, University of Edinburgh, 2 Buccleuch Place, Edinburgh EH8 9LW, UK. E-mail:

PDF (164.564 KB) PDF Plus (192.994 KB)

This article considers the automatic evaluation of information ordering, a task underlying many text-based applications such as concept-to-text generation and multidocument summarization. We propose an evaluation method based on Kendall's τ, a metric of rank correlation. The method is inexpensive, robust, and representation independent. We show that Kendall's τ correlates reliably with human ratings and reading times.

Cited by

Nikiforos Karamanis, Chris Mellish, Massimo Poesio, Jon Oberlander. (2009) Evaluating Centering for Information Ordering Using Corpora. Computational Linguistics 35:1, 29-46
Online publication date: 1-Mar-2009.
Abstract | PDF (119 KB) | PDF Plus (125 KB) 

Technology Partner - Atypon Systems, Inc.
  CrossRef member COUNTER member