Summarization road map
Specifies a series of annual cycles, with
- progressively more demanding text data
- both direct (intrinsic) and indirect (extrinsic, task-based) evaluations
- increasing challenge in tasks
-
Year 1 (September 2001)
- Intrinsic evaluation of generic summaries,
- of newswire/paper stories
- for single and multiple documents;
- with fixed lengths of 50, 100, 200, and 400 words
- 60 sets of 10 documents used
- 30 for training
- 30 for test