Evaluation basics
Intrinsic evaluation by humans using special version of SEE (thanks to Chin-Yew Lin, ISI)
Compare:
- a model summary - authored by a human
- a peer summary - system-created, baseline, or human
-
Produce judgments of:
- Peer grammaticality, cohesion, organization
- Coverage of each model unit by the peer (recall)
- Characteristics of peer-only material