Origins of the evaluation framworkSEE+++
Evaluation framework builds on ISI work embodied in original SEE software
Challenges for DUC-2001
- Better explain questions posed to the NIST assessors
- Modify the software to reduce sources of error/distraction
- Get agreement from DUC program committee
-
Three areas of assessment in SEE:
- Overall peer quality
- Per-unit content
- Unmarked peer units
-