SP500207 Appendix C: System Features appendix National Institute of Standards and Technology Donna K. Harman C. other automatic methods bnef descriptioll feedhack is l)ased on sul)-d()cuments D. Automatic£'illy built queries (routing) 1. topic fields used <TITLE>, <DESC>, <NARR>, <CON> 2. total computer time to build query (cpu seconds) 5 (average f([OCRerr]r each (luery) 3. which of the following were used in building tlie query? a. terms selected from (1) topic b. telin weighting (1) with weights bised on terms in topics (2) with weights based on terms in all training documents (3) with weights based on terms from documents wid) relevance judgmenL'; 1. eXpansion of queries usinLT previously-constructed data structure (from part I) (1) which structure? word-pair phrase tile E. Manually constructed queries (routing) 1. topic fields used <TITLE>, <DESC>, <NARR>, <CON> 2. average tilne to build query (minutes) 3()([OCRerr] minutes for 25 (jueries 3. type of query builder b. system expert 4. data used fi)r buildin[OCRerr] query a. from trijiling topic 5. tools used to build query a. word frequency list sonletinles 6. which of the f()ll()win[OCRerr] were used? a. term weighting b. 13()()le£'i'1 connectors (ANt), oR, NoT) III. Searching A. Total computer time to se[OCRerr]uch (cpu seconds) 1. retriev[OCRerr]'il tilne (total cpu seconds between when [OCRerr]`i query enters [OCRerr]e document numbcrs £ue ()bt[OCRerr]iined) 8-2([OCRerr] per query without soft-Boolean (Conll)ifle 2 methods). with " ` (coml)ine 3 methods). 2. ranking time (total cpu seconds to sort d([OCRerr]ument list) 4-12 per query B. Which methods best describe y[OCRerr][OCRerr]ur Inichille searching me[OCRerr]()ds? 2. pr()babilistic model 8. neur[OCRerr]il networks C. Whai factors are included in your raiiking? 1. tenn frequency 3. other term weights (where do they ColfiC fi-om?) inverse collection term frequency total word occurrences 9. document leng[OCRerr] IV. What machine did you conduct [OCRerr]e TRE(' experiment on? SPARC-2GS How much RAM did it have? 48 [OCRerr]1B WhLit w[OCRerr]-is the clock r[OCRerr]-ite of ilie CPU? 4([OCRerr] [OCRerr]1Hz V. Some systems are rese[OCRerr]'irch prototypes and others [OCRerr]`ue colninercial. To help C()mp[OCRerr]u-e tl)ese systems: 475 system until a list of