3. INDEXES GENERATED BY MACHINE- -AUTOMATIC DERIVATIVE INDEXING We have noted, in the earlier statement of the scope of this survey, a distinction between "derivative" and "assignment" indexing. This distinction is related directly to the question: ?~Is what can be done by machine properly termed `abstracting', `indexing', or classifying'?'1 It relates also, as we have remarked, to a continuing controversy far older than any question of the introduction of machine techniques--that between "word" and "concept" indexing, between "uniterms" if selected directly from the text and "descriptors'1 in the sense of their being1indexin~ terms selected so as to have "a care- fully specified meaning for retxieval", to say nothing of contrasts with subject heading schemes and classification schedules. Some of the major arguments pro and con derivative (usually word) and assignment (usually concept) indexing will be considered in a subsequent section of this report on the problems of evaluating indexing methods. Nevertheless, the present popularity of automatic derivative indexes of the KWIC type, while subject to all the disadvantages typically cited for all purely derivative indexing systems, does show the actuality of automatic indexing potentialities and may in fact hold the promise of solving some of the present-day problems of subject control. In this section, we shall consider first the straightforward word extraction tech- niques used in KWIC type indexes. Possibilities for modified derivative indexing by title augmentation, manipulation of word groups and use of special clues in keyword selection are then discussed, including work by Baxendale, Luhn, and Artandi. Related research and developments efforts work in automatic abstracting which lend themselves to derivation of indexing terms includes proposals and experiments by Luhn, Oswald, Edmundson, Wyllys, Doyle, and Lesk and Storm, among others. Some comments will be given on the quality of modified derivative indexing by machine. Automatic derivative indexing at the time of search, as in the natural language text searching systems of Swanson, Maron, Kuhns, and Ray, and Eldridge and Dennis, will be discussed in a later section of this report. 3.1 KWIC Indexes The development of computer-generated permuted-title keyword indexes, especially in the issuances of Chemical Titles and B. A. S.I. C. (Biological Abstracts-Subjects-In Context) has been hailed by some as "the miracle of the decade"~and "the greatest th7ng to happen in chemistry since the invention of the test tube". The major reason for the optimistic enthusiasm is the speed with which the computer can produce can produce a complete index to some specific set of books, documents or papers so that publication and dissemination of the index can be prompt and thus serve as an important tool in 1/ 2I 3/ Mooers, 1963 L423], p 3. See pp. 132-136. Quoted by D. R. Baker statement in "U.S. Congress, Senate Committee on Government Operations", 1960 [619], p. ~69. 40 maintenance of truly current awareness. For example, Herner in his 1961 review of the state- of-the - art of organizing information says: T11 am told that the American Chemical Society has never had a more successful basic science publication. The key to the whole thing is, I believe, the extreme currency of Chemical Titles. This in turn derives from the speed and simplicity of the KWIC process." 1/ Conrad reports as follows: "Reception of B. A. S.I. C. ... has been so extremely enthusiastic . . . that we are excited by the possibilities of producing permuted title indexes in one or more additional languages. The creation of a B.A. S. I.C. index in any language requires only that the titles be translated and punched on cards. Alphabetical arrangement, permutation and `type-setting' iscom~1etely automated and, for 5, 000 titles takes only two hours to accomplish. " 2/ 3.1.1 Applications of KWIC Indexing Techniques The KWIC type process is indeed simple and straightforward. The words of the author's title are prepared for input to the computer by keystroking either to punched cards or to punched paper tape. Mter being read by the computer, the text of a title is normally processed against a "stop list" to eliminate from further processing the more common words, such as "the", "and", prepositions, and the like, and words so general as to be insignificant for indexing purposes, such as, "demonstration", "typical'1, measurements", "steps", and the like. The remaining presumably "significant" or "key" words are then, in effect, taken one at a time to an indexing position or window, where they are sorted in alphabetical order. The result is a listing of each such word together with its surrounding context, out to the limit of the line or lines permitted in a given format. As each keyword is processed, the title itself is moved over so that the next keyword occupies the indexing position, and this process is repeated until the entire title has thus been cyclically permuted. A number of formats are available in which the length of the line, the position of the indexing window, and the extent of "wrap-around" (bringing the end of a title in at the beginning of a line to fill space that would otherwise be left blank) are major variables. Current examples of KWIC type indexing output are shown in Figures 2 through 7. Usually, the indexing window is located at or near the center of the line with several extra spaces to the immediate left or with other devices such as the shading of B. A. 5.1. C. to aid the searcher in scanning down the keywords listed. This is 1/ 2/ Herner, 1962, E266], p.10. Conrad, 1962 E137], p. 378A. 41 OTOLTAGE FOR TYOROGE LINOGAT ION ONRONGASESE.-- U ON TOE 0 ZPOO-0035-2030 SOLOIST SISTER IS OIUOIO-LIOUID CONOMATO00OPOI .M SOPOR O CONTENT I N THE FODDER LICHENS OF THE TUNTRA.=OASCDNRIC Ad 0002-NOR?- IRON 00011101000 I NANISOONLIGO 10-01+0100100 TOOl OUSCYSCENONO ACSO-ROIN-2200 00000 IONS IN TOE o .QAIE-PTASE DUIDOTION OF OLIFINS.0 SOLATIONS IN DIPOLOWLIQA lOS TI TOE 000000 OF MOONED IC USOTISCOSITI OF LEGAtOS CONDENS0-D IS COPILLOMEES. TOTING TI DENTATE LIGANOS. CHLORIDE OCOTYL ACITOSATES JCDR-0TNO-OANI 1150 00000 FRESSANES OF LEQOIDS.- U METOODS FOR COLCULA ONPLEAESWITHOIFFENENTLIGANTS.= SPECTRA OFNICREL III C TION RANTS OFROLECOLUNLIGA ITS. + OFTINROT ITS 005000 FTTT-NROG-3022 C ACID IN NALFII N SPENT LIQUOR. C OF 01050 SUOF ON) OS REGION IN I ONICT LIGHT TISPERNION IN ERCITON AMNOMPTI FTTT-NROG-3512 SOLON INSEWGGE-SLA0GE LIQUOM.=R OF 0000910 GOlDS ANN 00010 OFFECT OF DOYGEN ON TOE LINTT EMISSION OMODUCET NT TISSOLUTI ACSA-OTI~2I 13 CC CRYSTALS OF ZINC ANT LITHIUM 00000009 DI OYTROTES.WO SING NCE OF FOLARIZET HELIUM LIGHT ERCITEN NT ELECTRDNS.=DTEPENOE FTRT-012M-2222 ION OFALURINUR-COPPER- LITHIUM 000015.0 + OS THE FROPERT LOGGOITTRICOL OPTICOL LIGHT FILTER FOR OGANTITATITE 001591 0011-0010-0333 PLANTS. ACTION OF LITHIUM ALUMINUM HIDOIDE OS THE OF TOE RESULTING LIGHT INTUCET NT PNTTON IMPACT 15-35 PHTS-002W-IIWG 000001 GLASS TO 510000. CI DOlOR AND TOOLLOUS IONS. U ELI NCC N DECREASE OF THE LIGHT INTENSITY OF ELECTRO LURINESCE AOAH-NNIA-OISS O 0100 NESZDIC ACED 050 LITHIUM MENZOATE. =0 ATOMS OF TRITIA ALS UNDER TOE ACT ION OF LIGHT IONG.= U EMINNION OF MET IANF-0020-10N3 MOTIATION TOMOOC I NOITHIUR DOPED SIOICOS.W ELO CTNICTRECOMRINATION LIGHT OF INTl UMANTIMON ION IN NYMONG 0055000 PDOYMORFHISO I NOITHIUN HYDRIDE. TOSSIWLO LOW-P LY PANG COLORO STYMENED LIGHT SCATTERING AND RISCOSITY OF PT EFFECTS OF SODIUM AND LITHIOM UPON THE RECEPTOR ION THE SW LOTIONS. LIGHT SEATTEMING fly MIRED POLYMER NT FOOFOSES RI OH 000010 LITHIUM.M AS ISO MAROONCULAR ADDITIT TOTETMINAT ION OF TOO LIGHT SCATTERING CONSTANT OF RENZONE P00105 ROMWRODMENT OF LITHIUM .=EWETAI-l ACTIRITY INDUCED 0 IONS IN TOE CASE OF LIGHT TARGETS MOMMORTET MY HEAT AND CANNDN-12 I OIIHEUW-6.DI ODYGE~I6 FROM 3.0 TO SUNJOCTET TO 000150 NT LIGHT. U CHLORINE) OLASIEN REACTIONS CARMON-IP I LITHIU~A.FI ORIGIN-I? AND C0RM0~I2 0001001 ION NYMTDLLATCTLIGHT.--UCRYSTALS I THE CANE OF WROMIDE. POTASSEAM. 0110100. IODINE. MAMIDIAM IMPARITY TI 1001001 IN POLUNIZETLIGTT.=TTFTMIIPOOSFHO NITMILIE DOTERMINAT 10901 LITHIUM. SODIUM. TOTOSSIUW. CALCIUM. NY NOONS OF ALONG I OLET LIGHT. 0 IN TEODYMINO NUCLEIC 0010 ON CONOETIONS OF TOOT 011000001000 COOFOSITI ON AND FORMAT) UPON CORORATUS TOACTARAL LIGNIN UNITS STANIED NYMETHOOS OF P 0000000 REACTOR OF 10.1 LION 15 000001ST WET. REACTOR MITT LNYLI-2- POOPANONE FROM LI GNIS.--NY-I-IA- 0 OH EACTETITI OF PISI-TREE LETTERS. A AND RN OSYL GROUPS OF COTTON LIGNINS. OMOLECULAN WEIGHTS ANT CA ACID COMPOSITION OF THE LITER AND ADIPOSE TISSUE LIPIDS IN DOTERRINAT I TN OF LIONO SULFON IC 0010 IN SULFITE SPENT OF GUINEA FIG 01910 ANN NINNEl I N HISTAMINE SHOCE. FEATIL I ZATION. LIME ANN P PLACEMENT EFFECTS TN 000000 MI COLOOOFONM EN LIVER ANT NEDNEYS OF MOD~= H TN REACTIONS IN 000000 LIMO- ALUMINA MIOTUMES. EN TOE LITER ANT 500015 OF NICE AlIEN INTRO EFFECTS OFFENTIL liENS. LIME. UND CULTITATIONS ON YIELD. ENOGONEWEST OF DOE LITER 050 SPOONS OF THE 0120! I GIlDS 15 TOE UPRONLEMS. LIMITATIONS. ANT THE FUTURE OF AUTOM INYL FYRROLITONE IS TOO LEVER AND 900105. + AND 0001 SATU-0197-00M7 METAl. DETECTION LIMITS IN RATIATION ANT OPTICAL FY00 JOSA-0052- 1307 IEOOOYMETHYL+AZO DYE LIVER CARCINOONNESIN .M MEACTION OF JRIO-NT0R-0IOI WITHIN THE TEMPERATURE LIMITS 20-60-TOG.=T GLASSY TEOTOLITE TLWS-02-1 1-053 ON IS TOE FATE ENDS WITH lIVER DISEOSEN.= 0 ACID ONTO JWOH-0230-0060 LEAR MAGNET IC RESONANCE LINE OF ZEDLITIC MATEW.=D OF THE NUC CORE-0255-3000 SIN OF 00000 ACETATE NY LiVEN ENZIMES.W 519001 WIJO-0006-0232 MAGNETIC RESONANCE RITE LINE SHAPES GENERATED MY DM0 OMOADEN ACSO-TNIN-2212 ACID SYNTHISIS IS RAT- 01000 EATNACTS. 011000 OF 0-IMMOTEA OIFO-REGI-TE II NOGNETIC RESONANCE WIDE LINE SPECTRA. ANALYSIS OF NUCLEON ACSA-OTI~2IG9 010009 OF TOT ON 01010 FUNCTION. CELL. MORPOOLOGO. ONT JWCO-023W-GWIF N IODIDE. LINE STRENGTHS ANT WIOTHS IN HYOMOGE ICPS-0037-2E99 MOIGHO OF 001 ONES LIVEN GOUTAM IC ACID DEHYOPOGONASE IN ANIA-0102-OI IR HAGNEDIC RESONANCE LINE WIDTH IN GANNET ANN SPINEL TYPE GATOROTION OF TOE LERCO 00100015 TEIEOWENGTION.= WIJT-00W6-0365 ORGANIC ELECTROLYTES I NUNEAR ANT CIRCULAR CHROMATORMAPTY CASM- 0007-0909 5100050 RI FEMALE-MOD- LITER OOMOGESATE.- WOPO-OTI I-El IS N-RUNODN DEGRODATION OF LINEAR CHAIN MOLECULES.=TOFANO JAFS-0017-INIA TN TUITATIO WY LIVEN HORNOENOTES ON METOCHONDWEO OF JWCO-OZ3~NG7O 0050DM DEGRADADION ON LINEAR CHAIN MOLECULES. TON THE NO FHOSFOOMILOTION I NLITINWITOCHONTMI AFROMOIOTOOISECIT JMCH-023M-NGOV TOE ANTI F ERR DRAGNET I CLIHEAW CHAIN. 0 SPECTRUM OF PHMT-012W-2131 EADMISISTRA lION I THE LITER OF ROTS ANT WICE.00 WY ETOONIN TEW-TISORTEN THEN NY FOR LINEAR COLLOIDS. = OW JCFS-0037-2323 ALDERAT IONS IS THE LIVER OF 00111 ROTS UNDER TOO 1510+0 OF IRE COEFFICIENT OF LINEAR CROONS ION OF GLASSY PLASTICS. FLWS-02-l 1-036 AT 1 0010 1005SF INANE IN LIVEN PORTICLES. =OOFGLYCENOL 000900 OF TOE SPECIFI CHEAT OF LINER N POLYMERS AT LOW TEMPIFRATUWEN. TANE-01G7-NNWO FOOl FATTY ACITS AND 01010 PATHOLOGY.. EFFECTS OF 00050+1 INTESTIGATION ON THE LINERNITY OF THE TENT CURRE FOR THE FROTUCTITS RI HOMAN LITER SLICES IN TITNO WI AN INWUNOOR COANGE OF 01391- LI SEN ANT THE TALUE OF THE INITIAL FMMT-TNIG-ONAN ANT OUTYORTE NI SHEEP- 01000 SLICES. =oACETATI. OROPIOSATE OF SPECTRAL TYDATOEN LINES I NAPLANWA .= ANYMMET DANE-N 107-0302 ACTIVITY I NEITNEI ANT LEREM TISSUE FROM STARRED 090 FIN EAROPIAMIIIII 101551 ON LINES IN EUROPIUM TI WENZOYL METHANE JCTS-0037-2333 00011 MI TNONSPOANTOOLOOETNOTUWOMS.O A CHOONT MOTMOTO SITIES OF THE MANGANESE LINES.=SOF THE DIFFERENCE OF TOE TEN WOIONOLISM ES DISEASED 01010.0 SEOTTONIN OFLINNAGE.=RCOMPOONNSMITHACLNNED GA DANE-01G7-0030 THE OETOLOPMCNT OF 000 LITER. ARCOITITY TURING ONETHYLEN I C LINEAGES. ANALYTICAL APPLICATIONS. CHAL-TOGG-NGN3 0111 15 MOOSE ORAlS ANT LIVEN. 0 ON GOOTOMINOSE 0001 INHINIDION OF ENERGY- LINRET TI OHOSPHO PYWITINENUCLEOTIT JWCH-023M-OGGN STESOISGO TRACT ANT THE LIVEN. 0 ONION IN THE 009100 1 ODD SUMNER OFRONOME RI C LINEN. FORMED IN THE THERMAL POLYMER StOIC AEON I N MANMALIAN LIVER. A lOOM 3-HITODOIANTHRO NOACOTISTLAT ION OF FU=ELINOLENO TO OS ITS MERCUWI C ACETATE A JATC-0039-RNI 7 AL 050 FRICANCEROUS OAT LITER. = 001 AMINO ACIDS ES NORM CRANED FRACTIOSUTION OF LINSEED TI L FATTY RObS. COMFAWATIT I `JAC-0025-0053 IN 0000101 ANT 01910910 LEVER. 0 5-TYDRORY- TRYFONPOAN ETITIDY OF LIFT PROTEIN LIPANE IN TORI 005 TISSUE NL ICES.=T A IWO 5000110 ACID OF ROT 0100W. A NUCLIOTIDES OF 5000000 0 0010 ACT ION OF FF09000 LIPASE ONAMAST. CELLS. DR FOR THE ACTITA 0105 OF LETEO-PIMUVOTI 0050050 SYSTEM RELATE FUSE I NTLIFDPWDTEINLIFGSE. 000101 DY OF LIFT PROTEIN LI INSO-OROG-OlON RIO SUMNER GREATETHOOF- CITES OF FIRST 0001010 2+STNTISOTO TOENIDEN MY PANCREATIC LIOGSE.--AENZYM IC HYDROLYSIS OF N I NOTON GAS EUCOASGE IN LIVING ANIMOLN.T S OF INOMA FOLMONAR I INTOSTINALTFTDSOHOL IPID COMOOSITI ON ANT TONNOTON IN MA IC 0 000000 HORMONE ONTO 000 DING IRPEMIMESTNNITHOORNNO COOT LIPID COMOOSITION OF TUMOR CELLS. 05010 HEATING AST ONDEM LOODENG.= 0 OF OOPPER-NICEIO SYSTEM FVDI-02-EI-017 OFOANOL 1051005 15 LIPIT EDORACTS NY `THIN-LAYER CHROMAT ON NY FOTOZOLIC REDIUR- LOAMY 50105.0 0 TROPERIIES OF S NCSJ-0035-NRZO ON OF AN ORGAN SPECIFIC LIOIT RATION IN RRAIN.=IIOENTIFICATI TI DZOOININDIDNCN.M NI WLDCOLOSONSTOETICS.0 +-ANYO-2.G-T JTMS-NNSl-I 160 SOCROL ANT PHOSTHOL IPID IN CEMEMMO SF1 NAL FLU IT ONE OF NEATERIUM 00100 TN LOCAL ASESTHOTI COCIIUITY OF TROCAIN ZMLD-62- 11-055 RE OF CERTAIN ROCTENIAL LIOIDEN.--T RELATED TO THE STRUCOD NONEGNINO FOONACTION OF LOCAL FERTIOIZERS.= NISOORCEN FOR I ANT ROTH ITNINE ON SONAR C lOINS AND LIFT PROTEINS. O NI OSOSTHISIS I SlOE 100000 1200105 AND 900 ROES OF INOOGODS OF POLO SACCOGA IDES LIPIDS AND NUCLED PROTEINS OF THE N ISTERTOSE TN SOLOWLIA LOCALIZOTION OF ACTION OF 0010051 ON IRWO-ONI 0757 RETUTOLISM OF PHOSPHOL 101 OS AN FUNCTION OF AGE ANT UNDER IN 101 TRESESCO OF 0000001 APPLIED TROPS OF A 010010 JOWA-0OW~IIS2 IDENTIFICATION OF LIPIDS IN OLOOD THRDMWOPLASTTN.- TIN-RINNING SITES. 00000105 050 MOLE OF STENOLOOSYSTA JONO-NONG- 133W- ERYTONOCYTO FEOSPHO LIPIDS I N THE NERRORN INFANT. OCIOTROPIC CARWOHOONOTE LOCUS I NSTAPRYOOCOCCAS AANOUN.0+O F CUSC-0031-OSIW ANT ADIPOSE TISSUE L lOINS IN THE RATS RECEITING 000010 INSOCOICIDAL CONTROL OF 0000509 OIAENIGLSTRAYING.= WOlF-ROt ~O333 RYO-INDNITOL POOSPOOL 10100 OF RYCO NACTEMIAM TUWEMCULDSI OW OLANTITATIUE EWISSIO OOGANIDHMICAO OPTICAL LIGHT 110110 F lION OF ERTTHMDOSPHINGOL 10109 SERIES. SYNTHESIS ANT WESOLA S ES ITALIAN 01100099 I OOOIOMMUOIIFOOOAMI.=+MELGT IONSHIF JAPS-OT 17-100W INOTOSE FROM NEN-CLOTER LIPIDS WITH ASTHRONE.=S OF SULOHO NA DETECT TWSINTATION OF LOWER DISLOCATION IN GERMANIUM CRISO JCPS-0037-2G21 HATE INTO MITDCODNTRIAL LIPtON. U INCORPORATION OF TOAST FOLOGIZONILITE ESASDSODSGITUTE 500 AND 10099010SE ELECTRON SEPARATION OF LIFT POLY SACCHARITE AND WACO 000010 JWCH-N23~0026 OYSTERLSES LOOT OF COWOLT-NI 1010 FIRRIONS.- OF LOW-TENSITY LIFT PROTEIN IRWUNO PRECIPITATES IN Altos INTENOCTION CDNSULORESTZ PARAMETERS AND RIWNAT ION-NOT LIPANE. ACTIRIDY OF LIFT PROTEIN LIPASE IN VARIOUS 01990 IGSN-UOOG-N1NS AND CHRUWIUM IS LOW 00001 STEELS ANN STAINLESS 51110 TO PROTEIN LIPASE IN U LION PROTEIN LITASE. ACTIOIYY OF LI IOSN-TOOA-0105 00150-131 IS WITCHES ON LOW ANN MODERATE FAT 150000.0 0 1 CONCENTRATION OF ROTA- LIFT PROTEINS AND PROTEIN CORFOSITID LAMN-OM-II-017 I YIELDS.O 1111019 OF LOR DOSES OF GAMMA WODIATEOS ON PLAN 010000 FLOTATION CLASS LIPO PROTEINS AS THE CAUSE OF THE CCOT-00O7-0072 ISlAM-ZR )F.P~GOM0AIOT LOW ENEOGIOS. oIMOCOAN ISM IN MANS SOLEOOSIN IN RANNONEDO- LIFT PROTEINS IS CHOLE STEM DL 000000 LAWD-OW-I1-025 INELASTIC SCATTERING OF LOM ENENGY PROTONS FROW 5105-20.0 FOG TETONMINATION OF LIPO PROTEINS OF OLOOD SERUM NY LARD-RN-I 1-021W 005-3! IF. GAMMA! SALFUO LOW 150051 RESONOSCES ES 000 0009000 RD FOR DOTERMINAT ION OF LIFT PROTEINS OF OLOOD SERUM.-- MOTH LAND-NM-I 1-0210 GLANDS = EOTNACTIDN OF LOW MOLECULAR WEIGHT 0001110 TROOHIS ISO ONSERUOL 101 OSANOL ITT FROTEINS.= H AND ROTH ION P91W-NI I 1-0579 ID FROM C.TISOLGTION OF LOW MOOECALOM WEIGHT RIND NUCLEIC AC ACTIDIIY OF ADIPONIN. LIPOCAINE AND FOOLOCOIN IN THEIR PEGT-00-0A-037 RIZOTITS OF 00010051 AT LOW TRESSURIS .0 METHOD FOR ODLIME 1000000 NT 0100W! 0 ON LIPOIOS 090 OLOOD COAGULANILITY IN EORTEOASACOOSI OF LOW MIS! STANCE OF 100 NEMOOWN AND GOLD SENSITIZAI ITS OFALITFOAN ORALS ION. PROfiLER OF TOE ZNFF-0007-NNRS N THE' U ENFLAESCE OF ROOM SODIUM DIET ON TYSON IC 1005015 1 NCR ROOD TO FOR STORING LIGUEFIED GASES. ENE~TOI5-O997 OELINOS WITH CGOSIICULORTEMPOAOTUNIAGGOONIRATITS DI SEP TYL ETHYL OCTANE IN THE LINA I N AND GAS PHASES. +01 WOO ENET-0020-ORGO 050 0 001009 FROM THE LOW TEMPERATURE NUITOIEON OF NIONIUM FOWl-ON) 0-0750 INFRARED SPECTRA OF LIQUID ANT SOLID CANNON MON 00101. EFORWCOALUMI0NATOMC OF LOW TOMFENATAMOTRONNFOOWOTIONS IN N NRNN-0107-ONWO TOE CASE OF STIRRING OF LIGAI DANOSOL ID FRASES.OIACT ION IN OF LISbO FOLIRCRSOTOOWTEWTERODUWES. TINMADION STEETWA WC9J-N03~2NA0 ITT OF NEGOTITE IONS IN LIQUID ARGON. 0000005. OENON.=AMOMIL 0010 TOLONCE FOR USC AT LOW TEMOERATARES. 0001 MANN EOPCRIRENTSWITOGOS- LIQUID NUNMLORS.= ON ODMIATARE NUCLEI AT LOW TORPIMATAMES. =MOSSROAEO EFFECT JUPS- 00)7-1801 C GCIOS-TOEIR FNEPGRATOLIGU ID C-IN SOTARAOEDWRNDCAMRTOYLI NOATIOS I NMONSISI AM AT LOW TIMPOROTURES.0 ULTRA SONIC OTTO JCPS-0037-2G96 0000010 CONOUCOISITY OF LIQUID CANRO~NI COOL ALLOYS.=E AND I TIDLISIS OF 5-010050 AT LOW TENFORATAMIS. 0001001 IONS IN AG NOSIER IN LIDUIT- LIQUID CONOMATDGMOOHY.R SEPARATION 0100101 INCOOSEONS EN LOR-COONOS OIGALCHADRIUR 90110.0 ELECOMOROTITE FORCE OF LIGGI TEOUFLES .= TOENMO REFINED 1000 LOR-CONCENIROT ION ORES OOSTOISING CLCH-0O00-0616 AS CANNON WLACE. U LIQUI N CRUDE FOR OWODACTION OF ORSON IPITOTENOESTEWGT ITS OF OOM-OENSEOYO IFO 0000115 100050 PROC JCPS-003?-ZS?I TI 9009101 OF LINAID TOUTERTOOTHANE. OF NEGOTIVE VYDROGENHLOM-1NOV01 COLLISION CROSS SECTIONS JCPS-0037-2097 TURING 101 0100190 WITH LINA IT TI TOLYL METHANE. OF 000100009 MI 000-051001 OLICIMON IMPACT SFECTROSC 0000-OIZN-2352 O EFISSION OF METALS DO LIQA IT DIELEETMICS. FOOT 001001 TISTOIWOTION EN LOM-INERGY ELECTRON- PHOTON SHOW IRS JCFS-0037-2?2? ICICLE PROCESS. SOLID-, LIQUID EOUILIRMIUM OF CW-AMOMATICS.= 000000 OF ESOIAM. LOM-F01001N010ODI1C10I000TIE50050 CROW-00EO-OOMR OF TOE LORWOR FOIST OF LIOUI N HELIUM I N THIN FILMS AND MIOSIC CONOE0TEMSITTDLOO-FNNOUESCI OSCILLATIONS IN A THEN NCNJ-003~Z0GS SF00111 CHEAT OF LIQUID OELIAM-3.= GONIC COW FOUNT S ASINOOLOM-LETCO SEAT RON SOURCE. 0 IN ON FRESSORE OF OEL~UW-3 IN 01001 THCL1O~N. RIOT PROPOSALS FOR PORT-NI -lOOT TEOlONOLISIS RATES TI LOW-MOLECALAR-RII GOT ALEONESOLFONIL ATARI 050 FOES NOFLON OF LIQUID HOLIURIIII UNDER LONOF TEMPER NINNITE.0 FOSS) 001 LOM-PWESSURO FOLYRORFOESM I SLEOHEOW OS IN TOO WADI OLYSIS OF LINUID HYDMOCANWONS. S RADICAL YIEL IJAR-ONI 3-0093 OF 0100050+0 OS OAFTIOLOW~TEMPEOATUMN 00100111 C TREATMENT. ONTENSAT I ON AT TOE GAS- LIQUID INTERFACE.= FOLIO 0110 DI COLOR) DES FOR LOW-TEMPIROTONE TEWOUISO OF OILS.. OF OYDROGEN IN LINAIT IRON WELT TOE MOILING POINT. DOSE-O!N7-R6~W OOW-OEMPEMOTANE POOIMENEZATION OF ND NODE FTONPOORIZ=TION OF LIQUID IRON. EFFECT OF PHONFOORUS 0 SOTG-001A-031E I OFOLIAM IN TOINFIOMTLOWEOING DI TOE LAMOTA 00150 OF OlGA EACOITITY OF 001005 IN LIQUID I NSO.=OOFTODNFODMUS ON OH SRTA-RT10-0316 0.7-At REOTIL-0-RIWEDYOOAMOTINE0NDEM ANAEMONIC CONDITION. AS. WYALANINOTHEMWY OF LEGAl TRANGANOUSSLAGS .=TFTOSTOOM OS COFTEOIIT OUIDEOORINESCCNCE 050 OOECTOOCONDUCOIVIOY FARIFICATION OF LIQUID FANAFFINS WITH 51000 ETHANE.= 0110-07- 12-ROE S TOE CASO OF 0 00010 LOMINISCENCE ANT VONIOUS OHENDRENO I COROLTATE 1111 ION. LIQUID PROSE OYONDOONOOION AND 0000W JElL-NON 1-0000 HI INTOSSITI OF ELECTR TOORINENCENCE CELLS. TOFOTEL tO NSOITTMLTALLICSOLTULIQU IT P0050 TOITATION OF OYTNOCAMWO TOSH-00N7-0573 00100 100101- + FTDTOOORINISCENEIIOCITAT I ON SF11100 OF S 009000 CATALYSTS ON THE LIQO ID PHASE URINATION OF 0-NYLENI. TESH~0NS7-OS73 TOY LOMESESCESCO FROM COTTONTERTILIS.- STATE OF THE +0000 ANT LIQO IN PHONES IN PRODUCTS OF THE UFZH-0007-1 136 DCCUNOENCEOFEOECTROLURINESCENCE IN ZINC SULFIDE 915001 ELECTRIC STUDY OF LIQAI TSONICONOACTON SOLUTIONS OF JCFS-0037-20?? F + 500000 00505 OF TOE LUMINESCENCE OF 000000 0000101 050 0 NITTOUD CHANGING TOE IR LIOUI 091010 CDMOOSITION.= MIOF-ONOP-O?25 SOOIOF 100101- OO-NOIOOMINESCENCE DI ORISOALLO P00500009 101 OF TELLURIUM IN THE LIQUID 50000.0 DONS COME-0255-3006 OF +01005 ON TOE 101000 OAMINCSCEGCC OF ERRAOEATED POLl FOLA-0271-0170 50100 01N00T0101 IN THE 010010 51001.0 U OF THE ALLOY I FONT-RN! G-07R7 LONE 090 OOOEROTOORWOLOWINLSCENCE OF IRNOTIODED POLIETOl ITVT-0ROS-3630 OIL POLNYL NET 00101 IN 010010 SULFUR DI OOIDE.=TOF CICLO NE WCSJ-RN3~ 1006 1 OF DEFECTS IN EUCITON LANISESCENCI OF WOLECOLOR 00151+05. JCFS-003?-2VI 3 ROLl APOL lED TOOTS 010010010 SURFACE-ACTITE METAL =001 LOC FMMT-O010-0757 FULOOEZATIUN OF 1+1 LONISESCESCE OF TRANSFER MEIMEEN GAS- LIQUID SYSTEMS AND THE TEAT 00000500 2FNO-0T3~2S7R IAN S TEODINGAISOINO TOO LOW) 51901501 DI 215090011 UELAMINOF 000010 TIES OF TOE LIQUID SYSTEMS ARGON-METHANE AND FHYS-002W-II9I 0015100 S.DFHOTO ELECTROLORINESCCSCE OF ZINC SULFIDE SINGLE AFA~0OI0-0IIS O SYSTEM LIQUID- LIQUID RIOT HA MIDAS CONCOSTNAO IONS ZONO-0035-2020 CRYSTALS. IOEOTNOLOMI51NCESCE OF ZINC SOCIETE SINGLE RCSJ-0N3~2OSR LORNOOTROSS I 50010W! OlGA ID. TN 5CR001MINO OF N NUPH-O0G~OT3R FTOROOC.0 CHORE LUMINISCISCI OF 2.3.4.9-10000 000510 Figure Z. Sa~p1e Page1 Standard IBM Format 4Z NSE OF THE EAT TO TOTAL ORTALESEENSIS" HENSELAP COUCH TECHNIBURI WHOLE RATS UNDER COLD STERNAl CYLAURS UN ELEVATION OF HIP TB RLOO~ PEESSURRI ONMENTAL TEMPERATURE OR REREITI ENVIRONMENT ANE RLAENOPTILUS-NUTTALLIII ANBES AFTER EBEACISE IN ECUTANROUS, MUSCLE, AND TRIN AND AN INCREASE IN ATIONS BETWEEN SOUL AND VIBRATION ON THE ANIMAL NETWORK OF THE VITREOUS E VIRUS INTO THE ANIMAL S IN VIROIN AND DRAINED THE TAREBACUM PLOER OF TAETUM-SCHULTZ FOUND IN F AUTOARNOUS FROZEN AND E NETHE B OREL" CAMFINE STA RENORS OF CHILE AND MANCUALE PLANT FLORA OF B BY ATOMIC OR HYOROORN CROAK OF CERCOSPORRE OF CIRN OF ALTERNARIR FROM ERRANT CANCER IN ONS ON THE NUTRITION OF BACCO MOSAIC VIRUS. THE ETERMINATION OF PEPTIOR BONE FROM HETEROGENEOUS O THERAPYI RADIULOBICAL AND TO THE INCIDENCE OF ULPHRTRMIA THE CAUSE OF NOICATIONS AND REAULTAI ZEN AND BOILED CYLINDER K RUNE TO CULTURED CALF NE FEVER VIRUS IN S~INR ROHO PHOSPHBTR-F"32" IN INO AND OF INJECTION OF LENTATION OF HOMOLOGOUS RATION OF THE THEORY OF S. ABSORBED DONE TO THE UN OF STORED AUTOLTGUUN F THE BLOOD PICTURE AND IMMUNITY RESPONSE AND IMMUNITY RESPONSE AND * IMMUNITY RESPONSE AND * IMMUNITY RESPONSE AND TE ANTIEBOIRS FULLOWIND UNDAMENTAL SUBSTANCE OF NYALLY INJURED ALVEOLAR ERALIZATION IN ERCHITIC ETAROLIAM OF GLUCOSE RU OSTEOMA OF THE FRONTAL NCY DURING LACTATION ON CONTENT OF HUMAN FINDER MARULANDI THE ATLANTIC BLOB PLUMARIA-ELEORNA" TO GENESIS UP SCALES IN B RELATIONS BETWEEN THE OF THE FEATURES OF THE BIRD AND THE ARO-FOBTED I ANTIGENIC RESPONSE TO MINIMAL SENSITIZING AND OPLESMIN. THE EFFECT OF AGNOSTIC AND PATHOGENIC PLANTS UN THE NORTHERN SENSITIZINO ACTIVITT OF HE CATALASE ACTIWBEY OF ARNOFLIES AND ARNOFLY IN THE STUDY OF TARTAR O MANAGEMENT PRACTICESI U MATTER PRODUCTION AND INDO SOVIET OLTONII, NEW SPECIES OP ORRENCE OF THE NOOTHERN NURININO THE BORLIUT OF THE BLOOD SERUM DURING N CRERAGEI ISOLATION OF ACID" EDUA"l REMOVAL OF AJA-LINTEA-FRIES AU THE OF A GLYCO PROTEIN FROM HUMAN TORERCOLDAIS FROM ANAPLASMA-MARGINALE IN DAIS AND PROPHYLABIS OF ESPERIMENTAL EVATIONS ON IMMUNITY TO ANIMALS NEOTRALISING A IC RELATIONSHIP RETWERN IDNI FURTHER STUDIES OF NIB VIRUS PEOPAGATRO IN RITOL, A CONSTITUENT OF ART CHARACTERIZATION OF GYI INFECTIOUS -MOUTH DISEASE VIRUS IN OBSTRATE UTILIZATION IN -MOUTH DISEASE VIRUS IN TYIC TEST IN CANINE AND NCR AND DISTRIBUTION OF STATISTICAL STUDIES ON SWEDISH STUDIES ON MICHIBAN. PATHOLOOTI BIOPSY OF THE EXPERIMENTAL VIRAL TION AGAINST CONTROIDOS RDWTH OF RR.-ARDRUOS IN ED EFFECT OF INFECTIOUS VIRUSES AND INFECTIOUS FECTION WITH INFECTIOUS IDNI PRECIPITATION OF U SUESTANCES PRESENT IN MISSION AND ETIOLOGY OF APHYLOCOCCII STUDIES UN CARBONIC ANHYDRASE IN A MIND ACID ANALYSIS OF A OW FOE FERUHET CULTURED RENTIRTION OF HUMAN AND BODY BUOY IR RADIATION~ EFFECT OF THE DES 4427 BOOT SIZE AND TEMPERATURE SENSITIVIT 4332 BUOY SUPERFICIAL IR RADIATION WITH S 4390 ROUT TEMPERATURE AND WORK DECREMENT 4335 BUOY TEMPERATURE DURING EXERCISEI EF EUSA RUBY TEMPERATURE IN PACIFIC ISLANDER 7242 BUOY TEMPEBATURE OF RARRITI ENVIRONM 6343 BUOY TEMPERATURE. INFLUENCE OF ENHIR 4343 BOOT TEMPERATURE, OBYGEN CONSUMPTION 4305 BOUT TEMPCRATURES AND HEART RATES OF 4325 BODY TEMPERATURES IN ANESTHETIZED MA 6341 BODY WATER AND HEAT POLTPNEA IN DUOS E327 BODY WEIGHTI CHUNGES IN SPIDER WEBS E492 RUDY. ITS PLACE IN PSYCHULDOICAL AND 4073 VOOTI DADA ON THE CUMBINCO EFFECT OF 4451 EDDYI EAPERIMENTAL RESEARCHES ON THE N941 BUOTI THE PATHOGENESIS OF HOG CHOLER 7341 EDOSI OESERVATIONS CONCERNING THE MI 7563 VUHOSLANI 74NE ROHUSLAN, WESTERN SWEDEN. SOME NOTES 7644 BUlLED CYLINDER BONE GRAFT REPLACEME 4407 BOLGE"I PALYNOLOGIC RESEARCH IN THE 7E7B BOLIVIA. DIATOMS" BACILLARIOPHYCEAR" TARE RULSHUI LTAKHUV INLAND NOVOSIBIRAKI 7454 RGMR EAPLOSION. EBOID-CHEMICAL ANALT TAUT BOMEAT STATRI CBNTRIAOTIONS TO OUR K TS9R BUMRAY-MAHARASHTBAI A NEW APE 7604 BOMBATI 7100 BOMRYCILLA-AARAALUS IN CAPTIVITY' DR ESEB BONDS BETWEEN PROTEIN SUBUNIYSI ACTI BASS RONOTI THE BIURET REACTION. CHANGES 4124 BONE BANE IN THE DIAPHYSEAL OSTEOSYN SAVE BONE CHANGES IN CUNHINGS SYNDROME AN 5093 BONE DISEASRI METABOLIC STUDIES IN A 5097 BONE GYSIRUPHIES IN CHRONIC RENAL BE SEAN BONE FROM HETEROGENEOUS RUNE RANK IN ABBE BONE GRAFT REPLACEMENT IN FEMURAL DR 44E7 BONE IMPLBNTATIGN IN DOGS, THE VESPO 5E94 RUNE MARROW AND EUFFY COAT CALOURESI 1419 RUNE MARRoW CELLS IN VITRO. EFFECT U 4433 RUNE MARROW CELLS ON THE EFFICIENCY 4444 BONE MARROW DURING ACUTE RADIATION S 4420 RUNE MARROW GRAFTING AS TREATMENT OF 4470 RUNE MARROW IN THE RAT AND THE MOOSE 4414 RUNE MARROW IN THE TREATMENT UP ADBA 4479 BONE MARROW OF ALBINO RATS UNDER THE SETE HONE MARROW REPLACEMENT. B SYMPOSIUM 4479 BONE MARROW REPLACEMENT. B SYMPOSIUM 4470 BONE MARROW REPLACEMENT. A SYMPOSIUM 4465 BONE MARROW REPLACEMENT. A SYMPOSIUM 4431 BONE MARROW TRANSPLANTATION ANBEB CO EASE RUNE MARROWI EAPERIMENTAL INVESTIGAT 695B BONE TO CULTURED CALF BONE IMPLANUBY 5094 BONE. ALPHA RADIOGRAPHIC AND MICRO H 5902 VUNEI AERORIC M 5079 AUNEI USTEDIT 5092 BONES ANO TEETH OF RBTS~ EFFECT OF T 5904 BONESI THICKNESS OF THE CORTICAL LAY SETS BONITO, SARDA-SARDA, IN NORTHERN CHE 4647 BONNEM" SCHMI THE EFFECT OF LIAHY ON 7544 RUNT FISHI THE ON ESOB AUNT LABYRINTH AND THE CAUDAL CRANID 4495 AUNT OREITI A STMPLE DEMONSTRATION 4499 ROURTI TEMPERATURE REGOLATION IN THE 4325 BOOSTER DOSE OF DIPHTHERIA AND TETAN 7073 ROOSTER OUSES OF THE TISSUE ARD NERO EROS BORATE ION ON THE UXIDASE ACTIVITY 0 4542 BORDERLINES RETWEEN HYPER DENSIVE DI SAAB BORDERS OF THE SAHARAI WATER ECONOMY 7707 EORBETELLA-PERTUSSISI A NEW METHOD F 4575 BURDETELLA-PERTUGSINI SOME NOTES ON 4449 VURNE DISRASESI 7131 BORNE DISEASESI RECENT ADVANCES 7144 BOTANICAL COMPOSITION OF PRAIRIE VEA 4550 BOTANICAL COMPUSITIONI EFFECTIVENESS 7909 BOTANICAL ERPEDITIONI 4203 BOTANICAL NOTESI TAUT BOTHIDAR IN THE MEDITEERANEANI ARNOD B520 BOTTLE-NOSED WHALE. HYPEROODON-PLANI 5562 BOTTLED MINERAL WATEAS/ METHODS FOR 7552 EDUILLAUDS DINERSE AND IN NORMAL INO 49DB BOUND ASCOERIC ACID" ASCURRIGEN PRO 0115 BOUND NUCLEOTIDE AND CALCIUM OF 0- A 4R24 BOUNDARY RETWEEN THE NORWEGIAN AND U 0555 BOVINE ADETAI ISOLATION NT'S BOVINE BACILLI." ITS RELATIVE FARBUE 4909 EOVTNE RLUOD PLATELETBI STUDIES IN A 5291 BOVINE REUCELLOSIS IN THE DEPARTMENT 7370 BOVINE COCCIDIOIAOMYCOSIS~ 7417 BOVINE CUTANEOUS PAPILLOMAUOSI~~ FUR 7442 BOVINE ENTERO VIRUSI A SURSTANCE IN 4532 BOVINE ENTERO VIRUSES AND INFECTIOUS 7431 BOVINE ENTEROVIRUSES. TENTATIVE ACHE 7266 BOVINE EPIDEEMAL CELLS/ ANTIORNICITY 7444 BOVINE PORTAL FLUIDS WHICH STIMULATE 7452 BOVINE GASTEINI PREPARATION, ASSAY, SiTS BOVINE KERETO CONJUNCTIVITIS. ETIOLO 7391 BOVINE KIDNEY CELL SUSPENSIUNSI BROW 74S1 BOVINE KIDNEY CULTURE CELLS INFECTED 4909 BOVINE KIDNEYS AND BLOOD AS RELATED 7392 BOVINE LEFTUSPIRONISI EVALUATION OF TUNA BOVINE LEUKUSIS IN SWEORNI STUDIES U 7443 BOVINE LEUKOSISI 73EV BOVINE LEUKUSISI 73B4 BOVINE MALIDNANT CATAREHAL FEVER IN 7279 BOVINE MAMMARY OLANDI T2RB BOVINE MASTITISI 1344 BOVINE PEEl PNEUMONIAI NOTE ON INTER 7445 BOVINE PHAAOCYTES~ THE CHEMICAL RASI 7452 BOVINE RHINO TRACHEITIA VIRUS AND PA 734B BOVINE RHINO URACHEITIS VIRUSI SEROL 7431 BOVINE RHINO URACHEITIS VIRUSI THE R 7337 BOVINE SERUM ALBUMIN BY THIOCYANATE 4791 BOVINE SERUM FOR FRESHLY CULTURED RD 1441 BOVINE SHIPPIND FEVER' STUDIES ON TV TUAT BOVINE STAPHYLUCOCCAL MASUITIS 1. CM 7413 BOVINE SURMABILLAET GLAND EBURACTI 5913 BOVINE SURMADILLARY MUCOIDI BUANUITA 5912 BOVINE TUREVCLE RACILLII STUDIES OF 7441 BOVINE TUVEECLE BACTERIAl NEW METHOD 4944 SERUMS PEON INTRADEEMAL OS, RESULTS OBTAINED IN FERENCE TO STRAINS FROM CCI ASSOCIATED WITH THE DOERS ISOLATED FROM THE CHARACTERISTICS OF SOME THE MECONIUM WITHIN THE ATIVE STOOTI METHODS OF R WOOD USED FOE STORAGE OR OF SEVERELY RETARDED NO MASCULINITY IN TOUNO VERY OF THE VICINITY OF TIMOLATES THE GROWTH OF EMETUM MELIANTHEMETOSOM DISEASEBI ORLITERATIVE CHRNG,-1941" TREMATUOR. S AND EVOKED ELECTRICAL BEHAVIORAL EFFECTS AND URIC ACID" GARB" IN THE LIPID BID SYNTHESIS IN OP NOR MORPHINE IN RAT CONDITIONS OF THE BLOOD l THE INHIBITION OF RAT N OF SUBSYRATE-SPECIFIC E MORPHOGENIC ACTION OF F P SUBSTANCE AND OTHER STEERSE ACTIVITY IN EAT SEA FOLLOWINO AELECTIVE ON THE LOCALIZATION OF TATUS OF SEROTONIN AS A STUDIES ON ACI~SDLUBLE AND LACTIC ACID IN THE ACID COMPOSITION OF THE ND AND OF KIDNEY DURING -PHOSPHATE LEVEL OF EAT ICOLAE-FbRMATION OF THE MENTAL ABSCESSES OF THE LIOSIDE IN MATURING EAT OS IMPLANTED IN THE EAT VOGEN METABOLISM OF THE OLLOWINO LESIONS OF THE ONDING FRETS OF RARRITI W NEURONS FOAMED IN THE VERAL ELECTRODES IN THE THE PRESENCE OF BUNDLE REVERSION OF BUNDLE El COMPLETE LEFT BUNDLE BILATERAL BUNDLE IC STUDY OF LEFT BUNDLE K BLOCK AND LEFT BUNDLE OF COMPLETE LEFT BUNDLE SUBJECTS. EIGHT BUNDLE C SOEJECTS. LEFT BUNDLE MENTAL BILATERAL BUNDLE OF INTERMITTENT BUNDLE COMPLETE RIOHY BUNDLE ROIDOKAM IN LEFT BUNDLE INCOMPLETE LEFT BUNDLE SYNTHESIS OF NOVIUSE, A BETWEEN UNSATOEBTED AND E METABOLIC FUNCTION OF PORT ON FLOOKIOBTION IN -1595"-DUWSDN,-1939, IN PANESE PEOPLE LIVING IN PLASMOSIS IN SA~FAULD, F THE FLUKE OF S"UTHERN WATER RELATIONS OF SOME ~DOKEl. ISOLATION FROM INO SPOIL AND MAY 19441 IC LESIONS IN THE BROAD ISRI OF EXERCISE END O"2" ON CRERTINE TREATMENT UPON KIN OF THE COMMON SOLEI GITAL PEESSUKE AND DEEP EFFECT OF 0"2" BYSTEMEC EFFECTS AFTER URONG POSITIVE PRESSURE P AS RELATED TO SEASON, THE DISPEESION AND THE LEAST TERN' THE BATIONSOF THE CHOICE OF SE FREE" PATHOGEN FREER LICATION OF GENETICS TO CAL PROBLEMS IN LUCERNE K HYBRID FORAGE SORGHUM FLORIDRI AUTUMNAL TAMIC ACID FORMATION IN CAL COMPOSITION OF SAKE DUPINGI STUDIES ON SAKE WATERI STUDIES ON SAKE MONO COMPONENTS OF SAKE CE BY ELECTRONIC MEANSI THE CURINE PROCESS FOR K RESPONSES IN A SIMPLE A DEVICE FOR FERDINO OF PLANT PHYSIOLDOISTS, OF PLANT PHYSIOLOGISTS, OF PLANT PHYSIDLOGISTS, ULE WITH HIGH MOUNTAIND THE GENUS ASELLOS IN CIES OP LITEBISID NEW TO N POTATO CRD"S IN OREAT MAN-MADE ACTIVITIES IN IZATION IN THE HANDS OP IN THE WEST INDIES AND BIOLOGICAL FLORA OF THE RIOLDAICAL FLORA OF THE ABERRATIONS OF HOlES, THE GUIAMAS, AND YTILUS-EDULIS-L. IN THE CLERDUIC LESIONS IN THE OF THE DISTRIBUTION OF F ISOLAYED FRACTIONS OF RAIN DIFFERENUIATION OF UWO VARIETIES OP AWOOTH DL STUDIES OF SOME WEED A PROURO LYTIC ENZUME, SPECIAL REFERENCE TO S- BROMO B 15 BOVINE TUREECULIN REACTORS AND NONTO 7490 BOVINE TUBERCULOSIS WITH AN ANTIRIOT 7499 BOVINE UDDER. PATHUGENICITYI STUDIES 7410 BOVINE UBTERI A STUDY OF THE SUAPHYL 7441 BOVINE UDUERI STAPHYLOCOCCIC PHASES. 7346 BOVINE VIERIUSI RIO CHEMICAL ANA CDL 7430 BOWEL OF THE NEWEORNI CALCIFICATION 4459 BOWEL PERPARATION POE SIAMUIDOSCOPT. S234 BOTESI WASUADE OF APPLES IN RELATION 5154 ROYAl A MULTIDIMENSIONAL STUDY OF TM 4107 ROYAl PARENTS SELF-REPORTS, CHILDREN 6095 BOZENI CONTRIBUTION TO THE FLORISTIC 7471 ER.-ARURTUS IN BOVINE PHAGOCTURSI TV 74S2 BR.-EL. ARTE OF THE ARA-LANGOEDOC" B 4S40 BRACHIOCEPHALIC ARTERITIS" POLSELESA 5591 AEACHTCBELIIDRRAI STUDIES ON THE MOM 0323 BRAIN ACUIVIUTI THE EFFECT OF 2 METH 42S4 BRAIN AMINE CONTENT IN RAUSI EISS BRAIN AND INTERNAL ORGANS OF WICRI I 4902 BRAIN AND LIVERI A COMPARATiVE EVALO S027 BRAIN AND LIVERI THE METHYLATION 4157 BRAIN AND OTHER BLOOD- TISSUE BAERIE 4514 BRAIN CHULIN ESUREASE AFTER ADMINIAT 4216 BRAIN ESIRRASEA BY STARCH GEL ELECER 4839 BRAIN EATEACT ON THE IN-VITRO COLTUR 4441 BRAIN EXTRACTS ON THE CENTRAL NEEVOD 6177 BRAIN HDMDBENAUESI THE IMPORTANCE OF 4072 BRAIN LESIONS `N 00051 UISBNHIEITION 5992 BRAIN LESIONS WITH I.53G"-LABELLEO P 4057 BRAIN NEDEB HORMONE AND IN ACTION OF 4145 BRAIN NOCLEOTIDES AND INCORPORATION 4972 BRAIN OF THE EAT DURING ONTOGENTI TM 4978 BRAIN OF YOUNG AND OLD CHICKENSI EFF 7290 BRAIN OPERATIONS UNDER PHYSICAL HUED 4019 BRAIN. AN IMPROVED EBTEACTION TECHNI 4234 VERIN-STEMI A NEW TYPE OF CELL IN TM S9SS ERAINI B METHOD OF DETAINING RAPERI 4054 BRAINI BANG 4990 REBINI GONADOTEOPIC ACTIVITY OF NEON 5842 BRAINI NIT EVES VERINI RENAL TUBULAR NECROSIS F 5724 BRAINI TWO TYPES OF PATTERN OF HIPPO 4037 BRAINS OF ADULT MAMMALSI ARE NE S973 BRAINS OF ALBINO ERUSI A METHOD FOR 4910 ERANCH BLOCK PATTERNS. RN EAPREIMENT 5400 BRANCH BLOCK WITH STEROIB THERAPTI 5490 BRANCH BLOCK. B PHYSIULOBIC FATHOLUG 5449 BRANCH BLOCKI SSSU BRANCH BLOCKI A RALLISTO CARDIOGRAPH 5479 BRANCH BLUCKI A-V DISSOCIATION WITH 5349 BRANCH BLUCKI ELECTED CARDIUGEAPHIC S333 ERANCH ELOCKI ELECTED CARDIOGEAPHIC 7098 BRANCH ELUCKI ELECTED CARDIDGEAPHIC 7102 BRANCH BLUCKI BAPERI 5261 BRANCH BLUCKI MECHANISMS INFLOENCIND SSES BRANCH BLOCKI PATHOLOGY OF THE CONDO 5450 ERANCH BLOCKI THE VECTOR CA 5443 BRANCH ELOCKI THE VECTOR CARDIOGRAM 5512 BRANCHED CHAIN MONO SACCHARIDRI THE 4S94 BRANCHED FATTY ACID ISOMERS BY GAS C 4747 VEANCHED-CHAIN VOLATILE FATTY ACIDS. 5174 ERANDUN, MANITURAI DENTAL EFFECTS OF 5910 ARASSICA SEBDI A METHOD FOR THE ORTE AlSO BRAZILI GASTRIC CANCER IN JR 7113 BEAZILI ORSERYATIONS ON CANINE TOAD 5209 BRAZILI ORIGINS U 4577 BRAZILIAN VEDEURTION TYPES. WITH APR 4553 BRAZILIAR WILD RODENYSI MICRUSPORUM 7133 BREAM TAGGINO EAPERIMENUS IN RANT DI 4609 BREAST CANCER IN ROMBATI 7100 BREASTED BRONZE TORKETI THE INFLORNC 7310 BREATH HALOINO AT AEGINNINE OF EBEEC 5742 ERRATH MOLGINGI INFLUENCE STEB BREATHING ENERGETIC OUTPUT AND ARBOR 4984 BREATHING MOVEMENTS IN ENUDROELLA-SO 8324 BREATHING ON PATIENTS WITH ADAMS lTD S522 BREATHING ON PULMONARY COMPLIANCRI 5745 BEERUHINA POTENT MEDICATED AREOSOLSI 5754 BREAUMINGI DIAPHRAGM ACTIVITY AND RH 5734 BREED, SEX, AND SEMEN GOALITTI THE U 7254 BREEDING BEHAVIOR OF THE RAVEN WITH 0544 BREEDING BIOLOGY AND ETHOLOGY OF THE 4S9S BREEDING RIOTYPEI THE STATE OF DEVEL 4593 BREEDING COLONTI FROGEESS REPORT. DI 7371 BREEDING DOMESTIC ANIMALSI APP 4544 BREROINO IN CONNECTION WITH FEETILIT 7905 BREEDING IN HUNOARTI THE PRESENT PUS 7907 AREEDING OF BOAT-TAILED ORACKLEA IN 8553 AREVIERCTRRIOM-FLRVOMI SIGNIFICANCE 4497 BREWING WATER AND THEIR GROOPINGI ST 5159 BREWING WATER. CHEMICAL COMPOSITION 5159 BREWING WATER. RELATIONSHIP AMONG CO 5140 BREWING WATERI STUDIES ON BAKE BREWI SlED RRID~ING OP INTERRUPTED ATEID VENTRI 5434 BRIGHT-LEAF UDRACCOI STEADY-STATE TM 7848 BRIGHTNESS DISCRIMINATION UNDER 01FF 4525 BRINE SHRIMP TO FISHESI 4485 BRISBANE MAT ANEBI LEAF TEMPERATURE 7716 BRISBANE MAT 19451 THE CUTICLE IN EU 7497 BRISBANE MAT 09611 THE EFFECTS OF MO 7703 BRISKET" DISEASE AND IN EXPERIMENTAL 7274 EEl TRINI 8342 BRITRINI PTLOSIA~ORUOSR-HEREICH-SCHA 8419 BRITAIN. 1952-ADI EXTENT OF PROTECTI 8199 BRITISH COLOMBIBI THE EFFECTS ON FEE 4643 BRITISH FISH FILLETERSI COLD WASODIL 4334 BRITISH GOIRNAI EASTERN ERUINE ENCEP 7487 BRITISH IDLES. RRRHENAUHERUM-ELRTIUS 7482 BRITISH ISLES. FRADINOS-EXCELSIDR-LI 7490 BRITISH LEPIDOPUREAI 8413 ERITIAH-HDNDURASI PRESENT AND POTENT 7050 REITISH-ISLES AND THEIR RELATIONSHIP BEER BROAD BREASTED BRONZE TORKETI THE IN 7310 BROAD-LEAVED EVERGREEN TREES, BASED 4S44 BROKEN CMLOEOPLRSUSI HILL ACTIVITY 0 7728 EROMEGRASS MOSAIC VIRUSI PORIFICATID 01ST REOMEDRASSI EFFECT OF CERTAIN FEETIL 7914 RROMEORBSSRSI LIFE CYCLES AND CONTE 7950 BROMELAINI SYSTEMIC RID CHEMICAL CHA 6259 EROMO DRURY ORIDINRI IONIZATION OF 0 4204 Figure 3. Sample Page, B. A.S. I. C. 43 FREQUENCY DOUSLING IN ANISOTROPIC FERRITES. I SINGLE MAGNETIC SPIN PLANES IN MAGNETITE MULTIPLE ThIN DOMAINS AND DOMAIN WALLS IN NICKEL- OXIDE PARAMAGNETIC RESONANCE OF THE COBALT ION IN RUTILE SINGLE AGNETIC ANISOTROPY MEASUREMENTS OF ANNEALED NICKEL- OXIDE TUS FOR MEASURING MAGNETIZATIONS. APPLICATION TO A COBALT ESONANCE ABSORPTION OF DIVALENT NICKEL IN CORUNDUM SINGLE LL ON SLOW NEUTRON SCATTERING BY A UNIAXIAL FERROMAGNETIC FFECT AND THEORDERING PROCESS IN A NICKELI3) IRON SINGLE MAGNETIC BEHAVIOR OF A TETRADONAL ANTIFERROMAGNETIC ISTRIBUTION OF DISLOCATIONS OVER THE CROSS SECTION OF THE RELAXATION OF TRIVALENT ERBIUM IN CADMIUM- IRDNI2) SINGLE EARTH-DOPED YTTRIUM IRON GARNET. I CONTRIBUTION OF STATIC OLYCRYSTALLINE MANGANESE- ZINC- FERROUS FE/ PERMEABILITY, RITE- MAGNETITE AND MAGNESIUM FERRITE- MAGNETITI MAGNETIC ALl. I LITHIUMIO.5)- ALUMINUMI2.51 OXYGENI4) I 0. HYDROTHERMAL SOLUTION VANADIU~ OXYGEN(41- CDBALTI2-2X1- NICKEL 12X)I C PROPERTLES OF POTASSIUM MANGANESEIII) FLUORIDE. PART-i. ICROWAVE ACOUSTIC LOSSES IN YTTRIUM IRON GARNET. I SINGLE R- CHLORIDE DIHYDRATE, COBALT-CHLORIDE HEXAHYDRATE SINGLE IIENTATION AND ON THE METHOD OF DEMAGNETIZATION IN SINGLE BALANCE FOR MEASURING ABSOLUTE SUSCEPTIBILITIES OF SINGLE ON, AND PLASTIC DEFORMATION. COERCIVITY OF NICKEL SINGLE SYMMETRY OF TRANSITION METAL IMPURITY SITES IN SPECIFIC HEATS OF SINGLE COPPER- MANGANESE GROWTH OF ALPHA- IRON SINGLE PART-I A NEW METHuD OF PREPARING MAGNETITE SINI GROWTH OF LI MAGNETIZATION PROCESS IN UNIAXIAL FERROMAGNETIC SINGLE ESE OXIDE, ALUMINUM OXIDE, MANGANESE SPINEL AND MAGNETITE TIONS. GROWTH SEQUENCE OF GADOLINIUM-IRON GARNET FORMATION OF MAGNETOPLUMBITE SINGLE RESONANCE TRIVALENT IRON AND DIVALENT MANGANESE IN SINGLE MICROWAVE RESONANCE LINEWIOTH IN SINGLE IMENSIONS. DEPENDENCE OF THE RESONANCE FIELD IN SINGLE lOF TITANIUM ON THE LOW TEMPERATURE TRANSITION IN NATURAL RIABLE WAVELENGTH. MAGNETIC ANALYSIS OF SINGLE IATION WITH DEMAI INITIAL PERMEABILITY OF SINGLE AND POLY MAGNETORESISTANCE OF SINGLE FERRITE OPERTIES. THERMODYNAMIC THEORY OF DISLOCATIONS IN FERRITE SINGLE ACOUSTIC PARAMAGNETIC RESONANCE IN PHONON-MAGNON INTERACTION IN MAGNETIC SYMMETRY PROPERTIES OF WAVE FUNCTIONS IN MAGNETIC DISORDER STRUCTURE IN TERNARY IONIC X-RAY AND MAGNETIC STUDIES OF CHROMIUM- OXYGENI2I SINGLE THEORY OF THE MAGNETIC SCATTERING OF SLOW NEUTRONS IN MAGNETIC SPIN LEVELS IN MAGNETITE NUCLEAR ORIENTATION IN ANTIFERROMAGNETIC SINGLE THEORY OF NUCLEAR ACOUSTIC RESONANCE LINE SHAPE IN CUBIC ON MAGNETIC RESONANCE SATURATION IN PARAMAGNETIC RESONANCE OF NICKEL IONS IN DOUBLE- NITRATE ASYMMETRIC SHAPE EFFECTS IN DIA- AND PARAMAGNETIC GROWTH OF YTTRIU~ALUMINUM GARNET SINGLE RESEARCH AND DEVELOPMENT OF YTTRIUM IRON GARNET SINGLE GROWTH OF REFRACTORY OXIDE SINGLE GROWING YTTRIUM IRON GARNET SINGLE IFFUSION OF IRON AND CHROMIUM IN CORUNDUM AND RUBY SINGLE EFFECT OF SIXTH DEGREE CUBIC FIELD ON RARE-EARTH IONS IN ALENT CHROMIUM AND IRON RELAXATION TIMES IN RUTILE SINGLE WAVES IN RHOMBIC ANTIFERROMAGNETIC AND WEAK FERROMAGNETIC C INTERACTION OF CERIUM AND COBALT IONS IN DOUBLE NITRATE IC DOMAIN PATTERNS ON NICKEL-COBALT ALLOY AND PURE COBALT NEALING EFFECT ON THE ANISOTROPY OF COBALT FERRITE SINGLE RESONANCE OF TRIVALENT IRON IONS IN SYNTHETIC ZINC- OXIDE ANCE OF DIVALENT MANGANESE IONS IN SILVER CHLORIDE SINGLE ATTERNS ON ThO~PHASE NICKEL- COBALT ALLOY AND PURE COBALT OF TRIVALENT IRON IONS IN SYNTHETIC CUBIC ZINC- SULPHIDE CTRON NUCLEAR DOUBLE RESONANCE OF PARAMAGNETIC DEFECTS IN PY OF THE FERROMAGNETIC PRECIPITATE IN GOLD-NICKEL SINGLE UN~STATE POPULATION CHANGES OF NEODYMIUM IN ETHYLSULFATE CREEP AND BASCULATION EFFECTS IN IRON- ALUMINUM SINGLE I I CRYSTALLINE ELECTRIC FIELDS IN SPINEL-TYPE ELASTORESISTANCE EFFECT IN IRON SINGLE STARK EFFECTS AND SPIN-PHONON INTERACTION IN PARAMAGNETIC LORIDE FROM II TO 300K. MAGNETIC OROBRING IN LINEAR CHAIN SORPTION AND MANGANESE- MAGNESIUM- COBALT- FERRITE SINGLE THE FERRIMAGNETIC RESONANCE LINEWIOTH OF LITHIUM FERRITE TERIAL. PART-i A NEW METHOD OF PREPARING MAGNETITE SINGLE ON THE MAGNETIC DOMAIN STRUCTURE OF IRON- SILICON SINGLE PORATION OF ALPHA- HEMATITE INTO MANGANESE FERRITE SINGLE IFECTS IN YTTRIUM- IRON AND GADOLINIUM-IRON GARNET SINGLE LOW-INDEX FACEI DISLOCATIONS IN MANGANESE FERRITE SINGLE ISTRIBUTION OF I DISLOCATIONS IN MANGANESE FERRITE SINGLE TRIC PROPERTIES. SYMMETRY OF LO SPLLTTINGS OF DIFFERENT IRON COMPLEXES. I PARAMAGNETIC OF ORIENTED NUCLEI. I FERROMAGNETIC OR ANTIFERROMAGNETIC SUPERCONDUCTIVITY IN THE FUNCTION AND RELATED NONCROSSING POLYGONS FOR THE SIMPLE- CE IN RUBIDIU~~ MANGANESE- IRONI3I. DISCOVERY OF A SIMPLE FERRO- AND ANTlFERROMAGNETISM IN A ADOLINIUM ION. THEORY OF NUCLEAR ACOUSTIC RESONANCE LINE SHAPE IN ITICE RELAXATION OF S-STATE IONS, DIVALENT MANGANESE IN A SPIN WAVE THEORY FOR CRYSTAL LINCIZI- YTTRIUM) CRYSTAL. CRYSTAL. CRYSTAL. CRYSTAL. CRYSTAL. CRYSTAL. CRYSTAL. CRYSTAL. CRYSTAL. I THEORETICAL I CRYSTAL. /PART-2. LOGE AND SCREW DISLOCATIONS, D CRYSTAL. IRAMAINETIC RESONANCE AND SPIN-LATTICE CRYSTAL-FIELD EFFECTS TO THE LINE-~IDTH IN RARE- CRYSTALLINE ANISOTROPY AND MADNETOSTRICTION OF P CRYSTALLINE ANISOTROPY IN THE SYSTEMS NICKEL FIR CRYSTALLINE ELECTRIC FIELDS IN SPINEL-TYPE CRYST CRYSTALLIZATION OF YTTRIUM- IRON GARNET ON A SEE CRYSTALLOGRAPHIC AND MAGNETIC STUDY OF THE SOLID CRYSTALLOGRAPHIC STUDIES. MAGNETI I TEMPERATURE DEPENDENCE OF M I /IVITY IN AN ANTIFERROMAGNET. I COPPE AND A POLYCRYSTAL OF O.SPERCENT ALUMINI AND DILUTE SOLUTIONS. ~SITIVE MAGNETIC AS A FUNCTION OF TEMPERATURE, ORIENTATI AS INFERRED FROM OPTICAL SPECTRA. BETWEEN 1.4 AND 5K. BY HALOGEN REDUCTION. BY THE CHEMICAL TRANSPORT OF MATERIAL. FOR THE CASE OF A VERTICAL MAGNETIC PIE FROM 3 TO 300K. ICONDUCTIVITY OF MANGAN IN MOLTEN LEAD OXIDE- BORON- OXIDE SOLO IN THE PRESENCE OF THALLIUM OXIDE. OF CALCIUM OXIDE. ELECTRON SPIN OF COBALT-SUBSTITUTED MANGANESE FERRITE OF FERRITES ON TEMPERATURE AND SAMPLE 0 OF HAEMATITE. I ELECTRON SHADOW METHODI OF IRON BY ELECTRON DIFFRACTION WITH VA OF IRON- 5 PERCENT ALUMINUM AND ITS VAR OF T~ANSITI0N METALS. USING AN ARC IMAGE FURNACE. WITH FERROELECTRIC AND FERROMAGNETIC PR WITH HEXAGONAL STRUCTURE. WITH IONS IN S-STATE. M A NLW APPARA PARAMAGNETIC R EFFECT OF DOMAIN WA MAGNETIC ANNEALING E CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS. CRYSTALS, CRYSTALS, CRYSTALS, 0 THE TRI V SPIN MAGNET I FERROMAGNET MAGNETIC AN PARAMAGNETIC PARAMAGNETIC RESON FERROMAGNETIC DOMAIN P PARAMAGNETIC RESONANCE FREQUENCY SPECTRA OF ELE OBSERVATION BY ELECTRON MICROSCO DIRECT OPTICAL DETECTION OF THE GRO I DEFECTS I LITHIUMIO.51- ALUMINUMI2.5I OXYGEN(4 I MAGNETDSTRICT~ON I. I THEORETICAL I lAND ENTROPY OF COPPER AND CHROMIUM CH IL POWER FOR THE CASE OF SUBSIDIARY AB IL, THERMAL, AND CHEMICAL TREATMENT OF ISTALS BY THE CHEMICAL TRANSPORT OF MA /TERNAL STRESSES AND OF FIELD STRENGTH EFFECT ON DISLOCATION DENSITY. INCOR PART-I. ETCHING AGENTS FOR IARNETS, 0/ PART-i. OBSERVATION OF DISLOCATIONS ON PART-2. EDGE AND SCREW DISLOCATIONS, 0 EXHIBITING FERROMAGNETIC AND FERROELEC GARNETS I ZERO FIE THEORETICAL I IMA RAYS FROM ASSEMBLIES CUAL2ICi6I CRYSTAL CLASS. CUBE LATTICE. HIGH-TEMPERATURE ISING PARTITION CUBIC ANTIFERROMAGNET, ANTIFERROMAGNETIC RESONAN CUBIC CLUSTER OF SPINS. CUBIC CRYSTAL FIELD SPLITTING OF THE TRIVALENT G CUBIC CRYSTALS. CUBIC ENVIRONMENT. I THEORETICAL I SPIN-LA CUBIC FERROMAGNETICS PART-3 MAGNETIZATION. Figure 4. Sarnple, Bell Laboratories Format 44 i9-066 04-036 06-062 12-046 06-063 17-032 12-016 01-070 03-031 06-021 04-073 12-057 11-020 04-068 04-147 04-091 18-003 01-064 05-035 11-113 06-050 03-065 17-019 03-007 16-031 16-029 18-019 18-022 02-091 16-027 18-002 18-021 12-030 11-081 11-032 01-009 03-062 03-011 09-006 18-013 02-095 04-082 12-002 01-021 01-022 01-063 01-065 01-097 04-035 06-014 11-115 12-008 12-036 14-015 18-001 18-015 18-020 18-024 12-032 14-040 12-031 06-005 05-038 10-015 04-108 12-024 12-044 10-022 12-025 12-014 05-022 14-012 03-013 04-091 03-043 13-005 16-023 11-082 11-089 18-022 10-017 04-025 04-012 04-072 04-073 01-024 12-015 13-006 15-062 02-067 06-038 02-065 13-051 11-115 12-005 02-011 68 have antiperasitic act ion 69 has entiparasitic action 70 not have antiparasitic acti on 71 has antiparasitic action 72 has entiparasitic action 73 has antiparasitic action 74 have anti pares it Ic action 126 of emebic colitis caused 127 of emebic colitis caused 126 weakLV have toxic action 25 158 158 20 21 150 150 150 8 B 5 5 119 42 46 46 162 166 32 36 37 35 32 34 33 119 32 32 157 157 64 53 63 53 55 63 63 136 135 131 132 THE LENGTH OF ACTION AND THE ouebein ver~ strongL~ increases TENSION AND THE RATE OF NET of hexobarbitel b~ ml crosomal of hexobarbitel b~ microso.eL h~dro ergokr~ptine with di h~dro h~dro ergocorni ne end di h~dro tolezoline end di h~dro but, action antagonized b~ of rabbit, action increased b~ dog end cet~ action reversed b~ action reversed b~ ergotami ne Streptococcus pyoomnes, in human accompanied b~ p~rroLidone causes aggregation of A SYNTHETIC MACROMOLECULE ON THE chloramphenicol end acid in acid-solubLe fraction of amino uridine inhibits growth of c~tidine inhibit growth of amino uridine inhibits growth of fluoro uraciL has toxic action on amino uridine inhibits growth of deox~ uridine inhibit growth of growth of Staph~Lococcus aureus. pimeLic acid in ceLl waLLs of content of N-ccet~L hexos amine AFTER GENERAL ANESTHESIA WITH c~cLo pent~L propionate and THE TERATOGENIC ACTION OF increases excretion of estrone excretion of estrone estredioL URINE methox~estra-l.3.5-tri ene has progestati onal action on immature progestati onal action on immature progestati onal action on immature 133 progestationeL action on 143 action on immature 63 5 144 144 148 133 131 132 43 44 43 13 16 14 12 80 80 113 145 145 145 146 145 145 80 80 140 139 139 83 increases excretion phen~L)-2-(iso prop~l amino) 2-di meth~L amino THE EFFECTS OF 2-01 METHYL AMINO suLfate choLine phen~l sterone, Less effective than more effective than sterone. equaL in action to ANTAGONISM OF LYSERGIC ACID DI recognition of l~sergic acid di recognition of L~sergic acid di cetechoL cmi nes caused b~ phen catechol am I nes caused b~ phen catecho L am I nes caused b~ phen catechoL emines caused b~ phen more effective than a-3-(2-di 8-3-( 2-di substituted benz~L and phen tri eth~l tin and tri THE ACTION OF TRI ETHYL TIN. TRI OF TRI ETHYL TIN, TRI ETHYL LEAD. tri THE ACTION OF TRI than e-3-(2-di Cth11L amino 8-3-(2-di Cth11L amino given as saLts with di benS11L m-9- morphen and 8- 5,9-di meth11l-2- 1-(2-p- amino phen11L) on Entameba histoL~tice on Entameba histoL~tica on Entemebe himtoL~tice on Entamebe histoL~tice on Entemeba histol~ticc on Entemeba histoL~tica on Entameba histoL~tica b~ Entameba histoL~tice b~ Entemeba histoL~tica on Entamebe histoL~tica ENTERAL RESORPTION OF in rat [weenling] in ret [weaniing] in rat [weanling] in rat [weanling] and wackl~ has toxi in ret [weenling] in rat [weanling] and has toxic actio in ret [weenLingi and have toxic acti in ret [1275723.1275724. and 1275725 in rat [1275732 as di(3- h~drox~-2- n in vitro and do not or weckl~ allevic DIGITOXIGENIN- MONO DIGITOXOSIDE(Dt2 entr~ of calcium and strongL~ increases resting tension of ENTRY OF CALCIUM-45 IN ISOLATED PERFUSED RABBIT VENTRICLES enz~mes of Liver enz~mes of Liver ergocornine and di h~dro ergocristineLh~dergine] inhibit ergocristine[h~dergine] inhibit action of vesopressin bu ergokr~ptine with di h~dro ergocornine and di h~dro erg ergotamine at higher dosage ergotamine at Low dosage but, action antagonized b~ ergot ergotamine ergotoxin guanethidine and phen~lephrine bu ergotoxin guenethidine and phen~lephrine but in rat. cc ErsipeLothri x I nsidiose end Streptococcus egelactem in wit er~thema [miLd] given b~ in~ection into skin Lesions er~throc~tes in bLood of hamster given intrc-artericLL~ ERYTHROCYTES OF THE BLOOD er~throm~cin strongL~ inhibit endotrophic sporulation of B ERYTHROMYCIN- AND STREPTOMYCIN-LIKE ANTIBIOTICS AS BLEACHI Escherichic coLi Escherichie coIl and Neurospora Escherichia coIl but do not inhibit growth of Neurospore Escherichia coLi K-12. action reversed b~ glutethione L- Escherichie coIl whiLe organism is growing cctivmL~. ectio Escherichla coIl, action reversed b~ glutathione ;, acti Escher I chic co Li. action reversed b~ ur I dine c~ti dine Escherichla coIl, SaLmonella tliphoae. PesturelLe muLtocida Escherl chic col i; increases content of N-ecet~l hexos amin esters and diamino pimelic acid in acid-soluble fraction 0 esti L general anesthetic decreases urinar~ output end incr EST IL. estre di ol valerete hormone cause edeac end thickening of ESTRADIOL AND THYROXINE ON MUELLER'S DUCT IN THE CHICKEN E estredioL estrioL and total neutral 17- keto steroids in estradioL inhibits formation of Mueller's duct of chicken estrediol with th~roxine strongl~ inhibit formation of st astrioL and totaL neutral 17- keto steroids in urine of ~o ESTROGEN RESPONSES TO HUMAN CHORIONIC GONADOTROPIN IN YOUN estrogenic action estrogen-primed rabbit and does not inhibit growth of adre estrogen-primed rabbit given orcll~ estrogen-primed rabbit given orcll~ immature estrogen-primed rabbit given orcll~ rabbit [estrogen-primed] given subcutaneousL~ of estrone estradioL estrioL and total neutral 17- keto ate ethanoL have h~potensive action on barbiturate narcotized ethanoL increases incorporation of phosphorus Into phospha ETHANOL ON BRAIN PHOSPHO LIPID METABOLISM ether bromide DMPP and hist cams acid phosphate in isol ethin~L testo sterone moderateL~ have progeatationaL cctio ethln~L tasto sterone strongL~ has progestational action 0 ethin~L testo sterone atrongL~ have progestationd action ETHYL AMIDE BY CHLORPROMAZINE AND PHEN OXY BENZ AMINE. eth~L emide in human if given aimultcneouaL~ eth~L amide In human onl~ if given previous to Latter ethVl amine eth~L amine eth~l amine end does not inhibit secrstion of catechoL cmi eth~L amine nicotine and carbachoL ethVl amino eth~L) amino tropine bis math iodide has nicot eth~L amino eth~L) amino tropine bia meth iodide. more eff eth~L h~dr ezines have toxic action [L050 292,4000+. 400+, eth~L Lead ver~ ctrongL~ inhibit metaboLism of gLucose b~ ETHYL LEAD. ETHYL MERCURY AND OTHER INHIBITORS ON THE META ETHYL MERCURY AND OTHER INHIBITORS ON THE METABOLISM OF BR eth~l mercur~ chLoride chlorpromazine malonic acid [CS S eth~L tin and tri eth~l Lead ver~ strongL~ inhibit matabo ETHY~ TIN. TRI ETHYL LEAD. ETHYL MERCURY AND OTHER INHIBIT eth~L) amino tropine bia math iodide has nicotinic bLockin eth~L) amino tropine bis math iodide, more effective than eth~Lenc diamine eth~L-2'- h~drox~-2.5-di meth~L-6.7- benzo morphen and 8- eth~L-2'- h~drox~-6.7-benZ0 morphan weakL~ heve toxic acti eth~L-2- meth~L-3 phen~l-3- propion 0511 p11rrolidine has Figure 5. Sample Page, ChemiCal BiologiCal ACtivities 45 NON-IRRADIATED ABSORPTION OF 0-GLUCOSE BY SEGMENTS OF INTESTI NE FROM ACTIVE AND HIBERNATING, IRRADIATED AND NOM-IRRADIATBO GROUND SQUIRRELS, CITELLUS IR) DECEMLINEATUS NASA N63-110021K) $2.60 0126 NON-ISOTHERMAL CORRELATIONS IN A NON-ISOTHERMAL PLASMA AD-290 0531K) $1.10 0196 NON-LINEAR INVESTIGATION OF MICROWAVE NON-LINEAR EFFECTS UTILIZING FERROMAGNETIC MATERIALS AD-29Q 5721K) $2.60 0481 NON-METALLIC BIBLIOGRAPHY AND TABULATION OF DAMPING PROPERT IES OF NON-METALLIC MATERIALS AD-289 8561K) $3.00 0502 NON-MILITARY NOTES ON NON-MILITARY MEASURES IN CONTROL OF I NIURGENCY 60-290 2371K) $1.60 0696 NON-MOVING JUDGMENTS OF VISUAL VELOCITY AS A FUNCTION OF THE LENGTH OF OBSERVATION TIME OF MOVING OR NO N-MOVING STIMULI PB 162 5491K) $1.60 0125 NON-RELATIVIST) TABLES OF NON-RELATIVISTIC ELECTRON TRAJECTORI ES FOR FIELD EMISSION CATHODES 60-290 6961K) $14.50 0239 NON-SIMILAR NON-SIMILAR NUMERICAL METHODS OF SOLUTION FOR ELECTRODE BOUNDARY LAYERS IN A CROSSED FIELD A CCELERATOR 60-290 525(K) $5.60 0185 NONDESTRUCTIVE NONDESTRUCTIVE SYSTEM FOR INSPECTION OF FIBER GLASS-REINFORCED PLASTIC MISSILE CASES 60-289 8251K) $1.60 0632 NONDESTRUCTIVE X-RAY IMAGE SYSTEM FOR NONDESTRUCTIVE TESTING OF SOLID PROPELLANT MISSILE CASE WALLS AND WEL OMENTS 60-289 821(K) $3.60 0631 NONDISSIPATIVE MAGNETOHYDRODYNAMIC STABILITY OF VORTEX FLOW - A NONOISSIPATIVE, INCOMPRESSIBLE ANALYSIS ORNL-TM-4121K1 $3.60 0615 NONEQUILIBRIUM SCALE EFFECTS FOR NONEQUILIBRIUM CONVECTIVE HE AT TRANSFER WITH SIMULTANEOUS GAS PHASE AND SO RFACE CHEMICAL REACTIONS. APPLICATION TO HYPER SONIC FLIGHT AT HIGH ALTITUDES 60-291 0321K) $1.60 0025 NONLINEAR APPLICATION OF VARIATIONAL EQUATION OF MOTION TO THE NONLINEAR VIBRATION ANALYSIS OF HOMOGEN EDUS AND LAYERED PLATES AND SHELLS 60-289 8681K) $2.60 0667 NONLINEAR EXTENSIONS IN THE SYNTHESIS OF TIME OPTIMAL OR BANG-BANG NONLINEAR CONTROL SYSTEMS. PART I. THE SYNTHESIS OF QUASI-STATIONARY OPTIMUM NONL INEAR CONTROL SYSTEMS PB 162 5411K) $4.60 U235 NONLINEAR EXTENSIONS IN THE SYNTHESIS OF TIME OPTIMAL OR BANG-BANG NONLINEAR CONTROL SYSTEMS. PART I. THE SYNTHESIS OF QUASI-STATIONARY OPTIMUM NONL (NEAR CONTROL SYSTEMS PB 162 5471K) $4.60 0235 NONLINEAR NONLINEAR FLEXURAL VIBRATIONS OF SANDWICH PLAT ES 60-289 8711K) $2.60 0669 NONLINEAR OPTIMUM NONLINEAR CONTROL FOR ARBITRARY DISTUR BANCES NASA N62-158901K1 $2.60 0682 NONRECURRENT A TECHNIQUE FOR NARROW-BAND TELEMETRY OF NONRE CURRENT PULSES 60-290 6911K) $2.60 0571 NONUNIFORM ELECTROMAGNETIC SCATTERING FROM A SPHERICAL NO NUNIFORM MEDIUM. PART II. THE RADAR CROSS SECT ION OF A FLARE 60-289 6151K) $2.60 0747 NONUNIFORM ELECTROMAGNETIC SCATTERING FROM ASPHERICAL NON UNIFORM MEDIUM. PART I. GENERAL THEORY 60-289 6141K) $2.60 0748 NORMAL PROBABILITY INTEGRALS OF MULTIVARIATE NORMAL A ND MULTIVARIATE-T 60-290 7461K) $8.60 0160 NORMAL RESONANCE ABSORPTION OF GAMMA-RAYS IN NORMAL A NO SUPERCONDUCTING TIN 60-289 8441K) $3.60 0826 NORMS NORMS FOR ARTIFICIAL LIGHTING 60-290 5551K) $1.10 0734 NORTH FACTORS INFLUENCING VASCULAR PLANT ZONATION IN NORTH CAROLINA SALTMARSHES 60-290 9381K) $1.60 0603 NORTH SONAR STUDIES OF THE DEEP SCATTERING LAYER IN THE NORTH PACIFIC PB 162 427(K) $2.60 0587 NORTH THE DEVELOPMENT OF RESCUE AND SURVIVAL TECHNIQ UES IN THE NORTH AMERICAN ARCTIC PB 162 4101K) $12.00 0085 NOSE THE FLORA OF HEALTHY DOGS. I. BACTERIA AND PUN GI OF THE NOSE, THROAT, AND LOWER INTESTINE LP-21K) $2.60 0458 NOZZLE FABRICATION OF PYROLYTIC GRAPHITE ROCKET NOZZL B COMPONENTS PB 162 3111K) $1.10 0351 NOZZLE FABRICATION OF PYROLYTIC GRAPHITE ROCKET NDZZL E COMPONENTS PB 162 3701K) $1.10 0353 NOZZLE FABRICATION OF PYROLYTIC GRAPHITE ROCKET NOZZL E COMPONENTS PB 162 3121K) $2.60 0352 NOZZLE THIRD SYMPOSIUM ON ADVANCED PROPULSION CONCEPT S SPONSORED BY UNITED STATES AIR FORCE OFFICE OF SCIENTIFIC RESEARCH AND THE GENERAL ELECTRI C COMPANY FLIGHT PROPULSION DIVISION CINCINNAT I, OHIO OCTOBER 2-4, 1962. PLASMA PLOW IN A MA GNETIC ARC NOZZLE 60-290 0821K) $2.60 0147 NOZZLES HEAT TRANSFER AND PARTICLE TRAJECTORIES IN SOL 10-ROCKET NOZZLES 60-289 6811K) $5.60 0030 NKOTC DEVELOPMENT AND STANDARDIZATION OF FORMS 3 AND 4 OF THE NROTC CONTRACT STUDENT SELECTION TES 1 60-290 1841K) $1.10 0201 NROTC EVALUATION OF NROTC AVIATION INDOCTRINATION F) ELD TOURS FOR 1961-1962 60-290 3561K) $1.60 0581 NUCLEAR A 7090 CODE FOR THE CALCULATION OF ELECTROMAGN ETIC BLACKOUT FOLLOWING A HIGH ALTITUDE NUCLEA R DETONATION 60-291 1411K) $8.60 0312 NUCLEAR ACCURATE NUCLEAR FUEL BURNUP ANALYSES GEAP-4062)KI $1.60 0362 NUCLEAR APPLICATION OF NUCLEAR POWER SUPPLIES TO SPACE SYSTEMS TID-173061K) $8.60 0141 NUCLEAR CAROLINAS-VIRGINIA NUCLEAR PO~ER ASSOCIATES, I NC., RESEARCH AND DEVELOPMENT PROGRAM QUARTERL Y PROGRESS REPORT FOR THE PERIOD APRIL - JUNE 1962 CVNA-1561K1 $6.60 0839 NUCLEAR COMPUTER PROGRAMS FOR OPTIMUM START-UP OF NUCL EAR PROPULSION SYSTEMS 310-161301K) EE.IQ 0112 NUCLEAR DOSE-TIME-DISTANCE CURVES FOR CLOSE-IN FALLOUT FOR LOW YIELD LAND-SURFACE NUCLEAR DETONATION S PB 162 5561K) $1.60 0573 NUCLEAR EXTRUDED CERAMIC NUCLEAR FUEL DEVELOPMENT FROG RAM ACNP-62550)KI $4.60 0092 NUCLEAR FEASIBILITY DETERMINATION OF A NUCLEAR THERMID NIC SPACE POWER PLANT 60-290 0681K) $2.60 0031 NUCLEAR HIGH - ENERGY NUCLEAR PHYSICS RESEARCH PROGRAM AO-291 140(K) $1.60 0314 NUCLEAR HIGH-ENERGY NUCLEAR REACTIONS OF NIOBIUM WITH INCIDENT PROTONS AND HELIUM IONS UCRL-104611K1 $2.25 0222 NUCLEAR INVESTIGATIONS ON THE DIRLOT CONVERSION OP NUD LEAR FISSION ENERGY TO ELECTRICAL ENERGY IN A PLASMA DIODE 60-290 7271K) $9.60 0385 NUCLEAR NUCLEAR SUPERHEAT DEVELOPMENT PROGRAM GNEC-2541K1 $14.00 0386 NUCLEAR PRODUCTION OF TRITIUM BY CONTAINED NUCLEAR EXP LOSIONS IN SALT. I. LABORATORY STUDIES OF (SOT OPIC EXCHANGE OF TRITIUM IN THE HYDROGEN-WATER SYSTEM ORNL-33341K1 $.50 0617 NUCLEAR STRIKING EFFECT OF NUCLEAR EXPLOSION 60-290 824(F) $21.00 0083 NUCLEAR THE NUCLEAR PROPERTIES OF RHENIUM 60-291 1801K) $1.60 0310 NUCLEAR VARIATIONS IN THE TOTAL ELECTRON CONTENT OF TH E IONOSPHERE AFTER THE HIGH ALTITUDE NUCLEAR E XPLOSION NASA N63-104861K1 $1.10 0142 NUCLEAR 6306 MARITIME NUCLEAR STEAM GENERATOR GEMP-1601K1 $8.10 0349 NULL-ZONE THE ESTIMATION PROBLEM IN NULL-ZONE RECEPTION FEEDBACK SYSTEMS 60-290 3251K) $11.00 0599 NUMBERS FUNDAMENTAL SOLUTION TO THE DIFFUSION BOUNDARY LAYER EQUATION FOR MEARLY SEPARATED FLOW OVER SOLID SURFACES AT VERY LARGE PRANOIL NUMBERS 60-291 0311K) $2.60 0023 NUMBERS LOCAL PRESSURE DISTRIBUTION ON A BLUNT DELTA W ING FOR ANGLES OF ATTACK UP TO 35-DEGREES AT M ACH NUMBERS OF 3.4 AND 4.7 NASA N63-)08001K1 1.75 0516 NUMERICAL A MAINTENANCE PROGRAM FOR NUMERICAL CONTROL SY STEMS ON MACHINE TOOLS TIO-173761K1 $2.60 0809 NUMERICAL A PRIORI BOUNDS ON THE SISCRETIZATION ERROR IN THE NUMERICAL SOLUTION OF THE OIRICHLET PROBL EM 60-290 3221K) $4.60 0464 NUMERICAL NON-SIMILAR NUMERICAL METHODS OF SOLUTION FOR ELECTRODE BOUNDARY LAYERS IN A CROSSED FIELD A ODELERATOR 60-290 5251K) $5.60 0185 NYSTAGMUS MANIPULATION OF AROUSAL AND ITS EFFECTS ON HUM AN VESTIBULAR NYSTAGMUS INDUCED BY CALORIC IRR (GAllON AND ANGULAR ACCELERATIONS 60-290 3481K) $1.60 0252 OAK A SAFETY REVIEW OF THE OAK RIDGE D~TIDAL EXPE RlMENTS FACILITY ORNL-TM-3491K) $5.60 0612 OBJECTS DRAG OF OBJECTS IN PARTICLE - LADEN AIR PLOW P HASE IV. BLUNT BODIES AND COMPRESSIBILITY EFFE OTS 60-291 1181K) $6.60 0752 OBSERVATORY TONTO FOREST SEISMOLOGICAL OBSERVATORY 60-291 1481K) $3.60 0815 OCEAN A SAMPLE TEST EXPOSURE TO EXAMINE CORROSION AN O FOULING OF EQUIPMENT INSTALLED IN THE DEEF 0 DEAN 60-291 049(K) $1.60 0582 OCEANOGRAPHIC OCEANOGRAPHIC CRUISE TO THE BERING AND CHUKCHI SEAS, SUMMER 1949. PART I SEA FLOOR STUDIES PB 162 426(K) $2.60 0585 OCEANOGRAPHIC OCEANOGRAPHIC AND UNDERWATER ADDOUSTICS RESEAR OH 60-290 252(K) $2.60 0848 OCEANOGRAPHIC OCEANOGRAPHIC CRUISE TO THE BERING AND CHUKCHI SEAS, SUMMER 1949. PART IV. PHYSICAL ODEANOOR APHID STUDIES. VOL. I. DESCRIPTIVE REPORT PB 162 428-1(K) $3.60 0584 OCEANOGRAPHIC OCEANOGRAPHIC CRUISE TO THE BERING AND CHUKCHI SEAS, SUMMER 1949. PART IV. PHYSICAL OCEANOOR APHID STUDIES. VOL. 1. DESCRIPIlVE REPORT PB 162 428-IlK) $3.60 0584 OCEANOGRAPHIC OCEANOGRAPHIC CRUISE TO THE BERING AND CHURCH) SEAS, SUMMER 1949. PART IV PHYSICAL ODEANOGRA PHID STUDIES. VOL. 2. DATA REPORT PB 162 428-21K) $4.60 0586 OCEANOGRAPHIC OCEANOGRAPHIC CRUISE TO THE BERING AND CHURCH) SEAS, SUMMER 1949. PART IV PHYSICAL ODEANOGRA PHID STUDIES. VOL. 2. DATA REPORT PB 162 428-2(K) $4.60 0586 OCEANOGRAPHIC PROCEEDINGS OF INTERINDUSTRIAL OCEANOGRAPHIC S YMPDSIUM (ND. 11, BURBANK, CALIFORNIA, 5 JUNE 1962 PB 162 587(K) $2.60 0451 OCTYL RUBBER ELASTICITY IN HIGHLY CROSSLINKED SYSTEM Figure 6. Sample, CEIR Format for Qffice of Technical Services 46 DIABETES ROLATED LITERATURE REYWORD INDEX i96B CHANGES OF GLYCEMIA IN THE UMBILICAL VEIN FOLLOWING INTRAVENOUS ADMINISTRATION OF GLUCOSE TO MOTHER. Z A STEMBERA. J HODR * CESE OTHER V24 P6TE~A. OCT 59 CO MODIFICATION OF THE GLYCAMIA LEVEL. PTRUVIC ACID LEVEL AND THE LEVEL OF INORGANIC PHOSPHORUS BY APPLICATION OF GLUCOSE DURING LABOR WITH CONSIDERATION TO HYPOXIA OF THE FETUS. e J 90DM, J HEROHANN. J JAN05 * Z GEBURTSH GTNAEE 010.4 P57-~S 0959 GEM EFFECTS OF THE ADMINISTRATION OF SULFONAMIDE BY WAY OF THE EXOCRINE DUCTS ON THE GLYCAMIA AND HISTOLOGICAL STRUCtURE OF THE PANCREAS. * A LOUBATIERES, A SASSINA. M M HARIANI. C FRUTEAU DE LACLOS * C H SOC BIOL PAR 0154 P155-S. 1960 FR EFFECT OF SODIUM ACETOACETATE ON GLYCERIA. * M TOTH. L DARTA ACTA HOD ACAD SC HUNG ViS P343-A. 1960 FR MODIFICATIONS IN GLYCEMIA AND OLUCOSE LOADING CURVE IN ANIMALS WITH CHRONIC LESIONS OF THE SFINAL CORD * G PINNA. M S DECHERCHI BOLL SOC ITAL BIOL SPER 035 PlEAS-B. Ti DEC 59 IT THE GLYCEMIC CYCLE COMPAVED WITH THE INDUCED HYFEMGLTCEM,'A TEST AND THE FASTING GLYCEMIA, ITS IMPORTANCE IN DIABETICS. EVEN IN THOSE APPARENTLY IN EOUILISRIUM, BIMPLIFIED PERFORMANCE OF TEST USING ADTX-HICRO-SAHPLINGS. C PEREZ * TUNISIE MED V3B P1V9-0X9. MAO AX FR EFFECT OF OVERSTIMULATION OF THE CNS ON ILTOEHIA IN MAYA IN VARIOUS CONDITIONS. * H SUBOVA * CESE FYSIOL VS PNSS. NOV 59 Cl THE GLYCAMIC CYCLE COMPARED WITH THE INDUCED HYPERGLYCEMIA TEST AND THE FASTING GLYCEHIA, ITS IMPTOTANCE IN DIABETICS AVON IN THOSE APPARENTLY IN EGUILIAVIUM. SIHFLIFIEO PARFDRMANCE OF TEST USING AUYO-MICMD-SAHFLINXS, * C PEREZ A TUNISIE MED OTE P199-ZOR. MAR AX FM EFFECT OF INSULIN OR GLYCEHIA STUDIES AT MEANS OF TEMPONAVO AND PERMANENT METHODS OF LIGATION oF THE V. PORToE AND V. HEPAYICUM IN OATS. * R EDRAC * CESE FYSIDL V9 P28. JAN BA CO GLYCEM IC THE AMINOACIDEHIC AND GLYCEHIC RESPONSE N ULCER PATIENTS AFTER INTRAVENOUS LOAD OF AHINO ACIDS. I 0100Gb. V OLIVA BOLL SOC ITAL BIOL SPAR 9~S P1064-B. 15 SOFT 59 IT EFFECTS OF CHLORPROHAZINE ON CERTAIN GLYCERIC TESTS IN CHILDREN. * V TISCHLER, J JACINA. B HRUBA. 0 PAVEORCEROVA CASE PEDIAT V14 fAll-BR. AUG 59 CX 190 GLYCEHIC CYCLE COMPAHED WITH THE INDUCED HYPERGLYCEHIA TEST AND THE FASTING GLYCAMIA. ITS IMPOATANCE IN DIABETICS. EVEN IN THOSE APPARENTLY IN EGUILIBRIUM. SIMPLIFIED PERFORHANCE OF TEST USING AUTO-MICWO-XAHOLINGS. C PEREZ * TUNISIA MED VTS P1RV-OCV. VAR oD FR NEURAL REGULATION OF INDUCEC GLYCEHIC REACtION. E GUTHARN. B JAEDUBEE * CASE FYSIOL OR P404-s, SEPT 59 CX GLYCEHIC CURVE CHANGES OF GLYCAMIC CURVE FOLLOWING THE ADMINISYVATION OF GALACTDSE IN HEAD INJURIES. I VOOLIN CESE FYSIOL VB P017. JULY TV CZ EXPERIMENTAL CONTRIBUTION TX THE STUDY OF THE INFLUENCE EXERTED BY PERIPHERAL TISSUE ON GLYCERIC HOHEOSTASIS. II. THE GLYCAHIC CURVE FROV ADRENALINE. * C CORDOVA. G D BOMPIANI. O PALMA * BOLL SOC ITAL SIOL SPAR VTS P1566-9, 15 DEC SM IT EXPERIMENTAL CONTRIBUTION TO THE STUDY DF THE INFLUENCE EXERTED BY PERIPHERAL TISSUES ON GLYCEHIC HOMEOSTASIS. III. THE GLYCEHIC CURVE FROM INSULIN. G PALMA. C COADOVA, O D BOHPIANI * BOLL soq ITAL BIOL SPER 035 P1570-3. 15 DEC 59 IT GLYCAMIC CURVES IN NORMAL SHEEP FOLLOWING THE ADMINISTRATION OF CHLORINATED HYDROCARBONS. * E EDNA * CASE FYSICL VS P320. JULY 59 CZ GLYCAHIC HOHEOSYASIS EXPERIMENTAL CONTRIBUTION TO THE STUDY OF THE INFLUENCE EXERTED BY PERIPHERAL TISSUE ON GLTCEHIC MOHEOSTASIS. II. THE GLYCAMIC CURVE FROM ADRENALINE. C CORDOVA. 0 D SOMPIANI. O PALMA * BOLL SOC ITAL WIOL SPAR VTV P1556-V, 55 DEC 59 IT EXPERIMENTAL CONTRIBUTION TO THE STUDY oF THE INFLUENCE EXERTED CT PERIPHERAL TISSUES ON GLOCEMIC HOHEOSTASIA. III. THE GLYCEMIC CURVE FROM INSULIN. * 0 PALVA. C CORDOVA. O I BOMPIANI * BOLL SOC ITAL BIOL SPoR VTS PIS7X-T. 15 DEC 59 IT GLYCERATE EINoSE PHOSPHORTLATION OF D~BLTCEVIC ACID to 2-PHOSPHO.-D-GLYCAMIC ACID WITH GLYCERATE RINABE IN THE LIVER. I. ON THE BIOCHEMISTRY OF FRUCTOSE METABOLISM. II. * B LAHPRECHT, T DIAMANTSTEIN. F HEINZ, P BALDE HOPPE SAYLER Z PHTSIOL CHEM 9310 P97-lIZ. 31 SEPT 59 GEM 1953 BLYCERIC ACID 0 PHOSPHORTLATION oF 1-GLYCERIC ACID To Il-PHOSPHO-D-GLYCERIV ACID WITH BLYCIDRATE AINASE IN THE LIVAR. I. ON THE BIOCHEMISTRY OF FRUCTOSE METABOLISH. II. * B LAMPRECHT, T DIAHANTETEIR. F HEINZ. P BALDE * HOPPE SETLER T PHYSIOL CHAR VOlO P97-112. 35 SEPT 59 OAR SLYCERIDE INFLUENCE OF INSULIN ON THE INCORPORATIOR OF 2-14 C-SODIUM PTRUVATE INTO GLYCERIDE GLYCEROL IN DIABETIC ANDRORMAL BABOONS. N SAVAGE. J GILLMAN. C GILBERT * NATURE LORD ViES pi*S-9, 16 JAN 60 GLYCERIDE GLYCEROL METABOLIC ROLE oF GLUCOBE. A SOURCE OF GLYCERIDE-OLYCEROL IN CONTROLLING THE RELEASE OF FATTY ACIDS BY ADIPOSE TISSUE. * F C WOOD JO.. B LABOAUF. 0 F CAHILL JR. * DIABETES 99 P261-3. JULY-AUG AX GLYCEROL EFFECT oF EPIREAMMIRE ON GLUCOSE UPTARE AND GLYCEROL RELEASE BY ADIPOSE TISSUE IN VITHO. * B LAEDAUF. B FLINO. 0 F CAHILL JR. PROC SOC EXP AIOL MAD 0110 PBZ7-R. OCT-DEC 59 INFLUENCE OF I~SULIR ON THE INCORPORATION OF 2-14 C-SODIUM PYRUVATE INTO GLYCERIDE GLYCEROL IN DIABETIC ANIT NORMAL BABOONS, * N SAVAGE. J GILLMAR, C GILBERT * NATURE LONO ViES P168-V. 10 JAN 60 UNIMPAIRED SYNTHESIS OF FATTY ACIDS AND ALTERED SYNTHESIS OF GLYCEROL OF TRIOLYCORIDES IN DIABETIC BABOONS P. URSIRUS. * N SAVAGE. J GILLHAN. C GILBERT S AFM J HAD SCI 025 P19-TO. APR AX GLYCIDA MATERNAL OLYCIDE NORMAL ASSIMILATION. TOHATO BABY, PRECEDENTS OF HACROSOMIA AND FATAL MORTALITY. B SALVADOMI. O CAGNAZZO, A DALEONARDIS HINARVA PEOIAT 012 P117. 11 FEE 60 IT GLYCINE AN INSULIN ASSAY BASED TN THE INCDRPORATION OF LABELLED OLYCINE INTO PROTEIN oF ISOLATED RAY DIAPHRAGM. * A L MANCHESTER. P J RANDLE. F 0 YOUNG * J ENDOCR 019 P059-AZ, DEC 59 MAINTENANCE OF CARBOHYDRATE STORES DURING STRESS OF COLD AND FATIGUE IN RATS PREFAD DIETS CONTAINING ADDED OLYCINA. * S R TODD. H ALLEN * USAF ARCTIC AERORED LAB TECHN RAP 957-34 P1-lA. JUNE AX GLYCINA C14 RATE OF ASSOCIATION OF STS AND C14 IN PLASMA PROTEIN FRACTIONS AFTER ADMINISTRATION OF NA2ST5IR. GLYCINE-C14. OR GLUCOSE C14. * J A RICHMOND J BIOL CHAM 0234 PZTlT-A, OCT 59 OLYCOGAR GLTCOGAN OF THE ADRENAL CORTEX AND VEDULLA. INFLUENCE OF AGE AND SEX. * H PLANEL. A GUILOEM * C V SOC BIOL PAR 9153 P844-B, 1059 FR AFFECT OF DIET ON THE BLOOD SUGAR AND LIVER GLYCOGEN LEVEL OF NORMAL AND ADRANALECTOHILED RICA. B P BLOCE, 0 5 CDX * NATURE LORD 9184 BUPPL II P721-Z. OR AUG 59 LIVER GLYCOGAR AND BLOOD SUGAR LEVELS IR ADRENAL-DEHADULLAYAO AND AORERALECTOHIZAD RATS AFTER A SINGLE ODGE OF GROWTH HORMONE. * C A Do BROOT * ACTS PHYSIOLPHARRACOL REERL OR PlI7-2D, HAY Al A HICROHATHOD FOR SIMULTANEOUS DETERMINATION OF GLUCOSE AND AETONE BODIES IN BLOOD AND GLYCOGAR AND EATORE EDDIES IR LIVER. 0 HANSEN * SCARD J CLIR LAB IRVAET 012 P1A-Z4. 1960 AN IRVEREE RELATION BETWEEN THE LIVER GLYCOGAR AND THE BLOOD OLUCOSE lo THE RAT ADAPYAD TO A FAT DIET. * P A HAYES * NATURE LONG VSB~ P005-A, 23 JULY 60 LIVER BLUCOSYL OLIOOAACCHARIDES AND GLYCOGAR CAREOR-14 DIDOIDE ESPERIHERTS WITH HYDROCORYISORE. * H 0 SIE. J ASHMORE. R HANLAR, W H FISHHAR * NATIVE LORD 9184 P1380-I. 31 OCT 59 STUDIES ON GLYCOBER BIOSYNTHESIS IN GUINEA PIG CORNEA BY MEANS OF GLUCOSE LABELED WITH C14. * R PHAUS, J OBERBERGEM. J VOTOCEOVV * CASE FYSIOL OR P45-~. JAR Al Cl GLYCOGEN CONTENT sOD CARBOHYDRATE METABOLISM OF THE LEUROCYTES IR DIABETES HELLITUS. * 0 HAEHR BIER Z INN HAD 940 P3TX-4. SEPT 59 OEM GLYCOGEN LIVES. AN IATROOERIC ACUTE ABDOMINAL DISORDER IR DIABATES MELLITUS. * A SCHOTTE. H A LAREAMP, H FREREAL * NED Y GEREESA 01ST PZ2SE-62. 7 NOV SR OUT ACUTE GLYCOGEN INFILTRATION OF THE LIVER IN DIABETES MALLITUS. 2. THE EFFECTS OF GLUCAGON THERAPY. * A SCHOYTE. H A LAREAMP. H FRENEEL * RED T GEREESE 0104 P1288-Ri. 0 JULY AX OUT Figure 7. San~p~e Page, Diabetes Index 47 cssenti4ly the original Luhn format, and it should be noted in this connection that while Luhn recognized that the origin of the KWIC principle lay in the making of concordances, he claimed in particular the use of machines to achieve speed, completeness, and accu- racy, and a novel format. 1/ The most common variant to the center position for the indexing window (or keyword position) is at the left or the beginning of the line. Netherwood's selected bibliography of logical machine design, which is probably the first of the modern permuted title indexes to appear in the open literature, used the left-most positions for the index entry word in each title listing. Slant marks were also printed to show the breaks in the normal order of the title (Netherwood, 1958 L437]) A proposed subscription service, advertized in 1958 but never actually brought into operation, would also have used the left-hand position. In these left position examples, the keyword-in-context principle is kept only partially intact since the word in the index position is directly adjacent to its most specific right-hand context, not to its left-hand. In variations such as developed at Stanford Research Institute, however, the index word is extracted from its context and printed separately in the left-hand margin, with the title in its normal order printed to the right. This type of variation has been called "KWOC", for keyword-out-of-context, and is illustrated in Figure 6, which shows the format developed by C. E.I.R., Inc. for the OTS index to U.S. Government Research Reports. Table 1 lists a number of KWIC index projects for which computer programs are or might be made available to interested additional users. Computer programs have been written specifically for the IBM 650, 704, 1620, 709, 7090, and 7094 data processing systems, the G.E. 225 computer, the Deuce Computer in England, the UNIVAC 1103 and 1107 systems, and the Japanese computer JEIPAC, among others. In addition, some permuted title indexes are produced manually, or with the use of simple business office machine equipment. For example, an index to the MBS Bulletin for 1951-1961 has been so produced by the American Institute of Biological Sciences. 3/ 1/ Private communication, excerpt of letter from H.P. Luhn to C. L. Bernier, December 27, 1960: "With respect to the origin of the KWIC Index, you are, of course, right that it is a form of concordance, as stated in my original paper. Furthermore, keyword indexing has been practiced in various forms as far back as a hundred years ago. All of these methods were, however, de- pendent on manual effort. I would say that the significance of the present KWIC Index is based on the fact that it is produced automatically by machine, affording speed of compilation, accuracy and completeness. As far as the particular format of the Index is concerned, this is novel to my knowledge, in accordance with in- formation I have been able to ascertain from others." 2/ "PILOT--a permutation index to this month's literature", see p.8 and Figure 1. A left-most window full-title format was developed at Stanford University in co- operation with the IBM San Jose Laboratories. It has been applied by the Com- putation Center to the titles of computer pro~rams for the benefit of users of the Program Library Computation Center, Stanford University, "The KWIC Index", 1963. See also Marckworth, 1961 L393] National Science Foundation's CR&D Report No. 11, L430], p.10; Janaske, 1962 [299~; Shilling, 1963 Lsso] and [55~J 48 3/ Table 1. KWIC Type Indexes and Programs References Issuing Organization and/or Investigator Name of Index or Program and When Issued Format P9m?u~ Remarks Service Bureau Corp- "Bibliography and Auto-Index, First edition Z-column, 60-char- IBM 709 Basic Luhn KW oration - H.P. Luhn Literature on Information Re- Sept. 1958 acter single line title trieval and Machine Second edition center window Translation" June 1959 Chemical Abstracts Chemical Titles Semi-monthly Standard Luhn IBM 1401 Service Chemical Abstracts Chemical Biological Bi-weekly-lst Single column 1401 Service Activities issue Sept. Center window, lZ0- 196Z character line, upper and lower case, 1Z0- character 1403 printer Biological Abstracts B. A. S.I. C. Semi-monthly Standard Luhn IBM 1440 Modified Luhn gram: shading used as an aid scanning. Biological Abstracts Biochemical Title Index Monthly Luhn, Chem. 1440 Titles Formats Bell Telephone Lab- -Index to the Literature of Annually Single column, lZO 7090 BE-PIP Progr~ oratories Magnetism character line, available throu -BTL talks and papers Annually center window SHARE organiz All-Union Inst. for " ... an index of Mikhailov, 196 Scientific and Tech- the `Chemical [418] nical Information Titles' type." I Table 1. (cont.) References and Issuing Organization and/or Investigator Name of Index or Program When Issued Format Compute Remarks American Bar Index to Current State Initial issue, Eldridge and DE Foundation, Bobbs Legislation 1963 196Z [183] Merrill American Diabetes Diabetes-related First of Z-column, left GE-ZZB, Association Literature Index proposed series, window, KWOC, Western covering litera- full citation for Reserve ture for 1960, each entry. program issued 1963 American Meteoro- Meteorological and April 1961, Standard Luhn 704 Includes a Syst logical Society Geoastrophysical Titles Oct. 1961, IBM UDC -Subject HE Jan. l96Zand Index as well a 0 following modified KWIC Armour Research Key words in context Two column, 1103, Foundation (reports received in 60-character 1107 document library) line, center window ASTIA (Defense Keywords-in-context Irregularly No. IBM Documentation title index. A list of 1, Oct. 196Z Center) titles for ASTIA docu- No. Z, Feb. ments not previously 1963 announced. English Electric KWIC-type Deuce See Black, 1962 Company Dowell and Ma 196Z [159]. Table 1. (cont.) References Issuing Organization and/or Investigator Name of Index or Program and When Is sued Format Computer Remarks General Electric General Bibliography on Single column, GE-ZZ5 Computer Dept. Information Storage and center window Phoenix Retrieval Gmelin Institute Information Journal for See Koelewijn, Atomic Energy 196Z [330]. Japan Information JEIPAC "The JEIPAC, Center of Science transistorized and Technology mation proces machine.. . been program for automatic mg designed a the IBM KWIC mg system." DNo. 11, [43 p. lZ0-lZl. Lockheed Missiles KWIC Index of Reports Modified Bell 1401/ See Carroll ai and Space Division Labs. 7090 Summit, 196Z Mimosa Frenk KWIC Index to Neuro- August 1961 Standard Luhn IBM Foundation for chemistry IBM Applied Neuro- chemistry M.I.T. KWIC Index to The 1st Edition, Standard Luhn 704 Science Abstracts of December IBM China 1960 Table 1. (cont.) References Issuing Organization and and/or Investi~ator Name of Index or Pro~ram When Issued Format Computer Remarks National Bureau of A Bibliography of Foreign July 1963 Single column, 7090 Byproduct in~ Standards Developments in Machine lZO-character from Flexowr Translation and Informa- line, center tape, citation tion Processing window including uppE lower case, p tape to punchE card conversi Walkowicz, 1' __________________________________________ _________________________________________ [6z9]. National Bureau of -Index to the Communi- Single column, 7090 Youden, 1963 Standards, W. W. cations of the ACM lZO-character and [660]. Youden -Index to The Journal line, center of the ACM window Radio Corporation Significant Words RCA Unpublished r of America Indexed From Title 301 by D. Chmen. and M. Becim Stanford Univ. IBM Dissertations in Physics 1961 Keyword-out- IBM Marckworth, San Jose Labs. of-context, [393]. left window Union Carbide Oak Key Word Index Labora- 1st issue 1963, Bell Labs. Ridge National Lab- tory Reports Received monthly System oratory Libraries Semi-annual Index thereafter January-June 1963 U.S, Atomic Energy Index to Conferences December Bell Labs. Commission, Division Abstracted in Nuclear 1963 System of Technical Info rmatior Science Abstracts Table 1. (cont.) References and Is suing Organization and/or Investigator Name of Index or Program When Issued Format Computer Remarks University of Califor- Key-word-in-title (KWIT) Various Single column, 1401/7090 Records can be nia Lawrence Radia- index for reports issues 120-character machine seard. tion Laboratories line, center with and, or an window not logic University of Unclassified Reports Biweekly Single column, 1401 By-product pre California3 Titles List 120-character paration from Lawrence Radiation line, center owriter of libr~ Laboratories window cards. Turner Kennedy, 1961 University of Kansas Kansas Slavic Index Initial issue 60-character 1401 Farley, 1963 July 1963 Modified JI Chemical LA) Titles University of Kansas, (Space Law collection) 1401 "Current rese~ University of Okla- and developme: homa No. 11, p. 44~ Western Periodicals Permuted Indexes to As available Standard Luhn Advertised reg Company Scientific Symposia IBM ly in various p icals, e.g., JS Libraries In addition to the regularly issued KWIC indexes by Biological Abstracts, Chemical Abstracts Service, the American Meteorological Society and others, a large number of special field, one time, or limited collection coverage indexes of this type have been and are being produced both in the United States and in other countries. Well-known examples include the programs developed at the Lawrence Radiation Laboratories, University of California, which simultaneously produce catalog, cross-reference and subject authority cards, I' and the programs developed at the Bell Telephone Laboratories from 1959 on- ward (Kennedy, 1962 [310]). Other KWIC indexing efforts cover a wide variety of subject matter. In the field of law, applications of KWIC type indexing include work on the legislation of the 50 states, a joint project of the American Bar Foundation and the Bobbs-Merrill Company (Eldridge and Dennis, 1962 [183], 1963 [182]), the ninth annual edition of the Index to Legal Theses and Research Projects, July 1962, (Eldridge and Dennis, 1963 [182]); and a co- operative program between the libraries of the Universities of Kansas and Oklahoma to prepare an index to the latter's `1Space Law) collection. 2/ In 1960, the KWIC Index to the Science Abstracts of China was prepared for an AAAS Symposium) (Henuerson, 1~b1 [ 263]; Farley, 1963 [192]). At the University of Kansas Library also, the Kansas Slavic Index is being produced, with coverage of 3, 000 articles from more than 200 Slavic journals. ~/ In the computer technology field, Youden (1963 [659] and [660]) has com- piled KWIC type indexes to both the Journal of the ACM and the Communications of the ACM and the Western Periodicals Company offers KWIC indexes to the proceedings of the Joint Computer Conferences as well as to the proceedings of other conferences and symposia including those in fields of electronics, aerospace and quality control. 4/ A special-purpose application is in the use of a KWIC-index in lieu of cross-references in a revised edition of Current Medical Terminology. 5/ Examples of KWIC indexing projects abroad include work at the Japanese Informa- tion Center of Science and Technology, Tokyo, an index `1of the `Chemical Titles'type" at the All-Union Institute for Scientific and Technical Information (VINITI) U.S.S.R__7/ an information journal for the atomic energy field being prepared at the Gmelin Institute, (Koelwijn, 1962 [330]), and work in Great Britain both at the English Electric Company 8/and the IBM British Laboratories (Black, 1962 [65]). 1/ Nation Science Foundation's CR&D Report, No.11, [430], p.42. 2/ 3/ 4/ 5/ 6/ 7/ 8/ Ibid, pp.44 and 171. Ibid, p.43; University of Kansas, 1963 [307]. See advertisements in journals such as American Documentation. Gordon and Slowinski, 1963 [236], p.55. National Science Foundation's CR&D Report, No.11, [430], p.120. Mikhailov,1962 [418], p.50. Dowell and Marshall, 1962 [159], p.323; Black, 1962 [65], p. 316. 54 1/ Trans-Canada Air Lines - is using a KWIC System, and at the EURATOM ISPRA labora- tories a KWIC type program has been developed with up to 600-character context and a left-most indexing position. 2/ 3.1.2 Advantages, Disadvantages and Operational Problems of KWIC Indexing Luhn's original acronym, KWIC, is peculiarly apt for permuted title word indexing. As both proponents and critics have noted, the resulting product may be relatively crude in terms of indexing quality, but it is quick. The speed achievable both by elimination of human intellectual effort and by use of machine (especially computer) processing is indeed the major single advantage of this type of automatic indexing. Closely related, however, are the advantages of currency of announcement and the availability of these indexes for individual use. Some typical claims with respect to speed and currency are as follows: "The permuted index was invented as a means of adequately controlling (essentially, of indexing) the literature without further intellectual effort, and thus eliminating indexing delays " 3/ "The great merit of this particular method. . . is that it enables information concerning new articles to be made available very much more quickly than if there were the inevitable delays of human abstracting and indexing " 4/ "In spite of the disadvantages which are pointed out, perhaps the greatest advantage is the timeliness and the speed with which permuted-title indexes can be prepared." 5/ Specific examples of high speed are given by Biological Abstracts, where one hour's computer time suffices to prepare and arrange entries for over 150,000 items. 6/ Kennedy reports for the Bell Laboratories System that: "Editorial scanning is very fast; only several lines of print must be read for each report and the required text markings are trivially few. Keypunching, the largest single task, takes about two minutes per report. .. Main-frame time ... was 12 minutes for 1703 reports " 7/ 1/ 2/ 3/ 4/ 5/ 6/ 7/ Simons,1963 [556], p.34. Meyer-Uhlenried and Lustig, 1963 [417], p. 229. Tukey, 1962 [611], p. 13. Cleverdon, 1961 [125], p.108. Janaske, 1962 [299], p.3. See Biological Abstracts, 36:24, p. xii. Kennedy, 1961 [311], p. 123. 55 Skaggs and Spangler claim: "The most obvious advantage of permuted indexing by computer is speed. In a test of one permuted indexing system, input of 3, 000 punched cards contain- ing titles and running text produced a permuted significant word index of 12,190 index entry lines, with approximately 85 minutes of computer time required for the permuting and sort operations. The output was printed at some 500 lines per minute. ` 1/ In many cases, greater speed and timeliness are achieved at significantly lower cost. This is particularly true if the preparation of the input -- title, author, item identification and other descriptive cataloging information- - serves multiple purposes from a single keystroking operation. Thus, the MATICO System provides from a single input (1) KWIC indexes as required, (2) selective dissemination notices to potential users of new acquisitions, (3) records on magnetic tape for the information retrieval file, and (4) book catalogs covering specialized areas of the collection, all at a net savings over previous methods of $0.39 for each title processed. 21 Another advantage which is typically claimed for KWIC indexes is the use of the author's own terminology. The display of different words as they have been used in title context with any word looked up introduces "suggestiveness" so that different mean- ings and different browsing clues are shown. Kennedy makes the following typical points: "The use of the author's own terms--the alive currency of new ideas--rather than the considered reshapings to the indexing system may often be of advantage. The automatic generation as index entries of all the separate words in multi-term concepts is definitely so. Access is direct, under any one of the component terms, in the unrestricted manner of uniterm indexing. And context minimizes false drops; the author has supplied the term coordination." 3/ Others, however, consider some of these same factors to be definite disadvantages. In general, even among enthusiasts of KWIC, there is more agreement as to the values of the technique as a device for current awareness scanning and as a dissemination index than for its use for more extensive searching. It was, in fact, primarily as a dissemination index that Luhn first proposed the KWIC technique. He pointed out that such indexes could be prepared with minimum effort and be ready for dissemination in the shortest possible time, justifying publication by inexpensive printing means. He also noted the following additional advantages: 1/ 2/ 3/ Skaggs and Spangler, 1963 [557], p.30. Carroll and Summit, 1962 [102], p.4. Kennedy, 1962 [310], p.184. 56 "1. Because of the mechanical method of preparation, more information may be displayed than would have been practicable by conventional means. "2. Keywords-in-context permit the cross-correlation of subjects to an extent not realizable by conventional procedures." 1/ The most common type of complaint against the KWIC indexing method is, as we have noted earlier, identical with that which is applied to word indexing in general--the lack of terminological control. Where the indexing terms are restricted to those used by the author himself, in his title or even full text, there arise many serious problems of synonyms, near-synonyms, homographs, neologisms, and eponyms. The effects of machine inability to resolve these problems are redundancy, scatter of references throughout the index, `1haphazard groupings" 2/ and retrieval losses because the user is forced to guess at the terminology the author actually used. ~ These problems are severely aggravated when only the title is used as the basis for index-word extraction. Thus, a first and major question in attempting to appraise the effectiveness of KWIC- indexing techniques is that of the adequacy of titles alone as the source of subject content clues. Spurred on at least in part by the existence of KWIC-type indexes, several investigators have studied this question, with somewhat different results. Williams has explored for some years the possibilities of developing systematic procedures for title elaboration, especially making explicit information that is implied. Her conclusions are that indexing by title and direct elaboration of the title would produce index information equivalent to that found in Chemical Abstracts for about 50 percent of the documents studied, but that other procedures would be required for the remainder. 4/ Specific studies of title adequacy for a particular journal or field have been under- taken by both the American Institute of Physics and the Biological Sciences Communica- tions Project. In the A. I. P. experiments, graduate physics students were asked to locate from limited clues certain specific articles appearing in The Physical Review, and search times were checked for their use of permuted title and other indexes. Another group of students compared the subject index entries in Physics Abstracts and Chemical Abstracts with the words in the titles of 25 papers from The Physical Review. In the case of Physics Abstracts, 69 percent of the entries for these papers were found in the words of the title and 63 percent of the titles contained all of the information supplied by the set of index entries. In the case of Chemical Abstracts, the corresponding percentages were 47 and 23.5/ These latter findings, for the chemical index, are closely corroborated 1/ 2/ 3/ 4/ 5/ Luhn, 1959, [381] p.295. Olney, 1963, [458], p. 44. See, for example, Dowell and Marshall, 1962, [159], p.324: "This problem of `conceptual scatter' becomes a nightmare when highly idiosyncratic author language is used as a basis for subject indexing." Williatns, 196~ [643) , pp. 36~ -363. Maizell, 1960[392], p. 126. 57 Bernier and Crane who report that for the non-organic chemistry items covered by Chemical Abstracts, 34 percent of the entries can be derived from the titles. 1/ With respect to the Biological Sciences Communications Project studies, Shilling reports as follows: `1Titles of scientific articles are being utilized at present in a great many ways under the general assumption that there is a positive correlation between the title and the content of the article. A study was undertaken to analyze the accuracy of titles in describing the content of biomedical articles. It was conducted in two parts. In part one, a group of scientists were asked to predict the content of selected scientific articles, in their area of interest, from the title, the author1s name, and the name of the journal in which it appeared. The results of the first phase of the study on the first trial journal were so diverse as to make analysis impossible, and this part of the study was not pursued further. From this small segment of the study it appears that scientists are deluding themselves when they search by title only and then decide what they wish to read. "In the other half of this experiment, the article without title, author1s name, or journal name was sent to 20 scientists, selected as experts in the scientific field of the article, who were asked to write a meaningful title. Fifty articles were used, five from each of ten selected biomedical journals. From this part of the study it is apparent that if the article is in a field which is relatively well standardized and has an accepted vocabulary, it is possible for a group of titlists to agree remarkably well on an appropriate title. However, if the article is loosely organized, contains more than one subject, or is in a specialty in which there is no standard vocabulary, then titling scientists fail to agree to a rather alarming extent. _ Other studies involving the question of usefulness of titles alone for indexing purposes include those of Doyle, Lane, Montgomery and Swanson, O'Connor, Ruhl, Swanson, and White and Walsh, among others. Doyle checked the retrieval loss likely to result from the synonymity-scatter problem for a permuted title index compiled in 1958 to the internal reports of the System Development Corporation. He found, for example, that for 12 direct references to McGuire Air Force Base, there were one to "New York Air Defense Sector", two to "New York Sector", ten to "NYADS" and five to "N.Y. Sector". 1/ 2/ 3/ Bernier and Crane, 1962 [56], p.120. Shilling, 1963 [551], pp.205-206. Doyle,~96~ [166], p. 11. 58 Ruhi (1963 [506]) found that between 50 and 90 percent of author-prepared titles (the variation depending on subject field and other circumstances), did fully reflect the index terms assigned to these documents by human indexers. Lane and White and Walsh have also made studies directly related to the question of KWIC index effectiveness. The latter two investigators report only 52 percent retrieval effectiveness for a permuted title index to the Abstracts of Computer Literature, 1962, which they attribute to the changing terminology in the still new field of computer technology. ~1/ Lane made counts of titles that would be "acceptable" and those that would not for a KWIC index for 50 titles drawn from each of 10 published indexes. He concluded that, if there were judicious pre-editing, technical articles in the technical subject indexes could be quite adequately covered, and papers in the fields of law, business, and the humanities somewhat less satisfactorily so, but that for the material indexed in the Reader's Guide to Periodical Literature, the KWIC technique would fail 58 percent of the time. ~l Montgomery and Swanson have studied, as has O'Connor is even more detail, the adequacy of "machine-like indexing by people". Montgomery and Swanson took as their test corpus the September 1960 issue of Index Medicus and found that for 4, 770 items, 85.8 percent contained either the word itself or a synonym for the subject heading assigned, slightly over 11 percent did not, and in the remaining cases the investigators could not clearly decide. They concluded, therefore, that: "Most of the articles studied could have been indexed by machine on the basis of machine `inspection' of article titles alone." 3/ O'Connor, however, typically reports that of a random sample of 50 papers manually indexed under the term "Toxicity", five had titles which contained the word "toxic" or the word "toxicity" and 34 had titles which were not even indirectly connected with the term. ([;443], [444], [445], [447] and [448]). With respect to the Montgomery- Swanson conclusions as such, Carlson raises the further critical questions of over- assignment and false drops and suggests that: "a simple machine processing of titles would give us way too much or practically nothing." 4/ Research activities at the American Bar Foundation have included checking of KWIC type indexing of several thousand legal articles with the subject headings assigned under the "Index to Legal Periodicals" system (Kraft, 1962 [333]). It is reported that: 1/ 2/ 3/ White and Walsh, 1963 [639], p. 346. Lane, 1964[345], p.46. Montgomery and Swanson, 1962 [421], p. 359. In another study (1962 [534], p. 468), Swanson reports findings for several thousand entries in classified bibliographies where approximately 90 percent of the sampled items contained title words that were identical, or similar in meaning, to the subject headings under which they were indexed. He notes, however, that similar results could have been produced by machine processing with the sigrnficant p7oviso that the machine have available an adequate synonym dictionary or thesaurus. G. Carlson, 1963 [100], pp.328-329. 59 4/ "Interpretation of data revealed, among other things, that 64.4 percent of the title entries contained as keywords one or more of the ILP subject heading words under which they were indexed, and 25.1 percent contained logical equivalents. The remaining 10.5 percent of the title entries had non-descriptive titles. The difficulties with titles as sources of the indexing information stem from at least three distinct types of determining factors: (1) the language habits, background, interests, and idiosyncracies of the author; (2) the interests, familiarity with the subject matter, language habits, imagination, and idiosyncracies of the user, and (3) factors largely extrinsic to either the particular author or the particular user. In the first case, we find especially the problem of the witty, punning, deliberately non-informative title, the so-called `1pathological title". Janske gives the provocative example, in the literature of information selection and retrieval itself, of "The Golden Retriever". 2/ Even in the non-pathological case, however, there is the serious question of whether the author him- self is likely to be a good indexer 3/ On the user side, the normal critical problems of "bringing the vocabulary of indexer and searcher into coincidence" (Bernier, 1953 [55]) are aggravated by the facts that the user of KWIC must anticipate the terminology used by a large number of different "indexers" (i. e. , the authors), that title words spelled the same but with quite different meanings in different special applications are grouped together in the same place in the index, and that the same concepts may be expressed in quite different phraseology depending on the author's, rather than the user's, field of specialization. these aggravating circumstances there must be added in turn the psychological accept- ability to the individual user of the scatter and redundancy, to say nothing of the format and legibility, of a particular published index. To Such factors affecting the particular user will of course vary with the nature and pur- post of his search. Kennedy points out, for example, that the location of a document from only a single clue, a single title word, is particularly easy with a permuted title index and he emphasizes that the "index purpose, use, size, statement and array are other factors of considerable moment in judging the value of title indexes". 1/ 2/ 3/ National Science Foundation's CR&D Report No.11, [430], p. 62. Janaske, 1962 [299] , p.4. See, for example, a report on a conference on better indexes for technical literature, ASLIB Proceedings, 13:4, April 1961, with a number of statements on the author as a poor indexer. See also Crane and Bernier, 1958 [144], p. Si5: "Not even authors are qualified to index their own work unless they are equipped for the task by train- mg and experience 4/ Kennedy, 1961 [311], p. 125. 60 A major question in the area of user acceptability, however, is that of the adequacy of title alone to tell the searcher whether or not a specific document is relevant to his query or interest. A number of investigators, both documentalists and user-scientists, suggest that this is rarely the case. 1/ In fact, for many users, titles alone provide only a negative searching device--in an announcement bulletin or abstract journal the user's scanning of titles merely tells him whether or not he should read the abstract and then perhaps go on to the paper itself. It is for reasons of this type, in all probability, that Montgomery and Swanson found less effectiveness of titles on *re1evance~judgment tests than might be suggested by their more optimistic findings as to the success of machine procedures for replicating human subject heading assignments. Whereas they have claimed that about 90 percent of test items could have been as successfully indexed by machine as by manual procedures, (Montgomery and Swanson, 1962 [421]; Swanson, 1962 [584]), they have also reported that: 1'Comparison of title relevance judgment with judgment based on full text examina- tion indicates that titles are only about one-third effective (i.e., two-thirds of the relevant articles would be judged irrelevant) as the basis for estimating the relevance of the article to a given question". 2/ They go on to suggest, therefore, that ". . indexing should be based on more than titles and. . . a bibliographic citation system should present to the requester something more than titles. 1' 3/ Similarly, Jahoda reports in an analysis of 281 actual search requests at Esso Research and Engineering that only two-thirds could have been answered with a shallow index based on titles and major section headings of the documents and that answering the remainder of the requests would have required an index of considerable depth. 41 The obvious factors affecting the utility of titles as the source of indexing~searching clues include, first, the limitation of most titles to the principal subject matter, the main topic or topics of the document. The display of title context does to some extent provide for modifications of the topic to the special aspects treated, but it is of course obvious that a title cannot possibly provide clues to subject content not implied in the words of that title. In many cases, the potential user wants information contained in the paper, or even 1/ See, for example, Atherton and Yovich, reporting on evaluations by physicists of experimental citation indexing, 1962 [26], p. 22: "The reliance on titles of papers for retrieval purposes was not sufficient"; Levery. 1963 [359], p.235. "Titles are usually insufficient to furnish a correct index to the text"; Hocken, 1962 [274], p. 93: "The titles were not explicit enough"; Crane and Bernier, 1959 [145], p. 1053: "Li sts of titles can be prepared rapidly, but they are inadequately useful in selecting articles of interest, and they provide little or no directly usable ~ Dowell and Marshall, 1962, [159], p.324: "Frequently titles either lack sufficient detail or are in fact misleading"; Connolly, 1963 [136], p.35: "Most titles are inadequate as descriptions of the contents of papers." 2/ 3, 4' Montgomery and Swanson, 1962 [421], p.364. Ibid, p. 366. Jahoda, 1962 [298], p. 75. 61 in its appendices, which was not the principal concern of the author and may not even have been considered significant by him. The claim that the author, who knows his own subject best, has already indexed his paper best by his choice of words and emphasis in text, and especially in his title, is pertinent only to that main subject to which he addresses himself, not to the other potentially useful information which he may also disclose. Other extrinsic factors affecting title adequacy and hence the effectiveness of title- indexes are the size and the relative homogeneity or heterogeneity of the collection or set of documents so indexed, the breadth or narrowness of the subject field or fields covered, the time period covered and whether for one or many fields. Whether or not material in more than one language is included is a special factor. These various factors interact in various ways, usually with disadvantageous effects when even the most "nondescript" human indexer (that is, one who accepts only words from the text itself) is replaced by "a keypunch operator whose job it is to convert the keywords into machine-readable form, and a machine whose job it is to assimilate machine-readable text and print out its per- mutations with each significant word serving as an access point." 1/ The difficulties of subject scatter, synonymy, homography, redundancy, and the like, however, will also occur in human indexing that relies heavily1on title only, which is perhaps more frequently the case than is generally recognized, - just as much as for machine-generated indexes involving the permutations of keywords in titles. Such dis- advantages must therefore be balanced not only against the advantages of speed, timeliness, having an index announcement tool personally available at low cost, and the like, but also against the probability of obtaining as useful a tool within the limits of available human indexing resources and justifiable costs. Cleverdon, for example, comments as follows: "There are those who would say that this [KWIC] can in no way be called indexing, and that the value of such indexing must be very much lower than that done by intelligent trained human beings. This is a comfortable thought, but such small evidence as is at present available makes it appear doubtful as to whether it is entirely true. This is not to say that a human being cannot do a better job, but it certainly appears likely that the cost of employing a human being to do it is of doubtful economic value." 3/ 1/ 2I Herner, 196z [266], p.4. See, for example, Moss, 1962 [425], p.39: "I am convinced that a great many of the UDC and other numbers which are provided on millions of cards in technical libraries up and down the country, and which look so erudite, are, in fact, no more than cards transliterating titles, with occasionally similar transliteration of a few randomly chosen words from the abstracts as well. . . We are, in effect, already largely using title indexing and complicating it unnecessarily by magic numbers." See also Crane and Bernier, 1958 [144], p. 514: "Some indexes to periodicals, particularly word indexes, are merely indexes of titles of papers or of abstracts." Cleverdon, 1961 [125], pp.107-108. 62 3/ It is also of interest to note, moreover, that the very existence of machine-generated permuted title indexes should greatly increase the likelihood that authors will use better and more useful titles. 1/ At a seminar on word and vocabulary byproducts of permuted title index~ng held at Biological Abstracts headquarters on October 8, 1962, Rigby of Meteorological and Geoastrophysical Abstracts reported informally that as of that time there was already discernible improvement in titles covered by their KWIC index. In the same year (1962), Tukey similarly stated that: "Chemjcal Titles has been heavily enough used to affect the construction of titles of papers on chemical subjects. " 2/ Instructions to authors of the previously mentioned 11Short Papers" 3/ for the A. D. I. 1963 Annual Meeting specified that at least six significant words should be included in their titles and nearly all authors did in fact comply. Two of the "Short Papers" are specifically directed to the topic of improvements that authors can make in writing their titles (Brandenberg, 1963 [80]; Kennedy, 1963 [312]). Instructions of this type can be effectively used for situations where all authors are under the same administrative control, as in the internal reports prepared in a single organization. This type of situation, incidentally, is one for which KWIC proponents are often most enthusiastic (Kennedy, 1962 [310]; Black, 1962 [65]; Linder, 1960 [362]). Finally, there is considerable promise that pressures brought to bear by journal editors of the publications of professional societies, notably the American Institute of Chemical Engineers and other cooperating member societies of the Engineers Joint Council, will result in improved adequacy of titles and thereby increased effectiveness of title word indexes. Certain other disadvantages of KWIC indexing techniques, however, relate specif- ically to operational problems and requirements in the machine production of these indexes. There is, first, the problem of the amount of context that is usually displayed--that is, the question of line length--and the related problems of title truncation and wrap-around. As Kennedy notes: "Progressive shifting of the title to bring a given word to the indexing column frequently causes portions of the title to exceed the line space available, first at the right margin, then the left, or even both simultaneously. " 4/ A case in point is the perhaps apocryphal "EROTIC TENDENCIES AMONG TRAPPIST MONKS" where "ATHEBOSCL" had been dropped off at the left. For multi-column KWIC indexes, in particular, where the line length is typically 58-60 characters, "much of the relevance is lost because the reader sees the wrong slice of the title". 5/ The Bell Laboratories KWIC index, 6/ Chemical-Biological Activities, 7/ 1/ 2/ Tukey, 1962 [611], pp. 9-10. 3/ Luhn, 1963 [376] and [377]. 4/ 5/ 6/ 7/ See for example, Black, 1962 [65], Kennedy, 1961 [311], p. 117. Brandenberg, 1963 [80], p. 57. Kennedy, 1961 [311], p. 118. Figures 4 and 5. p. 317; Youden, 1963 [658], p. 332. 63 and Youden's indexes to ACM papers (1963 [659] and [660]) illustrate single-column formats that alleviate this problem by extending the title line to 103-106 characters, ex- clusive of the identification code. Youden has calculated that for the titles in the field of computer literature which he analyzed 30 percent of the titles would have been truncated in 60-character title line formats, but that only 2 percent would have been chopped by 103- character title length limits. 1/ A second disadvantageous effect of machine production requirements in most KWIC indexes is the tedious sequential scanning necessary because of the unbroken organization of the page format and the long blocks that occur for frequently occurring word entries. Doyle (1959 [168], 1961 [166]) has investigated this problem of block length and suggests either that alphabetization be carried out to the 1words following those in the indexing window or that the entries in the block be permuted also in a second-order cycle. The latter suggestion has the advantage of facilitating any two-term coordinate indexing type of search, "because one can now look up directly any pair of subject words, regard- less of whether or not they occur adjacently in a sentence.' 2/ Redundancy in KWIC indexes, which aggravates the sequential scanning and the long- block fatigue effects, is in large part the result of difficulties in establishing the most appropriate bounds for exclusion or "stop" lists. We have previously distinguished machine-generated indexes of the derivatiy e type from certain of the machine-compiled indexes primarily on the basis that in the first case, the criteria for determining the significance of the keywords to be used as the index access points are applied auto- matically during the machine processing, even if the selectivity so achieved is only "negative selectivity. " The amount of index entry redundancy, of too many entries and of irrelevant entries is, in simple KWIC indexing, a direct function of the length and contents of the stop list. In Luhn's original proposals for both KWIC and other types of automatic indexing, he pointed out the importance of the rules which must be established in order to differentiate the significant words from the nonsignificant. He says, for example: "Since significance is difficult to predict, it is more practicable to isolate it by rejecting all obviously nonsignificant or `common' words, with the risk of admitting certain words of questionable value. Such words may subsequently be eliminated or tolerated as `noise'. A list of nonsignificant words would include articles, conjunctions, prepos4tions, auxiliary verbs, certain adjectives, and words such as `report','analysis', `theory', and the like." 4/ 1/ 2/ 3' 4/ W. W. Youden, 1963 [458], p.331. Doyle, 1961 [166], p. 13. Artandi, 1963 [zo], p.15. Luhn, 1959 [381], p.289. 64 Interesting variations are to be noted in the current practices of using stop lists. Some lists are quite short, and others extend to several thousand words. Parkins reports that a mere 14 words on the stop lists used for B. A.S.I.C. are responsible for 80 percent of the title lines that need not be printed, but that their original list of 200 stop words grew quite rapidly to more than 1, 000 now in use. 1/ ChemicalAbstracts Service representatives reported in 1962 an initial list of about 1, 000 words which dropped to 300 at one time and then was increased again to the original level. 2/ Using a stop list of 82 words eliminated 30 percent of a 42, 000-word corpus of internal reports at the System Development Corporation, (Olney, 1961 [456]). Critical questions in the establishment of stop lists relate to the problem of balancing the economics of the number of title lines to be printed and to be subsequently scanned against the loss of retrieval effectiveness if certain words are omitted from the search entry positions. How this balance should be achieved may vary from one subject field to another and between different organizations. In several regularly published KWIC indexes, the actual list used to exclude the presumably nonsignificant words is printed so that the user can check before proceeding to actual search. Williams has suggested that each excluded word be listed once, in its proper alphabetic place in the index, if it occurs in the titles of the particular set of items being indexed. 3/ In general, however, not enough is yet known about the requirements of particular subject fields and particular types of organization to arrive at the most effective compro- mises in establishing exclusion lists for keyword indexing. Noting that stop lists in actual use vary from only a few function words such as prepositions and conjunctions to lists several hundred words long, Brandenberg points out that: 11At the present state of the KWIC indexing art the selection of stop words appears to be largely arbitrary and a comparison of half a dozen stop lists shows that they have about two dozen words in common. 11 4/ Kennedy and Doyle both specifically suggest that more research on the contents and effects of stop lists is necessary, (Kennedy, 1961 [311], 1962 [310]; Doyle, 1963 [162]), but Kennedy points out the ease with which the machine programs themselves can be used for modification of the lists. 5/ 1/ 2/ 3/ 4/ 5/ Parkins, 1963 [466], p.27. F. A. Tate, discussions at seminar on the word and vocabulary byproducts muted title indexing, Biological Abstracts headquarters, October 8, 1962. of per- T. M. Williams, discussions at seminar on word and vocabulary byproducts of per- muted title indexing, Biological Abstracts headquarters, October 8, 1962. Brandenberg, 1963 [80], p. 57. See also Clark, (1960 [123], p.459), who suggests: "It is very probable.. .that the cut-off points [for most common, for very infrequent, words] will have to be adjusted to the material we actually use. The effect on the process of such factors as style, size of text, the complexity of the subject matter, and the like, is as yet not clearly seen. The collection of large amounts of text and their analysis will undoubtedly be the best way of determiningthe effects of these variables." 65 Some of the reasons for keeping stop lists short, however, may reflect unnecessary programming difficulties. Turner and Kennedy have reported that in the SAPIR system a title word is compared only with the group of nonsignificant words that have the same number of characters, in order to reduce the machine time required for the exclusion list search. 1/ Skaggs and Spangler give an account of an exclusion list system developed for general text processing as follows: "A representative form developed by General Electric is composed of three groups of words, high frequency, special and standard. The high frequency words (25) occur most frequently in English text. A compression of approximately 35 percent will occur for most kinds of text when these 25 words are deleted. The special words are derived from the particular body of text being processed The com- position of this group is left to the program user. Normally the words for this group are selected by making an Editing list in alphabetical sequence. The words appearing in the index position on the preliminary listing are then reviewed. "Standard words are words that occur with a relatively high frequency in most types of text and therefore are appropriate for a general purpose screen. In the GE program, 375 words are used in this group. "To minimize computer processing time, it is desirable that words in the Ex- clusion Dictionary be arranged in approximate order of their frequency of occurrence." 2/ It should be noted, however, that in most cases stop list searches can be programmed in the form of so-called "logarithmic", "partitioning" or "bifurcation" searches in which the number of machine operations required is only log2N + 1, where N is the number of words in the list. The more words excluded, the fewer the title entry lines that must be included in the final index. This is a factor involving first of all the user in the sequential scanning he must do, where, as Coates has remarked, the retrieval effectiveness is usually in inverse proportion to the amount of such scanning required. 31 Secondly, longer stop lists help to minimize the long block problem, since it is obviously the most frequently occurring title words that have not been excluded that cause the longest blocks of entries. 1/ 2/ 3' Turner and Kennedy, 1961 [614], p.7. Skaggs and Spangler, 1963 [557], p. 29. Coates, 1962 [134], p. 430. 66 The important economic factor, however, is the total number of lines to be printed in the index, which is directly reflected in page costs. The effects of page costs, in turn, engender compromises in printing quality, such as page format and size of type. These are among the serious unresolved problems that affect user acceptance of KWIC indexes and involve questions of format, legibility, character sets, and size of the index. In general, however, in the present state of the art of KWIC indexing, the consensus seems to be that of qualified praise, especially for the early announcement and dis- 1/ semination applications. The KWIC index is recognized as responding to a definite need,- as having merit for fields in whi~h more conventional indexes do not exist as well as for current awareness searching,21 as receiving excellent response from users "because they can take a handy booklet, sit down at a table and look under the words they know and use, and which they expect other engineers to use in titles. 3/ Bernier and Crane, after considering comparative effectiveness data for subject as against word indexing, come to the following conclusions: `1Title lists keyed by words have value for quick distribution and fast use since time is often a very important element in the obtaining of information. Such lists do not serve adequately for thorough searching. ... A title concordance may be more use- ful than would seem from the . . . data on index entries. However, it must obviously be incomplete, must have many unnecessary entries, and would not prove suggestive enough to users who lack background in the subjects sought." 4/ Additional benefits can quite readily be obtained by taking advantage of the biblio- graphic information once it is in machine-readable form to provide selective KWIC indexes (Ba1z and Stanwood, 1963 L28],' Black, 1962 [65j; Carroll and Summit, 1962 [lOZj') machine retrieval of item citations by specified keywords. (Kennedy 1961 ~11]) and selections of items geared to a Selective Dissemination of Information System (Barnes and Resnick, 1963 [36]; Balz and Stanwood, 1963 [28]). Gallianza and Kennedy at the Lawrence Radiation Laboratory, for example, report as being under development programs for the IBM 1401 and 7090 computers which will combine KWIC type indexing features with the logical search operators "AND", "OR", and "IF" in order that users may specify subject searches in ordinary English language terms. 1/ Clapp, 1963 [122], p. 7 2/ 3/ 4/ 5/ Markus, 1962[394], p.19. Black, 1962 [65], p.316. Bernier and Crane, 1962 [56], p.120. National Science Foundation's' CR&D Report No.11, [430], p.42. 67 3.2 Modified Derivative Indexing Some of the more obvious of the disadvantages of KWIC indexing techniques can be reduced if not eliminated by a variety of human and machine procedures. These include augmentation of titles to provide additional clues to subject aspects, manual post-editing, and synonym reduction through such devices as thesaurus lookups. The ink was scarcely dry on the first issues of a KWIC index before a number of suggestions for improvements, modifications, and augmentations were proffered in the literature. In fact, both Luhn and Baxendale considered various possible refinements in their original proposals. The first systematic review of work in the field of automatic extracting- -whether to produce indexes or abstracts, or both- -was made by Edmundson and Wyllys in 1961[(181]. They covered not only the KWIC type indexes as such, but also modifications suggested by Baxendale, Luhn, Oswald and others, and they themselves advanced a number of additional possibilities. Of the various modifications and refine- ments that have been suggested, the most obvious is that of title augmentation. 3.2.1 Title Augmentation The machine-prepared index that was probably the first to go into productive opera- tion is actually one involving title and subject indicators rather than pure keyword-from- title permutations. The CIA project, beginning in 1952, is based upon manual pre- editing of the titles themselves, with the words to be picked up as index entries being underlined. In addition, it involves assignment of other words, descriptors or terms from a hierarchical classification schedule to indicate additional access points (Veilleux, 1961 [624]. In later KWIC type indexing, the possibilities of improving effectiveness by pre- editing or post-editing to modify and expand titles have been suggested and explored by a number of investigators. The semi-automatic indexing reported by Janaske adds descriptive words or phrases in parentheses at the end of titles and uses them as additional indexing points (Janaske, 1962 [299]). At Biological Abstracts Service, improvements have been obtained (without sacrifice in the speed desired in order to index 5,000 abstracts twice a month) by title supplementation as well as by an improved stop list and by post-editing word divisions and word recombinations. 1/ Titles for each of two 12, 000-item bibliographies in the field of radiobiology are reported as being edited considerably before KWIC type processing. 2/ Other examples3?f modified derivative indexing based on title augmentation include Chemical Patents -, the Applied Physics Letters indexing project at Oak Ridge National Laboratory, which provides for an author- prepared form to describe features of property and method not covered in the title, 4/ and the KWIC Index to Neurochemistry ([420]). 1/ 2/ 3/ 4/ Parkins, 1963, [466], p.27. Davis, 1963 [lS0i,p.238. See Markus, 1962 [394], p. 19, and ref. [662]. Connolly, 1963 [136], p.35. 68 To some extent, however, the use of human editors to improve the product of KWIC type indexing defeats the initial purpose of a quick and purely clerical or mechanical process. Thus, Dowell and Marshall argue: "...The basic permuted-title index can be substantially improved by editing and re- writing the titles before they are submitted to the computer. . . . But this of course, destroys the great advantage claimed for the permuted title index, `that it is a purely clerical process'. Intellectual effort has entered the picture again and we are back where we started.' 1/ In the extreme case, the re-introduction of intellectual effort is in effect the re-introduc- tion of conventional human indexing, with the machine's role limited to that of compilation, as in the case of the "notation-of-content" statements prepared for NASA's STAR System (Slamecka and Zunde, 1963 [561]; Newbaker and Savage, 1963 [430]). Kennedy suggests instead, therefore, that the augmentation might be accomplished by the authors themselves. However, it may then be pointed out, as by Bernier and Crane, for example, that the supplementation of titles before publication in order to provide suitable additional indexing words would be "awkward, space~consuming and difficult". They continue: "It would call for the attention of index experts at the manuscript stage, which would delay publication and expand the total indexing effort. Furthermore, good, thorough indexes are based on the full information of abstracts and papers, not on their titles only." 2/ An alternative method for title augmentation to improve the quality of KWIC indexing is therefore to establish procedures for machine selection of significant words from more of the text than just the titles alone. In fact, Luhn himself did not limit his technique as originally proposed to titles only but indicated that the process could be performed at various levels: title, abstract, or full text. 3/ In the 1958 permuted index to the ICSI preprints, entries were derived from titles, author's names, author affiliations, headings withinthe paper, figure and table captions, and sentences and phrases taken directly from text. ~4I Combinations of human and machine procedures based on sentences and phrases selected from text are described by Herner who cites a two-fold advantage: "First, it is not wholly dependent on the informativeness or lack of informativeness of titles and bibliographic citations, and, second, it affords a greater depth of analysis than is generally possible where titles or bibliographic descriptions alone are used." 5/ 1/ 21 3' 4/ 5/ Dowell and Marshall, 1962 [159], p. 324-325. Bernier and Crane, 1962 [56], p.117. Luhn 1959 [381], p. 289. Citron, et al, 1958 [120], p. i. Herner, 1963[264], pp. 1-2. 69 Taking more text as the basis for automatic derivative indexing adds, of course, the problems and costs of keystroking additional input material. At the same time, most of the major problems of scatter of references, synonymity, redundancy and exclusive reliance on the author's own language and terminology not only remain but may quite probably be intensified. The problems of establishing suitatle rules for selection of significant words are aggravated, not only by the far larger number of different words to be processed, but because of unresolved problems in effectively relating length of index and depth of indexing to the length of the document. 1/ There are, however, a number of practical suggestions by which machine augmenta- tion of titles might be accomplished. First is the invariant selection of words that are capitalized, other than those that begin a sentence. As Wyllys points out, this type of selection criterion would emphasize proper names, and these in turn might be particularly valuable clues, especially in a military intelligence situation. 3/ It has also been suggested that the selection criteria should depend on particular pre-specified contexts, such as being preceded by the words: "the results were...,", "in conclusion ...", and the like. A second type of machine selection procedure is the converse of the exclusion or stop list, namely, an inclusion list or dictionary which may involve especially significant words for a particular subject matter area or words that are of importance to a particular organization. In the discussions of the Area 5 ICSI papers it was remarked: "Another complication is that mechanized indexing finds in a paper what was important to the author. What happens if there is something in the paper not important to the author but of importance to the indexer? One possibility is to have a list of words and phrases expressing the interests of a particular collection, which the machine looks for in the papers. If this word or phrase occurs even once, it should be picked up as an indexing term." 4/ 1/ 2I 3/ 4/ See, for example, Wyllys, 1963 [653], p.22. See Luhn, 1959 [371], p. 52; [384], p. 8. Wyllys, 1963 [653], p.15. ~ee Ref. [578], p. ~263. See also, among others, Luhn, l9~9 [37~] , p. 52: "Just as common words have been eliminated by look-up in a special index, certain essential words may be looked up in another special index for the purpose of listing them under any circumstances". 70 This approach to the selection problem can be combined with other devices, as in the "Selective Dissemination" system described by Kraft in which keyword extraction indexing is applied to abstract, title, author's name and manually assigned index terms, after processing of all input material against both "in" and "out" dictionary lists. 1/ The use of abstracts rather than full text as source material makes the selection criteria problems somewhat less severe. In addition, there is evidence to suggest that the abstract does contain much of the significant information that would normally be indexed and the text of the abstract is therefore a fertile field for title augmentation. In experiments conducted by Slamecka and Zunde on the comparison of indexing terms manually assigned with the occurrences of the names of these terms in abstracts used in NASA's STAR system, it was found that 80.4 percent of the assigned terms were contained in the abstracts. 2/ Swanson, on the other hand, suggests that, at least for short articles having homogeneous subject matter, title and first paragraph "are nearly as good as full text , 3/ A combination inclusion-exclusion list system may involve prior "weighting for relevance "of words that are judged by human analysts to be significant for purposes of search and retrieval, as suggested by Swanson, for example: "The computer first separates those words which are important for purposes of information retrieval from those which are unimportant. This is accomplished by means of looking up each word in an alphabetized word list with which the computer is furnished. Each word in this word list carries a `weight' which reflects an estimate of its importance for retrieval purposes. Words of zero weight are completely unimportant and discarded by the computer for indexing entries." 4/ Continuing work at Thompson Ramo-Wooldridge on automatic indexing methods includes further investigation of assignments of relevance weight estimates to words and phrases, (1959 [490] and[491], 1963 [602]). 3.2.2 Book Indexing By Computer For internal indexing, that is, the subject indexing of the contents of a single book or report, automatic indexing experiments are usually directed toward the processing of full text, with use of stop lists of various lengths. The work of Artandi for her doctorate 1/ 2/ 3/ 4/ Kraft, 1963E334], pp.69-70. Slamecka and Zunde, 1963 [561]. In addition they report (p. 139) that a large number of the terms not found were "either broad, general terms (i.e., `device') or generic level concepts of terms contained in the abstracts." Swanson, 1963[580J, p. 1. Ibid, p. 1. 71 at Rutgers in indexing of a book by computer programs (1963 [zo] and [22]) is an example of such modified derivative indexing. Specifically, Artandi's method involves: (1) Establishment of a list of key terms appropriate to a given subject area to be used as an inclusion list for word extractions from text. (2) Application of an appropriate syndetic apparatus to be used in the compilation and ordering of the inde~ entries. (3) Means for the automatic selection of index entries other than those on the pre-specified inclusion list, especially for the selection of proper names. The text used by Artandi for her study consisted of a 59-page chapter on halogens from J. W. Mellor1s Modern Inorganic Chemistry. This text was keypunched with special tags being assigned to indicate the page numbers and the incidence of capitalized words in the text. Text words greater than three characters in length were first checked against the inclusion dictionary of `1detection terms". There was, in addition, an "expression term" dictionary which constituted the vocabulary of the final index and in which a given expression term might or might not be identical with the corresponding detection term. Cross-references were supplied by a program routine which checks the index term list against a list of expression terms with their detection terms grouped under them and which compiles cross-reference entries, one for each detection term associated with an expression term appearing on the index list. For her experimental corpus, Artandi's program developed 363 page references, 138 different index entries and 35 cross-references. She compared these results with those obtainable by conventional human indexing with respect to the factors of heading density (ratio of number of entries to number of words in the book), entry density (ratio of the number of page references to the number of pages), and distribution (ratios of entries for chemical compounds, proper names, and subject entries to the total number of entries. No indexing errors were found in the computer-generated index for a 5 percent random sample of the pages of the corpus, but five Omissions were found in the machine indexing of these sample pages. Artandi concluded, however, that although the quality of indexing appeared favorable, the costs, which approximated $1.50 per page indexed, were impractically high. Book indexing by computer has also been investigated by Maloney, Dukes, and Green at the Army Biological Laboratories, Fort Detrick, 1/ Maryland.~ Input is based on the by- product paper tape generated when the manuscript is typed on a tape typewriter. The paper tape is in turn converted.to punched cards which are then processed by a UNIVAC SS-90 II computer in an editing run that deletes unrecognizable codes and then stores page, 1/ C. J. Maloney, private communication. A report by C. J. Maloney, J. Dukes, and S. Green, "Indexing reports by computer" is in process of preparation for publication. 72 line, sentence number and other reference identifications. After re-processing against a stop list of common words, all other words in the edited text are selected as candidate index entries, these are then sorted into alphabetical order with subsequent printout giving each word occurrence followed by the entire sentence which contained it and the page and other location identifications. This computer output is then post-edited manually not only to eliminate trivial entries but also to normalize terms and phrases used. 3.2. 3Modified Derivative Indexing - Baxendale's Experiments As has been previously noted in the introduction to this report, the name of Phyllis Baxendale together with that of H. P. Luhn is generally accorded credit for pioneering efforts in the entire area of automatic indexing.Baxendale in particular is generally credited with the first actual experiments in modified derivative indexing. In investiga- tion beginning in the late 1950's, she has explored not only statistical approaches to automatic selection of index terms (based for example on word frequencies) but also the use of word pairs, word groups, contextual associations, and in particular the subject- indicating clues of prepositional phrases (Baxendale, 1958 [41], 1961 [40], 1962 [42]; Becker, 1960[44]; Edmundson and Wyllys, 1961 [181]). Baxendale began by considering the patterns of scanning that humans typically use to select `1topic" sentences, phrases and words, and she then proceeded to simulate by computer program the selection of phrases consisting primarily of nouns and modifiers. In her first experiments, (1958 [41]) she used two methods of automatic selection. In the first procedure, words serving the grammatical functions of pronoun, article, auxiliary verb, conjunction and the like, were deleted by stop list lookup. Frequency count statistics were then derived for the remaining words. In her second procedure, the computer was programmed to select prepositional phrases from text and to use the four words succeeding the preposition as index entries unless an additional preposition or a punctuation mark is first encountered. In later experiments, Baxendale has explored possible grammatical models "which would select all and only nouns or adjective-noun combinations". 1/ Taking as an initial corpus a sample of document titles, rules were devised to reject for human analysis titles with question-marks and the like, to eliminate numeric information and single symbols, and to segment the title into its component clauses and phrases by the detection of commas, periods, and similar clues. By list lookup, certain words are identified as capable of serving the syntactic functions of being quantifiers, prepositions, or clause introducers. Special subscripts are then assigned to these words and the subscripts are examined by machine to provide further segmentation; to delete quantifiers, auxiliary verbs, or words ending in "ed" or "mg" and preceded by an auxiliary verb, and to deter- mine relationship functions between the remaining, presumably substantive, words. Still other work by Baxendale has been directed toward the development of frequency of co-occurrence or textual association of candidate indexing terms. She reports as follows: 1/ Baxendale, 1961 [40], p. 209. 73 "[In the frequency matrix~ . . the diagonal elements . . give the total frequency of an index term and the off-diagonal gives the frequency of co-occurrence of two terms. The diagonal of the `context' matrix represents that portion of the total vocabulary with which an individual term has been coordinated, and the off-diagonal the extent to which two terms have common context. . . Such matrices give a basis for examining the extent to which terms are generic or specific within the context of the collection of documents. One can speculate that terms occurring with high frequency and wide context, i.e., with frequencies distributed amongst all or nearly all off-diagonal elements of the matrix are of such broad connotation as to be indifferent discrimina- tors of content . . . The frequency and context matrices can again be used to deter- mine the modifiers with which they can most r~eaningfully be coupled for the collection of documents being considered. 11 11 Finally, Baxendale notes that on the basis of her studies it should be possible to select quasi-subject headings based on frequency counting criteria, but then to order the remaining vocabulary of selected terms according to contextual measures of association which are semantic, syntactic, or statistical in nature. Fxperimental results for a collection of 1, 500 documents included semantic associations between "searching" and "retrieval", syntactic associations of "machine" or "literature" with "retrieval", and the apparently misleading association of ~~metal~! with `1retrieval" which, however, had statistical significance within the particular document sample. 2/ Other investigators who have explored noun-adjective clues for selection include Anger, Chonez, Langleben and Shumilina, and Swanson. Anger looked for relationships indicated by syntactic dependencies or by noun-adjective and adjective-adverb linkages, and gave in an appendix a suggested program for phrase inversions. 3/ Chonez has described a computer program which by recognizing "separating" words, especially prepositions, and applying "pseudo-grammatical" rules compiles an index to English language items in the fields of ionized gas physics and thermonuclear fusion. It is claimed that: "The subject index thus prepared is similar in presentation to Luhn's KWIC indexes, but is fundamentally different in conception and is in fact intermediate between... (this) ... and the conventional alphabetic subject indexes." 4/ Langleben and Shumilina are concerned with machine-aided procedures for trans- lation from natural language materials to an intermediary or documentation language. 1/ 2/ 3/ 4/ Ibid, pp.215-216. Ibid, pp. 216-217. Anger, 1961 [151 pp. III-6ff. Ghonez, et al, 1963 [119], p. 31. 74 They indicate, for example, that the preposition 1from1' serves as a key for the treatment of two nouns connected by it. 1/ Swanson, describing research project progress at Ramo Wooldridge as of 1960, reported to the National Symposium on Machine Translation with respect to multiple meaning problems as follows: `1We are also investigating the possibility of discovering semantic attributes of words based upon certain automatically recognizable statistical features of the context. Our initial endeavor in this direction has been to attempt to discover a classification system for nouns based upon their frequency spectrum of cate- gories of modifying adjectives, these categories being automatically recognizable. 3.3 Derivative Indexing From Automatic Abstracting Techniques While Baxendale's work has had certain points in common with automatic abstracting or extracting processes, particularly in the use of word frequency statistics and the consideration of possibilities for first selecting topic sentences, her major interests in this area have been in automatic indexing as such, rather than in machine selection of sentences from text to serve as an automatic extract or derivative abstract of the document. Much of the machine processing to date of full text for documentation purposes, however, has had the latter goal as the principal research objective. As we have previously noted, the subject of automatic abstracting or auto- condensation is not in itself a primary concern of this survey. Nevertheless, the signifi- cant words occurring in the abstract of a document, whether generated by man or by machine, are obviously good candidates for indexing terms. Moreover, it has been strongly suggested that the questions of using positional, editorial, and syntactical clues in order to improve automatic indexing techniques will profit by research that is being done in both automatic extracting procedures and in other types of linguistic data pro- cessing based upon full text. 3/ 3.3.1 Auto-Condensation and Auto-Fncoding Techniques of H. P. Luhn Although Luhn's work in the field of documentation aided by machine has had its best known and most popular acceptance with respect to the KWIC index proper, even more provocative possibilities lie in the development of some of the auto-condensation and auto- encoding techniques which he also proposed, especially for full text processing. In this area, although he himself has also suggested a variety of possible improvements and refinements, the actual experimental work done by him and by his associates has mostly been done on the basis of word frequency statistics. 1/ ZI 3/ Langleben and Shumilina, 1962 [347~, p.109. Swanson, 1961 [585], pp. 391-392. See, for example, Wyllys, 1963 [653], p.7. 75 Considering first the most frequently occurring words in a given text as too common to be subject-indicative (those usually stopped or purged by a suitable exclusion dictionary or stop list, for example) and next the least frequent words as being rarely topical in a content-revealing sense, Luhn settles upon a middle range of frequency of word occur- rence as the basis for his auto-condensation processes. The actual frequency counts are computed, together with indications of page, line, and occurrence within the same sentence. When this has been done for the complete text, each individual sentence is then checked for the I!scorel! of relatively high frequency words occurring in it, and sentences with the highest scores are then automatically selected, in textually-occurring order, and are printed out as an abstract, more properly an extract, of the document. The automatic encoding of documents may be achieved either by taking the high ianking words of the selected sentences or by selecting the highest ranking of the words in the entire document as index entries. Luhn typically justifies these procedures as follows: "Of various automatic procedures for deriving typical patterns for characterizing documents, the systems here proposed are based on operations involving statistical properties of words . . . It is held that the more often a certain word appears in a document the more it becomes representative of the subject matter treated by the author. In grading words in accordance with the frequency of usage within a document, a pattern is derived which is typical of that document and unique amongst all similarly derived patterns of a collection of documents. It is proposed that the more similar two such patterns are the more similar is the intellectual contents of the documents they represent... The creation of an encoding pattern may consist of listing an appropriate portion of the words ranking highest on the word frequency list derived from a document. Experiments conducted so far on documents ranging in size from 500 to 5000 words have indicated that word patterns consisting of from ten to twenty- four of the highest ranking words furnish adequate discrimination and resolution for retrieval, sixteen such words being a likely average. 1/ At Wright-Patterson Air Force Base an automated information selection and retrieval system has been developed jointly by Air Force and IBM personnel (Gallagher and Toomey, 1963 L205~). It involves both auto-indexing and auto- abstracting techniques following the Luhn word-frequency-counting techniques. Pre- editing is applied to demarcate fields (e.g. , title, author) and to flag certain text words, particularly proper names, for special treatment. Special treatment, over and above the frequency-based selection score, is also given to words in the title field. On the abstracting side, modifications to the original Luhn formula involve segmenting sentences in terms of strings of both high and low valued words separated by either periods or continuous strings of low valued words, on the assumption that long consecutive strings of low value words should weight negatively. The automatic extract consists of the highest ranking 20 percent of the sentences subject to the restriction that no less than 7 and no more than 20 sentences should be selected. On the indexing side, the investigators report: 1/ Luhn, 1959 [37l~, p.47. 76 "As it is currently run, the auto-indexing program selects about one word in ten as a keyword in articles of three thousand words or less. In articles longer than three thousand words it tends to pick about one word in fifteen. This high incidence of keywords naturally increases the amount of noise results returned by the query program, although good search strategy cuts them down considerably." As of October 1963, the system was reported to be fully operative although not as yet extensively tested in actual use. Gallagher and Toomey give illustrative auto-extract results on two tested papers, one being Luhn's own "Automatic Creation of Literature Abstracts". They give comparative results for manual versus machine selection of key- words as index or search terms with 88.6 percent agreement, the human indexers having selected, in 6 tests reported, 132 words and the machine method 117. Modifications under consideration include pre-edit flagging of terms in author and cited-reference fields for special weighting, setting the length of the abstract as a function of the total number of worQs in an item, and, in the search program, generating additional search terms by means of association factor techniques such as those suggested by Stiles. To the basic approach of straight-forward word frequency counting, Luhn himself has suggested that improvements might be obtained from considering closely adjacent words, 2/word pairs, y/ and reference to vocabularies specific to a given field. 4/ Other possibilities are capitalized words and lookup against an inclusion list. He also suggests: "If certain words could be given in their relationships to other words, more specific meanings may be identified by such combinations. These relationships may range from the mere co-occurrence of certain words within a phrase or sentence to the combinations of specific parts of speech. " 5/ Various investigators have proceeded to explore these and other possible improve- ments, including incorporation of relative frequency information, use of information about distances between high-ranked si~nificant words, word pairs and word n-tuples, 1/ 2/ 3/ 4/ 5/ Gallagher and Toomey, 1963 [205], p.51. Luhn, 1959[384], p.10. Luhn, 1962[373], p.11. Luhn, 1959 [384], pp. 8 and 10. Ibid, p. 5. 77 and other devices to improve detection of significant clues to subject content. Repre- sentative examples of such work will be discussed below. In addition, investigators abroad have developed modifications to the basic Luhn word frequency approach which appear to be necessary when it is applied to languages other than English. 1/ Thus, for example, Purto reports various investigations conducted by V. A. Argayev and V. V. Borodin and by himself with respect to Russian language documents. _ Purto notes first that the Luhn method as applied to Russian language materials selects sentences which, while having the largest "significance coefficients", were not those most essential to the meaning and further that: "an abstract in Russian made by Luhn's method results in a choice of sentences not conveying basic information and not logically connected with each other. ` 3/ The reasons for such failure he attributes to the fact that words with different frequencies are considered equally important within a sentence for sentence selection purposes and to the lack of consideration for semantic and grammatical connectivity between significant words and between sentences. He then discusses several methods for determining connectivity, such as the rule that the sentences most closely connected with each other will be those in which the greatest number of the same signifi- cant words occur. 4/ A somewhat different example of difficulties occurring when the basic Luhn technique is applied to material in languages other than English is given by Levery. He describes a study of thirty French texts concerned with the development and manufacture of glass. He reports as follows: "While we followed the classical idea that a relationship between the frequency of a word and its significance exists, the fact that we worked with French texts forced us to discount the value of frequency alone. "French authors generally do not like to repeat the same words, and they vary their vocabulary... It was necessary to combine the frequencies of words with the same meanings or related to the same idea." `A dictionary of synonyms was constructed. . . (and) different versions of the same ~d had to be regrouped." 5/ 1/ Note, however, that in the automatic abstracting program at Thompson Ramo- Wooldridge, small-scale experiments suggest that automatic abstracting is as feasible for other Indo-European languages as for English, (1963 [603], p. ii). Also, at the Centre d'Etudes Nucle'aire Saclay, automatic extraction experiments are being applied to texts both in French and other languages, see National Science Foundation's CR&D report No.6, [430], p. ZO. 3' 4/ 5/ Purto, 1962 [484]. He refers to a report "The problem of automatic abstracting and a means of solving it", by Argayev and Borodin, apparently available only as a typescript dated 1959. Ibid, p. 3. Ibid, pp. 3-4. Levery, 1963 [359], p.235. 78 3.3. ZFrequencies of Word n-tuples - Oswald and Others The first alternative to the basic Luhn word frequency approach in automatic ab- stracting techniques to be actively explored was apparently that of Oswald and his associates. (Oswald et al, 1959 [459]; Edmundson et al, 1959 [180]). Like Baxendale, Oswald was interested in word pairs and word groups, particularly compound-noun and adjective-noun compositions, as more revelatory of meaning than single words. Unlike Baxendale, however, he was interested in the word group itself as selection criterion, whereas she had used word group or phrase clues for the selection of (usually) single indexing terms. Differences between their two approaches, both representing very early efforts in the field, are summarized by Edmondson and Wyllys as follows: "Oswald's experiment in automatic abstracting differs from Luhn's and Baxendale's techniques in that it combines the notion of significance as a function of word frequency and the notion of significance as a function of word groupings, by employing juxtapositions of significant words as the basic unit for measuring the importance of a sentence... "It may further be observed that Baxendale's exhibited indexes are made up of single words rather than word groups, in spite of the strong case she makes for using groups... "Baxendale's work is concerned solely with the automatic construction of indexes; she does not extend her treatment of word significance into the area of automatic abstracting." 1/ Oswald's "multiterms", however, were intended to overcome, in the areas of both automatic indexing and automatic abstracting, at least some of the difficulty that concepts are often expressed in compound nouns, word pairs, and longer groups of words consist - mg of n-tuples of substantive words or of phrases. The result of considering both word frequency and word-group frequency is that in Oswald's selection~groups it is usually the case that only one word of the group has an individually high frequency but the co- occurrence feature heightens the significance of the relatively lower frequency words with which it appears. Thus, for automatic indexing, Oswald proposed significant word groups as indexing terms, and his criteria for selection of sentences to be included in machine~generated extracts are similarly based on the number of significant groups in the sentences chosen. Other investigators who have stressed the importance of word pairs and longer groups as necessary to reflect concepts include Bar-Hillel (1959 [33]), Black(1963 [64]), Clark (1960 [1z3]), Doyle (1959 [165]), and Salton (1963 [519]). Doyle says succinctly that "when a phrase, or some other aggregation of words, stands for a single idea, its frequency in a document ought to interest us more than the frequencies of its component words." 2/ Salton considers it desirable to use word groups rather than individual words 1/ 2/ Edmundson and Wyllys, 1961 [181], pp.231-232. Doyle, 1959 [165], p. 11. 79 for purposes 0£ identifying document contents and to use data on the joint occurrence of words in the same sentence or similar contexts as grouping criteria. Clark points out in particular that the use of ordered pairs and longer sequences of words to express a single concept may be highly characteristic of the special technical language used in a specific subject field, and notably those of the social sciences. 1/ Others who have explored word n-tuples as selection criteria for automatic extraction operations include such investigators as Szemere, Levery, and Yakushin. Szemere reports an investigation of 39 Swedish patent specifications in the field of switching circuits looking for significant word-pairs, with emphasis on noun-adjective combinations (1962 L591J) The objectives of a project headed by Levery at IBM - France have been reported as follows: `1A series of experiments is planned in the fields of automatic indexing of technical texts and technical vocabulary analysis. "A statistical method will be tested to determine the degree of closeness in meaning of words. The method will consist of studying the pairs of words which appear together in the majority of texts and calculating a coefficient of corre- lation from the frequencies. Such work will result in a standard list of notions frequencies for a particular kind of information. "Starting from this list, new experiments will be made so as to obtain a list of keywords representing each text. The method will use statistical comparison between the distribution of frequencies of notions contained in a text and the standard distributions obtained for the entire corpus." 2/ Yakushin(1963 [654~) develops a variation of the word-pair principle in which he looks for those pairs where the words are, or suggest, names of objects, such as 11table-leg'1. He suggests, further, that so-called `1basis nouns" can be established for a given scientific field and entered into an inclusion dictionary, which also contains codes for the lexical classes to which the word can belong and codes for determining whether or not the word can join with another as a "basis term". Machine routines are then suggested to develop whether or not given terms are jointly part of the same text, whether one textually precedes another in a given text, whether or not there is a "nomenclator" pair. Depending upon the frequency of occurrence of identical or semantically related nomenclator constructions, it is claimed that subject concepts can be detected. That is: "The method is founded on the finding in a text of so-called basis terms, established by list, and of the words which explain them. These explanatory words, which in different contexts refer to one basis term, are grouped and ordered according to definite rules into a subject concept." 3/ 1/ 2/ 3/ Clark, 1960 [123], p.460. National Science Foundation's CR&D report no. 11, [430], p. 118. Yakushin, 1963 [654], p.16. 80 3.3.3 Relative Frequency Techniques - Edmundson and Wyllys, and Others The first comprehensive critique of word frequency approaches to automatic extract- ing and indexing was undoubtedly that of Bar-Hillel (1959 [33], 1960 [34]), followed closely by Edmundson and Wyllys (1961 [181]), who themselves have experimented with various alternative or improved methods for obtaining measures of word significance by statistical analysis. These critics have been in agreement both on many points of specific criticism and on suggested possibilities for amelioration of observed difficulties, especially in terms of considering relative word frequencies within a particular subject field. In addition, several other investigators independently proposed a relative frequency approach at about the same time. 1/ Some typical expressions of opinion on the importance of relative frequency criteria are as follows: "Let me propose here a system of auto-indexing which, to my knowledge, has never been publicly proposed before in this form and which seems to me superior to any other system I have heard of ... Assume that ... we are given a list of the average relative frequencies of all English `words' . . . It would then be possible, for any given document, to rank-order all the `words' occurring in this document according to the excess of their relative frequency within the document over their average relative frequency. By some mechanically implementable standard or other, an initial segment of this list is selected as the index-set." 2/ "Very general considerations from information theory suggest that a word's information should vary inversely with its frequency rather than directly, its lower probability evidencing greater selectivity or deliberation in its use. It is the rare, special, or technical word that will indicate most strongly the subject of an author's discussion. Here, however, it is clear that by `rare' we must mean rare in general usage, not rare within the document itself. In fact it would seem natural to regard the contrast between the word's relative frequency f within the document and its relative frequency r in general use ... as a more re- vealing indication of the word's value in indicating the subject, matter of a document." 3/ 1/ Compare, for example, Kochen, 1963 [327], p.7: "The idea of contrasting words which occur frequently in a document against the frequency of this word in the background language for purposes of selecting index terms seem to have been suggested first by Bohnert and the author, then described in more detail by Edmundson and Wyllys, and tested empirically by Damerau. Something similar was suggested even earlier by Bar-Hillel." See Bar-Hillel, 1962 [35], p.418, footnote, with respect to himself, Edmundson, and Bohnert. See also, however, Doyle 1962 [163], p.388: "Edmundson and Wyllys were probably the first to publicly advocate contrasting word frequencies within a document to word fre- quencies within a given field and using these relative frequencies as criteria for scoring and selecting sentences." 2/ 3' Bar-Hillel, 1959 [33], pp 4-8-9. Edmundson and Wyllys, 1961 [181], p.227. 81 "We naturally find that the words of greatest interest are those for which there exists the greatest contrast between general usage frequency and local (within the article) usage frequency. 11 1/ "Luhn has bypassed syntactical analysis by taking advantage of the information content of the most frequently used topical words in articles ... Edmundson et al take a further step in a desirable direction by bringing in information from outside the article being analyzed: words and terms are given greater topical value as the contrast increases between the frequency of use within the article and the rarity of general usage." 2/ `1A further refinement of the process of automatic analysis would be the develop- ment of special sets of reference frequencies for special fields of interest. This would have two benefits: it would become possible to classify documents as to field, and it would become possible to note the significance of words which are frequent in the document and frequent in a very large reference class c0 of literature (i.e. , these words would not be significant with respect to c0) but which are rare in the special field. For example, the word `emotion' might be too common in general usage to seem significant, but frequent occurrence of the word would stand out in a paper on electronic circuitry (e.g. , of a robot) when compared with its frequency in general electrical engineering literature." "One of the . .. goals is to investigate a relative-frequency approach to the cate- gorization of documents. .. For this investigation it will be necessary to develop sets of reference frequencies for words used in different subject fields. It was suggested by Fdmundson and Wyllys that these sets of reference frequencies, when developed, could be used to categorize a document as belonging to a particular subject-field, by means of measuring the degree of matching (e.g. , with the chi- squared test) between the proportional frequencies of words in the documents and the sets of reference frequencies." 4/ Two points in the comments quoted above appear especially worthy of note. The first is that of introducing at least some measure of reference to material other than the individual author's own choice of linguistic expression and specific terms. We shall dis- cuss this factor in more detail in a later section of this report. The second point, derived in part from the first, is the specific suggestion of movement away from purely derivative indexing by machine in the direction of automatic assignment indexing and automatic categorization or classification. 1/ 2/ 3/ 4/ Doyle, 1959 [165], p. 9. Doyle, 1961 [169], p. 3. Edmundson and Wyllys, 1961 [181], p.228. Wyllys, 1963 [653], p. 10. 82 Actual experiments in application of relative frequency techniques to automatic ex- tracting processes have been pursued since 1959 by various investigators. Edmundson and Wyllys and Damerau (1963 [148])were certainly among the first. Edmundson and Bohnert were engaged in experimental investigations at Planning Research Corporation in 1959, Iland the following year Edmundson, Oswald, and Wyllys worked on the auto- indexing and auto-extracting of the 40, 000 words of text contained in nine articles in the subject field of missilery. 2/ Wyllys has continued work on relative frequencies (1963 [6533] ). At the System Development Corporation Doyle, in some of his work,has also explored the relative frequency approach (1961 [161]). An example in Europe is work reported by Meyer-Uhlenried and Lustig, where significant keywords from abstracts are used not only as indexing terms directly, but by means of keyword lists and micro- thesauri can also be used to assign documents to specific subject fields (1963 [417]). 3.3.4 Significant Word Distances Another technique that has been investigated for the improvement of automatic ex- traction operations based on the statistics of word frequencies is that of distances between significant words. The desirability of attaching greater weight to n-tuples of immediately adjacent words and to the co-occurrences of words within the same sentence has been mentioned previously. Savage, in relatively early work developing some of the initial proposals of Luhn, considered intra-sentence distances between significant words as follows: The criterion is the relationship of the high-frequency words to each other, rather than their distribution over the whole sentence. Consequently, it seems reasonable to consider only those portions of sentences which are bracketed by high-frequency words and to set a limit for the distance at which any two such words shall be considered as being significantly related . . . An analysis of many sentences and many documents indicates that a useful limit is four or five non- significant words between a~y two high-frequency words " 3/ Doyle has also noted the tendency of words that are in fact highly related in a content- revealing sense to co-occur in the same sentence or as quite direct neighbors. The same investigator has also suggested that word distances can be used to provide "clustering" effects that might, for example, sort out the possibly different topics cove re~/in intro- ductory or background discussions, the main text, and various appendices. - 1/ 2/ 3/ 4/ National Science Foundation's CR&D Report No.5, [430], p33; Bar-Hillel 1962 [35], p.418. National Science Foundation's CR&D Report No. 6 [430], pp 43-44. Savage 1958 [521], p.4. Later related work has included a method for generating auto-extracts which adds to the high-frequency word sentence scores a correction factor for the number of words in gaps between such words. (See Rath et al, 1961 [493;) Doyle 1961 [166], p. 7. 83 Related research efforts in more general areas of linguistic data processing suggest inter-sentence distances as criteria for the selection of words and word groups in auto- matic indexing and abstracting processes. In natural language text searching, for example, the work of both Swanson (1960 [587], 1961 [586], 1963 [583]), and of Maron and Ray!, suggests that limitation of searching to a four-sentence span would eliminate a number of irrelevant responses to search requests specifying the joint occurrence of two or more words. Swanson's findings indicated that if two words or phrases contained in the sear~h request were found in textual proximity within these limits, they were highly likely to bear a semantic relationship that is what was intended by the requester. Applying the four- sentence proximity criterion, it was found that the amount of irrelevant material retrieved by the text searching system could be reduced by 60 percent without serious loss of relevant information. 2/ Black cites the four-sentence proximity criterion and notes further that it might be used also to retrieve only a paragraph or similar small portion of the full text, reducing the amount of material to be read by the user, perhaps by as much as 90 percent. 3/ Artandi, in her book-indexing studies, suggested as a topic for further investigation the possibility that proximity of index term candidates as derived from the same section of the text could serve to improve the quality of the indexing. Since her computer program checks for duplicate potential entries occurring on the same page, this feature could be used for further analysis, on the assumption that the number of occurrences of the same entry for the same page is an indication of the importance of the discussion of the subject on that page. 4/ 3.3.5 Uses of Special Clues for Selection Intra- and inter-sentence distances between words are relatively crude examples of clues to selection of words and word-pairs which, because of their implied relationships, may be especially significant for indexing, sentence extraction, or document categoriza- tion. They can be quite readily detected by machine, but the implication that physical proximity is a good measure of significant co-occurrence is often false. Other clues which can be detected equally well, mechanically, are those which have to do with position and format. 1/ 2/ 3/ Ray, 1961 [494], p. 92. Swanson, 1963 [5831, p. 9, 1961 [586], pp.298-299. See Black, 1963 [64], p.20 and footnote: "The figure 90 percent is derived from experience in previous experiments, wherein the amount of relevant material was scanned and a subjective judgment was formed that the relevant material was actually about 10 percent of the total verbiage retrieved. That is, about 10 percent of each document contained the relevant material; 90 percent of the document was of no relevance but the document as a whole was relevant." 4/ Artandi, 1963 [20], p.47 84 Such obvious positional clues as occurrences of words in titles, chapter or section headings, figure captions, have already been mentioned. To these can be added first and last sentences of paragraphs, 1/ or of first and last paragraphs as such. 2/ Wyllys observes that other criteria which are detectable in the text by straightforward machine procedures can be based on such features as italicization, capitalization, or punctuation. He notes, however, that such "editorial" criteria vary from journal to journal so that their usefulness would need to be related to the particular practices of individual journals. 3/ Somewhat more difficult for machine implementation, but certainly feasible in the present state of the programming art, is the use of specific semantic or syntactic clues. Here again, Luhn, Baxendale, and Edmundson and Wyllys all anticipate their critics and later investigators. Luhn recognized the fact that in at least some applications the characterization of documents by isolated words alone would fail to provide an effective degree of discrimination. He, therefore, suggested operations to establish word relationships, whether based on co-occurrences or combinations of specific parts of speech. 4/ Baxendale clearly uses both syntactic and semantic clues, detectable by built-in table lookups. Representative suggestions by Edmundson or Wyllys or both as co-authors include the following: We have in mind a glossary or dictionary of perhaps one to two thousand words that act either as cue words which signal the importance of a sentence or as stigma words that signal the insignificance of a sentence for purposes of abstracting." 5/ 1/ See, for example, Wyllys, 1963 [653], p.27: "One of the first published studies in automatic document-content analysis, that of Miss Phyllis Baxendale, brought out the importance of the first and last sentences in a paragraph as bearers of a good deal of the content of the paragraph." See also Marthaler, 1863 [399], p.25. 2/ 3/ 4' 5/ Compare Swanson, 1963 [580], p. 1: ". . Some evidence exists to show that for short homogeneous articles title and first paragraph are nearly as good as full text. Wyllys, 1963[653], p.28. Luhn, 1959 [384], p. 5. Edmundson,1962 [178], p. 11. 85 "The criteria for attributing significance to words . . . may be positional (in virtue of their occurrence in titles or section headings), or semantic (in virtue of their relation to words like `summary'), or perhaps even pragmatic (in the case of names of specialists mentioned in text footnotes, or bibliography "A cataloguer or abstract-writer would naturally give more weight to a technical word that appears in a title, in a first paragraph, or in a summary. A machine can be programmed to do the same. It can be instructed to recognize the title by position and capitalization . .. It can place first-paragraph indications... It can test every heading or subtitle for the words rsummaryt or `conclusions' and place a summary indication after each word in the summary paragraphs." 1/ "The statistical criteria . . . by no means exhaust the potential clues to the representativeness of sentences. Among other plausible clues are certain words and phrases ... authors use words such as `conclusion', `demonstrate', `disclose', `prove', `show', and `summary' (and related forms of these) with high frequency in sentences that contain concise statements about the topic or topics of the article. The occurrence in a sentence of such a phrase as `it was found that...', `the experiment proves. . . `, or `the central problem is . . . ` would indicate probably even more sharply than any single word could that the sentence was likely to be highly representative of the topics..." 2/ 3.3.6 Recent Examples of Mixed Systems Experimentation It is quite obvious from the above samples of suggestions for the use of various special clues for automatic extraction, that improved systems will largely depend upon a mixture of means for determining subject- representativeness of words, phrases, and sentences Many of the clues suggested by Edmundson and WyUys are continuing to be explored, as mixed systems, at RAND 3/ and the System Development Corporation, (1962 [590]), for example. Two specific recent examples of mixed systems experimentation are the automatic abstracting experiment programs at Thompson Ramo-Wooldridge and the work involving detection of first incidences of nouns at the Harvard Computation Laboratory. The TRW programs to investigate possibilities of computer generation of document auto-abstracts, involving both English and Russian language texts are based upon a combination of four different methods to measure significance and determine representa- tiveness. These four methods are briefly described as follows: The Key method has its source of machine recognizable clues the specific characteristics of the body of the document and is based on a Key Glossary of content words taken from the body pf the document. 1/ 2/ 3/ Edmundson and Wyllys, 1961 [181], pp. 227 and 229. Wyllys, 1963L653J, p.25. See National Science Foundation's CR&D report No. 11, [430], pp. 314-315. 86 * . The Cue method has as its source of machine recognizable clues, the general characteristics of the corpus that are provided by the bodies of the documents and is based on a Cue Dictionary of function words apt to appear in the body of a document. ..... The Title method has as its source of machine recognizable clues, the specific characteristics of the skeleton of the document, i. e. , title, headings, and format, and is based on a Title Glossary compromising those content words found in the title, subtitles, and headings, but excluding certain words of the Cue Dictionary. * . The Location method has as its source of machine recognizable clues, the general characteristics of the corpus that are provided by the skeletons of the documents and uses a Heading Dictionary of certain function words that appear in the skeletons of documents.'1 1/ The Harvard work involving detection of the first incidences of nouns as sentence selection and indexing clues is part of a larger-scale program for mechanized informa- tion selection and retrieval under the general direction of Salton (1961 [siz], 1962 [513], 1963 [514] and [515]). The specific mixed system involving frequency data, syntactic identification clues, and positional criteria is primarily the result of investigations by Lesk and Storm (1961 [577], 1962 [358]). Related work takes advantage of computer techniques for predictive syntactic analysis and automatic dictionary lookup also under development at the Harvard Computation Laboratory (Kuno and Oettinger, 1963 [339], [340], [341]). The Lesk-Storm experiments have involved investigations where the hypothesis assumed is that the points in a text where the author has first introduced a specific noun or nominal phrase, or where he has used, with higher frequencies, a combination of first-referred-to-nouns, are most likely to be especially indicative sections of text with respect to subject-content representativeness. The assumption is further,that areas in which specific `1new" ideas, not mentioned previously in the text, are first introduced is particularly rich in topical-content concentration. 2* The_mixed-system emphasis followed by Lesk and Storm, however, is revealed in the following comments: `11t is not, of course, apparent that a count of initial occurrences of nouns . . . is by itself sufficient to reveal areas of significant information content for purposes of abstracting or indexing. Accordingly, the method suggested here must be used together with other available means, and is not expected to provide by itself an acceptable abstracting algorithm. 3/ In their actual investigations, Lesk and Storm first made manual counts of initial noun occurrences in various sample texts, noting paragraph, sentence, and first incidence-of-word identifications. The computer was then used to carry out three distinctive tasks: (1) calculation of the number of new nouns for each sentence in the text; 1/ 2/ 3' Thompson Ramo Wooldridge, 1963 [603], p. 1. Lesk and Storm, 1962 [358], p. 1-6. Storm, 1961 [577], pp. I-i and 1-2. 87 (2) computation of functions proportional to the number of initially occurring nouns for each sentence, and (3) the preparation of a normalized graph for initial noun occurrences by plotting the functional values against each sentence in the text.!' Sentence selection can then proceed by processes to detect "peaks" on the graph, using a relative criterion or weighting function to minimize the effect of high first-noun counts in the beginning sentences of a paper. Trials were made with a number of different weighting formulas, and the best of these involved the obtaining of moving averages of first-noun counts over several adjacent sentences. A particular formula covering a span of seven sentences gave results that appear to emphasize contextual effects and to reduce the effects of a particular single sentence with a large number of new nouns, such as a listing of proper names. The resulting abstracts are quite lengthy (e.g. , comprising 20 percent or more of the original text), and contain some relatively uninformative sentences. The investigators think that the results with respect to satisfactory abstracting are inconclusive but provocative. They also conclude that the possibilities for indexing are more immediately promising: "Most key definitions are retained in the successful summaries, and the vocabulary reflects the topics covered in the texts." 2/ Qther examples of mixed-system experimentation, especially involving the use of syntactic and semantic considerations, include the work at the General Electric Computer Department under Spangler, and work by Jacobson and Plath. In the Phoenix laboratories of General Electric, a KWIC type indexing program can be applied both to titles and to running text and a contemplated extension is intended to "generate indexes by means of word analysis, taking into consideration syntactic and semantic aspects of text lines". 3/ Jacobson describes rules for machine determinations of same-meaning occurrences of words which may be homographic and for selection of descriptors for indexing simple paragraphs by choosing words occurring at least twice with a high probability of having the same meaning. 4/ Plath reports: "Although sentences occur in which the key term or phrase lies buried deep down in the structure, preliminary observations indicate that there are many others in which the semantic hierarchy closely parallels that of the syntactic structure. This suggests that more sensitive vocabulary statistics for purposes of automatic abstracting may be obtainable by considering only words occurring in positions above a predermined cut- off level in the sentence structure. Alternatively, one might count occurrences of words on each level, and then multiply by a fixed "5/ weighting factor in each instance before taking the overall totals. - 1/ 2/ 3/ 4/ 5/ Lesk and Storm, 1962 [358], pp. 1-2, I-~ ff. Ibid, p. 1-31. National Science Foundation's CR&D Report No. 11, [430], p. 21. Jacobson, 1963 [292], p. 191-192. Plath, 1962 [474], p. 190. 88 3.4 Quality of Modified Derivative Indexing by Machine Most of the modified derivative indexing techniques that have been proposed to date have few or no indexing results to provide comparative data for purposes of evaluation. Moreover, those techniques which are primarily directed to the generation of document abstracts rather than indexing terms have been reported to date with a paucity of actual examples. I' One of the main reasons for this lack of product~effectiveness data is un- questionably the high cost and difficulty of obtaining substantial corpora of representative document text in machine-readable form. For the most part, the few examples of automatic abstracts produced by machine are sadly lacking in pertinency, relevancy, 2/ and in continuity for scanning or reading by comparison with conventional human abstracts, whether prepared by author, editor, volunteer specialist in the subject field, or pro- fes sional documentalist. A few studies have been made for a somewhat larger numbers of examples of "auto- abstracts'1 with respect to differences between several different machine-extraction formulas, random sentence selections, and sentences extracted manually. A project conducted by IBM's Advanced Systems Development Division for the ACSI-matic program, (1960 [289], 1961 [290]), involved 70 to 90 articles on military intelligence items. The comparisons were of "auto-abstracts'1 as against titles, full texts, "pseudo-auto- abstracts1 comprised of the first and last 5 percent of the sentences of each text, and sets of sentences selected randomly, without reference to conventional types of manually prepared abstracts and without respect to the quality as such. Similarly, Thompson Ramo Wooldridge data (1963 [601]) on machine-extracted and randomly-extracted, sentence sets compare these "abstracts" against manual selection of 25 percent of the sentences of each item, rather than against a conventional type of abstract. There are however, almost no data available on the possible results of using sentence and word-group extracting techniques, applied to machine-usable texts, to the develop- ment of indexing entries rather than to the generation of substitutes for document abstracts. For this reason, as well as because discussion of the difficulties of evaluation in general will be deferred to a later section of this report, the question of the quality of modified derivate indexing will be briefly considered below, largely in terms of non- quantitative judgments. First and foremost, as has been noted previously, is the objection that word-indexing typically produces redundancy, scatter of references among synonyms and near-synonyms, inclusion of many irrelevant entries at high page and user-scanning costs, omission of 1/ Purto expresses regret that the studies of Agrayev and Borodin, intercomparing results of human abstracting, use of Luhn's method, and their own modification, used only a single paper (1962 [484]). Storm, (1961 [577]), evaluating the initial noun occurrence technique as a measure of sentence and index-term extraction significance, reports results for only two papers, both by Quine. Only nine articles, with no more than 40, 000 words of text in toto, were used by Edmundson, Oswald and Wyllys in their 1960 experiments ([180]). 2/ Compare, for example Lesk and Storm, 1961 [358], pp. 1-29 and 1-30 as follows: "A final problem is the ambiguity that may arise by removing two sentences from context; two sentences alone do not always permit comprehension. Worse yet, the meaning may actually be inverted upon removal from context. For example. . . a quote is selected which an unsuspecting reader might think the author supports, when he is really attacking the position." 89 many properly indexable topics or points of interest because the authors did not emphasize them or used new and unusual terminology to describe them, failures to achieve con- sistency both of reference and index-vocabulary control for the papers of more than one author, and the like. Additional difficulties are engendered, for word indexing by machine from text as against word indexing by people, because of complexities required in pro ramming to achieve recognition of even such simple indicia as endings of sentences, - incon~is - tencies of capitalization 2/ and misspellings.~3/ Context distinctions between multiple meanings of homographic words are even more difficult. Difficulties in achieving good indexing quality are increased if only titles are used; those of keystroking and machine cost requirements increase as the amount of input material grows. For these reasons, early criticisms such as those of Bar-Hillel are largely as pertinent today as they were when statistical techniques for computer generation of document extracts and index terms were first proposed. For example: tiThere can be no doubt but that computers are in a position to select out of the words or word-strings occurring in the encoded form of the original document those words or strings which fulfill certain formal, statistical conditions, such as occurring more than five times, occurring with a relative frequency at least double the relative frequency in general. . . However, it is . . . unlikely that the set obtained thereby will be of a quality commensurate with that obtained by a competent indexer. First, there will be serious difficulties as to what is to be regarded as instances of the same word ... Second, there arises ... the problem of synonyms. Third, and most important, this procedure will yield at its best a set of words and word strings exclusively taken from the document itself 4/ On the other hand, there are many situations where, because of time factors or lack of conventional indexing resources, even unmodified derivative indexing by machine is itself of value and therefore modifications to improve the quality of results, whether made by man or by machine, may be well worthwhile. As Anzlowar claims: `1The in- creasingly widespread KWIC indexes . .. can save so much in time and effort that they surely deserve better than the somewhat haphazard `slash-dash -mg' now done in most 5/ in most instances as the only cerebral operations thereon. - 1/ See Luhn, 1959 [384], p.22: `1Amongst the difficulties encountered in the processing of machine readable texts, inconsistencies in the use of punctuation marks, com- pounds, capitals, spacing and indentations have been a problem way out of propor- tion with respect to the simple functions these devices stand for. For instance, even with the aid of a dozen different tests performed by the machine, the true end of a sentence cannot be determined with certainty." 2/ 3/ 4/ 5' See Artandi, 1963 [20], pp. 52ff, on problems of capitalization of proper names. See Wyllys, 1963 [653], p. 15. Bar-Hillel, 1962 [35], pp.417-418. Anzlowar, 1963 [16], p. 104. 90 Modifications to derivative indexing techniques that tend toward normalizations of terminology and word usage, and increasingly sophisticated proposals for machine use of syntactic, semantic, and contextual clues hold out the promise of transition to more truly `1subject" indexing and to automatic assignment indexing systems.