0CPA ~BEST AVAI LAB LE COPY--- - DTIC

52
Technical Report AD 640 124 MECHANIZATION STUDY OF THE AEROSPACE MATERIALS INFORMATION CENTER (INCLUDING CERAMICS AND GRAPHITES TECHNICAL INFO CENTER). WRIGHT-PATTERSON AFB, OHIO Submitted to Defense Supply Agency Defense Documentation Center Cameron Station, Virginia by Booz, Allen Applied Research Inc. 4733 Bethesda Avenue Bethesda, Maryland 20014 Under Contract No. DSA-7-15489 BAARINC Report No. 914-1-29 September 1966 -/BOOZ'ALLEN APPLIED RESEARCH INC. WASHINGTON CLEVELAND CHICAGO LOS ANGELES 0CPA ~BEST AVAI LAB LE COPY---

Transcript of 0CPA ~BEST AVAI LAB LE COPY--- - DTIC

Technical Report

AD 640 124

MECHANIZATION STUDYOF THE

AEROSPACE MATERIALSINFORMATION CENTER

(INCLUDING CERAMICS ANDGRAPHITES TECHNICAL INFO CENTER).

WRIGHT-PATTERSON AFB, OHIO

Submitted to

Defense Supply AgencyDefense Documentation Center

Cameron Station, Virginia

by

Booz, Allen Applied Research Inc.4733 Bethesda Avenue

Bethesda, Maryland 20014

Under Contract No. DSA-7-15489

BAARINC Report No. 914-1-29

September 1966

-/BOOZ'ALLEN APPLIED RESEARCH INC.

WASHINGTON

CLEVELAND

CHICAGO

LOS ANGELES

0CPA ~BEST AVAI LAB LE COPY---

TABLE OF CONTENTS

PageNumber

ABSTRACT ii

INDEX OF FIGURES v

1. SUMMARY I

II. MECHANIZATION 3

1. Chronology 3

2. Major Problems in Development 4

3. Thesaurus Development 6

4. Description of Processes 7

5. Activities Being Planned or Developed 17for Mechanization

III. PROGRAM SYSTEM DATA 19

1. Files 19

2. Programs 20

IV. EQUIPMENT, COSTS, AND EVALUATIONS 26

1. Equipment 26

2. Time and Costs 27

3. Evaluations 28

REFERENCES 33

-iii-

INDEX OF FIGURES

PageNumber

1. Input Flow of Information 8

2. Index Card 10

3. Card Formats 12

4. IR Worksheet for Search 14

5. Information Retrieval - Search Input 15

6. Search Questionnaire 32

"-V-

I. SUMMARY

Under contract to the Air Force Materials Laboratory, Wright-

Patterson Air Force Base (W-PAFB), Ohio, the University of Dayton

has indexed and processed some 30,000 documents for the Aerospace

Materials Information Center. Index terms have been added to computer

tapes for retrieval and printing of the keyword index.

The final choice of an information retrieval system was an in-

verted file system using deep indexing, links, and roles; all material

was processed on the University NCR 304 computer. The initial pur-

pose of the computer operations was the the tabulation of a thesaurus

of the system's vocabulary and the generation of a keyword index that

could be used by individuals in performing manual literature searches.

The magnetic tape from which the thesaurus and dictionary were gen-

erated also provided the opportunity to perform mechanized searches

as the need arose.

Within the past year, all data in the system have been added in

sequential format and without roles to the IBM 7094 at W-PAFB, which

is now used for searching, though the capability still exists at the

University of Dayton. In addition to searches, the IBM 7094 produces

the KWIC index section of the "Materials Information Bulletin. "

Currently all documentation received at, or issued by, the

Ceramics & Graphites Technical Information Center is included in the

overall program developed and operated by the University of DayOn.

All of the 30, 000 documents on file at the Aerospace Materials

Information Center are unclassified. The collection is growing at the

rate of 400 per month. Reference use of . ie collection and abstracts

has averaged about 300 per month, with loans (approximately 600 to 700

annually beside use in the library) being made to Materials Laboratory

personnel and in a few instances to people located outside Wright-

Patterson AFB.

A weekly "Materials Information Bulletin" announces to potential

users all new additions to the collection; the "Abstracts of Active Con-

tracts" announces current projects of the Laboratories. Bibliographies

are prepared as requested. The majority of requests are by telephone,

though requests by memo or letter are received quite frequently. Fifty

percent of all requests are made by DoD contractors; the remaining

50 percent cover requests from various government activities.

"-2-

II. MECHANIZATION

1. CHRONOLOGY

In early 1960, the Materials Information Branch was established

as a centralized technical information service for the Air Force Mater-

ials Laboratory. A proc ssing group was organized to assist inthe

problem of storage, and use of information dealing with the

materials R&D area. From this original group, the Air Force Mater-

ials Information Centers (AFMIC) have evolved. The Aerospace Ma-

terials Information Center and the Ceramics and Graphites Technical

Information Center are two of the eight information centers. (Appen-

dix A illustrates the eight centers.)

Contract with the University of Dayton was let December 1, 1960,1

to perform indexing and develop a computer-assisted information sys-

tem.

Actual work on the contract with the University of Dayton began

in September 1961. The system iras developed and input began.

-3-

In mid-1963, the retrieval program became operational. The

program until this time consisted only of input. The thesaurus was

revised to retain as much specificity as practical while using a frag-

mentation system for organic chemicals and applying a modified but

similar approach to other areas where an uncontrolled increase in

vocabulary appeared detrimental. The established controls have pro-

vided a fairly stable vocabulary and eliminated the need for continued

revision of the computer tapes.

In 1964, the retrieval program was rewritten for the IBM 7094 at

W-PAFB. In this tLansition, the inverted file was changed to sequen-

tial. The data base was added in September although the University of

Dayton still formulates the search questions. Thesaurus maintenance,

&eyword index printing, and data-base updating are still being per-

'ormed on the NCR 304 at the University of Dayton.

After a year of setting up the program on the IBM 7094, the re-

:rieval program became operational in late 1965.

•. MAJOR PROBLEMS IN DEVELOPMENT

Problems with the free vocabulary began developing within a

:ouple of years, initiating a redevelopment of terms within the system

tnd the establishment of vocabulary controls.

"-4-

Indexing is usually a chore, although some relief is given when

the indexer formulates search questions as well as indexing. Plans

call for indexers to supervise students in the indexing and spend part of

their time doing more interesting and varied work.

The University's experience has shown negative aspects to the

system such as the difficulty encountered in applying role indicators to

the terms. After a thorough evaluation, the assigning of role indicators

was dropped. It was also discovered that a large amount of time could

be saved in the editing operation by letting the computer, rather than

the editors, do the cross-relating of terms.

Another problem developed is the indexing of progress reports,

which increased the number of overall entries to the system. This pro-

cedure was changed; currently, if a progress report is received in the

Center and it is the first to be received on the contract, it is assigned

a new accession number and processed for indexing. If it is not the

first, the document is assigned the same accession number affixed to

the first report and filed. Because of this method of handling progress

reports, the exact size of the system is indeterminate.

"-5-

3. THESAURUS DEVELOPMENT

The use of deep indexing with links and roles formulated the basis

of this system. The role indicators used were a slightly modified ver-

sion of those used by the DuPont Company. The first 500 documents

that were indexed averaged over 80 link-to-role-term combinations per

report. As the information analysts gained experience, the average

number of entries per document was reduced to slightly over 40. The

elimination of roles from the system reduced the average to about 27

entries per document.

In 1963, when controls were established for the naming of ma-

terials, the 18,000 items in the system were reduced to about 10,000.

Within the past year, some 6,000 documents being added to the system

have generated very few new terms.

Twelve to thirteen terms are assigned for each document, but

because of the hierarchial relationships, a document may then be posted

to about 20 to 25 terms automatically.

Maintenance of the thesaurus is described in Appendix B.

"-6-

4. DESCRIPTION OF PROCESSES

Until 1960, a collection of Materials Laboratory's and its con-

tractors' reports had been maintained manually. Reports were logged

in, and a report number index card maintained. No subject cross-

referencing was available.

Since the beginning of the University of Dayton contract, material

added to the computer also has had abstract cards prepared for it.

Currently, these abstract cards are maintained at the Materials Labor-

atory by contractor, contract number, agency, title, and accession

number. Card sets are also maintained at the University of Dayton and

some of the divisions within the Laboratory.

The computer programs developed and operated by the University

of Dayton permit computer searches and also produce a thesaurus and

a printed index of the entire collection (see Figure I for input flow).

Searches and printing of the KWIC index are performed from the same

data base using the IBM 7094 at the Materials Laboratory. In order to

provide information required to produce the outputs just mentioned, the

following procedures are followed:

-7-

AEROSPACE MATERIALS :NFORMATION CENTER

(Procedures performed at Center)

"* Document Acquisition"• Check for Duplication"* Review for Pertinency• Assignment of Accession Numbers0 Preliminary Typing of Record Card0 Maintain Document File

I+New IndexedDocu ents Docu Ients

UNIVERSITY OF DAYTON

Document Control

Doc ment IIIndexer Indexed

Documents

Document andIndex Card I

Leview Indexer -

RPre- EditingI

Index Cards

-"Card Control 4----C--- iorted_-_. . ..___ _TabulationI

Index aid Vocabulary CardsI

IBM Key-Punch NewCards IVocabul. ;.ry

IBM Cardsors

Computer Rejected Tprm-L- Ta-ba'* 1~ r 551 'o -

Vocabulary .... "Tapes Te rm. . Tapes

TKeyword Index

FIGURE 1Input Flow of Information

(1) Input Procedures

I. Document is received, checked for duplication, and

reviewed for pertinency to the collection.

2. Accession numbers (six digits) are assigned by the

University of Dayton staff located at the Materials Labora-

tory.

3. Preliminary record card is typed showing accession

number, title, date, and contractor.

4. Documents are forwarded to the University of Dayton

for indexing and processing.

5. Final abstract card is typed including complete bibli-

ographic information.

6. Indexer indexes the document using an indexing work-

sheet (referred to as index card; see Figure 2). This index

card includes the accession number (access number), title

of the report, author or authors, indexer's name and date,

and the terms and appropriate links assigned. A link is a

unique alphabetic suffix added to the accession number.

Terms are selected from the thesaurus by following cer-

tain ground rules. See Appendix C for a further explanation

of these rules.

-9-

7p - 9b VS 7 if 14S

z D

- - ,A4"iJVI. A&SS:#/A7'

4A / _-T g, IVN~

FIGURE 2Index Card

-10~-

7. Document and index card go to the review indexer for

pre- editing.

8. Indexed documents are returned to the Materials Lab-

oratory.

9. Index and vocabulary cards are keypunched.

10. Cards are processed on the computer; terms not al-

ready on tape are rejected.

11. Reject ,d terms are sent to editors for review. Terms

are held for further review or added, if usage has shown

need for the term. Modifications to the various sections of

the valid vocabulary are made as described in Appendix B.

Figure 3 shows the various card formats.

12. Final abstract cards are returned to the Materials

Laboratory and filed.

13. Final record cards are filed by the University of

Dayton staff, including abstract and index cards.

(2) Out put s

1. Thesaurus

The thesaurus contains some 10,000 terms, printed

in numeric sequence by numeric code (see Appendix D-1

for sample). Generic Terms (GT), Related Terms (RT),

-11-

0i 0o 0 00

A Saa

00 0 00ILn50 544

0 0 0 14 04

0 0

*~~p 0 0m ct

M 4)0 0 M

In

0 00 0 94

to 00

0- f-4 9 0.q mr* U C. ~ C, ~0"

ga

-12-

and Posted On (PO) terms are listed immediately below the

main term entries with the code GT, RT, or PO. "Se e"

terms and "see also" (SA) terms are included in the the-

saurus.

2. Keyword Index

Published annually, with supplements as 4,000 or

5,000 entries are accumulated, this index (Appendix D-2)

provides a manual searching tool of all items in the collec-

tion. Each term is shown with all the accession numbers

posted to it. The accession numbers may then be used to

locate the abstract card with full bibliographic data or the

document itself. To simplify this manual search, accession

numbers are printed in 10 columns corresponding to the

terminal digit of the number. The index is kept at the lab-

oratory for quick ready reference-type searches not requir-

ing computer processing.

The index as well as the thesaurus is produced on the

NCR 304 at the University of Dayton. Frequency of use can

be determined from the index printout but not from the

thesaurus.

-13-

3. Document Search

Search requests are received by the Materials Labo-

ratory and sent to the University of Dayton for processing.

The search writer formulates the question and writes up the

search in English (Figure 4). The word numbers are usu-

ally looked up by one of the student employees. The codes

IR WORKSHEET FOR SEARCH *......

PAGE -OF

CONNECTOR WORD'DER WOR-AND OR NOT NUMBER

FIGURE 4

are transferred to a keypunch form (Figure 5) used in punch-

ing cards for the retrieval program on the IBM 7094 at the

Materials Laboratory.

- 14-

INFORMATION RETRIEVAL - SEARCH INPUT PAGE OF

SESEARCH TTLEOf 1I12 13 114 15, 16 17, 10 1 L20, 21 122,23,24,25,26,2? 126 2930,31,32,33 34,35 36,3?,30 39,40

I I I I 1 ! ! I I L Ik I I . I I ' I I I -1 I I I 1 t I I I .I I! I I , , I -

NAME OF REQUESTOR CUTOFF MAX W H41,* 42,4S .44,45,464?.47 8,49,S50,5152,53 54,55,56, 57,59 ý5.,6O 6 6 ?0, .0s

I I I I I II* , *I , .I . .,,.11.............

J I I 1 I *, 1*_1 . ... v I

CONNCTO I ii CONNECTOR Ii I!

IORDER -ONNCT- WORD NUMBER ROE ORDER CONETO WORD NUMBER ROLEAND OR NOT _ _____AND OR NOT______

8 Y 0 9 1 10 IS 1 21314 1 1 1 s t 6 1 9 10 1 2 1 4 1 6 1 819

01 -41 21-61

02-42T 22-62

03-43 23-63

04-44 24-64I 1 l11 1 I - - - _ _ ! I I !I I ,

05-45 25-65- - I I I I I .. .I -...- - _. I. 1 I I I I . . ,..

06-46 26-66-..- - - I I I I I I - . .- I - _ . I... I 1

07-47 27-67! i I 1 4 . . I. I I . I I I I ,,

08-48 28-68- - - - I i I ,I, , I I ... I I I I I .I

09-49 29-691 I 1 1 1 I I I ,i. 1 I 1 I .I

10-50 30-70, ,I I I I I I I I 1 I I I I .

11-51 .31-71S, • i i i _i I i I I Ii I ..

12-52 32-72I I I I I I I__I __. __________

13-53 33-73,I I I I 1 I I ,, I I I .I l I I

14-54 34-74I I I I I I I ,•. . I , I l I l I

15-55 35-75,,I I I I I I I . . .. . . I I I 1 I I I

16-56 36-76* * I I I I i ... I I . I I, I , l

17-57 37-77I I I I I 1 __ __ - 1_ I II . I I I

t8-51 38-78I I I I I I I ,,I I I I I I !

'9-59 39-79I II I i i __ __ I 1__ I i I I I I

20-60 40-80SI ! 1 i I.11111 I .iI ,

FIGURE 5

-15-

Resultant printouts (Appendix D-3) indicate the search

number, search title, requester's name and extension, spe-

cial instructions on the search, order of terms, corrections,

term numbers, and terms to be searched. Results are in

the form of accession numbers for documents containing all

or some of the terms specified in the search question. Ac-

cession numbers are printed in 10 columns.

Printouts are reviewed by analysts at the Center be-

fore the requester receives a copy. The analyst may indi-

cate items which seem to be best suited to the requester's

needs, ones which look doubtful, or ones which are ruled

out immediately. Local users will receive a printout of

terms; outside requesters will receive a list of references

or the actual information they required.

4. KWIC Index to "Materials Information Bulletin"

Weekly, the IBM 7094 prints a KWIC Index of new doc-

uments added to the collection (See Appendix D-4 for sam-

ple). Permuted titles refer to the accession number (found

at the right-hand side of the page for each title). This ac-

cession number may be used to locate either the abstract

or document. A request form (added two months ago) is

provided at the back of the bulletin, allowing the user to

-16-

circle any accession numbers pertaining to documents for

which he wishes to see an abstract. This form is returned

to the Materials Laboratory, and abstracts are furnished

as soon as possible.

5. Other

A number of printouts are made to assist in system

management. The vocabulary may be printed in alphabetic

or numeric sequence. The Generic File may be printed,

creating a listing in the same format as the thesaurus, dif-

fering only in that all terms at all levels appear. Also,

lists of errors are printed by each of the updating runs for

correction.

5. ACTIVITIES BEING PLANNED OR DEVELOPEDFOR MECHANIZATION

It is hoped that the "Abstracts of Active Contracts, " now being

produced manually, can be printed from the DD Form 1498 file at DDC,

directly from the computer to reproducible mats.

A Miracode system just purchased will be used to store Materials

Laboratory information as well as the "Commerce Business Daily"

entries and some AEC materials information being purchased on film

from the AEC.

-17-

Microfilm will be obtained on all other older documents, micro-

fiche on the more current.

-18-

III. PROGRAM SYSTEM DATA

1. FILES

(1) Vocabulary File (Master Word List)

This is the basic file of valid descriptor terms and their

numeric code equivalents and also contains "see" terms. Two

versions of the file are kept, one in numeric sequence which is

nearly alphabetic because of the code assignment technique, and

another in computer alphabetic sequence which is a slightly dif-

ferent sequence. These and the Thesaurus File are the only tapes

in the system that contain English.

(2) Generic File

This file contains records that reflect the hierarchical re-

lationships of the vocabulary. It consists of pairs of term code

numbers, the first being posted on or generically lower than the

second.

-19-

(3) Thesaurus File

This is the complete dictionary for the system. The the-

saurus is not required by the computer system except as an in-

dexing aid and a search writing aid. It centains the codes, first-

order generic terms (both higher and lower), "see" terms, "see

also" terms, and related terms. Bombardment and irradiation

are examples of "see also" terms; each is a good term but there

is overlap in meaning.

(4) Posting Index (Search File)

This inverted index contains term code and accession num-

ber pairs in 32-word records. When it is transferred to the 7094

system, it is reinverted to document sequence.

2. PROGRAMS

(1) Input

Data cards containing an English descriptor and the docu-

ment accession number are read. The English descriptor is

compared to the Vocabulary File. If the term is valid, the code

number and accession number pair is written on a work tape.

-20-

The Generic File is examined, and all higher order terms are

selected for automatic posting. These are also written on the

work tape. Contents of invalid cards are printed for reassess-

ment.

(2) Post

The work tape resulting from the Input program is sorted

by code numbers and posted in proper sequence in the Posting

Index.

(3) Search

Batches of four to six questions (maximum of 92 words per

question) from one or more users are read and stored. The term

codes of the questions are compared to the Posting Index, and

their Boolean relationships are evaluated. Evaluation takes place

serially from first term to last and on two levels. AND or NOT

terms are on the higher level and OR terms are on the lower

level. Thus the truth of a single OR term in a string makes true

that section of the AND statement in which it appears.

Provision is made for limiting the total number of document

retrievals desired and for selecting the number of true phrases

to constitute a hit.

-21-

Accession numbers of retrieval documents are printed in

numeric order within groups showing the number of hit terms.

Two versions of this program have been written, one for

the NCR 304 and one for the IBM 7094.

(4) Print Thesaurus

The preparation of the Print Thesaurus tape involves match-

ng input time with the Master Word List tape. A special sub-

routine is required to add new terms to these tapes. A cross-

match is made to establish that the same terms are included on

both tapes. The Print Thesaurus tape is used to produce multiple

copies of the thesaurus off-line.

The thesaurus is printed in numeric sequence. All first-

order generic terms, related terms, "see" terms, and "see also"

terms are printed.

(5) Print Keyword Index

English terms are extracted from the Vocabulary File and

merged with data frorrm the Posting Index onto a work tape. The

tape is sorted into sequence by the English term and accession

numbers, and printed off-line. A supplement to the Posting Index

-22-

is printed when 4,000 or 5,000 entries are accumulated. Once

each year, all the supplements are merged and a complete ver.

sion is printed.

(6) Print Vocabulary- NumericPrint Vocabulary-Alphabetic

The Vocabulary file of codes and English is printed in the

sequence indicated. To date, the alphabetic sequence has not

been printed.

(7) Print Generic

The Generic File is printed in numeric sequence.

(8) Vocabulary Update

This program makes additions and deletions to the Vocab-

ulary File. An addition is a new term and an unused code number.

Code numbers are assigned so that a nearly alphabetic sequence is

maintained. Unnecessary terms are deleted from the file. Those

terms are also deleted from the Posting Index.

(9) Flip

This program performs interchange of one term for another.

It deletes the first term from the Vocabulary File and inserts the

-23-

second. It then moves the postings from the first to this second

term in the Posting Index. If the second term number is zero,

all entries in the Posting Index are simply deleted.

(10) Change

The English portion of an entry in the Vocabulary File is

replaced by the contents of the change card.

(11) Access Nimber Flip

A single accession number may be removed from posting

under one term and inserted under another term in the Posting

Index to correct mispostings.

(12) Delete Generic

This program deletes single entries from the Generic File.

(13) Add Generic

This program adds single entries to the Generic File.

(14) The3aurus Update

This program is used to make changes to the Thesaurus

File. Change cards containing code numbers and designations

-24-

P (e. g., GT, PO, SA, RFT, and "see" terms) are read, sorted,

checked for validity against the Vocabulary File, and posted.

Invalid terms are printed for correction.

(15) Punch

The contents of the Posting Index are punched into cards

for transfer to the IBM 7094 for retrieval. This step is neces-

sary because of magnetic tape incompatibility between equip-

ments.

(16) Compare

This progi -compares the vocabulary to the thesaurus to

find terms that exist in the vocabulary but do not appear in the

thesaurus. These terms and invalid terms from the Thesaurus

Update are reconciled by deleting or by adding in the proper

place, to assure one-to-one correspondence in the two files.

(17) KWIC

This is a standard program provided by IBM to all users.

It prints a permuted title listing for all new documents.

-25-

IV. EQTIPMENT, COSTS, AND EVALUATIONS

I. EQUIPMENT

NCR 304 The NCR 304 system is owned by the Universityof Dayton and is used primarily for nonscientificdata processing problems. In addition to thefollowing equipment, the computer also haspaper tape in and -ut and typewriter control atthe console.

304- B with 4K memory

330 magnetic tape controller

8 332 magnetic tape handlers

320 multipurpose converter

340 printer

380 card reader

IBM 514 card punch

IBM 7094-7044 The 7094-7044 system has been rented by theDigital Computations Division, a service facilityfor all of W-PAFB, for about one year. It isused primarily for scientific computations, andabout 85 percent of the programs are in FORTRANlanguage.

7094 direct couple system with 32K memory

8 729 Mod IV tapes

disk (10 million words)

-26-

-7044 input-output computer

1402 card reader/punch

6 1403 line printers

2. TIME AND COSTS

The University of Dayton personnel assigned to the contract con-

sist of five full-time employees (professional, technical for subject in-

dexing) at the University and five full-time employees located at the

Center.

The contract with the University of Dayton has cost the Center

approximately $150,000 per year for the last three years. This in-

cludes system development, indexing, retrieval statement composition,

and file maintenance.

The search program, which ran approximately 30 minutes on the

304, takes only 3 minutes to run on the 7094. Some 400 searches were

made during the past year, and some 600 are expected this year. In

addition, 10 to 15 manual searches are made each month.

Costs on the 7094 (at $400 per nour) have been approximately

$15,400 in the 15 months since September 1964, including $2, 300 in

November 1965. This includes the cost of printing KWIC title listings

-27-

and operation of the system. Since the Center is not charged for search

time on the Materials Laboratory's IBM 7094, they feel they save

$11, 000 by using this computer.

3. EVALUATIONS

The information retrieval system established by the University of

Dayton became operable in mid-1963. At that time, a thesaurus of ap-

proximately 10, 000 terms and a dictionary containing references to ap-

proximately 6,500 documents were tabluated on the NCR 304 computer,

and multiple copies of each were forwarded to the Laboratory. It was

only after this date that any form of an evaluation could be made on the

propriety of the selected system and its various components.

The use of links and roles had been added to the indexing process

in order to reduce the number of false drops and to permit highly soph-

isticated searches. It became desirable to determine the depth of in-

dexing being performed on each document and whether links and roles

were serving the purpose for which they were intended.

(1) Evaluation of Links and Roles in Searches

A study of the value of links and roles was undertaken by a

student of the Air Force Institute of Technology (AFIT) as his

graduate thesis. Working with the University of Dayton staff, he

-28-

ran actual searches on which to base his evaluation. In this study,

roles were found inferior to links. The use of links showed a re-

duction of irrelevant information by over 56 percent while incur-

ring less than five percent loss of relevant information. The

study recommended the dropping of roles, or an increase of the

word limit for computer searches from 40 to 100 (40-word limit

is sufficient when using links alone). The recommendation to

drop roles was accepted, recognizing that it was almost impos-

sible to proride definitions which would assure the use of the

same role in a question as in the original indexing. Complete

results of this study are given in ML TDR 64- 152 (see Refer-

ence 1).

A second evaluation of links and roles was made by a Uni-

versity of Dayton employee experienced in setting up actual

search questions. This study supplemented the first and con-

firmed the decision to drop roles.

(2) Special Indexing Studies

A special study has been made of the indexing process.

This study was devoted to the indexing of documents in which

attention was paid to the location of the terms indexed. Each

document was indexed in four parts: the abstract, summary and

-29-

conclusions, table of contents and figures, and the body of the

report. The indexing was done in the indicated sequence, and a

color code was used to distinguish the indexing of the four parts.

The indexing of each subsequent section was used to complement

and/or supplement the indexing of the preceding sections. The

results of this study are tabulated in Tables I and 2 of RTD-TDR-

63-4263 (see Reference 2).

Realizing that different disciplines presented distinct in-

dexing problems, the documents were categorized as being in the

area of ceramics, chemistry, metallurgy, or physics. However,

since the reports did not necessarily contain all four sections

from which terms were indexed, i. e. , all reports did not have

abstracts, etc., additional tabulations were made of those re-

ports having similar sections. In addition, the results of this

study show some of the costs added to the system by the use of

links and roles; e.g., 50 percent more entries caused by use of

links and roles undoubtedly results in increased indexer's time,

keypunch expenses for time and materials, additional computer

processing time, and additional postings.

-30-

(3) Additional Studies

The Center has, for the past three years, run searches on

projects proposed for contract and distributed these to the proj-

ect offices involved. Following these searches, a questionnaire

(see Figure 6) was sent to each recipient to determine the value

of the particular search. At the end of 1964, some 42 replies had

been received; 22 indicated that the search results had been of

help, and six indicated that the search results had actually can-

celled parts of projected projects. Some 183 searches were per-

formed this past year, but results of the questionnaire are not yet

available.

-31 -

EVALUATION OF INFORMATION RECEIVED FRCM

EstimatedPercent

Material was closely related to my work %

Material was moderately related to my work %

Material was remotely related to my work %

Material was totally unrelated to zy work %

Material was new to me _

Material was not new to me %

Receiving this material affected the courseof the work

Receiving this material affected the choiceof contractor %

This material indicated some anticipated workwas unnecessary (J

This material made no contribution to my work

would have appreciated

Journal Literature Patent Literature ___......

s material adequately pin-pointed? YES NO

mments.

FIGURE 6Search Questionnaire

-32-

REFERENCES

"An Evaluation of Links and Roles Used in Information Retrieval,Technical Documentary Report No. ML TDE 64-152,July 1964, AF Materials Laboratory, RTD, AFSC, Wright-Patterson Air Force Base, Ohio (AD 606 192).

2. "Establishment of a Coordinate Indexing Retrieval System for theAir Force Materials Laboratory, " Technical DocumentaryReport No. RTD-TDR-63-4263, March 1964, AF MaterialsLaboratory, RTD, AFSC, Wright-Patterson Air ForceBase, Ohio (AD 428 423).

-33-

APPENDIX A

AIR FORCE MATERIALS INFORMATION CENTERS

0. N

c-/ u4

E 0 LI

00 uC

-~- I

.2 LC06 3. 41

C19c 4

APPENDIX B

MAINTENANCE OF THE THESAURUS

THINGS YOU CAN DO TO THE VOCABULARY

CODE COMMENTS

1 A Add a NEW word to the system; should have anumber which has never been used

2. C Change the spelling of an existing number. Ef-fect is to delete one word and add another withthe same word number

3. D Delete existing word on vocabulary which DOESNOT have postings on the posting index

4. F a.) Flip to "zeros" for a delete only--thosewords which DO HAVE postings on the postingindex. Effect is to delete the word from thevocabulary AND the postings from the postingindex; new word is NOT added to vocabulary.b.) Flip to another word number for deleteand add. Effect is to delete one word fromvocabulary and add a NEW word with a NEWnumber, while "flipping" documents from theold word number to the new word number, de-leting the documents from the old word number.

THINGS YOU CAN DO TO THE THESA URUS

COMMENTS

I1. Add a new master word # (not previously in the thesaurus) using00 as the posting.

2. Add SA, PO, GT, or RT to an already existing master word # inthe thesaurus. If no master item exists (a 00 item) then programprints error and new card is not added into thesaurus.

3. Delete master word # and ALL corresponding postings using 00and ERASE

APPLINLX B(2)

4. Delete individual postings SA, PO, GT, or RT using ERASE.This is used when master word item is to remain in thesauruswith or without other postings.

THINGS YOU CAN DO TO THE GENERIC TAPE

CODE COMMENTS

1. A Add a NEW PO to the generic tape; both the

master word # and the PO word # MUST be inthe vocabulary

2. D Delete an existing item from the generic tape;there must be a one-to-one correspondencebetween cards and items you wish to delete;i. e., one card must be punched for each itemyou wish to delete

THINGS YOU CAN DO TO THE POSTING INDEX

I1. Add new documents--word items to the Posting Index (from indexcards or error sheets). Cards will be matched with vocabulary(sorted by word) and output will be matched with generic tape.You will get a new error sheet, also, the generic tape matchoutput will be merged with the search tape and a supplement willbe printed (or the entire search tape, if desired).

2. FLIPS--the flip cards from the vocabulary update will be used todelete access #'s and add them under new master word #'s. Thisoutput WILL be matched with the generic tape, which output inturn will be merged with the search tape. A printout can be madeavailable if you so desire.

3. "Bad" access numbers can be deleted from the posting index.One card per access # must be punched. The "bad" documentswill be deleted, leaving good documents untouched--even underthe same master word #, i.e., you can delete any number of"bad" documents under a certain word #, leaving "good" docu-ments under that word #. Just remember that one card must be

APPENDIX B(3)

punched for each "bad" document. Also, some of the deleteddocuments may belong elsewhere. You can add these documentsto the proper word simply by utilizing this feature on the inputcards. If additions exist, the output will be matched with thegeneric tape and in turn will be merged with the search tape. Theeffect is similar to that of a flip card--the difference being theability to "flip" certain but not all the documents under a givenword #.

APPENDIX C

INDEXING GROUND RULES

APPENDIX C

INDEXING GROUND RULES

The elimination of role indicators simplified the indexing pro-

cedures and reduced the number of indexing ground rules. Specific

indexing techniques are primarily concerned with terminology or vocab-

ulary control while the basic indexing procedures remain unchanged.

First, the information analyst must become familiar with the contents

of a document before he can determine its important concepts. For the

majority of documents, this can be accomplished by reading the ab-

stract and conclusions, and by scanning the table of contents and the

body of the report. The key terms that best describe the report's

contents are then chosen, and links are used to mai-tain separation of

the terms of principal concepts. The use of links has become valuable

in separating organic compounds and preventing the "connection of

substituent groups to the wrong basic structure.

Any indexed terms that are not already included in the system's

vocabulary are recorded on master word cards. These cards are re-

viewed once a week by all staff members. This method permits the

revising of the vocabulary tape prior to the updating of the Posting

Index, and at that time, only keypunching errors should be rejected by

the computer.

The changes made in the system's vocabulary made it advisable

to make one other change in the indexing procedure. Realizing the pos-

sibility that users might ask for information on specific materials, a

decision was made to use more scope notes on the ind;ýx cards in order

to simplify the screening of search results. Any notes that an informa-

tion analyst thinks would be beneficial in the screening process are

written on the index card in script and enclosed in parentheses. These

notes are not keypunched and, therefore, do not affect the computer

programs.

APPENDIX D

SAMPLES OF OUTPUTS

U

e4. *Csn Pý 'METALSR' EF'RACTORY 'IETAg.S

4i TIA'JSIT13*4 MECTALS

346?;.lo 4H*4)IJmhl ALLOYSPO R FRAC7ORY ALL.YS

P C A TIMONIDS

* ~~ ~R.'s~ COATNOS S

7~~cPi __!qE7AT.~ TAL S.

REFRCTOY MTALCUATIN'GS.ý rARACTORY KVEALS

4i.6.i: 00 TRANSITIONJ METALS .

31 lS - POW S1LZC3DES

3:REF~RACTORY ALLOYS~4t2C~ ~ RHODUM1 ALLOYS

i~zrý55 P3 q'RACTORY ALLOYS

3,. b2 0 0 P0OO01M ALLOYS

34.2COC1 p REFACORYM ALLOYS

3425501, P -REFRACTORY ALLOYS3462co. PJROOVIM ALLOYS

3470.,.1 RNPj0 4 RAOY LLEn_. AL=LP _ALLOYSUT

.J I.; P1 MANGANESE 5161CATE2ý0655_; PO. MINERAL$2r,7?t% P3 uXED oxIDE9

KZ SILICATES

144ý--,, PO FASTENERS

1? 1.c -0:4ET "O'TOR CASES

D-2

PUL 23s 65 Document Subject Index PAGC 253

'" PYL 23 . ,_... . ._ _--I OO0A 1-98IA 13933A . 12619

3A .. 3713L255 .

I-'" YL 34 ....323A 236A

-jTrTITYV COAYINS ....i4OOA 3161A 316 A . 3163i 1... 4A i'I I t1172A 4271A 35PCA __ 343A____ - O--49___ I6'A 7... c 3097A 194AC 3o49A

1 Z A 15411A 78?'A 84-3A 3e4loA I ' -- 3|-6A 3487A 124PAD 3lir9 A'ý4',,) . '_ -171A 147 1 -49•,•A 1 _ L ._31__6_ 3697A 06A ___3519A_-- I'J 3171A . .. I33'3 II-"' 1•3A -- ____• " "_.... .....

I4:DJ 13141K i3332C 114033 167 i4A7 20h':A 3166A -8557A 312A 36) 9A1433DA 17041A 133920 __ 1133A -_ 55 . .A z 1 .105A -. .....6A lerAA .. 69A _25620A 13392E 20223A -l-1(A 1|616A 6557C .34& 16,'.W9 .

14512E - -25613A _._25eA 12076A ___16497A_._. 1171U ?55CA.1#51 e m64)lA 16527A I.4PA 25609A

__..... ... . ...... .._____... ......... .. ..... ..__ _ 16• 6A ... .. ... .......... _____ ____,

_5466A -P5596A

'4TE INS1243 4 _3 J 9c _ 5.6. __..... ......... .

133?-C 157o5A-- 1 6A i3A57iC 2029k25495A I?46C _.... ...... 13779A

Z5I96A 13779E

•.L$E 25043A__ _4934A 15 0 16 A 1472?

150143 1501611 25088A15014: ,

15014E

.. .. 4 J8 3 A .. ._4554A _t:35A 25557A

J . . . ... . . .. r• . .. .

li. 7fA T1DtJ,,CTuqE

2 490 2 A

WzIF!CATION 2S6 4 2A 24813A 2[1 3 4A -P4 5 6A 247 28A

Y(,APJ 11 I498 -

1 57A

bi.U

0-3

INFOR"AtI)3 RETRIFV*L -- D3CumENt SEARCH NO 8533 DATE 25 40V 6S

A RC-4 TILF - CERA"I: RiINF04CEDI C)RP')SIFES REOuESTEDO 8 - 8 EPRICK 36123 PR CJfOFF s PANX 40. ALL

'It'nil C3N4 01300 V4.

I A 411 343JO00 RE I4F]RCEMENTSR 4587500 WI ISOERSI UR 1461500 FILAMENIS

4 O 1463000 FI8ERSS 4A )2%0)000 P)LYMERS

6 A41' 1016500 CaMPnSIiESSt0 I hh4 4M00 GLASSES

I NOT 7h6?0CU NITRI|ES'ngT 919500 CARBIDES

IU 41T 1617500 GRAPHITE%II NOT 624500 BORIIESI2 NOt 3h19050 SINGLE OXIDESIi -4' T 6)000n "tRON14 NOT 2511500 MIXED O010s

13931A 012hl 0143048 013362C 014034A 014272A OL4452A 0146660 015678A 016301C68h3A D1&111*A 014344 019?50A 00621IA 020721A 021312A 022141A 022176A 022238O

11)2. '225213A 022O512 022538A 022724A 023569* 023570A 0236284 0239494 024522A47'1J8* 04114A 024897* 024909A 024909A

I V 0)CJ"E'dS LISTED ABJVE :0'TAIN TIE FIRST 14 WORDS.

,1442F UL3IsR%0 03A?0R4 008672A 011?b16 021590A 022271A 024818*

16 8 U0CumFP'IS LISTED AP3VE CONTAIN Iqf FIRST 12 WOROS.

*1442F 3I44?: 031447H 0314421 03144?J 0116M98 012034A 012303* 012500A 014370351)M& 02134a 072276A 022322A 022533* 0247SIA

k6 0)CJMf4IS LISTED AROVE CONTAII THE FIRST 11 WOROS.

ot I DOCCJm

ENTS LISTED A8OVE CONTAIN THE FIRST 1o WORDS.

,141fA jIO0108A 0I01080 01I8778 011898A 012348A 022020A 022149A 0221554 0225118

to I0 Ori)J-EiTS LISTFO a&iIVe Cf)JtAI' THE FIRST 9 WORDS.

I!,/8 JI146?C 02I05A 014732* 070551* 02253*A 022713A

07 1J)CJOE4IS LISTED ABOVE :14TAIN T-If FIRST 8 WORDS.

4 A I ? 0116 ?A

,f U.)CJwF'4S LITfU AB)VE '.0NTAIN tif FIRST 7 WIIORDS.

lul/Ja OJO1om 01)712* OO442 O00207* 010431A 011689A 011689C 011689E OI87OG24:)IA 0126150 0126?%C 012675U 0O26?SE 012675M 012675m 012675L 012675 013783C

'.2h4A Jl43R(.A 0144OI A 0142321 0?0125* C24Lb9A

it ?h UJCJNENTS LISTED AB)VE :3NrtIN THE FIRST 6 .r)kDS.

iOOuSA 9)0106A l000(,•7 000008A 000009A 0000I0A 000011A O00012* 000313A 000015*

161741, J)0?U30 G)0264$ 000248C 0002644 00o414* 100429A 00041SF 0005464 0305888

ID-

KWIC Index

WW%4mN w tr 0 f. w F" 4) 1% FY N W, W, WN '0 -r N 0 m P% N m w m P- Pý 4 0 0 0 um 0 4 N f" 't f

a a IV 10 0 4 -d 4 a 4 .0140 0 41 - 0 4 'c 'D 4 -0 a 4 C) 4 6N 0 0 a .0 ý 4 .4 N .0 4 r 4 Or a c .0 0 4 c -c Q, W%

416 a c 0 cu - w = p- t- ao c #v% c cu c r = 1: z- 06 .0 w jo w 000" , 000`0 ", 0 w , "'o : "r w Q

ry N ry N.- NN a, N f.. f4 N NIN 14 ^a N IV N N N fy 4p f" N fm N sy f% rv N N N rv 04 r" N ry r4 N

w a C w ýr CID 60, OC Z b- 1.9 IL

L9 #7 it cc cot j j .4 w LA -j j .9 U. -4

or Cf 0 M: 0 C cý w j ui > LL 1. V1 V., 4F U. LA k- w, X

J Q I W CA j L" &W- -1 c U. %U a - -ý 0 W - A. CAa 0 'L. j f ý4, 0 ýu >. J. - :7 .1 0- or tu uj - Z cz oweW U, q W .9, j ý 46. 1 , u b.. uj a e v 'i U. LL 21 U)

3L at A. U 6- - gz W $A ý; CO CC CC ýQ .9 4A P. L.) ui uj U w w ý I-kA uj .9 w eý C 10 to $- - 'c IZ U u w w

4j a 0 z 4L V, 0-4tu CL

4 0 CL j -. 0 V)

cz "i U414. 'a 10 j Q -j W W-j 14 V,uj ji - 9L 0 a, -i Ix %j

.9 ý 0 cc -21X U.ý uj 0 0 e jnfuj w W wh w ;e .4 a-j 6- IC 10 = c 1 0 b. -'! C 6ý >-'- 4A %A --) - - %6 0 0 LA.

0 V LAJ Uj C 1 '* ý A e4c ý! 'Y 0 1 1- LU wcc -a ui CL J1

-j X QQ ut Iuj 1z j z LU wj%A %A -1 UJ 0 'J.- N uj Z Xý ori- LL -L U. U LL

s'LQ A 3L JL.U t-)uuw co 0 L) W U) ar

CL V, Z! A 11 V -.) J. L4. 41 9% e Z; I Z uj cc ta,0 7-,: jj V ýj 2L, I-) jr X 0.- Q :I- -a I -x JL

L.J' - .4 -!.* tu

LA. c cý CL 0 6..20 j ce uj a -V'ku.j 1j 4 t^ W W, ýr c W11, 1j uj Q A. k^ LAO

U. )-- t& N N - >. -j le w -c -1 uj U.u w j w wi- .1 j A.A'.d L) it b. 3L j V j X cc

j cc cc "J dr-i UJ4 CL - ij V1, X y 'ja to A.M Lj %n i U) W

t". " 0 .9 - = -,'j Ij -j Lj :;I Ile It Ix 3- UO. cX 11 ::1-Lý: Ile, UQIJ t", ý -c 0 0 .5, ýLu a .ý, L2 L61 - Q, k 2. M .j W, -1 k^ > z AJ uj w e.'Ab.- U"d U. uj L 1W L; I u P- e 0 >. C.ý C; -j ud - so uj V1 3.. w w

4 X W, u -ý W. 2. dr w w j L2 - 0ý uj -j z). " 14 ol

ýj 41 m z < CL D u -4 u -9 &L ýu*f ce Zm -j wj V, -W 'u, 'a wj b.. 4 . z -IXw -4 LAJ -4 U, -2 cr _W1.4 z 2F. j 1 a ý u C) 6- 0 Id LU 6-JUJ

L; -a A. 42 k.ý - 7 m) - e ui XI.E A V1 jA. 1ý' a -a =

.6 ý6it. LLJ L.0 4.4 -daL )c z -j ui L.J,.zZ .4 61 tj CL .0

uj [A^ E: I w I

! .4 >-CL U 10 11 A. - rý V) X V, to, 0 U, Q v, I 't rý ce CL LIW, -1 0 LL. P-- 44J JJ'X C) Wýj N Z I Ln ", " D 4 21 Xto W, 0 U. vi uj -W "i

V,- V, " L.! Z - - Q a LIJ IT! .1. U, % -IJ 0 " -;ý! :: E = I z 0 2C Aj, 4f 0 0 b.- 0. -a I L; '.&, w tj w 4 X Ic 0 Or cc >

-j e tj i is L6 tY ýILJ ý.J _j wll;.j W) JL 2L

-1-4 -j .1. X Ni.6 D zLd j sui e -1-d < 3-1 0ý - -j X -mix w Q -1 a = ý *416AJ U) w 0 Z >

.1 ý5 uj uj = ;..j 0 tu 11 io tj uj W 0 X -W W .9 66. .U ui uj 0 11 ^ 0 %A m 6-1 W,- - - ý 0 to - JL> zo. = -i w 2 L.) -j 1.) () --- QZ W =io Q 0 - - - - - - -

:.z w z ziw 0- w Q -a, z -1 .0. = IL ;L Q:,j ki Z a -- z e rp = b- I V- A VV

(OX, Qj u -9 ). 3. - - X - ý, - or - - W e. < 4 ý E X 4 -a 0 u u = w ý; ýj -1 -2c >- & 7 z r ;!-j -j -i -i - oi= 4 w o. 2 o mr, % a ý^ tr Z 9L 0. Ia. 0. 0. 0. a. 0 o- ý

ýj j j v7 mý, 4 cx r. L, i 4a n cL E vi ý 4x A. -a e e x Q: -a < -i u j s 4 -a a 3, , x a x 2- a. .41Q.e z z0 cc = w c: c - -j -j 25 = c = c 5 c 0 1VI uj LU 44 4 0 <'.c 4 4 ýw -w w

LL, U. &L.V, w z 4. U. c- w X U. Z a Q ct 4,6 U Utw U Ct LA. rý W Ao' UJ Z J LLJ X j Q L 4.4 J Q L.

.,6 of cX uiI- ýq CL U J =,O tj O-w ki

.U U. LA b- z - Oz. w 0 7!fl: 0 -j Z U -i V, j .:; Uj X A ar

ar -4 z :) QýV, uj uj -XI w < 0 U= w 4 = u ;: 4 - :: ý: -j u -j b- 0i X c) a v, .41LU -j> U. 0 M -,a ce 'ji % M; I Or tr -,j ýX -,Aj 'U'ji 4 -4 4A U. 0 M, w A w -1 30. Z: X ý ;- -j X o a.

u ^ b- W 0. -'.) L 6- a, ý111 W X J. -i M'ý J cr J: L& a. 4 -d u b- crU, -4 LL k6

4' 3ý .41 0 u LU 0 zU. Q w L^ X = 1j Q 6L V) D u u 0 UA u - -M Lý,Oý w ýX U1.4 W,.W uj -41 La ým

0 D 0 z uj w I" ý,w 1 3. -j 2 - I Z r- CL 0- 0. -4 UP ý of y CO I Uj ujCL cr ox m - X -4 "j Lm 6j 'a < %M U., uj U, ki

U. I& w 1: - . uj t.. > e IA " ly I... L > b.- ui!; : 0 crýu) X X cr ýLýx U. v 0 -4:1or It 0 a 6 V, V, L) Uj Q LU 6. 0 mlý uj I U. d m z z ri Cf Q uj .4: U, 0 6- -

U, I 'I ý!CC Q -9 L; j zf; , 6^ e .4, j b- -4 0- ;.ag 4.1; 0 J -1. -9 y Z -4 0.-1 CL uj b- M U. 1UJ CID %A d. - > 0 0 Z %A W Uj

.1 w -j t-) L; X cr 6mý 2- X uj 49;= %A Z X 10 'A, T 13: .4 4.-9 - ef - ce u a &L z jj M, co cpb.. LU c 0. Z -- Q 0- 1 C; Z 0 cc 6- X c): X ex ; = -tj cu .'a X ý D w X, U-W 3 fX .:,,a "i -a b- %6 1^ ýL uj I-, -j -jM. CL - , 0 W Z L.) (9-4 U uj Ui u P. 4 .16 m ý, w w. aj wcL

0- ar 'L CL 0 D Of X 1AJ M- 2L M 0 af 'qCC 0 V1 Lý cX w uj U, 3. IA LIM Q . . 'mj IA cz arl E)W Z: P. U. u b- X 1... .4 j 7 ca Z -j .4 b- , b- uj cc uj 4j:

.9 C) - cr. U U. CZ .10 &A Q LD %A D 4 CL w Li g Q w -C 1cr. - - z uj -1 (AQ Q uj tj u n ).. j X 0 - U. b- a b-

-9 .9 0 3. 1" LL 0.9 .4 m u X 0 < w -j W LL) 0- CKc lw U. z z 6-1 Z - .- 4 0- > U, ui 'L .1 - w -a.- 66 0- do w 'AJ 4L,-j W z ýL dCj U b- 0 U C. j %L b.-

IA. c LU X ujý w uj cj LL. 0 w co z .4 V -C j m 0 -1 0z Q rv 0 a 0 U 3. W1 0 &A 0

-.. a I ior Z e Z 7 IJ z IA 00 cat 13 .A Ij I CC z61 -4 1:1ý = J 0 cz z I U .4 -9 ;3 U. U. W U. a, W Uj W !% -9 0b- j b- uj _J1 w 0 uj z 0 0 C3 w IL j ý LL 0.. m-4 D 2. UP C13 z j %A uj 2. V) P- U uj Z C2 iu) 49 .4 &L I 4A X ujat 0 'Z uj >, 0 0 X tA W X U. 0 ki ua 1; -

0 0 uj .j w CL uj 7p 66 Z b- :0 uj 0

M IL 0 X 0 1 OX 0 U. ). 4d LU Cc 0 ; 9L uj. a - .0 U mi ka - -k as tj - 40 461 4A At

kA Loi -j J noc lot %M LU W Cie 0 0- 00 C16 b-. %64 CC %> -9 uj - do LU 4A X Z 0 441 3C LU 419 4L IL 0 J- 4L dq Z)

UA 4A 0 lb- j uj Fý U) 6u ag 4t j w w X w wwo P- CA -

0 ca s.- w W co3c 1 .9 0 1 1 'A. oo' wj X, IL cc LA 0 0 IL Z ciA %A Q U.w 6A p Z, X - - Z:w -1 b. z ku 21b W w -0, ' 4' at ofk., cc ýi %w Xc N zoo a. u War mi 0 cc I U1 .1ý,A - Zd1l 0 , , ý z 0 Z)

at IL 49 : a X b- dj: M 06

- -9 - :ae w 400 a A 6L Z. 0- UA w w ýj Q49 IL uj J 40 a " 40 w %j .41 X ujw 0 w

4A w I--,= 61:1 me.. X 0-1 0 Z, LL U.

Unclassifiedi•Untval RCepor ofn-tloey

DOCUMENT CONTROL DATA RE. &Dao

BOOZ" 4Ci-'EN ............... RESEARCH, INC. Unclassified4733 Bethesda Avenue ? -......Bethesda, Maryland 20014 T

I Sept- eITLE Mechanization Study of the Aerospace Materials Inb1ormationCenter (Including the Ceramics & Graphites Technical Info Center),Wright- Patterson Air Force Base, Ohio

Final Report of on-site survey

G. A. Kershaw, D. Crowder, J. E. Davis, E. G. Loges,E. Merendini, S. M. Thomas

September, 19665"41 AC .. ,1e i |,- ,

DSA-7-15489 914-1-29

AD 640 124

10 A , .. •'"ILA A , 0 ., I ,Y ' L M IU ?,¢U ....I... . ..N. ...C..

Distribution of this Document is unlimited

I UPPL • IMESTARY NOTES ,2 SPONSORING MILITRY ACT IVITY

Defense Supply AgencyNone Defense Documentatijn Center

I Cameron Station, Virqinia

By use of the IBM 7094, the Materials Laboratory performssearches and produces the KWIC index section of the "Ma-

terials Information Bulletin. " Under contract to the Materials

Laboratory, thesaurus maintenance, keyword index printing,

and data-base updating are performed on the NCR 304 computer

at the University of Dayton. The use of deep indexing with links

and roles formed the basis of the system; after evaluating the

value of links and roles, however, roles were eliminated. A

Miracode system just recently purchased will be used to store

Materials Laboratory information. Several studies covering

specific areas of this system have been conducted. Currently,

the Center is sending questionnaires to certain groups after

running searches for them to determine the value of each search.

DD '?!.1473 Unclassified

54LINK A LINK 9 LIN14 C

Digital ComputersIndexesInformation Retrieval

DataAnalysis

I. (SPlfW.WATIN W;5 As iTiY- Fiter the sname and addipe.. iey.r.n.d hI. soo-n.4iv 4.le.1, of ."gs,. ,,.4inli kflt~dotA statomtitst'sf ii,... -Aloa.S,,t* 0sb.0h,Iln.l 64..9sl9*p DePparmiesnt nf pfo5p miisc ait

In.p*.lil v * ..... .... ~,,t .. s.. ... *'f*uallfir1 rorque-en...'. isv rshia~st - -ps-e -4his111011110f report I (.

I.~ P1 SI? )I SUV lifil's CIV .A'IMMIt A lION I titer fith o%.- I~ s) **F'otolpss oflneui,, ..m*s ;.Mf. "Itnsns tn *hin-9 I .. st9 ' i t-5f-- vo-..n 4 lfe tI,-1 r i t~. . Ins... If, oot wheither e otIysW I ~

ws ii Ism's " ise. ro... d, rl. llkig .. is,.. to in V1 rofr-xrnle4isp ny*il.isspe s'~~~~~~~~~~~~~~ ~~~~~~ It P(li'. .. ,sti I. ',ils~ r.ifp.en hI'l. q. (srii dlip.l2 IN..o.1pos5 may,. ghitti rtip.l "I~f

Ir.. ri. 4 40-1. Its -0.. Aimesd F.-, -~ Ifd,sio,tol Alai...s1. of. qpF.iMI rm.IIsrv

I Ii "it 9 millnitv acetic sea mv obtain -is of thin

* ;s, 2 ... -i lot In. in all ene ise. ' r,. 1It'. 1004Ia.ifieps.

qI-4 Wsin..lý isl.An.tom .$.Ii all4 or,frosi Ist parentesis l 4$ssreotI ...a.,4PL ......t,.I.- i.. . l.,fl~ipI'ltit l- ptam i ;np~lp s "All 011ft,Isl.n ho s,. repi ri .*s-h. .Ips b,

: -t f i n a l..i I ' t o. II te l .1 2 21 . 1 - - b ossi 9 5 i- te l i s p 11 1ts4li .- t i a* '5*.. i'.g. 511,,,, es . ....'P .."ss.. to .if 'slia.uf. tia . "Ih* i5i1 h, I . ...... * ,i " .2 . #..I Iole f . ,. 11' r. h i l

.**2*I 1i0, tIh' los, t sold ."1"-t191. p.... P. i k.'-weis.'.Atlll~iIP I*,i,' 92.. ,Pmpoloo MI ;.l... . .lshswii no 11. 7i'0'114.1101 NI AIV %,I I Ps.~ floor I.,r .. tt,11i,,saI oirsillsm.

If -, Staas... . . ,, I I., I'i... is .I .tervoe. lisp isp-se -f*h f, n jsi. 1tt,, 55.1 U..i .. ,p I., ý .~, ,~.-,.. 111111SlP i.ki2.1 1 ARYt ACTrIVi, Y: Fiosrt thepnpnsp sif

fI,,- 1,stniaoP..a,dta pt.-.. . I ,#iel Ifo Inph.,stfos,, otp;.nnni stsa (0. P1 I 'isP I Di.A f F nt rie 1* nto4f, p s* ,orf~nv a4 ,IIAy *".0 1 of. f1. , opprs 1, p..lIve sod-s It, , sels addI,....11., . i... ...... it' Vent. If .*i itfli5 "958 'Ipie Aflf'lP41

I-.. lAt, nf .1 ...... I I AilqTRAf-r: F~ist.,- an pshoti,. I givinif a 2,rote and. In, 1,14lI 'ni",--v 'f flisp firn. utsqp,ssstt inecPt, ye of1 lits ro-prit even t houghfli ti Al. NIIUIlI. N Of- l'A(CFS Tip t,'Inrare .5 ,fii95 it ii-v *[%r, atspfoar elpwsewher in flisp I.'..dy Mi oi,. lotlsIsnral roe

It o I -. M-1,s 1-20enatinnrv~ets . I.. -. . s-u' f h. P-1 if .1ilil1i~t 'iS Ope. - I~t ron45 i.s a . '1oi; 9 9...s o 0,-f* othll.m*.I .~ ~ ' .. slfar"esIf onf8'osvr51,-M )- 'sit.., scsi

7V. %t isll-F R Ill NO-.1 I- I?FN *I- %- F---,. it, 1 s .' .. -1 or "f It i s histitt il.'irahle is t flipi e sa hotrosti I s..ea%%fiss-e reportso.li.s - , 0-1'. m~ ffP .. of-;f. I... lot, jangssfllo Pooch paragraph "t slip pshotff, t mispli end fill-I.. 5 o-4S rVit r owt IMAPI I NI iVIIFPP If mrppropvth1-. oritey Psio' tspis s'f lit' frosiifsl,% -Piirifv Isq At.fi. p..isI- tfsh inths.elt .14. p...s, A i nI-oof o ,,'n9 si ,, '9 fpin ssrnsle *his .2 It'S,- P9nit .he pa istrophi rpro-f99m-it-c! PoP f's it I,' .r , 5,I,h, i 5 ~i 4 Wa~s~ n Thopr. is n559 Iisitai,,pini ,r ts-. Ip-togth 'f.h lsp hoto,. I 11.,w,

555 P, , A, a,# 5wfirCT Nit'4lVnp Vnle 'I, ss~sp.I ~ yls lentilsI~ i~~Is ftuomy ttI VW f, 2s womoolsia,~de.Pi,.et, sidenliitr'.ssnn. -S, I- .*,. vt Pio I 9iitnhflbt. 1 PYWsD:ie snPPp9,i~iai esigsiIc

Vis .s r u~ls. %tpof .ssinl',m,proo ath~ s, p' l . 14KYWci.. eraetthial eiiniii om", oth-ii phrse~s~ sisall lsPho- estfiv P is-p..t9 Pt may~ be. isqpf so'5. 1si1i.NA rOPI, 14E1'oRr NTmnFlR1s;. r..Iev it,.. ssffi. s"sI, . esflqs~ ('If s $to .§lnsgtl if Vto.,## Ketv 5i..,s% Motor hat

is.. .11"! 1.%9 if.e rs s .g , 11'ii . ...m ... stns~ fsP, , I. )~Is am P2iIm Is. toItitc- I 4--i ps. g tp m trad..~s~ namec milIitar'y..-.. I... .. t',- it-isicI , ,do sname,. *c.totaphiss t..ssax. 1sp I.~d as.~ ike

29 , I -II is l I'oi NI 'IfII'Ro q I f t e to"p.r hasos. booest v rdot hill will Isp WfnIwai't2 iy an inln-lioP~n suf or, lonss as ro. ....I " fo,* s.....be.. f..h,is I 1- tho, fi~,dsAf,,f t"11 7%-P Pvmft-eflt-5 $0-ofm sl and a..ghte. -5m *.fialsvp

0si... .s to I. ., I. q enter, thim sssltm.

ii. A%. All AMost I IY 1.11611 VA rION NlIC ft~ FAsp anorty firstv.

ii i luh.'I,'',s.,sspissn f Stip ipt-s,i ,'iisr than lisoup .

Rot-il riniiicto