III. EVALUATING AND WEEDING COLLECTIONS
Discovering How Information Seekers Seek:
Methods of Measuring Reference Collection Use
Mary Biggs
SUMMARY. The author observes that reference collections are often too large for librarians and users to learn them well and fully exploit them. Evidence suggests that many titles in what were designed to be lean âworkingâ reference collections are rarely if ever consulted. Systematicallyâathered use data are needed to guide selection and weeding decisions. Methods that have been employed to assess in-library materials use âincluding use of journals and circulating books as well as of reference worksâare reviewed and their application to reference materials discussed. The author closes with concrete recommendations for carrying out reference collection use studies.
In an era when neither library budgets nor library buildings expand proportionately to the growth of publication, librarians need solid data to inform their collection decisions. Perhaps most needful and most neglected are reference librarians. Given their purpose, one would expect a library's reference works to comprise a lean âworkingâ collection, well-known and thoroughly exploited by the reference staff. Additions to the collection would be made cautiously, and works that were rarely or never used would be weeded regularly for discarding or removal to another part of the library. Many reference librarians have, after all, remarked the critical need to âlearnâ the collection and the frustration of being defeated by its size.1
In late 1985, Victor Biggs and I surveyed reference heads in 471 academic libraries of all sizes.2 We discovered that even within libraries of comparable size and purpose, the numbers of titles held in reference collections varied greatly. In all of our four size strata, including small college libraries, collections numbering tens of thousands of titles could be found.3 And while all libraries weeded their reference collections, and substantial percentages indicated that âlow useâ by librarians or patrons was one weeding criterion, very few libraries had ever gathered use data systematically.4 This was all the more striking as respondents estimated that only about one-fifth of the titles in their reference collections were used by anyone as often as once a month (with some guessing as low as 1%); that slightly under half were used annually (with some guesses as low as 5%); and that only about two-thirds were used in a fiveyear period (with guesses as low as 10%).5
These guesstimates, however, were just that. And even if they were accurate, a reader of the article pointed out to us in a letter, they would offer little guidance. The obstacle to whittling the collection into a lean mean reference tool lies in the difficulty of determining which 80% is not used once a month, which half is not used in a year, and which 30% lies idle for five years and more. This observation circles back to the need for use studies. How can they be carried out, and what can they tell us?
Precisely because there have been so few, the library literature offers little direct advice. To discover pertinent models, I examined reports of research on in-library use of all types of material, most prominently of periodicals. Here I summarize the principal research methods employed, consider their applicability, and set forth suggestions for multi-faceted explorations of reference-collection use.
TOUCH TECHNIQUES
Perhaps the easiest to implement are what Fussier and Simon call âall or nothingâ studies.6 Equating one use with many, these can at best yield only gross tabulations of works used, or moved, for any purpose in a given period. They are essentially of two types.
What can be termed the âReach Out and Touch Techniqueâ involves placing in each book (or in a selected sample of those books whose utility is doubted) some substance or item which will surely be disturbed if the book is moved. At the end of the studyâwhich can extend over any period, though most likely a few months or a year-âdisturbedâ titles are noted. Among the substances that may be planted inconspicuously, Fussier and Simon suggest, are âinfrared dust, beads on top of the book, or unexposed photographic paper inserted between the pages.â7 One portion of a periodical-use study at Newcastle University employed ordinary slips of paper.8
Obviously, the task of dusting, beading, or otherwise marking the books would be tedious and time-consuming, as would taking tallies to close the study (and sweeping up the beads before they tumbled readers to the floor). But a more substantive problem is the false registering as uses of mere physical disruptions. Books moved by shelvers to make space, or mistakenly pulled out by patrons misreading call numbers, or merely jostled by someone bumping against the stacks, may be recorded as âused.â The great advantage of this technique, however, is its independence of reader cooperation. âIt has been found,â warns M. B. M. Campbell, âthat the degree of success with any [use study] is inversely proportional to the level of user participation required by the methodology employed.â9
RESHELVING TECHNIQUES
Reshelving techniques, which may or may not fall into the all-ornothing category of research, require user participation but no user effort, and are probably the most popular methods because they can be integrated with normal library activity. Shelvers simply record items when putting them away. The variations are many, depending on the time available and just what the librarians wish to learn. At least in theory, all titles can be listed on a tally sheet ordered by call number or title, with space provided for the shelversâ hatch marks. Alternatively, shelvers can list the titles of works as they are reshelved. But when tens of thousands of titles are involved, this will slow the shelving considerably. W. M. Shaw, Jr. suggests affixing a small pressure-sensitive label to a book's spine the first time it is reshelved10âwhich is an allor- nothing technique if the book is then ignored until the final tally. If the label is large enough to accommodate hatch marks, however, numbers of reshelvings can be recorded.111 used a related method when working at Bowling Green State University (Ohio). A small colored dot was pressed to the spine of each reference book the first time it was reshelved in a semester. This continued for two semesters and one summer, with dots of different colors used for each of the three time periods (i.e., fall semester was green, spring semester red, summer session silver). Although numbers of uses within a semester could not be told from this study, it did reveal whether the book was used consistently. When the study was completed, the subject specialists (all of whom also had reference and user education responsibilities) scanned the shelves in their call-number areas of expertise and noted those titles that had lain unused all year or had been used in only one semester. If a specialist wished to retain such a title in reference, he had to write a supporting rationale and have his request approved by the head of reference. A weeded title might be discarded, stored, put into circulation, or sent to the stacks as a non-circulating itemâwhich guaranteed its availability in the building but reduced ânoiseâ in the working reference collection. Obviously, a dot study could extend over a shorter or longer period: dots come in many colors.
Offsetting the simplicity and relative ease of reshelving studies are the fact that they cannot yield qualitative data and inevitably underestimate use. Everything depends upon used works being pulled off the shelf and left off. But unobtrusive observation and other checks on usersâ habits show that even when signs ask them not to do so, many people reshelve the books they consult, especially when they have used them for only a few minutes. At Newcastle University, for example, twenty-one of fifty-five periodicals that were used were also reshelved.12 Discussing a periodicals use study, Martin Gordon asserts: âIt should be noted in passing that some feel⌠uses [marked by the need to reshelve] are equalled or even exceeded by [other] uses, but that [the former] are more indicative of need fulfillment.â13 Without supporting evidence, however, this is unduly optimistic and does not in any case deny the possibility of large distortions. To prevent patrons from reshelving, librarians customarily post signs asking them to leave materials at conveniently placed collection points, sometimes adding the explanation that a use study is underway.14 The study may also be publicized through talks to user groups, announcements in campus or town newspapers, and so forthâthough Edward T. Shearin warns that too much fanfare may make readers self-conscious about their library behavior and alter normal use patterns.15
Figures may also be deflated when two or more people use a book before it can be reshelved, scooping it up from a table or collection bin. To minimize this problem, the authors of the American Library Association's influential manual entitled Output Measures for Public Libraries recommend gathering data only on sample days, during which books are reshelved punctually every hour on the hour.16
A problem with opposite effect is the fact that an unshelved work may have received no more than a cursory glance from its âuserâ or have fallen accidentally when a neighboring volume was pulled downâmay, in any case, represent no serious use, no satisfied need.
In short, though the data gleaned by shelvers can be valuable, it will ideally be supplemented with other methods.
USER TALLIES AND SELF-ADMINISTERED QUESTIONNAIRES
Relying much more on usersâ cooperation, yet a potentially rich source of qualitative data, is not-so-simply asking people what they use and how.
In a study of the periodical collection at the National Oceanic and Atmospheric Administration Library, Wenger and Childress attached to each current journal issue a slip of paper asking readers to make a check-mark if they use the issue âfor any reason.â17 At Wolverhampton Polytechnic Library, Campbell placed punch-card sets in periodicals with the request that readers remove one card for each article consulted and place it (or them) in a handily located collection tray.18 Because such techniques require little of the user, they are thought (but not known) to elicit high cooperation.
More interesting and problematic is the method employed by Fussier and Simon in their famous study of research library book use. Eschewing simple counts, this team sought to answer four questions: why the reader had removed the volume from its shelf; where and for what purpose he would use it; and how valuable he expected to find it.19 In each sample book was placed a sheet of paper asking these questions. This questionnaire, which could not be seen unless the book was removed from the shelf, would be visibly disturbed if the book was opened âallowing the researchers to determine rate of nonresponse. That is, by counting questionnaires disturbed but not returned, they could tell how many people had used (or at least handled) a sample book but not filled out a questionnaire. In about half the sample books, cheap ballpoint pens were taped to the questionnaires, providing both an easy means of filling them out and a âreward.â Readers returned many more of the questionnaires that had been accompanied by pens, which, according to the authors, âhints at the degree of caprice in motivationâ and, of course, gives still more information about nonresponse. That is, it can be assumed that âat least as many questionnaires as the difference between the two groups were seen but not returned.â20 The disadvantage of the Fussier-Simon method is its complete reliance on reader cooperation, hence low response rate. However, it yields rich qualitative data. The questions asked, of course, would vary depending on the study's o...