Under AccessMichigan's Technology Literacy Grant from the Michigan Dept of Education, the Evaluation Center-Western Michigan University is in the process of conducting an evaluation of usage of the K-9 databases (Electric Library Elementary, SIRS Discoverer and InfoTrac Kids). The evaluation project is divided into two phases: (1) a written survey sent to school and public libraries in fall 1999 and (2) case studies conducted in early 2000.

The Evaluation Center has completed the interim report on the phase one survey results. Following are some highlights from the report:

Response rate: Completed surveys were returned by 758 respondents, representing 60 percent of the total sample. Of 386 public libraries that were surveyed, 285 (74 percent) responded. Of the 866 school library media centers that were surveyed, 474 (55 percent) responded.

Reasons for not signing up for the K-9 databases: 66.5 percent of the respondents indicated that their libraries were registered for the K-9 databases. The reasons the other 33.5 percent gave for not registering included:

• Student use of the Internet is prohibited: 4.2 percent
• Lack of Internet connection: 9.9 percent
• Haven't had time to sign up yet: 18.4 percent
• Didn't know about availability: 17.5
• Administrative approval has not yet been granted: 2.4 percent
• Databases do not meet the needs of our patrons: 33 percent (These respondents were high school media centers serving only grades 9-12.)
• Other: 14.6 percent (This includes such things as staff turnover, technical problems, subscriptions to similar resources, confusion with the registration form, lack of funds.)

Database Rankings: Respondents were asked to rank the databases 3, 2, 1 in order of preference. We hoped that this information would show a clear preference for one database (or two) over the others. The results, however, showed almost no difference between the three. Taking into account the responses of all respondents, the rankings showed SIRS (2.07), EL (1.9) and Kids (2.01). Taking into account only the responses of respondents who indicated they were "Very Familiar with All Databases," the rankings were EL (2.05), Kids (2.04) and SIRS (1.91). This section of the survey elicited several comments from respondents, such as, "It's difficult to rank them because they provide different information and meet different needs. All three are wonderful! Keep them going!"

Suggestions for improvement: While respondents seem to be pleased with the databases and the services provided by AccessMichigan, they did have some suggestions for improvement. Two salient issues that emerged from the comments are (1) technical difficulties and (2) need for more training and promotion. Sources of technical difficulties included unreliable Internet access, computer breakdowns, network problems and outdated equipment. A few respondents indicated they had problems with the sign-up process (such as difficulty in getting IP ranges registered properly). The training and promotion comments related to the need for more assistance in promoting the databases to students, teachers and/or patrons, and in training staff to use them. Comments included: "We need more workshops to get training!" and "Patrons aren't aware of them and we need more promotional materials to inform them. We've posted info ourselves but people don't seem to use it. You need a lot more publicity!" and "We need staff training. This is what is preventing us from offering this service to our patrons."

Summary and Conclusions: The comments and favorable ratings of the databases indicate that the K-9 databases offered by AccessMichigan have been well received by school library media center and public library personnel. No significant differences between the three databases were revealed with regard to familiarity, level of use or perceived quality.

Since the vast majority of responding institutions (more than 90 percent) have Internet access and computers available for student or patron use, the primary barrier to use (among the one-third minority who are not signed up) appears to be lack of knowledge among library staff about the availability of the databases and how to sign up for them. With 18 percent of those not signed up for the databases indicating they "didn't have time," it is important that the sign-up process be as simple and straightforward as possible. Respondents' comments regarding technical problems and the need for additional training and promotion also suggest that AccessMichigan, if possible, should focus efforts in these areas.

Library personnel clearly appreciate the databases, as evidenced by high ratings of them and the numerous comments expressing gratitude for free access to these otherwise very expensive resources. The case study portion of the evaluation will provide insights as to how the databases are being used by library staff, teachers, and students.

Updated 01/09/2006