Implementation of Proactive Chat Increases Number and Complexity of Reference Questions

A Review of: Maloney, K., & Kemp, J. H. (2015). Changes in reference question complexity following the implementation of a proactive chat system: Implications for practice. College & Research Libraries, 76(7), 959-974. http://dx.doi.org/10.5860/crl.76.7.959 Abstract Objective – T...

Full description

Bibliographic Details
Main Author: Sue F. Phelps
Format: Article
Language:English
Published: University of Alberta 2017-06-01
Series:Evidence Based Library and Information Practice
Subjects:
Online Access:https://journals.library.ualberta.ca/eblip/index.php/EBLIP/article/view/29062
id doaj-44d5c041809140029318ba63611ee5bd
record_format Article
collection DOAJ
language English
format Article
sources DOAJ
author Sue F. Phelps
spellingShingle Sue F. Phelps
Implementation of Proactive Chat Increases Number and Complexity of Reference Questions
Evidence Based Library and Information Practice
proactive chat
staffing
author_facet Sue F. Phelps
author_sort Sue F. Phelps
title Implementation of Proactive Chat Increases Number and Complexity of Reference Questions
title_short Implementation of Proactive Chat Increases Number and Complexity of Reference Questions
title_full Implementation of Proactive Chat Increases Number and Complexity of Reference Questions
title_fullStr Implementation of Proactive Chat Increases Number and Complexity of Reference Questions
title_full_unstemmed Implementation of Proactive Chat Increases Number and Complexity of Reference Questions
title_sort implementation of proactive chat increases number and complexity of reference questions
publisher University of Alberta
series Evidence Based Library and Information Practice
issn 1715-720X
publishDate 2017-06-01
description A Review of: Maloney, K., & Kemp, J. H. (2015). Changes in reference question complexity following the implementation of a proactive chat system: Implications for practice. College & Research Libraries, 76(7), 959-974. http://dx.doi.org/10.5860/crl.76.7.959 Abstract Objective – To determine whether the complexity of reference questions has changed over time; whether chat reference questions are more complex than those at the reference desk; and whether proactive chat increases the number and complexity of questions. Design – Literature review and library data analysis. Setting – Library of a doctoral degree granting university in the United States of America. Methods – The study was carried out in two parts. The first was a meta-analysis of published data with empirical findings about the complexity of questions received at library service points in relationship to staffing levels. The authors used seven studies published between 1977 and 2012 from their literature review to create a matrix to compare reference questions based on the staffing level required to answer the questions (e.g., by a nonprofessional, a generalist, or a librarian). They present these articles in chronological order to illustrate how questions have changed over time. They sorted questions by the service point at which they were asked, either through chat service or at a reference desk. In the second part of the study authors used the READ scale to categorize the complexity of questions asked at the reference desk and via proactive chat reference. They collected data for chat reference for six one-week periods over the course of eight months to provide a representative sample. They recorded reference desk questions for three of those same weeks. Both evaluators scored the data for a single week to norm their results, while the remaining data was coded independently. Main Results – The complexity of questions in the seven articles studied indicated change over time, shown in tables for desk and chat reference. One outlier, a study published in 1977 before reference tools and resources moved online, reported that 62% of questions asked could be answered by nonprofessionals, 38% by a trained generalist, and only 6% required a librarian. The six other studies were published after 2001 when most resources had moved online. Of the questions from these six, authors found a range of 74-90% could be answered by a non-professional, 12-16% by a generalist, and 0-11% required a librarian. Once chat reference was added there was more variation reported between studies, with generalist questions at 30-47% of those reported and 10-23% requiring a librarian. Though the underlying differences in the study designs do not allow for formal analysis, the seven studies indicate that more complex questions are asked via chat service than at the reference desk. Each staffing level was grouped and averaged for comparison. The 1977 study shows nonprofessional questions at 62%, generalist questions at 32%, and librarian questions at 6%. Reference desk questions in the post-2001 articles indicated 81% nonprofessional, 13% generalist, and 5% librarian questions. Post-2001 chat questions were at 49% nonprofessional, 36% generalist, and 15% at librarian level. In the second part of the study, the data coded using the READ scale and collected from the proactive chat system showed an increased number and complexity of questions. The authors identified 4% of questions were rated at a level 1 (e.g., directional, library hours), 30% at level 2 (e.g., known item searching), 39% at level 3 (e.g., reference questions), and 27% at level 4 requiring advanced expertise (e.g., using specialized databases or data sets). Authors combined questions at levels 5 and 6 due to low numbers, and did not describe these when reporting their study. In comparison, 15% of reference desk questions were at a level 3 on the READ scale, and 1% were at level 4. Conclusion – Proactive chat reference service increased the number and the complexity of questions over those received via the reference desk. The frequency of complex questions was too high for nonprofessional staff to refer questions to librarians, causing reevaluation of the tiered service model. Further, this study demonstrates that users still have questions about research, but for users to access services for these questions “reference service must be proactive, convenient, and expert to meet user expectations and research needs” (p. 972).
topic proactive chat
staffing
url https://journals.library.ualberta.ca/eblip/index.php/EBLIP/article/view/29062
work_keys_str_mv AT suefphelps implementationofproactivechatincreasesnumberandcomplexityofreferencequestions
_version_ 1725886836716339200
spelling doaj-44d5c041809140029318ba63611ee5bd2020-11-24T21:49:52ZengUniversity of AlbertaEvidence Based Library and Information Practice1715-720X2017-06-0112210.18438/B8537019719Implementation of Proactive Chat Increases Number and Complexity of Reference QuestionsSue F. Phelps0Washington State University VancouverA Review of: Maloney, K., & Kemp, J. H. (2015). Changes in reference question complexity following the implementation of a proactive chat system: Implications for practice. College & Research Libraries, 76(7), 959-974. http://dx.doi.org/10.5860/crl.76.7.959 Abstract Objective – To determine whether the complexity of reference questions has changed over time; whether chat reference questions are more complex than those at the reference desk; and whether proactive chat increases the number and complexity of questions. Design – Literature review and library data analysis. Setting – Library of a doctoral degree granting university in the United States of America. Methods – The study was carried out in two parts. The first was a meta-analysis of published data with empirical findings about the complexity of questions received at library service points in relationship to staffing levels. The authors used seven studies published between 1977 and 2012 from their literature review to create a matrix to compare reference questions based on the staffing level required to answer the questions (e.g., by a nonprofessional, a generalist, or a librarian). They present these articles in chronological order to illustrate how questions have changed over time. They sorted questions by the service point at which they were asked, either through chat service or at a reference desk. In the second part of the study authors used the READ scale to categorize the complexity of questions asked at the reference desk and via proactive chat reference. They collected data for chat reference for six one-week periods over the course of eight months to provide a representative sample. They recorded reference desk questions for three of those same weeks. Both evaluators scored the data for a single week to norm their results, while the remaining data was coded independently. Main Results – The complexity of questions in the seven articles studied indicated change over time, shown in tables for desk and chat reference. One outlier, a study published in 1977 before reference tools and resources moved online, reported that 62% of questions asked could be answered by nonprofessionals, 38% by a trained generalist, and only 6% required a librarian. The six other studies were published after 2001 when most resources had moved online. Of the questions from these six, authors found a range of 74-90% could be answered by a non-professional, 12-16% by a generalist, and 0-11% required a librarian. Once chat reference was added there was more variation reported between studies, with generalist questions at 30-47% of those reported and 10-23% requiring a librarian. Though the underlying differences in the study designs do not allow for formal analysis, the seven studies indicate that more complex questions are asked via chat service than at the reference desk. Each staffing level was grouped and averaged for comparison. The 1977 study shows nonprofessional questions at 62%, generalist questions at 32%, and librarian questions at 6%. Reference desk questions in the post-2001 articles indicated 81% nonprofessional, 13% generalist, and 5% librarian questions. Post-2001 chat questions were at 49% nonprofessional, 36% generalist, and 15% at librarian level. In the second part of the study, the data coded using the READ scale and collected from the proactive chat system showed an increased number and complexity of questions. The authors identified 4% of questions were rated at a level 1 (e.g., directional, library hours), 30% at level 2 (e.g., known item searching), 39% at level 3 (e.g., reference questions), and 27% at level 4 requiring advanced expertise (e.g., using specialized databases or data sets). Authors combined questions at levels 5 and 6 due to low numbers, and did not describe these when reporting their study. In comparison, 15% of reference desk questions were at a level 3 on the READ scale, and 1% were at level 4. Conclusion – Proactive chat reference service increased the number and the complexity of questions over those received via the reference desk. The frequency of complex questions was too high for nonprofessional staff to refer questions to librarians, causing reevaluation of the tiered service model. Further, this study demonstrates that users still have questions about research, but for users to access services for these questions “reference service must be proactive, convenient, and expert to meet user expectations and research needs” (p. 972).https://journals.library.ualberta.ca/eblip/index.php/EBLIP/article/view/29062proactive chatstaffing