The Library Assessment Capability Maturity Model: A Means of Optimizing How Libraries Measure Effectiveness

Abstract Objective – This paper presents a Library Assessment Capability Maturity Model (LACMM) that can assist library managers to improve assessment. The process of developing the LACMM is detailed to provide an evidence trail to foster confidence in its utility and value. Methods – The LACM...

Full description

Bibliographic Details
Main Authors: Simon Hart, Howard Amos
Format: Article
Language:English
Published: University of Alberta 2018-12-01
Series:Evidence Based Library and Information Practice
Online Access:https://journals.library.ualberta.ca/eblip/index.php/EBLIP/article/view/29471
id doaj-5eb02bf8f54b4870a2c48d0eb5f0cbe8
record_format Article
spelling doaj-5eb02bf8f54b4870a2c48d0eb5f0cbe82020-11-24T21:34:07ZengUniversity of AlbertaEvidence Based Library and Information Practice1715-720X2018-12-01134314910.18438/eblip2947129471The Library Assessment Capability Maturity Model: A Means of Optimizing How Libraries Measure EffectivenessSimon Hart0Howard Amos1University of Otago LibraryUniversity of Otago LibraryAbstract Objective – This paper presents a Library Assessment Capability Maturity Model (LACMM) that can assist library managers to improve assessment. The process of developing the LACMM is detailed to provide an evidence trail to foster confidence in its utility and value. Methods – The LACMM was developed during a series of library benchmarking activities across an international network of universities. The utility and value of the LACMM was tested by the benchmarking libraries and other practitioners; feedback from this testing was applied to improve it. Guidance was taken from a procedures model for developing maturity models that draws on design science research methodology where an iterative and reflective approach is taken.  Results – The activities decision making junctures and the LACMM as an artifact make up the results of this research. The LACMM has five levels. Each level represents a measure of the effectiveness of any assessment process or program, from ad-hoc processes to mature and continuously improving processes. At each level there are criteria and characteristics that need to be fulfilled in order to reach a particular maturity level. Corresponding to each level of maturity, four stages of the assessment cycle were identified as further elements of the LACMM template. These included (1) Objectives, (2) Methods and data collection, (3) Analysis and interpretation, and (4) Use of results. Several attempts were needed to determine the criteria for each maturity level corresponding to the stages of the assessment cycle. Three versions of the LACMM were developed to introduce managers to using it. Each version corresponded to a different kind of assessment activity: data, discussion, and comparison. A generic version was developed for those who have become more familiar with using it. Through a process of review, capability maturity levels can be identified for each stage in the assessment cycle; so too can plans to improve processes toward continuous improvement. Conclusion – The LACMM will add to the plethora of resources already available. However, it is hoped that the simplicity of the tool as a means of assessing assessment and identifying an improvement path will be its strength. It can act as a quick aide-mémoire or form the basis of a comprehensive self-review or an inter-institutional benchmarking project. It is expected that the tool will be adapted and improved upon as library managers apply it.https://journals.library.ualberta.ca/eblip/index.php/EBLIP/article/view/29471
collection DOAJ
language English
format Article
sources DOAJ
author Simon Hart
Howard Amos
spellingShingle Simon Hart
Howard Amos
The Library Assessment Capability Maturity Model: A Means of Optimizing How Libraries Measure Effectiveness
Evidence Based Library and Information Practice
author_facet Simon Hart
Howard Amos
author_sort Simon Hart
title The Library Assessment Capability Maturity Model: A Means of Optimizing How Libraries Measure Effectiveness
title_short The Library Assessment Capability Maturity Model: A Means of Optimizing How Libraries Measure Effectiveness
title_full The Library Assessment Capability Maturity Model: A Means of Optimizing How Libraries Measure Effectiveness
title_fullStr The Library Assessment Capability Maturity Model: A Means of Optimizing How Libraries Measure Effectiveness
title_full_unstemmed The Library Assessment Capability Maturity Model: A Means of Optimizing How Libraries Measure Effectiveness
title_sort library assessment capability maturity model: a means of optimizing how libraries measure effectiveness
publisher University of Alberta
series Evidence Based Library and Information Practice
issn 1715-720X
publishDate 2018-12-01
description Abstract Objective – This paper presents a Library Assessment Capability Maturity Model (LACMM) that can assist library managers to improve assessment. The process of developing the LACMM is detailed to provide an evidence trail to foster confidence in its utility and value. Methods – The LACMM was developed during a series of library benchmarking activities across an international network of universities. The utility and value of the LACMM was tested by the benchmarking libraries and other practitioners; feedback from this testing was applied to improve it. Guidance was taken from a procedures model for developing maturity models that draws on design science research methodology where an iterative and reflective approach is taken.  Results – The activities decision making junctures and the LACMM as an artifact make up the results of this research. The LACMM has five levels. Each level represents a measure of the effectiveness of any assessment process or program, from ad-hoc processes to mature and continuously improving processes. At each level there are criteria and characteristics that need to be fulfilled in order to reach a particular maturity level. Corresponding to each level of maturity, four stages of the assessment cycle were identified as further elements of the LACMM template. These included (1) Objectives, (2) Methods and data collection, (3) Analysis and interpretation, and (4) Use of results. Several attempts were needed to determine the criteria for each maturity level corresponding to the stages of the assessment cycle. Three versions of the LACMM were developed to introduce managers to using it. Each version corresponded to a different kind of assessment activity: data, discussion, and comparison. A generic version was developed for those who have become more familiar with using it. Through a process of review, capability maturity levels can be identified for each stage in the assessment cycle; so too can plans to improve processes toward continuous improvement. Conclusion – The LACMM will add to the plethora of resources already available. However, it is hoped that the simplicity of the tool as a means of assessing assessment and identifying an improvement path will be its strength. It can act as a quick aide-mémoire or form the basis of a comprehensive self-review or an inter-institutional benchmarking project. It is expected that the tool will be adapted and improved upon as library managers apply it.
url https://journals.library.ualberta.ca/eblip/index.php/EBLIP/article/view/29471
work_keys_str_mv AT simonhart thelibraryassessmentcapabilitymaturitymodelameansofoptimizinghowlibrariesmeasureeffectiveness
AT howardamos thelibraryassessmentcapabilitymaturitymodelameansofoptimizinghowlibrariesmeasureeffectiveness
AT simonhart libraryassessmentcapabilitymaturitymodelameansofoptimizinghowlibrariesmeasureeffectiveness
AT howardamos libraryassessmentcapabilitymaturitymodelameansofoptimizinghowlibrariesmeasureeffectiveness
_version_ 1725950214910509056