Annual Report 2020-21

Project Highlights

Project Overview

Culture Counts, in conjunction with Public Libraries Australia (PLA) and more than 30 participating libraries across Australia, has completed the second year of a nation-wide data collection initiative to better understand and illustrate the vital outcomes generated by libraries. This document provides a small snapshot of the Public Library Evaluation Network (PLEN) results from 2020-21, demonstrating the aggregate impact of libraries and discussing differences by location and demographics.

Aim

Libraries are an extremely important asset to local communities, but membership numbers and lending statistics only address a small part of the value of a library to its community. Measuring the role of libraries and the value that communities place on them gives libraries the ability to engage more deeply with the public, impact the community more strongly, and provide an evidence-based argument for greater funding. The use of standardised measures means that libraries can learn from direct comparisons with their peers, or from wider sector trends and insights. The project gives libraries the opportunity to test outcome metrics and evaluation methods and provide feedback to ensure appropriateness from an Australian library perspective.

Network Methodology

Participating libraries subscribe to the Culture Counts survey platform; accessing standardised survey templates, unlimited evaluations, in-built metrics, client support and training. Each library surveys public library users at least once annually on outcome measures and usage, and provides the project with annual data related to library expenditure, collections, loans and visitation. All results collected through the project contribute to a large body of evidence about the value of the sector as a whole, with participants able to access a dynamic, filterable big data dashboard. Quarterly webinars enable participants to connect, interrogate the big data dashboard, and discuss implications and learnings.

Evaluation Methodology

Libraries involved in the network collect feedback on library use, performance, personal and community outcomes from public users of the library. This feedback is collected through a short standardised online survey (~4 minutes) that the library can email to its member database, link to on internal computers, deliver to library users via an iPad or tablet device, or encourage users to complete on their own smart phones.

Library staff (self-assessors) and external peer assessors (such as council members or library staff from another library) are also able to reflect on the library service using the same standard outcome measures. This can help the library to identify where its views and expectations are aligned or different to those of the community.

A representative of the library also completes an additional survey for the annual period containing library lending, staff and expenditure statistics.

Library Outcomes

A key part of the project involves asking community members around Australia if they agree or disagree with a statement relating to their experience of the library service, across 11 key outcome areas. Outcomes assessment provides evidence of the impact that library services have on people’s lives and the value that this adds to personal, community and economic wellbeing. The outcome areas align with the Outcome Measures for Australian Public Libraries research (ALIA, APLA, NSLA), ILFA generic learning and social outcomes, Project Outcome, and other community indicator research in Australia and overseas.

The use of standardised measures means that libraries can learn from direct comparisons with their peers, or from wider sector trends and insights. The results help the library to learn where they are generating the greatest impact, where they can improve, and whether certain outcome areas are more relevant or impactful to specific demographics or community groups.

The charts below show the percentage of respondents across the whole Public Libraries Evaluation Network who agreed with the associated statement regarding their library experience in 2020-21.

ALIA/APLA Outcomes Alignment

To ensure that all data collected can be clearly reported against the achievement of important sector objectives, Culture Counts aligned outcome metrics used in the project with Australian Library and Information Association (ALIA) and Australian Public Library Alliance (APLA) outcome areas, and the UK Inspiring Learning for All (ILFA) social and learning outcomes. This enables the library sector to build on significant research already carried out by peak bodies in Australia and internationally.

This page contains a matrix aligning project outcome metrics with ALIA and APLA outcome areas (as described in their published Guidelines, Standards and Outcome Measures for Australian Public Libraries, July 2016).

Underneath the matrix, the chart illustrates the percentage level of agreement recorded by respondents across the project network for each of the six ALIA/APLA key outcome areas.

ILFA Learning Outcomes

This page contains a matrix aligning project outcome metrics with ILFA Learning outcome areas.

Underneath the matrix, the chart illustrates the percentage level of agreement recorded by respondents across the project network for each of the five ILFA Learning outcome areas.

ILFA Social Outcomes

This page contains a matrix aligning project outcome metrics with ILFA Social outcome areas.

Underneath the matrix, the chart illustrates the percentage level of agreement recorded by respondents across the project network for each of the three ILFA Social outcome areas.

Library Awareness

Respondents were asked whether they were aware of various library resources and services, and whether the library helps them to learn, apply learnings and gain confidence across these service areas. These four stages are expected to be sequential, with library users initially gaining awareness, followed by learning something new, application of learnings and increased confidence.

Awareness: The library has helped me be more aware of applicable resources and services it provides

Learning: The library has helped me learn something new

Application: I intend to apply what I’ve learnt at the library

Confidence: The library has helped me feel more confident

The chart below shows the proportion of respondents who indicated that the library helped their awareness, learning and application across seven resource areas, and gives insight into their progression through each stage.

Library Use

Respondents were asked their frequency of library use and whether they engaged with library facilities, services and events. This helps libraries to understand usage by demographics and identify links between use and outcomes.

Demographics

Demographic information is collected to enable participating libraries and the network as a whole to understand the communities that they service, the impact of services for different groups, and gaps and opportunities for broader and deeper engagement. The 3,500 survey respondents across the network in 2020-21 represent a mix of ages, genders and identities, ensuring that the opinions of a broad range of community members are reflected.

Talk to us

We would love to partner with you on your evaluation journey. Please complete the enquiry form and we will be in touch!

Data and Insights by

This report has been prepared by Culture Counts.

We respectfully acknowledge the Traditional Owners of Country throughout Australia and recognise the continuing connection to lands, waters and communities. We pay our respect to Aboriginal and Torres Strait Islander cultures, and to Elders past and present.