Evaluating the performance of
user-driven services
72. Processes for evaluating government performance
and capability will need to adapt to the demands of user-driven
public services. At present, the model of capability for the Departmental
Capability Reviews makes only passing reference to the need to
"understand what your customers and stakeholders want".[71]
It does not contain questions to check the efforts departments
are making to enable people to get involved in public services,
rather than simply understanding their needs. This is in sharp
contrast to the statutory requirements that have recently been
placed on local authorities and NHS organisations to inform, consult
and involve people in the provision of local services.[72]
73. Similarly, evaluation frameworks need to be put
in place to assess the effectiveness of user-driven servicesa
crucial part of which entails getting the views of service users
themselves. To this end, we have been heartened by recent proposals
for the Comprehensive Area Assessment (CAA) framework for local
services, which will replace the Comprehensive Performance Assessment
(CPA) regime from 2009. The Audit Commission explained how the
new framework is designed to involve people in evaluating local
services:
CAA, when implemented, will help to engage citizens
and people who use services by:
- concentrating on what local
people care about most;
- gathering intelligence about their experiences
in order to assess local services
Such information will carry
significant weight in CAA so that local people feel they have
real influence in how local services are assessed;
- assessing the quality of involvement of local
people, including those in vulnerable circumstances, to check
whether their voices are heard and heeded; and
- providing information to people about the findings
from CAA so that they can be better informed about the quality
of local services and be better placed to exercise choice and
influence.[73]
74. According to the Audit Commission, CAA will "put
the experience of citizens, people who use services and local
taxpayers at the centre of the new local assessment framework".[74]
This objective was supported by the service user groups that gave
evidence to us. They informed us that service users have a key
role to play in evaluating the performance of public services,
in particular through defining the outcomes that should be used
to assess service effectiveness.[75]
75. More broadly, user-driven services have some
implications for how audit and inspection bodies evaluate public
services. In particular, inspection bodies will need to adjust
the criteria they use for assessing services. Evaluation frameworks
should to some extent include service users' own assessments of
the services they receive, as explained above. This will need
to be done carefully, however, due to possible concerns about
the subjectivity of user assessments such as customer satisfaction
measures. At the same time, inspection bodies will need to ensure
that standards of public services are safeguarded, so that people
can be sure they are getting an adequate level of provision. Inspection
bodies therefore need to consider how they would adjust their
evaluation frameworks and measures to deal with the demands of
user-driven services.
76. Government bodies need to ensure
that proper evaluation mechanisms are in place to monitor and
assess the performance of user-driven public services. For departments
that oversee public services, the relevant Departmental Capability
Reviews should contain questions to test whether departments are
creating the right environment for user-driven services to flourish.
Inspection bodies should institute evaluation frameworks for user-driven
services that ensure standards of public service provision are
safeguarded, and which allow for direct input from service users
into evaluation.
41