LASA—Course Project Final Submission

profileSyncere35
references_and_rubric.zip

Accountability and Expertise.pdf

Financial Accountability & Management, 30(3), August 2014, 0267-4424

Accountability and Expertise in Public Sector Risk Management:

A Case Study

TOMMASO PALERMO∗

Abstract: This paper examines the adoption of a formal risk management framework in a large public sector organisation. The paper shows the relevance of risk management as an accountability tool, extended by means of disclosure to the scrutiny of distant others. The paper also reveals how the use of risk management is dependent on relational skills, knowledge of business activities and professional experience. Risk management can be seen as both a context-dependent device and as a technique abstracted from a context. The paper discusses how risk officers deal with this complexity, addressing the expectations of multiple organisational actors and external entities.

Keywords: risk management, accountability, expertise, public sector

INTRODUCTION

Since the late 1990s, formal risk management processes, techniques and roles have become increasingly diffused in the public sector (Fone and Young, 2000; Drennan and McConnell, 2007; and Collier, 2009). These private-sector-derived organisational arrangements, which constitute a ‘new world of generic risk management’ (Hood and Miller, 2009, p. 3), are considered a dimension of good governance and a tool to improve public service delivery (CIPFA, 2001; Audit Commission, 2001; and HM Treasury, 2004).

However, the adoption of generic risk management frameworks in the public sector has been criticised by a number of scholars who point to their use for

∗The author is from the Department of Accounting, London School of Economics and Political Science. He acknowledges the helpful comments from John Ferguson, Martin Messner, Dane Pflueger and the participants in the 2011 NPS seminar (Edinburgh Business School). The financial support of the Management Control Association is also gratefully acknowledged. The author would like to thank the managers who collaborated for their time and patience.

Address for correspondence: Tommaso Palermo, Department of Accounting, London School of Economics and Political Science, Houghton Street, London WC2A 2AE. e-mail: [email protected]

C© 2014 John Wiley & Sons Ltd, 9600 Garsington Road, Oxford OX4 2DQ, UK and 350 Main Street, Malden, MA 02148, USA. 322

RISK MANAGEMENT IN THE PUBLIC SECTOR 323

defensive management and blame-avoidance in a context uniquely influenced by the political and societal spheres (Power, 2007; Hood and Miller, 2009; and Lapsley, 2009). Moreover, corporate failures such as WorldCom and Enron and the recent financial crisis have raised questions regarding the efficacy of the ‘new’ risk management1 in private and public sector organisations alike (Hood and Miller, 2009; Lapsley, 2009; and Mikes, 2011).

This paper aims to explore why private-sector-derived risk management principles and instruments are adopted and retained in the public sector, despite corporate failures and growing criticism of formal and generic risk-related organisational arrangements. To this end, the paper examines how a new risk management framework is developed in a large UK public sector organisation. Drawing on new institutional theory and research on risk management and accounting change in the public sector, the paper explores how formal risk management structures, roles and instruments are related to a variety of environmental pressures and the work of multiple organisational actors.

The case study findings draw attention to notions of accountability and expertise in relation to public sector risk management. First, the study shows the relevance of risk management as an accountability tool, extended by means of disclosure to the scrutiny of distant others. In line with prior studies (Crawford and Stein, 2004; Woods, 2009; and Collier and Woods, 2011), accountability expectations are shown to be related to environmental pressures such as government policies, external assessment criteria, and professional standards. The paper adds to the literature by exploring the multifaceted nature of exchange and communication of internal mechanisms between an organisation and external entities. Whilst risk management accountability is often related to a dysfunctional emphasis on auditable trails and documentation (Power, 2007; and Lapsley, 2009), the case study suggests that risk management disclosure can also influence organisational performance by reducing the cost of borrowing and insurance premiums. The case study findings also challenge the idea of a clear- cut distinction between intra-organisational dynamics and external pressures. An example of this is that the case study organisation itself became a model that others sought to use in developing their own risk management processes.

Second, the paper sheds light on the expertise required to put risk management at work. Prior research (e.g., Scheytt et al., 2006; and Woods, 2009) suggests that various entities such as practising organisations, the media and consultants contributed to make risk management an increasingly formalised organisational and management practice. The case study shows that the use of risk management tools is dependent on elements such as relational skills, knowledge of business activities and prior professional experience. Specifically, the paper provides insights into the role of risk officers as change agents. In line with recent new institutional work (Lounsbury, 2008; and Modell, 2009), the paper shows how their activities can be related to the ambivalent logic of the ‘new’ risk management, which emphasises both generic organisation-wide representations of risks and front line responsibility

C© 2014 John Wiley & Sons Ltd

324 PALERMO

for detailed risk management practices. Risk officers deal with this complexity of risk management through a leadership style that emphasises communication and advice rather than formal authority.

The paper is structured as follows: the next section illustrates the emergence and complexities of the ‘new’ risk management in the public sector; the third section describes the theoretical background to the study; the fourth section provides details of the research context and method; the fifth section presents and discusses the case study findings, followed by concluding comments in the final section.

THE ‘NEW’ PUBLIC SECTOR RISK MANAGEMENT

A growing body of literature has illustrated the emergence of new risk management and control frameworks in the public sector (Fone and Young, 2000; Drennan and McConnell, 2007; Collier, 2009; and Woods, 2009). In the UK, the development of a risk management agenda has been fostered by central government guidance (e.g., NAO, 2000; Audit Commission, 2001; and HM Treasury, 2004) and the design of governance frameworks by professional bodies and other institutions (e.g., CIPFA, 2001; IRM/AIRMIC/ALARM, 2002; and COSO, 2004). Risk management processes are considered helpful to achieve strategic objectives at a time when public services face funding cuts (NAO, 2000; Audit Commission, 2001 and 2006; and HM Treasury, 2004). This body of practice guidelines also runs in parallel to external monitoring initiatives such as the Comprehensive Performance Assessment (CPA), which aimed to evaluate how risks are incorporated into strategic and operational decisions (Audit Commission, 2006).

Regulatory initiatives and practicing organisations emphasise two features of the ‘new’ risk management. First, the ‘new’ risk management is generic and abstracted from specific circumstances, conveying ideas of formal procedure and order (Power, 2007). The ‘new’ risk management processes can be seen as ‘go-anywhere frameworks that aim to standardize and formalize organisational processes’ (Hood and Miller, 2009, p. 3). Adoption of risk management is similar to corporate change programmes such as Total Quality Management, where seemingly ubiquitous managerial techniques have been used as a solution to organisational problems in any organisation (Townley, 2002). It is also comparable to New Public Management change programmes that aimed to modernise public sector organisations by introducing private sector logic and instruments, including accounting tools (Hood, 1995; and Lapsley, 2009).

Second, the ‘new’ risk management is integrated and holistic. It implies achieving a shared corporate approach to identifying and managing risk across the organisation, where ‘everyone in an entity has some responsibility for enterprise risk management’ (COSO, 2004, p. 6). Professional guidance recommends a ‘top down’/‘bottom-up’ approach, where the ambition of providing an organisation-wide overview of risks coexists with front line responsibility for

C© 2014 John Wiley & Sons Ltd

RISK MANAGEMENT IN THE PUBLIC SECTOR 325

risk identification and management. This ambition puts considerable pressure on senior-level officers supporting the adoption of risk management (hereafter: risk officers). These latter have responsibility for the oversight of a range of risk management activities, while detailed risk management practices remain the responsibility of line management. As put by Ward (2001, pp. 7–8), ‘risk managers should not be managers of risk at all; they should make their contribution around the risk management process.’ However, risk officers are the ultimate bearers of blame in case something goes wrong (Power, 2007).

The puzzle is how generic, organisation-wide processes can coexist with the context-dependency that characterises front line responsibility for detailed risk management practices. Scholars (e.g., Hood, 1996; Power, 2007; and Mikes, 2012) have challenged the feasibility of the application in practice of generic risk management processes and frameworks into real life organisational contexts. Going back more than 15 years, Hood (1996) argued that ‘new’ risk management frameworks embrace an unrealistic view of organisations, given that in practice risk management is subject to conflicting demands. More recently, Mikes (2012, p. 19) argued that risk management guidelines ‘talk to the high ground but fail to address the complexity, incongruity, context-dependency, and politicized nature of real organizations.’

Focusing on the public sector, some scholars (e.g., Hood and Miller, 2009; and Lapsley, 2009) argued that generic risk management frameworks face significant challenges when applied to public services. The ‘new’ risk management has a hierarchical emphasis, while decisions in the public sector involve multiple organisations via partnership arrangements (Hood and Miller, 2009). Moreover, rising expectations of public accountability incentivize the use of risk management for defensive management and blame-avoidance, intensifying focus on documentation rather than service delivery (Power, 2007; and Lapsley, 2009).

To summarise, the ‘new’ risk management poses unique challenges in the public sector. First, regulatory and professional initiatives formalise generic processes to be adopted in any kind of organisation, but public sector organ- isations need specific risk management tools that address the organisational complexity of public service delivery. Second, the unitary image of formal procedure, disclosed through integrated risk management, coexists with line management responsibility for detailed risk management practices, putting pressure on the organisational actors (i.e., risk officers) who are responsible for the risk management process without being managers of risk. These issues suggest the need to examine the institutional and organisational context in which risk management is enacted. To this end, the paper uses a theoretical framework inspired by new institutional theory.

THEORETICAL FRAMEWORK

The theoretical framework draws on foundational contributions in new insti- tutional theory that emphasise isomorphic change processes in response to

C© 2014 John Wiley & Sons Ltd

326 PALERMO

environmental pressures (e.g., Meyer and Rowan, 1977; and DiMaggio and Powell, 1983) and more recent work that encourages the exploration of intra- organisational dynamics (Lounsbury, 2008; and Modell, 2009).

The following sub-sections discuss these two strands of the literature, incor- porating insights from empirical studies of risk management and accounting change in the public sector. Although not directly related to risk management, the accounting change literature provides useful insights since the ‘new’ risk management can be compared to change programmes that aimed to introduce private sector accounting tools in the public sector (Hood, 1995; and Lapsley, 2009). Moreover, given the dearth of empirical studies on how risk management is undertaken in public sector organisations, the accounting change literature plays an important role in pointing to relatively unexplored, yet potentially relevant, aspects of the ‘new’ risk management.

The discussion of these strands of the literature leads to three dimensions of analysis that inform the analysis and presentation of the empirical material: (1) the relation between environmental pressures and the adoption of formal risk management processes, roles and instruments; (2) the role of risk management change champions; (3) the use of risk management tools.

Environmental Factors: Competitive and Institutional Influences

Seminal contributions in new institutional theory (Meyer and Rowan, 1977; and DiMaggio and Powell, 1983) suggest that the emergence and prevalence of organisational forms can be related to widely-shared and taken-for-granted social values and ideas that serve as a template for organising under conditions of uncertainty. The paper by DiMaggio and Powell (1983) has drawn attention to three change mechanisms: formal or informal exogenous requirements (coercive isomorphism); imitation of elements of organisations that are perceived as successful (mimetic isomorphism); norms set by professional groups (normative isomorphism).

This perspective suggests that the adoption and retention of a new risk management framework is related to competitive pressures (e.g., financial con- straints), exogenous requirements (e.g., regulations), cognitive and normative factors (e.g., standards set by professional groups, widely-accepted conceptions of ‘best practice’). Prior empirical studies on public sector risk management reveal a mix of these elements. A study of UK local authorities (Crawford and Stein, 2004) shows that risk management became part of an increasingly formalised set of good practice governance arrangements. A case study of the Birmingham City Council (Woods, 2009) suggests that the risk management control system was shaped by central government’s expectations that formal risk management should be developed by reference to existing professional standards. The same study shows normative influences as the risk management control system was supported by personnel undertaking examinations for professional bodies such as the Institute of Risk Management (IRM). Research on Australian and UK local

C© 2014 John Wiley & Sons Ltd

RISK MANAGEMENT IN THE PUBLIC SECTOR 327

authorities (Collier and Woods, 2011) reveals that compliance with legislation was a key driver in risk management implementation and that the external monitoring of risk management had effects on financial resources allocation.

To summarise, in line with foundational new institutional work (Meyer and Rowan, 1977; and DiMaggio and Powell, 1983), the ‘new’ risk management can be seen as a best practice template for organising risk management in response to environmental influences. A first dimension of analysis for this paper, therefore, refers to how formal risk management structures, roles and processes are related to environmental factors such as competitive, regulative, cognitive and normative influences. The empirical studies of risk management summarised above outline indicative examples of such influences such as government expectations, constraints on the availability of financial resources, standards set by professional groups and external assessment criteria.

Intra-Organisational Factors: Championing and Using Risk Management

In the last decade, the new institutional literature has put greater emphasis on the relation between environmental pressures and intra-organisational dynamics (Lounsbury, 2008; and Modell, 2009). Empirical studies of accounting change stress the effects of power struggles in the enactment of new accounting tools (e.g., Collier, 2001; Modell, 2003; and Moll and Hoque, 2011). This literature shows how those in senior leadership roles may seek legitimacy by adopting accounting tools used elsewhere, but the outcome of change processes depends on internal disputes about how the new tools should operate.

Recent work (Liguori, 2012; and Liguori and Steccolini, 2012) examines how regulative, normative and cognitive pressures are filtered by intra-organisational factors such as leadership styles, interest satisfaction and technical capabilities. Liguori and Steccolini (2012) argue that the ability to commit people to action facilitated the introduction of accounting tools in two Italian local authorities. In both cases, concentrated power helped to identify ‘a clear champion who became the reference point (also for technical advice) for those who wanted to implement the new changes’ (p. 50). In the context of radical change, concentrated power was accompanied by an ambition to disseminate technical capabilities across the organisation via training and frequent meetings. Liguori (2012) suggests that transformational leadership (e.g., engagement and frequent interactions with those subject to the change process) and satisfaction with the conditions brought about by the new tools were necessary to achieve radical change in the context of both sedimented and disruptive processes of reform. The author also claims that technical capabilities became an important reference point for the change process: ‘Those who “knew more” had to be considered’ (p. 455).

Studies such as these emphasise the role of change agents, their leadership styles and technical capabilities as well as users’ perceptions of new accounting tools. In the context of this paper, these elements draw attention to the role of risk officers as change agents in the adoption of risk management. Whilst there is

C© 2014 John Wiley & Sons Ltd

328 PALERMO

anecdotal evidence of the emergence of a new category of risk professionals (e.g., Woods, 2009), little is known about their technical capabilities and expertise. Risk officers can be seen as either technical experts of every sub-discipline of risk management or facilitators of organisational change (Power, 2007). An early explorative study (Ward, 2001) shows that resource constraints and competition with other functional experts limited the ability of practicing risk managers to take a broader view of risk management. Recent fieldwork (Mikes et al., 2013) shows that some risk officers leverage an increasingly formalised body of expertise (e.g., compliance champions), some rely on personal interactions and internal networking, while others focus on communicating in a simple way the results stemming from risk management tools.

To summarise, the accounting literature, embracing a new institutional perspective, suggests examining organisationally-specific factors related to the adoption of a new control system. Some scholars (Liguori, 2012; and Liguori and Steccolini, 2012) focus on how environmental pressures are related to change agents and managers’ commitment to change. Drawing on this literature, two further dimensions can be outlined to inform this paper’s data analysis and presentation (see Table 1). The first relates to those supporting the adoption of risk management (‘change champions’), including their expertise and leadership styles. The second refers to those subject to the change process (‘users’), including their perceptions of, and interest in, the new risk tools. Both dimensions draw attention to the role and effects of risk officers as change agents in the context of multiple environmental pressures, an aspect of the ‘new’ risk management that is yet to be explored in the public sector.

RESEARCH CONTEXT AND METHOD

The paper embraces a single case study approach to investigate organisational practices in their real-life context (Stake, 1994). The case study organisation is responsible for providing an integrated transport service in a large urban area in the UK. It is responsible for the daily operation of the public transport system as well as the planning and building of new infrastructure. The case is illustrative of large public sector organisations operating in the UK, a context that is significant for this study given the exposure to various institutional pressures, rising demands for public accountability and increasingly constrained financial resources.2 The organisational structure, which underwent a significant re- organisational process in 2011, is divided into corporate services (e.g., planning, finance, legal and governance) and business units that focus on different means of transport.

The empirical material used for this paper was collected between January 2010 and September 2011 from different sources such as interviews, direct observation, public documents and presentations. The interviews involved 11 individuals spanning different levels of the organisational structure (e.g., senior managers, managers) and different functions (e.g., corporate services, business

C© 2014 John Wiley & Sons Ltd

RISK MANAGEMENT IN THE PUBLIC SECTOR 329 T

ab le

1

D im

en si

on s

of A

na ly

si s

D im

en si

on s

D es

cr ip

tio n

E xa

m pl

es of

A ss

es sm

en tC

ri te

ri a

E nv

ir on

m en

ta l

in fl

ue nc

es C

om pe

ti ti

ve C

on st

ra in

ts on

fi na

nc ia

lr es

ou rc

es av

ai la

bi lit

y •

D em

an ds

fo r

sa vi

ng s

pr og

ra m

m es

• E

xt er

na la

ss es

sm en

ts by

en ti

ti es

su ch

as cr

ed it

ra ti

ng ag

en ci

es R

eg ul

at iv

e R

eg ul

at io

ns ,a

ud it

an d

in sp

ec ti

on fr

am ew

or ks

• C

om pl

ia nc

e w

it h

co rp

or at

e go

ve rn

an ce

co de

s an

d ot

he r

re gu

la ti

on s

• E

xt er

na la

ss es

sm en

ts by

en ti

ti es

su ch

as th

e A

ud it

C om

m is

si on

C og

ni ti

ve an

d no

rm at

iv e

C on

ce pt

io ns

of be

st pr

ac ti

ce ,e

xt er

na l

as se

ss m

en t

cr it

er ia

an d

w or

ki ng

m et

ho ds

• R

ec og

ni ti

on of

ex te

rn al

‘b es

t pr

ac ti

ce ’m

od el

s an

d gu

id an

ce •

Pa rt

ic ip

at io

n to

aw ar

d co

m pe

ti ti

on s

an d

se ar

ch fo

r m

ed ia

at te

nt io

n •

A do

pt io

n of

w or

ki ng

m et

ho ds

pr om

ot ed

by pr

of es

si on

al bo

di es

R is

k m

an ag

em en

t ch

an ge

ch am

pi on

s

L ea

de rs

hi p

st yl

es R

is k

of fi

ce rs

’a pp

ro ac

h in

su pp

or ti

ng ri

sk m

an ag

em en

t. It

ca n

be m

or e

or le

ss ‘t

ra ns

fo rm

at io

na l’

de pe

nd in

g on

th e

em ph

as is

pu t

on bu

si ne

ss su

pp or

t an

d ad

vi ce

ra th

er th

an fo

rm al

au th

or it

y

• In

te rn

al ne

tw or

ki ng

an d

co m

m un

it y

bu ild

in g

• C

on ta

ct ti

m e

an d

in te

ra ct

io n

w it

h di

ff er

en t

ar ea

s of

th e

bu si

ne ss

• E

xt en

t of

fo cu

s on

fo rm

al au

th or

it y

an d

hi er

ar ch

ic al

po si

ti on

C ap

ab ili

ti es

an d

ex pe

rt is

e R

is k

of fi

ce rs

’e xp

er ti

se .I

t ca

n em

ph as

is e

te ch

ni ca

lr is

k m

an ag

em en

t- re

la te

d sk

ill s

or re

la ti

on sh

ip m

an ag

em en

t

• D

es ig

n of

ne w

to ol

s dr

aw in

g on

ex pe

rt is

e th

at ca

n be

re la

te d

to sp

ec if

ic su

b- di

sc ip

lin es

of ri

sk m

an ag

em en

t (e

.g .,

co m

pl ia

nc e,

ri sk

,s af

et y)

• D

ev el

op m

en t

of us

er fr

ie nd

ly to

ol s

su ch

as ja

rg on

-f re

e do

cu m

en ts

an d

vi su

al re

pr es

en ta

ti on

s

U se

of ri

sk m

an ag

em en

t to

ol s

In te

re st

sa ti

sf ac

ti on

Pe rc

ep ti

on s

of ,a

nd in

te re

st in

,t he

ri sk

to ol

s •

T re

nd s

in th

e nu

m be

r of

st af

f w

it h

ac ce

ss to

ri sk

to ol

s •

Pe rc

ei ve

d us

ef ul

ne ss

of ri

sk to

ol s

• O

ve rl

ap w

it h

th e

us e

of ot

he r

m an

ag er

ia lt

oo ls

C ap

ab ili

ti es

an d

ex pe

rt is

e E

xp er

ti se

of us

er s

of th

e ri

sk to

ol s

• C

on ce

pt s

an d

m et

ho ds

us ed

to id

en ti

fy an

d m

an ag

e ri

sk s

• Pr

es en

ce of

ex pe

rt is

e th

at ca

n be

re la

te d

to sp

ec if

ic su

b- di

sc ip

lin es

of ri

sk m

an ag

em en

t (e

.g .,

sa fe

ty ,

fi na

nc ia

lr is

ks )

C© 2014 John Wiley & Sons Ltd

330 PALERMO

units). An outline of key points for discussion was provided in advance to the interviewees, while a summary was sent for review after each meeting had taken place. The interview format was adjusted to the level of seniority and the area of responsibility of each interviewee (see the Appendix). Risk personnel were asked to explain their organisational role, and provide their views on the reasons why the risk management process had evolved in a particular way and how it may change in the future. Other interviewees were mainly asked about their interactions with risk personnel and their use of risk management tools.

Annual reports, business plans, and the minutes of the meetings of the Board and other senior-level committees were reviewed to examine the development of risk management over time. This material was particularly useful to reconstruct the period (2002–2011) in which the new risk management process was adopted, providing information on the conditions and events around the adoption and mantainence of risk management. A search has also been made (in January 2010 and June 2010 and 2011) for additional documents using a web search engine. Results included news articles, professional magazine articles, and reports by rating agencies and other external entities.

During data analysis, the researcher moved back and forth among the empirical material, the theoretical framework and empirical research on public sector risk management. The initial data analysis aimed to illustrate the risk management process and its development over time; then, the researcher examined evidence of environmental pressures (e.g., competitive, regulative, cognitive and normative) and intra-organisational factors (e.g., leadership styles, technical capabilities) related to risk management. Table 1 provides more detailed information on how the paper’s dimensions of analysis have been integrated into specific assessment criteria.

CASE STUDY FINDINGS

The presentation of the case study is organised along the three dimensions of the theoretical framework. Initially, it provides an overview of the development of risk management and its relation to various environmental pressures; then, it examines the role of risk officers in championing risk management; finally, it reports findings related to the use of risk tools.

Risk Management and Environmental Influences

The development of an organisation-wide risk management process started in the early 2000s. As shown in Figure 1, the initial arrangements were part of a set of governance-related tools, including a corporate governance code that contained a risk management and internal control dimension. In 2003, the Audit Committee, whose members had the responsibility of ensuring on behalf of the Board that appropriate assurance was received on governance processes, was

C© 2014 John Wiley & Sons Ltd

RISK MANAGEMENT IN THE PUBLIC SECTOR 331

Fi gu

re 1

A do

pt io

n of

R is

k M

an ag

em en

t (R

M )

20 02

• RM

p ol

ic y

• Co

de o

f C or

po ra

te

Go ve

rn an

ce

• Fe

at ur

in g

as a

c as

e st

ud y

in

th e fin

an ci

al p

re ss

• RM

p ol

ic y

re vi

ew

• E-

tr ai

ni ng

, r isk

so w

ar e

ro ll

ou t

• Co

nt ro

l R isk

S el

f-a ss

ur an

ce (C

RS A)

• Ex

te rn

al a

ss es

sm en

t o f R

M

‘m at

ur ity

’ ( Au

di t C

om m

iss io

n)

• RM

a w

ar d

• ‘E

xc el

le nt

’ fi na

nc ia

l a nd

R M

pe

rf or

m an

ce (r

a ng

ag

en cy

)

• RM

p ol

ic y

re vi

ew

• Ri

sk tr

ai ni

ng p

la n

• Ri

sk so

w ar

e ro

ll ou

t

20 03

20 04

20 05

20 06

20 07

20 08

20 09

20 10

• Be

nc hm

ar ki

ng a

nd n

et w

or ki

ng •

Ga p

an al

ys is

ag ai

ns t C

IP FA

m

at ur

ity fr

am ew

or k

an d

20 06

/2 00

7 RM

p la

n

• RM

p ol

ic y

ap pr

ov al

a nd

tr ai

ni ng

p la

n •

Ri sk

c ha

m pi

on s n

et w

or k

• Ri

sk re

gi st

er s a

nd m

ap s

• He

ad o

f R isk

a nd

G ro

up R

isk •

Ri sk

so w

ar e

• ‘G

oo d’

ri sk

m an

ag em

en t

pr oc

es se

s ( Au

di t C

om m

iss io

n -

In i

al P

er fo

rm an

ce

As se

ss m

en t)

• St

ra te

gi c

ris k

re vi

ew •

CR SA

fu rt

he r a

dv an

ce d

• Fe

ed ba

ck fr

om tr

ai ni

ng c

ou rs

es •

Be nc

hm ar

ki ng

a nd

n et

w or

ki ng

C© 2014 John Wiley & Sons Ltd

332 PALERMO

requested to approve a policy outlining the risk management principles, roles and instruments to be applied across the whole organisation.

The policy set the overall framework for risk management. According to the policy, risk management was the direct responsibility of all managers within the organisation; senior managers were required to record risks into a map and a register with the support of their management teams; the top ‘significant’ risks (10–15 at the most) had to be fed into a strategic risk reporting process. The policy explicitly stated that managers could continue with any ‘detailed’ technique and procedure they already had in place as long as the key principles of the policy were satisfied. In such a context, Internal Audit provided advice and guidance to support the risk management process.

The policy was accompanied by an ‘implementation plan’ including actions such as the design of risk registers and maps, the identification of a network of individuals to promote the policy across different business areas (hereafter: local risk champions), and the adoption of a software to score risk across the whole organisation (hereafter: risk software). Subsequent documents on what became known as Strategic Risk Management (SRM) indicated further initiatives, including the creation of an internal advisory team dedicated to the risk management process (hereafter: Group Risk), headed by a former senior audit manager (hereafter: Head of Risk), the development of risk management training programmes, and the design of a Control Risk Self-Assurance (CRSA) process to provide assurance that controls and risk mitigation activities were operating across the organisation.

Three clusters of empirical evidence suggest that the progress of risk management can be related to competitive, regulative and cognitive pressures (DiMaggio and Powell, 1983), similar to the findings of prior research on public sector risk management (Crawford and Stein, 2004; Woods, 2009; and Collier and Woods, 2011). First, external frameworks and guidelines constituted a key reference point in developing and reviewing risk management. For instance, the risk management policy (e.g., 2003 draft) defined the guidance published by the IRM, AIRMIC (Association of Insurance and Risk Managers in Industry and Commerce) and ALARM (Association of Local Authority Risk Managers), as the ‘recognised industry standard’ with which the policy complied. In 2006, the risk management maturity framework developed by CIPFA (Chartered Institute of Public Finance and Accountancy) was used to identify what had to be changed to take the organisation into the area of ‘best practice’ (Audit Committee, 2006).

Second, organisational efforts around risk management were intertwined with external assessments. In 2004, the organisation as a whole was classified as ‘excellent’ in the Initial Performance Assessment (IPA) initiative, a version of the CPA that has been conducted by the Audit Commission for all top tier local authorities and district councils in England; within this evaluation exercise, risk management processes were rated ‘good’. In 2008/2009, the

C© 2014 John Wiley & Sons Ltd

RISK MANAGEMENT IN THE PUBLIC SECTOR 333

Audit Commission granted a favorable assessment on risk maturity, reflecting ongoing developments in risk management arrangements and training (Audit Committee, 2009a).

Third, the progress in risk management structures and processes helped to cope with increasingly constrained financial resources. The Head of Risk mentioned in an interview that appeared in the financial press in 2006 that the disclosure of information about the risk management framework contributed to financial savings in relation to the cost of capital and insurance. Indeed, in 2010, a rating agency report mentioned the ‘excellent’ risk management performance as a factor contributing to the positive assessment of organisational structure and strategy, while interviewees suggested that the presence of formal risk management arrangements had a demonstrable positive effect in reducing the insurance premium.

An important aspect to be considered in analyzing the role of environmental influences is that organisational actors, and Group Risk members in particular, were not passive recipients of external pressures. On the contrary, they tried to engage with professional networks, media and other practicing organisations. Group Risk engaged with institutions such as the IRM and CIPFA to remain aware of changes in what contributed to ‘best practice’ in the field (Audit Committee, 2009b). The case study organisation itself became a reference model for external entities. As stated in several documents, some organisations contacted Group Risk, seeking to learn from ‘best practice’ in developing their own risk management processes (Audit Committee, 2006 and 2009b). In 2006, the organisation featured as a case study in the financial press; in 2010, a practitioner magazine conferred an award for the best approach in public sector risk management.

This overview shows the emergence over time of elements that the literature ascribes to generic, organisation-wide risk management frameworks: a senior- level risk officer, risk maps and registers, a network of local risk champions, control and assurance processes. Consistent with foundational work in new institutional theory (Meyer and Rowan, 1977; and DiMaggio and Powell, 1983), the new risk management framework was related to environmental influences such as external frameworks and guidance, professional networks and external assessment criteria. In line with prior public sector studies (Crawford and Stein, 2004; Woods, 2009; and Collier and Woods, 2011), risk management has been positively recognised by external entities, suggesting that external accountability was a key factor in the adoption and retention of risk management. Nonetheless, the case study evidence challenges the idea of a clear- cut distinction between intra-organisational dynamics and external pressures. The disclosure of risk management had effects on organisational performance by reducing the cost of borrowing and insurance premiums; the work of Group Risk became a model that others sought to use in developing their own processes.

C© 2014 John Wiley & Sons Ltd

334 PALERMO

Championing Risk Management

The Head of Risk and his team (Group Risk) had responsibility for developing and implementing the risk management policy and related tools, providing support and leadership to the business in relation to risk management. The team, comprising a former audit manager and a person with a private sector financial background, sat in what can be considered a governance and legal function. According to interviewees, the rationale could be traced back to the origins of the risk function as part of Internal Audit.

The Head of Risk coordinated an annual workshop and quarterly review meetings with senior managers to identify and review ‘strategic’ risks for the whole organisation. The Head of Risk and his team also put together and coordinated a ‘generic’ approach on how to score risks. They could not, though, mandate how risk reviews were undertaken within the business. Senior managers had to ensure that local arrangements were in place to identify, evaluate and prioritise risks in their areas of responsibility. This issue recalls the complexity of the ‘new’ risk management where the ambition of providing an organisation- wide overview of risks and risk management coexists with front line responsibility for detailed risk management practices.

In such a context, Group Risk engaged in different activities to get managers and staff involved in, and satisfied with, the new risk management framework. These activities signaled an ambition for a leadership style that emphasised communication and advice rather than formal hierarchy and authority (similar to what is labelled ‘transformational leadership’ in Liguori, 2012). A first set of activities aimed to support the business in relation to risk management via communication and interaction. This happened through participation in risk forums instigated by the business, the arrangement of brainstorming sessions to support risk identification and explain the value of risk management, and the use of surveys to explore the effects of risk management change programmes (Audit Committee, 2009a). These initiatives shared an ambition to propagate risk management principles and tools further down the organisation, once the policy had been established at a high level. An indicative example of this ambition is that the increase of one-to-one risk reviews carried out with senior managers outside the annual risk workshop was reported as an achievement of Group Risk (Audit Committee, 2008a).

A second lever was related to induction and training activities. Training courses were undertaken in collaboration with Human Resources (HR) staff and a third party training consultancy (Audit Committee, 2006). Risk management training was integrated with initiatives for the project management community in order to get more people involved (Audit Committee, 2009a). E-learning courses, intended for wide circulation across the workforce, provided an initial introduction to risk management. More focused initiatives were tailored to managers who had been asked to manage risk as part of their daily jobs (e.g., senior managers, risk champions). In the latter case, the risk management policy

C© 2014 John Wiley & Sons Ltd

RISK MANAGEMENT IN THE PUBLIC SECTOR 335

was introduced, along with risk tools for managers to apply (e.g., risk maps and registers, risk software). The aim was for attendees to ‘cascade’ key learning points back to their own staff. As put by a member of Group Risk, ‘hopefully these guys would say, right this is good . . . I feel I can set up my own network and I would like to have [the software] rolled out further and used by other people.’

A third set of activities aimed to encourage the diffusion of risk management principles and techniques adapting and simplifying existing tools and datasets. In line with the view that organisation-wide risk management coexists with line management responsibility for specific risk management strategies, the changes aimed to provide users with ‘a tailored environment’ for their business needs (Audit Committee, 2009a). Risk maps were modified into a 5 by 5 version providing more flexibility for risk scoring to fit the organisational level to which they were applied; the input screens of the risk software were reorganised to create a more ‘user friendly’ system (Audit Committee, 2008a and 2008b). A pilot study carried out in 2010 tried to show how existing data could be used to indicate potential areas of weakness for the organisation. For example, data on staff churn was broken down by professions to outline shortages of key personnel for business operations such as project managers.

To summarise, the aim of promoting a coherent framework capable of address- ing internal and external expectations (e.g., Audit Commission, rating agencies) coexisted with the need to support risk management practices tailored to specific business needs. To cope with this complexity, Group Risk stressed a relational rather than technical expertise. Its members embraced a transformational leadership style (Liguori, 2012), collaborating with organisational actors that shared mutual interests. The technical aspects of existing tools (e.g., risk maps, risk software) were adjusted to fit the needs of different levels and areas of the organisation, while risk training was integrated with initiatives for the project management community to expand the potential target audience.

Using Risk Management Tools

Since the first risk management policy (2003) it was recognised that different business areas may retain existing processes as long as key principles of the policy were satisfied. Internal documents suggest an increase over time in the number of users of the tools of the new risk management process across the organisation. For instance, the user base of the software reached more than 1,100 staff in 2010 (Audit Committee, 2010). However, the perceptions of, and interest in, the use of risk tools varied across the organisation. Some parts of the organisation found them of less direct relevance to their daily work. For instance, a member of Group Risk commented that project managers preferred to use their own project risk spread sheets rather than the new risk software, which they found more time consuming. A senior manager from the investment programme unit confirmed that different methods were used at the project

C© 2014 John Wiley & Sons Ltd

336 PALERMO

level. To address this issue, a study was carried out in 2011 to develop a common approach in terms of framework and scoring to get a better understanding of strategic risks.

Other parts of the organisation, in contrast, seemed to incorporate the tools of the new risk management process in their work. For instance, managers responsible for teams of management accountants within the finance area of corporate services contributed to the risk management process by periodically updating local risk registers. The information inserted in the risk registers was considered a synthetic narrative around risks, namely a best ‘guesstimate’ (interviewee’s words) for impending issues. The same information was sometimes inserted as part of the commentaries on the management accounting forecasts, where what was likely (or unlikely) to happen was described. As put by one manager:

We sometimes highlight those things as part of our commentary on the forecast, saying that these kinds of things are happening in the background. But we won’t necessarily highlight them as a risk . . . but we mention that in our commentary, so that people are aware.

Risk champions and people contributing to the risk management process locally did not refer to a ‘professional’ body of risk management knowledge. Risk management work was ‘very much about doing the templates . . . it’s more about what you know about the business’ (manager). In certain parts of the organisation, local risk champions were considered professional experts in particular sub-fields (e.g., safety). However, it was business experience and relational skills that played a major role. A key element for local risk champions’ work was attending meetings with line managers, which enabled them to deliver ‘first-hand’ guidance. As noted by a local risk champion:

To a very large degree it’s been learning best practice. I’ve been doing it for the last six years, so . . . I don’t have a formal risk management qualification [ . . . ] Probably looking to getting it in the future, it’s just nice to have. But all my activities are qualified by experience.

To summarise, the unitary view of risk management, well-received by external entities, coexisted with multiple internal uses and perceptions of the risk tools. Contrary to research that emphasises the role of technical capabilities (Liguori, 2012; and Liguori and Steccolini, 2012), business experience and relational skills were more important than ‘technical’ knowledge in the practical application of risk management tools. Local risk champions emphasised the importance of frequent contacts with line managers and a good understanding of business activities in the areas in which they operate. Some users of risk tools suggested that risk management information was shaped by the tasks required to perform their day-to-day activities (e.g., accounting).

C© 2014 John Wiley & Sons Ltd

RISK MANAGEMENT IN THE PUBLIC SECTOR 337

DISCUSSION AND CONCLUSIONS

Despite criticism of formal and generic risk-related organisational arrange- ments, risk management has attracted a growing interest in recent years (Drennan and McConnell, 2007; Power, 2007; Hood and Miller, 2009; and Lapsley, 2009). This paper has examined the activities and events around the adoption and retention of a formal risk management framework in a large public sector organisation.

Drawing on new institutional theory and research on risk management and accounting change, the paper contributes to three strands of accounting research and debate. First, the case study shows the relevance of risk management as an accountability tool, extended by means of disclosure to the scrutiny of distant others. The case study findings are consistent with the new institutional argument that, when subject to competitive, regulative, cognitive and normative influences, organisations adopt organisational forms and managerial tools used elsewhere (Meyer and Rowan, 1977; and DiMaggio and Powell, 1983). But the case study findings also show that environmental pressures are not simply ‘out there’. What might be seen as adoption of good governance external templates influenced organisational performance by lowering the cost of borrowing and insurance premiums. Moreover, risk officers contributed, through their engagement with external networks, professional magazines and financial press, to define ‘best practice’ in a field. Whilst it is beyond the scope of this paper to assess the ‘success’ of their initiatives, it is relevant that the case study organisation itself became a model that others could use in developing their own processes.

Second, the case study sheds light on the nature of the expertise required to champion a new risk management process. Risk officers deployed a relational expertise, which made them change facilitators and communicators rather than technical experts (Power, 2007). Risk officers contributed to a number of organisational facts (e.g., risk policy, risk maps) that provided an intelligible overview of organisational strategies and structures to outsiders. At the same time, their leadership style revealed an ambition to engage with the business units. ‘Tool making’ (Mikes et al., 2013) and ‘technical capabilities’ (Liguori, 2012; and Liguori and Steccolini, 2012) were characterised by refining and adapting existing instruments to encourage their diffusion within a wider audience rather than mandating the use of new procedures through formal authority.

Third, the case study provides insights into the type of expertise required to use the tools of the ‘new’ risk management in day-to-day organisational life. Individuals across different parts of the organisation used risk management tools in a way that reflected their own professional and business experience. Contrary to claims of the emergence of an increasingly formalised body of risk management-related technical knowledge (e.g., Scheytt et al., 2006; and Woods, 2009), the use of risk tools was a matter of ‘doing the templates’ and ‘learning

C© 2014 John Wiley & Sons Ltd

338 PALERMO

best practice’ from experience. The term ‘experience’ refers to a mix of prior professional background (e.g., accounting), knowledge of business activities, interaction and contact time with colleagues.

The study is subject to limitations. First, the illustration of the development of risk management is primarily based on analysis of documents, although corroborated by interviews. Second, interviews were conducted during a period of relevant organisational change for some informants, potentially affecting the opinions expressed on the phenomenon under investigation. Third, the empirical evidence used in this paper3 cannot be stretched to classify the study as a case of either radical or incremental change. Hence, the paper focuses on analysing the nature of the activities and events around the adoption of risk management rather than assessing the ‘success’ of change initiatives.

Bearing in mind these limitations and focus, the study contributes to knowledge of public sector risk management. The case study findings point to the relevance of notions of accountability and expertise in explaining the emergence and persistence of the ‘new’ risk management in the public sector. A top-down perspective, which emphasises the role of risk management in satisfying public accountability expectations, can be complemented by a bottom-up perspective that shows how the tools of the ‘new’ risk management are dependent on relational skills, professional experience and knowledge of the business. On the one hand, similar to change programmes that have been seen in private and public sector organisations (Hood, 1995; Townley, 2002; and Lapsley, 2009), the ‘new’ risk management transmits a unitary image of formal procedure, providing an intelligible account to external entities seeking evidence of risk management. On the other hand, the ‘new’ risk management can be flexibly adapted to the needs of different organisational parts, supporting front line responsibility for the detailed management of risk.

In line with a new institutional perspective (Lounsbury, 2008; and Modell, 2009), the case study findings suggest that change agents cannot fully emancipate themselves from institutional constraints and bring about change intentionally and strategically. Within the present study, the approach of risk officers can be related to the broader principles and instruments of the ‘new’ risk management, which emphasises simultaneously organisation- wide representations of risks and front line responsibility for detailed risk management practices. Risk officers addressed this complexity of the ‘new’ risk management by seeking the collaboration of organisational actors with mutual interests (e.g., HR) and face-to-face interaction and contact time with the business.

Drawing on the terminology of recent research on accounting change (Liguori, 2012; and Liguori and Steccolini, 2012), the case study stresses the relevance of a ‘transformational leadership’ style in supporting risk management, while it questions the importance of ‘technical capabilities’ with reference to risk expertise. Despite claims of the emergence of an increasingly formalised body of risk management knowledge (e.g., Scheytt et al., 2006; and Woods, 2009),

C© 2014 John Wiley & Sons Ltd

RISK MANAGEMENT IN THE PUBLIC SECTOR 339

championing and using risk management within the case study organisation is dependent on a mix of relational skills, knowledge of the business and prior professional experience. The case study suggests that the ‘change facilitator’ rather than the ‘technical expert’ is a more accurate description of the role of risk officers. The link between this approach and the tensions that characterise the ‘new’ risk management suggests that this finding, inductively derived from a single case study, may hold across a wider range of cases.

In closing, the paper’s findings draw attention to areas for further research. The case study suggests that risk management plays a mediating role (e.g., Miller and O’Leary, 2007), aligning the efforts of dispersed actors towards a common set of criteria for the evaluation of organisational structure and strategy. Further research could explore the inter-organisational relationships that risk management generates by means of empirical material collected from individuals working across different organisations. This research strategy can be an opportunity for theoretical development and new empirical insights for accounting, sociological and organisational scholarship concerned with how external pressures become absorbed and embodied in organisations.

APPENDIX

References (documents cited in the paper)

Board Paper (2003), Report from the Audit Committee, February. Audit Committee (2006), SRM progress report, November. Audit Committee (2008a), SRM annual report, June. Audit Committee (2008b), SRM progress report, November. Audit Committee (2009a), SRM progress report, March. Audit Committee (2009b), SRM annual report, June. Audit Committee (2010), SRM annual report, June.

Interview protocol (risk personnel)

• Activities and area of responsibility

• The risk management process and future developments

• Professional background and training

• Interactions with line and corporate functions

• Networking and benchmarking activities

NOTES

1 The paper uses the term ‘new’ risk management to refer to organisational arrangements that are generic, integrated and holistic, reflecting private sector literature on Enterprise Risk Management (ERM).

C© 2014 John Wiley & Sons Ltd

340 PALERMO

2 The case study organisation is subject to the support and constraints of the UK local government financing system. The main sources of funding are government grants, operational revenues (e.g., fares) and borrowing. The organisation is assessed by rating agencies for its creditworthiness.

3 The paper uses empirical material from a broader, ongoing research programme.

REFERENCES

Audit Commission (2001), Worth the Risk: Improving Risk Management in Local Government (Audit Commission, London).

——— (2006), CPA 2005: Key Lines of Enquiry for Corporate Assessment (Audit Commission, London). CIPFA (2001), Corporate Governance in Local Government – A Keystone for Community Governance Framework

(Chartered Institute of Public Finance and Accountancy, London). Collier, P. (2001), ‘The Power of Accounting: A Field Study of Local Financial Management in a

Police Force’, Management Accounting Research, Vol. 12, No. 4, pp. 465–86. ——— (2009), Fundamentals of Risk Management for Accountants and Managers. Tools and Techniques

(CIMA publishing, Oxford). ——— and M. Woods (2011), ‘A Comparison of the Local Authority Adoption of Risk Management

in England and Australia’, Australian Accounting Review, Vol. 21, No. 57, pp. 111–23. COSO (2004), Enterprise Risk Management – Integrated Framework (Committee of Sponsoring

Organizations, New York). Crawford, M. and W. Stein (2004), ‘Risk Management in UK Local Authorities: The Effectiveness

of Current Guidance and Practice’, International Journal of Public Sector Management, Vol. 17, No. 6, pp. 498–512.

DiMaggio, P.J. and W.W. Powell (1983), ‘The Iron Cage Revisited: Institutional Isomorphism and Collective Rationality in Organizational Fields’, American Sociological Review, Vol. 48, No. 2, pp. 147–60.

Drennan, L.T. and A. McConnell (2007), Risk and Crisis Management in the Public Sector (Routledge, New York).

Fone, M. and P.C. Young (2000), Public Sector Risk Management (Butterworth-Heinemann, Oxford). HM Treasury (2004), Management of Risk: Principles and Concepts (HM Treasury, London). Hood, C. (1995), ‘The ‘New Public Management’ in the 1980’s: Variations on a Theme’, Accounting,

Organizations and Society, Vol. 20, Nos. 2/3, pp. 93–109. ——— (1996), ‘Where Extremes Meet: SPRAT vs. SHARK’, in C. Hood and D. Jones (eds.),

Accidents and Design: Contemporary Debates in Risk Management (UCL Press, London). ——— and P. Miller (2009), ‘Public Service Risks: What’s Distinctive and New?’ CARR Special

Publication – Risk and Public Services, pp. 2–3. IRM, AIRMIC and ALARM (2002), A Risk Management Standard (The Institute of Risk Management,

London). Lapsley, I. (2009), ‘New Public Management: The Cruellest Invention of the Human Spirit?’,

ABACUS, Vol. 45, No. 1, pp. 1–21. Liguori, M. (2012), ‘Radical Change, Accounting and Public Sector Reforms: A Comparison of

Italian and Canadian Municipalities’, Financial Accountability & Management, Vol. 28, No. 4, pp. 437–63.

——— and I. Steccolini (2012), ‘Accounting Change: Explaining the Outcomes, Interpreting the Process’, Accounting, Auditing & Accountability Journal, Vol. 25, No. 1, pp. 27–70.

Lounsbury, M. (2008), ‘Institutional Rationality and Practice Variation: New Directions in the Institutional Analysis of Practice’, Accounting, Organizations and Society, Vol. 33, Nos. 4/5, pp. 349–61.

Meyer, J.W. and B. Rowan (1977), ‘Institutionalized Organizations: Formal Structure as Myth and Ceremony’, The American Journal of Sociology, Vol. 83, No. 2, pp. 340–63.

Mikes, A. (2011), ‘From Counting Risk to Making Risk Count: Boundary-Work in Risk Management’, Accounting, Organizations and Society, Vol. 36, Nos. 4/5, pp. 226–45.

——— (2012), ‘The Struggle to Codify Risk Management’, Risk & Regulation (Winter), pp. 18–9. Mikes, A., M. Hall and Y. Millo (2013), ‘How Experts Gain Influence’, Harvard Business Review

(July/August), pp. 1–6.

C© 2014 John Wiley & Sons Ltd

RISK MANAGEMENT IN THE PUBLIC SECTOR 341

Miller, P. and T. O’Leary (2007), ‘Mediating Instruments and Making Markets: Capital Budgeting, Science and the Economy’, Accounting, Organizations and Society, Vol. 32, Nos. 7/8, pp. 701–34.

Modell, S. (2003), ‘Goals versus Institutions: The Development of Performance Measurement in the Swedish University Sector’, Management Accounting Research, Vol. 14, No. 3, pp. 333–59.

——— (2009), ‘Institutional Research on Performance Measurement and Management in the Public Sector Accounting Literature: A Review and Assessment’, Financial Accountability & Management, Vol. 25, No. 3, pp. 277–303.

Moll, J. and Z. Hoque (2011), ‘Budgeting for Legitimacy: The Case of an Australian University’, Accounting, Organizations and Society, Vol. 36, No. 2, pp. 86–101.

NAO (2000), Supporting Innovation – Managing Risk in Government Departments (National Audit Office, London).

Power, M. (2007), Organized Uncertainty: Designing a World of Risk Management (Oxford University Press, Oxford).

Scheytt, T., K. Soin, K. Sahlin-Andersson and M. Power (2006), ‘Introduction: Organizations, Risk and Regulation’, Journal of Management Studies, Vol. 43, No. 6, pp. 1331–37.

Stake, R. (1994), ‘Case Studies’, in N. Denzin and Y. Lincoln (eds.), Handbook of Qualitative Research (SAGE publications, London).

Townley, B. (2002), ‘Managing with Modernity’, Organization, Vol. 9, No. 4, pp. 549–73. Ward, S. (2001), ‘Exploring the Role of the Corporate Risk Manager’, Risk Management, Vol. 3, No.

1, pp. 7–25. Woods, M. (2009), ‘A Contingency Theory Perspective on the Risk Management Control System

within Birmingham City Council’, Management Accounting Research, Vol. 20, No. 1, pp. 69–81.

C© 2014 John Wiley & Sons Ltd

Copyright of Financial Accountability & Management is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use.

Promoting Public Trust in Public Organizations.pdf

Promoting Public Trust in Public Organizations: Explaining the Role of Public Accountability

Hassan Danaee Fard & Ali Asghar Anvary Rostamy

Published online: 24 November 2007 # Springer Science + Business Media, LLC 2007

Abstract This paper is aimed at explaining the role of public accountability in promoting public trust in public organizations. Initially a conceptual model was developed. Then, the model was tested empirically in Iran. The result shows that public accountability influences the public trust by improving citizens’ satisfaction. In other words, legal, ethical, financial, functional, and utmost political accountabil- ity affect public trust through influencing citizens’ satisfaction. This study also confirms that changes in social trust, citizens’ trust in government, and media will moderate trust in public organizations.

Keywords Public trust . Citizens’ satisfaction . Public accountability .

Public administration . Public organizations

Introduction

Public trust is important to public officials because it is central for supporting the development and implementation of public policies and, subsequently, for effective, cooperative compliance. Trusted public officials are able to make flexible use of their skills, as well as their discretion and autonomy, to enhance their efficiency, responsiveness, and effectiveness (Gordon 2000). The linkage between public officials and citizens leads to the success and advancement of public affairs, and separation between them results in decline of public managers (Ibne Abu Talib 1996,

Public Organiz Rev (2007) 7:331–344 DOI 10.1007/s11115-007-0041-4

H. Danaee Fard :A. A. Anvary Rostamy Tarbiat Modares University, TMU, Tehran, Iran

H. Danaee Fard e-mail: [email protected]

A. A. Anvary Rostamy (*) Iran Management and Productivity Study Center (IMPSC), No. 12, Shahid Rahnama Alley, Saidi St., Lavasani Ave., Tehran P. O. Box 19546, Iran e-mail: [email protected]

p.531). Therefore, public trust has been a great issue in public administration and political science, and many scholars (Denhard 2002; Herzlinger 1996; Citrin and Green 1996; Putnam 1995; Kim 2005; Miller and Listhaug 1990; Thomas 1998) have focused on public trust as an important issue in government.

According to the literature, various factors affect public trust. Studies also indicate that one of the most important factors creating distrust is “lack of accountability.” On the other hand, most of the previous studies have neglected to present a model of public trust for the public organizations.

The purpose of this research is to design a model for public administration to attract public trust toward public organizations. The major Questions of this research are as follow:

& What factors significantly affect citizens’ trust in public organizations? & How can citizens’ trust in public organizations be strengthened? & What are the actual elements of public trust in public organizations? & How does public accountability affect public trust? & How does public accountability relate to citizens’ satisfaction? & What is the relationship between citizens’ satisfaction and public trust? & How does trust in government, social trust, and media affect public trust?

This research has attempted to explain the relationship among “accountability” (as an independent variable), “citizens’ satisfaction” (as an intervening variable), and “public trust” (as a dependent variable). Furthermore, we have analyzed the effects of three moderate variables of “trust in government,” “social trust,” and “media” on the relation between citizens’ satisfaction and public trust. For this purpose, first, a conceptual model of “public accountability, citizens’ satisfaction, and public trust”was developed to explain public trust in public organizations, then the model was tested empirically in Iran.

The next section of the paper explains the main theoretical foundations. The general model of public trust is presented in Section 2. Section 3 describes research hypotheses and methodology. Moreover, statistical results of the model in Iran are presented in Section 4. Finally, the paper ends with research findings and suggestions.

The review of literature

Trust has both theoretical and practical significance in the study of public organizations. Despite the availability of numerous studies on the importance and applications of trust in organizational life, unfortunately, few studies have been conducted to determine elements affecting public trust (Carnevale and Wechsler 1992). Considering the fact that public trust is what links citizens to public organizations effective public administration will be the end result of this mutual trust (Farazmand 2001; Mishler and Rose 2002; Barnes and Gill 2000; Swindell and Kelly 2000; Bouckaert and Van de Walle 2003; Sims 2001; Van de Walle and Bouckaert 2003; Newton and Norris 1999). Thus, public trust has a tremendous effect on the quality of public administration. Trust is one of the most valuable social capitals, and its decline will impose heavy expenditure on the political system. This is why many studies have been conducted in several countries on this important research subject (Sztompka 1996; Ryan 2000; Steen 1996; Kavanagh 1997; Citrin 1974; Barnes and Gill 2000; Holkeri and Nurmi 2002).

332 H. Danaee Fard, A. Anvary Rostamy

Scholarly studies also indicate (e.g., Farazmand 2002; Farazmand 2004; Dalton 2005; Cheena 2005; Blind 2007; United Nations 2007a, b) public trust can promote sound governance in society.

A number of theorists view high performance as the root of trust in government while linking distrust mostly to the poor performance of government. This view explains the importance of quality and reform programs in government. In the performance approach, trust in government is based on two main theories: macro performance theory, which explains variation of trust in different countries as owing to the fluctuations in unemployment, economic growth, inflation, stability of governments, etc. and micro performance theory, which indicates variation in trust is due to the changes in the quality of public services or citizens’ attitude toward public services.

Some theorists relate distrust to government’s workload. Accordingly, managing citizens’ expectations is the basic solution to reduce distrust. By workload, we mean that government is unable to fulfill its obligations toward citizens, and therefore, citizens’ expectations must be administered (Barnes and Gill 2000; Papadakis 1999).

Sociologically, the existence of distrust culture in society is regarded as the actual root of distrust. For this reason, creation of social capital, mutual trust, social norms, and identity are emphasized by sociologists (Clark and Lee 2001; Burns and Kinder 2000; Kampen et al. 2002).

Approaches based on game and agent–principal theories introduce other viewpoints about trust in government. Game theory considers trust from an economic perspective. Accordingly, the philosophy of agent–principal itself is an indicator of distrust between citizens and government. From this viewpoint, government and citizens are considered as agent and principal, respectively. According to theorists, cooperation and participation between citizens and government are the only way to solve this problem (Harisalo and Stenvall 2002; Mishler and Rose 2002; Muller and Jukam 1977).

Contemplating administrative thoughts expressed in Islamic religious sources, (Ibne Abu Talip 1996; Nabavi 1998; Taghavi 2000; Aliabadi 1998), it can be concluded that the most important factor creating distrust is “administrative detachment” and “the solution to it is the close relation between administrators and citizens.” Table 1 summarizes research views, causes of distrust, citizens’ reaction, and the ways of promoting trust in government.

Table 1 Theoretical frameworks for trust (Boukaert and Van de Walle 2003, p. 335, adjusted by authors)

Research views Diagnosis: reasons for low trust in government

Citizens’ reactions Restoring trust: remedy

Management Failing performance Exit/voice/loyalty Quality services Public administration

Failing performance because of government overload

Exit/voice/loyalty Expectation management

Sociology Distrust & societal discomfort

Exit/voice/loyalty anomie... Social capital norms, identity

Economy Principal–agent problems Cooperation and polarization Participation and cooperation

Islamic viewpoints

Administrative detachment

Cooperation with officials/ reinforcement of cooperation with public officials

Close linkage between citizens and officials

Promoting Public Trust in Public Organizations: Explaining the Role of Public Accountability 333

Considering diverse viewpoints regarding trust in government, if we are to explain public trust in public organizations, we might be able to find variables, including the resolutions proposed by all the five perspectives listed in the table.

In view of the current literature on public trust, it can be said that the most suitable variable may be “accountability” with ethical, legal, financial, performance, and democratic aspects (Jensen 2000). Because of the importance of management theories in the advancement of public administration and the tendency among public organizations toward different performance systems in which the emphasis is on performance as a key cause of trust, we may define a variable named “citizens’ satisfaction” reflecting the high performance of public organization as a result of public accountability. Citizens’ satisfaction can itself be measured by the quality of services. Therefore, public accountability leads to citizens’ satisfaction, and citizens’ satisfaction in turn leads to public trust. For this purpose, accountability as an independent variable and citizens’ satisfaction as an intervening variable were selected. Furthermore, previous studies on the fivefold thought indicate the significant role of three major factors, i.e., “trust in government,” “social trust,” and “media” as moderate variables. Therefore, in the general public trust model, accountability via citizens’ satisfaction influences public trust, and the relationship between citizens’ satisfaction and public trust is moderated by “trust in government,” “social trust,” and “media” (moderate variables Table 2).

In Table 1, five different views can be presented as five different ways to eliminate or reduce distrust. Public service organizations need to design a model by synthesizing these five solutions to earn citizens’ trust. After investigating the theoretical foundations of effective factors on public trust, researchers present a model in which all of the abovementioned five elements are given their appropriate place based on the solutions they provide. They also believe that accountability performs a key role in creation of public trust.

Public satisfaction can be viewed as a major determinant of performance because satisfaction is, in reality, measured by the quality of public services. Accordingly, it is a way to eliminate distrust arising from bad performance. With respect to the studies conducted and the current situation of Iran (based on the exploratory interviews), three factors play outstanding roles in public trust; that is, public trust cannot be created simply through the accountability of public organizations as well as acquiring public satisfaction, because the three moderating variables of “trust in government,” “social trust,” and “media” modify this role. With respect to “accountability” (as independent variable), “satisfaction” (as intervening variable),

Table 2 Types of accountabilities incorporating five-fold theoretical frameworks

Accountability/solutions Service quality

Managing expectations

Creation of social capital

Participation Closely linkage between citizens and officials

Ethical accountability * * * * Legal accountability * * * Financial accountability * * * Performance accountability * * Democratic accountability * * * Political accountability * * * *

334 H. Danaee Fard, A. Anvary Rostamy

and “trust in government,” “social trust,” and “media” (as moderate variables), the general theoretical model of this research is developed and presented in the next section of the paper.

The conceptual model

With respect to the literature, a general conceptual model can be proposed to explain the relationship between accountability and public trust. Figure 1 shows the conceptual model.

Research hypotheses and methodology

Research hypotheses

On the basis of research hypotheses, an empirical test is conducted. The research hypotheses are as follows:

H1: Public accountability affects trust by creating a feeling of satisfaction in citizens toward public services.

H1a: Legal accountability influences public trust via affecting satisfaction. H1b: Ethical accountability influences public trust through affecting satisfaction. H1c: Financial accountability influences public trust through affecting satisfaction. H1d: Performance accountability has an impact on public trust through

affecting satisfaction.

Fig. 1 The conceptual model

Promoting Public Trust in Public Organizations: Explaining the Role of Public Accountability 335

H1e: Democratic accountability has an effect on public trust through affecting satisfaction.

H1f: Political accountability impacts on public trust through affecting satisfaction. H2: Social trust modifies the relation between citizens’ satisfaction and public trust

toward public services. H3: Citizens’ trust in government modifies the relation between citizens’

satisfaction and trust toward public services. H4: Media modifies the relation between citizens’ satisfaction and public trust

toward public services.

Research methodology

This is naturally a fundamental research. Statistical population consisted of all citizens who lived in the 22 districts in Tehran. Out of 6,755,845 populations, 1,437 samples were selected based on the Morgan Table. After classification of total population, samples from each classified groups were selected based on a random sampling method.

As shown in Tables 3, 4, and 5, the independent variable of “accountability” has been tested by 21 questions, the intervening variable of “satisfaction” was checked by 21 questions, and the moderating variables of “trust in government,” “social trust,” and “media” were examined by 32 questions. Trust in government, social trust, and media in turn were measured by 10, 8, and 14 questions, respectively. To measure the dependent variable of “public trust,” one direct question was designed. Tables 3, 4, and 5 show the dimensions and the indicators of the independent, the dependent, the modifying variables, and the intervening variables.

Table 3 Dimensions and indicators of independent and dependent variables

Concept Dimensions Indicators

Accountability (independent variable)

Ethical accountability

(1) Lack of cumbersome bureaucracy and formalities, (2) guiding citizens, (3) commitment to Islamic values, (4) lack of nepotism and bribery. (5) Response to citizens’ requests, (6) availability of administrators and employees, (7) respectful behavior to citizens, (8) providing necessary information to citizens, (9) fulfilling promises, (10) attempting to solve citizens’ problems, (11) number of requests for getting services

Legal accountability

(1) Effective execution of law and regulations, (2) providing citizens with required information about laws and regulations at the expected time

Democratic accountability

(1) Citizen’s participation in organizational affairs, (2) citizens’ participation in the election of the administrators

Financial accountability

(1) Presenting annual budget information to the citizens, (2) providing information on financial savings

Performance accountability

(1) Presenting annual performance information to citizens, (2) providing information about the achievements of government

Political accountability

(1) Response to the questions of peoples’ representatives in councils, (2) response to the printed questions of the press

Public trust (dependent variable)

(1) How much do you have trust toward four selected public organizations

336 H. Danaee Fard, A. Anvary Rostamy

Table 4 Dimensions and indicators of moderate variables

Concept Dimensions Indicators

Trust in government (moderate variable)

(1) Close relation and intimacy to government, (2) compatibility of governmental politics with citizen’s values, (3) the rate of government high performance in solving citizens’ problems, (4) governmental influence on citizens, (5) citizens’ perceptions with regard to governmental efforts to solve their problems, (6) citizens’ perceptions about mutual relations between government and citizens, (7) justice in paying attention to all citizens, (8) justice in providing services, (9) citizens’ opinion about their influence on government, (10) government attention to average and poor people

Social trust (moderate variable)

Communication to citizens

(1) Honesty of government to people, (2) no prejudgment of people as being dishonest, (3) trust toward people without any prior acquaintance, (4) trust to people, (5) conveying a truthful conception

Communication with law enforcement organizations

(1) Presence of law enforcement agency (police)

Communication with colleagues

(1) No misuse in competition, (2) no conception of exploiting others or situations in cooperation

Trust in media (moderate variable)

Newspaper (1) The usage rate of national left newspapers, (2) the usage rate of national right newspapers, (3) the usage rate of foreign newspapers

Radio and television The usage rate of: (1) national radio, (2) national television channel 1, (3) national television channel 2, (4) national television channel 3, (5) national television channel 4, (6) national television channel 5, (7) national television channel 6, (8) intranet, (9) foreign radios, (10) foreign televisions, (11) Internet

Table 5 Dimensions and indicators of intervening variables

Concept Dimensions Indicators

Satisfaction (intervening variable)

Cost of services (1) Cost of utilized services, (2) terms of payment for service costs, (3) process of payment for service costs, (4) payment period for service costs

Communications (1) Response to citizens’ questions, (2) providing citizens with necessary information, (3) transparency of forms and regulations, (4) administrators behavior to employees

Access to services and facilities

(1) Suitable place to present services, (2) the ways of receiving services, (3) suitable installation of signs for guiding citizens, (4) suitable timing and providing on time service

Citizens trust to services

(1) Commitment to governmental standards and policies, (2) fulfilling promises, (3) providing necessary and required services, (4) minimum defects in providing services

Responsiveness to citizens

(1) Number of requests to receive services, (2) justice in service distribution, (3) waiting time to receive services, (4) modesty and curtsy of employees and administrators

Promoting Public Trust in Public Organizations: Explaining the Role of Public Accountability 337

Validity and reliability of the questionnaire

The questionnaire of this research, with the exception of its accountability part, has been adopted from Van de Walle’s (2004) standard questionnaires, and the questions of the social trust have been adopted from Yamaguchi and Yamaguchi’s (1994) standard questionnaires. To test the validity of the questionnaires, 50 questionnaires were distributed among citizens of various districts of Tehran. Then, the data were gathered and analyzed by SPSS software. To measure the reliability of the questionnaire, Chronbach alpha was calculated. Chronbach alpha value for the questionnaires was nearly 0.90.

Data collection

During the interview with 365 randomly selected citizens, we asked citizens which of the public organizations have more effect on their lives. Their responses were put to content analysis. The results are summarized in Table 6. On the basis of data analysis, four of the most important public organizations that, according to the citizens’ views, had much more influence on their lives were selected.

Data analysis methods

In the data analysis stage, descriptive and inferential statistical techniques were used. The statistical techniques that were applied for data analysis were Chronbach alpha method (to determine the reliability of the questionnaire), binominal test (to test research hypotheses), least significant difference test, analysis of variance test, Spearman correlation test, path analysis method, and Friedman and good fitness tests.

Table 6 Name of public organizations and the frequency of the citizens

Row Name of public organizations Frequency of citizens

1 Police 85 persons 2 Municipality 65 persons 3 Post 59 persons 4 Public hospitals 58 persons 5 Schools 20 persons 6 Tax department 17 persons 7 Water and Sewage system 11 persons 8 Health care 10 persons 9 Universities 10 persons 10 Social security 8 persons 11 Water supply 7 persons 12 Registration department 5 persons Total 356 persons

338 H. Danaee Fard, A. Anvary Rostamy

Statistical results and findings

Results of statistical analysis are presented in Table 7, Fig. 2, and Table 8. Table 9 reveals the priorities of sixfold accountabilities in selected public

organizations.

Findings and suggestions

We have developed a general model of public trust in public organizations and tested it empirically in Iran. In this model, the independent variable was “accountability” (with ethical, legal, financial, performance, democratic, and political aspects), the intervening variable was “citizens’ satisfaction,” and the modifying variables were “trust in government,” “social trust,” and “media.” To gather the data, questionnaires were used. Analyzing the statistical data, we found that luckily high percentage of

Table 7 Covariance matrix

Accountability Satisfaction Public trust Modifying variable

Accountability ρ 63.9% ρ 44.2% ρ 58% α 0 α 0 α 35%

Citizens’ satisfaction ρ 63.9% ρ 69.3% ρ 92% α 0 α 0 α 01%

Public trust ρ 44.2% ρ 69.3% ρ 99% α 0 α 0 α 0

Moderating variables ρ 58% ρ 92% ρ 99% α 35% α 01% α 0

ρ Interrelated coefficients, α significant level

Fig. 2 Results of empirical test

Promoting Public Trust in Public Organizations: Explaining the Role of Public Accountability 339

citizen (97%) had been customers of these organizations previously, at least for once. The following are the findings of the test model in the four selected organizations:

& The study showed that among 1,342 respondents, 69% were between the age group of 20–30 years and more than 70% of them had university degrees. It was found that the relation between accountability and citizens’ satisfaction and also between citizens’ satisfaction and public trust were 63.9% and 69.3%, respectively. While direct relation between accountability and public trust was 44.2%, less than the result of the process-oriented relation (69.3%). This value shows that the model of public trust is a process model. Moreover, moderate variables have influenced and modified the relationships between citizens’ satisfaction and public trust. Accordingly, it can be stated that the proposed model has been verified strongly.

& Ninety-four percent of citizens believed that the rate of accountability in these four organizations were low; that is, with the binominal test and at 95% confidence level, it can be said that the majority of respondents believed the rate of accountability of public service organizations is low. On the other hand, Friedman analysis shows that legal accountability is ranked number one, whereas other accountabilities (ethical, financial, performance, democratic, and political) are lower ranked. According to the empirical results, it can be noted that citizens’ attitudes toward ethical, financial, and performance accountabilities are not as high.

Table 9 Six fold accountabilities and their mean ranks

Row Kinds of accountability Mean rank Final rank

1 Legal 4.92 1 2 Ethical 4.53 2 3 Financial 2.69 4 4 Performance 3.02 3 5 Democratic 2.26 6 6 Political 2.59 5

Total responses=1,342 Test/sq. km=2,483,945 Independent level=5 Significant level=0

Table 8 Results of hypotheses tests

Row Research hypotheses Rejected/accepted

1 H1 Accepted 2 H1a Accepted 3 H1b Accepted 4 H1c Accepted 5 H1d Accepted 6 H1e Accepted 7 H1f Accepted 8 H2 Accepted 9 H3 Accepted 10 H4 Accepted

340 H. Danaee Fard, A. Anvary Rostamy

& Due to lack of or low citizens’ participation in public organizations, it becomes evident that citizens do not consider democratic and political accountabilities as important, and thus, they are placed in the lowest ranks.

& Likewise, the percentage of citizens unsatisfied with public services was 77%, a much higher value compared to those satisfied with public services (23%). In other words, based on binominal test and at 95% confidence level, more than 50% of respondents were not satisfied with public services.

& Undoubtedly, media plays an important role in forming public opinion. Research findings show that 67.5% of citizens believe that the most important source of their information is international media and 61.5% of them read left newspapers. In addition, about 85% of citizens believe that they prefer national television channel. However, in view of the fact that gossip market in Tehran grows through internet and satellite day by day, therefore, their trust in government has been influenced, as well.

& The percentage of citizens who had little trust toward the four selected organizations was 13%. On the basis of the binominal test, it can be said that, at 95% confidence level, more than 50% of respondents show low trust toward these organizations.

In light of these research results and to improve accountability in public organizations, the following suggestions are provided:

Legal accountability

& Execution of a comprehensive master plan to find the causes of people’s dissatisfaction with the legal system and, in effect, to improve legal account- ability in the public organizations

& Adopting a “managerial approach” to modify the “political approach” in managing public services

& Providing citizens with legal education via radio, television, and other mass media and setting up public legal advisory centers to make citizens familiar with rules and regulations

& Revising existing laws from an administrative point of view to boost fairness

Ethical accountability

& Paying more attention to ethical issues in the educational programs aimed at public administrators

& Developing strategies to prevent and fight corruption in public organizations & Developing ethical principles for managers and civil servants working in public

organizations

Financial accountability

& Defining transparent financial guidelines & Designing tools for self-assessment of financial transparency

Promoting Public Trust in Public Organizations: Explaining the Role of Public Accountability 341

& Revising the existing bidding and auction processes in public organizations & Presenting awards to highly economic and efficient public organizations with

large amount of yearly savings.

Performance accountability

& Designing hard performance accountability (efficiency, effectiveness, productivity, quality, etc.) and soft performance accountability (satisfaction, trust, equity) systems in public organizations.

Political accountability

& Reinforcement of monitoring and controlling the role of city councils as citizens’ representative in regional public organizations

& Holding of publicmeetings at regional and local levels in order for the city councils’ the representatives and parliament members to engage citizens and handle their problems.

Democratic accountability

& Encouraging citizens’ involvement and participation for making macro decisions in public organizations

& Promoting the rate of citizens’ direct involvement in important public organizations’ decisions that significantly affect their lives

& Developing a comprehensive framework for citizens’ participation in the administration of public organizations.

Promoting satisfaction

& Designing an efficient system for evaluation of public organizations & Designing an Iranian citizens’ satisfaction index & Designing an indigenous total quality system for the Iranian public organizations.

Strengthening the role of media in building public trust

& Providing the people with pertaining and accurate information, in a timely fashion via media in regard to governmental activities, thus, gaining public trust and support.

Consolidation strategies of social trust

& Setting cultural policies to restore the values that have been transformed after defense war in the country

& Developing a national education document for the country in which trust toward others is emphasized in the instructional materials and programs

342 H. Danaee Fard, A. Anvary Rostamy

& Developing cultural policies for radio and television programs to consolidate social capital, which ultimately will increase public trust in society.

Acknowledgement The authors wish to thank the anonymous reviewers who read our manuscript and made suggestions for improvements. We also especially express our deep gratitudes to the Editor in Chief, Professor Farazmand for taking his time with us, guiding us with the latest theoretical literature on the subject, for his instrumental suggestions in revising the manuscript several times, for his insightful and time consuming guidance in enhancing it to a publication level, and of course for his generous professional editing of the manuscript into a quality English article. We finally appreciate the production staff at Springer and POR for their professional help in getting our article published.

References

Aliabadi, A. 1998. Administrators of Islamic society. Tehran: Ramin Publication. Barnes, C., & Gill D. 2000. Declining government performance? Why citizens don’t trust government.

Willington: State Services Commission. Blind, P. 2007. Building trust in government in the twenty-first century: review of literature and emerging

issues. 7th Global Forum on Reinventing Government: Building Trust in Government, 26–29 June 2007, Vienna, Austria.

Boukaert, G., & Van de Walle, S. 2003. Comparing measures of citizen trust and user satisfaction as indicators of good governance: Difficulties in linking trust and satisfaction indicators. International Review of Administrative Sciences, 69(3): 329–343.

Burns, N., & Kinder, D. 2000. Social trust and democratic politics. Report to the National Election Study Board, Based on the 2000 NES Special Topic Pilot Study.

Carnevale, D. G., & Wechsler, B. 1992. Trust in public sector: individual and organizational determinants. Administration and Society, 23(4): 471–494.

Cheena, S. 2005. Building democratic institutions: governance reform in developing countries. Conn: Kumarian Press.

Clark, J. R., & Lee, D. R. 2001. The optimal trust in government. Eastern Economic Journal, 27(1): 19–34. Citrin, J. 1974. Comments: The political relevance of trust in government. American Political Science

Review, 68(3): 973–988. Citrin, J., & Green, D. P. 1996. Presidential leadership and the resurgence of trust in government. British

Journal of Political Science, 16(4): 431–453. Dalton, R. J. 2005. The social transformation of trust in government. International Review of Sociology,

15(1):133–154. Denhard, R. B. 2002. Trust as capacity: The role of integrity and responsibility. Public Organization

Review: A Global Journal, 2(1): 65–76. Farazmand, A. 2001. Public service ethics and professionalism: a primer for public official. In Frazmand, A.

(Eds.),Handbook of comparative and development public administration: 784–799. NY: Marcel Dekker. Farazmand, A. 2002. Administrative ethics and professional competence: accountability and performance.

International Review of Administrative Science, 58:127–143. Farazmand, A. 2004. Building partnerships for sound governance. In Farazmand, A. (Eds.), Sound

governance: policy and administrative innovations: 177–199. Westport, Conn: Praeger. Gordon, M. T. 2000. Public trust in government: the U.S. media as an agent of accountability.

International Review of Administrative Sciences, 66(2): 297–310. Harisalo, R., & Stenvall, J. 2002. Citizen’s trust in government. Annual Conference of EGPA, 5–8 September

2002, Potsdam, Germany. Herzlinger, R. E. 1996. Can public trust in nonprofits and government be restored? Harvard Business

Review, 74(2): 97–107. Holkeri, K., & Nurmi, J. 2002. Quality, satisfaction and trust in government—Finishe case. Paper for the

Permanent StudyGroup of Productivity in the Public Sector at the EGPAAnnual Conference5–8 September 2002, Potsdam, Germany.

Ibne Abu Talip, A. 1996. Peak of Eloquence-Nahjul Balagha, Compiled by Syed Razi, Tahrike Tarsile Qur’an, Inc. Publisher and Distributors of Holy Qur’an, Letter 53, p. 531.

Kampen, J. K., Van de Walle, S., Bouckaert, G., & Maddens, B. 2002. Intra and extra government determinants of trust in government. EGPA—European Group of Public Administration.

Promoting Public Trust in Public Organizations: Explaining the Role of Public Accountability 343

Kavanagh, D. 1997. Crisis of confidence: the case of Britain. Studies in Comparative International Development, 32(3): 30–41.

Kim, S. E. 2005. The role of trust in themodern administrative state. Administration and Society, 37(5): 611–635. Jensen, L. 2000. Image of accountability in Danish public sector reform. Discussion Paper for IPMM

Conference at Macquarie School of Management 2000. Miller, A. H., & Listhaug, O. 1990. Political parties and confidence in government: a comparison of

Norway, Sweden and the United States. British Journal of Political Science, 20(3): 375–386. Mishler, W., & Rose, R. 2002. What are the origins of political trust? Testing institutional and cultural

memories in post-communist societies. Comparative Political Studies, 34(1): 30–62. Muller, E. N., & Jukam, T. O. 1977. On the meaning of political support. The American Political Science

Review, 71(4): 1561–1595. Nabavi, H. 1998. Islamic Administration. Qom: Publication Center of Islamic Propagation. Newton, K., & Norris, P. 1999. Confidence in Public Institutions: Faith, Culture or Performance. Paper at

the annual meeting of the American Political Science Association, Atlanta, 1–5th September, Panel 14-T2: What’s troubling the trilateral democracies?

Papadakis, E. 1999. Constituents of confidence and mistrust in Australian institutions. Australian Journal of Political Science, 34(1): 75–93.

Putnam, R. 1995. Tuning in, tuning out: the strange disappearance of social capital in America. Political Science and Politics, 28(4): 664–683.

Ryan, N. 2000. Public confidence in the public sector. A discussion paper prepared for the Office of the Auditor General of Western Australia.

Sims, H. 2001. Public confidence in government and government service delivery. Ottawa: Canadian Centre for Management Development.

Steen, A. 1996. Confidence in institutions in post communist societies: the case of the Baltic states. Scandinavian Political Studies, 19(3): 205–225.

Swindell, D., & Kelly, J. M. 2000. Linking citizen satisfaction data to performance measures: a preliminary evaluation. Public Productivity & Management Review, 24(1): 30–52.

Sztompka, P. 1996. Trust and emerging democracy. International Sociology, 11(1): 37–62. Taghavi, D. S. 2000. A glance on Islamic administration. Tehran: International Organization of Islamic

Propagation. Thomas, C. W. 1998. Maintaining and restoring public trust in government agencies and their employees.

Administration and Society, 30(2): 166–193. United Nations. 2007a. Public administration and democratic governance: governments serving citizens.

7th Global Forum on Reinventing Government: Building Trust in Government, 26–29 June 2007, Vienna, Austria.

United Nations. 2007b. Governance for the Millennium Development Goals: core issues and good practices. 7th Global Forum on Reinventing Government: Building Trust in Government, 26–29 June 2007, Vienna, Austria.

Van de Walle, S. 2004. Perceptions of administrative performance: the key to trust in government? Dissertation at the Catholic University of Leuven (B).

Van de Walle, S., & Bouckaert, G. 2003. Public service performance and trust in government: the problem of causality. International Journal of Public Administration, 29 (8–9): 891–913.

Yamaguchi, T., & Yamaguchi, M. 1994. Trust and commitment in the United States and Japan. Motivation and Emotion, 18: 129–166.

Hassan Danaee Fard completed a PhD in Public Administration at the AllamehUniversity. He is anAssistant Professor in the Department of Management, Tarbiat Modares University (TMU). He also collaborates as project manager with Iran Management & Productivity Study Center (IMPSC), a research institute affiliated with TMU.

Ali Asghar Anvary Rostamy completed a PhD in Business Administration at Osaka Univeristy, Japan. He is an Associate Professor of Management, Tarbiat Modares University (TMU). He also is the president of Iran Management & Productivity Study Center (IMPSC), a research institute affiliated with TMU.

344 H. Danaee Fard, A. Anvary Rostamy

Public Sector Accounting Standards.pdf

Public Sector

Public Sector Accounting Standards Strengthening accountability and impr

By Ian Sanderson and Frans Van Schaik

International Public Sector Accounting Standards (IPSAS) are the public sector

accounting standards of choice for many countries of the world. Developed by the

International Public Sector Accounting Standards Board (IPSASB) of the International

Federation of Accountants (IFAC), these standards set out recognition, measurement,

presentation, and disclosure requirements dealing with transactions and events in the

general purpose financial statements of all public sector entities. Currently, over 60

countries as well as inter-governmental organisations like the European Commission,

NATO, and the United Nations, have either adopted, or are in the process of adopting

IPSAS, as Ian Sanderson and Frans Van Schaik explain.

TFAC's international Public Sector .—.^...^ ^ ^ ...^.^......^ ^.,....^,^..^, Accounting Standards Board has P^bllC SeCtOr .'P.^.^S . ^ ^ ^ IFRS developed standards that apply to ACCCXJnting in Ireland both the accruals basis and the cash .^.'^^...E'^^?.?.? ^^^^^ ^'^ '''"^'^ ^^ *^^ '^^^^ ^" '̂"^ "^ basis of accounting: there is one cash- the International Federation of based standard. Cash Basis IPSAS: *^^"*"^ government accounts in Accountants (IFAC) which is the Financial Reporting under the Cash Basis 'reland are based on the cash g¡ot,ai organisation of the accounting of Accounting {Updated 2006 and accounting method. Ireland is not profession. The IPSAS Board (on 2007), and 26 accruals-based IPSAS. ^ ' ° " ^ ' " *^'^ regard; central ^^¡^.j^ ^^^ ^^ ^j^^ authors sits) focuses Countries that are adopting the cash- governments in the majority of ^^ ̂ ^^ accounting and financial based standard see this as a stepping ^"""^"^^ ' " ^^e European Union ^^^^^ ^^ ^^^ ^^^^^^^ stone towards the eventual adoption ^""^"^^y ^^P'^Y cash accounting ^^^^^^^ .̂ .̂ ̂ ^^^.^^^^ ^^ ,^^^j of thp arrniaU ha-ipH IPSAS While some Central governments (e.g. ot tne accruals-based II äA î. c • fu ^ government, or inter-governmental

Germany, Spam and Hungary) use . . only cash accounting, others use full organisation. accruals accounting (e.g. Finland, IFRS are issued by the International

standard- Sweden and the United Kingdom), Accounting Standards Board (IASB), ^"^ ^°"^^ ^^'^' ^^'S^""^' Denmark and ^^ independent body committed to

s^ ^y»'"^ systems of ^^^ting a single set of global Some countries, including Australia, J^^f^^ that incorporate elements ,,,^^^,^^ .^^^^ards for the private ^ , . . . - , , , , of both methods. ^ , - , ̂ , .n^ A c i i Canada and New Zealand, have sector. Many of the IPSAS are closely chosen not to fully adopt IPSAS and There are often differences between aligned to IFRS, but there are also have instead developed their own the accounting framework used at important deviations, without which accounting standards for the public national and at local levels, with local IPSAS would not account adequately sector. South Africa has plans to governments likely to adopt accruals- for specific public sector issues, implement accruals-based public based accounting before central sector standards based on IPSAS. The government. All projects that attempt ^^^^^ provide extra guidance, public UK public sector remains the only one to move towards an accruals-based sector-specific terminology and more that we know of which has chosen to accounting framework are complex generous transition clauses than IFRS. adopt International Financial and costly; they represent huge A number of IPSAS include differences Reporting Standards (IFRS), and will change management challenges that of accounting substance when supplement it where necessary with require training of staff and compared to the IFRS which deals other standards, primarily IPSAS. upgrading of IT systems. with the same topic. These are:

22 Accountancy Ireland October 2008 Vol.40 No.5

oving governance

• Where assets are held to provide goods and services at no or nominal charge (non-cash-generating assets);

• Where assets are acquired for no or nominal charge (donations).

To deal with these two situations IPSAS require that measurement and impairment of non-cash-generating assets must be related to an asset's on- going usefulness in providing services rather than its ability to generate future cash flows, and initiai measurement of donated assets must be at fair value rather than cost. In the absence of these amendments, assets would be under-stated and associated expenses and equity mis- reported.

There are also instances where IPSAS exist but there is no equivalent IFRS; for example IPSAS 24: Presentation of Budget information in Financial Statements. This standard reflects the fact that public sector organisations often issue a budget which can then be linked clearly to the actual out- turn against that budget in the financial statements. IPSAS 24 therefore increases the accountability of the organisation by allowing the

Example: A government decides to build a bridge which will take two years to complete. The government pays the contractor 50% of the costs upfront and the remaining 50% of costs on delivery. The bridge is expected to last 100 years and will cost €100 million. Under cash accounting €50 million hits the Cashflow Statement in both years 1 and 2 while under ¡PSAS accruals accounting only €1 million hits the Statement of Financial Performance for 100 years. Cash accounting reflects the cash flows of the transactions while accrual accounting reflects the usage of the asset.

reader of the financial statements to see how the hudget was followed through in practice. There is no private sector equivalent of IPSAS 24 because companies would be unwilling to release this sensitive strategic information which could be used by their competitors.

Perceived benefits of IPSAS

The United Nations General Assembly adopted IPSAS in 2006 helieving the benefits of IPSAS include:

• Improved internal control and transparency with respect to assets and liabilities generally;

• The alignment with best accounting practices through the application of credihle, independent accounting standards on a full accruals basis;

• More comprehensive information about costs that will better support results-based management;

• The integration of non-expendable equipment into the accounting system, with resulting improvements in the accuracy and completeness of non-expendable equipment records;

• Improved consistency and comparability of financial statements as a result of the detailed requirements and guidance provided in each standard.

• Improved allocation of resources.

Of the many perceived benefits of accruals over cash accounting, two stand out:

• it is good to know what assets and liabilities you have so as to better manage them;

> the potential to make better investment decisions (see Example).

As governments work in a political setting and are accountable for their decisions the choice of accounting framework does affect investment choices. Capital expenditure typically makes a greater immediate impact on the bottom line under cash accounting than under accruals accounting. One of the reasons why Canada adopted accruals accounting was the belief that it would positively influence infrastructure investment decisions.

IPSAS and the developing world

Many developing countries are in the process of adopting cash-based IPSAS. Although the cash-based IPSAS are seen as a transitional step towards the future adoption of accruals accounting, in reality this may take many years.

Historically, developing countries have lacked a rigorous public sector accounting framework and this has probably been a contributing factor to high levels of wastage and corruption in some of these countries. International donor agencies, such as the World Bank and the International Monetary Fund, are investing heavily in public sector reform programmes in developing countries. A strong accountability framework that includes IPSAS is seen as essential.

The impact of adoption of IPSAS by developing countries must not be under-estimated because the move towards an effective and transparent accounting system should improve governance in these countries. Having an effective accounting framework should reduce the risk of

Accountancy Ireland October 2008 Vol.40 No.5

Public Sector

wastage and corruption and the money saved can be redirected to improving public services for the citizens of these countries. On another level, foreign businesses are more likely to invest where there is a strong accountahility framework. But the adaption of IPSAS in developing countries is difficult and often requires a large investment in educating and training to develop a new range of accounting skills. In many developing countries skilled

people have migrated and this leaves a vacuum. It is essential to develop technical accounting capacity in these countries, and then somehow to make sure that those individuals with the required skills remain in place.

A strong accountability framework also requires effective checks and balances in the system. In many developing countries an independent audit office must be established or strengthened - this is why there are often donor-supported projects to strengthen the audit function as well as to introduce IPSAS. Countries such

as Kenya, for example, already have a strong oversight function. The Kenyan Controller and Auditor General's 293-page report on the 2005-06 Accounts of the Government of Kenya noted 'significant weaknesses in the accounting system' leading to her being unable to 'express any meaningful opinion' on many of the accounts which make up the government account. The Controller and Auditor General's report clearly highlights the challenges to the public sector accounting profession that will come with Kenya's adoption of the cash- based IPSAS in 2009.

IPSAS - The future

The IPSAS Board has a challenging workplan which aims to address the needs of the multitude of puhiic sector bodies across the world. The Board is currently working on establishing a public sector standard for financial instruments and on a conceptual framework for

government accounting. In the pipeline are topics such as accounting for intangible assets, fair value accounting, and accounting for entity combinations. These topics all have a public sector slant; entity comhinations (IFRS 3 refers to Business Comhinations), for example, must take into account the fact that governments usually sell business enterprises rather than huy them and so the issue of goodwill does not arise.

Readers interested in learning more about IPSAS can read the latest IPSAS Board newsletter at www.ifac.org/ eNews-Archives/2008_07_IPSASB. htm. The same link also gives readers the opportunity to sign up for future newsletters.

Ian Sanderson ([email protected]) works in the field of internationai development for Detoitte in Geneva. Switzerland. Professor Frans Van Schaik ([email protected]) is a member of the iPSAS Board of tiie internationai Federation of Accountants and works for Deloitte in The Hague, the Netherlands.

IFAC'S IPSASB Proposes Modifications To Borrowing

The International Public Sector Accounting Standards Board (IPSASB), an independent standard- setting board within the International Federation of Accountants (IFAC), is seeking comments on its proposed changes to IPSAS 5, Borrowing Costs, set forth in exposure draft (ED) 35, Borrowing Costs (Revised 200X).

"Public sector entities borrow for a variety of reasons, most of which are unrelated to asset acquisition," said Mike Hathorn, Chair of the IPSASB. "The IPSASB concluded that requiring public sector entities to capitalise borrowing costs as part of the cost of qualifying assets would not satisfy the qualitative characteristics of general purpose financial reporting, particularly related to the reliability of information reported. The immediate expensing of these borrowing costs instead will enhance the accountability of public sector entities."

Most notably, ED 35 proposes amendments to reflect that in many circumstances the capitalisation of borrowing costs as part of the cost of an asset is not appropriate for public sector entities. This view, a departure from both IPSAS S and the International Accounting Standards Board's International Accounting Standard 23, Borrowing Costs, is an evolution from public sector consideration of the issue. The ED proposes that entities recognise borrowing-related expenses, such as interest or loan origination fees, during the period in which they are incurred. The ED also proposes, however, that where entities borrow funds specifically to acquire, construct or produce a qualifying asset, the entity has the option to capitalise those costs as part of the cost of that asset.

ED 35 may he viewed and downloaded, free-of-charge, by going to http://www.ifac.org/EDs. Comments on ED 35 are requested by 7 January, 2009, and may be submitted via email at EDcom me [email protected].

IFAC Education Pronouncements The International Accounting Education Standards Board (lAESB), an independent standard-setting board within the International Federation of Accountants (IFAC), has released amended versions of its International Education Standards (lESs) and related education pronouncements. The amendments result in more consistent use of terminology throughout the standards and more clearly describe the role of the IAESB and its standard- setting process, including oversight of its work hy the Public Interest Oversight Board.

The amended documents comprise the Framework for International Education Pronouncements, the Introduction to International Education Standards, and International Education Standards 1-8. They can be downloaded free of charge from the IFAC online bookstore at http://www.lfac.org/store.

The IAESB has also commenced a project to suhstantively revise the Framework and the Introduction.

Accountancy Ireland October 2008 Vol.40 No.5

ACCOUNTABILITY AND THE PROMISE.pdf

376 PPMR / March 2005

Public Performance & Management Review, Vol. 28 No. 3, March 2005, pp. 376–417. © 2005 M.E. Sharpe, Inc. All rights reserved.

1530-9576/2004 $9.50 + 0.00.376

ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE

In Search of the Mechanisms

MELVIN DUBNICK Rutgers University–Newark Queen’s University, Belfast

ABSTRACT: In an effort to determine the basis for the assumed relationship between accountability and performance that pervades much of contemporary administrative reform efforts, this paper applies a “social mechanisms” approach to elaborate the factors that might be involved in account giving and various forms of administrative performance. This search for mechanisms indicates that the relationship is paradoxical and either spurious or so contingent as to raise questions regarding administrative reforms based on it. Various theoretical approaches for dealing with the relationship are considered.

KEYWORDS: accountability, new public management, performance, social mechanism approach

Self-evident truths are frequently invoked when scholars and policymakers propose political reforms. We often hear: “It is obvious that X is true, therefore we need to do Y.” The implication of this assertion is that common sense dictates our understand- ing of the problem and the solution. But is it really the case that X is true? And is Y really the best response? The fact that something is widely believed does not make it correct. (Ostrom, 2000, p. 33)

Among the pervasive notions characterizing contemporary public administra- tion rhetoric and scholarship is the idea of accountability as the solution to a wide range of problems. According to proponents of accountability-centered re- forms, enhanced accountability will (among other things) result in

• greater transparency and openness in a world threatened by the powerful forces of hierarchy and bureaucratization (the promise of democracy) (O’Donnell, 1998; Schedler, Diamond, & Plattner, 1999);

• access to impartial arenas where abuses of authority can be challenged and judged (the promise of justice) (Ambos, 2000; Borneman, 1997; Elster, 2004);

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 377

• pressures and oversight that will promote appropriate behavior on the part of public officials (the promise of ethical behavior) (Anechiarico & Jacobs, 1994; Dubnick, 2003; Gray & Jenkins, 1993; Morgan & Reynolds, 1997); and

• improvements in the quality of government services (the promise of performance).

This paper relates to the last of those “promises of accountability” by explor- ing the logic and issues underpinning the relationship between accountability and performance. Specifically, I seek to establish (and put to use) a framework for answering the question: Is there a basis for the assumed relationship between accountability and performance (A⇒P) that is implied in discussions of such reforms?

Anyone familiar with current efforts to reform government through strategies under the general rubric of new public management (NPM) will appreciate the importance of this question. Constructed of general doctrines that proponents claim can be universally applied (Hood, 1991), NPM has developed into a global revolution in governance that is now a quarter-century old (Kettl, 2000; Pollitt & Bouckaert, 2000). Varied in form from jurisdiction to jurisdiction, NPM has proven conceptually elusive for students of public administration. No textbook rendition or POSDCORB (Planning, Organizing, Staffing, Directing, Coordinating, Re- porting, Budgeting) equivalents have yet to emerge, but there is a consensus that the foundations of modern governance have shifted (Rhodes, 1996).

Perhaps the most fundamental change has been in the altered role of account- ability in the reformed systems. Accountability has served as a traditional anchor for the modern state since its emergence in late Middle Ages (Dubnick, 2002), and it was critical to the transformation of monarchial rule into representative government and popular rule (Bendix, 1978). In its pre-NPM form, it was for- malized in most democratic political systems as ministerial responsibility (or some less formal mechanism, e.g., “the buck stops here”) that focused legal and political attention on elected officials who were assumed accountable for all that went on (positive or negative) under his or her jurisdiction. A central feature of this view was the fictive yet effective cover it provided to nonelected government functionaries whose accountability was limited by the boundaries of the agency they worked in. Under NPM, this Diceyan notion of accountability (and its Madisonian cousin) is being replaced by a form of accountability that essentially strips the functionaries of their cover and holds them more directly responsible for their performance and the work of their agency (Barberis, 1998).

This paper was originally presented at the annual meeting of the American Political Science Association, Philadelphia, 2003, and the conference of the European Group of Public Admin- istration, Lisbon, Portugal, 2003. The author thanks those individuals at both meetings who provided feedback for those drafts, especially Jonathan Justice and Barry Mitnick as well as the Public Performance & Management reviewers.

378 PPMR / March 2005

Underlying the shift to this new accountability is the widening acceptance of perspectives that pose major challenges to more traditional models of modern governance. Although reflecting fundamentally distinct worldviews, the newer models of governance reinforce the anti-bureaucratic NPM paradigm with im- ages of self-seeking (public choice), turf protecting (bureau shaping), dehuman- izing (postmodern) bureaucracies that are indifferent and unresponsive to the public they are intended to serve. Thus, a major theme of NPM reform efforts is the improvement of public-sector performance through forms of accountability involving more direct connections between the providers and consumers of pub- lic services (Barberis, 1998). The role of the elected official as a point of ac- countability has been substantially reduced, and the exposure of the administrator has been increased.

Viewed in this light, NPM is both fostering a radical change in basic gover- nance relationships and following a long-standing tradition of maintaining accountability’s role in modern governance. The assumed relationship between accountability and performance has deep and firm roots in an administrative tra- dition spanning several centuries (Jacoby, 1973). The emergence of the modern state has been linked to the need for techniques and technologies that would enhance the capacity of administrative cadres to serve the needs and wishes of their rulers (Scott, 1998). The common use of the term servants (whether civil or public) in labels applied to government officials reflects linguistically what is central to our traditional norms for governance. The popular acceptance of vari- ous NPM reform initiatives—from New Zealand’s State Sector reforms (Norman, 2002; Pallot, 1998; Schick, 1996) to the United Kingdom’s Financial Manage- ment and Next Steps Initiatives (Broadbent, Dietrich, & Laughlin, 1996; Flynn, Gray, Jenkins, & Rutherford, 1988; Gray & Jenkins, 1993) to Clinton/Gore’s National Performance Review (Fox, 1996; Osborne & Gaebler, 1992; Thompson & Riccucci, 1998)—was based in good part on the unchallenged rhetoric of “greater accountability will mean improved performance.”1

Why has this pivotal premise gone unexplored? The most obvious answer is that the A⇒P relationship has attained the status of an institutionalized myth (DiMaggio & Powell, 1983; Meyer & Rowan, 1977) among both proponents and students of administrative reform. As such, it has become the unchallenged premise that has avoided close scrutiny either theoretically or empirically. Janet Kelly observes,

Accountability for outcomes is such powerful rhetoric for this time in our adminis- trative history that we are squeamish to subject the practice of performance mea- surement to the same harsh scrutiny we level at other administrative theories. (2002, p. 375)

This paper is a first step in an effort to explore the A⇒P relationship by posit- ing a framework for analyzing the logic that it assumes. For purposes of this

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 379

analysis, I approach the “assumed relationship” as a hypothesis asserted by those who take the promise of performance seriously. It is this assertion—whether ex- plicit or implicit—that requires analytic attention, and we need to consider what- ever variations of the relationship that might be covered by it.

Establishing a precise formulation of the relationship, however, can prove frus- trating because the assumed accountability–performance nexus is typically ex- pressed (when it is expressed at all) in the rhetoric of reform rather than derived from some clearly articulated theory of governance. Although reformist rhetoric is well intentioned as a means for justifying and energizing changes that advo- cates deem necessary and wise, such proselytizing of “the gospel” (Hood, 2001) is not conducive to thoughtful reflection or analysis (e.g., Osborne & Gaebler, 1992; Savas, 1982, 1987).

Alternatively, students of administrative reform have sometimes been able to derive useful propositions about underlying assumptions from a careful exami- nation of the rhetoric surrounding debates about policy choices (e.g., Ostrom, 1972; Ostrom, Baugh, Guarasci, Parks, & Whitaker, 1973; Ostrom & Whitaker, 1973; also see Barzelay, 1999, 2001; Hood & Jackson, 1991). That method is most useful when the debates surrounding the reform have developed into well- articulated positions proffered by advocates and attacked by opponents (Hirschman, 1991). In the case of A⇒P, however, we are confronted with a re- form position that is rarely challenged and thus has not been subjected to the articulation and reflection that would provide us the rhetorical resources to con- duct a propositional inventory of the debate. Although many analysts have raised issues regarding the wisdom and potential perversities of the assumed relation- ship, there has been no significant contestation of the assumption itself. As a result, there is no substantial literature (rhetorical or analytic) from which to draw propositions or conclusions about the relationship.

Nor does relying on the existing literature on accountability provide a suitable solution. As noted at the outset of this paper, the concept of accountability has been mobilized in recent years to serve the needs of those who regard it as a central means for the pursuit of a wide range of highly desirable objectives. In the process, the concept has become increasingly ambiguous, leading one ob- server to term it “chameleon-like” (Sinclair, 1995) and another to characterize it as “notoriously imprecise” and “ever expanding” (Mulgan, 2000a, 2000b). De- spite the elusiveness of accountability, it retains a “core” idea (Mulgan, 2000a, pp. 555–556)—a defining tether of sorts—on which to build analytically useful tools. That core focuses on accountability as those actions related to the social function of “giving accounts.”

On close examination, however, that “core idea” is rarely explicated and proves difficult to find. The core function of “account giving” seems well hidden by layer upon layer of obfuscating material resulting from well-intended misuses or

380 PPMR / March 2005

abuses of the term. Accountability, for example, is cursed with a range of syn- onyms that in fact distract us from the giving-of-accounts idea. Most often, for example, accountability is equated with such terms as “responsibility,” “answer- ability,” or “responsiveness.” Its relationship to the concept of responsibility has been especially problematic because each has been applied as a particular form of the other (see Bovens, 1998; in contrast, see Dubnick, 1998).2

Accountability’s core meaning has also been subject to a variety of tropes which, although fruitful and extremely insightful in many instances (Morgan, 1983; Oswick, Keenoy, & Grant, 2002; Tietge, 1998), can result in distractions, distortions, and misunderstandings of the term and thus compromise both its analytic and practical usefulness in comprehending and conducting modern gov- ernance (Bourgeois & Pinder, 1983; Pinder & Bourgeois, 1982). Thus, although accountability is posited as an obvious means in the search for justice and de- mocracy, equating it with the achievement of either proves frustrating at the least. Although some sense of justice might be achieved by having a former torturer admit to his or her crimes publicly before a truth and reconciliation commission, such a form of accountability is not equal to having achieved jus- tice as defined by either philosophers or the victims (Minow, 1998). Nor is the accountability implied in holding elections the same as having achieved democ- racy (Zakaria, 2003).

The obfuscation problem has been nurtured as well by the analytic approaches adopted by those who study accountability. With either complete indifference or a perfunctory effort at defining the concept of accountability, many scholars leap to characterizing it either strategically or instrumentally. When regarded strategi- cally, accountability is typically viewed from an “accountable for what” or “ac- countable to whom” perspective (Haque, 2000, pp. 601–606). In 1998, for example, the U.S. Office of Personnel Management issued an “HRM Account- ability Development Guide,” which provided federal personnel managers with a hierarchy of accountability that stressed the need for (in ascending order) legal compliance, efficient human resources processes, effective human resources pro- grams, and alignment with strategic goals of the organization (Gallo & Thomp- son, 2000). Similarly, Larry Gamm (1996) advises those in nonprofit hospital management to focus on four salient dimensions of accountability, each reflect- ing the interests and expectations of an important public: political, commercial, community, and clientele (patients). In both instances, accountability is used to advocate an approach to dealing with the demands and expectations one is facing as a public administrator. In this sense accountability is a general strategic ap- proach to the management of expectations (see Dubnick & Romzek, 1991), but that observation does not clarify what the term means.

From an instrumental perspective, accountability is regarded as the more spe- cific means by which officials are held answerable, responsible, responsive, and so

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 381

on (Burke, 1986; Caiden, 1988; Dwivedi & Jabbra, 1988, p. 5; Gruber, 1987; Haque, 2000, pp. 606–609). This instrumental perspective is manifest in the logic of prin- cipal–agent theory and its variants, which place issues of accountability and mana- gerial control at the center of modern governance research and analysis.3

As useful as these management-focused approaches to accountability are in helping us understand, design, and assess the contemporary use of the concept, they also pose a problem as we seek to explore the A⇒P relationship. They reflect an analytic and conceptual bias of paradigmatic proportions4 that has defined the way public administration scholars deal with even the most basic of concepts (Lynn, Heinrich, & Hill, 2000). As a consequence of this pervasive and deepening analytic bias, the very nature and significance of accountability’s role in governance and public management has been reconstituted in such a fashion as to limit our capacity to deal with questions such as the one addressed here.5

A Social Mechanism Approach

In lieu of an explicit theory explicating the A⇒P relationship and in light of the analytic bias inherent in the public management literature, I adopt a social mecha- nism approach (Hedström & Swedberg, 1998; also Elster, 1989) that begins with the assumption that the accountability–performance relationship involves “so- cial processes having designated consequences for designated parts of the social structure” (Merton, 1968, pp. 42–43). Put in the words of the social mechanism approach, A⇒P is posited as an (hypothesized) embedded social relationship (Granovetter, 1985) among specific factors (account giving and targeted perfor- mances) in a social setting that has assumed transformational implications for the situation in which it is applied (i.e., enhanced account-giving results in improved performances).

The roots of the social mechanism approach are difficult to pinpoint, but many point to a description offered by sociologist James S. Coleman (1986) in his exploration of contemporary social theory. The central problem plaguing social theory in the post-Parsonsian era, he argued, was how to integrate the growing awareness of the role of individual actions and agents in dynamics of social life; that is, how to deal with the micro–macro linkage that was missing in the grand theories of the 1950s and 1960s.6 Coleman saw this problem being addressed in a range of disciplinary contexts, and his examples include a directly relevant case:

This micro-to-macro problem is sometimes called by European sociologists the prob- lem of transformation. In economics, it is (misleadingly) termed the problem of aggregation; in political science, a major instance of it is the problem of social choice. It is the process through which individual preferences become collective choices;

382 PPMR / March 2005

the process through which dissatisfaction becomes revolution; through which si- multaneous fear in members of a crowd turns into a mass panic; through which preferences, holdings of private goods, and the possibility of exchange create mar- ket prices and a redistribution of goods; through which individuals’ task perfor- mance in an organization creates a social product; through which the reduction of usefulness of children to parents leads families to disintegrate; through which inter- est cleavages lead (or fail to lead) to overt social conflict. (Coleman, 1986, p. 1321; emphasis added)7

The social mechanisms perspective has emerged as a growing force in the analysis of social and political life, with major credit given to several leading scholars in the field (e.g., Thomas Schelling, Jon Elster, Charles Tilly, Arthur Stichcombe) for providing exemplary studies. Nevertheless, there has been dis- agreement among users about the role of methodological individualism and col- lective behavior in social mechanism models (see Boudon, 1998; McAdam, Tarrow, & Tilly, 2001, pp. 24–32; Tilly, 2001). In addition, there is no textbook- like consensus on exactly what constitutes a social mechanism construct. Elster (1998), who is prone to metaphorical descriptions of social mechanisms as “nuts and bolts” or “cogs and wheels,” is more likely to describe the components of a social mechanism in relation to something it is “like”—it is law-like and explana- tion-like, but it is neither of these exactly. Schelling (1998), regarded as one of the most effective practitioners of social mechanism analysis even before it had a name, tries his hand at a construct by paraphrasing Hedström and Swedberg: It “is a plausible hypothesis, set of plausible hypotheses, that could be an explana- tion of some social phenomenon, the explanation being in terms of interactions between individuals and other individuals, or between individuals and some so- cial aggregate” (pp. 32–33). Perhaps most specific is Diego Gambetta’s (1998) construct, which I will rely on in this paper: Social mechanisms are “hypothetical causal models” having the form: “Given certain conditions K, an agent will do x because of M with probability p” (p. 102). Our project will focus on the effort to articulate the A⇒P relationship as a social mechanism in terms of that format. Given the adoption of account-giving mechanisms (our K, to be defined in the following), an agent will perform (our x) because of some energizing/motivating/ triggering factor M (a point of conjecture at this juncture, but central to our ef- fort) with the probability p (also a variable at issue at this point, but not covered in this paper).

Conditions K: Account-Giving Mechanisms

We begin by taking seriously Mulgan’s (2000a) observation that, at their core all forms of accountability are linked to behaviors associated with account giving. For the moment we will focus on the concept of account giving and avoid associ- ating it synonymously with accountability. To understand the mechanisms rel-

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 383

evant to account-giving behavior, we turn to works from a variety of disciplines (philosophy, psychology, sociology, and accounting specifically) that have ad- dressed the subject. This work has developed along at least three different con- ceptual paths. At the risk of oversimplifying the different approaches, I will term the three versions of account giving as reporting, mitigating, and reframing. Each represents a range of account-giving behaviors and actions, and the labels are intended to highlight a common theme within the groups rather than act as a defining constraint. More important is a key factor that differentiates the three: the role of the account giver in the account-giving relationship (see Figure 1).

In the reporting form, the account giver’s role is to provide information or feedback to some principal in a relatively “neutral” fashion. The nature of that neutrality (and the reason for the scare quotes) is such that it is actually not neu- tral at all; rather, it operates as a mechanism of control because (under ideal conditions) the form, content, and delivery of the report by a designated agent is pre-established by the principal, who requires (and often actively seeks) nothing more from the reporting agent than compliance with the reporting requirements.

Mitigated account giving, in contrast, involves significant input from the ac- count-giving agent who is expected to respond to an implicitly or explicitly awk- ward or untoward situation for which he or she is considered responsible (in whole or part) by the principal. As will be noted, here the relationship between agent and principal is more like one finds among peers.

Finally, reframed account giving converts the account giver into an account maker with a purpose: the account giving/making agent is engaged in an effort to control or transform his or her relationship with the principal.

REPORT ACCOUNT GIVING

The most basic form of account giving, and the one most neglected in the recent literature on accountability and account giving, is the act of reporting. At its sim- plest, it is the providing of information by an agent in a form, time, and place that is preset by some principal. In many instances it is a mirror of (and surrogate for) the act of direct monitoring by a principal of the behavior and actions of the agent.

In its most elaborate forms, reporting can involve detailed minute-by-minute diaries or complex financial reports. These documents are the artifacts of account giving, and in many respects they become the artifacts of the governance process itself. Although often overlooked as a significant aspect of governance, archival records tell us as much about the structure and operations of past governments as it does about the subject of those records. Their form, the language, and conven- tions of presentation they used, the categories of data they applied—all provide insight into the kind of account giving required of those who administered the government of the time (Hull, 2003; Stoler, 2002). Their value as archeological evidence hints at the important role reporting plays in contemporary governance

384 PPMR / March 2005

as well. For present purposes we focus on two major types or reporting: adminis- trative and financial.

Administrative Reporting

Reporting played an important role in the emergence of modern management, first as a central ingredient in the scientific management movement and then as one of the pivotal points in the classical POSDCORB formula that became the dominant practitioner paradigm for today’s public sector. These early manage- ment perspectives were greatly influenced by the engineering mentality from which they emerged (Jenks, 1960), and although reports and observations of ac- tivity on the factory floor were initially used scientifically to design and maintain productivity, they came to be regarded as important means for implementing plans and exercising control through the monitoring of worker behavior (i.e., performance according to specification). Frederick Taylor’s much maligned man- agement system, for example, relied less on traditional direct foreman oversight and more on reporting mechanisms such as job cards and worksheets filled out be the workers themselves as self-generated reports of their productivity; these were then sent directly to planning departments where the information would be analyzed and used to adjust workloads and workflow accordingly (Littler, 1978; Zuboff, 1988, pp. 42–46).

Although the Taylorist approach fell out of favor in intellectual circles, the clas- sic “folk wisdom” on administrative reporting remained a major premise underly- ing both the design and management of public-sector agencies for most of the twentieth century (Fesler, 1959; Freeman, 1996; Marx & Reining, 1959). This is most evident in Herbert Kaufman’s (1967) insightful description of the internal operations of the U.S. Forest Service as well as his study of administrative feed- back published several years later (Kaufman, 1973, see especially pp. 25–28).

Today we see administrative reporting used as a source of control and trans- parency at both the micro and macro levels of organizational life. Street-level and field-based service providers typically face reporting demands from their man- agers who are unable to oversee their work directly (Lipsky, 1980). Reports are a common part of management control systems designed to ensure congruence

Reporting Mitigating Reframing

Principal Agent ⇔ Principal Principal ⇓ ⇑

Agent Agent

Figure 1. Forms of Account-Giving Relationships

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 385

between the organization’s goals and unit/individual actions, and these play a critical role in the design and operation of the modern corporation or government program (Picard & Reis, 2002).

Account giving through administrative reporting may have emerged and de- veloped primarily as a means for managerial oversight and control, but it also serves as a component of democratic accountability through the passage of vari- ous policies expanding the public’s access to government documents. Although reports and records may not be designed specifically with public access in mind (Clark, 1939; Simon & Ridley, 1938), the demand for transparency in govern- ment operations (as well as the protection of one’s rights and civil liberties) has made it a factor to be considered in the design of any reporting system (see Halstuk & Chamberlin, 2001; Jenkins & Goetz, 1999; Piotrowski & Rosenbloom, 2002; A.S. Roberts, 2000).

Despite the fact that administrative reporting remains an important ingredient in the design and operations of public- and private-sector organizations, most commentators either dismiss it as trivial but burdensome red tape, or regard it as a mere surface artifact that has been replaced by more subtle and pervasive forms of control. Students of management, for example, have followed the lead of Peter Drucker (1974), who regards cutting back on paperwork to be a sign of success for the modern manager whose control systems must be based on showing re- sults rather than merely monitoring processes. Reporting, if it is to be valued at all, would have to serve the needs of the production system—that is, if it is not providing useful feedback, then it is red tape and needs to be minimized, if not discarded.8

Financial Reporting

Perhaps the most developed (and still widely accepted) form of reporting-as- account-giving is financial reporting and the range of accounting mechanisms that have become institutionalized through legal requirements and professional standards. Many historians regard accounting systems as critical to the develop- ment of modern society: They brought rationality to an emerging capitalist economy (Carruthers & Espeland, 1991; Hummel, 1994, pp. 84–86) and legibil- ity to the modern state (Scott, 1998). As important, they made the operations of both private- and public-sector organization’s more transparent and controllable, at least on the surface. That transparency not only fostered more effective man- agement (Chandler, 1977; Coleman, 1949) but also became the major tool for evaluating the enterprise in the open market (Sanders, 1934) and facilitating the oversight and auditing of government agencies (Bartelt, 1942; Kravchuk & Schack, 1996; Mansfield & Marx, 1959; Morey, 1942; Webber & Wildavsky, 1986, pp. 400–411). The macro-level association of financial reporting with account giv- ing is so powerful that the label “accountability system” is used as a synonym for

386 PPMR / March 2005

describing an organization’s accounting system (see Keating & Frumkin, 2003).9

At the micro level, account giving through financial reporting places distinc- tive demands on the public-sector agent who faces a much more complex and constraining environment than his or her private- and third-sector peers (Dittenhofer, 2001). In general, the historical and formal role of the financial reporting agent was to provide the relevant principals—the citizenry, legislative and oversight bodies, and investors and creditors—with information they needed to assess government operations and to make decisions. “Financial reports are used primarily to compare actual financial results with the legally adopted bud- get; to assess financial condition and results of operations; to assist in determin- ing compliance with finance-related laws, rules, and regulations; and to assist in evaluating efficiency and effectiveness” (Government Accounting Standards Board, 1987). These traditional uses of financial reporting created a culture that has proven very resistant to pressures to transform public-sector financial man- agement into a tool for reform and change (Cochrane, 1993; Potter, 2002).

Reporting as Control

As a form of account giving, reporting stands apart in establishing a distinctly subordinate and responsive role for the account-giving agent faced with the de- mands for information and feedback from the principal(s). In both its administra- tive and financial forms, report-based account giving reflects a system focused on the need for oversight and control. The image most relevant here is provided by students of accounting history who contend that modern accounting technolo- gies are best described as mechanisms of social control operating as a context (“calculating spaces”) for governing those who operate within its conceptual and organizational borders (Miller & O’Leary, 1987). The very process and stan- dards of account giving require that the reporters adopt and adapt to the logic of which they are a part (Collins, 1982). Karl Weick observed:

It is clear that accounting procedures affect perceptions of control and predictabil- ity, and this is just as true for the people who impose these procedures as for those who are the target of them. For better or worse, organizations live by what their accountants tell them. In many ways organizations are their accounting reports. What accountants do affects people’s lives, literally, even more than you may have imagined. (1983, p. 366)

MITIGATING AND REFRAMING ACCOUNT GIVING

In the classic sociological exposition on account giving, an account is defined in functional terms as “a linguistic device employed whenever an action is sub- jected to valuative inquiry” (Scott & Lyman, 1968, p. 46). In more specific terms, the act of account giving is defined as “talk designed to recast the pejorative significance of action, or one’s responsibility for it, and thereby transform others’

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 387

negative evaluations” (Buttny, 1993, p. 1; cited in Tata, 2000, p. 438). In these perspectives, and unlike the situational context for reporting, we begin with con- ditions (a social predicament; see Schlenker & Darby, 1981) that assume the principal is judging the agent for some act that is regarded as wrong, undesirable, incorrect, untoward, or in some other way odd or unexpected. In short, the ac- count giver is in the situation of having to undertake some action (usually in the form of speech acts) to mitigate or offset the real or potential damage that has (or can be) done. What distinguishes mitigation from reframing is whether the agent’s actions are based on admitting that she or he was involved in the wrong-doing. If so, the account giver will be engaged in mitigation; if not, she or he will work to reframe the situation to deal with the awkward or negative situation that remains between the agent and the principal(s).

Mitigation

Those who examine the mitigating form of account giving typically start with J.L. Austin’s “A Plea for Excuses” (Austin, 1956/1979), in which he focuses on excuse making as an exemplary form of the speech act. Austin was prominent among a group of several young analytic philosophers who had joined Ludwig Wittgenstein in his linguistic turn in the late 1940s and early 1950s (Burge, 1992), and his work on speech acts is regarded as groundbreaking today even though most of it was not well known until after his death in 1960. Austin was especially interested in establishing the value and methodology for examining the practical use of words as “performatives” (i.e., words and statements that perform rather than merely describe), a project he articulated more substantially in lectures de- livered in the mid-1950s (Austin, 1975). His choice of excuses for this particular study may have been a matter of convenience in terms of his overall objective, but as a result he focused philosophic attention to the major role of account giv- ing in social life.

At the outset, Austin (1975) posited a major distinction between excuses and justifications as account-giving mechanisms: both start with the admission that a wrong was done (e.g., an error or faux pas), but although the justifier claims there was good or appropriate reason for the wrong doing, the excuse maker attempts to show how he or she was not in control or completely at fault in doing the deed. Austin is careful to note that there is considerable ambiguity associated with the use of these terms in ordinary language, and that his decision to focus on excuses rather than justifications was somewhat arbitrary, given that the line separating the two is often unclear. As important for present purposes, in the process of elaborating his “excuses” case in detail, Austin stressed the role that context and the judgment of others play in the excuse-making account-giving situation. If you inadvertently step on a snail while walking down the street, a simple “I am sorry” will suffice, but inadvertently stepping on a crawling child would call for

388 PPMR / March 2005

much more account giving and excuse making. Thus, distinctions that seem only linguistically superficial, when examined in the abstract (e.g., the difference be- tween stepping on a snail or a child, or between a mistake and an accident) are of considerable importance when situated in different contexts, and each generates a need for a distinct type of speech act performance.

The examination of mitigating account giving moved from analytic philoso- phy to sociology in the work of Scott and Lyman10 on “Accounts” (Scott & Lyman, 1968), in which emphasis was placed on the uses of excuses and justifications in “bridging the gap between action and expectations” (p. 46). They elaborate a number of strategies (“modal forms”) associated with each of those major types of accounts11 (see Table 1), discuss the conditions under which various forms of account giving will be honored, and note the various account-giving styles asso- ciated with different types of social relationships: intimate, casual, consultative, formal, and frozen (i.e., an extremely formalized and scripted, “by the book” style). This conceptually rich article ends by stressing that account giving is, above all, a negotiated action taking place among individuals whose identities and decisions are shaped by their social roles. “A normative structure governs the nature and types of communication between the interactants, including whether and in what manner accounts may be required and given, honored or discredited” (p. 58).

The analysis of mitigating account giving has since been extended beyond excuses and justifications (e.g., Schönbach, 1990; Semin & Manstead, 1983).12

Of special note is the mitigating use of apology (see Folkes & Whang, 2003; Petrucci, 2002; Schlenker & Darby, 1981; Tavuchis, 1991) in which the agent negotiates for the forgiveness of the principal simply on the basis of admitting to a role in the faux pas and hoping for a just response. An interesting variant of this is the concession without an explicit apology that borders on a reframing ac- count: “A wrong was done, and I admit to a role in it—and that is just the way it is.” A recent study indicates that a credible effort to assume responsibility for

Table 1. Modal Forms of Mitigating Account Giving

Excuses Justifications Avoidance

Appeal to accidents Denial of injury Mystification Appeal to defeasibility Denial of victim Referral Appeal to biological drives Condemnation of Indentity

condemners switching Scapegoating Appeal to loyalty

Sad tale Self-fulfillment

Source: Based on Scott and Lyman (1968).

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 389

one’s wrongful actions can be more effective in mitigation than the major alter- natives (Dunn & Cody, 2000).

Publicly acknowledged shame is not effective in all cultural contexts but is significant enough in some to warrant special attention. Shame is typically re- garded as a very private emotion, but it is among several self-conscious emotions that develop as we mature into social beings (as opposed to the primary emotions that are evident in infants; e.g., joy). Long the subject of interest to social psy- chologists and psychoanalysts (Lewis, 1971; Lynd, 1958), in recent years it has drawn the attention of philosophers and others who regard the emotions as a central factor in contemporary social life (Eisenberg, 2000; Elster, 1999; Lewis, 1995; Nussbaum, 2001; Williams, 1993). In some cultures, an openly acknowl- edged shame is an important and widely practiced form of mitigated account giving (Scheff, 2000, 2003), the best known case being Japan where examples of giri resignations by the heads of leading companies after some scandal or other embarrassment often makes headlines (e.g., the resignation of the head of Japan Air Lines after a string of disasters or the tearful admissions of leading banking figures as they took responsibility for failures before employees and the media). Although portrayed in the Western media as reflecting a distinct sense of oriental honor, behind it is a form of public shame and humiliation that remains central to Japan’s giri relationship traditions (Benedict, 1946/1989; Gelfand et al., 2001).13

The act of confessing one’s shame does not require any response from the principal(s)—not even the expectation of forgiveness that is implied in apolo- gies. Rather, the mitigation comes from whatever self-respect the agent receives from having expressed his or her regret before the relevant principals.14

Reframing

At times, account giving involves efforts by the agent to transform how the prob- lematic situation (i.e., the wrong-doing, error, faux pas) is defined and perceived. Much of the literature on this form of account giving is derived from the work of Erving Goffman, especially his elaboration of how people manage face-to-face relationships and the framing of shared perspectives. Much of Goffman’s analy- sis is directly related to mitigation account giving, but with a difference most clearly expressed in his classic study of The Presentation of Self in Everyday Life:

Table 2. Major Types of Mitigating Accounts

Mitigation based on: Type

Defense of the action Justification Explanation of agent’s role Excuse Concession (seeking forgiveness) Apology Expression of regret (seeking understanding) Acknowledged shame

390 PPMR / March 2005

Regardless of the particular objective which the individual has in mind and of his motivation for having this objective, it will be in his interests to control the conduct of others, especially their responsive treatment of him. This control is achieved largely by influencing the definition of the situation which the others come to formulate, and he can influence this definition by expressing himself in such a way as to give them the kind of impression that will lead them to act voluntarily in accordance with his own plan. (Goffman, 1959, pp. 3–4; emphasis added)

Here we see the emphasis shifting from being the account giver (in both re- porting and mitigating) to being an account maker who seeks to control the situ- ation rather than be subject to it (see Orbuch, 1997). The agent is actively engaged in reframing how the situation is perceived—and thus how his or her actions are going to be described and evaluated.

To some degree, Scott and Lyman (1968) had covered several forms of reframing account giving under the heading of “avoidance” strategies (see Table 1). One form of avoidance, “mystification,” is drawn directly from Goffman’s discussion of performances that people engage in their efforts to control the per- ception of the situation (1959, pp. 67–70). Another, “defeasibility,” also requires narrative elaboration by the account giver in which the defense is based on some story about events leading up to the predicament. Apologies and public expres- sions of shame and remorse can be manipulated to generate a response that does more than mitigate. Reframing efforts can also be linked to forms of refusal, in which the account-giving agent seeks to go beyond avoidance and either conceal or deny his or her involvement or withdraw from the discussion by changing the subject or creating a diversion to a different issue. In some instances these vari- ous manipulations of account giving might be intended to merely restore the image of the agent (Benoit, 1995), but there are those who see account giving as an opportunity for “impression management” that can be used to their advan- tage—a case of using lemons to make lemonade (Bromley, 1993).

Reframing also draws attention to strategies of account giving applied in an- ticipation of the predicament. This can be accomplished through the use of upfront disclaimers (Hewitt & Stokes, 1975) designed to preempt negative reactions to an act, or at the least to provide a firmer foundation for later mitigation. Or they can take the form of preemptive account giving itself—saying “excuse me” as you break into a line, and then reminding anyone who might protest at some later point that “I said excuse me!”

What reframed account-giving strategies have in common is the assumed con- scious intent of the agent to control or manage the account-giving situation. Thus, insights into impression management can provide insights into the management of expectations as well (Dubnick & Romzek, 1991, chapter 3). Among psycholo- gists, the motivation to engage in impression-managing behavior goes beyond the mere urge to control how one is thought of. In their review of the literature on self-presentation, Leary and Kowalski (1990) highlight three factors driving im-

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 391

pression management: the relevance of impressions to one’s goals, the value of those goals, and the gap between one’s current and desired image. In addition, they list five factors that shape the impression construction process or, for present purposes, what we call “account giving/making”: one’s self-concept, the desir- ability of potential images, role constraints, what the target audience values in an image, and the current image that is in need of change (Leary & Kowalski, 1990). Clearly, the situation places the account giver in a mode for strategic thinking.

Not surprising, much of the nonpsychological literature on reframing involves studies of politicians and the actions they take in the face of demands for account giving. W. Lance Bennett’s (1980) analysis of Nixon’s Watergate account giving was based on a framework highlighting the special nature of political accounts but is suitable in any situation under reframing conditions. Kathleen McGraw (1990a, 1991, 1998b) extended the study of account giving to its use in electoral politics and efforts to shape public opinion. F.G. Bailey (1969, 1988, 2001) ap- proaches the use of accounts as part of the tools of “political manipulation” in- herent in the tasks of leadership, and William Riker (1986; also see McLean, 2002; Paine, 1989) included them as part of his description of “heresthetics,” which he defined as the political skills for structuring the world so one can maxi- mize the possibility of winning.

Action x: Types of Performance

Any effort to elaborate the performance variable in our A⇒P relationship must rely on extant conceptualizations in the vast literature that has emerged over the past three decades. It is helpful, however, to consider the generic sense of perfor- mance, especially because a form of the concept plays such a major role in the Austinian study of speech acts.

As with the term accountability, the word performance is both blessed and cursed by its synonymic nature. Outside of any specific context, performance can be associated with a range of actions from the simple and mundane act of opening a car door, to the staging of an elaborate reenactment of the Broadway musical Chicago. In all these forms, performance stands in distinction from mere behavior in implying some degree of intent. A performance in these senses is a behavior motivated or guided by some intent or purpose—whether it is to exit the vehicle or to entertain a paying audience.15 The broad range of meaning that might be applied within this context is, of course, useful for some and problematic for others. Critiques of government performance feed on the very looseness of meaning that makes the task of managing government performance so frustrating.

When we posit or assume a relationship between accountability and perfor- mance, we are in essence linking account-giving behavior with some form of

392 PPMR / March 2005

intentional behavior. Getting an analytic handle on performance requires that we make some sense out of the many ways performance is referred to in that litera- ture while our factoring in the generic parameter of intended behavior. We can accomplish this by relying on two aspects of performance stressed in much of the literature: (a) the quality of the actions being performed, and (b) the quality of what has been achieved as a result of those actions. The typology in Figure 2 results from transposing those two focal points along dimensional lines (i.e., low to high).

The most basic form of performance focuses attention on tasks being carried out by the performing agent. It is the view of performance associated with the process of production (P1) in the broadest and narrowest senses of that term. For example, we speak of theatrical productions as the staging of performances. We also speak to manufacturing forms of production that are associated with the design and operation of machinery and foster a machine view of work. In the first case we think about the performance/role as a scripted and ritualistic endeavor that allows for interpretation by the performing agent.16 In contrast, the manufac- turing form of production is reflected at its most extreme in the Taylorist para- digm, which breaks any performance/job down to its basic component tasks and assesses whether the tasks are being done appropriately using the right tools. Although few of the major performance measurement systems associated with the NPM rely explicitly on this view of performance, it is a pervasive presence within organizations at the level at which job design (Morgeson & Campion, 2002), personnel selection (Borman, Hanson, & Hedge, 1997), and performance appraisal systems (Arvey & Murphy, 1998) are put to regular use.

The second form of performance (P2, competence) elevates the significance of the quality of the act dimension in performance. Performance is not merely a matter of engaging in the actions required of some role or job. Rather, it is a reflection of the quality of the agent’s actions in applying higher levels of knowl- edge, skill, understanding, and so on in the carrying out of the tasks (Ericsson & Lehmann, 1996; Hood & Lodge, 2004). Anyone can read a recipe and think themselves a halfway decent cook, but a professional chef is a cook with a level of knowledge, experience, and skill that allows us to define cooking performance

Focus on quality of performance achievement

Low High

Focus on quality High P2 Competence P4 Productivity of performance actions Low P1 Production P3 Results

Figure 2. Types of Performances

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 393

at a different level than merely producing a meal. Under the assumption that a highly competent performer will be more likely to generate more and better qual- ity output from an activity most of the time, performance becomes associated with the competence of the performer. The measurement of the competencies, skills, experience, and knowledge of the performer becomes pivotal under this perspective, and performance improvement translates into strategies for enhanc- ing the capacities, skills, and so on of the performers.

Two examples from completely distinct literatures demonstrate the popularity and applicability of this perspective (cf. Hood & Lodge, 2004). In management, this view of performance is closely linked to the total quality management (TQM) approach that became so popular in the 1980s.17 TQM is a managerial perspec- tive that puts forward the capacity to perform as a surrogate for actual perfor- mance. It stresses processes designed to achieve better production, results, and productivity. For Deming and other TQM advocates, “mean performance level simply reflects a system’s overall capacity” (Waldman, 1994, p. 512), and that capacity is the key to overall performance rather than production at any point in time. Focus on the design of quality processes and quality control, and you will be enhancing the overall performance of the unit (Reeves & Bednar, 1994).

In contrast is the approach advocated by David H. Rosenbloom (1987, 1994, 2003; Rosenbloom, Carroll, & Carroll, 2000) and others for a performance stan- dard of “constitutional competence” applied to public sector employees. Public administrators are obligated to uphold the Constitution and to operate within its restrictions. Thus, beyond whatever skills or knowledge is required to perform their particular jobs as public health officers, law enforcers, educators, and so on, public administrators must be competent in their knowledge of constitutional and legal responsibilities. Performance is not merely related to outputs and out- comes but to competence in this area as well.

The third form of performance, results (P3), focuses attention on what is pro- duced as opposed to the process of production itself (P1) or the efficiency of the production process (P4). Typically results performance is discussed in quantita- tive terms, as in the number of units manufactured or the number of performances of a play; or attention can be shifted to some secondary measure of a perfor- mance, such as the popularity of the performance as indicated by a demand for the manufactured good or the number of sold-out play or concert dates.

This view of performance is the most prevalent type in the literature on perfor- mance associated with NPM. The effort to develop some measure of output or outcome has been seen by some as a critical necessity (Faucett & Kleiner, 1994), by others as a promising vehicle for change (Wholey, 2001), and by still others as a potential Achilles heel for the reform movement (Bouckaert & Peters, 2002).18

Finally, there are approaches to performance that highlight both the quality of the act as well as what is achieved, and to capture it we rely on the economic

394 PPMR / March 2005

concept of productivity (P4). The term implies something rather simple, of course: the ratio of output to input for a given production unit under given conditions, (i.e., the production function). From this perspective, performance is comprised of those actions that shape or determine the different factors in the production function. This can include decisions or acts regarding the mix of inputs, how they will be processed, what technologies will be used, where and when the produc- tion occurs, the disposition of outputs, and so on (Gold, 1965).

This approach to performance is best understood by using some well-known examples. Productivity performance has been a major issue in policing, for ex- ample, where competing views of the field’s production function have generated considerable debate over the years. In its most recent iteration in the United States, the debate has been between advocates of the traditional professional crime con- trol and supporters of community-based prevention (Kelling & Coles, 1996). In Great Britain, a similar debate has emerged in the education policy arena that centers on the distinction between those who seek school improvement through the enhancement of the schools’ capacity to educate and the advocates of school effectiveness, who stress measures of student performance on examinations (Cutler & Waine, 2001; Gibson & Asthana, 1998; Goldstein & Woodhouse, 2000; Lodge & Reed, 2003). In both cases, the issues are actually about which mix of produc- tion factors will be used in the respective arenas, and the measure of performance will ultimately depend on the particular mix that emerges.

The four forms of performance that emerge from this exercise cover a consid- erable range of the meanings typically applied to the concept in the existing lit- erature. If the assumed A⇒P relationship can be established logically or empirically, it will be reflected in the impact that account giving has on one or more of these performance formats. The empty cells in Table 3 provide a visual frame of the challenge we face. As of now, each represents a black box that begs to be opened so that the assumed social mechanism within can be exposed.

The M Factor

A social mechanism requires an energizing factor—a motivating force—to com- plete the relationship between the condition (in our case, account giving) and the action (performance), and in the Gambetta (1998) format we have adopted, that is represented by the factor M. The significance of the M factor is such that one can consider it the defining characteristic of any social mechanism. In providing the dynamic that links the related variables, it can be regarded as the causal factor of the relationship. Without it, the relationship is merely rhetorical.

Although there is a general agreement about the important role of the M factor among those who use the social mechanism approach, until recently there has

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 395

been no major effort to develop a meta-theory that might further define and ar- ticulate a core set of M factors (Turner, 2002). There have been discussions of developing an inventory of social mechanisms (Schelling, 1998), but such pro- posals are rarely advocated with the intent of ending the “open source” philoso- phy that characterizes its community of users. One effort to summarize the array of social mechanisms is based on a logic that would sort them into four common types of M factor mechanisms:

• cognitive mechanisms that rely on the bounded human capacity to deal with information through various forms of processing and reality construction tools (e.g., metaphors, narratives);

• integrative mechanisms such as norms, institutions, social identities, and so on that provide a shared environment for social interaction;

• social interaction mechanisms, such as bargaining, negotiation, deliberation, ar- gumentation, persuasion, and other forms of contention that drive interpersonal contacts; and

• rational-choice mechanisms, such as the strategies and games set up through institutional patterns. (Trondal, 1999, 2001)

With this as our initial guide, the question is: What are the M factors associ- ated with account giving that lead to the improvement in desirable performances (i.e., those valued under the NPM reforms)?

THE ACCOUNTABILITY PARADOX

Unfortunately, the relevant literature on account giving is of limited help in this regard. There is no indication of any effort to consider (either theoretically or empirically) issues relating account giving to social functions beyond the imme- diate needs of individuals in awkward social situations. And what we learn of those efforts is that account-giving actions are generators of performances in their own right, a point highlighted in Goffman’s (1959) reliance on the drama- turgical model to describe much of what takes place under such circumstances. The performances being generated in these Goffman-esque stagings, however,

Table 3. Seeking the M Factor

Performance as:

Production Competence Results Productivity (P1) (P2) (P3) (P4)

Reporting

Mitigating

Reframing

Account giving as:

Table 3. Seeking the M Factor

396 PPMR / March 2005

are not relevant (except perhaps by coincidence) to those of production, compe- tence, results, or productivity. If they generate value, it is value of a narrower symbolic sort for the agencies who conduct the account giving to placate the “powers that be” with superficial or ceremonial activity (Fox, 1996; Spira, 1999).

This situation helps explain a phenomenon that is best termed the “account- ability paradox.” Halachmi, Bouckaert, and others (Bouckaert & Peters, 2002; Halachmi, 2002a; Halachmi, 2002b; Halachmi & Bouckaert, 1994) have pointed out that there exists an inherent tension between accountability and performance on an operational level as well as logically: Increasing efforts to improve perfor- mance through accountability tends to have the opposite effect. Rather than act- ing as a driver for desired levels of improved performance, accountability tends to be a “breaker” by either slowing down or stopping the improvements.

The paradox makes sense when the performative nature of account-giving actions is considered. As speech acts, reporting, mitigating, and reframing de- mand attention and consume the energy and time of the account giver—thereby using resources that would otherwise be devoted to the more desired forms of performance. They are policies (and performances) unto themselves, and can be treated as such. Thus, when considering the success or failure of an administra- tive reform, such as the development and implementation of a performance mea- surement program, one must take care to distinguish between the assessment of the program and the evaluation of its consequences.

Consider the case of the Government Performance and Reporting Act of 1993 (GPRA) and its associated reforms.19 The legislation mandated that all federal agencies engage in a process that would result in promulgating a five-year strate- gic plan by September 30, 1997. These plans are to be linked to measurable outcomes that would be used as the basis of annual performance reports starting no later than in May 2000 (Kautz, Netting, Huber, Borders, & Davis, 1997; Kravchuk & Schack, 1996). By the late 1990s, the difficulties of implementing the program was beginning to show, leading one observer to note that the early optimism felt at the launch of GPRA was gone even as the process was unfolding (Radin, 1998a; also see Gómez, 1998; Kates, Marconi, & Mannle, 2001; Radin, 1998b, 2000; N. Roberts, 2000). As the process moved into full implementation, the assessments were relatively kind (“a laudable effort” [McNab & Melese, 2003, p. 94]), but more detailed evaluations indicate what most skeptics had predicted: GPRA has turned into a costly but largely symbolic exercise, which has not de- livered on a number of hoped-for improvements in performance (Cavalluzzo & Ittner, 2004). By September 2002, the White House was ready to make that as- sessment official and to take more radical steps:

• Nearly 10 years have passed since the Government Performance and Results Act (GPRA) was enacted. Agencies spend an inordinate amount of time prepar- ing reports to comply with it, producing volumes of information of questionable

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 397

value. If one were to stack up all the GPRA documents produced for Congress last year, the pile would measure over a yard high. A policy-maker would need to wade through reams of paper to find a few kernels of useful information.

• Even with GPRA, accounting for performance when making budget decisions is unfortunately the exception, not the rule. The implementation of this impor- tant law has gone astray.

• As a result, the Administration has decided to take GPRA in a new direction. (U.S. House of Representatives, 2002)

That “new direction,” as it turns out, is an entirely different process, one that effectively replaces the GPRA plans and processes (while leaving the legal re- quirement in place) with Program Assessment Rating Tool (PART), a process that shifts the assessment of performance to reflect the priorities of the current administration. The White House, in short, has hijacked the Congress-centered GPRA and hidden it away while filling the vacuum with still another account- giving performative. PART, like GPRA, is likely to do little to improve public- sector performance, but it will add still more account-giving obligations. As in the case with GPRA, more attention will be paid to assessing the performance of the PART-based account giving (e.g., whether the relevant agencies filed the ap- propriate forms on time in a readable format) than the achievements of the pro- grams that the account giving was intended to improve.

ALTERNATIVES AND CONTINGENCIES

A slightly more promising path in the search for relevant M factors is found in the work of social psychologist Philip E. Tetlock and his colleagues (Tetlock, 1980, 1983a, 1983b, 1985, 1991; Tetlock & Boettger, 1989; Tetlock & Kim, 1987; Tetlock, Skitka, & Boettger, 1989), who have been examining individual reactions to the expectation that one is going to be held accountable (thus chang- ing the focus of our attention to A

exp ⇒P). Over nearly two decades of experimen-

tal studies,20 the Tetlock group has developed a loosely articulated model of contingent human behavior based on a number of social mechanisms that are triggered when an individual learns that he or she will have to answer for some act or decision. Tetlock posits that when faced with such an expectation, we typi- cally operate as intuitive politicians who seek to satisfy what we perceive to be the demands and needs of the audience we are accounting to (Tetlock, 1991). Thus, Tetlock’s work adds support to the already widely accepted “satisficing- and-search” model articulated in the mid-1950s by Herbert A. Simon (1955), but he does so relying on a range of cognitive social mechanisms.

What this promising line of research has made clear is that account giving and the expectation of being held accountable are complex phenomena. In an article reviewing the research findings to date, Jennifer Lerner and Tetlock (1999) high- light the extremely contingent nature of accountability on the individual level.

398 PPMR / March 2005

The intuitive politician model worked well when applied to a very specific set of circumstances in which the individual believes he or she knows what the audi- ence for the accounts expects and regards that audience as legitimate. Under such conditions, the desire for approval and the urge to conform are among the domi- nant factors. Shift either of those basic conditions (certainty of expectations or perceived legitimacy of the audience) and other, more defensive and calculating mechanisms kick in. In addition, whether the anticipated account giving is to occur before or after the decision or act makes a significant difference, as does whether the account giving relates to the process or outcome of the decision under scrutiny. The resulting behaviors may follow a general pattern, but the outcome remains unpredictable because so many variables enter into the equa- tion. Their conclusion is worth quoting at length:

This review underscores the falsity of the conventional wisdom—often born of frus- tration at irrational, insensitive, or lazy decision makers—that accountability is a cognitive or social panacea: “All we have to do is hold the rascals accountable.” Two decades of research now reveal that (a) only highly specialized subtypes of account- ability lead to increased cognitive effort; (b) more cognitive effort is not inherently beneficial; it sometimes makes matters even worse; and (c) there is ambiguity and room for reasonable disagreement over what should be considered worse or better judgment when we place cognition in its social or institutional context. In short, accountability is a logically complex construct that interacts with characteristics of decision makers and properties of the task environment to produce an array of ef- fects—only some of which are beneficial. (Lerner & Tetlock, 1999, p. 270; emphasis added)

ALTERNATIVES: CONTEXTS OF EXPECTATIONS AND TRUST

Another possible solution is to accept the inherently contingent nature of the A⇒P relationship and focus on the setting or context of the relationship as a means for honing in on relevant M factors. This approach begins by denying the basic assumption implied in A⇒P, and instead posits that whatever links exist between account giving and desired performances are derived from the context within which the account giving and desired performances occur.

Taking this approach leads directly to the problem of uncovering contexts that are potentially relevant to the relationship. Among the many contingencies that enter into the relationship (e.g., uncertainty, legitimacy, etc.), expectations and levels of trust stand out as significant.

Expectations pervade the account-giving situation from both sides of the princi- pal–agent relationships that underlie it. This is clearest in the reporting form in which the expectations of what to report, when to report it, and in what form to make the report are basic components of the situation and must be understood on both sides of the relationship. Under mitigation, the expectations surrounding ac- count giving are likely to be less defined and open to explicit or implicit negotiation

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 399

among those involved. In the reframing format, it is the shaping (or reshaping, as the case may be) of expectations that is central to account-making efforts.

As a context for account giving, expectations provide a multidimensional source for relevant M factors (see Table 4), especially as one explores the various ways that expectations can be strategically manipulated. Most important for present purposes, there is empirical support for a link between expectations and perfor- mance (Balkwell, 1991, 1995; Berger, Norman, Balkwell, & Smith, 1992), a fact that might provide a basis for more warrantable assertions of potential connec- tions between account giving and performance and (as Tetlock et al.’s research demonstrates) between expectations of accountability and performance.

Table 4. Characteristics of Expectations

Dimension Focus Relevant strategies

Number Quantity of expectations in a set Reduce/Increase influencing an administrator or agency

Scope Quantitative range of behaviors Narrow/Expand addressed by the expectations

Depth Degree of specificity of behaviors Specify/Broaden covered by the expectations

Translucence Clarity of meaning in the expectations Clarify/Obfuscate

Diversity Qualitative range of behaviors Homogenize/ addressed by the expectations Differentiate

Structure Arrangement of component parts of a Equalize/Prioritize set of expectations reflected in priority order

Intensity The degree of cathartic (i.e., emotional) Lower/Raise attachment to an expectation or set of expectations

Temporality Time factor associated with specific Shorten/Lengthen expectations reflecting variations in perceptions about when an expected state of affairs should be reached

Tractability Extent to which the expectation or set Facilitate/Impede of expectations can be handled, managed, and so on

Consistency Stability and invariability of a set of Stabilize/ expectations over time and space Destabilize dimensions

Interrelatedness Degree of interdependence among the Link/Disaggregate component parts of a set of expectations

Source: Dubnick and Romzek (1993, p. 56).

400 PPMR / March 2005

Trust as a contextual factor is closely tied to expectations in a double fashion, for it reflects the expectation in a social relationship that the other party will act as expected. The phrase “as expected” is used in a broad sense, for it can mean everything from as-explicitly-agreed-upon (e.g., promised) to according-to-past- behavior (e.g., habitual). Whatever the nature of those trust-related expectations, they take shape within varying contexts, from one-on-one game playing and tightly coupled hierarchies to open networks and market exchange systems (see Coleman, 1990, chapters 5, 8, and 28). Although trust is often assumed to play a central role in fostering good governance (Denhardt, 2002; Hamilton, 1999), it (like account giving) is a complex phenomenon that eludes simple generalizations (Van de Walle & Bouckaert, 2003). Nevertheless, theoretical and empirical work on trust over the past decade has provided us with a wealth of material and ideas to be mined for their relevance to the A⇒P relationship (Kramer, 1999).

The key to making this context approach work is being able to construct the logical and empirical connection between different contexts and A/A

exp ⇒P rela-

tionships. One obvious difficulty in doing this is that contexts of expectations and trust are infinitely variable, especially at the micro-event level. Each situa- tion is a unique configuration of expectations and related contingencies. This implies—or at least helps to explain—why almost all accountability-based re- forms are prone to fail, for one size truly does not fit all (or perhaps even most or many) circumstances. But patterns do emerge out of this randomness if we fo- cus at a higher level or relationships that develop over time, and typologies of accountability-relevant contexts can help us capture those patterns for analytic purposes.

The typology developed by Romzek & Dubnick (1987),21 for example, was originally posited as a means for examining various institutional contexts for the management of expectations in public administration. Rosenbloom’s (Rosenbloom & Goldman, 1998) typology of politics, management, and law was designed to stress the constitutional (e.g., separation of powers) roots of the expectations that impact on American public administration. More recently, Klingner, Nalbandian and Romzek (2002) offered a typology that contrasted politics, administration, and markets as “separate ways of thinking” about governance that generate “cross- cutting expectations of accountability.”

An alternative perspective offered by Dubnick (2003) attempts to encompass a broader contextual landscape for accountability by taking into consideration the moral and sociocultural sources of relevant expectations and systems of trust and ethics. In this typology, the focus is on the overlapping contexts for account- giving behavior within which those engaged in governance activities must oper- ate. These include (a) systems of answerability, including the range of hierarchi- cal institutions that pervade modern society, (b) moral communities that establish environments of blameworthiness, (c) formalistic and legal environments that

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 401

expose us to the constant pressure of liabilities, and (d) a social system of roles and status that subject us to attributions of competence with their accompanying sets of expectations and trustworthiness.

Systems of answerability reflect contexts in which expectations in general, and trust expectations in particular, are manifested in structures of authority and formalisms. It is the managerialist context, and in form it can range from tightly coupled, machine-like hierarchies to networks and “adhocracies” (see Mintzberg, 1979, 1980). Here the relevant potential M factors are found in the classic litera- ture on administrative behavior (Katz & Kahn, 1978; Kaufman, 1973) and orga- nizational communications (Rogers & Agarwala-Rogers, 1976), as well as the more recent work on the dynamics of network-based governance (Considine, 2002; Considine & Lewis, 1999; Flap, Bulder, & Völker, 1998; Klijn, 2001; Klijn & Koppenjan, 2000).

As a setting, environments of blameworthiness reflect the fact that individuals act within moral communities, that is, communities that assign one a status of exposure to blame (Smiley, 1992). Expectations of moral blameworthiness need not be rational or justified to play a role in how individuals deal with a specific situation. At times one is blameworthy because one is associated with a some group that is regarded as responsible for a problem or issue (a condition that, in its most extreme form, results in scapegoating). At other time one stands blame- worthy because one is perceived to have some causal control over an event (e.g., holding the captain of a ship blameworthy for any mishaps onboard during a cruise). Blameworthiness is also applicable to those who are perceived to be in a position to foresee that something bad might happen, or if one had expressed an intention to do something that might cause problems—whether, in the end, the intending actor actually had anything to do with an event. In short, we live and work in environments where blameworthiness and the potential attribution of blame shape expectations and our reactions to them (Shaver, 1985). This little explored area of social psychology has considerable potential as a source of M factors in the search for real linkages between account giving and performance (Dubnick, 1996, 2003).

The setting labeled liabilities deals with the pervasive role of the legal envi- ronment in administrative life. Many expectations, of course, emerged from “rule of law” standards, but as a contextual setting, the term “liabilities” is more broadly defined to include law as a distinct institutional setting (Hayek, 1972; Ingram, 1985) that fosters certain types of social relationships (Fuller, Edelman, & Matusik, 2000; Minow, 1990, 1997). It is an environment that stresses proto- cols, precedents, and formalization (Stinchcombe, 2001), and the mechanisms that emerge from this context (e.g., legalistic behavior, various means of deal- ing with discretion) can prove useful in understanding the link between ac- count giving and performance.

402 PPMR / March 2005

Finally, the context of attributions—what we expect of people in certain roles (e.g., the boss, professor X, police officer Y) and how we see the causes of prob- lems (who is responsible)—generates expectations and assessments of trustwor- thiness that trigger a wide range of mechanisms individuals use in shaping their relationships with others (Forsyth, 1980). The attributions associated with rela- tionships are deeply embedded in daily routines as well as common understand- ings of the way the system functions. We find evidence to support this in the way teachers perceive students (and vice versa) (Tetlock, 1980), in the diverse ways people of different cultures and political ideologies view problems and judge the behavior of others (Al-Zahrani & Kaplowitz, 1993; Howard & Pike, 1986; Menon, Morris, Chiu, & Hong, 1999; Skitka, Mullen, Griffin, Hutchinson, & Chamberlin, 2002), in the way informed voters assess the work of political institutions (Rudolph, 2003), and so on. Most important, self-identity and self-efficacy (attributions of one’s own role and the expectations of others) create a prominent setting for generating expectations and the associated mechanisms used with them (Bandura, 1989; Bandura & Wood, 1989; Beauchamp, Bray, Eys, & Carron, 2002; Fejfar & Hoyle, 2000; Gecas, 1989; Gist, 1987; Lindsley, Brass, & Thomas, 1995) as well as provide fertile ground for exploring the linkages that give life to the A⇒P assumption.

Conclusion: The p That A⇒P

If reforms and the way governance is conducted are public policies and if those public policies are essentially administrative arguments (Hood & Jackson, 1991), then students of public administration and public management are obliged to make certain those arguments are warrantable (Barzelay, 1999, 2001). In that regard, we are design scientists as Herbert Simon (1981) defined that field. In doing our job, however, we must remember that, in the design sciences, intelli- gence precedes both design and choice.

The central argument of this paper is that we cannot—and should not—con- tinue to rely on the assumed relationship between accountability and performance that underlies much of the NPM reform agenda. This position is not based on the contention that the assumption is false, but rather that it is unarticulated and un- tested. We have not engaged in the intelligence function of our job. Worse still, the A⇒P assumption is deeply embedded in a dominant mindset of those who should be most skeptical of it and related premises. Our misguided preoccupa- tion with management as the heart and soul of modern governance is not only blinding us to such basic questions, but is also binding us to theories and models that continue to send us down the wrong path.

By applying the logic of the social mechanism approach, we have started the process of articulating the theory that lies beneath the A⇒P relationship. What

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 403

we uncovered, however, is an urgent need to think more clearly about the con- cepts and constructs that comprise our folk wisdom about both accountability and performance. Shifting our focus to the act of account giving resulted in a search for what it meant to be accountable—something that most of us regarded as a self-evident truth. What we found was a complex phenomenon that has been subject to examination by philosophers, sociologists, social psychologists, and some political scientists for several decades. Turning to performance, we found that there is more than one brass ring reformers are grabbing for, and each is as conceptually complex and elusive as the idea of accountability.

Most significant, we found nothing in the existing literature on either topic that would provide a logical (let alone a theoretical or empirical) link between account giving and performance (outside the performative nature of account giv- ing itself). What emerges, instead, is some insight in the accountability paradox and the awareness that we need to broaden our perspective if we are to find the M factor(s) that might link account giving and performance. If such links exist (and that remains an open empirical question), then they are probably exogenous to the relationship itself. At this point the key seems to lie in the context of expecta- tions and trustworthiness (among other possible factors), and the next logical step would be an inventory of potential M factors with the various contextual frames. That done, we can undertake an elaboration analysis that will provide us with at least the logical foundations (i.e., propositions) for a testable argument about the relationship.

Unfortunately, we academics lack the capacity to call for a moratorium on bad policies. If we possessed such power, most of the current NPM agenda would be placed on hold.

Notes

1. Not all students of modern governance would agree that the A⇒P relationship is so central to the NPM movement. Behn (1998, 2001), for example, regards the problem as a dilemma of trying to deal with two highly valued but not completely related goals: improved performance and democratic accountability; for him the issue is how to reconcile these parallel and, from his viewpoint, competing values. Others see reforms as a means for using enhanced performance with the intention of improving program accountability (i.e., P⇒A) (Kearns, 1994; Neale & Anderson, 2000; Virtanen, 1997; Wang, 2002). This view is especially evident in the field of education (Cibulka & Derlin, 1995; Hanushek & Raymond, 2001; Ogawa & Collom, 2000; Schwartz, 2000). Aucoin and Heintzman (2000) have described the situation as dia- lectical, reflecting a fundamental tension between accountability and performance as the twin objectives of NPM. But every dialectic starts with a basic thesis, and in this case it is the unexamined assumption that the enhancement of accountability will improve performance, A⇒P.

2. The issue of the relationship between responsibility and accountability is central to many philosophical and ethical discussions as well (e.g., Fischer, 1999; Haydon, 1978).

3. See Waterman & Meier (1998) for an insightful critique of the principal–agent logic and its limitations as applied in studies of bureaucratic behavior. (See also Bendor, Glazer, &

404 PPMR / March 2005

Hammond, 2001; Bendor, Taylor, & Van Gaalen, 1985, 1987a, 1987b; Gray & Jenkins, 1993; Moe, 1984; Trebilcock & Iacobucci, 2003; Watt, Richards, & Skelcher, 2002).

4. Expressed most clearly in the phrase “to manage is to govern” (Feldman & Khademian, 2002; also see Metcalfe, 2001).

5. In the administrative reform movement, this has been manifest as managerialism (see Hood, 1991, 1995; also Kettl, 2000).

6. The question of whether contemporary efforts at grand theory have been able to resolve the problem is addressed in van den Berg (1998).

7. Although Coleman (1986, 1990) focuses his criticism on the grand theorists of the Parsonsian school for not dealing with the micro–macro linkage, Sørensen (1998) shows how the empiricists who came to dominate the field in the 1960s and 1970s also failed to address the problem. He points to their reliance on statistics rather than mathematics and on structural models drawn from econometrics.

8. Herbert Kaufman (1977) and other students of red tape acknowledge the existence of beneficial red tape, but the overwhelming view is negative (see Bozeman, 2000, especially pp. 8–10; cf. Gore, 1993).

9. For example, federal agencies responding to Office of Management and Budget’s re- quirement for annual Accountability Reports issue documents under that title that deal almost exclusively with financial reporting requirements.

10. Scott and Lyman (1968) note that previous work on account giving was associated primarily with the study of motivation. They draw special attention to two works: a little known publication of C. Wright Mills (1940) on “Situated Actions and Vocabularies of Motive” and a “theory of delinquency” that provided much of their typology of excuses and justifications (Sykes & Matza, 1957).

11. They note that their lists are “illustrative rather than . . . exhaustive” (p. 46, n. 10)—a caution repeated by every analyst in this area, and one that applies here, as well.

12. Schönbach’s (1990) study provides the most exhaustive list of account-giving acts (117) but all under the logic of mitigation. For overview of his and other typologies, see Table 3.1 in Benoit (1995, pp. 51–61).

13. Although rare in the United States, one arena where something close to acknowledged shame exists is in the military. The most explicit example of this mitigation form was the case of Commander Scott Waddle’s public admission of fault in the 2001 sinking of a Japanese vessel by his submarine (see Dubnick, 2003, p. 409).

14. An analogous form of account giving is found in many “12-step” programs (such as Alcoholics Anonymous), which require that the recovering party visit those whose lives had been impacted by the addict’s actions in the past to express regret as much as to apologize.

15. A performance involves, in Godlovitch’s (1993) words, “goal-directed activities.” In his examination of musical performance, Godlovitch regards the goal as “getting the work to the listener” (p. 573)—and doing so with integrity.

16. For a survey of theories and research associated with the social psychology of musical performance, see Palmer (1997).

17. Some would argue that TQM is actually a contemporary form of Taylorism (Boje & Winsor, 1993), and in a sense the distinction made here between P1 and P2 does not contradict such a view. On the one hand, Taylorism in its original form may not have been as rigid as it is oftentimes portrayed (Freeman, 1996); on the other hand, one could see TQM as a variant of Taylorism in which quality control has been factored into the design.

18. The most sustained theme in the literature has been related to the potentially dysfunc- tional nature and abuse of the measures that are associated with this perspective (Halachmi, 2002b; Perrin, 1998; Ridgway, 1956; Thompson, 2000; Townley, 2001).

19. The Chief Financial Officers Act of 1990, the Government Management and Reform Act of 1994, and the issuance of standards by the Federal Accounting Standards Advisory Board starting in 1993.

20. For example, Lerner and Tetlock (1999); Tetlock (1983a, 1983b, 1985); Tetlock and Boettger (1989); Tetlock & Kim (1987); and Tetlock et al. (1989).

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 405

21. See also Dubnick & Romzek (1991); Romzek and Dubnick (1994); 2000.

References

Al-Zahrani, S.S.A., & Kaplowitz, S.A. (1993). Attributional biases in individualistic and collectivistic cultures: A comparison of Americans with Saudis. Social Psychology Quarterly, 56(3), 223–233.

Ambos, K. (2000). Judicial accountability of perpetrators of human rights violations and the role of victims. International Peacekeeping, 6(2), 67–77.

Anechiarico, F., & Jacobs, J.B. (1994). Visions of corruption control and the evolution of American public administration. Public Administration Review, 54(5), 465–473.

Arvey, R.D., & Murphy, K.R. (1998). Performance evaluation in work settings. Annual Review of Psychology, 49, 141–168.

Aucoin, P., & Heintzman, R. (2000). The dialectics of accountability for performance in public management reform. International Review of Administrative Sciences, 66(1), 45–55.

Austin, J.L. (1975). How to do things with words. 2nd ed. Cambridge: Harvard University Press.

Austin, J.L. (1979). A plea for excuses. In J.O. Urmson & G.J. Warnock (Eds.), Philo- sophical Papers (pp. 175–204). Oxford: Oxford University Press. (Original work pub- lished 1956.)

Bailey, F.G. (1969). Stratagems and spoils: A social anthropology of politics. New York: Schoken Books.

Bailey, F.G. (1988). Humbuggery and manipulation: The art of leadership. Ithaca: Cornell University Press.

Bailey, F.G. (2001). Treasons, stratagems, and spoils: How leaders make practical use of values and beliefs. Boulder, CO: Westview Press.

Balkwell, J.W. (1991). From expectations to behavior: An improved postulate for expecta- tions. American Sociological Review, 56(3), 355–369.

Balkwell, J.W. (1995). Strong tests of expectation-states hypotheses. Social Psychology Quarterly, 58(1), 44–51.

Bandura, A. (1989). Human agency in social cognitive theory. American Psychologist, 44(9), 1175–1184.

Bandura, A., & Wood, R. (1989). Effect of perceived controllability and performance stan- dards on self-regulation of complex decision making. Journal of Personality & Social Psychology, 56(5), 805–814.

Barberis, P. (1998). The new public management and a new accountability. Public Admin- istration, 76(3), 451–470.

Bartelt, E.F. (1942). The role of accounts in the administration of the federal government. Accounting Review, 17(2), 82–88.

Barzelay, M. (1999). How to argue about the new public management. International Pub- lic Management Journal, 2(2), 183–216.

Barzelay, M. (2001). The new public management: Improving research and policy dia- logue. Berkeley: University of California Press/Russell Sage Foundation.

Beauchamp, M.R., Bray, S.R., Eys, M.A., & Carron, A.V. (2002). Role ambiguity, role efficacy, and role performance: Multidimensional and mediational relationships within interdependent sport teams. Group Dynamics, 6(3), 229–242.

Behn, R.D. (1998). The new public management paradigm and the search for democratic accountability. International Public Management Journal, 1(2), 131–164.

Behn, R.D. (2001). Rethinking democratic accountability. Washington, DC: Brookings Institution Press.

406 PPMR / March 2005

Bendix, R. (1978). Kings or people: Power and the mandate to rule. Berkeley: University of California Press.

Bendor, J., Glazer, A., & Hammond, T. (2001). Theories of delegation. Annual Review of Political Science, 4(1), 235–241.

Bendor, J., Taylor, S., & Van Gaalen, R. (1985). Bureaucratic expertise versus legislative authority: A model of deception and monitoring in budgeting. American Political Sci- ence Review, 79(4), 1041–1060.

Bendor, J., Taylor, S., & Van Gaalen, R. (1987a). Politicians, bureaucrats, and asymmetric information. American Journal of Political Science, 31(4), 796–828.

Bendor, J., Taylor, S., & Van Gaalen, R. (1987b). Stacking the deck: Bureaucratic missions and policy design. American Political Science Review, 81(3), 873–896.

Benedict, R. (1989). The chrysanthemum and the sword: Patterns of Japanese culture. Boston: Houghton Mifflin. (Original work published 1946.)

Bennett, W.L. (1980). The paradox of public disclosure: A framework for the analysis of political accounts. Journal of Politics, 42(3), 792–817.

Benoit, W.L. (1995). Accounts, excuses, and apologies: A theory of image restoration strategies. Albany: State University of New York Press.

Berger, J., Norman, R.Z., Balkwell, J.W., & Smith, R.F. (1992). Status inconsistency in task situations: A test of four status processing principles. American Sociological Re- view, 57(6), 843–855.

Boje, D.M., & Winsor, R.D. (1993). The resurrection of Taylorism: Total quality management’s hidden agenda. Journal of Organizational Change Management, 6(4), 57–70.

Borman, W.C., Hanson, M.A., & Hedge, J.W. (1997). Personnel selection. Annual Review of Psychology, 48, 299–337.

Borneman, J. (1997). Settling accounts: Violence, justice, and accountability in postsocialist Europe. Princeton: Princeton University Press.

Bouckaert, G., & Peters, B.G. (2002). Performance measurement and management: The Achilles heel in administrative modernization. Public Performance & Management Review, 25(4), 359–362.

Boudon, R. (1998). Social mechanisms without black boxes. In P. Hedström & R. Swedberg (Eds.), Social mechanisms: An analytical approach to social theory (pp. 172–203). Cambridge: Cambridge University Press.

Bourgeois, V.W., & Pinder, C.C. (1983). Contrasting philosophical perspectives in admin- istrative science: A reply to Morgan. Administrative Science Quarterly, 28(4), 608– 613.

Bovens, M. (1998). The quest for responsibility: Accountability and citizenship in complex organisations. Cambridge: Cambridge University Press.

Bozeman, B. (2000). Bureaucracy and red tape. Upper Saddle River, NJ: Prentice Hall. Broadbent, J., Dietrich, M., & Laughlin, R. (1996). The development of principal-agent,

contracting and accountability relationships in the public sector: Conceptual and cul- tural problems. Critical Perspectives in Accounting, 7(3), 259–284.

Bromley, D.B. (1993). Reputation, image and impression management. New York: Wiley. Burge, T. (1992). Philosophy of language and mind: 1950–1990. Philosophical Review,

101(1), 3–51. Burke, J.P. (1986). Bureaucratic responsibility. Baltimore: Johns Hopkins University Press. Buttny, R. (1993). Social accountability in communication. London: Sage. Caiden, G.E. (1988). The problem of ensuring the public accountability of public officials.

In J.G. Jabbra & O.P. Dwivedi (Eds.), Public service accountability: A comparative perspective (pp. 17–38). West Hartford, CT: Kumarian Press.

Carruthers, B.G., & Espeland, W.N. (1991). Accounting for rationality: Double-entry book-

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 407

keeping and the rhetoric of economic rationality. American Journal of Sociology, 97(1), 31–69.

Cavalluzzo, K.S., & Ittner, C.D. (2004). Implementing performance measurement innova- tions: Evidence from government. Accounting Organizations and Society, 29(3/4), 243– 267.

Chandler, A.D., Jr. (1977). The visible hand: The managerial revolution in American busi- ness. Cambridge: Belknap Press/Harvard University Press.

Cibulka, J.G., & Derlin, R.L. (1995). State educational performance reporting policies in the U.S.: Accountability’s many faces. International Journal of Educational Research, 23(6), 479–492.

Clark, W.C. (1939). Municipal reports or museum pieces? Public Opinion Quarterly, 3(2), 292–298.

Cochrane, A. (1993). From financial control to strategic management: The changing faces of accountability in British local government. Accounting, Auditing, and Accountabil- ity Journal, 6(3), 30–51.

Coleman, J.S. (1986). Social theory, social research, and a theory of action. American Journal of Sociology, 91(6), 1309–1335.

Coleman, J.S. (1990). Foundations of social theory. Cambridge: Belknap Press/Harvard University Press.

Coleman, R.W. (1949). The role of accounting in management. Accounting Review, 24(2), 179–183.

Collins, F. (1982). Managerial accounting systems and organizational control: A role per- spective. Accounting, Organizations and Society, 7(2), 107–122.

Considine, M. (2002). The end of the line? Accountable governance in the age of net- works, partnerships, and joined-up services. Governance, 15(1), 21–40.

Considine, M., & Lewis, J.M. (1999). Governance at ground level: The frontline bureau- crat in the age of markets and networks. Public Administration Review, 59(6), 467–480.

Cutler, T., & Waine, B. (2001). Report: Performance management: The key to higher stan- dards in schools? Public Money & Management, 21(2), 69–72.

Denhardt, R.B. (2002). Trust as capacity: The role of integrity and responsiveness. Public Organization Review, 2(1), 65–76.

DiMaggio, P.J., & Powell, W.W. (1983). The iron cage revisited: Institutional isomor- phism and collective rationality in organizational fields. American Sociological Re- view, 48(2), 147–160.

Dittenhofer, M.A. (2001). Behavioral aspects of government financial management. Mana- gerial Auditing Journal, 16(8), 451–457.

Drucker, P.F. (1974). Management: Tasks, responsibilities, practices. New York: Harper & Row.

Dubnick, M.J. (1996, August). Public service ethics and the cultures of blame. Paper pre- sented at the Fifth International Conference of Ethics in the Public Service, Brisbane, Australia.

Dubnick, M.J. (1998). Clarifying accountability: An ethical theory framework. In N.P. Charles Sampford with C.-A. Bois (Eds.), Public sector ethics: Finding and imple- menting values (pp. 68–81). Leichhardt, Australia: Federation Press/Routledge.

Dubnick, M.J. (2002, August/September). Seeking salvation for accountability. Paper pre- sented at the American Political Science Association, Boston.

Dubnick, M.J. (2003). Accountability and ethics: Reconsidering the relationships. Inter- national Journal of Organization Theory and Behavior, 6(3), 405–441.

Dubnick, M.J., & Romzek, B.S. (1991). American public administration: Politics and the management of expectations. New York: Macmillan.

Dubnick, M.J., & Romzek, B.S. (1993). Accountability and the centrality of expectations

408 PPMR / March 2005

in American public administration. In J.L. Perry (Ed.), Research in public administra- tion (pp. 37–78). Greenwich CT: JAI Press.

Dunn, D., & Cody, M.J. (2000). Account credibility and public image: Excuses, justifica- tions, denials, and sexual harassment. Communication Monographs, 67(4), 372–391.

Dwivedi, O.P., & Jabbra, J.G. (1988). Introduction: Public service responsibility and ac- countability. In J.G. Jabbra & O.P. Dwivedi (Eds.), Public service accountability: A comparative perspective (pp. 1–16). West Hartford, CT: Kumarian Press.

Eisenberg, N. (2000). Emotion, regulation, and moral development. Annual Review of Psy- chology, 51, 665–697.

Elster, J. (1989). Nuts and bolts for the social sciences. New York: Cambridge University Press.

Elster, J. (1998). A plea for mechanisms. In P. Hedström & R. Swedberg (Eds.), Social mechanisms: An analytical approach to social theory (pp. 45–73). Cambridge: Cam- bridge University Press.

Elster, J. (1999). Alchemies of the mind: Rationality and the emotions. New York: Cam- bridge University Press.

Elster, J. (2004). Closing the books: Transitional justice in historical perspective. New York: Cambridge University Press.

Ericsson, K.A., & Lehmann, A.C. (1996). Expert and exceptional performance: Evi- dence of maximal adaptation to task constraints. Annual Review of Psychology, 47, 273–305.

Faucett, A., & Kleiner, B.H. (1994). New developments in performance measures of pub- lic programmes. International Journal of Public Sector Management, 7(3), 63–70.

Fejfar, M.C., & Hoyle, R.H. (2000). Effect of private self-awareness on negative affect and self-referent attribution: A quantitative review. Personality and Social Psychology Re- view, 4(2), 132–142.

Feldman, M.S., & Khademian, A.M. (2002). To manage is to govern. Public Administra- tion Review, 62(5), 541–554.

Fesler, J.W. (1959). Field organization. In F.M. Marx (Ed.), Elements of public adminis- tration (pp. 246–273). 2nd ed. Englewood Cliffs, NJ: Prentice-Hall.

Fischer, J.M. (1999). Recent work on moral responsibility. Ethics, 110(1), 93–139. Flap, H., Bulder, B., & Völker, B. (1998). Intra-organizational networks and performance:

A review. Computational and Mathematical Organization Theory, 4(2), 109–147. Flynn, A., Gray, A., Jenkins, W., & Rutherford, B. (1988). Making indicators perform.

Public Money & Management, 8(4), 35–41. Folkes, V.S., & Whang, Y.O. (2003). Account-giving for a corporate transgression influ-

ences moral judgement: When those who “spin” condone harm-doing. Journal of Ap- plied Psychology, 88(1), 79–86.

Forsyth, D.R. (1980). The functions of attributions. Social Psychology Quarterly, 43(2), 184–189.

Fox, C.J. (1996). Reinventing government as postmodern symbolic politics. Public Ad- ministration Review, 56(3), 256.

Freeman, M. (1996). Scientific management: 100 years old: Poised for the next century. S.A.M. Advanced Management Journal, 61(2), 35–41.

Fuller, S.R., Edelman, L.B., & Matusik, S.F. (2000). Legal readings: Employee interpreta- tion and mobilization of law. Academy of Management Review, 25(1), 200–216.

Gallo, J., & Thompson, P.R. (2000). Goals, measures, and beyond: In search of account- ability in federal HRM. Public Personnel Management, 29(2), 237–248.

Gambetta, D. (1998). Concatenations of mechanisms. In P. Hedström & R. Swedberg (Eds.), Social mechanisms: An analytical approach to social theory (pp. 102–124). Cambridge: Cambridge University Press.

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 409

Gamm, L.D. (1996). Dimensions of accountability for not-for-profit hospitals and health systems. Health Care Management Review, 21(2), 74–86.

Gecas, V. (1989). The social psychology of self-efficacy. Annual Review of Sociology, 15, 291–316.

Gelfand, M.J., Nishii, L.H., Holcombe, K.M., Dyer, N., Ohbuchi, K.I., & Fukuno, M. (2001). Cultural influences on cognitive representations of conflict: Interpretations of conflict episodes in the United States and Japan. Journal of Applied Psychology, 86(6), 1059–1074.

Gibson, A., & Asthana, S. (1998). School performance, school effectiveness and the 1997 white paper. Oxford Review of Education, 24(2), 195–210.

Gist, M.E. (1987). Self-efficacy: Implications for organizational behavior and human re- source management. Academy of Management Review, 12(3), 472–485.

Godlovitch, S. (1993). The integrity of musical performance. Journal of Aesthetics and Art Criticism, 51(4), 573–587.

Goffman, E. (1959). The presentation of self in everyday life. Garden City, NY: Doubleday Anchor.

Gold, B. (1965). Productivity analysis and system coherence. Operations Research Quar- terly, 16(3), 287–307.

Goldstein, H., & Woodhouse, G. (2000). School effectiveness research and educational policy. Oxford Review of Education, 26(3/4), 353–363.

Gómez, M.R. (1998). Exposure surveillance tools needed in agency GPRA plans. Ameri- can Industrial Hygiene Association Journal, 59(6), 371–374.

Gore, A. (1993). From red tape to results: Creating a government that works better and costs less: Report of the national performance review. Washington, DC: U.S. Govern- ment Printing Office.

Governmental Accounting Standards Board. (1987). Summary of Concept Statement No. 1: Objectives of Financial Reporting. Available at http://accounting.rutgers.edu/raw/ gasb/st/concepts/gconsum1.html, accessed on December 15, 2004.

Granovetter, M. (1985). Economic action and social structure: The problem of embeddedness. American Journal of Psychology, 91(3), 481–510.

Gray, A., & Jenkins, B. (1993). Codes of accountability in the new public sector. Account- ing, Auditing & Accountability Journal, 6(3), 52–67.

Gruber, J.E. (1987). Controlling bureaucracies: Dilemmas in democratic governance. Berkeley: University of California Press.

Halachmi, A. (2002a). Performance measurement, accountability, and improved perfor- mance. Public Performance & Management Review, 25(4), 370–374.

Halachmi, A. (2002b). Performance measurement: A look at some possible dysfunctions. Work Study, 51(5), 230–239.

Halachmi, A., & Bouckaert, G. (1994). Performance measurement, organizational tech- nology and organizational design. Work Study, 43(3), 19–25.

Halstuk, M.E., & Chamberlin, B.F. (2001). Open government in the digital age: The legis- lative history of how Congress established a right of public access to electronic infor- mation held by federal agencies. Journalism and Mass Communication Quarterly, 78(1), 45–64.

Hamilton, L. (1999). Improving public trust in government. Available at www.excelgov.org/ displayContent.asp?NewsItemID=1467&Keyword= prfwTranscripts, accessed January 3, 2005.

Hanushek, E.A., & Raymond, M.E. (2001). The confusing world of educational account- ability. National Tax Journal, 54(2), 365–384.

Haque, M.S. (2000). Significance of accountability under the new approach to public gov- ernance. International Review of Administrative Sciences, 66(4), 599–617.

410 PPMR / March 2005

Haydon, G. (1978). On being responsible. Philosophical Quarterly, 28(110), 46–57. Hayek, F.A.V. (1972). The constitution of liberty. Chicago: Regency. Hedström, P., & Swedberg, R. (eds.). (1998). Social mechanisms: An analytical approach

to social theory. Cambridge: Cambridge University Press. Hewitt, J.P., & Stokes, R. (1975). Disclaimers. American Sociological Review, 40(1), 1–11. Hirschman, A.O. (1991). The rhetoric of reaction: Perversity, futility, jeopardy. Cambridge:

Belknap/Harvard University Press. Hood, C. (1991). A public management for all seasons? Public Administration, 69(1), 3–19. Hood, C. (1995). The “new public management” in the 1980s: Variations on a theme.

Accounting, Organizations, and Society, 20(2/3), 93–109. Hood, C. (2001). Public service managerialism: Onwards and upwards, or “Trobriand

cricket” again? Political Quarterly, 72(3), 300–309. Hood, C., & Jackson, M. (1991). Administrative Argument. London: Dartmouth. Hood, C., & Lodge, M. (2004). Competency, bureaucracy, and public management re-

form: A comparative analysis. Governance, 17(3), 313–333. Howard, J.A., & Pike, K.C. (1986). Ideological investment in cognitive processing: The

influence of social statuses on attribution. Social Psychology Quarterly, 49(2), 154– 167.

Hull, M.S. (2003). The file: Agency, authority, and autography in an Islamabad bureau- cracy. Language & Communication, 23(3/4), 287–314.

Hummel, R.P. (1994). The bureaucratic experience: A critique of life in the modern orga- nization. 4th ed. New York: St. Martin’s Press.

Ingram, P. (1985). Maintaining the rule of law. Philosophical Quarterly, 35(141), 359– 381.

Jacoby, H. (1973). The bureaucratization of the world (E. Kanes, trans.). Berkeley: Uni- versity of California Press.

Jenkins, R., & Goetz, A.M. (1999). Accounts and accountability: Theoretical implications of the right-to-information movement in India. Third World Quarterly, 20(3), 603–622.

Jenks, L.H. (1960). Early phases of the management movement. Administrative Science Quarterly, 5(3), 421–447.

Kates, J., Marconi, K., & Mannle, T.E.J. (2001). Developing a performance management system for a federal public health program: The Ryan White Care Act Titles II and I. Evaluation and Program Planning, 24(2), 145–155.

Katz, D., & Kahn, R.L. (1978). The social psychology of organizations. 2nd ed. New York: Wiley.

Kaufman, H. (1967). The forest ranger: A study in administrative behavior. Baltimore: Johns Hopkins University Press.

Kaufman, H. (1973). Administrative feedback: Monitoring subordinates’ behavior. Wash- ington, DC: Brookings Institution Press.

Kaufman, H. (1977). Red tape: Its origins, uses, and abuses. Washington, DC: Brookings Institution Press.

Kautz, J.R., III, Netting, F.E., Huber, R., Borders, K., & Davis, T.S. (1997). The Govern- ment Performance and Results Act of 1993: Implications for social work practice. So- cial Work, 42, 364–373.

Kearns, K.P. (1994). The strategic management of accountability in nonprofit organiza- tions: An analytical framework. Public Administration Review, 54(2), 185–192.

Keating, E.K., & Frumkin, P. (2003). Reengineering nonprofit financial accountability: Toward a more reliable foundation for regulation. Public Administration Review, 63(1), 3–15.

Kelling, G.L., & Coles, C.M. (1996). Fixing broken windows: Restoring order and reduc- ing crime in our communities. New York: Martin Kessler Books.

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 411

Kelly, J.M. (2002). Why we should take performance measurement on faith (facts being hard to come by and not terribly important). Public Performance & Management Re- view, 25(4), 375–380.

Kettl, D.F. (2000). The global public management revolution: A report on the transforma- tion of governance. Washington, DC: Brookings Institution Press.

Klijn, E.-H. (2001). Rules as institutional context for decision making in networks: The approach to postwar housing districts in two cities. Administration & Society, 33(2), 133–164.

Klijn, E.-H., & Koppenjan, J.F.M. (2000). Public management and policy networks: Foun- dations of a network approach to governance. Public Management Review, 2(2), 135– 158.

Klingner, D.E., Nalbandian, J., & Romzek, B.S. (2002). Politics, administration, and mar- kets: Conflicting expectations and accountability. American Review of Public Adminis- tration, 32(2), 117–144.

Kramer, R.M. (1999). Trust and distrust in organizations: Emerging perspectives, endur- ing questions. Annual Review of Psychology, 50, 569–598.

Kravchuk, R.S., & Schack, R.W. (1996). Designing effective performance-measurement systems under the Government Performance and Results Act of 1993. Public Adminis- tration Review, 56(4), 348–358.

Leary, M.R., & Kowalski, R.M. (1990). Impression management: A literature review and two-component model. Psychological Bulletin, 107(1), 34–47.

Lerner, J.S., & Tetlock, P.E. (1999). Accounting for the effects of accountability. Psycho- logical Bulletin, 125(2), 255–275.

Lewis, H.B. (1971). Shame and guilt in neurosis. New York: International Universities Press.

Lewis, M. (1995). Shame: The exposed self. New York: Free Press. Lindsley, D.H., Brass, D.J., & Thomas, J.B. (1995). Efficacy-performance spirals: A mul-

tilevel perspective. Academy of Management Review, 20(3), 645–678. Lipsky, M. (1980). Street-level bureaucracy: Dilemmas of the individual in public ser-

vices. New York: Russell Sage Foundation. Littler, C.R. (1978). Understanding Taylorism. British Journal of Sociology, 29(2), 185–202. Lodge, C., & Reed, J. (2003). Transforming school improvement now and for the future.

Journal of Educational Change, 4(1), 45–62. Lynd, H.M. (1958). On shame and the search for identity. New York: Harcourt. Lynn, L.E., Heinrich, C.J., & Hill, C.J. (2000). Studying governance and public manage-

ment: Challenges and prospects. Journal of Public Administration Research and Theory, 10(2), 233–261.

Mansfield, H.C., & Marx, F.M. (1959). Fiscal accountability. In F.M. Marx (Ed.), Ele- ments of public administration (pp. 525–559). 2nd ed. Englewood Cliffs, NJ: Prentice- Hall.

Marx, F.M., & Reining, H., Jr. (1959). The tasks of middle management. In F.M. Marx (Ed.), Elements of Public Administration (pp. 371–384). 2nd ed. Englewood Cliffs, NJ: Prentice-Hall.

McAdam, D., Tarrow, S.G., & Tilly, C. (2001). Dynamics of contention. New York: Cam- bridge University Press.

McGraw, K.M. (1990a). Avoiding blame: An experimental investigation of political ex- cuses and justifications. British Journal of Political Science, 20(1), 119–131.

McGraw, K.M. (1990b). Making all the difference: Inclusion, exclusion, and American law. Ithaca: Cornell University Press.

McGraw, K.M. (1991). Managing blame: An experimental test of the effects of political accounts. American Political Science Review, 85(4), 1133–1157.

412 PPMR / March 2005

McGraw, K.M. (1997). Not only for myself: Identity, politics and the law. New York: New Press.

McGraw, K.M. (1998a). Between vengeance and forgiveness: Facing history after geno- cide and mass violence. Boston: Beacon Press.

McGraw, K.M. (1998b). Manipulating public opinion with moral justification. Annals of the American Academy of Political and Social Science, 560, 129–142.

McLean, I. (2002). William H. Riker and the invention of heresthetic(s). British Journal of Political Science, 32(3), 535–558.

McNab, R.M., & Melese, F. (2003). Implementing the GPRA: Examining the prospects for performance budgeting in the federal government. Public Budgeting & Finance, 23(2), 73–95.

Menon, T., Morris, M.W., Chiu, C.-Y., & Hong, Y.-Y. (1999). Culture and the construal of agency: Attribution to individual versus group dispositions. Journal of Personality and Social Psychology, 76(5), 701–717.

Merton, R.K. (1968). Social theory and social structure. Enlarged ed. New York: Free Press. Metcalfe, L. (2001). Reforming European governance: Old problems or new principles?

International Review of Administrative Sciences, 67(3), 415–443. Meyer, J.W., & Rowan, B. (1977). Institutionalized organizations: Formal structure as

myth and ceremony. American Journal of Sociology, 83(2), 340–363. Miller, P., & O’Leary, T. (1987). Accounting and the construction of the governable per-

son. Accounting, Organizations, and Society, 12(3), 235–265. Mills, C.W. (1940). Situated actions and vocabularies of motive. American Sociological

Review, 5(6), 904–913. Minow, M. (1990). Making all the difference: Inclusion, exclusion, and American law.

Ithaca: Cornell University Press. Minow, M. (1997). Not only for myself: Identity, politics and the law. New York: New

Press. Minow, M.(1998). Between vengeance and forgiveness: Facing history after genocide

and mass violence. Boston: Beacon Press. Mintzberg, H. (1979). The structuring of organizations: A synthesis of the research. New

York: Prentice-Hall. Mintzberg, H. (1980). Structure in 5’s: A synthesis of the research on organization design.

Management Science, 26(3), 322–341. Moe, T.M. (1984). The new economics of organization. American Journal of Political

Science, 28(4), 739–777. Morey, L. (1942). Financial reporting in the federal government. Accounting Review, 17(2),

73–82. Morgan, G. (1983). More on metaphor: Why we cannot control tropes in administrative

science. Administrative Science Quarterly, 28(4), 601–607. Morgan, P.W., & Reynolds, G.H. (1997). The appearance of impropriety: How the ethics

wars have undermined American government, business, and society. New York: Free Press.

Morgeson, F.P., & Campion, M.A. (2002). Minimizing tradeoffs when redesigning work: Evidence from a longitudinal quasi-experiment. Personnel Psychology, 55(3), 589– 612.

Mulgan, R. (2000a). “Accountability”: An ever-expanding concept? Public Administra- tion, 78(3), 555–573.

Mulgan, R. (2000b). Comparing accountability in the public and private sectors. Austra- lian Journal of Public Administration, 59(1), 87–97.

Neale, A., & Anderson, B. (2000). Performance reporting for accountability purposes: Lessons, issues, future. International Public Management Journal, 3(1), 93–106.

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 413

Norman, R. (2002). Managing through measurement or meaning? Lessons from experi- ence with New Zealand’s public sector performance management systems. Interna- tional Review of Administrative Sciences, 68(4), 619–628.

Nussbaum, M.C. (2001). Upheavals of thought: The intelligence of emotions. New York: Cambridge University Press.

O’Donnell, G. (1998). Horizontal accountability in new democracies. Journal of Democ- racy, 9(3), 112–126.

Ogawa, R.T., & Collom, E. (2000). Using performance indicators to hold schools account- able: Implicit assumptions and inherent tensions. Peabody Journal of Education, 75(4), 200–215.

Orbuch, T.L. (1997). People’s accounts count: The sociology of accounts. Annual Review of Sociology, 23(1), 455–418.

Osborne, D., & Gaebler, T. (1992). Reinventing government: How the entrepreneurial spirit is transforming the public sector. Reading, MA: Addison-Wesley.

Ostrom, E. (1972). Metropolitan reform: Propositions from two traditions. Social Science Quarterly, 53(4), 474–483.

Ostrom, E. (2000). The danger of self-evident truths. PS, Political Science & Politics, 33(1), 33–44.

Ostrom, E., Baugh, W.H., Guarasci, R., Parks, R.B., & Whitaker, G.P. (1973). Community organization and the provision of police services. Beverly Hills: Sage.

Ostrom, E., & Whitaker, G. (1973). Does local community control of police make a differ- ence? Some preliminary findings. American Journal of Political Science, 17(1), 48–76.

Oswick, C., Keenoy, T., & Grant, D. (2002). Metaphor and analogical reasoning in organi- zation theory: Beyond orthodoxy. Academy of Management Review, 27(2), 294–303.

Paine, S.C. (1989). Persuasion, manipulation, and dimension. Journal of Politics, 51(1), 36–49.

Pallot, J. (1998). New public management reform in New Zealand: The collective strategy phase. International Public Management Journal, 1(1), 1–18.

Palmer, C. (1997). Music performance. Annual Review of Psychology, 48, 115–138. Perrin, B. (1998). Effective use and misuse of performance measurement. American Jour-

nal of Evaluation, 19(3), 367–379. Petrucci, C.J. (2002). Apology in the criminal justice setting: Evidence for including apol-

ogy as an additional component in the legal system. Behavioral Sciences and the Law, 20(4), 337–362.

Picard, R.R., & Reis, P. (2002). Management control systems design: A metaphorical inte- gration of national cultural implications. Managerial Auditing Journal, 17(5), 222–233.

Pinder, C.C., & Bourgeois, V.W. (1982). Controlling tropes in administrative science. Ad- ministrative Science Quarterly, 27(4), 641–652.

Piotrowski, S.J., & Rosenbloom, D.H. (2002). Nonmission-based values in results-ori- ented public management: The case of freedom of information. Public Administration Review, 62(6), 643–657.

Pollitt, C., & Bouckaert, G. (2000). Public management reform: A comparative analysis. Oxford: Oxford University Press.

Potter, B. (2002). Financial accounting reforms in the Australian public sector: An episode in institutional thinking. Accounting, Auditing, and Accountability Journal, 15(1), 69.

Radin, B.A. (1998a). The Government Performance and Results Act (GPRA): Hydra- headed monster or flexible management tool? Public Administration Review, 58(4), 307–316.

Radin, B.A. (1998b). Searching for government performance: The Government Perfor- mance and Results Act. PS: Political Science & Politics, 31(3), 553–555.

Radin, B.A. (2000). The Government Performance and Results Act and the tradition of

414 PPMR / March 2005

federal management reform: Square pegs in round holes? Journal of Public Adminis- tration Research & Theory, 10(1), 111–135.

Reeves, C.A., & Bednar, D.A. (1994). Defining quality: Alternatives and implications. Academy of Management Review, 19(3), 419–445.

Rhodes, R.A.W. (1996). The new governance: Governing without government. Political Studies, 44(3), 652–667.

Ridgway, V.F. (1956). Dysfunctional consequences of performance measurements. Ad- ministrative Science Quarterly, 1(2), 240–247.

Riker, W.H. (1986). The art of political manipulation. New Haven: Yale University Press. Roberts, A.S. (2000). Less government, more secrecy: Reinvention and the weakening of

freedom of information law. Public Administration Review, 60(4), 308–320. Roberts, N. (2000). The synoptic model of strategic planning and the GPRA: Lacking a

good fit with the political context. Public Productivity & Management Review, 23(3), 297–311.

Rogers, E.M., & Agarwala-Rogers, R. (1976). Communication in organizations. New York: Free Press.

Romzek, B.S., & Dubnick, M.J. (1987). Accountability in the public sector: Lessons from the Challenger tragedy. Public Administration Review, 47(3), 227–238.

Romzek, B.S., & Dubnick, M.J. (1994). Issues of accountability in flexible personnel sys- tems. In P.W. Ingraham & B.S. Romzek (Eds.), New paradigms for government: Issues for the changing public service (pp. 263–294). San Francisco: Jossey-Bass.

Romzek, B.S., & Dubnick, M.J. (2000). Accountability. In J.M. Shafritz (Ed.), Defining public administration: Selections from the international encyclopedia of public policy and administration (pp. 382–395). Boulder, CO: Westview Press.

Rosenbloom, D.H. (1987). Public administrators’ liability: Bench v. bureau in the contempo- rary administrative state. Public Administration Quarterly, 10(4), 373–386.

Rosenbloom, D.H. (1994). Fuzzy law from the high court. Public Administration Review, 54(6), 503–506.

Rosenbloom, D.H. (2003). Administrative law for public managers. Boulder, CO: Westview Press.

Rosenbloom, D.H., Carroll, J.D., & Carroll, J.D. (2000). Constitutional competence for public managers: Cases and commentary. Itasca, IL: F.E. Peacock.

Rosenbloom, D.H., & Goldman, D.D. (1998). Public administration: Understanding man- agement, politics, and law in the public sector. 4th ed. New York: McGraw-Hill.

Rudolph, T.J. (2003). Institutional context and the assignment of political responsibility. Journal of Politics, 65(1), 190–215.

Sanders, T.H. (1934). Reports to stockholders. Accounting Review, 9(3), 201–219. Savas, E.S. (1982). Privatizing the public sector: How to shrink government. Chatham,

NJ: Chatham House. Savas, E.S. (1987). Privatization: The key to better government. Chatham, NJ: Chatham

House. Schedler, A., Diamond, L.J., & Plattner, M.F. (Eds.). (1999). The self-restraining state:

Power and accountability in new democracies. Boulder, CO: Lynne Rienner. Scheff, T.J. (2000). Shame and the social bond: A sociological theory. Sociological Theory,

18(1), 84–99. Scheff, T.J. (2003). Shame in self and society. Symbolic Interaction, 26(2), 239–262. Schelling, T.C. (1998). Social mechanisms and social dynamics. In P. Hedström & R.

Swedberg (Eds.), Social mechanisms: An analytical approach to social theory (pp. 32– 44). Cambridge: Cambridge University Press.

Schick, A. (1996). Spirit of reform: Managing the New Zealand state sector in a time of change. Wellington, New Zealand: State Services Commission and the Treasury.

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 415

Schlenker, B.R., & Darby, B.W. (1981). The use of apologies in social predicaments. So- cial Psychology Quarterly, 44(3), 271–278.

Schönbach, P. (1990). Account episodes: The management or escalation of conflict. Cam- bridge: Cambridge University Press.

Schwartz, R. (2000). School accountability—an elusive policy solution: The Israeli expe- rience in comparative perspective. Journal of Public Policy, 20(2), 195–218.

Scott, J.C. (1998). Seeing like a state: How certain schemes to improve the human condi- tion have failed. New Haven: Yale University Press.

Scott, M.B., & Lyman, S.M. (1968). Accounts. American Sociological Review, 33(1), 46– 62.

Semin, G.R., & Manstead, A.S.R. (1983). The accountability of conduct: A social psycho- logical analysis. London: Academic Press.

Shaver, K.G. (1985). The attribution of blame: Causality, responsibility, and blameworthi- ness. New York: Springer-Verlag.

Simon, H.A. (1955). A behavioral model of rational choice. Quarterly Journal of Econom- ics, 69(1), 99–118.

Simon, H.A. (1981). The sciences of the artificial. 2nd ed. Cambridge: MIT Press. Simon, H.A., & Ridley, C.E. (1938). Trends in municipal reporting. Public Opinion Quar-

terly, 2(3), 465–468. Sinclair, A. (1995). The chameleon of accountability: Forms and discourses. Accounting,

Organizations and Society, 20(2/3), 219–237. Skitka, L.J., Mullen, E., Griffin, T., Hutchinson, S., & Chamberlin, B. (2002). Dispositions,

scripts, or motivated correction? Understanding ideological differences in explanations for social problems. Journal of Personality and Social Psychology, 83(2), 470–487.

Smiley, M. (1992). Moral responsibility and the boundaries of community: Power and accountability from a pragmatic point of view. Chicago: University of Chicago Press.

Sørensen, A.B. (1998). Theoretical mechanisms and the empirical study of social pro- cesses. In P. Hedström & R. Swedberg (Eds.), Social mechanisms: An analytical ap- proach to social theory (pp. 238–266). Cambridge: Cambridge University Press.

Spira, L.F. (1999). Ceremonies of governance: Perspectives on the role of the audit com- mittee. Journal of Management & Governance, 3(3), 231–260.

Stinchcombe, A.L. (2001). When formality works: Authority and abstraction in law and organizations. Chicago: University of Chicago Press.

Stoler, A.L. (2002). Colonial archives and the arts of governance. Archival Science, 2(1/2), 87–109.

Sykes, G.M., & Matza, D. (1957). Techniques of neutralization: A theory of delinquency. American Sociological Review, 22(6), 664–670.

Tata, J. (2000). Implicit theories of account-giving: Influence of culture and gender. Inter- national Journal of Intercultural Relations, 24(4), 437–454.

Tavuchis, N. (1991). Mea culpa: A sociology of apology and reconciliation. Stanford: Stanford University Press.

Tetlock, P.E. (1980). Explaining teacher explanations of pupil performance: A self-presen- tation interpretation. Social Psychology Quarterly, 43(3), 283–290.

Tetlock, P.E. (1983a.) Accountability and complexity of thought. Journal of Personality and Social Psychology, 45(1), 74–83.

Tetlock, P.E. (1983b). Accountability and the perseverance of first impressions. Social Psychology Quarterly, 46(4), 285–292.

Tetlock, P.E. (1985). Accountability: A social check on the fundamental attribution error. Social Psychology Quarterly, 48(3), 227–236.

Tetlock, P.E. (1991). An alternative metaphor in the study of judgment and choice: People as politicians. Theory & Psychology, 1(4), 451–475.

416 PPMR / March 2005

Tetlock, P.E., & Boettger, R. (1989). Accountability: A social magnifier of the dilution effect. Journal of Personality and Social Psychology, 57(3), 388–398.

Tetlock, P.E., & Kim, J.I. (1987). Accountability and judgment processes in a personality prediction task. Journal of Personality and Social Psychology, 52(4), 700–709.

Tetlock, P.E., Skitka, L., & Boettger, R. (1989). Social and cognitive strategies for coping with accountability: Conformity, complexity, and bolstering. Journal of Personality and Social Psychology, 57(4), 632–640.

Thompson, F.J., & Riccucci, N.M. (1998). Reinventing government. Annual Review of Political Science, 1(1), 231–197.

Thompson, J.R. (2000). The dual potentialities of performance measurement: The case of the social security administration. Public Productivity & Management Review, 23(3), 267–281.

Tietge, D.J. (1998). The role of Burke’s four master tropes in scientific expression. Avail- able at www.siu.edu/departments/english/acadareas/rhetcomp/burke/tietge.html, ac- cessed December 15, 2004.

Tilly, C. (2001). Mechanisms in political processes. Annual Review of Political Science, 4(1), 21–41.

Townley, B. (2001). The cult of modernity. Financial Accountability and Management, 17(4), 303–310.

Trebilcock, M.J., & Iacobucci, E.M. (2003). Privatization and accountability. Harvard Law Review, 116(5), 1422–1453.

Trondal, J. (1999). Unpacking social mechanisms: Comparing social constructivism and organization theory perspectives. ARENA Working Papers, WP 99/31. Available at www.arena.uio.no/publications/wp99_31.htm, accessed on December 15, 2004.

Trondal, J. (2001). Is there any social constructivist-institutionalist divide? Unpacking so- cial mechanisms affecting representational roles among EU decision-makers. Journal of European Public Policy, 8(1), 1–23.

Turner, J.H. (2002). Face to face: Toward a sociological theory of interpersonal behavior. Stanford: Stanford University Press.

U.S. House of Representatives. (2002, September 19). Testimony of Mitchell E. Daniels, Jr., Director, Office of Management and Budget, before the House Subcommittee on Government Efficiency, Financial Management and Intergovernmental Relations and the House Subcommittee on Legislative and Budget Process. Available at www.whitehouse.gov/omb/legislative/testimony/daniels_part091902.html, accessed on December 15, 2004.

Van de Walle, S., & Bouckaert, G. (2003). Public service performance and trust in govern- ment: The problem of causality. International Journal of Public Administration, 26(8/ 9), 891–914.

van den Berg, A. (1998). Is sociological theory too grand for social mechanisms? In P. Hedström & R. Swedberg (Eds.), Social mechanisms: An analytical approach to so- cial theory (pp. 204–237). Cambridge: Cambridge University Press.

Virtanen, T. (1997). Financial autonomy and accountability of public managers. Leuven, Belgium: European Group of Public Administration: Permanent Study Group 4, Qual- ity and Productivity in the Public Sector. Available at www.valt.helsinki.fi/vol/tutkimus/ julkaisut/verkko/autonomy.htm.

Waldman, D.A. (1994). The contributions of total quality management to a theory of work performance. Academy of Management Review, 19(3), 510–536.

Wang, X. (2002). Assessing administrative accountability: Results from a national survey. American Review of Public Administration, 32(3), 350–370.

Waterman, R.W., & Meier, K.J. (1998). Principal–agent models: An expansion? Journal of Public Administration Research and Theory, 8(2), 173–202.

Dubnick / ACCOUNTABILITY AND THE PROMISE OF PERFORMANCE 417

Watt, P., Richards, S., & Skelcher, C. (2002). Briefing paper: Accountability. Belfast: Re- view of Public Administration in Northern Ireland.

Webber, C., & Wildavsky, A. (1986). A history of taxation and expenditure in the Western world. New York: Simon & Schuster.

Weick, K.E. (1983). Stress in accounting systems. Accounting Review, 58(2), 350–369. Wholey, J.S. (2001). Managing for results: Roles for evaluators in a new management era.

American Journal of Evaluation, 22(3), 343–347. Williams, B.A.O. (1993). Shame and necessity. Berkeley: University of California Press. Zakaria, F. (2003). The future of freedom: Illiberal democracy at home and abroad. New

York: W.W. Norton. Zuboff, S. (1988). In the age of the smart machine: The future of work and power. New

York: Basic Books.

Melvin Dubnick is a professor of political science and public administration at Rutgers University–Newark and a Senior Research Fellow in the Institute of Gov- ernance, Public Policy, and Social Research at Queen’s University, Belfast. His primary research interests are in the areas of accountability, governance, and civic education.

PERFORMANCE MEASUREMENT.pdf

PERFORMANCE MEASUREMENT, ACCOUNTABILITY, AND TRANSPARENCY OF BUDGETS AND FINANCIAL REPORTS

JAMES MELITSKI Marist College AROON MANOHARAN Kent State University

ABSTRACT

In an age of global public cutbacks and talks of austerity, public managers are wary of publishing performance data online. Yet, public organizations are using information technology to measure and manage their performance now more than ever. At the same time, communities that engage citizens online and report performance information are more accountable to the public and build public trust. This paper examines the link between performance reporting and financial decision-making by analyzing award winning financial reports and budget reports identified by the Government Finance Officers Association in 2009. Drawing on the Governmental Accounting Standards Board’s (GASB) criteria for performance reporting, a rubric is applied to both public budget and public financial reports. Second, a data dictionary or lexicon for performance measurement is developed and applied to the same documents to determine the extent to which the documents address performance measurement. Lastly, the relevance of performance reporting is examined in both planned and actual expenditures by comparing the budget and financial reports.

Keywords: Performance reporting, budget reports, performance measurement, e-government, public reporting.

INTRODUCTION The link between organizational performance and policy

decisions that allocate resources are often difficult to assess. Public administrators understand that evaluating the performance of public agencies is difficult to measure quantifiably, and the incremental nature of public policy, as well as the budgeting

PAQ SPRING 2014 39

!

processes makes the link between the evaluation of agency performance and the allocation of future resources difficult. Further, public administration scholars have long struggled with chicken-and-egg dilemmas of social conditions and government expenditures. Do crime-rates provide a rationale for police spending? Does the employment rate reflect the performance of departments of labor? In other words, is it appropriate or even possible to apply rational public policy models to the outcome measurement process that reflects both agency performance and broader socio-economic conditions?

The discussion is further complicated in times of economic and social distress, as outcome indicators such as unemployment and income levels consistently decline. A recent review of performance data published by the City of New York indicates that 204 of the city’s 519 performance indicators are currently declining (http://www.nyc.gov/html/ops/cpr/html/home/home.shtml). In an era when socio-economic outcome indicators are in decline, how are policy makers to integrate the information into their decision making process. What is the appropriate level of resource allocation when outcome indicators spanning multiple agencies decline?

Such dilemmas inhibit public officials from effectively integrating objective performance data into public budget and financial decisions on a regular basis. However, an inability to bring performance information into the financial planning and analyses processes should not stop public administrators from attempting it. Without data on the performance of their agencies, policy makers cannot effectively make informed decisions, rendering any hope of continuous improvement impractical. Furthermore, accurate, timely and historically comparable performance data is vital to managers as they seek to hold their agencies accountable to the public.

This paper assesses budget and financial reports in U.S. states to determine the extent to which they integrate performance data into their publicly available reports. First, we examine relevant literature in performance reporting. The paper then assesses budgets and popular annual financial reports in U.S. states to determine the extent to which they integrate

40 PAQ SPRING 2014

performance data. We employ two complementary methodologies to conduct the content analysis. Drawing on the Governmental Accounting Standards Board’s (GASB) criteria for performance reporting, a rubric is applied to both public budget and public financial reports. Second, a data dictionary or lexicon for performance measurement is developed and applied to the same documents to determine the extent to which the documents address performance measurement. Lastly, the relevance of performance measurement is examined in both planned and actual expenditures by assessing budget and financial reports.

LITERATURE REVIEW

Transparency, responsiveness and citizen engagement

are common themes among public management scholars in performance measurement, e-government, as well as, public budget and finance. Open government has become a common trope of recent political actions; the public, especially in the remnants of the Great Recession, demands greater understanding of where their tax dollars go. Polls conducted by Gallup from 2001 to 2012 reveal that over 65% of the population considers economic issues to be the most important problem facing the United States (http://www.gallup.com/poll/1675/most-important- problem.aspx). Until recently, few recognized the connection between technology, finance and performance, which all espouse the similar goals of engaging citizens and allowing policy makers to hold agencies accountable for productivity improvement (Justice et al., 2006). Indeed, there is a paradox associated with using outcome data as a basis for making decisions about future resource allocations. As Kasdin (2010) points out, rational responses to declines in outcome measures can involve both increases and decreases in agency funding levels. For example, if job growth declines, a rational response for policy makers is to increase funding for the Department of Labor due to need. Yet, a second rational response for decreasing funding because the agency is not fulfilling its mission is also reasonable. In sum, reasoned arguments can be made for both increasing and decreasing agencies’ funding based

PAQ SPRING 2014 41

!

on poor performance. As an alternative, some scholars argue that the more appropriate use for performance information is to inform the budgeting process rather than mandate particular decisions (Aristigueta & Justice, 2006). In other words, performance measurement is best used as a management tool as opposed to a method for allocating budgets (Joyce, 1993; Melkers & Willoughby, 1998).

Performance measurement advocates suggest that building systems for reporting objective metrics is an essential component of public management (Ammons, 1995; de Lancer Julnes & Holzer, 2001; Poister, 2010; Poister & Streib, 1999; Wholey & Hatry, 1992; Yang & Holzer, 2006). Movements to link budgeting and performance have arisen since the Hoover commission in 1947 (Howard, 1973; Rubin, 1997). In the 1960s and 1970s federal efforts were difficult to sustain. Budget reforms like zero based budgeting gained popular favor and performance budgeting was viewed as difficult to quantify and were unwieldy time consuming (Jordan & Hackbart, 1999; Lee & Johnson, 1994).

In the 1990s, performance budgeting was rediscovered as a part of the reinventing government movement and the Government Performance and Results Act (GPRA) of 1993. GPRA requires federal agencies to submit performance data along with budget requests and reinvigorated the performance budgeting movement (Jordan & Hackbart, 1999; Roth, 1992). As a result, global reinvention efforts in the field of public administration have included both performance measurement and performance budgeting (Gilmour & Lewis, 2006; Kettl, 2000).

At the state level, performance budgeting has become a common tool for policy makers. For example, a study in 1980s found performance measurement a useful and popular tool in 31 of the 50 U.S. states (Botner, 1985). However, several state level analyses failed to demonstrate a link between performance measurement, spending, staffing, and valid metrics (Connelly & Tompkins, 1989; Jordan & Hackbart, 1999; Lauth, 1985). Despite concerns about direct applicability of performance measurement in the budgeting process, performance budgeting

42 PAQ SPRING 2014

has been widely adopted (Gilmour & Lewis, 2006; Schick, 1990).

In 1998, Melkers and Willoughby began studying states with legislated performance measurement mandates and found that 47 of 50 states had some form of performance budgeting in place (Melkers & Willoughby, 1999, 2001). By 2009, a study of U.S. States indicates that 39 states integrated performance systems into their public budgeting processes (Lu, Willoughby & Arnett, 2009). Of the 39 states with integrated performance systems, 19 have performance portals or centralized online depositories for performance data (Yi & Willoughby, 2011). It is also worthy of note that public organizations are using the Internet and social media technologies as a means for engaging citizens and improving trust by making government more transparent and reporting on their performance, budgets and expenditures.

A significant factor in determining the success of performance budgeting is the performance measures/information itself. In a study on performance information in 1984, MacManus reported that more than 80 percent of public performance reports did not provide measures of effectiveness or efficiency. According to her, without proper linking between inputs and outputs, any changes in budgets would lack justification and are influenced by political favoritism. Based on a survey of 205 city budget directors, Moore found that more than 76 percent of the budget directors considered lack of performance information as a problem with more than half of them considering it as a serious problem (Grizzle, 1986). More recently, Ho & Ni (2005) found many of the largest cities in the United States reporting both outcome and output measures online, as well as integrating performance measurement and reporting with strategic planning and goal-setting.

In addition to the performance measurement and budgeting efforts, the performance reporting movement in the United States has its roots in the public reporting efforts, which began during the early half of the twentieth century. The New York Bureau of Municipal Research is recognized as an early exemplar in making public information accessible to the public in understandable formats (Jones, Scott, Kimbro & Ingram,

PAQ SPRING 2014 43

!

1985; Kahn, 1997). Public reporting is an act by the government to ensure an informed citizenry. According to Lee, public reporting relates to managerial initiatives for systematic transparency covering and regularly informing the public about government operations, thereby promoting an informed citizenry (2004a). Gradually, reporting began to assume a narrower role of informing the public on the performance of the public sector agencies and was considered necessary for the government to be accountable to the public. Lee states that early public reporting movements justified reporting on the basis that transparency, accountability, and effective management are facilitated by public reporting and these movements were seized upon as effective strategies and an essential foundation for good government in democratic societies (2004a). Yet, as the public reporting movement matured, it went beyond an accountability tool to the public; as some scholars during this period also hinted at public reporting as a tool of control. Further, performance measurement falls into Dubnick’s (2005) accountability paradox as it represents both a tool for quantifiably measuring manager performance toward the achievement of program outputs, while also addressing the larger qualitative issue of ensuring that public agencies serve the public interest. As a result, reporting of public performance seeks to achieve the goal of enhancing public trust in a time of sustained decline. Additionally, some ambitious candidates for public office seize upon public reports as a means of critiquing incumbents, threatening executive sponsorship of public reporting. As a result, public agencies are often reluctant to publish reports that showed any declines in the performance of public agencies. Recently, however, the growing emphasis of citizen participation and citizen engagement has rejuvenated the phenomenon of public performance reporting in the United States (Caddy & Vergez, 2004).

Isenmann, Bey & Welter (2007) argue that online reporting allows stakeholders to engage in a rich, personalized, and sophisticated interaction with information that facilitates greater understanding of the data. Online reporting also improves the quality of information and makes it more accessible to citizens (Holliday & Kwok, 2004; Scavo & Shi,

44 PAQ SPRING 2014

1999). Applying e-government literature to performance reporting indicates that online reporting can inform managerial decisions, help frame policy deliberations and engage the public (Chadwick & May, 2003). Moreover, Holzer et al. (2004) hypothesize that online interactions between citizens and government improves transparency and builds public trust.

In addition, online reporting leverages government technology and enables effective communication and reporting to citizens by allowing ubiquitous access 24 hours a day, 7 days a week. Often, governments utilize their websites to publish results of their performance measurement systems in the hopes of strengthening accountability through transparency. Lee defines e-reporting as “the administrative activity that uses electronic government technology for digital delivery of public reports that are largely based on performance information. E- reporting is a tool of e-democracy that conveys systematically and regularly information about government operations that is valuable to the public at large, in order to promote an informed citizenry in a democracy and accountability to public opinion” (2004b, p. 11). Public reporting of performance measurement data has its own distinct history. In 1994, the Governmental Accounting Standards Board (GASB) released the “Concepts Statement No.2 on Service Efforts and Accomplishments (SEA) Reporting,” stating that performance information needs inclusion in general purpose external financial statements. The recommendation further emphasizes the need to link performance measures with financial reporting. A significant statement by GASB, the report established the need for linking performance information to the allocation of resources, and it institutionalized performance measurement and reporting as an integral part of the financial reporting process (GASB, 2003). To achieve this objective, GASB proposed three broad categories and outlined sixteen criteria to guide the development of external performance reports, based on a series of discussions among managers, academics and other practitioners. The first such report, Reporting Performance Information: Suggested Criteria for Effective Communication (2003) presented various techniques to convey the efforts, challenges, approaches, and successes

PAQ SPRING 2014 45

!

associated with delivering public services. GASB standards established three goals for performance

reports: First, GASB requires an “External Report on Performance Information.” In essence, this requirement stipulates that performance reports need clear organization. To measure this goal, the report lays out criteria 1-7, which examine the purpose and scope of the report, and whether major goals are stated and established by key stakeholders. Meeting this goal requires multiple levels of reporting, and entails a macro-level analysis of results, challenges and key strategic performance measures.

The second GASB goal for performance reporting outlines “what performance information to report” in criteria 8- 14. To fulfill this goal, reports must conduct a detailed examination of performance information given in a report. For example, these criteria require that performance reports measure relevant metrics, examine resources used, efficiency, citizen perspectives, the availability of comparison data, factors that might affect the results, whether the information is aggregated or disaggregated and the consistency of the methodology used to collect the performance data.

Finally, GASB examines how well the performance data is communicated in its final category dubbed, “communication of performance information” which is measured in the final two criteria (15 and 16). These criteria measure accessibility and clarity of the report as well as whether the information in the report is collected regularly. Figure 1, below, lists a summary of the 16 GASB criteria for preparing performance reports.

46 PAQ SPRING 2014

Figure 1 GASB Criteria for Performance Reporting 1. Purpose and Scope: Highlights what the report aims to communicate to users along with a listing of the programs and departments that are covered in the report. 2. Statement of Major Goals and Objectives: Identifies the goals and the objectives of the report and explains the source of these goals and objectives. 3. Establishing Goals and Objectives: Determines if the stakeholders who are involved in selecting the goals and objectives are listed and the extent of their involvement. 4. Multiple Levels of Reporting: Determines if the report is able to guide specific users to their required performance information. 5. Analysis of Results and Challenges: Checks if the report contains the management’s perspective on the performance results and also discusses the major challenges faced. 6. Focus on Key Measures: Ensures that the report identifies key measures of performance and determines how these measures guide citizens to decision making. 7. Reliable Information: Checks the reliability and relevancy of the performance data. 8. Relevant Measures of Results: Determines the extent to which performance results are linked to the goals, statements of the program in the report.

9. Resources Used and Efficiency: Determines if the financial input into the program is linked to the output of the services in terms of effectiveness and efficiency measures. 10. Citizen and Customer Perspective: Examines citizens’ opinion/perception with the performance results and compares it to that of the management of the agency. 11. Comparisons for Assessing Performance: Checks for any comparative analysis with respect to established targets and other departments. 12. Factors Affecting Results: Identifies external and internal factors that affect the performance measurement process. 13. Aggregation and Disaggregation of Information: Ensures that the performance information is aggregated or disaggregated appropriately. 14. Consistency: Studies the methodology utilized in collecting the performance results and checks for changes introduced in the measures. 15. Easy to Find, Access and Understand: Measures the availability, accessibility of performance reports and how it can be identified. 16. Regular and Timely Reporting: Identifies the time period of performance reporting.

For the purposes of this research, we re-name the three GASB goals as follows: 1. Organization of Report (1-7); 2. Performance Information (8-14); and 3. Communication and Contact Information (15-16). We assess the three goal categories

PAQ SPRING 2014 47

!

and evaluate the 16 criteria using a rubric for assessing the extent to which different reports address performance information. By using these criteria, governments in the United States and abroad can utilize information and communication tools to the full potential in providing public information and services online to their residents. Besides the promise of improving the efficiency and effectiveness of public service delivery, performance reports available online draw on the benefits of e-government, which espouses to enhance government accountability by expanding public access to information.

RESEARCH METHODOLOGY AND ANALYSIS

To assess the impact of public performance data on budget and financial decisions, this research examines popular annual financial reports (PAFRs) and budget reports from U.S. states and assesses the extent to which they address performance. A purposive sample was identified using the Government Financial Officers Association’s annual award program for exemplar budgets and PAFRs. As a nonprobability sample, the documents represent best practices, and as such, it is expected that they exemplify performance reporting in budgeting and popular annual financial reports. The purposive sampling technique, analyzed 17 documents (budget reports and PAFRs) identified as exemplars by the Government Financial Officers Association (GFOA). The PAFR Awards Program was established by the GFOA in 1991 to motivate state and local governments to utilize performance information from their comprehensive annual financial reports (CFARs) and publish PAFRs that are easily understandable by the public. The state and local government that are considered for best practices in PAFRs should have either have received the GFOA’s Certificate of Achievement for Excellence in Financial Reporting for the comprehensive annual financial report (CAFR) of the previous year or 2) ultimately receive the GFOA’s Certificate of Achievement for Excellence in Financial Reporting for the current year. The evaluation process involves five categories with varying weights of importance – reader appeal (10%), understandability (25%), distribution methods (7.5%) and other

48 PAQ SPRING 2014

(such as creativity, notable achievement) (7.5%) and the remaining 50% for the overall quality and usefulness of the report. Similarly, the Distinguished Budget Presentation Award Program was established by GFOA in 1984 to guide state and local governments in preparing high quality budgets and also involves the guidelines of the National Advisory Council on State and Local Budgeting (GFOA).

In 2010, GFOA identified eight state budgets as exemplars through their “Distinguished Budget Award” program. The budgets were prepared in 2009, and they typically cover the 2010-2011 fiscal year. Budgets analyzed are from the following states: Pennsylvania, Illinois, Tennessee, Massachusetts, Ohio, New Jersey, West Virginia, plus Washington, DC. The second set of documents examined were again identified by GFOA in 2010. GFOA recognized a total of nine state governments for their “Distinguished Popular Annual Financial Report.” The PAFRs were typically prepared in 2009, covering the previous fiscal year (2008-2009). The nine PAFRs analyzed are: Illinois, South Carolina, Nevada, North Carolina, New Hampshire, New York, Idaho, Virginia, plus Washington DC.

Methodologically, two techniques were applied to each of the 17 documents. First, a content analysis was conducted using a rubric that operationalizes the GASB 16-point performance reporting standards. The content analysis employed a double blind review process to ensure reliability. As is customary in qualitative research, when reviewers did not agree on a report’s score, the report was reexamined and a consensus was reached (Miles and Huberman 1984). The performance reporting rubric contains 40 dichotomous measures that were applied to each budget. The resulting analysis evaluates each budget on a scale of 0-40, using a dichotomous scale of 1 and 0, representing the presence or absence of each feature. Next, a lexical analysis was conducted on each document using a dictionary of performance keywords.

The first step in conducting the lexical analysis is developing a data dictionary of performance reporting terms from practitioner articles, public reports and the academic literature. To develop the performance dictionary twenty-two

PAQ SPRING 2014 49

!

documents were identified from between 1978 and 2010 (appendix A). The documents were analyzed using the qualitative research software, YoshiKoder, to determine the most commonly used words. The software identified more than 25,000 words used across the 22 performance documents. The authors used an iterative process to identify a list of the 47 most frequently used terms that indicate a document’s emphasis on performance.1

RESULTS AND ANALYSIS

After creating the dictionary of performance terms, the

relative frequency of performance term usage across the 17 budgets and PAFRs was calculated. The analysis identifies between 15,000 and 20,000 distinct terms in both the budgets and PAFRs. This section assesses the results of the computer generated lexical analysis and the traditional content analysis performed by researchers using a rubric. Below, figure 2 shows the relative frequency of keywords from the performance dictionary among the nine budget documents.

States with the highest usage of performance terms from the performance dictionary in their budget reports were Tennessee and Ohio, which used performance terms of more than 8.7 and 8.4 per thousand words respectively. The lowest was New Jersey, which used a performance term 2.1 times per thousand words. The state of Ohio’s Office of Accountability and Results coordinated the performance measurement process among the various agencies and enabled tracking of the performance measures through the http://results.ohio.gov website. In Ohio, various state agencies also have performance contracts with the Governor, referred to as Flexible Performance Agreements, that require directors to track and report key performance measures. Tennessee uses a slightly different model whereby the individual agencies are expected to submit a strategic plan along with a performance-based budget, based on the guidelines of the Governmental Accountability Act, which are reviewed by the Commissioner of Finance and Accountability.

50 PAQ SPRING 2014

Figure 2 Lexical Analysis of Budget Documents

Table 1 below represents the score of each of the ten budget documents analyzed using the performance rubric based on the GASB 16-point criteria. The content analysis results are similar to that of the lexical analysis. The top four states in the lexical analysis (TN, OH, IL, MA) fared well in the traditional content analysis. However, the content analysis shows the budget reports for Pennsylvania and Washington, DC as most comprehensive in their integration of performance measurement into the budget process. Interestingly, Pennsylvania and Washington DC represent the two longest budget reports at 1,072 and 3,907 pages, respectively. By comparison, if we remove these two outliers, the average length of the remaining budget documents is 486 pages per report. Despite the use of relative frequency measures, the size of the Pennsylvania and Washington, DC budgets may prevent the lexical analysis from adequately analyzing their content. This suggests that size may be a factor in conducting the lexical analysis. Excluding Washington DC and Pennsylvania, both the lexical analysis and the traditional content analysis identify West Virginia and New

PAQ SPRING 2014 51

!

Jersey as the states that least incorporate performance information. Not surprisingly, these documents were the two smallest budget reports analyzed. Table 1 Content Analysis of Budget Reports

State 1 2 3 Total

DC Score 13.000 14.000 4.000 31.000 z-score 1.684 1.397 0.540 1.510 PA Score 10.000 11.000 4.000 25.000 z-score 0.561 0.776 0.540 0.722 IL Score 10.000 10.000 4.000 24.000 z-score 0.561 0.569 0.540 0.591 TN Score 8.000 11.000 4.000 23.000 z-score -0.187 0.776 0.540 0.460 MA Score 9.000 5.000 4.000 18.000 z-score 0.187 -0.466 0.540 -0.197 OH Score 7.000 4.000 4.000 15.000 z-score -0.561 -0.672 0.540 -0.591 NJ Score 4.000 1.000 3.000 8.000 z-score -1.684 -1.293 -1.620 -1.510 WV Score 7.000 2.000 3.000 12.000 z-score -0.561 -1.086 -1.620 -0.985 Average 8.500 7.250 3.750 19.500 Stdev 2.673 4.833 0.463 7.616 Number of Metrics 16 19 5 40

1 – Organization of Report 2 – Performance Information 3 – Communication and Contact

Further, Table 1 shows the greatest variation in the second goal category “Performance Information.” This manifests as two distinct models for incorporating performance information into state budgets. The first descriptive model allows states to describe their performance measurement initiatives, without integrating performance data into the budget.

52 PAQ SPRING 2014

The second integrative model, involves a traditional performance budget, whereby state budget tables either incorporate specific outcome measures or a separate table of outcome measures is included in the budget following agency budget tables.

Among the exemplars studied in this research, several of the states using the first descriptive model included excellent citizen’s guides that discuss the extent to which performance measurement is used in the budget process. However, despite narrative descriptions of the performance measurement process, many states do not amalgamate performance data into their budget reports. As such the first model demonstrates that while performance information may be collected and analyzed, it is not directly integrated into the budgetary decision making process. This led to the high amount of variation in assessing performance information available in the report.

Pursuant to the first model of describing statewide performance measurement processes, several states provide links in their budgets directly to performance portals designed specifically for measuring state agency performance. For example, the Ohio and Massachusetts budget reports both contain links to external performance measurement sites. The Massachusetts performance measurement site, MassGoals, is an excellent performance measurement site; however, there is no way of knowing the extent to which it is used by policy makers to inform budget decisions. The Ohio budget report represents a hybrid approach in that while it includes a link to external performance initiative, the report contains a departmental narrative, which often includes broad highlights and some performance measures.

The second integrated model is a more traditional performance budget, where the budget report contains a separate section for each department including a narrative description of its mission and key goals followed by its budget request for the year. In Illinois, the narrative sections included key strategic objectives, and a few performance measures, but this information was often inconsistent. The reported performance measures compare across years, along with projected performance levels for FY 2010. In a typical performance budget format, specific performance measures, metrics, or benchmarks are reported after

PAQ SPRING 2014 53

!

the budget tables. In the best cases such as Washington, DC and Pennsylvania, these tables of performance data include historical data and goals.

It is also worth noting that using the performance- reporting rubric on budgets is problematic. For example, the section that assesses a report’s conclusion is difficult to apply to state budgets, which often do not have a formal conclusion. The typical format for a state budget includes a narrative, including a message from the governor, followed by statements of revenue forecasts followed by departmental and capital budget needs for the upcoming year in tabular format. Finally, given the time period of the documents, it is understandable that many of the budgets describe a poor economic climate as an external rationale for potential performance declines in the future. Determining the extent to which these describe outcome measures for state governments is challenging. For example, some states report demographic changes in their regions and related issues such as housing, credit, employment and their potential impact on the state finances. The reports of Pennsylvania and Tennessee discuss the major performance related challenges to the organization in achieving its mission/goals/objective.

While some states use socio-economic shifts as an indicator of public performance, few states discussed internal factors that may impact agency performance in the future. Given the reluctance of policy makers to report poor performance, this is hardly surprising. Finally, consistency of metrics over time is essential to comprehensive performance measurement, yet only the budgets of Pennsylvania and Washington, DC reported any changes in performance measures or methodology.

As our focus on performance measurement shifts from planning of future expenditures to actual expenses incurred, Figure 3 (below) shows the relative frequency of terms from the performance dictionary in 2008 Popular Annual Financial Reports (PAFRs). The keyword analysis shows Illinois as an outlier using performance terms nearly two times (1.97) for every 100 words. Rounding out the top four were Nevada at 5.07 performance terms per thousand, South Carolina at 4.8 performance words per thousand, and New Hampshire, which

54 PAQ SPRING 2014

used 4.48 key performance words for every thousand total words. Of the best practices identified by GFOA, New York and Virginia used the key performance terms least frequently with 1.88 and 1.06 key performance terms per thousand.

Figure 3 Lexical Analysis of PAFRs

Table 2 (below) reveals that the top four states identified in the traditional content analysis were Illinois (26), South Carolina (24), Nevada (19) and Washington, DC (18). Both the lexical keyword analysis and the traditional content analysis identify Illinois, South Carolina, and Nevada. Again, Washington, DC does not score well in the lexical analysis, while scoring highly in the traditional content analysis. Since the PAFRs represent citizen friendly financial narratives, most are considerably smaller than the budget documents. Again, document size may impact the results, as Illinois represented the longest PAFR at 294 pages. Removing Illinois as an outlier, the average size of the remaining PAFRs was 19.5 pages.

PAQ SPRING 2014 55

!

Table 2 Content Analysis of PAFRs

State 1 2 3 Total

IL Score 10.000 12.000 4.000 26.000 z-score 1.249 1.951 na 1.781 SC Score 11.000 9.000 4.000 24.000 z-score 1.699 0.806 na 1.330 NV Score 6.000 9.000 4.000 19.000 z-score -0.550 0.806 na 0.201 DC Score 7.000 7.000 4.000 18.000 z-score -0.100 0.042 na -0.025 NC Score 7.000 6.000 4.000 17.000 z-score -0.100 -0.339 na -0.251 NH Score 8.000 5.000 4.000 17.000 z-score 0.350 -0.721 na -0.251 NY Score 7.000 5.000 4.000 16.000 z-score -0.100 -0.721 na -0.477 ID Score 4.000 5.000 4.000 13.000 z-score -1.449 -0.721 na -1.154 VA Score 5.000 4.000 4.000 13.000 z-score -0.999 -1.103 na -1.154 Average 7.222 6.889 4.000 18.111 Stdev 2.224 2.619 0.000 4.428 Number of Metrics 16.000 19.000 5.000 40.000

1 – Organization of Report 2 – Performance Information 3 – Communication and Contact

Despite the outliers (Illinois and Washington, DC), both assessment techniques identified Nevada and South Carolina as states with exemplar PAFRs. Furthermore, both techniques identified Idaho, New York, and Virginia as documents in our sample that address performance measurement the least.

These results suggest several intriguing findings. First, the Illinois PAFR is unique as it was the only document to use

56 PAQ SPRING 2014

the GASB performance reporting format to structure its PAFR. While the Illinois PAFR is noteworthy for its comprehensiveness, its length suggests that it may not be as citizen friendly as other PAFRs, which are nearly one-tenth its length. The document does provide a good explanation of the GASB’s Service Efforts and Accountability (SEA) reporting standards, as part of the Public Accountability Project; however, the PAFR intended to discuss the program information from agencies ‘in detail.’ Also, many of the PAFRs, such as Virginia, include macro economic data such as employment data. While these are outcome measures for many state agencies, particularly those dealing with labor policies and economic development, they also represent general economic indicators, which assess the external economic environment. The use of such data is necessary but it would be helpful to demonstrate how the outcome measures relate to the performance of various agencies.

In other words, just because a PAFR mentions jobs created in the last fiscal year, it does not mean the PAFR effectively measures the performance of economic development initiatives. As with budget reports, the poor economic climate in 2008 and 2009, when most of the documents were written, allowed many states to discuss broad outcome measures in framing their economic climate in a state. Given the challenges associated with outcome measures identified in the literature review, it is not surprising that states were reluctant to link these external outcome measures with the performance of specific agencies.

In addition, the overall comprehensiveness of the performance information provided in the PAFRs is problematic. The focus of the PAFRs is appropriate financial information, and as a result, the performance information included tends to be cherry-picked to either show improvement or highlight agency accomplishments. In many cases, PAFRs list one table of performance information that, while interesting, is neither strategic nor comprehensive. For example, New Hampshire includes a table that compares the number of bridges and roads in need of repair compared with the number repaired in the previous fiscal year. While this is compelling performance information about the Department of Transportation, it falls short

PAQ SPRING 2014 57

!

of a strategic measure of performance for all of state government. Similarly, the Nevada PAFR is worthy of note for including a table of aggregate performance measures that includes historical data and goals for reducing highway fatalities, the percentage of state roads in fair or better condition, and high school graduation rates. While the performance information is informative, there is no indication that the measures are comprehensive or strategic.

Perhaps the most telling assessment in this research involves the comparison between the budgets and PAFRs. Intriguingly, both the lexical and traditional content analysis show a high degree of variation among the reports as indicated in Tables 1 and 2. The content analysis indicates that there was more variation among the PAFRs as compared to the budgets, while the traditional content analysis shows more variation among the budgets than in the PAFRs. Again, this may be attributable to the nature of the two methodologies. Further, the PAFRs tend to be designed with citizens in mind and GFOA has basic criteria for their evaluation. In contrast, there is no uniform format for budgets. As a result, the traditional content analysis detects less variation among the PAFRs. The lexical analysis may be more precise in its ability to detect key words, but does not detect the context provided by the narrative PAFRs, and as such, it identifies the language used in the budgets as more consistent.

As a result, both methodologies identified Illinois as having the PAFR with the most emphasis on performance measurement. Both this structure and the Illinois emphasis on performance in its PAFR, which by nature is designed to make financial data relevant to citizens, is worthy of note. Also intriguing was that the two methodologies yielded very different results for Washington DC. This finding speaks to the reliability of both techniques and more research is needed to examine the validity of the techniques. In particular, both content analysis techniques hold the potential for bias. Intercoder reliability and selection of the keywords must be reexamined in both techniques to ensure consistency and improved reliability.

Table 3 shows that on average the budgets had higher scores than the PAFRs in both the lexical and traditional content

58 PAQ SPRING 2014

analyses. The lexical analysis shows that the use of performance terms in budgets was 2% greater than in PAFRs; while the traditional content analysis shows that average scores of budgets were 7% higher than PAFRs. One reason for the difference may be that the standards for including performance information in PAFRs are less well-known. For e.g., examples of performance budgets are available, while there are fewer examples for adapting comprehensive annual financial reports into citizen friendly PAFRs that include strategic performance measures. Table 3 Average Scores for Lexical and Traditional Content Analysis

Lexical Analysis

Traditional Content Analysis

PAFR 0.00513 18.11111 Budget 0.00523 19.50000 Difference 0.00009 1.38889

Table 4 Standard Deviation of Budgets and PAFRs

1 2 3 Total

PAFR 2.224 2.619 0.000 4.428 Budget 2.673 4.833 0.463 7.616 Difference 0.449 2.214 0.463 3.187

1 – Organization of Report 2 – Performance Information 3 – Communication and Contact

Interestingly, there was less consistency in the scores of budgets compared with the PAFRs. Table 4 (above) shows the standard deviation of budget scores and PAFRs in the traditional content analysis. The high degree of variance in the performance information available in the budgets reinforce the narrative

PAQ SPRING 2014 59

!

description offered, above, that not all exemplar state budgets fully integrate performance information into their budgets. Despite the number of states mandating performance budgeting, often the process is not integrated into the budget or it is reported separately. Further, while there is more consistency and less variation among the PAFRs, overall comprehensiveness of these documents is still lacking.

CONCLUSION

Evaluating public performance requires consistent

longitudinal metrics. This study builds on existing research that aims to integrate performance measurement with budgeting and reporting efforts in government. Public agencies are continually challenged to measure performance consistently over time, and report the results, which are offered to citizens electronically using the Internet and increasingly social media. States must acknowledge both difficulties and benefits they incur when incorporating performance measurement results into budget and financial reporting processes for the purposes of improving decisions and informing citizens. Integrating performance data into budgeting and financial reporting ensures transparency, improves public trust, and holds agencies accountable. By their nature, fiscal reports explain the past expenditures, while budget reports look forward and represent the intent of public officials for the future. Perhaps the most significant finding in this research is the extent to which performance budgeting is incorporated into exemplar state budgets. This research demonstrates that while performance information is integrated into budgets, the extent to which it is involved in the planning process is less apparent. As statewide performance portals become more popular it is a challenge for states with performance budgeting mandates to include performance data in their budgets. Including performance data in state budgets allows for a historical comparison assessment of agency performance and goal setting for the future. States that fail to integrate performance data in their budgets and instead include a link to a statewide performance portal are in contradiction with

60 PAQ SPRING 2014

the ideals of performance budgeting. Further they risk violating the spirit, if not the letter, of performance budgeting mandates

The analysis of budget and financial reports through a performance measurement lens suggests that states may find it easier to report on performance as a function of the budget rather than in the context of previous expenditures. This is not to say that states do not address performance in financial reporting, but rather the standards and guidelines for states interested in integrating performance measurement into their budgets are more prevalent as compared to financial reporting. This represents both a weakness and an opportunity, as ghosts of performance budgeting pilots abound to inform current budget officers, while there are fewer examples of popular annual financial reports. Such obstacles should not discourage public administrators from effectively integrating objective performance data into public budget and financial reports on a regular basis.

Integrating performance reporting into budget reports online serves as a mechanism to build public trust. Internally, it serves as a mechanism for holding managers accountable for results and improves effectiveness of public service delivery. For policy makers, the link between performance measurement and policy decisions like budget allocation is less clear. Despite the opaque relationship between performance measurement and policy determinations, the integration of performance information into policy discourse like annual budget deliberations are necessary to inform and ground the process. Including performance measures in budget documents helps public administrators in budgetary decision-making and resource allocation based on the agencies’ performance and effectiveness. However, performance measures in budget documents should not just be directed towards the legislative members; they should also be addressed towards citizens in a readable format that enables them to understand how their tax dollars have been spent. Such public reporting can possibly be achieved by states through integrating performance measures into publically available PAFRs, rather than just budget documents. Moreover, performance measures need to be linked to strategic plans to provide a comprehensive perspective of the states’ performance.

PAQ SPRING 2014 61

!

None of the budgets analyzed in this research integrates strategic performance information across multiple departments. The lack of such an aggregated approach, which is sometimes referred to as a balanced scorecard or dashboard approach, is a weakness of even the best performance budgets.

Moving forward, states need to continue integrating performance information into both their budget and financial reports. In an era defined by decreases in the availability of public funding and in public trust, citizens need more, not less, information about the outcomes associated with both resources spent and also with planned expenditures of public funds. Moreover, this research emphasizes the relevance of GASB suggestions in providing a comprehensive standard for performance reporting among states as well as municipalities. Among those budget and financial reports evaluated, only the Illinois PAFR makes an attempt to follow the GASB suggestions. Although governments are not required to adhere to its standards, it is advised and generally agreed that these standards can produce decision-useful information that both informs the users of government financial reports and aids government officials in providing transparency, accountability, and stewardship evidence. Finally, with the adoption of e- government among state and local governments, there is a renewed expectation among citizen users to obtain relevant and appropriate performance information from government agencies. Based on the findings, many state budget reports included links that directed to performance portals designed specifically for measuring state agency performance. While the GPRA and the reinventing movement revived performance budgeting in the 1990s (Jordan & Hackbart, 1999; Roth, 1992), the combination of e-government and citizen participation has the potential to rejuvenate public performance reporting and strengthen the link between performance measurement and budgeting.

NOTES

1 The qualitative research software YoshiKoder was used to conduct the lexical analysis. The software was developed by

62 PAQ SPRING 2014

Identity Project at Harvard's Weatherhead Center for International Affairs (see www.yoshikoder.org for more details). 22 documents were analyzed to develop the performance dictionary. The analysis of documents yielded a list of over 25,000 distinct terms used in the performance documents. From the list of terms used, the authors each selected 50 key terms that indicates an emphasis on performance or performance measurement. The two lists were compared and a final list of key words was compiled by consensus. The final performance dictionary of 47 terms includes multiple variations of keywords (multiple tenses, plural usage) identified by the authors from the initial performance documents. For example, the terms: performance, perform, performs and performance-measures were all used as distinct terms in the performance dictionary. Using Yoshikoder, frequency and relative frequency (or proportional frequency) of key terms was identified in each of the 9 PAFR and 8 Budget reports.

REFERENCES

Ammons, D. N. (1995). Overcoming the inadequacies of performance measurement in local government: The case of libraries and leisure services. Public Administration Review, 55(1), 37-47.

Anon. (2003). Reporting performance information: Suggested

criteria for effective communication. GASB-CT. Norwalk.

Aristigueta, M. P., & Justice, J. B. (2006). Introduction to the

symposium: The status of performance budgeting. Public Performance & Management Review, 30(1), 7– 13.

Botner, S. B. (1985). The use of budgeting/management tools by

state governments. Public Administration Review, 45(5), 616-620.

PAQ SPRING 2014 63

!

Caddy, J., & Vergez, C. (2004). Citizens as partners: Information, consultation and public participation in policy-making. Paris: Organisation for Economic Co- operation and Development.

Chadwick, A., & May, C. (2003). Interaction between states and

citizens in the age of the Internet: ‘E-Government’ in the United States, Britain, and the European Union. Governance, 16(2), 271–300.

Connelly, M., & Tompkins, G. (1989). Does performance

matter? A study of state budgeting. Policy Studies Review, 8(2), 288-299.

Dubnick, M. (2005). Accountability and the promise of

performance: In search of the mechanisms. Public Performance & Management Review, 28(3), 376–417.

Government Finance Officers Association. (n.d.). Retrieved Oct

25, 2012 from GFOA, http://www.gfoa.org/index.php?option=com_content&ta sk=view&id=34&Itemid=55

Gilmour, J., & Lewis, D. (2006). Does performance budgeting

work? An examination of the Office of Management and Budget’s PART scores. Public Administration Review, 66(5), 742-752.

Grizzle, G. A. (1986). Does budget format really govern the

actions of budget makers? Public Budgeting & Finance, 6(1), 60–70.

Ho, A. T.K., & Ni, A. Y. (2005). Have cities shifted to outcome-

oriented performance reporting? - A content analysis of city budgets. Public Budgeting & Finance, 25 (2), 61– 83.

64 PAQ SPRING 2014

Holliday, I., & Kwok, R. C. W. (2004). Governance in the information age: Building e-government in Hong Kong. New Media & Society, 6(4), 549-570.

Holzer, M., Melitski, J., Rho, S. Y., & Schwester, R. (2004).

Restoring Trust in Government: The Potential of Digital Citizen Participation. E-government Series. Washington, DC: IBM Center for the Business of Government.

Howard, S. K. (1973). Changing state budgeting. Lexington,

KY: Council of State Governments. Isenmann, R., Bey, C., & Welter, M. (2007). Online reporting

for sustainability issues. Business Strategy and the Environment, 16(7), 487–501.

Jones, D. B., Scott, R. B., Kimbro, L., & Ingram, R. W. (1985).

The needs of users of governmental financial reports. Stamford: Government Accounting Standards Board.

Jordan, M., & Hackbart, M. (1999). Performance budgeting and

performance funding in the states: A Status Assessment. Public Budgeting and Finance, 19(1), 68–88.

Joyce, P. (1993). Using performance measures for federal

budgeting: Proposals and prospects. Public Budgeting and Finance Review, 13(4), 3-17.

Julnes, P. L., & Holzer, M. (2001). Promoting the utilization of

performance measures in public organizations: An empirical study of factors affecting adoption and implementation. Public Administration Review, 61(6), 693-708.

Justice, J. B., Melitski, J., & Smith, D. L. (2006). E-Government

as an instrument of fiscal accountability and responsiveness. The American Review of Public Administration, 36(3), 301-22.

PAQ SPRING 2014 65

!

Kahn, J. (1997). Budgeting democracy: State building and

citizenship in America. Ithaca, NY: Cornell Univ. Press. Kasdin, S. (2010). Reinventing reforms: How to improve

program management using performance measures. Really. Public Budgeting & Finance, 30(3), 51–78.

Kettl, D. (2000). The Global Public Management Revolution.

Washington, DC: Brookings Institute Press. Lauth, T. (1985). Performance evaluation in the Georgia

budgetary process. Public Budgeting & Finance, 5(1), 67-82.

Lee, M. (2004). Public reporting: A neglected aspect of nonprofit

accountability. Nonprofit Management and Leadership, 15(2), 169-185.

Lee, M., & IBM Center for the Business of Government. (2004).

E-reporting: Strengthening democratic accountability. Washington, DC: IBM Center for the Business of Government.

Lee, R., & Johnson, R. (1994). Public Budgeting Systems.

Gaithersburg, MD: Aspen Publishers, Inc. Lu, Y., Willoughby, K., & Arnett, S. (2009). Legislating results.

Public Performance & Management Review, 33(2), 266– 287.

MacManus, S. A. (1984). Coping with retrenchment: Why local

governments need to restructure their budget document formats. Public Budgeting & Finance, 4(3), 58-66.

Melkers, J. E., & Willoughby, K. G. (2001). Budgeters’ views of

state performance-budgeting systems: Distinctions across branches. Public Administration Review, 61(1), 54–64.

66 PAQ SPRING 2014

Melkers, J. E., & Willoughby, K. G. (1998). The state of the

states: Performance-based budgeting requirements in 47 out of 50. Public Administration Review, 66-73.

Miles, M., & Huberman, M. (1984). Qualitative data analysis: A

sourcebook of new methods. Beverly Hills, CA: Sage Publications.

Poister, T. H. (2010). The future of strategic planning in the

public sector: Linking strategic management and performance. Public Administration Review, 70, 246- 254.

Poister, T. H., & Streib, G. (1999). Performance measurement in

municipal government: Assessing the state of the practice. Public Administration Review, 59(4), 325-335.

Roth, W. (1992). Performance-based budgeting to enhance

implementation of the CFO Act. Public Budgeting and Finance, 12(4), 102-106.

Rubin, I. (1997). The politics of public budgeting: Getting and

spending, borrowing and balancing (3rd Ed). Chatham, NJ: Chathan House Publishers.

Scavo, C., & Shi, Y. (1999). World Wide Web site design and

use in public management. Public information technology: policy and management issues, 299–330.

Schick, A. (1966). The road to PPB: The stages of budget

reform. Public Administration Review, 243–258. Wholey, J. S., & Hatry, H. P. (1992). The case for performance

monitoring. Public Administration Review, 52(6), 604- 610.

PAQ SPRING 2014 67

!

Yang, K., & Holzer, M. (2006). The performance–trust link: Implications for performance measurement. Public Administration Review, 66(1), 114-126.

Yi, L., & Willoughby, K. (2011). Charting performance

reporting: The perspective of state governments. In, 24. Washington, DC, October 15.

68 PAQ SPRING 2014

Appendix A Articles and Reports used to generate performance dictionary: Ammons, D. N. 1995. “Overcoming the Inadequacies of

Performance Measurement in Local Government: The Case of Libraries and Leisure Services.” Public Administration Review 55(1).

Behn, R. D. 2003. “Why measure performance? Different purposes require different measures.” Public Administration Review 63(5): 586–606.

Berman, E., and X. H. Wang. 2000. “Performance measurement in US counties: Capacity for reform.” Public Administration Review 60(5): 409–420.

Dubnick, M. 2005. “Accountability and the promise of performance: In search of the mechanisms.” Public Performance & Management Review 28(3): 376–417.

Epstein, P. D., and W. Campbell. 2000. GASB SEA Research Case Study: Iowa. Government Accounting Standards Board-CT, Norwalk. Epstein, P. D., and W. Campbell. 2000. GASB SEA Research Case Study: Louisiana. Government Accounting Standards Board-CT, Norwalk. Fountain, J. 2000. GASB SEA Research Case Study: State of Oregon: A Performance

System Based on Benchmarks. Government Accounting Standards Board-CT, Norwalk.

Government Accounting Office. 2005. Performance Measurement and Evaluation: Definitions and Relationships. Washington, DC: U.S. General Accounting Office, May.

Hatry, H. P. 1978. “The status of productivity measurement in the public sector.” Public Administration Review 38(1): 28–33.

Hatry, H. P. 2006. Performance measurement: Getting results. Urban Inst Press.

Julnes, P. L., and M. Holzer. 2001. “Promoting the utilization of performance measures in public organizations: An empirical study of factors affecting adoption and implementation.” Public Administration Review 61(6): 693–708.

PAQ SPRING 2014 69

!

Kravchuk, R. S., and R. W. Schack. 1996. “Designing Effective Performance-Measurement Systems under the Government Performance and Results Act of 1993.” Public Administration Review 56(4).

Melkers, J., and P. Mhatre. 2002. Case Study: Wisconsin. Use and Effects of Using Performance Measures for Budgeting, Management and Reporting. Government Accounting Standards Board-CT, Norwalk.

Melkers, J., and K. Willoughby. 2005. “Models of Performance- Measurement Use in Local Governments: Understanding Budgeting, Communication, and Lasting Effects.” Public Administration Review 65(2): 180–190.

Morley, E., S. P. Bryant, and H. P. Hatry. 2001. Comparative performance measurement. Urban Inst Press.

Poister, T. H. 2010. “The Future of Strategic Planning in the Public Sector: Linking Strategic Management and Performance.” Public Administration Review 70: s246– s254.

Poister, T. H., and G. Streib. 1999. “Performance measurement in municipal government: Assessing the state of the practice.” Public Administration Review 59(4).

Tucker, L. 2000. GASB SEA Research Case Study: State Of Texas—Focus On Performance. Government Accounting Standards Board-

CT, Norwalk. Tucker, L., and W. Campbell. 2002. Case Study: Maine. Use and Effects of Using Performance Measures for Budgeting, Management and

Reporting. Government Accounting Standards Board- CT, Norwalk.

Van Thiel, S., and F.L. Leeuw. 2002. “The performance paradox in the public sector.” Public Performance & Management Review 25(3): 267–281.

Wholey, J. S., and H. P. Hatry. 1992. “The case for performance monitoring.” Public Administration Review 52(6): 604– 610.

Yang, K., and M. Holzer. 2006. “The Performance–Trust Link: Implications for Performance Measurement.” Public Administration Review 66(1): 114–126.

70 PAQ SPRING 2014

How key words were developed: 22 documents analyzed for key performance related terms. From the list of terms used, the authors each selected 50 key terms that indicates an emphasis on performance or performance measurement. The two lists were compared and a list of key words was generated. The final performance dictionary of 47 terms includes multiple variations of keywords (multiple tenses, plural usage) identified by the authors from the initial performance documents. Using Yoshikoder, frequency and relative frequency of key terms was identified in each of the 9 PAFR and 8 Budget reports.

Copyright of Public Administration Quarterly is the property of Southern Public Administration Education Foundation and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use.

Financial Accounting Research.pdf

MARY E. BARTH

Financial Accounting Research, Practice, and Financial Accountability

Financial accounting is essential to financial accountability, which is essen- tial to a prosperous society. There are many examples of how improve- ments to financial accounting, supported by research, have enhanced financial accountability. Such research requires a strong relation between accounting academics and practice; this relation has ebbed and flowed during the life of Abacus. The relation seems to ebb when accounting academics embrace related fields and flows when the relevance to account- ing practice emerges. Economics and finance have provided new perspec- tives and meaningful insights about the information investors need to make informed decisions. Regardless, there are many intriguing and open questions awaiting accounting research that can provide insights into how financial accounting—and thus financial accountability—can be improved. The future is bright for financial accounting researchers who do research relevant to accounting practice and want to contribute to a prosperous society.

Key words: Accounting practice; Capital markets; Financial accounting and reporting; Prosperous society.

The aim of this article is to reflect on the role of financial accounting research in supporting financial accountability—in its broadest sense—and offer ideas for future research that can continue this role.1 Abacus’s 50th anniversary is an opportune time to do this. As historian Jacob Soll chronicles in his book The Reckoning: Financial Accountability and the Rise and Fall of Nations (Soll, 2014), financial accounting is the foundation of a prosperous society.Throughout history, societies that kept a keen eye on financial accountability prospered, but those societies declined when finan- cial accountability was disregarded. The book makes clear that accountants, includ- ing accounting researchers, have a responsibility to ensure that financial accounting

Mary Barth ([email protected]) is Joan E. Horngren Professor of Accounting, Graduate School of Business, Stanford University. The author appreciates the helpful comments of William Beaver, Greg Clinch, Wayne Landsman, James Leisenring, Warren McGregor, and Katherine Schipper.

1 The Free Dictionary offers a broad definition of accountability as ‘The responsibility of the person or organization responsible for a task to take credit for all positive outcomes and blame for all negative outcomes.Accountability is desirable in finance and economics because it promotes efficiency. See also transparency.’ See http://financial-dictionary.thefreedictionary.com/Accountability.

bs_bs_banner

ABACUS, Vol. 51, No. 4, 2015 doi: 10.1111/abac.12057

499 © 2015 Accounting Foundation, The University of Sydney

is designed to deliver, and delivers, high-quality information that supports sound economic decision making and the efficient allocation of resources, and thereby supports a prosperous society.2

The relation between the accounting academy—and, thus, accounting research— and accounting practice has ebbed and flowed during the life of Abacus.3 When Abacus was founded, the relation was strong. Although the relation ebbed when capital markets research became central to much of financial accounting research, it flowed again once it became clear that lessons learned from capital markets research could inform what financial accounting information supports investors’ capital allo- cation decisions.4 With the maturity of capital markets research, the relation between accounting research and practice has ebbed again.This time, the recent expansion of accounting research to focus on topics such as the effects of physical characteristics of the conveyor, and the linguistic style, of accounting information rather than its content illustrates the weakening of the link between accounting research and practice. Although this expansion could enhance our knowledge of how aspects of the communication of accounting information affect its interpretation, there is much we do not yet know about the characteristics of the accounting information being conveyed. Thus, the future is bright for financial accounting researchers who wish to play a role in supporting financial accountability and, thus, a prosperous society.

ENHANCING FINANCIAL ACCOUNTABILITY

The academic accounting literature offers numerous examples of how financial accountability is enhanced with the availability of high-quality accounting informa- tion and how accounting research provides evidence relating to what information supports economic decision making. One example is pension accounting in the United States (US). Before the issuance of Statement of Financial Accounting Standard (SFAS) No. 36 by the US Financial Accounting Standards Board (FASB) (FASB, 1980), information relating to the funded status of a firm’s defined benefit pension plans—that is, pension plan assets and liabilities to employees under the plans—was not disclosed in financial statements. Thus, users of financial reports lacked information about these often sizable assets and liabilities, and were

2 See, also, the Accounting Vision Model developed by the Pathways Commission in 2014.The Pathways Commission reflects the joint efforts of the American Institute of Certified Public Accountants and the American Accounting Association (AAA). See http://commons.aaahq.org/hives/a943df3efc/summary. The Vision Model was developed to answer the question ‘What is Accounting?’ for those unfamiliar with the field. Although this Vision Model also applies to management and governmental accounting, this article focuses on financial accounting and reporting.

3 The term ‘accounting practice’ encompasses all arenas in which accountants outside of academia play a role. For example, accountants employed by firms, auditors, accounting standard setters, and regu- lators and other accounting policy makers.

4 Beaver and Dukes (1972, 1973) and Gonedes and Dopuch (1974) reveal differences of opinion among academics regarding the extent to which capital markets accounting research could address practice, particularly standard-setting, questions.

A BAC U S

500 © 2015 Accounting Foundation, The University of Sydney

hampered in their ability to make sound economic decisions (Landsman, 1986). SFAS 87 (FASB, 1985, now Accounting Standards Codification (ASC) 715) requires firms to apply accrual accounting to their defined benefit pension plans and disclose information about plan assets and liabilities, as well as components of pension cost. The progress relating to defined benefit pension plan accounting thereby mitigated a previous information deficiency (Barth, 1991; Barth et al., 1992). A related, and perhaps more visible, example is the accounting for, and disclosures related to, other post-employment benefit plans. Until the issuance of SFAS 106 (FASB, 1990, now ASC 712), firms had promised post-employment health care and other benefits without accounting for them (Amir, 1993). Investors had some information about these promises, which enabled them to make assumptions regarding the magnitude of these obligations. However, investors know less than the firm about its promises and, thus, the assumptions necessarily were based on incomplete information. Inter- estingly, once these off-balance sheet liabilities were recognized in financial state- ments, firms took action to reduce them (Fronstin, 2010).5

A third example is the accounting—or lack of accounting—for employee services paid for with the firm’s equity instruments, that is, share-based payment. Before International Financial Reporting Standard (IFRS) 2 (IASB, 2004b) and SFAS 123R (FASB, 2004, now ASC 718) the recognized expense was zero for employee services paid for using at-the-money share options with fixed terms even though investors viewed the cost of these options as an expense of the firm (e.g., Aboody, 1996; Aboody et al., 2004). Since firms have been required to recognize an expense based on the value of the options granted, rather than their intrinsic value, there has been a decline in the use of such options.6 Measuring and recognizing economic costs is a key role of financial accounting that can lead to greater financial accountability and more informed decisions.

A fourth example is the accounting for derivatives. Before the effective date of SFAS 133 (FASB, 1998, now ASC 815) and International Accounting Standard (IAS) 39 (IASB, 2004a), derivative assets and liabilities were measured at cost. The cost of many derivatives is zero and therefore, without subsequent re-measurement, these derivatives effectively were unrecognized. ASC 815 requires fair value measurement for derivatives. Using fair values for these instru- ments brought to light the enormity of some previously off-balance sheet assets and liabilities, which investors endeavoured to incorporate into their investment decisions (Venkatachalam, 1996).7

5 These post-employment benefits are covered by International Accounting Standard (IAS) 19 (IASB, 2001), originally issued by the International Accounting Standards Committee in 1998. The require- ments in IAS 19 are similar to those in ASC 712 and 715.

6 There may be other reasons for the secular decline in the use of stock options as a form of compen- sation, for example, changes in tax rates (Aboody and Kasznik, 2008). Nonetheless, the decline in striking—see, for example, Figure 1 of Irving et al. (2011).

7 Using fair values for derivatives does not provide investors with all of the information they need because fair values mask the leverage inherent in derivatives (Barth and Landsman, 2010).

F I NA N C I A L AC C O U N T I N G R E S E A R C H A N D P R AC T I C E

501 © 2015 Accounting Foundation, The University of Sydney

Yet another example is the accounting for asset securitizations, which was a focus of the recent financial crisis. The opaque and questionable accounting for these transactions was purported to be associated with the meltdown of the financial sector, which some allege was a cost of the lack of adequate accounting information required by ASC 860 and IFRS 7 (IASB, 2005; Barth et al., 2012). Most recently, fair value accounting for financial instruments (ASC 820;ASC 825; IAS 39, IASB, 2004a; IFRS 13, IASB, 2011) has been blamed for precipitating the recent financial crisis. However, claims that accounting and reporting for asset securitizations, special purpose entities, and fair value accounting played a role in the recent financial crisis is not supported by evidence (Barth and Landsman, 2010, 2013). Nonetheless, that accounting is alleged to have played a role in and of itself is testament to the perceived importance of accounting to well-functioning product and capital markets and, thus, to society’s prosperity.

These examples highlight the importance of financial accounting to society and the role research can play in providing evidence to support or refute what is believed to be true and in providing new insights into the potential shortcomings of current accounting as well as offering insights into potential improvements.There is need for more of this research—research employing the scientific method—and thought pieces based on integrating our collective knowledge.

RELATION BETWEEN ACADEMIA AND PRACTICE DURING ABACUS’S LIFE

Abacus was founded in 1965. Beginning one year later, 1966, the Australian profes- sional accounting bodies jointly operated the Australian Accounting Research Foun- dation (AARF), which ultimately encompassed both the Accounting Standards Board (AcSB) and the Public Sector Accounting Standards Board (PSASB).8

Accounting standards in the US were set by the Accounting Principles Board (APB) of the American Institute of Certified Public Accountants. The FASB was not formed until 1973, and the publication of the Conceptual Framework was not to come for another ten years. When Abacus began publication, the thinking in research and financial accounting practice was fairly closely aligned. Financial reporting research around this time was normative, with principles relating to the characteristics of measurement of assets, liabilities, and income argued from deduc- tive reasoning. This normative, deductive reasoning approach made the research readily accessible to accountants in practice not only because the language was familiar to practising accountants, but also because the approach did not use data analysis or mathematical techniques unfamiliar to them. Some thought leaders of the time were Edwards and Bell (1961), Chambers (1962, 1965, 1966), Moonitz (1961), Moonitz and Sprouse (1962), and Jaedicke and Sprouse (1965).

Research changed dramatically with the advent of capital markets-based research, together with its focus on accounting as generic information signals (Ball

8 See http://www.aasb.gov.au/About-the-AASB/For-students.aspx#qa1440 for further information on the history of accounting standard setting in Australia.

A BAC U S

502 © 2015 Accounting Foundation, The University of Sydney

and Brown, 1968; Beaver, 1968). The information perspective was not new to aca- demics (Graham and Dodd, 1934), but the advent of capital markets research provided a new impetus for embracing it. Although financial accounting standard setting did not embrace this change directly and immediately, not many years later a Conceptual Framework for financial reporting was developed that embodies an information perspective. This perspective is evident in the objective of financial reporting specified in the Framework, which is ‘to provide financial information about the reporting entity that is useful to existing and potential investors, lenders and other creditors in making decisions about providing resources to the entity’ (FASB, 2010; IASB, 2010 ¶OB2). The Framework also clarifies that the primary users of financial reports are those outside providers of capital who cannot otherwise demand the information they need to make their economic decisions (FASB, 2010; IASB, 2010 ¶OB5).

The Framework incorporates economic concepts. For example, it defines compre- hensive income as the change in net assets of the period, other than those attribut- able to transactions with equityholders in their capacity as equityholders. This definition resembles a Hicksian economic view of income as the change in wealth (Hicks, 1946).Although, at first, the focus on accounting’s information role in capital markets seemed distant from accounting’s traditional role in practice of recording and measuring the effects of the firm’s transactions, basing the Framework on an information perspective and economic concepts, in fact, brought academia and practice closer together.

Although the advent of capital markets research in the late 1960s initially seemed to drive a wedge between financial accounting research and practice, some research- ers used capital markets research to shed light on practice-motivated questions. This effort gave rise to ‘value relevance’ research, in which researchers test whether a particular accounting amount has a significant predicted relation with equity share prices or returns. Because share prices summarize investors’ consensus beliefs about the value of the firm’s equity, such a relation is evidence that the accounting amount is relevant to investors and sufficiently reliable to be reflected in share prices, which are the two primary characteristics of useful accounting information set forth in the Framework.9 Some researchers also use value relevance techniques to learn about accounting measurement (Barth, 1991; Choi et al., 1997), including fair value mea- sures (Barth et al., 1996; Song et al., 2010).

Value relevance research aimed at standard setting has its supporters and critics (Gonedes and Dopuch, 1974; Barth et al., 2001; Holthausen and Watts, 2001). Perhaps because the academic criticism discourages researchers from employing value relevance designs, or because such designs seem overused and generate few new insights, value relevance studies are less prevalent today. Nonetheless, research- ers have not abandoned capital markets-based research aimed at learning about financial accounting. Instead, they have developed alternative approaches to address a wider variety of questions. For example, Barth et al. (2013) use the implications of

9 In 2010, the FASB and IASB replaced the term ‘reliability’ with ‘faithful representation’, which clarified the original intended meaning of the term reliability (FASB, 2010; IASB, 2010).

F I NA N C I A L AC C O U N T I N G R E S E A R C H A N D P R AC T I C E

503 © 2015 Accounting Foundation, The University of Sydney

option-pricing theory to provide evidence on whether employee stock options share key characteristics of equity or liabilities.10

RE-INVIGORATING THE RELATION BETWEEN ACADEMIA AND PRACTICE

Academia and practice seem to be drifting apart again. A visible, potentially con- tributing development is another broadening of the scope of what is considered financial accounting research. Accounting research has a long history of being informed by economics and finance, particularly in relation to the functioning of capital markets. In addition, insights from psychology enable us to understand how the way in which information is communicated affects how users of the information process and interpret it. Recently, accounting research is expanding beyond these fields, and examining topics such as the effects of physical characteristics of the conveyor of accounting information and the linguistic style of the information (e.g., Hobson et al., 2011; Jia et al., 2014). However, these studies focus on characteristics of how accounting information is communicated rather than on the content and characteristics of the information being communicated.The impact of the former on financial accounting and accountability is yet to be established, whereas the latter traditionally is the focus of financial accounting research.11

There are clear benefits of accounting research embracing individuals from differ- ent fields with relevant, complementary expertise and knowledge. Broader and new perspectives can rejuvenate a field and enrich it.Concurrent with the advent of capital markets-based research in accounting was a reaffirmation that accounting is related to economics and finance.12 This reaffirmation created the opportunity for individuals with those interests to become accounting academics.Their broader perspective helps clarify accounting’s role in the capital markets, which points to aspects of accounting that need attention or improvement. Their participation in accounting research also reveals new perspectives with which to view nettlesome problems (e.g., Barth et al., 2008, 2013). However, a cost is that more accounting academics are interested in questions other than those of interest to accounting practice, including accounting standard setting. For example, some researchers with strong finance backgrounds focus more on how to profit from situations in which accounting information is not fully impounded in equity prices (e.g., Richardson et al., 2010).

10 Not all capital markets accounting research is aimed at addressing specific financial accounting standard-setting questions. Two examples are the large literatures on earnings management and conservatism (see, Healy and Wahlen (1999) and Watts (2003) for reviews).

11 Perhaps future research will provide insights into how to design information content based on understanding the likely conveyor’s characteristics—and manner of delivery—to achieve a particular objective relating to the recipient’s interpretation of the information. That is, research might identify how the content of the information might interact with the characteristics of the conveyor and delivery—as well as the characteristics of the recipient.

12 Paton and Littleton (1940), among others, identified this relation before the advent of capital markets research.

A BAC U S

504 © 2015 Accounting Foundation, The University of Sydney

Top academic journals are embracing this perspective on accounting as a field far broader than its links to economics, finance, and psychology would imply. The consequence is that less journal space is devoted to financial accounting research aimed at improving the content of accounting information. This, in turn, has the potential to weaken the link between accounting research and practice (Kaplan, 2011). Another factor potentially contributing to the weakening of this link is the perception by some academics that standard-setting decisions are rarely based on concepts (e.g., Allen and Ramanna, 2013). Instead, standard-setting decisions often seem to be aimed at pleasing preparers of financial statements, or their auditors, rather than providing the most relevant information to users of financial statements. This perception raises the question of whether standard setters are interested in what can be learned from academic research. This perceived lack of impact on standard-setting decisions reduces the motivation of academics to pursue research aimed at informing those decisions.

OPEN QUESTIONS FOR RESEARCH

Any weakening of the link between academic research and practice cannot be attributed to a lack of interesting, unresolved, potentially researchable questions. Many of these questions are not new—they remain open because they are difficult to answer. They are difficult to answer for two reasons. First, answering them requires in-depth knowledge of accounting institutions—fortunately, that is the comparative advantage of accountants. Second, answering them requires creativity in developing appropriate research designs based on available data—fortunately that is a challenge innovative researchers welcome. The following is a partial list of these questions, all of which could result in knowledge that enhances financial accountability. The questions are framed as motivating questions, that is, practice questions that motivate the research; re-framing them as research questions is left to the researchers who seek to address them.

1. What is the best way to measure assets, liabilities, equity, income, and expense? Although this question has been the focus of considerable thought over many years, it remains unresolved (see, e.g., Chambers, 1962; Dean et al., 2010). A key shortcoming of the current Conceptual Framework is that it contains no con- cepts on measurement (Barth, 2014). Perhaps the absence of measurement concepts reflects the lack of progress relating to measurement in financial reporting (e.g., Chambers, 1998) or perhaps it reflects the acknowledgement that in an incomplete and imperfect world, measurement in accounting is not pos- sible (Beaver and Demski, 1979).13 It likely is not fruitful to go over old ground that failed to resolve the measurement question. However, measurement is fundamental to financial accounting and financial accountability and, thus, deserves renewed efforts at developing measurement concepts.

13 See Storey and Storey (1998) for an historical perspective on the development of the Conceptual Framework.

F I NA N C I A L AC C O U N T I N G R E S E A R C H A N D P R AC T I C E

505 © 2015 Accounting Foundation, The University of Sydney

2. Should financial accounting focus on assets, liabilities, equity, income, and expense items, or are there other items we should measure? If so, what are they and why should we measure them? How should the interrelations among these items be portrayed? Which interrelations are important? Joint use in opera- tions? Joint use in any activities? Creation of synergies? These questions relate to measurement and to display.

3. How can we recognize or otherwise faithfully represent intangible assets that increasingly comprise a larger portion of the economic value of firms in an information and technology age? These assets typically are unrecognized today because it is not easy to faithfully represent them in an historical cost, transactions-based measurement framework.

4. Research has begun to focus on risk reporting, but there is little quantitative information in financial statements about the risk of assets, liabilities, equity, income, and expense—either inherent risk or estimation risk (Ryan, 2012).What information is needed? What is the best way to provide that information?

5. What is the best way to summarize, aggregate, and present information in financial reports to aid investors and other outside providers of capital in their decision making? Research tells us much about investors’ decision making— both as individuals and in markets—and it seems clear that financial statements do not reflect all the information they need (Hodder et al., 2008). What addi- tional information do investors need and is that information best provided in financial statements? If not, why not? Is there information in financial reports that is irrelevant?

6. Financial reports are criticized as being out-of-date before they are published. Yet, they appear to have information content. What is the role of periodic—for example, quarterly, semi-annual, or annual—financial statements in a world with continuous information flow? What does this role imply for the content of financial reports?

7. What are the costs of not providing high-quality financial statements? Although researchers have identified some aspects of quality, the construct of ‘quality’ is inherently difficult to quantify and, thus, assess as high or low (e.g., Francis et al., 2004; Barth et al., 2008). What aspects of financial statements are the most important to be high quality, and why? Also, the Framework explains that the costs of providing—or not providing—accounting information are broad.14

Researchers have identified cost of capital as a key cost (e.g., Francis et al., 2004; Barth et al., 2013). Is it possible to identify the major costs, even if we cannot measure all costs? What features of financial statements reduce or increase these costs?

14 For example, the Framework states that ‘Providers of financial information expend most of the effort involved in collecting, processing, verifying and disseminating financial information, but users ulti- mately bear those costs in the form of reduced returns. Users of financial information also incur costs of analysing and interpreting the information provided. If needed information is not provided, users incur additional costs to obtain that information elsewhere or to estimate it’ (FASB, 2010; IASB, 2010, ¶QC35–¶QC39).

A BAC U S

506 © 2015 Accounting Foundation, The University of Sydney

8. What are the boundaries of financial reporting in terms of the extent of forward- looking information incorporated into financial reports? All accruals are esti- mates of the future and fair values reflect current estimates of all factors related to the item being measured (see, e.g., Barth, 2006). When do these estimates of the future cross the boundary between financial reporting and forecasting?

9. The academic literature is replete with studies showing that individuals respon- sible for financial reporting, such as firm managers, respond to incentives. Is there a way to provide incentives for high-quality financial reporting? What are the incentives and how would we create them?

10. What particular aspects of enforcement are needed to ensure the quality of financial reporting? Although some studies focus on enforcement indicators when determining how accounting amounts provide information to capital markets, these studies do not identify which aspects of enforcement are crucial (Ball, 2006).

11. What is the relation between financial reporting and contracting (Lambert, 2010)? Is it simply that it is not cost effective for firms to invest in two reporting systems? Is there any role for establishing accounting standards or principles for accounting used in contracts? If so, what is that role and what would be the basis for establishing such standards or principles? How would the particular needs of contracting parties be served by such standards or principles?

12. Accounting amounts are used not only at the firm level, but also at the economy level, for example, by governments, to make policy decisions. How do financial reports by individual firms aggregate to the economy-wide level? Is there a way to enhance the economy-wide use of accounting amounts without diminishing their informativeness at the firm level?

CONCLUSION

Financial accounting researchers have an important role to play in society. Financial accounting is essential for financial accountability, which is essential for a prosperous society. Accounting research is informed by knowledge in related fields such as economics, finance, and psychology. Recently accounting research has begun to embrace fields associated with how accounting information is communicated, includ- ing the physical characteristics of information conveyors and the linguistics of the information, with no apparent connection to the information being conveyed. Inter- action with related fields brings broader and new perspectives and can rejuvenate a field and enrich it. However, pursuing a new research area without considering its possible relation to accounting practice risks losing the connection between account- ing research and practice and, thus, financial accountability. Regardless, there are many intriguing, unanswered research questions, the answers to which could provide insights into ways to improve financial accounting and reporting. This article iden- tifies only a few.

To address these questions and provide these insights, the relation between accounting academics and accountants in practice needs to be strong. A strong academic–practice relation helps researchers to identify and thoroughly understand

F I NA N C I A L AC C O U N T I N G R E S E A R C H A N D P R AC T I C E

507 © 2015 Accounting Foundation, The University of Sydney

the accounting questions and to be creative in developing research designs to address them. As Robert Kaplan said in his 2010 American Accounting Association Presidential Scholar Address, accountants need to re-assert our role in society and to reaffirm our place as a learned profession. Thus, a goal to which accounting academ- ics should strive is research motivated by practice and practice motivated by research. Only then will academic researchers help facilitate financial accountability and contribute to a prosperous society that can base decisions on high-quality financial information.

REFERENCES

Aboody, D. (1996), ‘Market Valuation of Employee Stock Options’, Journal of Accounting and Econom- ics, Vol. 22, Nos 1–3, pp. 357–91.

Aboody, D. and R. Kasznik (2008), ‘Executive Stock-based Compensation and Firms’ Cash Payout: The Role of Shareholders’ Tax-related Payout Preferences’, Review of Accounting Studies, Vol. 13, Nos 2–3, pp. 216–51.

Aboody, D., M. E. Barth, and R. Kasznik (2004), ‘SFAS, 123 Stock-based Compensation Expense and Equity Market Values’, The Accounting Review, Vol. 79, No. 2, pp. 251–75.

Allen, A. and K. Ramanna (2013), ‘Towards an Understanding of the Role of Standard Setters in Standard Setting’, Journal of Accounting and Economics, Vol. 55, No. 1, pp. 66–90.

Amir, E. (1993), ‘The Market Valuation of Accounting Information: The Case of Postretirement Benefits Other than Pensions’, The Accounting Review, Vol. 68, No. 4, pp. 703–24.

Ball, R. (2006), ‘International Financial Reporting Standards (IFRS): Pros and Cons for Investors’, Accounting and Business Research, International Accounting Policy Forum, pp. 5–27.

Ball, R. and P. Brown (1968), ‘An Empirical Evaluation of Accounting Income Numbers’, Journal of Accounting Research, Vol. 6, pp. 159–78.

Barth, M. E. (1991), ‘Relative Measurement Errors Among Alternative Pension Asset and Liability Measures’, The Accounting Review, Vol. 66, No. 3, pp. 433–63.

—— (2006), ‘Including Estimates of the Future in Today’s Financial Statements’, Accounting Horizons, Vol. 20, No. 3, pp. 271–85.

—— (2014),‘Measurement in Financial Reporting:The Need for Concepts’, Accounting Horizons,Vol. 28, No. 2, pp. 331–52.

Barth, M. E. and W. R. Landsman (2013), ‘Financial Reporting and the Crisis’, By All Accounts, pp. 8–9.

—— (2010), ‘How Did Financial Reporting Contribute to the Financial Crisis?’, European Accounting Review, Vol. 19, No. 3, pp. 399–423.

Barth, M. E., G. Ormazabal, and D. J. Taylor (2012), ‘Asset Securitization and Credit Risk’, The Account- ing Review, Vol. 87, No. 2, pp. 423–48.

Barth, M. E., L. D. Hodder, and S. R. Stubben (2008), ‘Fair Value Accounting and Own Credit Risk’, The Accounting Review, Vol. 83, No. 3, pp. 629–64.

—— (2013), ‘Financial Reporting for Employee Stock Options: Liabilities or Equity?’, Review of Accounting Studies, Vol. 18, No. 3, pp. 642–82.

Barth, M. E., W. H. Beaver, and W. R. Landsman (2001), ‘The Relevance of the Value Relevance Literature for Financial Accounting Standard Setting: Another View’, Journal of Accounting and Economics, Vol. 31, Nos 1–3, pp. 77–104.

—— (1992), ‘The Market Valuation Implications of Net Periodic Pension Cost Components’, Journal of Accounting and Economics, Vol. 15, No. 1, pp. 27–62.

—— (1996), ‘Value-relevance of Banks’ Fair Value Disclosures Under SFAS No. (107),’ The Accounting Review, Vol. 71, No. 4, pp. 513–37.

Barth, M. E., W. R. Landsman, and M. H. Lang (2008), ‘International Accounting Standards and Account- ing Quality’, Journal of Accounting Research, Vol. 46, No. 3, pp. 467–98.

A BAC U S

508 © 2015 Accounting Foundation, The University of Sydney

Barth, M. E., Y. Konchitchki, and W. R. Landsman (2013), ‘Cost of Capital and Earnings Transparency’, Journal of Accounting and Economics, Vol. 55, Nos 2–3, pp. 206–24.

Beaver, W. H. (1968), ‘The Information Content of Annual Earnings Announcements’, Journal of Accounting Research, Vol. 6, pp. 67–92.

Beaver, W. H. and R. E. Dukes (1972), ‘Interperiod Tax Allocation, Earnings Expectations, and the Behavior of Security Prices’, The Accounting Review, Vol. 47, No. 2, pp. 320–32.

—— (1973), ‘Interperiod Tax Allocation and D-Depreciation Methods: Some Empirical Results’, The Accounting Review, Vol. 48, No. 3, pp. 549–59.

Beaver, W. H., and J. S. Demski (1979), ‘The Nature of Income Measurement’, The Accounting Review, Vol. 54, No. 1, pp. 38–46.

Chambers, R. J. (1962), Towards a General Theory of Accounting, Australian Society of Accountants, Annual Lecture, University of Adelaide Press, Adelaide.

—— (1965), ‘Edwards and Bell on Business Income’, The Accounting Review, Vol. 40, No. 4, pp. 731–41.

—— (1966), Accounting, Evaluation and Economic Behavior, Prentice-Hall (reprinted in Accounting Classics Series, Scholars Book Co., Houston, 1975).

—— (1998), ‘Wanted: Foundations of Accounting Measurement’, Abacus, Vol. 34, No. 1, pp. 36–47.

Choi, B., D. W. Collins, and W. B. Johnson (1997), ‘Valuation Implications of Reliability Differences: The Case of Nonpension Postretirement Obligations’, The Accounting Review, Vol. 72, No. 3, pp. 351–83.

Dean, G., A. Lennard, G. Whittington, R. Macve, and M. E. Barth (2010), ‘EAA Symposium,Tampere, 13 May 2009—Wanted: Foundations of Accounting Measurement’, Abacus, Vol. 46, No. 1, pp. 84–127.

Edwards, E. O. and P. W. Bell (1961), The Theory and Measurement of Business Income, University of California Press, Berkeley.

Financial Accounting Standards Board (1980), Statement of Financial Accounting Standards No. 36, ‘Disclosure of Pension Information’, FASB, Norwalk, CT.

—— (1985), Statement of Financial Accounting Standards No. 87, ‘Employers’ Accounting for Pensions’, FASB, Norwalk, CT.

—— (1990), Statement of Financial Accounting Standards No. 106, ‘Employers’ Accounting for Postre- tirement Benefits Other than Pensions’, FASB, Norwalk, CT.

—— (1998), Statement of Financial Accounting Standards No. 133, ‘Accounting for Derivative Instru- ments and Hedging Activities’, FASB, Norwalk, CT.

—— (2004), Statement of Financial Accounting Standards No. 123 (Revised), ‘Share-based Payment’, FASB, Norwalk, CT.

—— (2010), Statement of Financial Accounting Concepts No. 8, Conceptual Framework for Financial Reporting, Chapter 1, ‘The Objective of General Purpose Financial Reporting’, and Chapter 3, ‘Qualitative Characteristics of Useful Financial Information’, FASB, Norwalk, CT.

Francis, J., R. LaFond, P. Olsson, and K. Schipper (2004), ‘Costs of Equity and Earnings Attributes’, The Accounting Review, Vol. 79, No. 4, pp. 967–1010.

Fronstin, P. (2010), ‘Implications of Health Reform for Retiree Health Benefits’, Employee Benefit Research Institute, No. 338.

Gonedes, N. J. and N. Dopuch (1974), ‘Capital Market Equilibrium, Information Production, and Select- ing Accounting Techniques: Theoretical Framework and Review of Empirical Work’, Journal of Accounting Research, Vol. 17, pp. 48–129.

Graham, B. and D. L. Dodd (1934), Security Analysis, McGraw-Hill Book Co, New York and London.

Healy, P. M. and J. M. Wahlen (1999), ‘A Review of the Earnings Management Literature and its Implications for Standard Setting’, Accounting Horizons, Vol. 13, No. 4, pp. 365–83.

Hicks, J. R. (1946), Value and Capital, Second edition, Clarendon Press, Oxford.

Hobson, J. L., W. J. Mayew, and M. Venkatachalam (2011), ‘Analyzing Speech to Detect Financial Misreporting’, Journal of Accounting Research, Vol. 50, No. 2, pp. 349–92.

Hodder, L., P. E. Hopkins, and D. Wood (2008), ‘The Effects of Financial Statement and Informational Complexity on Analysts’ Cash Flow Forecasts’, The Accounting Review, Vol. 83, No. 4, pp. 915–56.

F I NA N C I A L AC C O U N T I N G R E S E A R C H A N D P R AC T I C E

509 © 2015 Accounting Foundation, The University of Sydney

Holthausen, R.W. and R. L. Watts (2001), ‘The Relevance of the Value Relevance Literature for Financial Accounting Standard Setting’, Journal of Accounting and Economics, Vol. 31, Nos 1–3, pp. 3–75.

International Accounting Standards Board (2001), International Accounting Standard 19 Employee Ben- efits, IASB, London.

—— (2004a), International Accounting Standard 39 Financial Instruments: Recognition and Measurement, IASB, London.

—— (2004b), International Financial Reporting Standard 2 Share-based Payment, IASB, London.

—— (2005), International Financial Reporting Standard 7 Financial Instruments: Disclosures, IASB, London.

—— (2010), The Conceptual Framework for Financial Reporting, IASB, London.

—— (2011), International Financial Reporting Standard 13 Fair Value Measurement, IASB, London.

Irving, J. H., W. R. Landsman, and B. P. Lindsey (2011), ‘The Valuation Differences between Stock Option and Restricted Stock Grants for U.S. Firms’, Journal of Business Finance & Accounting, Vol. 38, Nos 3–4, pp. 395–412.

Jaedicke, R. K. and R. T. Sprouse (1965), Accounting Flows: Income, Funds, and Cash, Prentice-Hall, Englewood Cliffs.

Jia, Y., L. Van Lent, and Y. Zeng (2014), ‘Masculinity, Testosterone, and Financial Misreporting’, Journal of Accounting Research, Vol. 52, No. 5, pp. 1195–246.

Kaplan, R. S. (2011), ‘Accounting Scholarship that Advances Professional Knowledge and Practice’, The Accounting Review, Vol. 86, No. 2, pp. 367–83.

Lambert, R. A. (2010), ‘Discussion of Implications for GAAP from and Analysis of Positive Research in Accounting’, Journal of Accounting and Economics, Vol. 50, Nos 2–3, pp. 287–95.

Landsman, W. R. (1986), ‘An Empirical Investigation of Pension Fund Property Rights’, The Accounting Review, Vol. 61, No. 4, pp. 662–91.

Moonitz, M. (1961), The Basic Postulates of Accounting, American Institute of CPAs, New York.

Moonitz, M. and R. T. Sprouse (1962), A Tentative Set of Broad Accounting Principles for Business Enterprises, American Institute of CPAs, New York.

Paton, W. A. and A. C. Littleton (1940), An Introduction to Corporate Accounting Standards, American Accounting Association, Chicago, IL.

Richardson, S., I. Tuna, and P. Wysocki (2010), ‘Accounting Anomalies and Fundamental Analysis: A Review of Recent Research Advances’, Journal of Accounting and Economics, Vol. 50, Nos 2–3, pp. 410–54.

Ryan, S. G. (2012), ‘Risk Reporting Quality: Implications of Academic Research for Financial Reporting Policy’, Accounting and Business Research, Vol. 42, No. 3, pp. 295–324.

Soll, J. (2014), The Reckoning: Financial Accountability and the Rise and Fall of Nations, First edition, Basic Books, New York.

Song, C. J., W. B. Thomas, and H. Yi (2010), ‘Value Relevance of FAS No. 157 Fair Value Hierarchy Information and the Impact of Corporate Governance Mechanisms’, The Accounting Review, Vol. 85, No. 4, pp. 1375–410.

Storey, R. K. and S. Storey (1998), The Framework of Financial Accounting Concepts and Standards, Financial Accounting Series No. 181-C Special Report, FASB, Norwalk, CT.

Venkatachalam, M. (1996), ‘Value-relevance of Banks’ Derivatives Disclosures’, Journal of Accounting and Economics, Vol. 22, pp. 327–55.

Watts, R. L. (2003), ‘Conservatism in Accounting Part II: Evidence and Research Opportunities’, Accounting Horizons, Vol. 17, No. 4, pp. 287–301.

A BAC U S

510 © 2015 Accounting Foundation, The University of Sydney

Copyright of Abacus is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use.

Enhancing Government Accountability Through Financial Reporting.pdf

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

Enhancing Government Accountability Through Financial Reporting Attmore, Robert H The Journal of Government Financial Management; Summer 2007; 56, 2; ProQuest Central pg. 8

Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.

The Reckoning.pdf

JACOB SOLL, The Reckoning: Financial Accountability and the Rise and Fall of Nations (New York, NY: Basic Books, 2014, ISBN: 978-0-465-03152-8, pp. xvii, 276).

Werner Sombart (1924) was the first to advance the hypothesis that double-entry bookkeeping (DEB) was

a necessary institution for the development of modern capitalism. Basil Yamey (1964, 117) summarizes

Sombart’s hypothesis:

[B]y transforming assets into abstract values and by expressing quantitatively the results of business

activities, double-entry bookkeeping clarified the aims of acquisitive business; moreover, it provided

the rational basis on which the capitalist could choose the directions in which to employ his capital to

best advantage; and finally, it made possible the separation of the business firm from its owners and

hence the growth of large joint-stock businesses.

Max Weber and Joseph Schumpeter have echoed Sombart’s view of DEB (Most 1972; Winjum 1972).

Other work suggests that the recordkeeping function of accounting may be a positive force at even earlier

stages in an economy’s development (Basu and Waymire 2006). Ultimately, understanding the role of basic

accounting institutions in economic development will likely require contributions from multiple disciplines,

including law and economics, sociology, psychology and neuroscience, and history. Jacob Soll’s The

Reckoning provides a historical analysis that contributes significantly to this undertaking.

The main focus of this book, as the author states in the introduction, is to explore a moral tension that has

surfaced throughout the history of modern accounting:

People have known how to do good accounting for nearly a millennium, but many financial

institutions and regimes have just chosen not to do it. Those societies that have succeeded are not

only those rich in accounting and commercial culture but also are the ones that have worked to build

a sound moral and cultural framework to manage the fact that humans have a regular habit of

ignoring, falsifying, and failing in accounting. This book examines why a lesson so simple has so

rarely been learned. (p. 12)

Soll tackles this important issue from the perspective of a historian doing qualitative analysis. This

approach allows the historian to cast a wide net in determining what constitutes evidence and how it is to be

interpreted, and offer a complementary approach to more quantitative empirical work. Soll’s book helps us to

better see the ‘‘big picture’’ of how the historical evolution of DEB shaped, and has been shaped by, cultural

changes reflected in the economic, social, and religious institutions of human societies since the 14th century.

After a brief introduction, Chapter 1 sets the stage by reviewing the political economy of accounting

before 1400. This chapter situates DEB as an innovation with the potential to improve on accounting functions

that had existed for thousands of years. Chapters 2 and 3 provide contrasting views of the morality play at work

in DEB through two case studies. Chapter 2 (‘‘For God and Profit: The Books According to Saint Matthew’’)

tells the story of Francesco Datini, who rigorously applied DEB to a vast and growing business centered on

banking and international trade. Datini was the ‘‘good accountant’’ whose books were ‘‘overwhelming’’ in

scope and number. Most importantly, the historical context for Datini’s business lies in the religious tradition

of Catholicism, which viewed the pursuit of business profit as sinful. Chapter 3 (‘‘Medici Magnificence: A

Cautionary Tale’’) tells the tale of Cosimo de’ Medici, a Florentine banker who amassed great wealth, but

whose heirs struggled to manage the bank’s far-flung finances, in part because of political connections that

today might be described as ‘‘crony capitalism.’’ In combination, Chapters 2 and 3 are central to the book’s

thesis that DEB is a moral enterprise that requires both hard work and extraordinary self-discipline to

implement successfully.

Luca Pacioli enters the story in Chapter 4 (‘‘The Mathematician, the Courtier, and the Emperor of the

World’’). This chapter tells us something about Pacioli’s background and the circumstances under which he

wrote the Summa. Soll describes Pacioli as the ‘‘father of accounting’’ whose manual was ‘‘its founding work’’

(p. 49). More importantly, Soll establishes the idea that DEB as depicted by Pacioli was a moral undertaking

where the ‘‘balance of account books represented the moral equilibrium of God’’ (pp. 50–51). He also recounts

how Pacioli’s Summa was not a commercial success initially (p. 55) and reviews the difficulties faced by early

statesmen, politicians, and businessmen who implemented DEB with varying degrees of success (pp. 55–69).

Book Reviews 823

The Accounting Review March 2015

Chapters 5 to 10 provide country-specific reviews of accounting and economic development during different

time periods: Holland (Chapter 5), France under Louis XIV (Chapter 6), England (Chapters 7 and 8), 18th century

France before and during the French Revolution (Chapter 9), and the United States around the time of the American

Revolution (Chapter 10). All told, these chapters further the narrative by providing more detailed analyses showing

how the same moral dilemma associated with DEB surfaced repeatedly between 1500 and 1900 in several countries.

Chapter 11 provides a discussion of accounting’s role in the emergence of 19th century British and

American railroads. This chapter does an excellent job of describing how large railroad organizations

transformed societies, influenced political institutions, and fostered the emergence of accounting as a modern

profession. Chapter 11 also serves in part as a segue into a captivating discussion of how accounting is

represented in the literature of Charles Dickens and other authors (Chapter 12, ‘‘The Dickens Dilemma’’).

Soll (p. 179) cites Dickens to illustrate the moral tension at the heart of DEB:

Of all the authors of the nineteenth century, Charles Dickens had the most vivid view of accountants

and accountability. In Dickens’s world, the accountant had been reduced to a good-hearted but hapless

clerk, a malicious swindler, or a nightmarish bureaucrat. Accountants could be good men like Bob

Cratchit, the father of Tiny Tim in A Christmas Carol (1843), who loyally kept the books of the

counting house or bank of the miser Ebenezer Scrooge. Both Scrooge and his ghostly partner in

banking, Jacob Marley, had trained as accountants. . . . Marley’s ghost appeared to Scrooge, bound by a

chain: ‘‘It was long, and wound about him like a tail; and it was made (for Scrooge observed it closely)

of cash-boxes, keys, padlocks, ledgers, deeds, and heavy purses wrought in steel.’’ Not just money, but

the ledgers and deeds of accounting had ensnared the wily banker and imprisoned his soul. Scrooge

risked the same were he not to make amends, in the logic of Pacioli, paying to the poor on Christmas to

balance his accounts with a moral, Christian God.

Chapter 13 and the final chapter titled ‘‘Conclusion’’ serve an integrative purpose. These chapters are very

good, but they do seem somewhat incomplete. Chapter 13, appropriately titled ‘‘Judgment Day,’’ reviews the

American experience in the 20th century. It chronicles various private sector scandals of this era but does not

link back to accounting discipline in the public sector, as was the case in several earlier chapters. For example,

some, like Warren Rudman and David Walker, have tried to warn of the potentially disastrous consequences of

profligate spending by American politicians over the last several decades. The final chapter is brief and runs

only three pages. That is both positive and negative. It is positive in that Soll does not make sweeping

generalizations based on his historical survey. It is possibly unfortunate in that a few more speculations about

implications for the future would have been welcomed. Nonetheless, the concerns about the final two chapters

are minor in relation to the value delivered by this book.

Overall, Soll successfully sets up his history of double-entry bookkeeping as a morality play. This is, in

my opinion, the book’s primary strength. The idea that the birth of DEB is linked inextricably with the

foundations of business ethics and morality is compelling. The moral conflict faced by those seeking

accountability is apparent in the history that Soll pulls together. Political and business leaders may not provide

proper accounting because it is difficult; it requires sustained effort and diligence as illustrated by Datini over

600 years ago. Soll brings the moral conflict inherent in DEB to life in his descriptions of ‘‘buck-passing’’ by

leaders who say they value accountability but lack the discipline to actually deliver it.

In terms of the book’s contribution, it is perhaps helpful to contrast it with other books on the subject. It is

similar to James Aho’s (2005) Confession and Bookkeeping in that it sets up the history of DEB as a moral

dilemma. It also explores issues similar to Winjum’s (1972) study of the relation of DEB and economic

development. However, Soll’s historical analysis is broader and extends beyond the specific times and places

considered by Aho (2005) and Winjum (1972): in the case of Aho (2005), the Catholic Church in Italy during

the Renaissance, and in the case of Winjum (1972), Great Britain from 1500 to 1750. A more direct competitor

is Jane Gleeson-White’s (2012) Double Entry: How the Merchants of Venice Created Modern Finance. Soll’s

book is vastly superior to Gleeson-White’s (2012) in terms of historical breadth and depth, as well as linking

the analysis more accurately with broader social changes.1

1 Gleeson-White’s (2012) book runs off the rails in the final chapters when she tries to link DEB with so-called market failures linked to third-party costs (i.e., negative externalities).

824 Book Reviews

The Accounting Review March 2015

Overall, I recommend Jacob Soll’s The Reckoning: Financial Accountability and the Rise and Fall of Nations enthusiastically and without reservation. But to what audience? First, this book will be useful in

helping serious undergraduate accounting students understand the importance of their future work and its

historical origins. (For the same reasons, it might be of interest to practicing accountants.) Indeed, I think this

book would be a perfect companion to Brown and Palmrose’s (2005) Thog’s Guide to Quantum Economics: 50,000 Years of Accounting Basics for the Future in an undergraduate seminar on accounting theory. Second,

the book should be read by accounting doctoral students and seasoned faculty members. While the book may

not have any direct bearing on any specific analytical or empirical research project, it does provide the serious

scholar with a perspective that I think is helpful. After all, man does not live by standard errors alone! Finally,

if any members of the general public, whose interactions with DEB are limited, wander by accident onto the

pages of The Accounting Review, I recommend Jacob Soll’s book to them as well. It is well-written and fun to

read. If nothing else, Soll’s book reminds us of a truth that is easy to lose sight of: those human institutions that

are genuinely important for our survival are sometimes not recognized as such. The ubiquity of accounting and

recordkeeping is a bit like breathing in that we notice it only when it stops working effectively.

REFERENCES

Aho, J. 2005. Confession and Bookkeeping: The Religious, Moral, and Rhetorical Roots of Modern Accounting. Albany, NY: State University of New York Press.

Basu, S., and G. Waymire. 2006. Recordkeeping and human evolution. Accounting Horizons 20 (3): 201–

229.

Brown, M., and Z-V. Palmrose. 2005. Thog’s Guide to Quantum Economics: 50,000 Years of Accounting Basics for the Future. Duvall, WA: MAC Productions.

Gleeson-White, J. 2012. Double Entry: How the Merchants of Venice Created Modern Finance. New York,

NY: W. W. Norton & Co.

Most, K. S. 1972. Sombart’s propositions revisited. The Accounting Review 47 (4): 722–734.

Sombart, W. 1924. Der Moderne Kapitalismus. 6th edition. Munich, Germany: Duncker and Humblot.

Winjum, J. O. 1972. The Role of Accounting in the Economic Development of England: 1500–1750. Center

for International Education and Research in Accounting, University of Illinois.

Yamey, B. S. 1964. Accounting and the rise of capitalism: Further notes on a theme by Sombart. Journal of Accounting Research 2 (2): 117–136.

GREGORY B. WAYMIRE

Professor of Accounting

Emory University

IZUMI WATANABE (editor), Fair Value Accounting in Historical Perspective (Tokyo,

Japan: Moriyama Shoten, 2014, ISBN 978-4-8394-2139-7, pp. x, 270).

If you are not an Anglo-American country, which set of accounting standards do you adopt? Do you go

with the International Accounting Standards Board (IASB) or Financial Accounting Standards Board (FASB),

or do you stay with, and enhance, your own national accounting standards? What are the consequences for

accounting practice, and what legacy are you acquiring when you harmonize with International Financial

Reporting Standards (IFRSs)? These are essentially the questions being asked about fair value accounting by

Japanese academics in this book, evaluating the extent to which fair value is relevant and welcome when

making the choice of which set of standards to adopt.

The most important insight comes from the penultimate chapter in the book. Ono discusses debates

surrounding the treatment of affiliate stock issues acquired as business investments under an illiquid market as

an example of a divergence from fair value accounting. The insight, however, applies to all and any of the

versions of fair value accounting that we have in our current sets of standards, and to the continuing debates

Book Reviews 825

The Accounting Review March 2015

Copyright of Accounting Review is the property of American Accounting Association and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use.

The Role of Fair Value Accounting.pdf

MANUEL PEDRO RODRÍGUEZ BOLÍVAR AND ANDRÉS NAVARRO GALERA

The Role of Fair Value Accounting in Promoting Government Accountabilityabac_352 348..386

A key factor to improve the financial accountability of governments is the existence of a set of generally accepted financial reporting of standards, such as IPSAS issued by the IFAC, which seek to enhance information transparency.This paper examines the capability of fair value accounting to improve, through financial transparency, government accountability, anal- ysing the possible effect of the implementation of this measurement basis on understandability, comparability and timeliness—three qualitative char- acteristics linked to the relevance of financial reporting. This paper further considers whether the difficulties involved in achieving FV estimations could affect government financial accountability. The findings indicate that FVA implementation could enhance accountability by improving under- standability, comparability and timeliness in governmental financial report- ing, although the use of objective measures to estimate the FV of assets is fundamental. In addition, the type of assets and the existence of an active market are crucial to improving the comparability of financial statements under FVA, whereas improving timeliness could be limited by the possi- bility of estimating FV measures in-house.

Key words: Fair value; Financial accountability; IPSAS.

Although new public management (NPM) postulates originated in the Anglo- American administrative culture model (Aucoin, 1990; Hood, 1991; Pollitt and Bouc- kaert, 2004; Pollitt et al., 2007), supranational organizations (OECD, World Bank, IMF) have propagated them worldwide (Christensen and Laegreid, 2007). The reform of public management systems has been characterized by a move towards a new management culture, with greater emphasis on citizen satisfaction and quality, and on more transparent information and updated control mechanisms (Torres, 2004; Torres and Pina, 2004, Alam and Nandam, 2005). According to Hood (1991, 1995), NPM is based on the following postulates: (a) greater emphasis on citizens’ satisfaction as ‘clients’ of public sector services; (b) greater emphasis on manage-

Manuel Pedro Rodríguez Bolívar ([email protected]) and Andrés Navarro Galera ([email protected]) are Professors in the Department of Accounting and Finance, Faculty of Economics and Business Sciences, University of Granada. This research was carried out with financial support from the Regional Government of Andalusia (Spain), Department of Innovation, Science and Enterprise (research project number P09-SEJ-5395) and from the Spanish National R&D Plan through research projects numbers ECO2010-17463-ECON and ECO2010- 20522-ECON (Ministry of Science and Innovation). The authors also wish to thank the collaboration of all persons and institutions that answered the survey.

bs_bs_banner

ABACUS, Vol. 48, No. 3, 2012 doi: 10.1111/j.1467-6281.2011.00352.x

348 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

ment and accounting assessment methods; (c) an opening of public sector entities to competition; (d) the development of a systematic comparison of activities between management units (benchmarking); and (e) the separation of policy-making from service delivery and the creation of agencies to deliver services.

In addition, a receptive administration should increase citizens’ involvement as customers, and improve accessibility and transparency (OECD, 1987; Hughes, 1994), thus enhancing the accountability of public entities. Information transparency is crucial to achieving this objective because it helps ensure citizens’ access to infor- mation (Haque, 2006). Furthermore, it might influence voting behaviour because citizens could be influenced by financial reporting, which among other things is a vehicle for communicating the economic effects of political management (Brusca and Montesinos, 2006).

Nonetheless, a major impediment to enhancing government accountability is the absence of generally accepted financial reporting standards (Sutcliffe, 2003). Improv- ing transparency, and therefore accountability, requires financial information that is more comparable, understandable and accessible (Lüder, 1988; Lüder and Kamp- mann, 1993; Benito et al., 2007).Therefore, a priority in promoting financial account- ability involves improving information transparency, with particular attention paid to enhancing the understandability, comparability and timeliness of accounting information. As the choice of the measurement basis could affect the accomplish- ment of this goal, this paper examines whether the adoption of fair value (FV), as proposed by the International Federation of Accountants (IFAC, 2011), would improve the usefulness of government financial statements for accountability pur- poses, using a survey performed through a questionnaire addressed to Public Sector National Accounting Standards Setters (NASS) in 29 countries.

According to the International Federation of Accountants (IFAC, 2011), the implementation of International Public Sector Accounting Standards (IPSAS) would enhance the accountability of public sector entities by increasing transpar- ency in government financial statements. A major issue in endorsing IPSAS and implementing NPM reforms is the question of the accounting measurement basis used. Indeed, the most obvious gap that needs to be filled in the accounting information system is to define a clear measurement objective (Whittington, 2008; Bradbury, 2008) and to develop guidance on measurement (Whittington, 2008). Accordingly, although historical cost accounting (HCA) is the traditional valuation criterion in governmental accounting (Lüder, 2001), IPSAS 15, 16 and 17 propose that fair value accounting (FVA) take its place.

Previous studies have shown that changing the basis used for accounts evaluation could affect the usefulness of government financial information with respect to the purposes of administrative reforms, as the replacement of historical cost by the FV method could have consequences on the relevance of government financial state- ments as regards improving transparency, performing benchmarking analyses and evaluating efficiency (Sutcliffe, 2003; Barth, 2006; Goldfrank, 2006; Haque, 2006; Navarro and Rodríguez, 2007; Victorian Government, 2008).

On the whole, FVA is broadly recognized as a measurement basis that increases the usefulness of financial reporting from the point of view of users’ needs (Elad,

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

349 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

2004; Betts and Wines, 2004, Bies, 2005; Ball, 2006; Barth, 2006). This understand- ing is based on the belief that, in view of the overriding goal of faithful representation—as addressed in the IASB-FASB joint project on the conceptual framework of financial reporting (FASB, 2008; IASB, 2008) and in the IPSASB project on the conceptual framework for general purpose financial reporting by public sector entities (IPSASB, 2008)—FV better captures ‘economic substance’ (Whittington, 2008).Therefore, some analysts have stated that FV provides the most relevant information for financial decision making (CFA, 2007). Nonetheless, a debate about FVA is currently taking place because adoption of this approach could generate problems of reliability, as is increasingly recognized (Elad, 2004; Bies, 2005; Ball, 2006; Martin et al., 2006), because on some occasions it is difficult to obtain objective and verifiable estimations of the fair value of assets.

Previous studies have concluded that the information obtained by the application of FV is more relevant to users, but less reliable, than that derived from the historical cost method (Betts and Wines, 2004; Elad, 2004; Häusler, 2004; Bies, 2005; Ball, 2006), but the debate continues. In the present paper, we contribute to the discussion about the usefulness of FV, analysing: (a) the impact of its adoption on the relevance of government financial statements for accountability purposes, a question not previ- ously addressed; and (b) whether doubts about the reliability of FV estimations in the public sector could be a determining factor in the above-mentioned relevance. We study this question by examining different types of assets and the existence or non-existence of markets.

Therefore, the objective of the research is twofold. First, we examine the capability of FVA to improve government financial accountability by enhancing transparency. Second, we analyse whether the difficulties involved in achieving FV estimations could affect government financial accountability.

To achieve these objectives, we inquired into the perception of NASS in different countries about the relevance and reliability of public sector financial reporting under FVA. Its effect on the relevance of accounting information is analysed via its repercussions on the understandability, comparability and timeliness of accounting information, these being key concepts in financial transparency (FASB, 2008; IASB, 2008; IPSASB, 2008). The effect of FV measures on the reliability of published financial information is analysed via their objectivity and verifiability, which are critical elements to the notion of reliability (FASB, 2008; IASB, 2008; Whittington, 2008; IPSASB, 2008). We also analyse the viability of FV estimations because this could determine the reliability of the financial information, with respect to public administrations’ capacity to estimate FV in a real-world context.

FAIR VALUE AS A MEANS OF IMPROVING GOVERNMENT FINANCIAL STATEMENTS

The opinions of standards setters bodies, the practical experience of governments and the findings of research studies have all pointed out that possessing high-quality information on financial assets is useful for a wide range of users in their decision taking. In Australia, the Victorian Government (2008) has formally declared that

A BAC U S

350 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

financial information on assets is useful for making management decisions in gov- ernment on issues such as assessing whether assets controlled by the organization are properly maintained, planning for the future replacement of assets, determining the cost of the outputs, products and services provided by the entity and determining values for insurance coverage and risk management. In the U.S.A., two authoritative sources, the Governmental Accounting Standards Board’s Statements 34 and 35 (GASB, 1999) and the Environmental Protection Agency’s Capacity, Management, Operation and Maintenance (CMOM) program, call for public agencies to improve their tracking, management, operation, reporting, and financial accountability with respect to the nation’s capital assets. The ability to demonstrate asset management capability is becoming a crucial qualification for receiving lucrative federal grant funding under the Homeland Security Act and from other sources. Some authors have analysed the relevance of financial information on assets to a specific group of information users. Thus, López and Caba (2004) showed the usefulness of this information for financial institutions in deciding whether or not to grant loans; and previously, Ingram and Copeland (1981) had demonstrated the influence of financial information on voting behaviour. Navarro et al. (2007) showed that the financial information available on assets is of importance to supervisory bodies in different countries, because these institutions are obliged to control wealth holdings and to perform financial audits aimed at verifying that annual accounts provide a faithful view of such holdings.

It has been shown that the accounting basis used for asset evaluation could affect the usefulness of government financial information with respect to the purposes of administrative reforms (Sutcliffe, 2003; Barth, 2006; Haque, 2006; Goldfrank, 2006; Navarro and Rodríguez, 2007). The publication of standards in which FVA is rec- ommended for the accountability of assets, as reported by Turley (2008),Whittington (2008) and Rayman (2007), has led to a lively debate on the relation of this evalu- ation criterion with the qualitative characteristics of financial information that are addressed in the main conceptual frameworks (FASB, 1980; IASB, 1989; IFAC, 2011), and very especially with two of these, which are considered to be of funda- mental importance: relevance and reliability. As noted previously, in general, prior studies have shown that the information obtained by applying FVA is more relevant for users than that derived from the historical cost approach, but also less reliable (Betts and Wines, 2004; Elad, 2004; Häusler, 2004; Bies, 2005; Ball, 2006). Using FV could produce greater bias in the financial information reported (Ronen, 2008; Danbolt and Rees, 2008).The lower degree of reliability with FVA, in comparison to historical cost, is usually associated with difficulties in obtaining market prices to quantify asset values (AAAFASC, 2005). According to ICAEW (2006), if FV is determined on the basis of active markets, then it is verifiable and objective. More- over, as observed by Whittington (2008), the problems encountered are usually greater for non-financial assets, with prices that are considered to be of less rel- evance and reliability than is the case with financial assets.

The problems arising from the quantification of FV were taken into account in the agendas of two of the most important international bodies in this field, the FASB and the IASB. In September 2006, the FASB, supported by the AAAFASC (2005)

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

351 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

published SFAS 157, Fair Value Measurements, which established a clear definition of FV, together with three levels with the methods to be followed for quantification under this criterion. The IASB, too, has been working on a document regarding the measurement of FV, in order to issue a single guide for quantifying FV in all the cases considered under the international standards, with the goal of reducing the complexity of this measurement process and of enabling users of financial informa- tion to be aware of the variables considered in the calculation.

In every case, the problems of quantifying FV are greater when markets are imperfect or incomplete. According to Betts and Wines (2004), in this situation the concept of FV becomes ambiguous, and it may occur that in certain situations there could be various FVs for the same element (Barth and Landsman, 1995; Bradbury, 2008). For Benston (2008), when FV is not based on a current market price, it is more costly to determine and verify, and at the same time easier to manipulate. It is in these situations that FV may be more difficult to audit (Martin et al., 2006). Given the habitual use of estimations in quantifying FV, which in some cases is based on estimations of future cash flows, the IFAC (2008) in its ISA 540, Auditing Accounting Estimations, and more specifically, in ISA 545, Auditing Fair Value Measurements and Disclosures, states the procedures to be adopted by the auditors regarding the measurement of FV and concerning the disclosures to be made on this criterion in financial statements.

It can readily be appreciated that the application of FV in recording the accounts values of assets is by no means an issue that has been decided. On the contrary, it is the subject of wide-ranging, lively debate, fundamentally because the replacement of historical cost by FVA could affect the fulfilment by financial statements of at least two of the characteristics that are required of accounts information—relevance and reliability—and therefore could affect its usefulness for the users of this information. The aim of the present paper is to contribute ideas to this debate, and in particular, to study the repercussions of adopting FV with respect to the usefulness of govern- ment financial statements for the purposes of accountability.

INFLUENCE OF THE ACCOUNTING MEASUREMENT BASIS ON GOVERNMENT FINANCIAL TRANSPARENCY

According to the prologue to the IPSAS document (IFAC, 2011), these standards provide the best international reference for the preparation of government financial statements, drafted for general purposes. The IPSAS standards are intended to promote the successful introduction of new public management (NPM) (see Hood, 1991, 1995). Among the fundamental notions of NPM are the concepts of transpar- ency and accountability, from the standpoint of the citizen as client. For IFAC (2011), the improvements proposed in the IPSAS have the potential to enhance the quality of financial information and, by favouring transparency, contribute to greater gov- ernment accountability. Therefore, any change of accounting criteria that affects the qualitative characteristics of financial information could influence government financial transparency and thus its accountability. As observed by Haque (2006), the

A BAC U S

352 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

concept of transparency is of special relevance to processes of accountability as it constitutes an excellent instrument for facilitating citizens’ access to information.

According to Kopits and Craig (1998) and Benito et al. (2007), raising the com- parability of the financial statements produced by public organizations would con- tribute to enhancing transparency, making such organizations more financially responsible. In this sense, many studies have attested to the utility of benchmarking analysis as an instrument of evaluation and improvement of public management (Llewellyn and Northcott, 2005; Van Helden and Tillema, 2005; Navarro et al., 2007; Pollitt et al., 2007). Nevertheless, the main problem with comparative analyses is that of achieving sufficient homogeneity in measuring the outputs generated by the economic information systems of public institutions (Ortiz et al., 2006; Rivenbark and Carter, 2000; Ammons et al., 2001; Morely et al., 2001; Folz, 2004). In order to obtain the necessary comparability, and thus improve governments’ financial trans- parency, a very significant question is that of the choice of accounts measurement basis to be used in drawing up the annual accounts. If the historical cost method is used for the accounts record of asset values, then financial statements could be comprised of heterogeneous values, if the assets in question were acquired at dif- ferent times (Navarro and Rodríguez, 2007). On the other hand, turning to the proposal made in the IPSAS (IFAC, 2011), the application of FV, based on estima- tions made in accordance with current market circumstances, could provide values that are more homogeneous and thus more useful for improving the financial trans- parency of governments (Barth, 2006).

Another of the qualitative characteristics of government financial information that could affect its transparency is that of understandability (Kopits and Craig, 1998; Navarro and Rodríguez, 2007). As observed by Matheson and Kwon (2003), the legislative obligation to publish understandable information is a powerful instru- ment for narrowing the power gap between government and citizens. Following authors such as Sutcliffe (2003) and Eccles et al. (2001), as historical cost gives values for assets acquired over a period of time, it may be difficult to identify and compre- hend the market circumstances prevailing at the moment of each successive acqui- sition. On the other hand, application of the FV method already incorporates present-day market circumstances, and so it is reasonable to believe that this would favour the understandability of financial statements and thus their transparency. In accordance with an official declaration by the Victorian Government (2008), the financial information on assets, resulting from the application of given methods of accounts evaluation, may influence the satisfaction of citizens’ legitimate informa- tion demands, as not all evaluation criteria provide information with similar levels of understandability and, therefore, of transparency.

Another key aspect of the transparency of financial information is the timeliness of government financial statements (Matheson and Kwon, 2003; Blöndal et al., 2004; Bastida and Benito, 2007), as delays in the preparation and disclosure of financial information may lead to this information becoming less useful for decision taking at a given time. As reported by IFAC (2011), the application of FV requires those responsible for presenting financial information to quantify estimations on the basis of actual, current market transactions. This requirement might cause delays in the

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

353 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

preparation and disclosure of financial statements, especially when there is no active market for the elements to be valued, or when it is impossible to consult such a market for reasons of time and/or cost (Navarro and Rodríguez, 2007). However, according to Barth (2006), estimations of FV are of great practical worth, to the extent that they reflect changes in current market circumstances.Thus, they are more useful for decision taking and more transparent for the users of financial statements.

In short, the replacement of historical cost by FVA could affect the transparency of government financial statements, and consequently the effectiveness of govern- ment accountability; this change in the accounting basis employed has the potential to influence the fulfilment of three characteristics that are demanded of government financial information: comparability, understandability and timeliness. The principal conceptual frameworks have traditionally considered these characteristics to be related to the relevance of financial information.According to the conceptual frame- works of IASB (1989) and AECA (1999), if financial information lacks understand- ability, then it loses some or all of its relevance. Comparability and timeliness, too, have been identified as qualities that have a notable impact on relevance, and may even be considered an integral component of it, as proposed in the FASB (1980) conceptual framework and the draft framework prepared jointly by FASB and IASB (FASB, 2008). In view of these considerations, it would be interesting to carry out empirical studies to determine the possible contribution of FV to improving the transparency of financial statements, taking into account that transparency is a fundamental concept of accountability.

EMPIRICAL RESEARCH

Prior Research It is now broadly recognized that the opinions of the users of governmental financial statements play a key role in the endorsement of accounting standards (Christiaens, 2003; IFAC, 2011) and there have been many calls for greater user involvement in the standard setting process to boost the usefulness of decision taking (Balmford, 1977; Masel, 1983; Rahman, 1991; Harding and McKinnon, 1997). The quest to raise the quality of accounting standards is the foundation on which the users’ needs model is built (CICA, 1990; GASB, 1987; AARF, 1990). This is of overriding conse- quence because in order to attain the transparency claimed for the NPM approach, financial reporting must be of high quality and must report and reflect economic reality (SEC, 2001).

Nonetheless, up to now studies focused on users of government financial infor- mation have only addressed the question of identifying user information needs (Ingram and Copeland, 1981; Robbins, 1984, 1988; Lin and Raman, 1998; Tayib et al., 1999), highlighting the conclusion that financial position and ability to pay are the most important information needs for citizens and contributors, or determining the extent to which information needs are met by the accounting information currently provided (Brusca, 1997; López and Caba, 2004; Navarro, 2005).

In this regard, although some studies and statements have pointed out the impor- tance of the opinions of the users of financial statements with respect to improving

A BAC U S

354 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

the quality of the latter, there is a lack of empirical research into the effects of alternative valuation methods in public sector accounting and into the usefulness of different measurement bases for the purposes of accountability. Concretely, prior research has not investigated the usefulness for information users of the measure- ment basis adopted despite the fact that the choice between HCA and the FVA proposed by IPSAS is a cornerstone in improving transparency information.

Therefore, this paper investigates the perceptions of one of the main groups of information users about the usefulness of FVA for providing information transpar- ency, which is widely considered an essential tool for improving accountability under NPM.To achieve this aim, we sought the opinion of professionals with experience in issuing accounting standards used by a wide spectrum of financial information users, because their opinion, based on a broad perspective, is likely to be better supported than that of a single group of users.

By means of our analysis, we aim to contribute ideas to the debate on public accountability, which as noted above is currently focused on the relevance and reliability of FVA in the private sector. In the business sector, previous studies have concluded that the information obtained by the application of FVA is more relevant to users, but less reliable than that derived from the historical cost method. In the present paper, we examine whether in public accountability FVA has the capability of improving government accountability via enhanced financial transparency, and also whether the difficulties of obtaining FV estimations could be a determining factor in this capability. We study these questions by examining different types of assets and the existence or otherwise of markets.

Hypothesis Formulation As shown above, HCA and FVA do not seem to have the same capacity to increase the usefulness of financial statements and hence government accountability. Among the aspects highlighted by IFAC (2011) regarding government financial information, three characteristics may have a direct effect on transparency: comparability, under- standability and timeliness. Therefore, in analysing whether FVA could improve financial transparency we must study its capacity to advance the accomplishment of these three characteristics. In practice, to determine the real capacity of FVA to improve financial transparency, we must analyse the variables that influence its utility, such as the verifiability and objectivity of its estimates, together with their cost and means of quantification. Likewise, as in the business sector, the inclusion of more complete information in the Notes to government financial statements could improve the reliability of FV estimations. Therefore, this matter must be studied.

Our first hypothesis seeks to examine whether the reliability of the FV estimates in the Notes to financial statements affects their understandability, or whether finan- cial statements drawn up under FV are comprehensible even when no mention is made of this reliability. As FV estimations are based on certain presumptions, the users of the information obtained, and especially external users of financial report- ing, could need to know the method used to calculate FV measures and the initial presumptions made, in order to interpret the financial statements derived under FVA. With respect to the business sector, Miller and Bahnson (2007) indicated that

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

355 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

it was necessary to provide more complete disclosures to users so they had sufficient analytical ammunition to deal with the uncertainty produced by FV estimates.

Hypotheses 2 and 3, concerning comparability over time and among entities, respectively, examine the relation between the comparability of financial statements and the use of generally accepted methods and techniques in FV estimation.We seek to determine whether, through comparability, the use of these techniques influences the usefulness of financial statements created under FV for improving government financial transparency. In the business sector, as observed by Fuglister and Bloom (2008), recognized standards setters’ bodies play an essential role in issuing account- ing standards and thus establishing credible and generally accepted methods to improve comparability among different organizations. Taking into account the report published by the International Valuation Standards Committee (IVSC, 2007), we analyse the effects of appraisers’ estimations on comparability over time, as the methods used could depend on the current socioeconomic scenario.

Finally, Hypothesis 4 is aimed at identifying the possible association of the time- liness of financial statements with two conditions for FV viability: the cost of estimation and the need to hire the services of independent appraisers.According to Barth (2006), obtaining the values of public sector assets under FVA, based on future estimations, could delay the preparation of financial reporting, since these estimations would have to be calculated specifically for this purpose.

By the above means, we hope to establish whether the viability of FV estimations affects the transparency of the financial statements prepared under FVA. Accord- ingly, the following hypotheses were proposed and tested using the items indicated in Appendix B:

H1: The understandability of government financial statements issued under FVA is associated with the reliable estimation of the FV measures included in the Notes to financial statements.

H2: The comparability over time of government financial statements issued under FVA is associated with objective FV measures and with the need to hire independent appraisal services to estimate FV measures.

H3: The comparability among public sector entities of financial statements issued under FVA is associated with objective FV measures and with the possibility of using credible and generally accepted methods.

H4: The timeliness of government financial statements issued under FVA is asso- ciated with the cost of estimating FV measures and with the possibility of in-house estimation of FV measures.

Under the terms of this research study, by ‘independent appraisers’ we mean valu- ation professionals who neither have nor have previously had any direct or indirect financial interest in the entity, with the exception of their fees. One of the main advantages of the services of independent appraisers is the usefulness of their reports for the preparation of financial statements, as well as the role they play in assisting other external professionals such as auditors. This is corroborated in the international valuation standards issued by the IVSC (2007). This is a non- governmental organization constituted of the professional valuation associations

A BAC U S

356 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

from over 50 countries; moreover, it is a member, in its own right, of the United Nations.The projects carried out by IVSC are always developed in cooperation with UN member countries, in close collaboration with international bodies such as the OECD, the World Bank, the IMF, the WTO and the International Bank of Settle- ments. In addition, the IVSC maintains a close relationship with international accounting standard setters such as the IASB and the IFAC.

From the point of view of the public sector entity that issues financial statements, independent appraisers must vouch for: (a) the quality of assessment reports, under- stood as their relevance and reliability for users; and (b) the objective, unbiased and neutral nature of the estimations presented. Regarding the first aspect, the opinion of the independent appraisers hired can be described as technically qualified to the extent that they meet the requirements under the IVSC (2007) rules, such as having a professional certificate of studies and professional experience, having sufficient local knowledge, complying with the relevant legal requirements and having liability insurance coverage. Some countries, like Australia, New Zealand, the United Kingdom, France and Germany, require independent appraisers to comply with certain conditions, such as being an experienced expert, with a good knowledge of current trends in the economy, and market supply and demand, together with inter- disciplinary knowledge, including the areas of technology and the law (IVSC, 2007). Regarding the second of these aspects, both the IVSC (2007) standards and the European standards of appraisal values (TEGOVA, 2003) state that appraisers should conduct their affairs and act with honour, dignity, fairness, integrity and independence, seeking the satisfaction of their clients, of their profession and of the general public. Most developed countries have issued codes of conduct for indepen- dent appraisers.

Sample Selection and Research Methodology For the purposes of this study, we sought and analysed the attitudes of NASS regarding the effects of FVA on the comparability, understandability and timeliness of government financial information, in the belief that debate on the question of international accounting standardization could be enriched by further examination of the issue of standard setting, prior to undertaking public sector accounting reforms. It is now broadly recognized that the opinions of stakeholders in govern- ment financial statements play a key role in the endorsement of accounting stan- dards (Christiaens, 2003; Nasi and Steccolini, 2008; IFAC, 2011).

NASS were selected for our study because: (a) they are legally responsible for setting national accounting standards in each country and for other functions such as the analysis of financial information and acting as consultants to other users of financial information; (b) NASS are obliged to consider the economic effects of implementing these standards prior to implementation (Beaver 1973;Hawkings 1975; May and Sunderm 1976), because such standards contribute to the efficiency of resource allocation and to the distribution of wealth within an economy (Collet 1995); (c) generally,NASS have broad experience in setting national accounting standards to meet users’ needs; and (d) NASS are well informed of the current national situation and should be able to achieve a viable model based on users’ needs.

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

357 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

All the NASS selected for this study perform similar functions. According to the regulations governing the NASS in our sample, their main function is to develop standards to enable public administrations to provide financial information of use to management, political, supervisory, internal control and international structures and organizations. All the NASS in our sample have a public accounts analysis department, whose main function, as can be seen on their respective official web- sites, is to examine the capability of the information content of government finan- cial statements to meet the needs of financial information users, such as the following: taxpayers, beneficiaries of public sector services, financial analysts, inves- tors, creditors and suppliers, employers, political parties, institutions and companies granted subsidies, neighbourhood associations, trade unions, insurance companies, other government agencies, financial institutions, auditors, voters and citizens in general. Therefore, the NASS answered the survey questions fully aware of the information demands made by a wide range of users of governmental financial statements.

According to the rules governing their operations, NASS are also required to advise governments (including regional and local governments) regarding the accounting information they issue, especially for accountability purposes. Therefore, the requirement for NASS to possess detailed knowledge of the information needs of users of financial information is not limited to the state level; their activity also involves meeting the demands of the users of financial information published by regional and local governments.

As in the accounting system applicable to the business sector (IASB, 2005), regardless of the agenda of work facing NASS, they are required to be impartial in the issuance of accounting standards; to protect the interests of users of financial information in their respective countries; and to permanently seek to enhance standards so that the information needs of the greatest number may be met (IFAC, 2000).

The selection of NASS for the purposes of the present study is appropriate for the following reasons: (a) NASS are obliged to inform the international standards bodies of the specific information demands of users of financial statements in their respective countries, and thus act as a key channel for information flow towards the international standards setters bodies from financial information users (GASB, 1987; AARF, 1990; CICA, 1990; IFAC, 2011); and (b) once an international standard is issued, NASS study its ability to meet the information needs of users and to meet national legal requirements, including the capacity to amend international account- ing standards; this responsibility requires a thorough knowledge of the demands for information from the users of government financial statements (McGrew and Robotti, 2006). Therefore, the answers given by NASS to the survey questions proposed, being based on their professional experience, are not biased by goals such as the modernization of accounting systems, but are solely based on their own performance of the main task imposed: issuing high quality accounting standards, for users whose information needs are considered on an ongoing basis.

In general, the NASS in our sample provide two types of services: (a) issuing accounting standards and monitoring their application; and (b) offering technical

A BAC U S

358 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

support for computer management, and advising public sector organizations on the overall coordination and analysis of public accounts.Although some services are not dedicated specifically to the development of accounting standards,all of them support this work by enhancing the work of those responsible for issuing the standards that, once adopted,are formally disclosed by the institution. In fact,based on the operating rules of the NASS, those responsible for issuing accounting standards are required to take account of reports issued by the department for analysis of public accounts, in coordination with other departments, on the effectiveness of these standards in meeting the information demands of all financial information users.

The NASS provided us with an institutional response to the questionnaire, one that was non-personal and non-subjective. Initially, we contacted the director/ president of the institution and, after carefully explaining the research goals and methods, requested their cooperation in completing the questionnaire.The chairper- sons of the sample NASS designated, as a liaison officer, the person in their organi- zation responsible for issuing accounting standards. This liaison officer was sent instructions on how to complete the questionnaire, in coordination with the other departments within the NASS. Moreover, the institutional response to the question- naire, although managed by the liaison officer, was supervised and supported by the director/president of the NASS. Therefore, the individuals responsible for the accounting policy of each NASS in our sample served as the contact persons with our research team, but they did not complete the questionnaire considering exclusively their own perception of the usefulness of financial statements for the purposes of accountability.

In short, NASS are the only stakeholders who, for the sake of legal compliance, must concern themselves with the usefulness of financial statements for the other stakeholders. Accordingly, they must be aware of the information needs of all users of government financial information for accountability purposes. In the present study, the responses received were based on the experience of all the departments within each NASS institution, not just on that of the one responsible for issuing accounting standards. Therefore, we believe that the information obtained is rel- evant and reliable for the purposes of our research and that the findings are adequately supported.

The research methodology was based on a questionnaire inquiring into the rel- evance, reliability and viability of FVA. As developed countries in the West are undertaking the reform and modernization of their public administration, a process in which financial transparency is a key factor (Christensen and Laegreid, 2007; Alam and Nandam, 2005), the questionnaire was sent to official NASS in the most representative countries of the three main public administration and accounting traditions in Western democracies: the Anglo-Saxon, Nordic and European Conti- nental models. As a fundamental aspect of their administrative reforms, these coun- tries are interested in adapting their government accounting systems to the criteria of the international accounting standardization movement. According to IFAC (2011), all the NASS in our sample have a good knowledge of the IPSAS recom- mendations, and their government accounting systems are sufficiently developed to implement these standards. Indeed, many of these countries have already begun

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

359 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

work on adapting their public sector accounting standards to IPSAS. As a result, it was possible to include 29 countries in our sample; of these, 26 answered the ques- tionnaire (Appendix A).

The questionnaire items were expressly constructed for the purposes of this study, and were arrived at via a two-phase process. First, the research team drafted a preliminary version based on the conclusions of previous work in the field and on the recommendations of internationally respected standards setting organizations that have addressed the question of FVA. The items selected by the research team are justified on various grounds: we opted to include items relating to the relevance and reliability of government financial reporting because they are the main qualitative characteristics of financial reporting both in the main conceptual frameworks of financial reporting (FASB, 1980; IASB, 1989; IFAC, 2011) and in the IASB–FASB joint project on a conceptual framework for financial reporting (FASB, 2008; IASB, 2008;), as regards making government financial statements more useful for the purposes of financial transparency and accountability. The questionnaire also includes items aimed at clarifying the viability of FV estimations by analysing the real possibilities of implementing FV measures under NPM models. The present paper analyses the viability of FV estimations because this aspect could determine the reliability of the financial information published, and the capability of public administrations to estimate FV in its real context. In addition, the viability of whatever measurement basis is adopted is a key requisite to systematically obtaining financial statements on this basis.

Taking into account the main conceptual frameworks of financial reporting, the questionnaire items referring to the relevance of financial reporting examine quali- tative characteristics of financial reporting that are related to financial transparency, such as comparability, understandability and timeliness (items 1, 4, 7 and 9). Finan- cial reporting is relevant if it is useful when economic decisions must be taken and when it helps users assess past, present and future events. According to Llewellyn and Northcott (2005) and IFAC (1993) recommendations, if financial reporting is comparable over time and among different entities, then its users will have more support for the economic decisions taken under NPM frameworks because they will be able to compare the management of a public sector entity in regard to others in a similar situation and/or over different fiscal years. This makes comparability a qualitative characteristic that is linked to the relevance of financial reporting. As for understandability, the IASB (1989) conceptual framework states that if financial reporting is not understandable, then it is not relevant. Similarly, the FASB (1980) conceptual framework and the IASB–FASB joint project on a conceptual frame- work for financial reporting (FASB, 2008; IASB, 2008) both identify comparability and timeliness as qualitative characteristics linked to the relevance of financial reporting.

With respect to the reliability of FVA, the questionnaire includes four items on the main drawbacks that prior research has revealed in FV estimations, that is, possible problems of verifiability and objectivity (items 5 and 6). Thus, we seek to determine the extent of their presence in public sector accounting and analyse their effect on the usefulness of government financial statements for accountability purposes. In

A BAC U S

360 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

addition, the questionnaire includes items (Nos 2 and 3) on the effectiveness expected (by the NASS in our sample) of IPSAS proposals aimed at overcoming problems of verifiability and objectivity in FV estimations. In addition, items 8, 10 and 11 enable us to analyse the viability of FV measures, that is, whether, under the NPM framework, FV estimations are achievable in practice.

In the second of the phases involved in deciding upon the items to be included, and as an experimental approach, the text of the initial version of the questionnaire was sent to three NASS, one for each type of administrative culture represented in our sample, explaining the objectives of the study. The purpose of this communica- tion was not to obtain answers to the questionnaire, but rather to ascertain the opinions of these three NASS on the following: (a) the understandability of the questionnaire text; (b) the clarity of and possible ambiguities in the questions posed; and (c) the possible inclusion of other questions relevant to the study aims. The suggestions received were analysed and, when considered appropriate, incorporated into the text of the questionnaire.Thus, the text of some items in the first version was not modified. By contrast, other items were changed following the suggestions of these three NASS, improving understandability and clarity of the questionnaire. These changes highlight the following: (a) the increase of the text in some items, (b) replacement of terms by other more specific meaning, and (c) alteration of the order of some words. By this procedure, we obtained the second and final version. In addition, an annexe was attached to the questionnaire with the definitions of some of the concepts employed, as explained below.

This second version of the questionnaire was sent to all the NASS in our sample. The introductory letter to the liaison person in each organization stressed the need for him/her, before answering the questions, to be quite certain of having understood the meaning of each questionnaire item and the goals of this study. Moreover, these interlocutors were offered the possibility of clarifying possible doubts before com- pleting the questionnaire. In this respect, some emails were received concerning the exact meaning of some items; these questions were answered, and thus we may be reasonably sure that the questions measured the intended constructs.

Most of the doubts sought to confirm the meaning attributed in the questionnaire to certain terms and, in most of them, the respondent had properly understood each sentence. Moreover, our response to each doubt of the respondents included a final question in which we asked whether these responses had adequately solved their doubts; all of them said yes.

In accordance with IPSAS (IFAC, 2011), ‘fair value’ was defined in the question- naire as the amount for which an asset could be exchanged, or a liability settled between knowledgeable, willing parties in an arm’s-length transaction. The ques- tionnaire also included definitions of concepts based on the NPM framework. These concepts included objectivity, verifiability, generally accepted methods and expert appraisal values. Only one answer was allowed to each of the questions and the questionnaire was divided into two main sections: (a) the relevance of FVA versus HCA for improving the comparability, understandability and timeliness of govern- ment financial statements; and (b) the reliability and viability of FV measures. According to IPSAS, the method used to determine FV measures could depend on

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

361 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

the existence of an active, liquid market for assets. Therefore, the questionnaire addressed the attribute of the existence or otherwise of an active, liquid market for each item.

The text of the questionnaire also indicated that the concept ‘government finan- cial statements’ referred to the annual report issued by governments, not the finan- cial statements of public sector companies whose accounting system is often the same as or similar to that used in business accounting. In addition, the respondents were asked to answer the questionnaire taking into account the circumstances of the different levels of government in their respective countries, that is, the national and sub-national levels.

Based on prior research into attitudes (Collison et al., 2003; Emerson et al., 2007) and into the usefulness of accounting information (Dumontier and Raffournier, 2002), the respondents were asked to express their degree of agreement with each statement on a five-point Likert scale (ranging from 1 = strongly disagree to 5 = strongly agree). The categories included in the questionnaire represent an inherent order (weaker to stronger), but the numbers assigned to the categories do not indicate the magnitude of difference between them.

Our hypotheses were tested using the t-test and the Wilcoxon test. The paired t-test is commonly used to test the hypothesis of the equality of two means, and is the most powerful test available when the normality assumption for the differences is satisfied (Wilks, 1962; Rohatgi, 1976; Lehmann and Romano, 2005). However, if this assumption is violated, the paired t-test may fail to detect a true difference. In order to avoid a distributional assumption, nonparametric methods (e.g., the Wilcoxon signed rank test and the sign test) or permutation methods (Good, 2005) can be used. In these cases, the Wilcoxon paired-sample test could be a more powerful test of the null hypothesis (Wilks, 1962; Rohatgi, 1976; Hollander and Wolfe, 1999; Gibbons and Chakraborti, 2003). Therefore, we used both parametric (t-test) and nonparametric (Wilcoxon) methods to test the differences between paired attributes of the usefulness and viability of FV measures.

RESULTS

Descriptive Analysis Of the 29 questionnaires mailed, 26 responses were received (89.66% of the sample countries) (Appendix A). Appendix C shows the descriptive statistics of the results of the empirical research.

According to our questionnaire results, if public sector entities applied FVA in their financial statements, greater understandability would be achieved than with HCA, especially if the assets acquired could be traded in an organized, active and liquid market (mean questionnaire scores of 4 and 3.83, respectively). Without such a market, it is less clear whether FVA would improve the usefulness of financial statements. Moreover, financial information based on FVA would be more compa- rable among organizations than that obtained via HCA, although in this case, too, the non-existence of markets for the assets would limit the usefulness of FVA (4.12 vs 2.78), albeit to a lesser degree than for understandability.The use of FVA to set an

A BAC U S

362 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

accounting value on assets would increase the comparability of financial statements over time, especially for organizations with large volumes of financial investments. Again, the benefits derived from FVA are more questionable when there are no markets for the assets. Thus, when markets are nonexistent, FVA is more significant in increasing comparability over time than in increasing understandability and inter- organization comparability. Likewise, the timeliness of financial statements would be improved if FVA replaced HCA, and more so when organizations possess greater quantities of non-financial assets (i.e., property, plant and equipment), although once again an absence of markets for the assets would limit the benefits to be gained from FVA (4 vs 2.94).

With respect to understandability, comparability and timeliness, our analysis of the standard deviation values recorded shows that some of the largest variations in opinions are obtained when FV is applied to non-financial assets for which active markets exist, while the highest degree of uniformity was found for the case of financial assets for which markets exist. For financial assets, the non-existence of appropriate markets is associated with a greater disparity of opinions regarding the understandability and timeliness of financial information based on FVA. In the case of non-financial assets, the non-existence of markets is related to a higher level of differences of opinion, too, in the answers on comparability.

This analysis is interesting in that it contributes ideas to the current debate on FV, which is the fundamental aim of this paper. In view of the fact that declarations by international bodies (IFAC, 1993; FASB, 2008; IASB, 1989, 2008) have considered understandability, comparability and timeliness to be significant characteristics of financial information, the positive effect of FV in enabling these characteristics to be achieved could improve the usefulness of government financial statements with respect to transparency and, therefore, accountability. Nevertheless, as remarked above, this usefulness is more debatable for public sector entities that possess assets that are not actively traded. Furthermore, although the use made of the assets held does not seem to strongly influence the replies made, the degree of agreement on the capacity of FV to facilitate the accomplishment of the abovementioned character- istics is lower in the case of non-financial assets.These results are consistent with the usefulness of FV for administrative reforms, which has been recognized by authors such as Sutcliffe (2003), Navarro and Rodríguez (2007) and Haque (2006), and also with the results of studies on FV in the context of private business, such as Elad (2004) with respect to the agricultural sector, Ball (2006), who analysed the case of investors, and Betts and Wines (2004), who studied the relation between FV and legal decisions in Australia. However, the results of our empirical study, as well as specifically reflecting the effects of applying FVA to public sector assets, provide a significant extension to our understanding of the quality of financial information based on FV, enabling us to conclude that this financial measuring approach is capable of improving the understandability, comparability and timeliness of govern- ment financial information, and thus of improving the transparency and account- ability of public sector organizations.

The results obtained show that the adoption of FVA for evaluating public assets, for accounts purposes, could alleviate the uniformity of values, which is the main

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

363 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

problem commonly recognized with respect to benchmarking analysis (Morely et al., 2001; Folz, 2004; Ortiz et al., 2006), and thus contribute to improving the transpar- ency of government financial statements. In parallel with this, to the extent that the publication of understandable information could help narrow the power gap between managers and citizens (Matheson and Kwon, 2003; Bastida and Benito, 2007), financial information based on FV could be an instrument favouring transparency. In addition, the results obtained concerning timeliness are consistent with the conclusions reached by Barth (2006) regarding private companies; this author claimed that FV improved the timeliness of financial statements, and thus, in accordance with authors such as Blöndal et al. (2004) and Bastida and Benito (2007), this evaluation criterion could improve transparency, which is a key element in accountability.

The results obtained, moreover, confirm the existence of problems of reliability in FV estimations, with respect to companies in the private sector, reported by authors such as Benston (2008), Martin et al. (2006), Ronen (2008), Danbolt and Rees (2008) and Whittington (2008). In relation to objectivity, our results are similar to those of the above studies; with FV estimations, a considerable amount of objectivity is lost when public assets cannot be traded in active, open markets. Nevertheless, our respondents as a whole acknowledged the existence of generally accepted methods for estimating FV, especially when appropriate markets exist. They also recognized, although to a lesser extent, that the cost incurred in applying FVA would be afford- able for public sector organizations. In any case, it is clear that the non-existence of markets produces greater recognition of the need to hire external appraisers; this follows from the impossibility of FV estimations being performed by the organiza- tion’s own personnel. In general, and as in the cases of understandability, compara- bility and timeliness, the difficulties of reliability do not seem to depend on the type of asset to which FV is applied.

Despite these reservations, our results show clearly that problems of reliability, with respect to FVA, could be overcome, at least partially, as the objectivity and verifiability of FV measures would be increased by including the methods and hypotheses used in the Notes to the financial statement.

With respect to measures of dispersion, there was a wide variation of opinions in the case of the problems of objectivity in FVA, especially when no markets exist for the assets to be valued. However, opinions on the existence of generally accepted methods present a higher degree of consensus when there are no markets for the assets in question. The greatest heterogeneity of replies was obtained regarding the need to hire external appraisers, while the opinions on the cost of obtaining FV estimations presented one of the highest levels of agreement among our respondents.

In general, the results obtained confirm that FV is less reliable when no appro- priate markets exist, as reported by AAAFASC (2005), and also that if markets do exist, then the replacement of historical cost by FV estimation could improve the objectivity of financial statements, which is in agreement with the views of ICAEW (2006). This is also consistent with the widespread recognition of the existence of generally accepted methods of estimation. However, our empirical study has also

A BAC U S

364 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

highlighted the advantages of including, in the Notes to financial statements, infor- mation regarding the FV estimations made, especially the consequent reduction of problems of reliability, whether or not there exist markets for the assets in question. In addition, our results concur with those published by Benston (2008), in that the non-existence of market prices tends to increase the cost of obtaining FV estima- tions, although this cost appears to be affordable for public sector organizations.

We were also interested to examine whether the demographic data for each country might be reflected in differences in our questionnaire replies.Therefore, and as shown in Tables C3 and C4 (Appendix C), the sample was divided into two groups, differentiated by two variables: population size and GDP per capita (taking the median value in each case). Countries were considered to have a large popula- tion when they had more than 9,210,952 inhabitants; the remaining countries were classified as having a small population. In a similar way, countries were taken as having a large GDP when per capita GDP exceeded $US34.46, and the remaining countries were classified as having a small GDP.

On the basis of these categories, the attitudes in large and small countries did not vary greatly with respect to understandability, comparability and timeliness of finan- cial information based on FV; neither were there any noteworthy differences in the dispersion of opinions. However, the comparability of financial information based on FV was somewhat more generally recognized in large countries for the case of non-financial assets for which markets exist. On the contrary, timeliness was rated higher among smaller countries than in the larger ones. Moreover, in large countries there was greater recognition of the objectivity of financial information based on FV, the existence of generally accepted methods for obtaining FV estimations and the need to hire external appraisers.There were no significant differences with respect to the recognition of the usefulness of including relevant information in the Notes to financial statements in order to address the problems of reliability in FV estimations (although in this respect attitudes were slightly more favourable among larger countries).

In our segmentation of the sample by GDP, opinions on the understandability, timeliness and, especially, comparability were rather more favourable among the countries with a lower GDP, and there were no large differences in the respective measures of dispersion.With respect to problems of reliability, when markets for the assets exist there were no clear differences between the attitudes of the two groups, except in the case of the need to hire external appraisers, which was more clearly recognized among the countries with a low per capita GDP. Furthermore, in the absence of markets for the assets, the respondents in the low-GDP countries also expressed a higher degree of recognition of the objectivity of FV, of the existence of generally-accepted valuation methods and of the possibility of public organizations’ meeting the cost of FV estimation.

In summary, for the entire sample, in general, the adoption of FVA could improve the usefulness of government financial statements for the purposes of accountability, as its application would increase the understandability, comparability and timeliness of government financial statements, provided that the assets held by public sector organizations, whatever use was made of them, could be traded in an organized,

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

365 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

active and liquid market. However, FV estimations could involve problems of reli- ability, although this problem might be overcome by including information in the Notes on the estimations made. With these considerations in mind, we analysed whether such problems of reliability might prejudice government accountability. This was done by means of a hypothesis test to determine whether the lack of reliability of FV estimations decreases the understandability, comparability and timeliness of financial statements, these three characteristics of financial information being associated with transparency.

Hypothesis Testing Descriptive analysis shows that the existence of markets can be crucial to the usefulness of FVA, especially for non-financial assets (Appendix C).Thus, to test H1, we examined the statements made concerning the non-existence of markets. FV measures for financial assets seem to be readily comparable. H2 and H3 were tested by analysing the opinions on non-financial assets, as in this case it is more difficult to find a market providing comparable evaluations.Likewise, the main problems regard- ing the timeliness of FVA-based financial information arise when it concerns non- financial assets for which no market exists, which is the situation addressed in H4.

The results of hypothesis testing are included in Appendix 4. The results obtained do not support H1. The understandability of financial statements under FVA is not associated with the reliability of FV estimations, although it is recognized that the objectivity and verifiability of FV measures could be increased if the methods and hypotheses used to measure FV were included in the Notes to financial statements. The observed difference is revealed by the paired t-test; p < 0.05 and therefore the mean values of the opinions about improving the understandability of government financial statements under FVA are not the same as those about the objectivity and verifiability gained by the inclusion of methods and hypotheses in the Notes to financial statements. This statistical result is confirmed by the nonparametric Wilcoxon test, which shows that H1 cannot be supported (p < 0.05); therefore the attributes compared are significantly different.

Although the inclusion in the Notes of information on how FV estimations were obtained might contribute to reducing the problems of reliability identified in earlier studies (AAAFASC, 2005; ICAEW, 2006; Benston, 2008; Whittington, 2008), we found no evidence that this inclusion favours the understandability of government financial statements. Therefore, explaining in the Notes the methodology used in estimating FV could contribute to improving accountability, through its positive effect on the objectivity and verifiability of financial information, but it remains unclear as to whether this would benefit the understandability of financial state- ments. It seems, therefore, that the understandability of financial information based on FVA depends on the capacity of the latter to reflect current market circum- stances; this conclusion is in accordance with the findings of Sutcliffe (2003) and Eccles et al. (2001), and also with those of Whittington (2008) who expressed it as ‘capturing the economic substance’. However, it is not necessary for the annual accounts to include data aimed at facilitating understanding of how FV estimations are calculated. Accordingly, even if the Notes do not include information on these

A BAC U S

366 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

estimations, adoption of the FV approach could improve the understandability of government financial statements, and thus improve the transparency and account- ability of public organizations.

By contrast, the improved comparability over time of government financial statements issued under FVA is associated with objective FV measures and with hiring independent appraisers (H2). The paired t-test shows that H2 is supported (p > 0.05). These results are confirmed by the Wilcoxon test (p > 0.05) and there- fore the attributes compared are not significantly different. Therefore, the objec- tivity of FV measures and hiring independent appraisers are determinant factors in improving the comparability over time of government financial statements. Accordingly, in order to realize the favourable view taken by Barth (2006) with respect to the comparability of FV, it would be essential for the estimations of value to be sufficiently objective and for them to be made by independent apprais- ers. This very proposal has been made by the IPSAS (IFAC, 2008) for quantifying the FV of assets. Only thus can financial statements based on FV resolve the problems of uniformity in benchmarking analysis that have been highlighted by authors such as Folz (2004), Morely et al. (2001) and Ammons et al. (2001). In conclusion, FVA could improve the transparency of government financial state- ments through an increase in their comparability over time, but with the condition that external appraisers should be hired in order to achieve sufficiently objective estimations. Nonetheless, when an active market does not exist, the comparability of financial statements over time under FVA is not associated with hiring inde- pendent appraisers to estimate FV measures. Thus, if there are no appropriate markets, the positive effect to be expected from hiring such independent apprais- ers is open to doubt.

On the other hand, greater comparability of financial statements under FVA among public sector entities (H3) was found to be associated with objective FV measures and with the use of credible, generally accepted methods for calculating FV measures. The paired t-test supports hypothesis 3 (p > 0.05), which is confirmed by the Wilcoxon test (p > 0.05). Therefore, the objectivity of FV measures and the existence of credible, generally accepted methods for calculating FV measures are determinant factors in improving the comparability of government financial state- ments among public sector entities. These results provide additional support for the conclusions of authors such as Morely et al. (2001), Ammons et al. (2001), Ortiz et al. (2006) and Navarro and Rodríguez (2007), who have recognized that one of the main drawbacks to benchmarking analysis lies in the absence of generally accepted methods for quantifying asset values. The results of our empirical study confirm the latter view, and show, moreover, that the absence of such methods could limit the capacity of FVA to favour comparability among the financial statements produced by different public organizations, thus prejudicing their transparency and account- ability. In short, therefore, FVA could improve the transparency of government financial statements by increasing comparability among public organizations, pro- vided that use is made of generally accepted valuation methods, providing suffi- ciently objective estimations. Nonetheless, when FV measures are used for property, plant and equipment and an active market does not exist, there is no such associa-

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

367 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

tion. Thus, in the absence of an appropriate market it is unclear whether the appli- cation of generally accepted methods would improve comparability between the financial statements produced by public organizations.

Finally, the paired t-test supports H4 (p > 0.05). There is a clear association between opinions about improving the timeliness of government financial state- ments and the possibility of in-house evaluations. Nonetheless, this association is not conclusive regarding the acceptable cost of estimating FV measures (p = 0.096). The Wilcoxon paired-sample test confirms the t-test paired-sample results (p > 0.05). Thus, NASS opinions about improving the timeliness of governmental financial statements could depend more on the need for in-house evaluation of FV measures than on the price that the public entity would be prepared to pay to obtain them.

Accordingly, for FVA to favour the timeliness of government financial statements in the terms described by Matheson and Kwon (2003) and Bastida and Benito (2007), and thus, transparency, it is essential for the public organizations concerned to have their own personnel systematically perform FV estimations (although, as noted above, the hiring of external appraisers could compensate for the shortcom- ings of public sector staff in this respect). Although some authors, such as Barth (2006) and Rodríguez and Navarro (2007), have studied the timeliness of govern- ment financial statements, none of them have identified significant factors in this respect. Our test of H4 shows that the ability or otherwise of public sector personnel to perform FV estimations could limit the timeliness of financial information based on FVA. Moreover, the cost involved in obtaining these estimations does not seem to pose any limitation to the timeliness of the operation.Therefore, the FV approach could improve the transparency of government financial statements, and increase their timeliness, but the skills possessed in this respect by the staff employed in public administrations would be a crucial factor.

DISCUSSION AND CONCLUSIONS

In the current process of modernizing public administration systems, calls have been made for greater information transparency, which is a key concept of accountability. Endorsing an internationally accepted set of accounting standards, such as IPSAS, and implementing FVA to measure the value of public assets, could enhance the usefulness of government financial statements with respect to improving financial transparency.

The contribution of the present study to the current debate on FVA lies in its analysis of the repercussions of this valuation criterion on the usefulness of govern- ment financial statements for specific purposes of accountability. Thus, we may gain further understanding of the greater relevance of FVA versus the historical cost approach, a view that has been proposed in previous studies in the context of private companies. In this paper, we provide additional evidence on the question of public sector assets and transparency. Furthermore, we build upon and extend previous findings; as well as examining whether public sector organizations suffer the prob- lems of reliability with respect to FV estimations that have been identified in private companies, we analyse whether these problems produce a negative effect on the

A BAC U S

368 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

usefulness of government financial statements for the purposes of accountability, and investigate the effectiveness of certain methods put forward to resolve such problems.

With respect to the first of the goals set out for this paper, the results of our empirical analysis show that FV could favour the transparency of government financial statements, and thus their transparency, by favouring the accomplishment of three qualitative characteristics (understandability, comparability and timeliness) that have been considered relevant in this respect by bodies such as IFAC (1993), FASB (2008) and IASB (1989, 2008). However, when suitable markets do not exist, attitudes among our respondents are mixed regarding the positive impact of imple- menting FVA.

More specifically, empirical research indicates that the understandability of gov- ernment financial statements could be improved under FVA. Hypothesis testing reveals that its implementation could improve the understandability of government financial statements even if the methods used to estimate FV are not included in the Notes to financial statements, because, unlike HCA, FVA takes into account current market circumstances to evaluate public sector assets.

This improvement in understandability could contribute to closing the power gap between managers and citizens, identified by Matheson and Kwon (2003) and Bastida and Benito (2007), by making financial statements more transparent. This could favour, on the one hand, greater participation in public management by non-accounting specialist external users, such as voters, taxpayers, users of public sector services, insurance companies and licensor grant entities and, on the other hand, the meeting of the needs of internal users responsible for the management of public sector assets, such as public managers, government executives and finance officers. In this respect, future research could examine whether the implementation of new valuation criteria, more understandable than historical cost, could influence the participation of certain interest groups in public management, through an analy- sis of their specific information requirements.

In addition, descriptive statistics show that the comparability of government financial statements among public sector entities and over time is improved when FV measures are used, although this is affected by the existence or otherwise of an active market. This improved understandability could alleviate the main problem recognized by theoreticians with respect to the performance of benchmarking analy- sis (Morely et al., 2001; Folz, 2004; Ortiz et al., 2006), namely the uniformity of values. Therefore, it might be possible to improve the transparency of government financial statements and, therefore, the accountability of public sector organizations.

In particular, the comparability of financial statements over time could be pro- moted by the use of objective FV measures and by hiring independent expert appraisers. Nonetheless, if public sector entities own a large amount of property, plant and equipment and an active market for these assets does not exist, hiring independent appraisers would not guarantee such an improvement. Moreover, the comparability of financial statements among public sector entities could be improved by the use of objective FV measures and credible, generally accepted means of obtaining them. Again, this is less apparent if public sector entities

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

369 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

own a large amount of property, plant and equipment and an active market does not exist.

Thus, our study confirms the findings of previous research in the private sector, that problems of reliability in FV estimations are greater for non-financial assets, a factor that could reduce the relevance of this valuation criterion, as observed by Whittington (2008). In addition, we noted, in accordance with Benston (2008), that the absence of suitable markets could make FV estimations more costly to deter- mine and verify; furthermore, hiring external appraisers for this task might not guarantee the difficulties of reliability associated with FVA would be overcome if this approach were applied to non-financial assets.

In the case of financial instruments, the use of FV measures could improve the comparability of government financial statements, since these instruments are usually traded in active markets and so FV measures are verifiable. Accordingly, the implementation of FVA to issue financial statements would allow public managers to have a better knowledge to assess the strong and weak points in managing public sector assets, in comparison with other public sector entities and over time, providing a comparison of their results in practical terms. Furthermore, managers could then decide their most efficient allocation.

Although descriptive statistics indicate that FVA could improve the timeliness of government financial reporting, this is associated with the possibility of FV being calculated in-house and with the cost of this activity being acceptable. Nonetheless, the possibility of FV being estimated in-house is more influential in improving timeliness than is the affordability or otherwise to the public sector of the in-house approach. Therefore, FVA could improve the transparency of government financial statements by improving their timeliness, although the skills of the public sector personnel would be a crucial issue in this respect. Accordingly, before incorporating FVA into government financial statements, it would be interesting to study the preparation of public sector staff to assess assets using FV criteria. Future studies on the training of public sector staff with respect to performing FV estimation, and its relation to the timeliness of the information provided, could shed further light in this respect.

The results of the present study show that the questions regarding problems of reliability associated with FV estimations in private sector accounts (Martin et al., 2006; Benston, 2008; Ronen, 2008; Danbolt and Rees, 2008; Whittington, 2008) could have a negative influence on the usefulness of government financial statements for the purposes of accountability. In addition, we have found evidence that if public sector entities provided more complete disclosures to deal with the uncertainty produced by FV estimates, the difficulties of reliability concerning this measurement basis could be reduced. Therefore, in government accounting information systems, the Notes to financial statements could play a key role in the implementation of FVA as a tool for enhancing financial transparency and accountability.

In summary, the NASS sampled believe that the international accounting harmo- nization movement, including FVA implementation, could enhance accountability by improving three essential aspects of transparency: understandability, comparabil- ity and timeliness in government financial reporting. However, the use of objective

A BAC U S

370 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

measures to estimate the FV of assets is fundamental to this process. The existence of an active market is crucial to improving the comparability of financial statements under FVA. Likewise, improving timeliness could be limited by the possibility of estimating FV measures in-house.

Finally, the findings reported in this paper reveal the need to carry out further studies of FVA in public sector organizations. Irrespective that the debate FVA/ HCA can be enriched by the analysis of the attitudes of other stakeholders (analysts, supreme auditing institutions, etc.), there are several issues whose study can be very interesting to determine whether the FVA should be taken in the preparation of governmental financial statements. It might be interesting to analyse the relevance of financial information when the FV is applied to assets not included in this paper, such as intangible assets, investment property and stocks. Furthermore, in relation to the reliability of financial statements based on FVA, future research should advance on the study of the technical specifications to be met by methods and assumptions used in the estimations as well as in the quantification criteria to ensure objectivity and verifiability of the accounting figures.

references

AAAFASC, ‘Response to the FASB’s Exposure Draft on Fair Value Measurements’, Accounting Hori- zons, Vol. 19, No. 3, 2005.

Alam, M., and R. Nandam, Public Sector Reform and Accounting Change in a Cultural Environment, paper presented at the 10th CIGAR Conference, Poitiers, May 2005.

Ammons, D. N., C. Coe and M. Lombardo, ‘Performance-Comparison Projects in Local Government: Participants’ Perspective’, Public Administration Review, Vol. 61, No. 1, 2001.

Asociación Española de Contabilidad y Administración de Empresas, Marco conceptual para la infor- mación financiera, Documento de Principios Contables No. 22, AECA, 1999.

Aucoin, P., ‘Administrative Reform in Public Management Paradigms, Principles, Paradoxes, and Pendu- lums’, Governance, Vol. 3, No. 2, 1990.

Australian Accounting Research Foundation, SAC 2, Objective of General Purpose Financial Reporting, AARF, 1990.

Ball, R., International Financial Reporting Standards (IFRS): Pros and Cons for Investors, Accounting and Business Research, International Accounting Policy Forum, 2006.

Balmford, J. D., ‘Accounting Standards—Development and Prospects Since 1972’, Australian Accountant, No. 47, 1977.

Barth, M., ‘Including Estimates of the Future in Today’s Financial Statements’, Accounting Horizons, Vol. 20, No. 3, 2006.

Barth, M., and W. R. Landsman, ‘Fundamental Issues Related to Using Fair Value Accounting for Financial Reporting’, Accounting Horizons, Vol., 9, No. 4, 1995.

Bastida, F., and B. Benito, ‘Central Government Budget Practices and Transparency: An International Comparison’, Public Administration, Vol. 85, No. 3, 2007.

Beaver, W. H., ‘What Should Be the FASB’s Objectives?’, Journal of Accountancy, Vol. 136, No. 2, 1973.

Benito, B., I. Brusca and V. Montesinos, ‘The Harmonization of Government Financial Information Systems: The Role of the IPSASs’, International Review of Administrative Sciences, Vol. 73, No. 2, 2007.

Benston, G. J., ‘The Shortcomings of Fair-Value Accounting Described in SFAS 157’, Journal of Account- ing and Public Policy, Vol. 27, No. 2, 2008.

Betts, J., and G. Wines, ‘Application of the Fair-Value Concept: Evidence From Australian Legal Deci- sions’, Australian Accounting Review, Vol. 14, No. 1, 2004.

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

371 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

Bies, S., ‘Fair Value Accounting’, Federal Reserve Bulletin, Vol. 91, No. 1, 2005.

Blöndal, J., R. Jón and M. Ruffner, ‘Issues in Accrual Budgeting’, OECD Journal on Budgeting, Vol. 4, No. 1, 2004.

Bradbury, M., ‘Discussion of Whittington’, Abacus, Vol. 44, No. 2, 2008.

Brusca, I., and V. Montesinos, ‘Are Citizens Significant Users of Government Financial Information?’, Public Money and Management, Vol. 26, No. 4, 2006.

Brusca, M. I., Un modelo de información contable para el análisis de la viabilidad financiera en la administración local [An accounting system model for the assessment of financial viability in Local Administration], City Council of Zaragoza, 1997.

Canadian Institute of Chartered Accountants, Public Sector Accounting: Local Government Financial Statement No. 6, Objectives and General Principles, CICA, 1990.

CFA Institute, Centre for Financial Market Integrity, A Comprehensive Business Reporting Model: Financial Reporting for Investors, CFA, 2007.

Christensen, T., and P. Lægreid (eds), Transcending New Public Management. The Transformation of Public Sector Reforms, Ashgate, 2007.

Christiaens, J. R., ‘Accrual Accounting Reforms in Belgian Local Governments: A Comparative Exami- nation’, Journal of Public Budgeting, Accounting and Financial Management, Vol. 15, No. 1, 2003.

Collet, P., ‘Standard Setting and Economic Consequences: An Ethical Issue’, Abacus, Vol. 31, No. 1, 1995.

Collison, D., N. Lorraine and D. Power, ‘An Exploration of Corporate Attitudes to the Significance of Environmental Information for Stakeholders’, Corporate Social Responsibility and Environmental Management, No. 10, 2003.

Danbolt, J., and W. Rees, ‘An Experiment in Fair Value Accounting: UK Investment Vehicles’, European Accounting Review, Vol. 17, No. 2, 2008.

Dumontier, P., and B. Raffournier, ‘Accounting and Capital Markets: A Survey of the European Evi- dence’, European Accounting Review, Vol. 11, No. 1, 2002.

Eccles, R. G., R. H. Herz, E. M. Keegan and D. M. H. Phillips, The Value-Reporting Revolution, Wiley, 2001.

Elad, C., ‘Fair Value Accounting in the Agricultural Sector: Some Implications for International Account- ing Harmonization’, European Accounting Review, Vol. 13, No. 4, 2004.

Emerson, T. L. N., S. J. Conroy and C. W. Stanley, ‘Ethical Attitudes of Accountants: Recent Evidence From a Practitioners’ Survey’, Journal of Business Ethics, Vol. 71, No. 1, 2007.

Financial Accounting Standards Board, SFAC 2, Qualitative Characteristics of Accounting Information, FASB, 1980.

——, Exposure Draft, Conceptual Framework for Financial Reporting: Chapter 1: The Objective of Financial Reporting. Chapter 2: Qualitative Characteristics and Constraints of Decision-useful Financial Reporting Information, FAS 1570-100, FASB, 2008.

Folz, D. H., ‘Service Quality and Benchmarking the Performance of Municipal Services’, Public Admin- istration Review, Vol. 64, No. 2, 2004.

Fuglister, J., and J. Bloom, ‘Analysis of SFAS 157, Fair Value Measurements’, CPA Journal, January 2008.

Gibbons, J. D., and S. Chakraborti, Nonparametric Statistical Inference, 4th ed., Marcel Dekker, 2003.

Goldfrank, B., Lessons From Latin American Experience in Participatory Budgeting, Proceedings of the Latin American Studies Association Meeting, San Juan, Puerto Rico, March 2006.

Good, P., Permutation, Parametric, and Bootstrap Tests of Hypotheses, 3rd ed., Springer, 2005.

Governmental Accounting Standards Board, Concepts Statement No. 1, Objectives of Financial Report- ing, GASB, 1987.

——, Statement No. 11, Measurement Focus and Basis of Accounting: Governmental Fund Operating Statements, GASB, 1990.

——, Summary of Statement No. 35, Basic Financial Statements—and Management’s Discussion and Analysis—for Colleges and Universities—an Amendment of GASB Statement No. 34, www. gasb.org, 1999.

Haque, M. S., ‘Modernizing Government: The Way Forward—an Analysis’, International Review of Administrative Sciences, Vol. 72, No. 3, 2006.

A BAC U S

372 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

Harding, N., and J. McKinnon, ‘User Involvement in the Standard-Setting Process: A Research Note on the Congruence of Accountant and User Perceptions of Decision Usefulness’, Accounting, Orga- nizations and Society, Vol. 22, No. 11, 1997.

Häusler, G., ‘The Insurance Industry, Systemic Financial Stability, and Fair Value Accounting’, Geneva Papers on Risk and Insurance, Vol. 29, No. 1, 2004.

Hawkings, D., ‘Financial Accounting, Standard Board and Economic Development’, in J. Burton (coord.), The Emmanuel Saxe Distinguished Lecture in Accounting: Fair Presentation: Another View, Bernard M. Baruch College, City University of New York, 1975.

Hollander, M., and D. A. Wolfe, Nonparametric Statistical Methods, 2nd ed., John Wiley & Sons, 1999.

Hood, C., ‘A Public Management for All Seasons?’, Public Administration, Vol. 69, No. 1, 1991.

——, ‘Contemporary Public Management: A New Global Paradigm?’, Public Policy and Administration, Vol. 10, No. 2, 1995.

Hughes, O., Public Management and Administration, Macmillan, 1994.

Ingram, R. W., and R. M. Copeland, ‘Municipal Accounting Information and Voting Behaviour’, The Accounting Review, Vol. 56, No. 4, 1981.

Institute of Chartered Accountants in England and Wales, Measurement in Financial Reporting: Infor- mation for Better Markets, ICAEW, 2006.

International Accounting Standards Board, Conceptual Framework for the Preparation and Presentation of Financial Statements, www.iasb.org, 1989.

——, Draft Memorandum of Understanding on the Role of Accounting Standard-Setters and Their Rela- tionships With the IASB, IASB, 2005.

——, Exposure Draft of An Improved Conceptual Framework for Financial Reporting: Chapter 1: The Objective of Financial Reporting. Chapter 2: Qualitative Characteristics and Constraints of Decision-useful Financial Reporting Information, IASB, 2008.

International Federation of Accountants, Managing Quality Improvements, IFAC, 1993.

——, Government Financial Reporting: Accounting Issues and Practices, PSC Study 11, IFAC, 2000.

——, Handbook of International Auditing, Assurance, and Ethics Pronouncements, www.ifac.org, 2008.

——, Handbook of International Public Sector Accounting Pronouncements, www.ifac.org, 2011.

International Public Sector Accounting Standards Board, Conceptual Framework for General Purpose Financial Reporting by Public Sector Entities: The Objectives of Financial Reporting. The Scope of Financial Reporting, The Qualitative Characteristics of Information Included in General Purpose Financial Reports, The Reporting Entity, IPSASB, 2008.

International Valuation Standards Committee, International Valuation Standards, IVSC, 2007.

Kopits, G., and J. Craig, Transparency in Government Operations, Occasional Paper 158, International Monetary Fund, 1998.

Lehmann, E. L., and J. P. Romano, Testing Statistical Hypotheses, 3rd ed., Springer, 2005.

Lin, W., and W. Raman, ‘The Housing Value-Relevance of Governmental Accounting Information’, Journal of Accounting and Public Policy, Vol. 17, No. 2, 1998.

Llewellyn, S., and D. Northcott, ‘The Average Hospital’, Accounting, Organizations and Society, Vol. 30, No. 6, 2005.

López, A. M., and C. Caba, ‘The Relevance of Spanish Local Financial Reporting to Credit Institution Decisions:An Empirical Study’, International Journal of Public Sector Management, Vol. 17, No. 2, 2004.

Lüder, K., ‘Governmental Accounting in West European Countries: With Special Reference to the Federal Republic of Germany’, in J. L. Chan and R. H. Jones (eds), Goverrmental Accounting and Auditing: International Comparisons, Routledge, 1988.

——, Research in Comparative Governmental Accounting Over the Last Decade: Achievements and Problems, Proceedings of the 8th Cigar Conference, Valencia, 2001.

Lüder, K., and B. Kampmann, Harmonisierung des öffentlichen Rechnungswesens in der Europäishen Gemeinshaft, Speyer Forschungsinstitut für Öffentliche Verwaltung bei der Hochschule für Verwal- tungswissenschaften Séller, 1993.

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

373 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

Martin, R. D., J. S. Rich and T. J. Wilks, ‘Auditing Fair Value Measurements: A Synthesis of Relevant Research’, Accounting Horizons, Vol. 20, No. 3, 2006.

Masel, L., ‘The Future of Accounting and Auditing Standards’, Australian Accountant, Vol. 53, No. 8, 1983.

Matheson, A., and H. S. Kwon, ‘Public Sector Modernization: A New Agenda’, OECD Journal on Budgeting, Vol. 3, No. 1, 2003.

May, R. G., and G. L. Sunderm, ‘Research for Accounting Policy: An Overview’, The Accounting Review, October 1976.

McGrew, T., and P. Robotti, The Role of Deliberation in the Governance of International Accounting Standards, 1st Annual Garnet Conference, Amsterdam, September 2006.

Miller, P. B., and P. R. Bahnson, ‘Refining Fair Value Measurement’, Journal of Accountancy, November 2008.

Morely, E. S., S. P. Bryant and H. P. Hatry, Comparative Performance Measurement, Urban Institute Press, 2001.

Nasi, G., and L. Stecolini, ‘Implementation of Accounting Reforms: An Empirical Investigation Into Italian Local Governments’, Public Management Review, Vol. 10, No. 2, 2008.

Navarro, A., ‘A Proposal for the Application of Valuation Models Included in the International Account- ing Standards to Spanish Public Sector Entities’, Spanish Review of Accounting and Finance, No. 126, 2005.

Navarro, A., and M. P. Rodríguez, ‘The Contribution of International Accounting Standards to Imple- menting NPM in Developing and Developed Countries’, Public Administration and Development, Vol. 27, No. 4, 2007.

Navarro, A., M. P. Rodríguez and D. Ortiz, ‘The Effect of the Endorsement of International Public Sector Accounting Standards on the Controlling and Monitoring Functions of the Supervisory Bodies in Spain (OCEXs)’, Spanish Review of External Supervisory Bodies, Vol. 9, No. 25, 2007.

Organization for Economic Co-Operation and Development, Administration as Service, the Public as Client, OECD, 1987.

Ortiz, D., A. Navarro and A. López, ‘Consensus Among Public Managers as Strategy for Standardization of Performance Indicators’, International Public Management Journal, Vol. 9, No. 4, 2006.

Pollitt, C., and G. Bouckaert, Public Management Reform: A Comparative Analysis, 2nd ed., Oxford University Press, 2004.

Pollitt, C., S. Van Thiel and V. Holmburg (eds), New Public Management in Europe: Adaptation and Alternatives, Palgrave, 2007.

Rahman, A. R., ‘Due Process and User Participation in Standard Setting’, Australian Accountant, Vol. 61, No. 1, 1991.

Rayman, R. A., ‘Fair Value Accounting and the Present Value Fallacy: The Need for an Alternative Conceptual Framework’, British Accounting Review, Vol. 39, No. 3, 2007.

Rivenbark, W. C., and K. L. Carter, ‘Benchmarking and Cost Accounting:The North Carolina Approach’, Journal of Public Management, Accounting and Financial Management, Vol. 12, No. 1, 2000.

Robbins, W. A., ‘Consensus Between Preparers and Users of Municipal Annual Reports: An Empirical Analysis’, Accounting and Business Research, Spring 1984.

——, ‘The Importance of Selected Information Items to Municipal Bond Analysis and Their Disclosure in Municipal Annual Reports: An Empirical Assessment’, in J. L. Chan and R. H. A. Jones (eds), Governmental Accounting and Auditing: International Comparisons, Routledge, 1988.

Rohatgi, V. K., Theory and Mathematical Statistics, John Wiley & Sons, 1976.

Ronen, J., ‘To Fair Value or Not to Fair Value: A Broader Perspective’, Abacus, Vol. 44, No. 2, 2008.

Securities and Exchange Commission, Letter from SEC Chief Accountant to Joint Working Group of Standard Setters, re: Draft Standard Recommendations on Accounting for Financial Instruments and Similar Items, SEC, December 2001, available at http://www.sec.gov/staffletters/jwg072401. htm.

Sutcliffe, P., ‘The Standards Programme of IFAC’s Public Sector Committee’, Public Money and Man- agement, Vol. 23, No. 1, 2003.

A BAC U S

374 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

Tayib, M., H. G. Coombs and J. R. M. Ameen, ‘Financial Reporting by Malaysian Local Authorities: A Study of the Needs and Requirements of the Users of Local Authority Financial Accounts’, International Journal of Public Sector Management, Vol. 12, No. 2, 1999.

The European Group of Valuers’ Associations, European Valuation Standards, TEGOVA, 2003, available at www.tegova.org.

Torres, L., ‘Accounting and Accountability: Recent Developments in Governmental Financial Informa- tion Systems’, Public Administration and Development, Vol. 24, No. 5, 2004.

Torres, L., and V. Pina, ‘Reshaping Public Administration: The Spanish Experience Compared to the U.K.’, Public Administration, Vol. 82, No. 2, 2004.

Turley, S., ‘Discussion of Ronen’, Abacus, Vol. 44, No. 2, 2008.

Van Helden, G. J., and S. Tillema, ‘In Search of a Benchmarking Theory for the Public Sector’, Financial Accountability and Management, Vol. 21, No. 3, 2005.

Victorian Government, Asset Valuations of Government, Financial Reporting l the Financial Management Act 1994 (FMA), www.land.vic.gov.au, 2008.

Whittington, G., ‘Fair Value and the IASB/FASB Conceptual Framework Project: An Alternative View, Abacus, Vol. 44, No. 2, 2008.

Wilks, S. S., Mathematical Statistics, John Wiley & Sons, 1962.

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

375 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

APPENDIX A

SAMPLE COUNTRIES THAT ANSWERED THE QUESTIONNAIRES AND THEIR NASS

Respondents NASS

Australia Australian Accounting Standards Board

Austria Bunderministerium für Finanzen

Belgium Miniterie van Financien

Canada Ministry of Finance

Cyprus Ministry of Finance

Czech Republic Ministry of Finance

Department of Accountancy and Audit

Denmark Finansministeriet

The Agency for Governmental Management

Estonia Ministry of Finance

Finland Valtiovarainministeriö

Management Unit/Economic Administration

France Ministry of Economy and Treasury

Head of Public Sector Accounting

Germany Bundesministerium der Finanzen

(Cash-Flow Office)

Greece Hellenic General Accounting Office

Ireland Department of Finance

The Irish Revenue

Italy Ministerio dell’Economia e delle Finance

Lithuania Ministry of Finance

Accounting Methodology Department

Luxemburg Ministère des Finances

Trésorerie de l’Etat

Malta Ministry of Treasury

Netherlands Ministerie van Financiën

Dutch State Treasury Agency

New Zealand The Treasury

Poland Ministry of Finance

Portugal Ministerio das Finanças

Comisión de Normalización Contable de la

Administración Pública

Slovak Republic Ministry of Finance

State Reporting Section

Slovenia Ministry of Finance

Spain Ministerio de Economía y Hacienda

Intervención Gral. de la Admón. del Estado

(General Inspection Office)

Switzerland Ministry of Finance

United Kingdom Her Majesty’s Treasury

A BAC U S

376 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

APPENDIX B

HYPOTHESES AND VARIABLES TO TEST

Hypothesis Equivalent to test variables

H1 Q1 and Q2–Q3

H2 Q7 and Q5–Q8

H3 Q4 and Q5–Q6

H4 Q9 and Q10–Q11

APPENDIX C

QUESTIONNAIRE AND TABLES OF DESCRIPTIVE STATISTICS

Table C1

QUESTIONNAIRE

Questionnaire

Q1: FVA is more relevant than HCA to improve the understandability of the governmental financial statements and, therefore, to improve the transparency of financial information.

Q2: The introduction of methods and hypotheses used to measure fair value accounting in the notes to financial statements could improve its objectivity.

Q3: The introduction of methods and hypotheses used to measure fair value accounting in the notes to financial statements could improve its verifiability.

Q4: FVA is more relevant than HCA to improve the comparability of the governmental financial statements among governmental entities, promoting the use of benchmarking techniques.

Q5: Fair value accounting measures the assets in a more objective manner than historical cost accounting.

Q6: Currently, fair value measures can be obtained with credible and generally accepted methods.

Q7: FVA is more relevant than HCA to improve the comparability of the governmental financial statements of the governmental entity itself at previous times, promoting the use of benchmarking techniques.

Q8: If government decided to implement fair value accounting, the fair value measures should be estimated by independent expert appraisal values.

Q9: FVA could improve the timeliness of governmental financial statements, providing useful information to adapt public sector entities to the current socioeconomic framework.

Q10: The application of fair value accounting periodically would be a cost that the public entity could bear.

Q11: If government decided to implement fair value accounting, the fair value measures could be estimated by its own staff.

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

377 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

T ab

le C

2

D E

SC R

IP T

IV E

ST A

T IS

T IC

S O

F T

H E

R E

SU LT

S O

F T

H E

E M

P IR

IC A

L R

E SE

A R

C H

F O

R SA

M P

L E

C O

U N

T R

IE S

Q ue

st io

ns N

W he

n an

ac ti

ve ,o

rg an

iz ed

an d

liq ui

d m

ar ke

t ex

is ts

Fi na

nc ia

la ss

et s

P ro

pe rt

y, pl

an t

an d

eq ui

pm en

t

To ta

l M

ea n

M ed

ia n

X m

in X

m ax

V ar

ia nc

e SD

To ta

l M

ea n

M ed

ia n

X m

in X

m ax

V ar

ia nc

e SD

Q 1

26 98

4. 00

4. 00

2. 00

5. 00

0. 75

0. 87

99 3.

83 4.

00 1.

00 5.

00 1.

44 1.

20

Q 2

26 92

4. 00

4. 00

2. 00

5. 00

0. 40

0. 63

10 4

4. 00

4. 00

2. 00

5. 00

0. 47

0. 69

Q 3

26 89

3. 88

4. 00

2. 00

5. 00

0. 78

0. 89

93 3.

61 4.

00 2.

00 5.

00 0.

60 0.

78

Q 4

26 10

1 4.

12 4.

00 2.

00 5.

00 0.

74 0.

86 99

3. 83

4. 00

1. 00

5. 00

1. 32

1. 15

Q 5

26 89

3. 88

4. 00

2. 00

5. 00

1. 32

1. 15

99 3.

83 4.

00 2.

00 5.

00 1.

32 1.

15

Q 6

26 99

4. 06

4. 00

3. 00

5. 00

0. 43

0. 66

10 4

4. 00

4. 00

3. 00

5. 00

0. 71

0. 84

Q 7

26 10

2 4.

18 4.

00 2.

00 5.

00 0.

65 0.

81 92

3. 56

3. 50

2. 00

5. 00

0. 85

0. 92

Q 8

26 59

2. 41

2. 00

1. 00

5. 00

2. 38

1. 54

73 2.

83 3.

00 1.

00 5.

00 1.

91 1.

38

Q 9

26 89

3. 65

4. 00

2. 00

5. 00

0. 62

0. 79

10 4

4. 00

4. 00

2. 00

5. 00

0. 94

0. 97

Q 10

26 89

3. 65

4. 00

2. 00

4. 00

0. 37

0. 61

88 3.

39 3.

00 2.

00 4.

00 0.

37 0.

61

Q 11

26 82

3. 35

4. 00

2. 00

4. 00

0. 87

0. 93

72 2.

78 2.

00 2.

00 4.

00 0.

89 0.

94

A BAC U S

378 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

T ab

le C

2

C O

N T

IN U

E D

Q ue

st io

ns N

W he

n an

ac ti

ve ,o

rg an

iz ed

an d

liq ui

d m

ar ke

t ex

is ts

Fi na

nc ia

la ss

et s

P ro

pe rt

y, pl

an t

an d

eq ui

pm en

t

To ta

l M

ea n

M ed

ia n

X m

in X

m ax

V ar

ia nc

e SD

To ta

l M

ea n

M ed

ia n

X m

in X

m ax

V ar

ia nc

e SD

Q 1

26 69

2. 67

3. 00

2. 00

3. 00

0. 24

0. 49

52 2.

12 2.

00 1.

00 3.

00 0.

74 0.

86

Q 2

26 10

5 4.

06 4.

00 2.

00 5.

00 0.

76 0.

87 70

4. 08

4. 00

2. 00

5. 00

0. 99

1. 00

Q 3

26 93

3. 61

4. 00

2. 00

5. 00

0. 49

0. 70

56 3.

25 3.

00 2.

00 5.

00 0.

75 0.

87

Q 4

26 72

2. 78

3. 00

1. 00

4. 00

0. 65

0. 81

63 2.

59 3.

00 1.

00 4.

00 0.

51 0.

71

Q 5

26 67

2. 61

3. 00

1. 00

4. 00

0. 49

0. 70

43 2.

50 3.

00 1.

00 3.

00 0.

45 0.

67

Q 6

26 82

3. 17

3. 50

1. 00

4. 00

0. 97

0. 99

62 3.

58 4.

00 2.

00 5.

00 1.

17 1.

08

Q 7

26 82

3. 17

3. 00

2. 00

5. 00

0. 74

0. 86

66 2.

71 3.

00 2.

00 3.

00 0.

22 0.

47

Q 8

26 95

3. 67

4. 00

2. 00

5. 00

0. 94

0. 97

59 3.

42 4.

00 2.

00 5.

00 1.

17 1.

08

Q 9

26 75

2. 89

3. 00

2. 00

4. 00

0. 22

0. 47

67 2.

94 3.

00 2.

00 4.

00 0.

46 0.

68

Q 10

26 86

3. 33

3. 00

2. 00

4. 00

0. 47

0. 69

59 3.

42 4.

00 2.

00 4.

00 0.

63 0.

79

Q 11

26 70

2. 72

3. 00

2. 00

4. 00

0. 57

0. 75

49 2.

83 3.

00 2.

00 4.

00 0.

52 0.

72

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

379 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

T ab

le C

3

D E

SC R

IP T

IV E

ST A

T IS

T IC

S O

F T

H E

R E

SU LT

S O

F T

H E

E M

P IR

IC A

L R

E SE

A R

C H

F O

R SA

M P

L E

C O

U N

T R

IE S

B Y

SI Z

E P

O P

U L

A T

IO N

Q ue

st io

ns N

C ou

nt ri

es w

it h

la rg

e po

pu la

ti on

s C

ou nt

ri es

w it

h sm

al lp

op ul

at io

ns

W he

n an

ac ti

ve ,o

rg an

iz ed

an d

liq ui

d m

ar ke

t ex

is ts

W he

n an

ac ti

ve ,o

rg an

iz ed

an d

liq ui

d m

ar ke

t ex

is ts

Fi na

nc ia

la ss

et s

P ro

pe rt

y, pl

an t

an d

eq ui

pm en

t Fi

na nc

ia la

ss et

s P

ro pe

rt y,

pl an

t an

d eq

ui pm

en t

To ta

l M

ea n

M ed

ia n

SD To

ta l

M ea

n M

ed ia

n SD

To ta

l M

ea n

M ed

ia n

SD To

ta l

M ea

n M

ed ia

n SD

Q 1

13 52

4. 00

4. 00

0. 82

50 3.

85 4.

00 1.

21 49

4. 08

4. 00

0. 90

54 4.

15 4.

00 0.

80

Q 2

13 49

4. 08

4. 00

0. 29

53 4.

08 4.

00 0.

49 48

4. 00

4. 00

0. 85

49 3.

77 4.

00 0.

83

Q 3

13 49

4. 08

4. 00

0. 79

49 3.

77 4.

00 0.

73 49

4. 08

4. 00

0. 90

50 3.

85 4.

00 0.

90

Q 4

13 51

3. 92

4. 00

0. 95

47 3.

62 4.

00 1.

12 49

4. 08

4. 00

0. 90

52 4.

00 4.

00 0.

91

Q 5

13 48

4. 00

4. 00

0. 85

51 3.

92 4.

00 0.

95 46

3. 83

4. 00

1. 03

47 3.

62 4.

00 1.

19

Q 6

13 53

4. 08

4. 00

0. 64

53 4.

08 4.

00 0.

64 50

4. 17

4. 00

0. 39

50 3.

85 4.

00 0.

69

Q 7

13 54

4. 15

4. 00

0. 80

50 3.

85 4.

00 0.

80 48

4. 00

4. 00

0. 85

48 3.

69 4.

00 1.

03

Q 8

13 40

3. 08

3. 00

1. 66

40 3.

08 3.

00 1.

32 33

2. 75

2. 00

1. 42

35 2.

69 3.

00 0.

95

Q 9

13 46

3. 54

3. 00

0. 66

51 3.

92 4.

00 0.

95 38

3. 17

3. 00

0. 94

46 3.

54 4.

00 1.

05

Q 10

13 44

3. 38

3. 00

0. 51

44 3.

38 3.

00 0.

51 45

3. 75

4. 00

0. 75

30 3.

33 3.

00 0.

71

Q 11

13 39

3. 00

3. 00

0. 91

37 2.

85 3.

00 0.

90 39

3. 25

3. 50

0. 87

41 3.

15 3.

00 1.

07

A BAC U S

380 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

T ab

le C

3

C O

N T

IN U

E D

Q ue

st io

ns N

C ou

nt ri

es w

it h

la rg

e po

pu la

ti on

s C

ou nt

ri es

w it

h sm

al lp

op ul

at io

ns

W he

n an

ac ti

ve ,o

rg an

iz ed

an d

liq ui

d m

ar ke

t ex

is ts

W he

n an

ac ti

ve ,o

rg an

iz ed

an d

liq ui

d m

ar ke

t ex

is ts

Fi na

nc ia

la ss

et s

P ro

pe rt

y, pl

an t

an d

eq ui

pm en

t Fi

na nc

ia la

ss et

s P

ro pe

rt y,

pl an

t an

d eq

ui pm

en t

To ta

l M

ea n

M ed

ia n

SD To

ta l

M ea

n M

ed ia

n SD

To ta

l M

ea n

M ed

ia n

SD To

ta l

M ea

n M

ed ia

n SD

Q 1

13 40

3. 08

3. 00

0. 76

39 3.

00 3.

00 1.

41 40

3. 08

3. 00

0. 86

29 2.

42 2.

00 1.

24

Q 2

13 50

3. 85

4. 00

0. 99

45 3.

75 3.

00 0.

97 52

4. 00

4. 00

0. 91

33 3.

67 4.

00 0.

87

Q 3

13 49

3. 77

4. 00

0. 60

45 3.

75 4.

00 0.

75 50

3. 85

4. 00

0. 80

33 3.

67 4.

00 1.

12

Q 4

13 45

3. 46

4. 00

0. 97

38 2.

92 3.

00 0.

95 42

3. 23

3. 00

0. 93

35 2.

92 3.

00 1.

00

Q 5

13 38

2. 92

3. 00

0. 64

34 2.

83 3.

00 0.

83 37

2. 85

3. 00

0. 80

26 2.

89 3.

00 1.

05

Q 6

13 48

3. 69

4. 00

0. 85

45 3.

75 4.

00 0.

97 42

3. 23

4. 00

1. 17

31 3.

44 4.

00 1.

24

Q 7

13 43

3. 31

3. 00

0. 85

43 3.

31 3.

00 1.

03 45

3. 46

3. 00

0. 97

36 3.

00 3.

00 0.

85

Q 8

13 54

4. 15

4. 00

0. 90

38 3.

17 4.

00 1.

34 47

3. 62

4. 00

1. 04

22 2.

44 2.

00 1.

13

Q 9

13 39

3. 00

3. 00

0. 58

39 3.

25 3.

00 0.

87 37

2. 85

3. 00

0. 80

34 2.

83 3.

00 1.

03

Q 10

13 41

3. 15

3. 00

0. 55

23 3.

29 3.

00 0.

76 45

3. 46

4. 00

0. 66

18 3.

60 4.

00 0.

89

Q 11

13 33

2. 54

3. 00

0. 97

35 2.

92 3.

00 0.

67 35

2. 69

3. 00

0. 85

28 3.

11 3.

00 0.

78

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

381 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

T ab

le C

4

D E

SC R

IP T

IV E

ST A

T IS

T IC

S O

F T

H E

R E

SU LT

S O

F T

H E

E M

P IR

IC A

L R

E SE

A R

C H

F O

R SA

M P

L E

C O

U N

T R

IE S

B Y

G D

P P

E R

C A

P IT

A

Q ue

st io

ns N

C ou

nt ri

es w

it h

hi gh

G D

P pe

r ca

pi ta

C ou

nt ri

es w

it h

lo w

G D

P pe

r ca

pi ta

W he

n an

ac ti

ve ,o

rg an

iz ed

an d

liq ui

d m

ar ke

t ex

is ts

W he

n an

ac ti

ve ,o

rg an

iz ed

an d

liq ui

d m

ar ke

t ex

is ts

Fi na

nc ia

la ss

et s

P ro

pe rt

y, pl

an t

an d

eq ui

pm en

t Fi

na nc

ia la

ss et

s P

ro pe

rt y,

pl an

t an

d eq

ui pm

en t

To ta

l M

ea n

M ed

ia n

SD To

ta l

M ea

n M

ed ia

n SD

To ta

l M

ea n

M ed

ia n

SD To

ta l

M ea

n M

ed ia

n SD

Q 1

13 52

4. 00

4. 00

0. 91

54 4.

15 4.

00 0.

90 49

4. 08

4. 00

0. 79

50 3.

85 4.

00 1.

14

Q 2

13 47

3. 92

4. 00

0. 79

51 3.

92 4.

00 0.

76 50

4. 17

4. 00

0. 39

55 4.

23 4.

00 0.

60

Q 3

13 46

3. 83

4. 00

0. 94

47 3.

62 4.

00 0.

77 52

4. 33

4. 00

0. 65

53 4.

08 4.

00 0.

76

Q 4

13 52

4. 00

4. 00

1. 00

48 3.

69 4.

00 0.

85 48

4. 00

4. 00

0. 85

51 3.

92 4.

00 1.

19

Q 5

13 48

4. 00

4. 00

0. 95

49 3.

77 4.

00 1.

01 46

3. 83

4. 00

0. 94

50 3.

85 4.

00 1.

07

Q 6

13 54

4. 15

4. 00

0. 55

53 4.

08 4.

00 0.

76 49

4. 08

4. 00

0. 51

52 4.

00 4.

00 0.

58

Q 7

13 51

3. 92

4. 00

0. 86

48 3.

69 4.

00 0.

95 51

4. 25

4. 00

0. 75

50 3.

85 4.

00 0.

90

Q 8

13 32

2. 46

2. 00

1. 61

37 2.

85 3.

00 1.

34 41

3. 42

3. 50

1. 31

42 3.

23 3.

00 0.

93

Q 9

13 44

3. 38

3. 00

0. 87

48 3.

69 4.

00 1.

03 40

3. 33

3. 00

0. 78

49 3.

77 4.

00 1.

01

Q 10

13 47

3. 62

4. 00

0. 65

44 3.

38 3.

00 0.

65 42

3. 50

3. 00

0. 67

46 3.

54 3.

00 0.

66

Q 11

13 43

3. 31

4. 00

0. 85

38 2.

92 3.

00 0.

95 35

2. 92

3. 00

0. 90

35 2.

69 2.

00 0.

85

A BAC U S

382 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

T ab

le C

4

C O

N T

IN U

E D

Q ue

st io

ns N

C ou

nt ri

es w

it h

hi gh

G D

P pe

r ca

pi ta

C ou

nt ri

es w

it h

lo w

G D

P pe

r ca

pi ta

W he

n an

ac ti

ve ,o

rg an

iz ed

an d

liq ui

d m

ar ke

t ex

is ts

W he

n an

ac ti

ve ,o

rg an

iz ed

an d

liq ui

d m

ar ke

t ex

is ts

Fi na

nc ia

la ss

et s

P ro

pe rt

y, pl

an t

an d

eq ui

pm en

t Fi

na nc

ia la

ss et

s P

ro pe

rt y,

pl an

t an

d eq

ui pm

en t

To ta

l M

ea n

M ed

ia n

SD To

ta l

M ea

n M

ed ia

n SD

To ta

l M

ea n

M ed

ia n

SD To

ta l

M ea

n M

ed ia

n SD

Q 1

13 39

3. 00

3. 00

0. 58

34 2.

62 3.

00 1.

04 41

3. 15

3. 00

0. 99

34 2.

83 3.

00 1.

64

Q 2

13 51

3. 92

4. 00

0. 95

45 4.

09 4.

00 0.

94 51

3. 92

4. 00

0. 95

43 4.

30 4.

00 0.

67

Q 3

13 47

3. 62

4. 00

0. 77

37 3.

36 3.

00 1.

03 52

4. 00

4. 00

0. 58

39 3.

90 4.

00 1.

10

Q 4

13 41

3. 15

3. 00

0. 90

36 2.

77 3.

00 0.

60 46

3. 54

4. 00

0. 97

37 3.

08 3.

00 1.

24

Q 5

13 35

2. 69

3. 00

0. 75

28 2.

55 3.

00 0.

82 40

3. 08

3. 00

0. 64

31 3.

10 3.

00 0.

99

Q 6

13 45

3. 46

4. 00

0. 97

44 4.

00 4.

00 0.

77 45

3. 46

4. 00

1. 13

36 3.

60 4.

00 0.

97

Q 7

13 39

3. 00

3. 00

0. 58

36 2.

77 3.

00 0.

83 49

3. 77

4. 00

1. 01

43 3.

58 3.

00 0.

90

Q 8

13 48

3. 69

4. 00

1. 11

36 3.

27 3.

00 1.

19 53

4. 08

4. 00

0. 86

38 3.

80 4.

00 0.

92

Q 9

13 38

2. 92

3. 00

0. 64

39 3.

00 3.

00 0.

71 38

2. 92

3. 00

0. 76

37 3.

08 3.

00 1.

16

Q 10

13 42

3. 23

3. 00

0. 73

36 3.

27 3.

00 0.

79 44

3. 38

3. 00

0. 51

34 3.

40 3.

50 0.

70

Q 11

13 34

2. 62

3. 00

0. 96

29 2.

64 3.

00 1.

03 34

2. 62

3. 00

0. 87

24 2.

40 2.

50 0.

97

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

383 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

A P

P E

N D

IX D

H Y

P O

T H

E SI

S T

E ST

IN G

PA R

A M

E T

R IC

M E

T H

O D

:T -T

E ST

T -t

es t

St at

is ti

cs C

or re

la ti

on s

P ai

re d

t- te

st

P ai

re d

di ff

er en

ce s

t df

Si g.

(2 -t

ai le

d) M

ea n

SD St

d E

rr or

M ea

n 95

% C

on fid

en ce

In te

rv al

of th

e D

if fe

re nc

e

M ea

n N

SD St

d E

rr or

M ea

n C

or re

la ti

on Si

g. L

ow er

U pp

er

H yp

ot he

si s

1: Fi

na nc

ia la

ss et

s th

at ar

e no

t tr

ad ed

in an

or ga

ni ze

d, ac

ti ve

an d

liq ui

d m

ar ke

t

P ar

1 Q

1 2.

66 67

26 0.

48 50

7 0.

11 43

3 0.

04 6

0. 85

5 -1

.3 88

89 0.

97 85

3 0.

23 06

-1 .8

75 50

-0 .9

02 28

-6 .0

22 25

0. 00

0

Q 2

4. 05

56 26

0. 87

26 0

0. 20

56 7

P ar

2 Q

1 2.

66 67

26 0.

48 50

7 0.

11 43

3 0.

11 6

0. 64

7 -0

.9 44

44 0.

80 23

7 0.

18 91

-1 .3

43 45

-0 .5

45 44

-4 .9

94 25

0. 00

0

Q 3

3. 61

11 26

0. 69

78 0

0. 16

44 7

H yp

ot he

si s

1: P

ro pe

rt y,

pl an

t an

d eq

ui pm

en t

th at

ar e

no t

tr ad

ed in

an or

ga ni

ze d,

ac ti

ve an

d liq

ui d

m ar

ke t

P ar

1 Q

1 2.

12 00

26 0.

86 40

0 0.

25 62

4 0.

27 4

0. 38

9 -1

.7 50

00 1.

13 81

8 0.

32 85

-2 .4

73 17

-1 .0

26 83

-5 .3

26 25

0. 00

0

Q 2

4. 08

33 26

0. 99

62 0

0. 28

75 8

P ar

2 Q

1 2.

12 00

26 0.

86 40

0 0.

25 62

4 0.

00 0

1. 00

0 -0

.9 16

67 1.

24 01

1 0.

35 80

-1 .7

04 60

-0 .1

28 74

-2 .5

61 25

0. 02

6

Q 3

3. 25

00 26

0. 86

60 3

0. 25

00 0

H yp

ot he

si s

2: P

ro pe

rt y,

pl an

t an

d eq

ui pm

en t

th at

ar e

tr ad

ed in

an or

ga ni

ze d,

ac ti

ve an

d liq

ui d

m ar

ke t

P ar

1 Q

7 3.

55 56

26 0.

92 17

8 0.

21 72

6 0.

53 6

0. 02

2 0.

27 77

8 1.

01 78

2 0.

23 99

-0 .2

28 37

0. 78

39 3

1. 15

8 25

0. 26

3

Q 5

3. 83

33 26

1. 15

04 5

0. 27

11 6

P ar

2 Q

7 3.

55 56

26 0.

92 17

8 0.

21 72

6 -0

.3 38

0. 16

9 0.

72 22

2 1.

90 37

3 0.

44 87

-0 .2

24 48

1. 66

89 2

1. 61

0 25

0. 12

6

Q 8

2. 83

33 26

1. 38

26 7

0. 32

59 0

A BAC U S

384 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

H yp

ot he

si s

2: P

ro pe

rt y,

pl an

t an

d eq

ui pm

en t

th at

ar e

no t

tr ad

ed in

an or

ga ni

ze d,

ac ti

ve an

d liq

ui d

m ar

ke t

P ar

1 Q

7 2.

71 00

26 0.

49 23

7 0.

14 21

3 0.

27 4

0. 38

9 -0

.1 66

67 0.

71 77

4 0.

20 72

-0 .6

22 70

0. 28

93 6

-0 .8

04 25

0. 43

8

Q 5

2. 50

00 26

0. 67

42 0

0. 19

46 2

P ar

2 Q

7 2.

71 00

26 0.

49 23

7 0.

14 21

3 0.

45 4

0. 13

8 -0

.7 50

00 0.

96 53

1 0.

27 86

-1 .3

63 33

-0 .1

36 67

-2 .6

91 25

0. 02

1

Q 8

3. 41

67 26

1. 08

36 2

0. 31

28 2

H yp

ot he

si s

3: P

ro pe

rt y,

pl an

t an

d eq

ui pm

en t

th at

ar e

tr ad

ed in

an or

ga ni

ze d,

ac ti

ve an

d liq

ui d

m ar

ke t

P ar

1 Q

4 3.

83 33

26 1.

15 04

5 0.

27 11

6 0.

77 8

0. 00

0 0.

00 00

0 0.

76 69

6 0.

18 07

-0 .3

81 40

0. 38

14 0

0. 00

0 25

1. 00

0

Q 5

3. 83

33 26

1. 15

04 5

0. 27

11 6

P ar

2 Q

4 3.

83 33

26 1.

15 40

5 0.

27 11

6 0.

36 5

0. 13

6 -0

.1 66

67 1.

15 04

5 0.

27 11

-0 .7

38 77

0. 40

54 4

-0 .6

15 25

0. 54

7

Q 6

4. 00

00 26

0. 84

01 7

0. 19

80 3

H yp

ot he

si s

3: P

ro pe

rt y,

pl an

t an

d eq

ui pm

en t

th at

ar e

no t

tr ad

ed in

an or

ga ni

ze d,

ac ti

ve an

d liq

ui d

m ar

ke t

P ar

1 Q

4 2.

59 00

26 0.

71 00

0 0.

19 30

0 0.

30 3

0. 33

9 0.

08 33

3 0.

79 29

6 0.

22 89

-0 .4

20 49

0. 58

71 6

0. 36

4 25

0. 72

3

Q 5

2. 50

00 26

0. 67

42 0

0. 19

46 2

P ar

2 Q

4 2.

59 00

26 0.

71 00

0 0.

19 30

0 0.

11 5

0. 72

2 -1

.0 00

00 1.

20 60

5 0.

34 81

-1 .7

66 28

-0 .2

33 72

-2 .8

72 25

0. 01

5

Q 6

3. 58

33 26

1. 08

36 2

0. 31

28 2

H yp

ot he

si s

4: P

ro pe

rt y,

pl an

t an

d eq

ui pm

en t

th at

ar e

no t

tr ad

ed in

an or

ga ni

ze d,

ac ti

ve an

d liq

ui d

m ar

ke t

P ar

1 Q

9 2.

94 00

26 0.

68 00

0 0.

21 32

0 0.

46 6

0. 12

7 -0

.4 16

67 0.

79 29

6 0.

22 89

-0 .9

20 49

0. 08

71 6

-1 .8

20 25

0. 09

6

Q 10

3. 41

67 26

0. 79

29 6

0. 22

89 1

P ar

2 Q

9 2.

94 00

26 0.

68 00

0 0.

21 32

0 0.

00 0

1. 00

0 0.

16 66

7 1.

02 98

6 0.

29 73

-0 .4

87 67

0. 82

10 1

0. 56

1 25

0. 58

6

Q 11

2. 83

33 26

0. 71

77 4

0. 20

71 9

T H E RO L E O F FA I R VA L U E AC C O U N T I N G

385 © 2012 The Authors

Abacus © 2012 Accounting Foundation, The University of Sydney

N O

N PA

R A

M E

T R

IC M

E T

H O

D :W

IL C

O X

O N

T E

ST

R an

ge s

Te st

st at

is ti

cs (j

) N

eg at

iv e

ra ng

e Po

si ti

ve ra

ng e

B al

an ce

d

N A

ve ra

ge ra

ng e

Su m

of ra

ng es

N A

ve ra

ge ra

ng e

Su m

of ra

ng es

N A

ve ra

ge ra

ng e

Su m

of ra

ng es

Z Si

g. as

in tó

t. (2

-t ai

le d)

H yp

ot he

si s

1: Fi

na nc

ia la

ss et

s th

at ar

e no

t tr

ad ed

in an

or ga

ni ze

d, ac

ti ve

an d

liq ui

d m

ar ke

t

Q 1–

Q 2

0( a)

0. 00

0. 00

14 (b

) 7.

50 10

5. 00

4( c)

-3 .3

60 (z

) 0.

00 1

Q 1–

Q 3

0( d)

0. 00

0. 00

12 (e

) 6.

50 78

.0 0

6( f)

-3 .1

53 (z

) 0.

00 2

H yp

ot he

si s

1: P

ro pe

rt y,

pl an

t an

d eq

ui pm

en t

th at

ar e

no t

tr ad

ed in

an or

ga ni

ze d,

ac ti

ve an

d liq

ui d

m ar

ke t

Q 1–

Q 2

0( a)

0. 00

0. 00

13 (b

) 5.

50 55

.0 0

5( c)

-2 .8

71 (z

) 0.

00 4

Q 1–

Q 3

0( d)

0. 00

0. 00

9( e)

3. 50

21 .0

0 9(

f) -2

.2 32

(z )

0. 02

6

H yp

ot he

si s

2: P

ro pe

rt y,

pl an

t an

d eq

ui pm

en t

th at

ar e

tr ad

ed in

an or

ga ni

ze d,

ac ti

ve an

d liq

ui d

m ar

ke t

Q 7–

Q 5

7( g)

5. 43

38 .0

0 3(

h) 5.

67 17

.0 0

8( i)

-1 .1

15 (z

) 0.

26 5

Q 7–

Q 8

9( j)

9. 06

81 .5

0 6(

k) 6.

42 38

.5 0

3( l)

-1 .2

65 (z

) 0.

20 6

H yp

ot he

si s

2: P

ro pe

rt y,

pl an

t an

d eq

ui pm

en t

th at

ar e

no t

tr ad

ed in

an or

ga ni

ze d,

ac ti

ve an

d liq

ui d

m ar

ke t

Q 7–

Q 5

4( g)

3. 50

7. 00

6( h)

3. 50

14 .0

0 8(

i) -0

.8 16

(z )

0. 41

4

Q 7–

Q 8

3( j)

4. 50

4. 50

10 (k

) 5.

06 40

.5 0

5( l)

-2 .3

09 (z

) 0.

02 1

H yp

ot he

si s

3: P

ro pe

rt y,

pl an

t an

d eq

ui pm

en t

th at

ar e

tr ad

ed in

an or

ga ni

ze d,

ac ti

ve an

d liq

ui d

m ar

ke t

Q 4–

Q 5

3( m

) 4.

67 14

.0 0

4( n)

3. 50

14 .0

0 11

(o )

-0 .0

00 (z

) 1.

00 0

Q 4–

Q 6

4( p)

4. 50

18 .0

0 5(

q) 5.

40 27

.0 0

9( r)

-0 .5

51 (z

) 0.

58 2

H yp

ot he

si s

3: P

ro pe

rt y,

pl an

t an

d eq

ui pm

en t

th at

ar e

no t

tr ad

ed in

an or

ga ni

ze d,

ac ti

ve an

d liq

ui d

m ar

ke t

Q 4–

Q 5

4( m

) 3.

00 6.

00 4(

n) 2.

00 4.

00 10

(o )

-0 .3

78 (z

) 0.

70 5

Q 4–

Q 6

4( p)

4. 00

8. 00

11 (q

) 6.

44 58

.0 0

3( r)

-2 .2

92 (z

) 0.

02 2

H yp

ot he

si s

4: P

ro pe

rt y,

pl an

t an

d eq

ui pm

en t

th at

ar e

no t

tr ad

ed in

an or

ga ni

ze d,

ac ti

ve an

d liq

ui d

m ar

ke t

Q 9–

Q 10

3( s)

3. 00

3. 00

7( t)

3. 60

18 .0

0 8(

u) -1

.6 67

(z )

0. 09

6

Q 9–

Q 11

6( v)

3. 25

13 .0

0 4(

w )

4. 00

8. 00

8( x)

-0 .5

41 (z

) 0.

58 9

(a )

Q 1

< Q

2; (b

) Q

1 >

Q 2;

(c )

Q 2

= Q

1; (d

) Q

1 <

Q 3;

(e )

Q 1

> Q

3; (f

) Q

3 =

Q 1;

(g )

Q 5

< Q

7; (h

) Q

5 >

Q 7;

(i )

Q 7

= Q

5; (j

) Q

7 <

Q 8;

(Q 4

> Q

5; (o

) Q

5 =

Q 4;

(p )

Q 4

< Q

6; (q

) Q

4 >

Q 6;

(r )

Q 6

= Q

4; (s

) Q

9 <

Q 10

;( t)

Q 9

> Q

10 ;(

u) Q

10 =

Q 9;

(v )

Q 9

< Q

11 ;(

w )

Q 9

> Q

11 ;(

y) B

as ed

on po

si ti

ve ra

ng e.

;( z)

B as

ed on

ne ga

ti ve

ra ng

e.

A BAC U S

386 © 2012 The Authors Abacus © 2012 Accounting Foundation, The University of Sydney

Copyright of Abacus is the property of Wiley-Blackwell and its content may not be copied or emailed to

multiple sites or posted to a listserv without the copyright holder's express written permission. However, users

may print, download, or email articles for individual use.

REDUNDANT ACCOUNTABILITY.pdf

REDUNDANT ACCOUNTABILITY: THE JOINT IMPACT OF HORIZONTAL AND VERTICAL ACCOUNTABILITY ON AUTONOMOUS AGENCIES

THOMAS SCHILLEMANS Utrecht School of Governance, Utrecht University, The Netherlands

ABSTRACT Since the 1990s, many executive and regulatory agencies have

been (partially) separated from central government departments. In response, new forms of accountability have been introduced. Many of these mechanisms are horizontal forms of accountability, where agencies report to others than their hierarchical principals. This papers evaluates the joint impact of vertical accountability of agencies towards parent-departments and horizontal accountability to professional evaluations and boards of commissioners. Autonomous agencies seem to operate in a redundant accountability regime where they have to provide accounts ofthe same behaviour towards different stakeholders. Redundancy is often considered as problematic and costly but may also have significant benefits in complex systems, such as greater reliability and the capacity to incorporate different values. Two successive research questions have been posed. Is the accountability regime in practice redundant in the sense that agencies have to account for the same aspects of their behaviour towards vertical and horizontal accountability forums? If found to be the case, does redundant accountability then have the advantages identified in the redundancy- literature? The subsequent analyses - based on a qualitative research design and studies of nine Dutch executive agencies - show that the agencies indeed face multiple or redundant accountability. This does involve costs, however, in these cases some advantages of redundancy were manifest. To begin with, redundant accountability may improve systems reliability. The chance increases that unwanted behaviour will be discovered by one of the seemingly redundant accountability mechanisms. Secondly, redundancy mitigates the information symmetry between agencies and their principals. And finally, redundancy allows the accountability system to incorporate multiple legitimate and important but contradictory values.

Key words: Agencies, accountability, horizontal accountability, redundancy, evaluation

PAQ FALL 2010 301

INTRODUCTION

Since the 1990s, many executive and regulatory agencies in numerous OECD-countries have been (partially) separated from central govemment departments (PoUitt and Bouckaert 2004; Rhodes 1994; Flinders 2001). The resulting autonomous agencies have been coined quango's (Van Thiel 2000; Deacon and Monk 2001), non- majoritarian institutions (Thatcher and Stone Sweet 2002) or simply 'the unelected' (Vibert 2007). The qualifications all signify that the autonomous agencies are exempted from traditional democratic lines of accountability as ministerial responsibility was restricted (Van Thiel 2000: 222; Flinders 2001). In response, new forms of accountability have been introduced, such as performance audit and reporting, client panels, charters and protocols, scorecards and benchmarks, audits, professional evaluations, ombudsmen and boards of commissioners (see Demmke e.a. 2006 for an EU-wide overview). Many of these mechanisms are horizontal forms of accountability, where agencies report to others than their hierarchical principals, such as clients, partners, professional peers or independent boards (Day and Klein 1987: 28; Sinclair 1995: 223; Scott 2000: 42; Verschuere et al. 2006; Schillemans 2008). They contrast with traditional forms of accountability, where a subordinate usually reports to a superior ("vertical accountability", see Mulgan 2003; Bovens 2007).

The introduction of horizontal accountability does not mean that the vertical line of accountability towards parent-departments disappears altogether. As a result, autonomous agencies operate in a seemingly redundant accountability regime. Redundancy is often considered as problematic and costly but may also have significant benefits in complex systems, such as greater reliability and the capacity to incorporate different values (Landau 1969; Bendor 1985; Scott 2000).

302 PAQ FALL 2010

I ' This paper analyses the multiple accountability

regimes of autonomous executive agencies in the Netherlands. The central question is: does the addition of horizontal mechanisms lead to a profitable, redundant accountability regime? In order to answer this question, two successive research questions will be posed. 1) Is the accountability regime in practice redundant in the sense that agencies have to account for the same aspects of their behaviour towards vertical and horizontal accountability forums? 2) If found to be the case, does redundant accountability then have the advantages identified in the redundancy-1 i terature?

The research questions are answered on the basis of qualitative research on two horizontal accountability mechanisms: professional evaluations and boards of commissioners. The research focused on six professional evaluations and six boards of commissioners at nine of the largest Dutch executive agencies.

The paper will first discuss the concept of (horizontal) accountability. The paper then proceeds to discuss the potential advantages of redundancy for accountability. After the section on research design and methods, the paper will asses to what extent the different accountability processes are redundant and to what extent the potential advantages of redundancy could be found in these cases. In the final section the findings are put into perspective.

\ ACCOUNTABILITY: VERTICAL AND HORIZONTAL

Accountability is a contested concept that, even though it is widely used in public administration, has failed to reach an unequivocal meaning (Romzek and Dubnick 1998; Mulgan 2003; Koppell 2005; Bovens 2010). 'Accountability' is used as a synonym for many loosely

PAQ FALL 2010 303

defined political desiderata, such as transparency, equity, democracy, efficiency, responsiveness, responsibility, and integrity (Mulgan 2000: 555; Behn 2001, 3-6; Dubnick 2003). Much ofthe academic literature on accountability is rather disconnected, and many authors set out to produce their own specific definitions of accountability or mainly use the term as a stepping stone for a normative assessment of some policy area. The result is that accountability seems to be an ever-expanding concept, which has come to stand as a general term for any mechanism that makes powerful institutions responsive to their particular publics' (Mulgan 2003: 8). Nevertheless, there appears to be substantial overlap in what many authors see as the heart of their definitions of accountability.

The point becomes clear when one looks at the accountability articles that were published in the last ten years in 17 international journals. Overall, 114 articles were published in this period that featured accountability in the title or as a key concept, including a number of review articles . The overview shows an enormous variety of definitions and approaches to accountability. The overview also shows that many different authors find accountability an important topic: there were almost as many authors as there were papers.

It was interesting to note that a number of authors chose to use a common sense understanding of accountability and did not formally define the concept (for instance Craig 2000; Dumont and Candler 2005; Mattli and Buthe 2005). Some twenty other authors located accountability in a principal - agent model. Accountability then essentially refers to the information a principal demands from his agents and the purpose of accountability is grossly speaking to prevent agency drift and to manage the information asymmetry between principal and agent (examples are Lehn 2008; Strom 2000; Breaux et al. 2002). A different approach is taken by a substantial number of

304 PAQ FALL 2010

I authors who use the fourfold typology of accountability by Romzek and Dubnick (see Page 2006; Mulgan 2000; Bundt 2000). Romzek and Dubnick (1987: 228) defined accountability as: "The means by which public agencies and their workers manage the diverse expectations generated within and outside the organization". They discriminated between four, not mutually exclusive, types of accountability. In bureaucratic accountability the expectations faced by organizations or officials in public administration are shaped by bureaucratic hierarchies. Also the expectations could be based on laws (legal accountability), professional norms (professional accountability) and political demands (political accountability).

The widely used Romzek and Dubnick framework has a relational core to it, because the four types of accountability connect public agents with different 'audiences' or accountability forums. In this sense their framework is similar to some other approaches that were widely cited (notably Day and Klein 1987; Keams 1996; Bovens 2007) and also connects to principal-agent models.

In definitions of accountability in the tradition of Day and Klein, Romzek and Dubnick and principal-agent theory, it refers to a specific social relation or mechanism that involves an obligation to explain and justify one's conduct (Bovens 2007; Pollitt 2003; Romzek and Dubnick 1998: 6; Mulgan 2003: 9; Day and Klein 1987: 5; Posner 2002; Str0m 2000). Explanations and justifications are not made in a void, but vis-à-vis a significant other. This implies a relationship between an agent and a principal (Strom 2000), an actor and a fomm (Bovens 2007), or an accountor and an accountee (Pollitt 2003: 89).

Accountability processes can analytically be divided in three phases (Mulgan 2003; Bovens 2007). The process starts with the information phase, in which the actor provides an account of his conduct and behaviour towards

PAQ FALL 2010 305

the accountability forum. In the subsequent debating phase, the forum assesses this account and may ask for additional information and pose follow-up questions. In the end, the forum will pass judgement on the behaviour ofthe actor in the sanctions phase and will punish, correct or reward him. Sanctions may be formal or informal, and can also be either positive or negative, although negative sanctions seem to be most conunon (Elster 1999; Behn 2001).

Horizontal Accountability Many public organisations provide accounts of their

behaviour towards a diverse array of accountability forums, such as the treasury, national audit office, parliament, the Ombudsmen, a management board, clients and the media. The different forms of accountability have been categorized in different ways and by different criteria. A number of authors have distinguished horizontal from vertical accountability (O'Donnell, 1998; Scott 2000; Mulgan 2003; Schillemans 2008). The adjective 'horizontal' is added in those instances where there is no hierarchical or principal-agent relationship between the actor and the accountability forum. It may be based on a legal requirement, may follow from freedom of information laws or be based on what Mulgan (2003) dubbed: 'The principle of affected rights and interests'. If the rights and interests of third parties are at issue this provides a title to hold someone accountable.

There are many horizontal accountability forums for public agencies, such as clients, partners, professional peers, non governing boards or journalists. Many of these forms of accountability have an informal character. In addition, a number of formal mechanisms have been developed in the Netherlands that give third parties the formal possibility to demand accountability from agencies.

There are first of all boards of commissioners that more or less serve as non-governing boards for agencies

306 PAQ FALL 2010

(see next section). Then there are boards of stakeholders that represent the most important stakeholders of an organisation. There are boards of experts at agencies that perform complex, professional tasks. There are special ombudsmen or comparable independent complaints offices at some agencies. And finally there are forms of professional evaluations designed for accountability purposes.

The introduction of these horizontal accountability mechanisms has been a trend of some substance: in a subset of 82 Dutch agencies a total number of 60 individual horizontal accountability mechanisms were found.

MULTIPLE OR REDUNDANT ACCOUNTABILITY I •

The multiplicity of accountability is a recurring theme in the contemporary literature. It is sometimes described as a historical sedimentation process (Paul 1992; Day and Klein 1987: 110). Over time, new accountability institutions and mechanisms have been introduced while the older institutions and mechanisms remain in operation.

Scholars very often associate multiple accountability with problems. They have for instance claimed that multiple accountability is simply too expensive (Pollitt 2003: 95); that it makes it more difficult for principals to control agents (Moe 1984: 769; Miller 2005: 211), and that it confronts public agents with competing and incompatible expectations (Klingner et al. 2002). In the end it could lead to multiple accountabilities disorder, where "Organizations trying to meet conflicting expectations are likely to be dysfunctional, pleasing no one while trying to please everyone." (Koppell 2005: 3).

However, there have also been a number of scholars who have pointed out that multiple accountability might be understood as a form of redundancy, which might be a promising way of organizing accountability in a context of

PAQ FALL 2010 307

dispersed govemance (Braithwaite 1999; Scott 2000). This line of reasoning harks back to scholars such as Landau (1969), Wildavsky (1973) and Bendor (1985) who underlined the counterintuitive appeals of systems with overlapping and potentially interfering elements.

In his classical paper in Public Administration Review, Landau (1969) surprisingly came up with a positive reply on the question whether it was possible to build a reliable system from unreliable parts. He contended this was not only possible, but also that this was actually the case in many high risk systems. The central argument was that systems increase in reliability when they consist of different parallel and overlapping elements. The apparent advantage is that parallel channels can serve as backups for each other, as long as they work independently, and may thus correct each other's failures. Redundancy is thus a substitute for perfect parts. Subsequent research in complex systems or projects often underlined the potential benefits of redundancy (Carroll 2004; Stein 2002; Bendor 1985).

The redundancy-literature explains that its importance increases with increasing complexity and uncertainty (Landau 1969: 352; Bendor 1985: 54). Redundancy increases the ability of organizations to be adaptive and responsive in the face of both. For this reason, a number of authors have underlined the promises of redundant accountability in a context of dispersed govemance (Scott 2000; Mulgan 2003: 219). Braithwaite (1999) for instance claimed that the sensible response to a govemance system with dispersed executive authorities would be to install new, and dispersed controlling authorities. It is a case of catching thieves with thieves. The relationships between the different agents and accountability forums should then not be linear but circular, Braithwaite (1999: 92) contends. In similar vein Behn (2001: 197-201) has argued that accountability systems should be overlapping and circular.

308 PAQ FALL 2010

There are a number of theoretical advantages in redundant accountability. The classical redundancy argument would be that it increases the chance that unwanted behaviour will be noted by any one of the overlapping accountability forums. Redundancy should increase the reliability of oversight. In addition there is the pragmatic argument that accepting redundancy, thus accepting that different mechanisms will be more or less investigating the same behaviour, at least lowers the costs of coordination. In this sense, redundancy might be cheaper than coordination (see Wildavsky 1973: 143). A third and more fundamental advantage of redundancy is that it may help to mitigate the information problem inherent in accountability relationships. The 'competition' between the accountability forums decreases the possibilities for agencies to control the exchange of information and may help to squeeze information from public organizations (Bendor 1985: 257). A fourth advantage of redundant accountability is that it is a convenient way to incorporate different legitimate values. The operations of most large executive agencies touch upon different policy issues and values. Monopolistic structures are not well adapted to dealing with a diversity of relevant normative and operational claims, particularly in situations where relevant stakeholders may have diverging interests and opinions (Bendor 1985: 255). A multiple accountability regime may help to incorporate all relevant values (see Scott 2000: 57).

In the empirical part of this paper we will analyse if our cases of multiple accountability displayed the potential advantages in the redundancy literature. Before we proceed to this discussion, we must first describe the research design and methods. , :

PAQ FALL 2010 309

RESEARCH DESIGN AND METHODS

The research aimed to leam whether or not the addition of horizontal accountability mechanisms leads to a profitable, redundant accountability regime. It was not possible to look at all the existing horizontal accountability mechanisms in the Netherlands (60), so we had to make a selection. In this paper two horizontal accountability mechanisms are studied: boards of commissioners and professional evaluations. They stand out among the different horizontal accountability mechanisms because they either have strong sanctioning powers (boards of commissioners) or because they are most tmly 'horizontal' in the sense of having no hierarchical superiority towards the agencies (professional evaluations). For each mechanism, six cases were studied at nine executive agencies in total.

Case 1 : Six Boards of Commissioners Boards of commissioners can be found at 14 ofthe

82 public, executive agencies in the Netherlands. They operate in different policy fields, amongst which social services, forestry, some specialized research agencies and agencies registering vehicles or land property rights. The boards of commissioners at agencies were explicitly modelled on the example of the two tier model of corporate govemance in the private sector (Douma 1997; Ghezzi and Malberti 2008). The board of commissioners basically needs to approve of all major decisions by executive management, even though the final responsibility for executing policies lies with the executives. Boards thus set tariffs (if applicable), approve of the annual reports, plans, and accounts and officially 'hire and fire' the executives. Also, the boards of commissioners are formally appointed by the minister and they may serve as an intermediary between ministry and agency. Boards see to the execution

310 PAQ FALL 2010

of tasks by the executive board in order to ensure that they comply with the rules and ensure the long term stability of the organisation.

Case 2: Six Professional Evaluations The second form of horizontal accountability in this

paper is a specific type of professional evaluation that was developed by a group of large Dutch executive agencies as a new form of accountability (see www.publiekverantwoorden.nl). It was developed by a consortium of currently thirteen agencies that have underwritten a code of conduct, performance measurements and a code of governance. The agencies are evaluated every fourth year by an independent commission of highly reputed evaluators who judge their performance on the basis of these codes. The evaluations are based on four sets of norms: a manifesto, a 'code of conduct', a 'governance code', and a set of specific rules for the evaluation process. The professional evaluation committee evaluates the agency, on the basis of its self-evaluation, a large pile of additional documents and interviews with between 24 and 37 internal and external parties. The resulting evaluation report is always published, presented to the evaluated agency but also sent to the concerned ministry, members of parliament, the media and important other stakeholders. Insufficient performance can and sometimes is then 'sanctioned' by public disapproval of the evaluation committee.

Two Research Questions The central question is answered following two

research questions. The first research question is, is the accountability

regime in practice redundant in the sense that agencies have to account for the same aspects of their behaviour towards vertical and horizontal accountability forums? This was

PAQ FALL 2010 311

translated into the following two specific indicators: does horizontal accountability (accountability to boards of commissioners / professional evaluations) in the information phase of accountability focus on the same topics as accountability to the parent department or does it focus on different topics? And subsequently, do horizontal accountability processes in the sanctions phase of accountability direct agencies in the same direction as parent-departments do or are their directions contradictory to those of parent-departments? This necessitates a comparative approach, where the content of the information phases and the sanctions phases of the accountability of agencies to parent-departments, boards of commissioners and evaluation committees is compared. Figure 1 provides a graphic display of the general idea of the research.

Figure 1 : Research Design

6 Boards of commissioners

312 PAQ FALL 2010

! The second research question is 'does redundant accountability have the advantages identified in the redundancy-literature?' In the earlier discussion three potential advantages^ were outlined: redundancy may increase the chance that unwanted behaviour is signalled, allow incorporating different values, and mitigates the information problem of principals. In order to answer this question, formal documentation on the different mechanisms was studied and interviews were held.

Data For each board of commissioners, the minutes of all

meetings in one year, all their formal communications, letters, and policy advices, and their annual reports were studied. In some cases, specific evaluations of the boards were found to exist and were included in the research.

For each evaluation, the self-evaluation report by the agency, the list of interviewed persons, additional written reports, the final evaluation report, the official reaction by the agency and the press release were studied.

For hierarchical accountability, the research was based on all communications such as official letters and reports to parliament on the agency by the parent department and documentation by the agencies.

In addition to the documents, interviews were held with all parties concerned: executives and central staff of the agencies, members of boards of commissioners and their supportive staff, members ofthe evaluation committee and their supportive staff, and senior civil servants from the parent department. Interviews lasted on average one and a half hour. Table 1 provides an overview. In total, 55 semi- open interviews of approximately 1,5 hrs. were held.

PAQ FALL 2010 313

Table 1 Overview of organizations, mechanisms and interviews^ Agency Number of executive and central staff interviewed Number of officials from parent department interviewed

Ol 4

3

02 1

1

03 3

4

04 1

1

O5 5

1

O6 2

2

07 2

0

O8 4

4

O9 1

1

Board of commissioners studied Number of members / staff board of commissioners interviewed

X

2

X

2

X

2

X

2

X

2

X

1

Evaluations studied Number of members / staff evaluation committees interviewed

X 2

X 1

X 3

X 1

X 1

X 2

THE INFORMATION PHASES OF VERTICAL AND HORIZONTAL ACCOUNTABILITY

This section will answer the research question: is the accountability regime in practice redundant in the sense that the content of the information phases of vertical and horizontal accountability are more or less the same? The answer is going to be affirmative.

314 PAQ FALL 2010

i Information phase of vertical accountability to parent- departments

The separation of agencies from the core of govemment in theory follows a simple logic: from then on the ministry is responsible for formulating policies, guidelines and financial regulations. These are usually detailed in a formal contract or in provisions of a similar nature. The agencies are responsible for policy implementation within this framework. In order to do this effectively, they were granted more operational autonomy. The vertical accountability to their parent-departments is supposed to be restricted to the terms of the contract. Ministries are not supposed to demand accountability on the business activities with which the goals of the agencies are pursued.

The policy-implementation dichotomy has an intuitive appeal but has been difficult to sustain in practice (Pollitt and Bouckaert 2004; Mulgan 2003: 256; Posner 2002: 525). It is difficult for ministries to steer away from detailed information requests; in part because agencies may become too entrepreneurial and pursue ends that are not in accordance with the preferences of their political principals.

A similar pattem comes to the fore in the case ofthe nine Dutch agencies. All respondents readily agreed that the level of detailed monitoring by ministries had increased significantly in the preceding years. One experienced respondent put it as follows:

"Initially there wasn't really any oversight. That was hardly an item. We talked about the advisory role of agencies and about establishing a sound 'interface'. Those were the issues on our mind. But in the course of time, detailed oversight has come forward as our principal concem. We presently meet with the executive board of the agency every six weeks and speak about all import

PAQ FALL 2010 315

issues. And twice a year there is a meeting with the minister."

For all the investigated agencies, the locus of hierarchical accountability was found to be very broad. Even though the ministry is in theory not supposed to demand detailed information on business processes, reality is that they increasingly do. This is enhanced by the fact that they had a much broader basis for demanding accountability reality than the contract between agency and ministry only.

First of all, the official, general doctrine of government-oversight indicates that it should focus on 'compliance with legal and budgetary rules', 'effectiveness, efficiency, responsiveness to clients and quality of operations'. It is very hard to see which aspects of the conduct of agencies do not fall within any of these categories. In addition, numerous (semi-)legal documents and instruments serve as bases for holding agencies accountable. Table 2 provides a list.

Thirdly, sometimes hierarchical oversight was supported by an inspection, which raised the level and the width of vertical oversight considerably. The social security agency and the centre for work and income, for instance, are each evaluated about twice a month in lengthy reports by an inspection that covers most aspects of their work, including many organisational and operational issues.

316 PAQ FALL 2010

Table 2 . Bases of vertical accountability Bases of vertical accountability to parent-departments • Legal framework ("contract") • Supervision statute • Budgetary rules • Information statute (with underlying documents) • Legal audit • Departmental accountant • Specific guidelines for the accountant • Extemal accountant

As a result, there are stable and often very detailed procedures between agencies and ministries for all structural issues (annual plans, etc.). Hierarchical accountability is then focused on compliance. For incidental issues, such as the removal of an office or a calamity, the level of departmental monitoring of the agencies increases significantly. One departmental respondent explains the logic as follows:

"We have never been caught by surprise by 'our' agency'. That wouldn't be possible. Just to illustrate, when the agency moved to a new building a few years ago, I remember that we even inquired about the carpeting and furniture in their offices. As there are no general mies for these situations, we had to reach specific agreements on a host of such questions"

Information phase of horizontal accountability to boards of commissioners

Boards of commissioners meet approximately six times a year with the executive boards of the agencies. Given the width of departmental oversight, it may not come as a surprise that the boards more or less treat the same

PAQ FALL 2010 317

issues. Even stronger, very often the agencies even discuss the exact same documents with their boards.

The meetings of the boards follow, as one respondent indicates, "the logic of our planning and control cycle". The board of commissioners needs to approve of most important decisions and steps in this cycle. As such, the oversight of the board covers "the entire scope of activities of the agency". This means that all important strategic documents are presented to the boards. One respondent states: "We simply discuss all important issues and decisions before they are sent to the minister for approval".

The agenda's and minutes of the board-meetings reveal that the following clusters of issues are at the core of the horizontal accountability to boards. The largest part of the issues are operational (38% of counted topics). These include issues such as information-systems, finances and budgets, investments and business-redesign. Accordingly the most time (24% of counted topics) is devoted to major strategic documents, such as annual plans, budgets, financial reports and midterm strategic plans. Then there is cluster of relational issues. Some 17% of the formal discussion topics between executive and non-executive boards are about political developments and the relationship with the parent-department. The interviews suggest that this part is quite more substantial than was recorded in the minutes. Some respondents report how many meetings with boards start with a long discussion of the relevant developments in their political environments and what they may imply for the agency. The board is then informed about "all important developments", and the current "relationship between the inner and the outer world of the organization". These strategic, political issues are seen by some of the respondents as the most important elements ofthe meetings. The respondent recounts:

318 PAQ FALL 2010

¡ "The most important topic is usually the tour d'horizon at the beginning of our meeting, where the executive manager talks about his experiences in the preceding months and this leads to all sorts of heated discussions. At some point the chairman then usually intervenes and redirects our

, discussion to the formal agenda".

All in all, the information phase of the accountability to boards of commissioners is quite similar to that of departmental oversight, as there are hardly any documents presented to the boards that are not presented to the ministry.

Information phase of horizontal accountability in professional evaluations

The basis of the evaluations is the set of norms and indicators that were laid down by the participating agencies'*. In the self-evaluation report, the agencies grade their own performances on the indicators. In the subsequent interviews with some tens of persons from within and outside ofthe agencies, the starting question is usually: 'do you support the general picture that emerges from these gradings?' From there on, the dynamic interaction between respondent and evaluation committee determines the course of events. The committee will have specific questions; respondents often wish to drop a few messages. As a result, the topics that are covered broaden substantially and this feeds into the final report. The reports start out by the norms, but always cover a number of additional issues that usually have also been looked at by ministries and boards of commissioners. In addition, the self-evaluation report is always accompanied by a small pile of additional documents, such as annual plans, budgets, accounts, etc., that have already been part of the accountability to ministries and to the boards.

PAQ FALL 2010 319

The evaluation committee acknowledges this broadening of their perspective and defend it in their code of conduct in the following way: "The indicators are deliberately used as guidelines, not as norms, because in the end the quality of our interviews must be leading. (...) if our dialogue manages to arrive at new insights on adjacent issues we consider that to be relevant. These types of insights must be recorded and reported". They thus deliberately choose to use the norms on which they operate in a loose manner.

THE SANCTIONS PHASE OF VERTICAL AND HORIZONTAL ACCOUNTABILITY

The information phases of all three accountability mechanisms are thus rather similar in content, yet quite different in form. They are truly redundant in the sense that they cover to a very large extent the same issues. On this basis, horizontal accountability seems a rather superfluous addition to the govemance system of executive agencies. The following question is then: how do these accountability processes evolve and what are the outcomes? We will now discuss the sanctions phases of the three types of accountability and consider whether the judgments passed were also found to be redundant.

Sanctions Phase of Vertical Accountability to Parent- Departments

Vertical accountability on the executive agencies has a broad focus but only culminates in a limited number of judgments. The studied documentation, and interviewed respondents from ministries and agencies were all very clear at this point: departmental oversight is restricted to three issues: finances and budgets, political priorities and preventing political harm to the minister as consequence of actions (or the lack thereof) by agencies. The political

320 PAQ FALL 2010

II agenda thus turns out to dominate the judgments ministries pass on agencies.

The focus on finances and budgets in the investigated period is a logical by-product of the efforts the Dutch government was making in the investigated period to downsize the public sector. Ministries set targets of up to 25% for the reduction in size of agencies, and subsequently evaluated most ofthe developments within agencies in light of this target. In addition, they also monitored the arrangements the agencies made for their employees in order to ensure that "redundancy agreements wouldn't bear implicit costs for the national budgets". The focus on finances is understandable, as the agencies might make decisions that could ultimately be paid for by the national government. It was however deplored by most of the respondents from the agencies, who experienced a notable lack of interest in their work by their departmental counterparts. As one of the respondents put it in a crie de coeur: "We only talk about money with the ministry! It's often disappointing. I make it too personal perhaps, I know. But, I sometimes wonder if we are ever going to talk about the content ofthe work we actually do!"

Apart from the finances, preventing political harm to the minister as a result of choices by agencies is a second concern in vertical oversight (earlier noted by Wilson 1989; 't Hart and Wille 2006). One of the departmental respondents states this concern as follows: "It is our first and foremost duty to keep our minister out of political troubles and, should trouble nevertheless arise, we should guide him through the storm". This departmental concern for the political agenda of the minister is widely noted by respondents who work for the agencies. One of them stated: "The only thing they (ministerial officials) care about is keeping their political superiors out of trouble. That is their prime focus and anything may be sacrificed to this end".

PAQ FALL 2010 321

Thirdly, departmental overseers are guided by general political priorities that may be forced upon the work of the agencies. When, for instance, the central govemment declares that it will reduce the level of official regulation with 25%, departments approach the agencies with this target in mind and they start looking for mies that can easily be discarded. The agencies sometimes experience this as a somewhat cynical disinterest in the heart of their work, as they have often leamt that specific rules are really beneficial for attaining their policy goals.

The overall picture of accountability to parent- departments is all in all as follows. In the information phase, parent-departments wish to have all available information (and sometimes more), in the sanctions phase they limit their focus to three well-defined priorities. Their monitoring is very broad, corrections are limited to key issues and experienced as very one-sided by the agencies.

Sanctions Phase of Horizontal Accountability to Boards of Commissioners

Where horizontal accountability to boards of commissioners was surprisingly similar to vertical accountability in the information phase, in the sanctions phase there appears to be a large difference. The root of this difference lies in the diverging interests served by ministries and boards in the sanctions phase. Ministries are focused on the political agenda of their minister; the boards of commissioners are primarily concemed with the stability of the agencies. As a result, the 'signals' from boards in the sanctions phase of accountability differ substantially from those of ministries.

Boards usually explicitly aim to reach a cooperative understanding with the executive board, as is reported in other studies as well (Comforth 2003; Roberts 2001). Respondents state that the suggestions and directions from boards never stray far from the official course that was

322 PAQ FALL 2010

) already adopted by the agency. "It is a reinforcement of what we already do", one respondent notes. And another respondent adds: "The bandwidth of their advice remains close to the existing plans".

In their judgments the boards clearly demonstrate that they take the interests of the organization as their starting point.

Generally, three types of directions can be discemed. Boards first of all focus on improving operations in general by addressing issues such as planning, registration and extemal presentation of strategic priorities. They secondly display a keen concem for risks, as displayed in their recorded comments and remembered by respondents. Boards were for instance found to question the resilience of information-systems, the support by the staff for policy changes, the coherence of a number of investment decisions or the policy risks involved in operations. Thirdly, boards were found to provide directions that concem the extemal presentation of the agencies. Board members all carry a weight of experience in policy fields, they are generally former politicians or senior civil servants, and they use this experience to guide the executives ofthe agencies.

All in all, the focus of directions from boards differs mostly from the directions by the ministries. The one similarity is that both were concemed with inherent policy risks of operations. The dissimilarity is that boards focus on organisational operations and extemal presentation, instead of on finances and political priorities. They thus underline different values in the sanctions phases of accountability on the basis of largely similar information.

Sanctions Phase of Horizontal Accountability in Professional Evaluations

The horizontal accountability in professional evaluations is guided by the set of norms that underlies the

PAQ FALL 2010 323

evaluation procedure. The evaluations put a large emphasis on the agenda of the agencies and the quality of̂ their operations; the finances, political risks and priorities that are so central to hierarchical control are largely absent.

The evaluation reports pass judgment on the four official goals ofthe evaluation process: quality of services, cost/performance, responsiveness & participation and transparency and a number of additional issues. Issues such as integrity and anticorruption, the relationship with the parent-department, or the hesitance to accept a new policy proposal were all judged in one ofthe reports.

Evaluation committees are weak instruments of accountability: their formal influence stops after the reports are published. However, the respondents that were interviewed and the formal documents that were studied all indicate that most (but not all) of these evaluations have had clear effects on the agencies. The agencies for instance translate the reports into lists of improvements, in combination with other policy developments. One respondent recalls: "Alongside this evaluation there were other important trajectories. We combined all the inputs into one big list of improvements, assigned responsibilities and had people report on their proceedings, every three months. I think it took about three years until we had effectively dealt with all these issues."

The results from the professional evaluations thus feed into the normal planning and control cycles of the agencies. Also, the results are discussed with the other agencies that are involved in the process. This adds a form of peer pressure to the evaluations. Finally, the outcomes are sometimes used in existing discussions over direction within the agencies. As such, it fuels internal battles. One respondent recalls:

"The evaluation committee pointed out how extremely focused we are on the technical

324 PAQ FALL 2010

performance indicators we have to meet. Through this focus, we are largely unable to show normal stakeholders and society at large what we do and what we achieve with their tax money. Our information is only comprehensible for specialists. That was one of the main conclusions by the chairman of the committee and it was instantly recognized at the executive level of our agency. I remember thinking how good it was that such an important outsider pointed at this, because I really support this point. In the aftermath of the evaluation, improvements have soon been implemented."

BENEFICIAL REDUNDANCY?

' Our discussion to this point should have made clear by now that horizontal and vertical accountability are redundant, focusing on many of the same documents and the same issues but providing different types of judgments. Redundancy is always a contested concept: at first glance it seems to be wasteful to have different accountability mechanisms assessing the same documents. It is obviously more expensive. At second glance however there could be advantages in a redundant accountability regime. We will discuss the potential advantages in our cases on the basis of the previous discussion of the sanctions phases of accountability.

Reliability The classical redundancy argument is that multiple

channels (of accountability) decrease the chance of systems failure. In this context that would mean that redundancy enhances the reliability of oversight in the sense of the ability of accountability forums to discover and redress unwanted behaviour.

PAQ FALL 2010 325

At first glance it seems that our cases of multiple accountability do contribute in a limited but nevertheless significant respect to reliability. The one common denominator in the oversight of the different accountability forums was their focus on discovering risks. Their interpretation of risks however differed. Ministries actively monitored the information they received for signs of implementation choices or consequences that might have negative political consequences (risks) for the minister. They were also always assessing the risks that agencies might overrun their budgets. Boards on the other hand were more concerned with long term stability risks for the agencies, including the loss of support from the different societal and political supporters. However different their focus was, they were both found to be looking for signs of mismanagement or policy failure, which is heartening from a reliability perspective.

The overall effectiveness in terms of reliability is difficult to assess, as we simply can't know if there were many failures within the agencies that were not uncovered. There is nevertheless some reason to doubt the added value ofthe boards and evaluations in this perspective. If we look at the four instances where agencies were found to be at fault during our research period, the boards and evaluations never played a part in uncovering them. The four cases consisted of policy failure with social risks (Land Registry), setting disproportionately high tariffs (Forest Service), failure to adopt quality standards (Vaccins Institute) and a large scale wasteful redecoration of offices (social security agency). Specifically the boards were in a position to judge if the agencies were pursuing the appropriate course of action. They nevertheless always approved of the courses of action the executives were taking. In all four cases it took a combined effort from vertical ministerial oversight, media reporting and parliamentary questions to correct the behaviour by the

326 PAQ FALL 2010

I

agencies. There is accordingly reason to doubt whether these horizontal mechanisms of accountability, operating in close proximity to the agencies, do substantially increase the reliability of the accountability system. Boards and evaluations take the interests of the agencies as their point of departure and may thus be disinclined to question seemingly inappropriate conduct.

Information Asymmetry » The second theoretical advantage of redundancy is

that it may help to mitigate information asymmetry that impedes the accountability forums. In this respect the findings in this limited case-study are overall rather positive. The different mechanisms all produce information on the agencies, in the forms documents and judgments, which are used as input for the other accountability processes. This increases the information base of the different accountability forums and breaks the information monopoly of the agencies.

Respondents from parent-departments for instance repeatedly underlined how useful the horizontal accountability mechanisms were for them as sources of information. The respondents noted that they considered notably the boards to operate as 'waming systems' that would help them detect unwanted behaviour. Another respondent added: "The existence of the boards as such is an extra reassurance for the minister that the agency is doing well. It is a safeguard"., as The judgments of boards and evaluators furthermore provide an added perspective to the information that is provided by the agencies. Particularly when boards or evaluators are critical, this is a waming sign for the ministries. One respondent from a ministry notes:

I "I suppose we would consider a negative ; judgment by the board of commissioners as a very

PAQ FALL 2010 327

serious signal that something is wrong. Given the fact that the agency will always try to prevent such a situation to occur; so in the case that it does happen, we should really take it very seriously".

The same logic applies to the evaluations. The parent-departments follow their proceedings from a distance and they wish to be informed about the processes and outcomes. Respondents from ministries suggest that these evaluations can be a useful source of information on what really happens within the agencies. Several agencies and parent-departments have for instance discussed the implications of the evaluations for future policy decisions. Other concemed parties may also react on the reports. In some instances joumalists followed up on the evaluation and devoted articles to the outcomes. Boards of commissioners have generally been interested in the evaluations and have sometimes demanded to be informed about the successive implementation of recommendations. And in one instance, parliament was alerted by the process and members of parliament asked questions about it.

Incorporating Multiple Values The third theoretical advantage of redundant

accountability is that it is a convenient way to incorporate different legitimate values. The different accountability fomms can act as guardians of different values, and were in this research generally found to do so. Where vertical accountability focused on a set of important values (budgetary discipline, political agenda), horizontal accountability stressed other important values (improving operations, stability ofthe organisation).

A good example of this multi-value approach came to the fore when one of the agencies was caught up in a highly public scandal over housing expenses, where the agency allegedly spent far too much on their new offices.

328 PAQ FALL 2010

I and particularly the redesign of the floor of the executive board. News reports made a huge scandal out of it and the false impression was raised that the agency had installed marble toilets and golden taps.

( The primary focus of vertical accountability in the aftermath of the incident was to ensure that the minister was not blamed for the ills (two executives of the agency were let of) and that future decisions on housing could be contained more effectively. Meanwhile the agency and its almost 20.000 employees still had to do their jobs of course. The minutes of the meetings of the boards of commissioners clearly show how they chose not to focus on the housing issue - even though they talked about it extensively - but how they were more concerned with "the going concern", as one member put it. Another member of the board added the following. The quote shows how the board focused on the stability of the operations (an important concern) and leaves the issue of the budget and the policy crisis (another important concern) to the parent department:

"The budget (...) it is not one of our main concerns. It is addressed at length by the ministry. They already start in early spring and it finishes in November. For us it is almost like trying to flog a dead horse. So we do talk about the budgets, but not very detailed. We rather ask the executive board how they are prioritizing in the face of the current turbulences and what they can do to contain the damage to our clients".

1

j CONCLUSIONS AND DISCUSSION [

This paper reported on a qualitative research ofthe multiple accountability regimes at a number of large, Dutch executive agencies. Horizontal and vertical accountability

PAQ FALL 2010 329

were found to be redundant and this had some positive effects, particularly mitigating information asymmetry and incorporating confiicting but important values in the oversight on agencies. The findings suggest that in these cases the extra investments in horizontal accountability mechanisms outweigh their costs.

These conclusions of course have a limited basis as they are drawn from just two handfuls of cases in one country. It is impossible to generalize the results beyond these cases. Also, the treatment of redundancy has been biased, as we did not systematically look at the potential negative effects of redundancy, such as its relatively high costs or the confusion it might invoke in agencies that need to cope with multiple accountability-demands.

In our discussion we will therefore just point to some observations from these cases that seem worthy to be explored in the future. Our first observation is that it was noteworthy how accountability mechanisms with different goals all displayed a tendency to broaden their scope. Departmental officials want to be informed on operational issues matters, members of boards and evaluation committees become "curious" as to how policy processes evolved and might affect the agencies. They also find it difficult to assess the quality of operations of the agency without looking at their statutory role, the budgetary rules and political support.

This tendency could be explained in a number of ways. First of all, the similarity between these polar extremes of accountability stmctures was likely enhanced by the fact that most agencies are partially autonomous from their parent-departments yet still linked to them in numerous ways (Pollitt et al 2004: 10). The partiality ofthe autonomy can be an important driver for increased controls. For instance, ministries will in the final instance have to pay the bill after mismanagement by the agencies and ministers are still held accountable by parliament for

330 PAQ FALL 2010

anything the agencies do (see Flinders 2001). This is a strong incentive for ministries to broaden their scope of oversight.

Secondly, the agencies were separated from ministries according to the doctrine of a separation between policy formulation and implementation. This divide is hard to sustain in practice. Parent-departments are supposed to focus their oversight on policy-results and some 'bottom- lines' but were in practice also found to be very interested in the business processes that should lead to these results. Boards of commissioners and evaluation committees on the other hand were supposed to focus on the quality of business processes and organisational stability. In practice they were understandably interested in the policy processes within ministries, as these are clearly very important for the stability ofthe agencies.

The third explanation would be that accountability forums are generally found to have difficulties in holding back with requests for information (Behn 2001). As specific issues usually overlap with other issues, accountability forums will be easily tempted to expand their range of oversight. This was for instance documented for national audit offices (PoUitt et al 1999), the Ombudsman (Meijer 2002) and non-governing boards (Comforth 2003). The level of interpretive flexibility of formal regulations is probably instrumental to this development.

A final and more general observation is that multiple accountability may actually have positive effects. This is remarkable; given that most scholars usually point out that multiple accountability has any one of a number of negative effects: inefficiency (PoUitt 2003), ineffectiveness (Strom 2000; Posner 2002) or confusion (Klingner et al 2002; Koppell 2005). The backdrop of this literature makes our results a bit remarkable. Did we investigate the proverbial black swans or have we used positive evaluation criteria ('mitigating information asymmetry' and

PAQ FALL 2010 331

'incorporating different values') that would also yield positive outcomes in other cases? In any case, the findings lend some empirical support to the claim (Scott 2000; Braithwaite 1999) that accountability in complex govemance settings may sometimes benefit from redundancy.

REFERENCES

Behn, R. D. (2001). Rethinking Democratic Accountability. Washington, D.C.: Brookings Institution Press.

Bendor, J. B. (1985). Parallel Systems. Redundancy in Government. Berkeley: University of Califomia Press.

Bovens, M. (2007). Analysing and Assessing Accountability: A Conceptual Framework. European Law Journal, 13 (4), 447-468.

Bovens, M (2010). Two Concepts of Accountability. In: West European Politics (forthcoming).

Braithwaite, J. (1999). Accountability and Govemance under the New Regulatory State. Australian Journal of Public Administration, 58 (1), 90-93.

Breaux, D. A., Duncan, C. D., Keller, D. C. and Morris, J. C. (2002). Welfare Reform Mississippi Style: Temporary Assistance for Needy Families and the Search for Accountability. Public Administration Review, 62 {\), 92-103

Bundt, J. (2000). Strategic Stewards: Managing Accountability, Building Tmst. Journal Public Administration Research Theory, 10(4), 757-778.

Carroll, J. S. (2004). Redundancy as a design-principle and an operating principle. Risk Analysis, 24(4), 955- 957.

Comforth, C. (2003). The Governance of Public and non- Profit Organisations, what do boards do?. New York: Routledge.

332 PAQ FALL 2010

Craig, P. (2000). The Fall and Renewal ofthe Commission: I Accountability, Contract and Administrative

Organisation. European Law Journal 6 ( 2), 98-116. Day, P. and Klein, R. (1987). Accountabilities: Five Public

Services. London: Tavistock. Deacon, D. and Monk, W. (2001). Quangos and the

"communications dependent society": part of the process or exceptions to the tule?. European Journal of Communication, 16 ( 1), 25-50.

Demmke, C, Hammerschmid, G. and Meyer, R. (2006). Decentralisation and Accountability as Focus of Public Administration Modernisation. Vienna: Austrian Federal Chancellery.

Douma, S. (1997). The two-tier system of corporate govemance. Long Range Planning, 30(4), 612-614

Dubnick, M. (2003). Accountability And Ethics: Reconsidering the Relationships. International Journal of Organization Theory and Behavior, 6(3), 405-441.

Dumont, G. and Candler, G. (2005). Virtual Jungles: Survival, Accountability, and Govemance in Online Communities. The American Review of Public Administration, 35 (3), 287-299.

Elster, J. (1999). Accountability in Athenian Politics. In: A. Przeworski, S. Stokes and B. Manin (Eds.), Democracy, Accountability, and Representation, Cambridge: Cambridge University Press, 253-278.

Flinders, M. (200\),.The Politics of Accountability in the Modern State. Burlington: Ashgate.

Ghezzi, F. and Malberti, C. (2008). The Two-Tier Model and the One-Tier Model of Corporate Govemance in the Italian Reform of Corporate Law. European Company and Financial Law Review, 5( 1 ), 1-47.

PAQ FALL 2010 333

Hart, P.'t and Wille, A. (2006). Ministers and Top Officials in the Dutch Core Executive: Living Together, Growing Apart?. Public Administration, 84 (1), 121-146.

Keams, K. P. (1996). Managing for Accountability: Preserving the Public Trust in Public and Nonprofit Organizations. San Francisco: Jossey-Bass.

Klingner, D E., Nalbandian, J and Romzek, B. S (2002). Politics, Administration and Markets. Conflicting Expectations of Accountability. American Review of Public Administration, 32(2), 117-144.

Koppell, J. (2005). Pathologies of Accountability: ICANN and the Challenge of 'Multiple Accountabilities Disorder'. Public Administration Review 65 (1), 94- 109.

Landau, M. (1969). Redundancy, Rationality and the Problem of Duplication and Overlap. Public Administration Review, 29 (4), 346-358.

Lehn B. M. (2008). Bearing More Risk for Results: Performance Accountability and Nonprofit Relational Work. Administration & Society, 39 (8), 959-983.

Mattli, W. and Buthe, T. (2005). Accountability in Accounting? The Politics of Private Rule-Making in the Public Interest. Governance, 18(3), 399-429.

Meijer, A. (2002). De doorzichtige overheid. Parlementaire en juridische controle in het informatietijdperk. Delft: Eburon.

Miller, G. J. (2005). The Political Evolution of Principal- Agent Models. Annual Review of Political Science 8,203-225.

Moe, T. M. (1984). The New Economics of Organization. American Journal of Political Science, 28,139-111.

Mulgan, R. (2000). Accountability: An Ever-Expanding Concept?. Public Administration, 78 (3), 555-573.

I

334 PAQ FALL 2010

Mulgan, R. (2003). Holding Power to Account. I Accountability in Modern Democracies. Palgrave:

MacMillan. O'Donnell, G. (1998). Horizontal accountability in new

democracies. Journal of Democracy, 9(3), 112-126. Page, S. (2006). The Web of Managerial Accountability:

The Impact of Reinventing Govemment. Administration & Society, 38 (2), 166-197.

Paul, S. (1992). Accountability in Public Services. Exit, 1 Voice and Control. World Development, 20, 1047-

1060. Pollitt, C. (2003). The essential public manager. London:

Open university press / McGraw-Hill. Pollitt, C , Girre, X., Lonsdale, J., Mul, R., Summa, H. and

Waemess, M. (1999). Performance or Compliance? Performance Audit and Public Management in Five Countries, Oxford: Oxford University Press.

Pollitt, C. and Bouckaert, G. (2004). Public Management I. Reform. A Comparative Analysis, Revised second

edition, Oxford: Oxford University Press. Pollitt, C , Talbot, C.,. Caulfield, J. and Smullen, A. (2004).

Agencies. How Governments Do Things through Semi Autonomous Organisations, Basingstoke: Palgrave Macmillan.

Posner, P. L. (2002). Accountability Challenges of Third- Party Govemment. In: L.M. Salamon (Ed.), The Tools of Government. A Guide to the New Governance, Oxford: Oxford University Press, 523- 551.

Rhodes, R. (1994). The hollowing out of the state: The changing nature of the public service in Britain.: Political Quarterly, 65 (2), 138-151.

Roberts, J. (2001). Trust and Control in Anglo-American Systems of Corporate Govemance. The Individualising and Socialising Effects of Processes of Accountability. Human Relations, 54 1547-1572.

PAQ FALL 2010 335

Romzek, B. S. and Dubnick, M. D. (1987). Accountability in the Public Sector: Lessons from the Challenger Tragedy. Public Administration Review, 47 (3) 227- 238.

Romzek, B. S. and Dubnick, M. D. (1998). Accountability. In: J. M. Shafritz (Ed.), International Enyclopedia of Public Policy and Administration, Boulder: Westview Press.

Schillemans, T. (2008). Accountability in the Shadow of Hierarchy: The Horizontal Accountability of Agencies. Public Organization Review, 8 (2), 175- 194.

Scott, C. (2000). Accountability in the Regulatory State. Journal of Law and Society, 27(1), 38-60.

Sinclair, A. (1995). The Chameleon of Accountability. Forms and Discourses: Accounting, Organizations and Society, 20 (2/3, 219-237.

Stein, J. G. (2002). Bad Translation or Double Standard? Productivity and Accountability Across the Private, Public and Voluntary Sectors. The Review of Economic Performance and Social Progress, 259- 275.

Strom, K. (2000). Delegation and accountability in parliamentary democracies. European Journal of Political Research, 37 (3), 261-289.

Thatcher, M. and Stone Sweet, A. (2002). Theory and Practice of Delegation to non-Majoritarian Institutions. West European Politics, 25 (1), 1-22.

Thiel, S. van (2000). Quangocratization: Trends, Causes,Consequences. Utrecht: ICS.

Verschuere, B., Verhoest, K., Meyers, F. and Peters, G. P. (2006). Accountability and accountability arrangements in public agencies. In: T. Christensen and P. Laegreid (Eds.), Autonomy and Regulation: Coping with Agencies in the Modern State, Cheltenham: Edward Elgar, 268-300.

336 PAQ FALL 2010

II

Vibert, F. (2007). The Rise of the Unelected, Democracy I and the New Separation of Powers. Cambridge:

Cambridge University Press. Wildavsky, A. (1973). If Planning is Everything, Maybe

! it's Nothing. Policy Sciences, 4 (2), 27-153. Wilson, J. Q. (1989). Bureaucracy: What government

, agencies do and why they do it. New York: Basic ! Books i ••

I ENDNOTES

1 The list of joumals can be found below. I am indebted to Christoph Ossege's excellent assistance in analyzing the literature. The joumals were initially selected on the basis of impact factors. The scope of joumals was then broadened, for purposes other than this paper, to include the most import joumals according to scholars on European politics and govemance. Most articles were published in high ranking public administration joumals such as Public Administration Review, American Review of Public Administration, Administration & Society and Public Administration.

PAQ FALL 2010 337

Journal Administration & Society European Joumal of Political Research European Law Loumal European Union Politics Governance Joumal of Public Administration Research and Theory Joumal of Common Market Studies Journal of European Integration Joumal of European Public Policy Joumal of Social Policy Local Govemment Studies Policy and Politics Public Administration Review Public Administration Public Performance and Management Review Regulation and Govemance The American Review of Public Administration West European Politics

Nr of articles 14 7 6 1 8 8

1 1 1 2 5 1 f7 13 6 2 17

4

2 Cost would be a fourth potential advantage of redundancy. But of course redundancy is also costly. It was not possible in the course of this research to assess the costs of multiple accountability with sufficient certainty. For a full scale evaluation this is nevertheless necessary.

3 The names for the organizations in the table are the following: 01 = Land registry 02 = Central Financial Org. for Education 03 = Centre for Work & Income 04 = IBG (loans & grants) 05 = Forest Service 06 = NL Vaccine Institute . 07 = Authority for Vehicles 08 = Social security agency (UWV) 09 = Statistics NL

4 The norms focus on the following general issues: quality of services, cost/performance, responsiveness & participation and transparency. Each issue has been translated into appr. 7 specific indicators.

Copyright of Public Administration Quarterly is the property of Southern Public Administration Education

Foundation and its content may not be copied or emailed to multiple sites or posted to a listserv without the

copyright holder's express written permission. However, users may print, download, or email articles for

individual use.

Emerging Risks.pdf

Emerging Risks in Auditing and Accountability

26 JOURNAL OF GOVERNMENT FINANCIAL MANAGEMENT SUMMER 2016

I n a world in which dynamic change is the new normal, and cynicism about government and other public institutions grows, the public sector

cannot afford to fall behind in its commitment to accountability.

While government and business alike struggle with technology that advances at breakneck speeds and risks that appear seemingly over- night, these challenges also provide opportunity for public-sector auditors to redefine their work and increase the credibility of those they work for as true public servants.

However, for this to happen, two fundamental shifts must occur first: Operational changes must be widely adopted to enhance public-sector auditor independence, and the scope of government auditing must more quickly expand beyond traditional finance and accounting.

The recently published 2016 North American Pulse of Internal Audit,1 produced by The Institute of Internal Auditors (IIA) Audit Execu- tive Center, encourages internal audit practitioners to examine how they approach their jobs.

“As risks change, as new risks emerge, and as stakeholder expec- tations continue to evolve, internal

auditors must move out of their comfort zone to audit at the speed of risk,” according to the report.

The Pulse report focuses on four key emerging risk/opportunity areas — cybersecurity, organiza- tional use of data, auditing culture, and developing soft skills — but the challenge for public-sector auditors is to free themselves of institutionally imposed restrictions that limit their scope of work and independence.

Government auditors operate in a less-than-uniform atmosphere than is typically found in the private sector. Some are stand-alone; others are incor- porated into finance or comptroller’s functions. Reporting lines are equally inconsistent, with some municipali- ties and states creating direct reports to elected or appointed boards, and others reporting to appointed top management or finance executives.

Two fundamental problems can develop when internal audit reports solely to management without a complementary reporting line to an independent audit committee, as most private-sector companies have. First, audit resources may be focused on less-risky areas, driven by management’s desire to avoid exposing problems. Consequently,

By: John W. Wszelaki, MPA, CIA, CRMA, CFE; and Jim Pelletier, CIA, CGAP

Continued on page 29

SUMMER 2016 JOURNAL OF GOVERNMENT FINANCIAL MANAGEMENT 27

While government and business alike struggle with technology that advances at breakneck speeds and risks that appear seemingly overnight, these challenges also provide opportunity for public-sector auditors to redefine their work and increase the credibility of those they work for as true public servants.

full risk assessments are not achieved. This can skew audit priorities and lead to underutilization of internal audit resources. The fallout also can create an atmosphere where there is little incentive to act outside the box.

As new technology and evolving risk raise the stakes for all organizations, there must be an enterprise-wide reas- sessment of how risks are managed. Focusing on internal control is no longer enough to protect the enterprise. Without deep analysis of the risks facing government entities, internal control in practice devolves into control activities performed by rote.

Given the public-sector’s fixa- tion on protecting taxpayer dollars, finance and accounting risks histori- cally are government’s default comfort zones. But even the most basic examination of the varied roles of government reflects the diversity of risks that government auditors should routinely examine.

Risks related to the use of Super- visory Control and Data Acquisi- tion (SCADA) systems offer a good example of government functions beyond finance and accounting that are not routinely audited. A cyberat- tack on a SCADA system could leave a government blind to what may be happening with water-treatment facilities, electrical grids or civil defense systems. Without internal audit providing oversight and assur- ance, governments may not realize the vulnerabilities of such systems.

Risks associated with cybersecu- rity, data privacy, health services, third-party vendors and services, and more, also come to mind. Simply, the new risk landscape demands audit functions that are sufficiently inde- pendent and free to evaluate a broad spectrum of risks and present their findings to management and elected leaders for evaluation and action.

Another area explored in the Pulse report, organizational use of data, makes the case that many internal audit functions do not provide suffi- cient oversight on how organizations collect, analyze and use data. Increas- ingly, significant strategic decisions are based, in whole or in part, on data analysis. Risks arise when there is

no mechanism to assure the data’s veracity or that the conclusions drawn from it are accurate.

Given the variety of data collected, processed, and reported by govern- ment entities, the public sector faces substantial challenges. Indeed, a 2014 report2 from the United Nations Statistics Division (UNSD) and the United Nations Economic Commis- sion for Europe (UNECE) of 57 big- data projects operated by government entities found that more than two- thirds did not have a defined quality assessment framework. Oversight of big data also must include an exami- nation of how data is collected and its moral and privacy implications. The same UN survey found that, whereas 68 percent of respondents identified privacy or confidentiality issues related to the collected data, only a few had created a privacy framework for dealing with the data.

Clearly, there are abundant exam- ples of how public-sector organiza- tions could conceivably face risks outside of finance and accounting, making it paramount to have a func- tion that provides objective assur- ance on how those threats are being handled.

In 2015, IIA introduced the concept of the Paradox of Structural Expecta- tions.3 Based on research of stake- holder views on internal audit’s value, it became clear that stakeholders desire internal audit’s involvement in more pressing risks to the orga- nization. At the same time, they expect internal audit to continue to provide traditional audit services in finance and accounting, even when those may pose lesser risks to the organization.

The paradox creates a situation in which the organization recognizes how internal audit can provide the highest value, yet boxes the function into a comfort zone. It’s an ironic reality in which internal audit’s continued focus on traditional but lower-risk areas creates new risks,

because the function does not have the time or resources to assess how the organization addresses its most pressing threats.

So, how should public-sector enti- ties assure relevance and account- ability? A significant first step would be to enhance independence and objectivity of accountability oversight.

IIA published a Global Public Sector Insight report5 in 2014 explaining the value of independent public- sector audit committees. Among the benefits:

“Independent audit committees help public sector organizations meet taxpayers’ increasing demands for transparency and accountability by providing

Continued from page 27

SUMMER 2016 JOURNAL OF GOVERNMENT FINANCIAL MANAGEMENT 29

Oversight of big data also must include an examination of how data is collected and its moral and privacy implications.

oversight of management practices in key governance areas, including:

n Values and ethics.

n Governance structure.

n Risk management.

n Internal control framework.

n Audit activity.

n External assurance providers.

n Management action plans.

n Financial statements and public accountability reports.

auditing, risk management, compliance, and information technology.”

The report provides a model audit committee charter that can be readily used by public-sector organizations looking to create an audit committee and prescribes the appropriate knowledge and expertise for audit committee chairs and members.

In addition, the report provides useful tools for appropriately addressing oversight of the organiza- tion’s values and ethics, governance, risk management, internal auditing, external assurance review, manage- ment action planning, financial state- ments, and public accountability reports.

The audit committee charter documents information about the audit committee’s mandate, membership, authority, responsi- bilities, and processes for devel- oping, reviewing, and updating the charter. Audit committee member independence is a key concept expressed in the charter. In addition to being indepen- dent from the organization, audit committee members are expected to conduct their work in a diligent and professional man- ner; demonstrate inquisitiveness, outspokenness, and courageous- ness; and collectively be knowl- edgeable of, or have expertise in, finance and accounting, business,

Public-sector auditors can take three concrete steps to protect their organizations from transparency-induced fraud:

3. UNDERSTAND THE ROLE OF CULTURE The culture of an organization plays a vital role on how employees view waste, abuse and fraud. Public-sector auditors must be attuned to the subtle signals from elected leaders and management executives that public employees will pick up on. Negative or dangerous trends and themes should be brought to the attention of management and boards.

2. ADOPT A ZERO-TOLERANCE POLICY FOR WASTE AND ABUSE The threshold for public outrage over government waste or mismanagement has virtually disappeared. While the public has become desensitized to overpriced military hardware, bureaucratic waste and political gridlock, the public-sector auditors must not succumb. No instance of bending or breaking the rules for political expediency or saving face can be tolerated.

1. PRACTICE HEALTHY SKEPTICISM All auditors must approach their jobs with polite incredulity. This means questioning long-held assumptions, not taking things at face value, understanding the motivation behind actions, and asking the extra question to get to the root cause of the most vexing problems. The caveat is not to confuse skepticism — a healthy questioning of the truth of a matter — with cynicism — the expectation that everything is motivated by self-interest.

30 JOURNAL OF GOVERNMENT FINANCIAL MANAGEMENT SUMMER 2016

The undercurrents and volatility of today’s economic environment demand public- and private-sector entities alike position themselves to act nimbly and confidently. The obligation to properly address those risks virtually mandates a robust, well-financed and independent internal audit function within the public sector.

Endnotes 1. The 2016 North American Pulse of

Internal Audit, produced by the Institute of Internal Auditors, can be downloaded from: https://na.theiia.org/news/ Pages/2016-North-American-Pulse-of- Internal-Audit-Released.aspx

2. Results of the UNSD/UNECE Survey on organizational context and individual projects of Big Data, prepared by the Statistics Divisions of UN/DESA and UN Economic Commission for Europe, February 2015. http://unstats.un.org/unsd/ statcom/doc15/BG-BigData.pdf

3. Pulse of Internal Audit, Navigating an Increasingly Volatile Risk Environment, The IIA Audit Executive Center, 2015.

https://na.theiia.org/special-promotion/ PublicDocuments/2015-Leadership-Pulse- of-Internal-Audit.pdf

4. The Fraud Triangle. http://www.acfe.com/fraud-triangle.aspx

5. Global Public Sector Insight: Independent Audit Committees in Public Sector Organizations, June 2014, The IIA. https:// global.theiia.org/standards-guidance/ Public%20Documents/Independent- Audit-Committees-in-Public-Sector- Organizations.pdf

John W. Wszelaki, MPA, CIA, CRMA, CFE is the director of The Institute of Internal Auditors American Center for Government Auditing. He is the former audit

director for the Department of Alcoholic Beverage Control for the Commonwealth of Virginia where he was responsible for the creation, implementation and ongoing optimization of the internal audit function.

Jim Pelletier, CIA, CGAP, is The Institute of Internal Auditors Vice President, Profes- sional Solutions. He is a former city auditor for the City of Palo Alto, Calif.

and was the chief of audits for the County of San Diego. His diverse auditing experience also includes roles at the California State University System, PETCO Animal Supplies, Inc., State Street Corporation and General Electric.

SUMMER 2016 JOURNAL OF GOVERNMENT FINANCIAL MANAGEMENT 31

Copyright of Journal of Government Financial Management is the property of Association of Government Accountants and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use.

B7640_M7_A2_LASA_rubric.docx

2

LASA—Course Project Final Submission Rubric

LASA—Course Project Final Submission

Rubric

Assignment Component

Unsatisfactory

<76%

Emerging

77%–86%

Proficient

87%–96%

Exemplary

97%–100%

Score

Content Knowledge: Understanding

Component 1

Introduction to your selected topic.

COs: 1, 2, 3, 4, 5

POs: 3, 5, 6.1

ILOs: 1, 2, 3, 6

Response provides a weak, non-focused introduction to the literature review.

Response incorporates a few but minimal

Important points of a competent introduction to a literature review as outlined in the assignment.

Provided an adequate introduction to your selected topic that has a topic sentence which indicates what will be covered and also tells the reader the specific focus of the literature review in the concluding sentence.

Response incorporates in-depth and extensive work on the details providing a complete and informative introduction to this literature review as outlined in the assignment offering extra details showing a depth and breadth of the topic chosen.

Unsatisfactory: <14

Emerging: 15–16

Proficient: 17–18

Exemplary: 19–20

______ /20 pts

Comments

Content Knowledge: Application

Component 1

Literature Review (a minimum of 10 sources).

COs: 1, 2, 3, 4, 5

POs: 3, 5, 6.1

ILOs: 1, 2, 3, 6

The review is superficially written and lacks organization and cohesiveness. The paper lacks the required number of qualified and credible scholarly sources.

The review minimally integrates the relevant sources in the discussion and provides an incomplete analysis.

The paper has only a few of the required number of qualified and credible scholarly sources.

Provides a complete and well written literature review regarding the articles chosen along with how each aligns with the student’s topic.

The paper has at least ten sources and includes a complete listing of all supporting materials of the required literature review.

Provides a comprehensive review with a thorough analysis of the selected articles. Key trends and gaps are highlighted and conclusion is well drawn.

The paper has well over the ten required sources and also many of which are highly regarded and qualified scholarly resources and includes a complete listing of all supporting materials of the required literature review.

Unsatisfactory: <42

Emerging: 42–47

Proficient: 48–53

Exemplary: 54–60

______ /60 pts

Comments

Content Knowledge: Application Component 2

Theoretical framework for the review.

COs: 1, 2, 3, 4, 5

POs: 3, 5, 6.1

ILOs: 1, 2, 3, 6

Response is not a clear and does not identify a cleat framework.

Response is lacking in depth and breadth in its explanation of the framework.

Response identifies landmark or classic studies and theorists as the framework/context for your study.

Response identifies landmark or classic studies and theorists as the framework/context for your study detailing thoroughly how the identified theories justify the context of the selected topic.

Unsatisfactory: <42

Emerging: 42–47

Proficient: 48–53

Exemplary: 54–60

______ /60 pts

Comments

Content Knowledge: Application Component 3

Data and analysis of selected topic, including impact of disclosure rules on the topic.

COs: 1, 2, 3, 4, 5

POs: 3, 5, 6.1

ILOs: 1, 2, 3, 6

Response exhibits substantial gaps in a competent analysis of the data as well as for any disclosure rules for your topic.

Response exhibits a weak analysis with gaps that would make a complete and competent analysis of both the data as well as any disclosure rules for your topic.

Response incorporates an adequate and competent analysis of both the data and the impact that any disclosure rules may have on the selected topic.

Response demonstrates an exemplary complete and competent analysis of both the data as well as any disclosure rules for your topic.

Unsatisfactory: <28

Emerging: 28–31

Proficient: 32–35

Exemplary: 36–40

______ /40 pts

Comments

Content Knowledge: Application Component 4

Summary of key findings in the literature supporting the topic.

COs: 1, 2, 3, 4, 5

POs: 3, 5, 6.1

ILOs: 1, 2, 3, 6

Response is not a clear, detailed and complete summary of key findings in the literature supporting the topic.

Response exhibits some gaps in the summary of key findings in the literature that supports the topic.

Response incorporates an analysis that adequately summarizes, interprets, and synthesizes the literature that has been selected.

Response demonstrates an exemplary analysis that summarizes, interprets, and synthesizes the literature that has been selected.

Unsatisfactory: <42

Emerging: 42–47

Proficient: 48–53

Exemplary: 54–60

______ /60 pts

Comments

Content Knowledge: Application Component 5

References & Appendices (if any).

COs: 1, 2, 3, 4, 5

POs: 3, 5, 6.1

ILOs: 1, 2, 3, 6

Response is not a clear, detailed or complete listing of References and

Appendices.

Response exhibits some gaps in a detailed or complete listing of References and

Appendices.

Response incorporates an adequately complete listing and supporting materials of References and

Appendices.

Response demonstrates an exemplary example of a complete listing and supporting materials of References and

Appendices.

Unsatisfactory: <28

Emerging: 28–31

Proficient: 32–35

Exemplary: 36–40

______ /40 pts

Comments

Written Communication/Personal Effectiveness

Conveys through written word understanding and application of the essential assignment components.

PO: 3, 4

ILO: 2, 3

Writing is disorganized; lacks appropriate APA style and format.

Writing is unclear and includes major grammatical and usage errors.

Writing shows some gaps with respect to organization and rhetoric, has some errors with respect to APA style and format.

Writing is somewhat clear and includes some major grammatical or usage errors.

The response is written in a clear, concise, and organized manner; demonstrates ethical scholarship in the accurate representation and attribution of sources; and displays accurate spelling, grammar, and punctuation.

Writing is professional and scholarly, reflecting mastery of content, language use, grammar, organization, and sentence structure.

Writing is cohesive, convincing, and well composed.

Unsatisfactory: <14

Emerging: 15–16

Proficient: 17–18

Exemplary: 19–20

______ /20 pts

Comments

Total:

/300 pts

Page 1 of 3

Accounting in a Global Financial Community

©2015 Argosy University

Page 2 of 3

Accounting in a Global Financial Community

©2015 Argosy University