Contemporary issues in Performance Measurement and Productivity: A review of research issues,...

28
UNIVERSITY OF GHANA BUSINESS SCHOOL RESEARCH DESIGN AND QUALITATIVE RESEARCH UGBS 653 Contemporary issues in Performance Measurement and Productivity: A review of research issues, conceptual approaches, methods and gaps MPHIL OPERATIONS MANAGEMENT GROUP 2013/2014 ACADEMIC YEAR-SEMESTER ONE 25/10/2013 Dr. Richard Boateng

Transcript of Contemporary issues in Performance Measurement and Productivity: A review of research issues,...

UNIVERSITY OF GHANA BUSINESS SCHOOL

RESEARCH DESIGN AND QUALITATIVE RESEARCH

UGBS 653

Contemporary issues in Performance Measurement and

Productivity: A review of research issues, conceptual approaches,

methods and gaps

MPHIL OPERATIONS MANAGEMENT GROUP

2013/2014 ACADEMIC YEAR-SEMESTER ONE

25/10/2013

Dr. Richard Boateng

1

Group List

No. Name Index

Number

Email Address Phone Number

1 Banuro, Joseph Kwaku

10277402 [email protected] 0240267716

2 Ofori, Charles Gyamfi

10283050 [email protected] 0207279230

3 Turkson, Charles

10442287 [email protected] 0208751735

4 Opoku Mensah, Richard

10443466 [email protected] 0246232968

5 Anagba, K. Kingsley

10443877 [email protected] 0243512308

6 Gakpey, Victor Sosu

10444001 [email protected] 0244813354

7 Asare, K.A. Jones 10444145 [email protected] 0247817537

2

Table of Contents

Group List .................................................................................................................................. 1

List of Figures ............................................................................................................................ 2

List of Tables ............................................................................................................................. 2

List of Abbreviations ................................................................................................................. 3

ABSTRACT ............................................................................................................................... 4

INTRODUCTION ..................................................................................................................... 4

FRAMING AND METHODOLOGY ....................................................................................... 6

PRESENTATION OF FINDINGS ............................................................................................ 9

Performance Measurement in Operations Management ...................................................... 10

Firm Performance ............................................................................................................. 11

Financial Performance ...................................................................................................... 12

Labour productivity .......................................................................................................... 12

Trends in research on performance measurement ................................................................ 13

Industrial trends in performance measurement ................................................................ 13

Contextual trends in performance measurement .............................................................. 15

Method trends in performance measurement ................................................................... 16

RESEARCH GAPS ................................................................................................................. 18

Gaps in research issue .......................................................................................................... 18

Gaps in conceptual approaches ............................................................................................ 18

Gaps in context of study ....................................................................................................... 19

Gaps in research methods used ............................................................................................ 19

FUTURE RESEARCH DIRECTIONS ................................................................................... 20

References ................................................................................................................................ 21

Appendix A: List of Articles Reviewed ................................................................................... 22

Appendix B: The Steps in a Systematic Review ..................................................................... 27

List of Figures

Figure 1: Number of articles in each topic category 8

Figure 2: Distribution of articles (Continent) 15

List of Tables

Table 1: Initial set of Journals considered ................................................................................ 7

Table 2: Descriptive statistics of works reviewed ..................................................................... 9

Table 3: Mapping of Research Issues ...................................................................................... 11

Table 4: Binomial Test of Proportions..................................................................................... 14

Table 5: Types of Service businesses ...................................................................................... 14

Table 6: Distribution of papers (Country level) ....................................................................... 15

Table 7: Methods used in the papers........................................................................................ 16

Table 8: Results of goodness of fit test .................................................................................... 17

Table 9: Statistical Methods Used ........................................................................................... 17

3

List of Abbreviations

1 European Journal Of Operations Research :EJOR

2 International Journal Of Production Research :IJPR

3 International Journal Of Operations And Production Management :IJOPM

4 Production Planning and Control :PPC

5 Supply Chain Management, International Journal :SCMIJ

6 Journal Of Operations Management :JOM

7 Omega - International Journal Of Management Science :OIJMS

8 Journal Of Operational Research Society :JORS

9 Naval Research Logistics :NRL

10 Decision Sciences :DS

11 Journal of Forecasting :JOF

12 Journal of Scheduling :JOS

13 Management Science :MS

14 Informs :INT

15 Operations Management :OM

16 Association of Business Schools :ABS

17 SCImago Journal Ranking :SJR

18 Journal Citation Report :JCR

4

Contemporary issues in Performance Measurement and Productivity: A review of

research issues, conceptual approaches, methods and gaps

ABSTRACT

Although there has been some considerable amount of review of knowledge in Operations

Management, these papers either generically look at all topics in Operations Management or

draw inferences from a single journal. They are thus either too broadly focussed or have a

narrow coverage. This study therefore assesses an aspect of operations management from

various academic journals. The study evaluates contemporary knowledge in performance

measurement and productivity in operations management. This allows for the assessment of

trends and identification of gaps in productivity research. A systematic literature review

process was implemented to aid in a more scientific review. This paper focused on

publications of three top journals in operations research from 2011 to 2013. In all 69 articles

were reviewed. The study revealed that, there are no publications with Africa as the study

area coupled with a relatively lower number of publications targeting developing economies.

Similarly, service industry seems to be of major concern to operations researchers. Also,

much research has been conducted on firm performance relative to labour and financial

performances in organizations. Coupled with these, there seem to be over-reliance on

quantitative techniques to the neglect of qualitative techniques. It is suggested that further

studies need to evaluate performance systems in developing economies and more research

directed towards labour and financial performance especially in the manufacturing industry.

Keywords: Performance measurement, Productivity, Firm performance, Operations

Management

INTRODUCTION

Performance measurement is an important aspect of Operations Management (OM), which

comprises a whole spectrum of research areas like Supply Chain Management, Management

Science, Quality Management, Scheduling and others. Generally OM aims at ensuring

efficient use of scarce resources to produce goods and services to satisfy customer needs or

requirements and enhance competiveness (Lehmann & Koelling, 2010). It also deals with

ways by which organisational activities can be managed in the production and delivery of

goods and services as required by customers (Radnor & Barnes, 2007). Performance

measurement is linked with several other research areas in the field of operations research.

Russell and Taylor (2011) posit that improving product design, quality of materials and parts,

job designs or production process will all lead to increased productivity.

Performance Measurement and Productivity are closely linked and difficult to distinguish.

Neely, Gregory and Platts (1995) identified that Performance Measurement, although often

used is barely defined. They outlined two fundamental dimensions for Performance

Measurement – Efficiency and Effectiveness. Whereas efficiency measures economic

utilisation of firms’ resources at a given level of customer satisfaction, effectiveness looks at

5

the extent to which the customer requirements are met. Mathematically, efficiency and

productivity are expressed as the ratio of the work output to input. By definition, productivity

is that aspect of performance measurement that focuses on efficiency. However, for the

purpose of this paper, these two concepts are used interchangeably. Performance

measurement became a field of study in academic institutions about three decades ago (Busi

& Bititici, 2006).

Performance measurement has been of concern to and applied by government agencies,

corporate bodies as well as non-profit making organisations (Vanichchinchai, 2012; Halligan,

Sarricco & Rhodes, 2012; and Shafer & Moella, 2012). Whereas Vanichchinchai, (2012)

applies it in Supply Chain Management, Halligan, Sarricco and Rhodes (2012) linked

performance measurement to Public Sector Governance. Shafer and Moella (2012) also

looked at performance monitoring at the corporate level. This shows the importance of

performance and productivity measurement in various fields of study.

Due to the importance of performance measurement, there is the need for a critical

understanding of the extent of research in this area of Operations Management. Over the past

decades, various reviews have been conducted in Operations Management. Scudder and Hill

(1998) provided a review of empirical studies in Operations Management in a ten-year

interval spanning from the year 1986 to 1995. Cohen and Kunreuther (2007) outlined the

contributions made by Kleindorfer to Operations management. Kouvelis, Chambers and

Wang (2007) also reviewed manuscripts that were focused on Supply Chain Management

published in the Production and Operations Management Journal in a fifteen-year period

(1992-2006). Similarly, Gupta, Verma and Victorino (2006) assessed empirical research

published in the same journal over the period 1992 to 2005. To the best knowledge of

researchers, only Lehmann and Koelling (2010) have reviewed works on productivity.

However, despite these important contributions of these researches, these reviews have three

main limitations: too broadly focused (on a lot of topic areas in Operations Management); too

narrowly covered (on only one journal or the contribution of an individual) and lack currency

(not enough reviews in the last three years).

This paper is therefore undertaken to provide a synthesis of literature that relates to current

research works that have been carried out in the area of productivity and performance

measurement and to provide directions for future research. It is thus undertaken to achieve

the following specified objectives:

1. Provide a review of literature and an analysis of research and results related to

productivity in Operations Management literature.

2. Identify trends in the research related to context, methods and industrial focus in

Performance Measurement

3. Identify gaps and provide directions for further research in the area of performance

measurement based on contexts, issues and methodologies.

The subsequent sections of this work are divided into four main sections. The first section

presents the methods applied in the review process. The second, third and fourth sections

reviews the research. Whereas the second section reviews current knowledge in productivity,

the third section examines the trend in research on productivity and performance

6

measurement. The fourth section finally takes a look at the gaps in the research and suggests

areas for further research.

FRAMING AND METHODOLOGY

A systematic literature review process was used to understand the extent and trends in

research in performance measurement and productivity. This is a means of identifying,

evaluating and interpreting all available research relevant to a particular question, topic area

or phenomenon of interest (Kitchenham, 2007). Here, the researcher identifies and plans the

review process before it is undertaken.

Unlike traditional reviews, a systematic review has been seen to synthesise existing work in a

manner that is more scientific, fair and seen to be fair, transparent, more rigorous and

minimizes bias (Kitchenham, 2007; Lehmann & Koelling, 2010). This is because there is the

need for a predefined search strategy that allow for completeness of the papers to be assessed.

It has been applied in wide variety of academic areas like software engineering, medicine and

management research. For example, Lehmann and Koelling (2010), have applied this

methodology in operations research in reviewing productivity of services. This study adopted

the Khan, Kunz, Kleijnen and Antes (2003) five steps plan to conducting a systematic review.

This is outlined in Appendix 2.

Step 1: Framing questions for review

The aim of this paper is to review research on performance measurement and productivity

during the three year period, from 2011 to 2013, that had been published in three top journals

in Operations Management. The paper therefore sought to answer the questions: What are the

new development in performance measurement? What techniques of researchers using to

evaluate performance? and What are the gaps in research?

Step 2: Identifying relevant work

Systematic review requires that works relied on are extensive and from multiple sources,

ensuring that reasons for inclusion and exclusion are recorded (Khan, Kunz, Kleijnen &

Antes, 2003).

This requirement was followed in conducting this review. To ensure availability of extensive

research from multiple sources, a pool of fifteen (15) discipline-relevant journals based on

four (4) metrics: Thomson Reuters’ 2012 Journal Citation Report, Association of Business

Schools’ 2010 Academic Journal Quality Guide, the SCImago Journal Rank and discussions

with faculty. These were journals in operations and management science that have high

impact factor ratings and highly recommended by experts in operations management. These

have been identified in Table 1.

7

Table 1: Initial set of Journals considered

Journal Publisher ABS SJR

1. IJPR Taylor and Francis 4 1.303

2. JOM Elsevier 4 4.997

3. OR Informs 4 3.925

4. MS Informs 4 2.906

5. EJOR Elsevier 3 2.596

6. IJOPM Emerald 3 1.784

7. OIJMS Elsevier 3 3.162

8. JORS Palgrave Macmillan 3 1.367

9. JOS Wiley 3 1.857

10. PPC Taylor and Francis 3 0.697

11. NRL Wiley 3 1.268

12. DS Wiley 3 1.292

13. SCMIJ Emerald 3 1.265

14. JOF Wiley 3 0.575

15. INT Informs 2 1.187

Source: Authors’ Construct

After a thorough assessment and discussion with experts, the following criteria was used to

select three top journals for review:

1. The Journal must be in Grade 3 or 4 of the ABS quality ranking

2. The Journal must be ranked in all three rankings (JCR, ABS & SJR) used for the

study

3. The Journal must have a relatively high impact factor

4. In order to ensure broader coverage, no three journals from the same publisher can

be selected.

The final three selected Journals were therefore: Journal of Operations Management (JOM);

Omega International Journal of Management Sciences (OIJMS); and Supply Chain

Management International Journal (SCMIJ). These are top grade journals with high impact

factors. Whereas JOM is a grade 4 journal (ABS), OIJMS and SCMIJ are grade 3 papers.

Other statistics also indicate a rising dependence on articles from these three journals by other

researchers.

Emphasis of this review was on contribution made on performance measurement from 2011

to 2013, to identify contemporary research issues that are trending in operations research.

Although the focus of the work was to understand the extent and trends of research on

performance measurement and productivity, there was the need to consider other topics that

have had prominence in these journals over the years under consideration. There were 557

articles in the three journals including editorials. These were subsequently categorized into

research topics to identify topics in operations research that have been researched on

extensively.

Step 3: Assessing the quality of studies

The selection criteria used in identifying the three top journals was robust at ensuring that

only highly ranked journals were selected. The Thomson’s JCR, ABS ranking and SCImago

8

rankings are all acknowledged to be good indicators of quality publishing. Therefore the

quality of papers from these journals was assured.

Also, to avoid bias in categorization, all seven (7) members of the group were part of the

panel for approval of article summary by individual members. This means that the article

summary by individual members had to go through scrutiny by all members for approval

before it could be accepted.

Step 4: Summarizing the evidence

The 557 articles identified were categorized based mainly on the topic categories in the

advice to contributors in Journal of Operations Management. This categorization has been

applied by Scudder and Hill (1998). The results of the topic categorization are presented in

Figure 1.

Figure 1: Number of articles in each topic category

From Figure 1, it is evident that issues on Supply Chain Management had been well

researched because one of the journals had it as its main focus. This is followed by

Performance Measurement and Productivity. Disaster Management in operations research has

had the least number of publications. The category “other” refer to articles that cannot be

placed under any of the listed categories since they are not operations research papers. These

papers may have applied operations research models in other academic disciplines.

178

6964

37 37

2823

13 12 11 94 4 4 1

0

20

40

60

80

100

120

140

160

180

200

Scm Perf Others Mat Prod Cap Plan Env Inf Beh Qua Tech Int His Dis

Nu

mb

er

of

Art

icle

s

Topic category

Supply Chain Management Scm

Performance Measurement and Productivity Perf

Others Others

Material and Inventory Management Mat

Product and Service Design Prod

Capacity Planning and Systems Design Cap

Operations Planning, Scheduling and Control Plan

Environmental Regulatory Issues Env

Operations Information Management Inf

Behavioural Operations Management Beh

Quality Management Qua

Technology Management for Operations Tech

International and Comparative Operations Int

History And Evolution His

Disaster Management Dis

9

Step 5: Interpreting the findings

The review then focuses on Performance measurement and productivity presenting insights

through synthesis of relevant literature, tabulation of study characteristics as well as use of

statistical methods for exploring differences between studies and combining their effects.

PRESENTATION OF FINDINGS

Table 2, presents a preliminary description of data used in this work. These are from critical

assessment of all works cited in Appendix A.

Table 2: Descriptive statistics of works reviewed

Frequency Percent

Name of Journal

JOM 16 23.2

OIJMS 47 68.1

SCMIJ 6 8.7

Total 69 100.0

Year of Publication

2011 30 43.5

2012 23 33.3

2013 16 23.2

Total 69 100

Type of Paper

Empirical 51 73.9

Conceptual 15 21.7

Literature Review 3 4.3

Total 69 100

Research Issue

Firm Performance 52 72.2

Financial Performance 7 9.7

Labour Flexibility 12 16.7

Other 1 1.4

Total 72 100

Level of Analysis

Micro 6 11.1

Meso 29 53.7

Macro 12 22.2

Meta 7 13

Total 54 100

Source: Authors’ Construct

From the three journals reviewed during the period, OIJMS has published the highest number

of articles on performance measurement. It had reviewed and published 47 papers (68.1%)

during the period. JOM followed with 16 papers (23.2%). SCMIJ, on the other hand, had

published the least number of articles during the period. This may be because of its focus.

10

This Journal is primarily interested in supply chain management. It is therefore not surprising

that it had the least number of publications. However, the existence of productivity papers in

SCMIJ provide enough evidence to supports Rusell and Taylor (2011) that, issues on

performance measurement cuts across all aspects of operations management.

Table 2 presents the number of articles that were published during the years under

consideration. From the table, 30 articles out of the 69 were published in 2011, representing

43.5 percent of the total articles. This is followed by 23 articles representing 33.3 percent

published in 2012. Only 16 articles on performance measurement had been published as at

September 2013. This corresponds to 23.2 percent. The few number of articles published in

2013 may be because the year has not ended, and it is possible more articles could be

published before the year ends.

Table 2 also presents the proportions of the type of research papers published during the

review period. These papers were grouped under three categories; empirical, conceptual and

literature reviews. There were 51 papers that had gone through empirical studies: this

represents about 74 percent of total articles. Also 15 articles were conceptual papers which

develops frameworks and models but has not yet seen empirical tests to confirm or disprove.

Only 3 articles representing 4.3 percent were papers which sought to review other articles and

literatures in relation to performance management. This therefore shows that there has been

extensive empirical application of OM concepts in real-world.

On the research issues, majority of the papers (72.2%) examined performance issues related

to the firm. It was seen that 7 papers narrowed down to assess financial performance of firms.

These papers consider the financial productivity. On the other hand, 12 papers emphasized

labour performance, bringing out modules for measuring labour performance and for

improving their performance. It is important to note that some articles researched on either

two or three of these research issues. Articles with numbers [24] [31] [44] and [47], for

example, considered two of the dimensions of productivity. Articles [1] and [66] considered

all three dimensions of productivity.

A breakdown was also made based on the level of analysis. It was seen that 6 articles were

the micro level. These were studies on individual organizations. Also 29 articles concentrated

on industry level (Meso), these papers investigated performance of various organizations in

one industry. This represents 53.7 percent of the total articles. For the country-wide level, 12

articles had been written. These analyse performance between firms across industries in a

given country. Also, 13 percent of published works were on the performance of entities

across country. This could be in the same industry or across industries. It is seen then that

there is the need for more Micro and Meta level studies.

Performance Measurement in Operations Management

Performance measurement practices are common in all sectors of industry and commerce as

well as the public sector, including government departments, non-governmental organisations

and charities. Given this increased interest in performance measurement, there is an

increasing interest in comparing the performance of organisations in order to identify the

performance gaps and improvement opportunities. Consequently, we have seen a number of

articles from practitioners and researchers on the subjects of performance measurement and

performance comparisons. In this work, performance is measured from three dimensions;

11

Firm performance, Financial performance and Labour productivity. Firm productivity looks

at assessment and performance improvement programmes that are aimed at the firm as a

whole. This may be a matter of sustainability or a multi-factor productivity measures.

Financial and labour productivity are single factor productivity measures. Whereas financial

productivity looks at cost minimization and profit maximization, labour productivity bothers

on improving labour size and their capacity to perform. Table 3 shows the mapping of

empirical papers based on the three research issues and the unit of analysis. This is adapted

from Duncombe and Boateng (2009).

Table 3: Mapping of Research Issues according to the Level of Analysis

Studies focusing on

firm performance

Studies focusing on

labour performance

Studies focusing on

financial performance

Studies conducted at

the Meta

level(across countries

and on global levels)

Studies conducted at

the Macro level

(across industries in

one country)

Studies conducted at

the Meso level

(across firms and

organization within

one industry)

Studies conducted at

the Micro level

(individual firms and

organizations)

Bold: studies conducted on firms in the service industry (31 articles); Italics: studies

conducted on firms in the manufacturing sector (17 articles); Normal: Studies that cut across

both service and manufacturing sectors (4 articles).

Firm Performance

Most of the papers reviewed researched on the development and evaluation of models used in

the assessment of performance at the corporate level. Some of these papers are based on

theories that have gone through empirical studies to prove its effectiveness. Meanwhile, some

of these papers are based on conceptual models that are yet to go through empirical studies.

These papers cuts across all levels of analysis. For example, Articles [20] [23] [29] [33] and

26, 43,

44, 62, 64 21 32 44

9, 27, 28,

36, 39, 42,

48, 56, 65

45,

61

3, 4, 7, 10, 13,

14, 15, 16, 20,

23, 29, 33, 34,

35, 38, 51, 57,

59

1, 47, 66

19, 22, 53 46, 49

24, 31

2, 5, 54,

55, 67 37

12

[59] are a few of the articles that are providing insights into firm performance at the meso

level. Article [20] postulates, with empirical test, the ability to now measure productivity

without explicit input. This paper presents a more systematic theoretical background for the

use of DEA-WEI models. For papers [23] and [29] they all measure bank efficiency. Whereas

[23] uses a two-stage network framework, [29] incorporates Nash bargaining game (NGB)

theory in addition to the traditional DEA model used in [23]. Other insights have been

presented at different levels of analysis. Models to help the improvement of performance and

productivity in organisations have also been developed with the type of business as the focus.

Whereas [2] [9] [10] [13] and [26] are a few of those papers that focused on the service

industry, [43] [44] [28] [38] and [64] primarily looked for answers in the manufacturing

setting. Article [28] for example, shows how research and development affects productivity.

It is revealed in this paper that both production activity and research and development play

important roles in firm efficiency.

Financial Performance

Amado, Santos and Marques (2012)1 believe that, in a competitive environment, because of

the scarcity of resources, performance measurement and management assume a crucial role.

Financial performance therefore measures how well a firm can use assets to generate

revenues. This term is also used as a general measure of a firm's overall financial health over

a given period of time, and can be used to compare similar firms across the same industry or

to compare industries or sectors. There are many ways to measure financial performance, line

items such as revenue from operations, operating income or cash flow from operations can be

used, as well as total unit sales [49]. For example [49] focuses on the impact of product

variety on sales performance of retail outlets. Other papers focused on finding a relation

between ISO 9000 (quality) and firm’s financial performance [45]. Article [45] identified that

firms with high industry competiveness, high industry sales growth and low levels of

adoption of ISO 9000 obtain more benefit from the ISO 9000 adoption in terms of their

financial performance. This paper therefore answered the question “Under what factors is the

efficacy of ISO 9000 adoption stronger?” Meanwhile [44] focused on financial advantages

and performance accruing from international diversification of manufacturing companies.

They showed the extent to which managers could diversify their market to gain financial

advantages relative to constraints from the diversification prices.

Labour productivity

Labour productivity measures the efficiency of workers in the production of goods and

services in a firm, industry or the nation as a whole. It takes the ratio of a measure of output

to a measure of labour inputs. Schreyer (2005) opines that labour productivity does not

necessarily indicate the effort per worker or an individual. Measuring the performance of

labour can therefore be viewed from the angle of the individual worker and workers as teams.

A team’s productivity can be assessed and improved through team cohesion, team leader job

satisfaction and team competence and how product and service quality is affected by these

1 This is Paper [1] in Appendix A

13

team dimensions (Lee, Cheng, Yeung & Lai, 2011)2. Labour productivity can be measured on

the basis of gross output or based on value added. Moreover, multi-factor productivity can be

measured, where labour, together with other resources such as capital are used as input

measures for measuring productivity.

Schreyer (2005) posits that among the inputs used to measure productivity, labour is the

simplest and has repeatedly been used. This is because of its readability, ease of measure and

its rippling influence on other single productivity measures such as material productivity,

capital productivity and energy productivity. The relevance of labour productivity to the total

firm efficiency requires a lot of investment into the selection, training, improvement,

motivation and supervision of the labour force to elicit the maximum output.

Three thematic areas were discovered during the review; optimum labour size, team

performance improvements, and finally learning, training and development. Article [31]

emphasized rightsizing to ensure increased productivity with fewer labour inputs. The

purpose of this exercise was to reduce slacks of tellers and typists which resulted in non-

optimization of human resources. The results of Article [31] demonstrate that the

effectiveness of the application in reducing and/or transferring staff, while maximizing

organizational output levels and implementing smooth down- sizing.

On the second theme, Article [19] looked at the five dimensions of transformational

leadership (Attribute, behavior, intellectual stimulation, inspirational motivation and

individual consideration) and how it impacts team performance. The measures of team

performance were: team cohesion, team-leader-job satisfaction, team competence, reliability

and responsiveness. Article [31] on the other hand, studied how behavioral rewards serve as

motivation for team performance to improve the quality of services in the retail industry.

Finally, Articles [1] and [32] stressed how performance management practices like learning,

training and development influence behavior of individual workers towards performance

improvements. The three clusters of operational behavior that were identified (understanding,

motivation and focus of improvement) had extensive impact on labour performance. Also

Article [24] considered how to use employee appraisal to make optimum staff decisions to

maximize their utilization.

Trends in research on performance measurement

Industrial trends in performance measurement

The aim here was to understand the industrial focus of these published articles. Generally,

industry may be a service or manufacturing one. OM has tools and techniques for addressing

each individually as well as together. It was therefore imperative to assess whether research

had been skewed towards a particular industry as compared to the other. Results showed that

whereas 33 articles focused only on the Service sector, 17 papers were mainly towards

manufacturing activities. Only 4 papers drew respondents from both industries.

2 This is Paper [19] at Appendix A

14

Table 4: Binomial Test of Proportions

Category N Observed

Prop.

Test

Prop.

Exact Sig.

(2-tailed)

Service 33 .66 .50 .033

Manufacturing 17 .34

503 1.00

Source: Authors’ Construct

Although the frequency of publication about services seemed higher, there was the need for

an inferential evidence to determine if there is any significant difference. The Binomial test

of Proportions, a nonparametric statistical test that tests the significance of the difference

between two proportions of occurrences, was therefore used. With a 5% level of significance

and an accompanied Sig. Value of less than 0.05, it was evident that there is significant

difference between the two proportions. It can be seen therefore that, research interest in

these three journals are mainly focussed on the Service sector.

For the service sector, Banking and Finance seem to be the prime focus of most of these

studies in the service sector. Out of the 33 articles written under the service sector, 36.4

percent were concerned with the performance measurement of Banks and other financial

institutions. This was followed by Education and Research firms (18.2%). Other services that

have seen research interest include; Health, Government, Retail, Utilities and Information

Technology and Telecom Industry. This is presented in Table 5.

Table 5: Types of Service businesses

Frequency Valid Percent

Education and Research Industry 6 18.2

Banking and Finance 12 36.4

Supermarkets and Retail Shops 2 6.1

Utilities 2 6.1

Government 3 9.1

Hospitals and Health Institutions 3 9.1

Tourism and Hospitality 1 3.0

IT & Telecom Industry 2 6.1

Airlines 1 3.0

Agriculture and Forestry 1 3.0

Total 33 100.0

Source: Authors’ Construct

3 Excludes the four Empirical papers that researches on both sectors. These are papers: [39] [42] [48] and [56]

Conceptual papers are not also added

15

Contextual trends in performance measurement

There is the need to also evaluate the trends in research from a contextual perspective. The

aim here is to understand the distribution of research in terms of continents and countries.

This will clearly show which continents will require more research. The results are presented

in Figure 2 and Table 6.

Figure 2: Distribution of articles (Continent)

Table 6: Distribution of papers (Country level)

Country Frequency Percent

United States 11 20.0

China 8 14.5

Spain 6 10.9

Taiwan 6 10.9

United Kingdom 4 7.3

Japan 3 5.5

Others4 17 30.9

Total 55 100.0

Source: Authors’ Construct

From Figure 2, it can be seen that, Asia and Europe are the primary focus of most researches

published in the three journals during the period under review. Whereas Asia represented

36.8 percent, Europe accounted for 33.3 percent of these articles. This was followed by North

America (24.6%) and Australia (5.3%). No research on performance measurement and

productivity during this period focussed on Africa or South America.

4 Others include: Australia, Portugal, Canada, New Zealand, Greece, Bangladesh, Netherlands, France

Thailand, Singapore, India, Sweden and Nicaragua

36

.8

24

.6

5.3

33

.3

A S I A N O R T H A M E R I C A A U S T R A L I A E U R O P E

PER

CEN

TAG

E O

F A

RTI

CLE

S

CONTINENT

16

For individual country level, United States of America accounted for 20 percent of published

articles on performance measurement. This was closely followed by China, Spain and

Taiwan. The most striking observation is that, only 6 countries account for more than 69

percent of all published articles. Among these 6 only one (China) is a developing country

(IMF, 2012). This therefore shows that, publications in these three journals focuses on a few

countries, and does not adequately cater for the research needs of developing countries.

Method trends in performance measurement

Classification of the articles was also based on the research methods that were used. The

research methods were based on three major indicators namely: the Research approaches

used; the time dimensions of the research; the sources of data. Given in Table 7 below are the

frequencies of articles for the various methods used in categorising the articles.

Table 7: Methods used in the papers

Frequency Percentage

Research approach used

Quantitative 50 87.7

Qualitative 1 1.8

Mixed 6 10.5

Total 57 100

Time dimension

Cross-sectional 32 59.3

Longitudinal 22 40.7

Total 54 100

Data Source

Primary 21 36.8

Secondary 36 63.2

Total 57 100

Source: Authors’ Construct

Research approaches used for the classification were based on whether they were qualitative,

quantitative or mixed methods. Over 85 percent of the articles gathered were analysed using

quantitative methods distantly followed by articles that contained both qualitative and

quantitative techniques numbering up to six ([10][22][37][44][62][67]). There was only one

study [26] that made use of a purely qualitative approach to analysing the data that were

presented. Cross sectional and longitudinal studies received fairly equal number of articles

presented within the said period of analysis. With respect to the data sources, data mostly

used were derived from secondary sources mostly from databases as compared to the primary

data sources. Secondary sources accounted for over 60 percent of articles written.

Table 8 showed the results of chi-square tests of goodness of fit conducted to test whether the

differences in each category of the various analysis approaches were substantial.

17

Table 8: Results of goodness of fit test

Research

approach

Time

dimension Data Source

Chi-Square test statistic 76.526a 1.852b 3.947c

Degree of Freedom 2 1 1

P value .000 0.174 0.047

Evidently, chi-square goodness of fit results showed differences in proportions of articles

grouped under research approach and data source. In other words, more quantitative research

are being conducted in performance measurement with data mostly historical or gathered

from database rather than being collected primary sources. Articles classified on the basis of

time dimension do not have much difference within their categories. That is to say that there

is almost an equal number of articles published based on longitudinal and cross sectional

studies.

As indicated in Table 8, majority of the studies were based on quantitative methods. As such,

there were varying statistical methods used in analysing the data gathered with each method

of analysis serving as a desired method to satisfy the objectives at hand.

Table 9: Statistical Methods Used

Frequency Percent

Data Envelopement Analysis (DEA) 23 31.5

Regression/Correlation 11 15.1

Descriptive Statistics 7 9.6

Structural Equation Modelling 5 6.8

Path Analysis 2 2.7

Malmquist Productivity Index Analysis 2 2.7

Mann Whitney U-Test 2 2.7

Hierarchical linear Modelling 2 2.7

Others5 19 26.0

Total 73 100.0

Source: Authors’ Construct

In efficiency and productivity measurement, DEA models are often used in the analysis of

data in establishing benchmarks for other decision making units. As evident in table 8, the

concept of DEA were used mostly in the articles published. Notable of them was [51] who

employed DEA in studying the profit efficiency of banks. In addition to DEA, other similar

non-parametric statistical techniques employed in the analysis of data included the Malmquist

Productivity Index Analysis [58], the Mann Whitney U-Test or the Sign Rank Test as

employed by [48] to test for impacts of the adoption of Six Sigma in firm performance.

5 Balanced Score Card, Game Theory, Sharpe Market Model, Analytical Network Process, Bayesian Frontier

Model, Super Efficiency Test, Hicks Moortesen TFP Index, Kousemanen Weakly Disposable Technology,

Mixed Mode Modeling, T-Test, Saidin Test, Median Test, Stochastic Simulation, Balanced Score Card, Process

Mapping, Cause and Effect, Mean Absolute Percentage Error (MAPE)

18

Parametric techniques such as regression and structural equation models were used

extensively to test for relationships between certain variables that relate to productivity ([43]

[42]). Seven of the articles did not use any rigorous statistical methods in the data analysis

but rather resorted to the use of descriptive statistics. They were involved in applying

frequencies and percentages to describe the data, making inferences based on the information

provided.

RESEARCH GAPS

This section identifies the research gaps related to issue, conceptual approaches, context and

methods. This section clearly presents the areas in performance measurement that requires

further research and concludes with suggestions for further research.

Gaps in research issue

This paper studied performance measurement and productivity as one of the major topic areas

of study in operations management. The specific issues considered included firm

performance, labour productivity and financial performance. From the study, it can be

deduced that financial performance and labour performance seem to have the least research

interest relative to firm performance. However, these are important dimensions of

performance that should be researched into. This is because labour and financial goals are at

the heart of any smooth operational functioning.

Even with the few studies that has been done on financial performance, most of them are

narrowed on individual institutions and industries. For example, [44] identified the

advantages of international diversification of products. However, this is based on a single

industry (Automobile industry) and as such problem of over generalization of results could be

alarming. Similarly, there is little crossed country assessment of issues. Article [14] for

example, only focuses on the Chinese banking industry. Cross-cultural evaluations may

provide the effects of international competition and collaboration on firm performance,

especially in a time where trade is becoming more liberalized. There is therefore the need to

consider productivity from a multi-setting perspective.

Gaps in conceptual approaches

It was noted that there were more empirical studies as compared to literature review and

conceptual studies. Empirical studies accounted for over half of the articles reviewed during

the study period. However, there were a number of interesting conceptual papers that had no

or little real life application. Article [6], for example, provide some guidance to practitioners

about the types of simplified models that are used for uncertain decision making. Article [12],

on its part, introduces the option contract mechanism into relief material supply chain

management.

Also, [50] designed control strategies on railway networks to guarantee service quality and

minimize energy consumption using mathematical programming and simulation procedures.

12 other papers [8][16][17][18][25][41][52][57][60][63][68] and [69] all presented new

19

insights in performance measurement. However, these studies lack adequate empirical

grounding.

Gaps in context of study

Asia, Europe and North America were seen as the primary areas where most research was

targeted. These three accounted for more than 90 percent of reviewed works. No article in

these three journals during the review period had used an African or South American country

as the study area. This does not necessarily mean that there are no studies concerning

performance measurement relating to Africa, as various authors like Ohene-Asare (2009) and

Figueira, Nellis and Parker (2006) have all assessed efficiency of Banks in various parts of

Africa. However, it seems that most research relating to Africa may lack the necessary rigour

to be published in such top ranking journals.

At the individual country level, six countries accounted for over 69 percent of published

works. Out of these six, there was only one developing country- China. Similarly, out of all

the 19 countries that had been research subjects, only 5 (China, Bangladesh, Thailand, India

and Nicaragua) were developing economies (see IMF, 2012). This shows a significantly low

focus on developing economies. There is the need for more developing economy oriented

studies.

Gaps in research methods used

An assessment of the research approaches used showed an over dependence on purely

quantitative techniques in research. Although six articles combined both quantitative and

qualitative techniques, only one work published used a purely qualitative approach [26].

There was no empirical study that used a purely qualitative technique.

For the statistical methods used, although there were generally a wide variety of techniques

employed in assessing performance, there seem to be an overdependence on DEA (a

nonparametric technique). This accounted for about 31.5 percent of all articles reviewed.

Researchers can apply more of other tests like Malmquist Productivity Index, Hicks

Moortesen TFP Index and Saidin Test for further studies. The use of qualitative techniques

must be encouraged in productivity measurement.

Gaps with Industrial focus

Understanding the extent of research from the industrial focus perspective was an integral

aspect of the study. It was evident that Service had received the majority of focus during the

study period. This was confirmed by the binomial test of proportions conducted.

Furthermore, within the Service sector, Banking and Finance seemed to be the prime focus of

research in these top journals. This notwithstanding, health, education and retail (commerce)

had seen some levels of research as well. Other research can do more to evaluate productivity

with the manufacturing sector as the prime focus.

20

FUTURE RESEARCH DIRECTIONS

This study has presented insights into the research publications on Performance

Measurement, issued in three journals between 2011 and 2013 highlighting the areas that

require further research. In all, 69 papers were reviewed. It should be noted that inferences

made in this paper are limited to the three journals reviewed within the review period.

The review explicitly indicates that:

a. Extensive research has been directed to the measurement and evaluation of

productivity and performance of firms;

b. Most of the research undertaken went through empirical testing [31];

c. Extensive amount of research have been directed towards developed economies; and

d. Productivity measurements are mostly directed towards the service industry.

Following from the gaps identified in the previous section, the review identified that:

a. There is insufficient research directed towards labour and financial performance

relative to studies on firm performance [19].

b. The manufacturing sector is deficient in number of research it has seen, as there are a

lot of works concentrating on the service sector.

c. There seem to be inadequate research interest on matters relating to developing

economies. No paper published within the period studied subjects in Africa.

d. There is concentration on studying a single firm or country. Few papers assesses

performance by considering cross-cultural situations [14] [44]. This makes such

studies narrowly focused and hence generalization highly difficult.

e. There are a number of conceptual studies that are yet to undergo empirical testing to

validate the models and frameworks that have been propounded [6] [17].

f. There are few papers that make analysis from qualitative perspective, ignoring those

aspects of performance that cannot be explicitly quantified. Meanwhile, these are very

significant facets about productivity [22] [10].

It appears that, extensive research has been carried out in firm performance as compared to

financial and labour performance which seem to lack enough research coverage. There is

therefore the need for more research on financial and labour performance to be used by both

managers and researchers in the academia. In addition, there seem to be a narrow focus either

on one industry or country which calls for further research on a cross cultural and industry

assessments with more focus on manufacturing firms.

An evaluation of conceptual issues revealed substantial number of conceptual studies which

require empirical grounding. Article [6] and [17], which are all conceptual, encourage further

empirical applications of its constructs. A look at the contexts revealed no research carried on

Africa. Although there are researches on operational issues in Africa, the focus may not be on

performance measurement or it may lack the rigour for publication in the top journals.

African and other researchers in the developing countries are therefore called to focus more

21

on performance measurement as well as advancing their research for global recognition and

significance.

Finally, for the research methods, there is seen to be preponderance of researches based on

mathematical or quantitative understanding of the phenomena. However, since performance,

especially labour productivity, has human implications, there is the need for more qualitative

understanding about the human factors affect performance. Articles [10] and [22] for

example, underscore the need to incorporate qualitative aspects in performance measurement.

Further quantitative research can use relatively underused statistical tests like the Malmquist

Productivity and the Saidin test.

References

1. Busi, M., & Bititci, S.U. (2006). Collaborative performance management: Present

gaps and future research. International Journal of Productivity Management, 55(1), 7-

25.

2. Cohen, M.A., & Kunreuther, H. (2007). Operations Risk Management: Overview of

Paul Kleindorfer’s Contributions. Production and Operations Management, 16(5),

525-541.

3. Gupta, S., Verma, R., & Victorino, L. (2006). Empirical Research Published in

Production and Operations Management (1992–2005): Trends and Future Research

Directions. Production and Operations Management, 15(3), 432-448.

4. Halligan, J., Sarrico, C.S., & Rhodes, M.L. (2012). On the road to performance

governance in the public domain? International Journal of Productivity and

Performance Management , 61(3), 224-234.

5. International Monetary Fund (IMF). (2012). World Economic Outlook: April 2012.

Washington, DC: International Monetary Fund.

6. Khan, K.S., Kunz, R., Kleijnen, J., & Antes, G. (2003). Five steps to conducting a

systematic review. Journal of the Royal Society of Medicine, 96(3), 118–121.

7. Kitchenham, B. (2007). Guidelines for performing Systematic Literature Reviews in

Software Engineering (EBSE Technical Report EBSE-2007-01). Durham: University

of Durham.

8. Kouvelis, P., Chambers, C., & Wang, H. (2006). Supply Chain Management Research

and Production and Operations Management: Review, Trends, and Opportunities.

Production and Operations Management , 15(3), 449-469.

9. Lehmann, C., & Koelling, M. (2010, September). Service Productivity – A systematic

literature review. Paper presented at RESER 2010, Gothenburg, Sweden.

10. Neely, A., Gregory, M., & Platts, K. (1995). Performance measurement system

design: A literature review and research agenda. International Journal of Productivity

Management, 15(4), 80-116.

11. Radnor, Z.J., & Barnes, D. (2007). Historical analysis of performance measurement

and management in operations management. International Journal of Productivity

and Performance Management , 56(5), 384-396.

12. Russell, R.S., & Taylor, W.B. (2011). Operations Management (7th ed.). USA: John

Wiley and Sons Inc.

22

13. Scudder, G.D., & Hill, C.A. (1998). A review and classification of empirical research

in operations management. Journal of Operations Management, 16(1), 91-101.

14. Vanichchinchai, A. (2012). The relationship between employee involvement,

partnership management and supply performance: Findings from a developing

country. International Journal of Productivity and Performance Management , 61(2),

157-172.

15. Duncombe, R., & Boateng, R. (2009). Mobile phones and financial services in

developing countries: A review of concepts, methods, issues, evidence and future

research directions. Third World Quarterly, 30(7), 1237-1258.

16. Schreyer, P. (2005, March 2). Measuring Productivity. Paper presented at the

Conference on next step for the Japanese SNA, organized by the Organisation for

Economic Co-Operation and Development (OECD), Tokyo, Japan.

17. Ohene-Asare, K. (2009, June). Efficiency analysis of banks under Corporate Social

Responsibility- The case for Ghana. Paper presented at the X1 European Workshop

on Efficiency and Productivity Analysis, Pisa, Italy.

18. Figueira, C., Nellis, J., & Parker, D. (2006). Does ownership affect the efficiency of

African banks? The Journal of Developing Areas, 40(1), 38-63.

Appendix A: List of Articles Reviewed

[1] Amado, A.F.C., Santos, S.P., & Marques, P.M. (2012). Integrating the Data

Envelopment Analysis and the Balanced Scorecard approaches for enhanced

performance assessment. Omega International Journal of Management Science,

40(3), 390-403.

[2] BanaeCosta, C.A., & Oliveira, M.D. (2012). A multicriteria decision analysis model

for faculty evaluation. Omega International Journal of Management Science, 40(4),

424-436.

[3] Barros, C.R., Managei, S., & Matousek, R. (2012). The technical efficiency of the

Japanese banks: Non-radial directional performance measurement with undesirable

output. Omega International Journal of Management Science, 40(1), 1-8.

[4] Grigoroudis, E., Orfanoudaki, E., & Zopoundis, C. (2012). Strategic performance

measurement in a healthcare organisation: A multiple criteria approach based on

balanced scorecard. Omega International Journal of Management Science, 40(1),

104-119.

[5] Kao, C., & Pao, H.L. (2012). Predicting project approvals: A case of grants from the

National Science Council of Taiwan. Omega International Journal of Management

Science, 40(1), 89-95.

[6] Durbach, I.A., & Stewart, J.S. (2012). A comparison of simplified value function

approaches for treating uncertainty in multi-criteria decision analysis. Omega

International Journal of Management Science, 40(5), 611-618.

[7] Kong, W.H., & Fu, T.T. (2012). Assessing the performance of business colleges in

Taiwan using data envelopment analysis and student based value-added performance

indicators. Omega International Journal of Management Science, 40(5), 541-549.

[8] Li, Y., Chen, Y., Liang, L., & Xie, J. (2012). DEA models for extended two-stage

network structures. Omega International Journal of Management Science, 40(5), 611-

618.

[9] Nicolau, J.L. (2012). The effect of winning the 2010 FIFA World Cup on the tourism

market value: The Spanish case. Omega International Journal of Management

Science, 40(5), 503-510.

23

[10] Verdecho, M.J., Alfaro-Saiz, J.J., Rodriguez-Rodriguez, R., & Ortiz-Bas, A. (2012).

A multi-criteria approach for managing inter-enterprise collaborative relationships.

Omega International Journal of Management Science, 40(5), 611-618.

[11] Li, X., Li, Y., & Cai, X. (2012). A note on the random yield from the perspective of

the supply chain. Omega International Journal of Management Science, 40(5), 601-

610.

[12] Liang, L., Wang, X., & Gao, J. (2012). An option contract pricing model of relief

material supply chain. Omega International Journal of Management Science, 40(5),

594-600.

[13] Assaf, G.A., Barros, C., & Sellers-Rubio, R. (2011). Efficiency determinants in retail

stores: A Bayesian framework. Omega International Journal of Management Science,

39(3), 283-292

[14] Avikiran, N.K. (2011). Association of DEA super-efficiency estimates with financial

ratios: Investigating the case for Chinese banks. Omega International Journal of

Management Science, 39(1), 323-334.

[15] Epure, M., Kerstens, K., & Prior, D. (2011). Technology-based total factor

productivity and benchmarking: New proposals and an application. Omega

International Journal of Management Science, 39(6), 608-619.

[16] Hinojosa, M.A., & Marmol, A.M. (2011). Axial solutions for multiple objective linear

problems.An application to target setting in DEA models with preferences. Omega

International Journal of Management Science, 39(2), 159-167.

[17] Hsieh, Y-J. (2011). Demand switching criteria for multiple products: An inventory

cost analysis. Omega International Journal of Management Science, 39(2), 130-137.

[18] Kuosmanen, T., & Matin, R.K. (2011). Duality of weakly disposable technology.

Omega International Journal of Management Science, 39(5), 504-512.

[19] Lee, P.K.C., Cheng, E., Yeung, A.C.L., & Lai, K-h. (2011). An empirical study of

transformational leadership, team performance and service quality in retail banks.

Omega International Journal of Management Science, 39(6), 690-701.

[20] Liu, W.B., Zhang, D.Q., Menag, W., Li, X.X., & Xu, F. (2011). A study of DEA

models without explicit inputs. Omega International Journal of Management Science,

39(5), 472-480.

[21] Moais, P., & Camanho, A.S. (2011). Evaluation of performance of European cities

with the aim to promote quality of life improvements. Omega International Journal of

Management Science, 39(4), 398-409.

[22] Nicholls, M.G., & Cargaill, B.J. (2011). Establishing best practice university research

funding strategies using mixed-mode modelling. Omega International Journal of

Management Science, 39(2), 214-225.

[23] Akther, S., Fukuyama, H., & Weber, W.L. (2013). Estimating two-stage network

Slacks-based inefficiency: An application to Bangladesh Banking. Omega the

International Journal of Operations Management, 41(1), 88–96.

[24] Asmild, M., Bogetoft, P., & Hougaard, J. (2013). Rationalizing inefficiency: Staff

utilization in branches of a large Canadian bank. Omega the International Journal of

Operations Management, 41(1), 80–87.

[25] Chen, Y., Du, J., & Huo, J. (2013). Super-efficiency based on a modified directional

distance function. Omega the International Journal of Operations Management,

41(2), 621– 625.

[26] Paradi, J.C., & Zhu, H. (2013). A survey on bank branch efficiency and performance

research with data envelopment analysis. Omega the International Journal of

Operations Management, 41(1), 61–79.

24

[27] Samoilenko, S., & Osei-Bryson, K.M. (2013). Using Data Envelopment Analysis

(DEA) for monitoring efficiency-based performance of productivity–driven

organizations: Design and implementation of a decision support system. Omega the

International Journal of Operations Management, 41(1), 131–142.

[28] Wang, C.H., Lu, Y.H., Huang, C.W., & Lee, J.Y. (2013). R&D, productivity, and

market value: An empirical study from high-technology firms. Omega the

International Journal of Operations Management, 41(1), 143–155.

[29] Yang, X., & Morita, H. (2013). Efficiency improvement from multiple perspectives:

An application to Japanese banking industry. Omega the International Journal of

Operations Management, 41(2), 501–509.

[30] Li, Y.J., Yang, M., Chen, Y., Dai, Q., & Liang, L. (2013). Allocating a fixed cost

based on data envelopment analysis and satisfaction degree. Omega the International

Journal of Operations Management, 41(1), 55–60.

[31] Yu, M.M., Chern, C.C., & Hsiao, B. (2013). Human resource rightsizing using

centralized data envelopment analysis: Evidence from Taiwan’s Airports. Omega the

International Journal of Operations Management, 41(1), 119-130.

[32] DeLeeuw, S., & van den Berg, J.P. (2011). Improving operational performance by

influencing shopfloor behaviour via performance management practices. Journal of

Operations Management, 29(3), 224-235.

[33] Inman, A.R., Sale, S.R., & Green, W.K. (2011). Agile manufacturing: Relation to JIT,

operational performance and firm performance. Journal of Operations Management,

29(4), 343-355.

[34] Queenan, C.C., Angst, M.C., & Devaraj, S. (2011). Doctors’ orders-If they’re

electronics, do they improve patient satisfaction? A complements/substitutes

perspective. Journal of Operations Management, 29(7), 639-649.

[35] McDermott, M.C., & Stock, N.G. (2011). Focus as emphasis: Conceptual and

performance implications for hospitals. Journal of Operations Management, 29(6),

616-626.

[36] Terjesen, S., Patel, C.P., & Covin, G.J. (2011). Alliance diversity, environmental

context and the value of manufacturing capabilities among new high technology

ventures. Journal of Operations Management, 29(1), 105-115.

[37] Wu, Y., Loch, C., & Ahmad, G. (2011). Status and relationships in social dilemmas of

teams. Journal of Operations Management, 29(7), 650-662.

[38] Wong, Y.C., Boon-itt, S., & Wong, Y.W.C. (2011). The contingency effects of

environmental uncertainty on the relationship between supply chain integration and

operational performance. Journal of Operations Management, 29(6), 604-615.

[39] Goodale, C.J., Kuratko, F.D., Hornsby, S.J., & Covin, G.J. (2011). Operations

management and corporate entrepreneurship: The moderating effect of operations

control on the antecedents of corporate entrepreneurial activity in relation to

innovation performance. Journal of Operations Management, 29(1), 116-127.

[40] Sahoo, K.B., & Tone, K. (2013). Non-parametric measurement of economies of scale

and scope in non-competitive environment with price uncertainty. Omega

International Journal of Management Science, 41(1), 97-111.

[41] Edelstein, B., & Paradi, C.J. (2013). Ensuring units invariant slack selection in radial

data envelopment analysis models, and incorporating slacks into an overall efficiency

score. Omega International Journal of Management Science, 41(1), 31-40.

[42] Devaraj, S., Vaidyanathan, G., & Nath, A.M. (2012). Effect of purchase volume

flexibility and purchase mix flexibility on e-procurement performance: An analysis of

two perspectives. Journal of Operations Management, 30(7), 509-520.

25

[43] Stouthuysen, K., Slabbinck, H., & Roodhooft, F. (2012). Controls, service type and

perceived supplier performance in inter-firm service exchanges. Journal of

Operations Management, 30(5), 423-435.

[44] Lampel, J., & Giachetti, C. (2013). International diversification of manufacturing

operations: Performance Implications and moderating forces. Journal of Operations

Management, 31(4), 213-227.

[45] Lo, C.K., Wiengarten, F., Humphreys, P., Yeung, A.C., & Cheng, T. (2013). The

impact of contextual factors on the efficacy of ISO 9000 adoption. Journal of

Operations Management, 31(5), 229-253.

[46] Oh, L.B., Teo, H.H., & Sambamurth, V. (2012). The effects of retail channel

integration through the use of information technologies on firm performance. Journal

of Operations Management, 30(5), 368-381.

[47] Sawhney, R. (2013). Implementing labor flexibility: A missing link between acquired

labor flexibility and plant performance. Journal of Operations Management, 30(2),

98-108.

[48] Shafer, S.M., & Moeller, S.B. (2012). The effects of Six Sigma on corporate

performance: An empirical investigation. Journal of Operations Management, 30(8),

521-532.

[49] Wan, X., Evers, P.T., & Dresner, M.E (2012). Too much of a good thing: The impact

of product variety on operations and sales performance. Journal of Operations

Management, 30(4), 316-324.

[50] Yang, L., Li, K., Gao, Z., & Li, X. (2012). Optimizing trains movement on a railway

network. Omega International Journal of Management Science, 40(5), 619-633.

[51] Juo, J.C., Fu, T.T., & Yu, M.M. (2012). Non-oriented slack-based decompositions of

profit change with an application to Taiwanese banking. Omega International Journal

of Management Science, 40(5), 550-561.

[52] Gonzalez-Pachon, P.J., & Romeo, C. (2011). The design of socially optimal decision

in a consensus scenario. Omega International Journal of Management Science, 39(2),

179 – 185.

[53] Lee, P.K.C., Cheng, T.C.E., Yeung, A.C.L., & Lai, K.H. (2011). An empirical study

of transformational leadership, team performance and service quality in retail banks.

Omega International Journal of Management Science, 39(6), 690 – 701

[54] Paradi, J.C., Royalt, S., & Zhu, H. (2011). Two stage evaluation of bank branch

efficiency using data envelopment analysis. Omega International Journal of

Management Science, 39(1), 99 -109.

[55] Partovi, Y.F. (2011). Corporate philanthropic selection using data envelopment

analysis. Omega International Journal of Management Science, 39(5), 522-527.

[56] Premachandra, I.M., Chen, Y., & Watson, J. (2011). DEA as a tool for predicting

corporate failure and success: A case of bankruptcy assessment. Omega International

Journal of Management Science, 39(6), 620 – 626.

[57] Ramon, N., Ruiz, J.L., & Sirvent, I. (2011). Reducing differences between profiles of

weights: A “peer-restricted cross-efficiency evaluation”. Omega International Journal

of Management Science, 39(6), 634 -641.

[58] Simon, J., Simon, C., & Arias, A. (2011). Changes in productivity of Spanish

University Libraries. Omega International Journal of Management Science, 39(5),

578 -588.

[59] Udhayakumar, A., Charles, V., & Kumar, M. (2011). Stochastic simulation based

genetic algorithm for chance constrained data envelopment analysis problems. Omega

International Journal of Management Science, 39(4), 387- 397.

26

[60] Wang, Y.M., & Chin, K.S. (2011). The use of OWA operator weights for cross-

efficiency aggregation. Omega International Journal of Management Science, 39(5),

493-503.

[61] Zhong, W., Yuan, W., Li, S.X., & Huang, Z. (2011). The performance evaluation of

Regional R&D investments in China: An application of DEA based on the first

official China Economic Census data. Omega International Journal of Management

Science, 39(4), 447 – 455.

[62] Adrian, E., Mondragon, C., & Lalwani, C. (2011). Measures for auditing performance

and integration in closed-loop supply chains. Supply Chain Management: An

International Journal, 16(1), 43–56.

[63] Bai, C., Sarkis, J., Wei, X., & Koh, A.L. (2012). Evaluating Ecological Sustainable

Performance Measures Supply Chain Management. Supply Chain Management: An

International Journal, 17(1), 78–92.

[64] Soosay, C., Fearne, A., & Dent, B. (2012). Sustainable Value Chain Analysis – A

Case Study of Oxford Landing From “Vine to Dine”. Supply Chain Management: An

International Journal, 17(1), 68–77.

[65] Bjorklund, M., Martinsen, U., & Abrahamsson, M. (2012). Performance

Measurements in the Greening of Supply Chains. Supply Chain Management: An

International Journal, 17(1), 29–39.

[66] Ruben, R., & Zuniga, G. (2011). How Standards Compete: Comparative Impact of

Coffee Certification Schemes In Northern Nicaragua. Supply Chain Management: An

International Journal, 16(2), 98–109.

[67] Atilgan, C., & Mccullen, P. (2011). Improving Supply Chain Performance through

Auditing: A Change Management Perspective. Supply Chain Management: An

International Journal, 16(1), 11–19.

[68] Gandomi, A., & Zolfaghari, S. (2013). Profitability of Loyalty Reward Programs: An

Analytical Investigation. Omega the International Journal of Operations

Management, 41(4), 797–807.

[69] Fang, H., Lee, H., Hwang, S., & Chung, C. (2013). A Slacks-Based Measure of

Super-Efficiency in Data Envelopment Analysis: An Alternative Approach. Omega

the International Journal of Operations Management, 41(4), 731–734.

27

Appendix B: The Steps in a Systematic Review

Adopted from Khan, Kunz, Kleijnen and Antes (2003)

Step 1• Framing questions for a review

Step 2• Identifying relevant work

Step 3• Assessing the quality of studies

Step 4• Summarizing the evidence

Step 5• Interpreting the findings

Planning the Review

Conducting the

Review

Reporting the

Review