Proposed Strategic KPIs of KSU

83
“Developing Strategic KPIs of King Saud University”, King Saud University Research Report – Deanship of Quality DoQ # 1/2014, January – April 2014 G Deanship of Quality King Saud University Kingdom of Saudi Arabia Copyright © Teay Shawyun, Consultant to KSU – QMS, King Saud University, April 2014. Any reference to usage and citations can be stated as “Teay, Shawyun, (2014), Developing Strategic KPIs of King Saud University, King Saud University Research Report – Deanship of Quality DoQ # 1/2014, April 2014”

Transcript of Proposed Strategic KPIs of KSU

“Developing Strategic KPIs of King Saud

University”, King Saud University Research Report – Deanship of Quality DoQ # 1/2014, January –

April 2014 G

Deanship of Quality King Saud University

Kingdom of Saudi Arabia

Copyright © Teay Shawyun, Consultant to KSU – QMS, King Saud University, April 2014. Any reference to usage and citations can be stated as “Teay, Shawyun, (2014), Developing Strategic KPIs of King Saud University, King Saud University Research Report – Deanship of Quality DoQ # 1/2014, April 2014”

Research Report of KSU Key Performance Indicators Page 1 of 4

Proposed Strategic KPIs of KSU

This research study is aimed at identifying a set of strategic KPIs for KSU and is

supported by key secondary research as follows:

KSU 2030 Strategic Plan analysis (Appendix 3 and 4) that identified KSU

has 9 strategic objectives with no indication of any strategic or operational KPIs

being specified. This is also looked at within the incorporation of the comparative

performance of the colleges and in their “ranking” which identified 14 KPIs which

was also used as the basis to arrive at the KSU Strategic KPIs (Appendix 2 and 8).

Benchmarked universities in the KSU 2030 (Appendix 6) which identified

10 top tier benchmarked universities like Oxford, Cambridge, MIT, Stanford,

Harvard, UC Berkeley, U of Southern California, Tokyo University, NUS and

Tsinghua University. Of these only UC Berkeley has a strategic plan with 10

strategic KPIs and 60 specific KPIs. 3 universities like Oxford, Tokyo and USC

have strategic plans but no indications of KPIs specified. The rest like Harvard,

Stanford, MIT, Cambridge, NUS and Tsinghua do not have strategic plans posted

on their institutions’ webpage, but do have some that have schools’ or

administrative units’ strategic plans.

CUC (Committee of University Chairman, 2006) research reports that

recommended strategic KPIs that comprehensively addresses the HEI’s in key

areas of 1) Academic Character, 2) Financial health, assets and resources, 3) Staff,

Management and Governance, and 4) Governance. (Appendix 1 and 4) that

resulted in 10 key areas where KPIs are developed

The KPIs areas are also supported by the IES (Institute for

Employment Studies) and NatCen (National Center for Social and

Economic Research) report in November 2013 which listed 29 most cited or

widely used in order of 1) Value-added; 2) Employability and destinations

(employment rates / starting salary); 3) Quality of Research (research outputs /

funding); 4) Finance (financial performance / sustainability / efficiency); 5)

Widening participation / access; 6) Fair access; 7) Non-continuation /

Continuation; 8) Entry qualifications; 9) Admissions; 10) Demand; 11) Student

Satisfaction / experience; 12) Achievement / attainment (average awards); 13)

Learning and development in key areas; 14) Return on student loan investment /

value for money; 15) Course / Teaching quality; 16) Class size; 17) Contact and

study hours; 18) Postgraduate activity; 19) Estates, facilities and student services;

20) Entrepreneurship support; 21) Employment creation; 22) Industry

engagement; 23) Commercial activities; 24) Contribution to economic growth

and development regionally and nationally; 25) Public engagement and social /

community impact; 26) Knowledge Transfer; 27) Sustainability (environment

impact); 28) Administrative efficiency; and 29) Staffing.

Research Report of KSU Key Performance Indicators Page 2 of 4

Study of 11 universities strategic plans and their frequently cited or

listed KPIs that identified about 988 types of KPIs categorized into 18 areas

(Appendix 5 that were later consolidated into Appendix 4 with a list of illustrative

KPIs that were listed by the research and the universities studied) as follows:

o # 1 Student Focus / Student Experience and Teaching and Learning (216);

o # 2 Estates and Infrastructure (6) / Infrastructure and Technology (103

each = 206 in total) and Technology (34);

o # 3 Academic Profile and Market Position (7) and Education (Teaching

and Learning) (87);

o #4 Financial Health (86) and Institutional Stability (6);

o # 5 Research (90);

o # 6 Stakeholders/ Social / Society Engagement and Responsibilities (59);

o # 7 Faculty / Staff and HRD (51);

o # 8 Community and University Environment (48); and

o # 9 Others (Innovation – 12; Access / Affordability – 6; Diversity – 18)

totaling 36;

o # 10 Partnerships / Collaborations / Knowledge Transfer (19) and lastly

Governance, Leadership, Management, Planning (12)

Based on the above key research findings and the direction of KSU in its key areas as

identified in its KSU 2030, with the exception of Strategic objectives # 8 and 9, the key

areas where strategic KPIs can be identified and is proposed as an initial list with a total

of 32 potential KPIs. The details of the step-wise determination of the strategic KPIs of

KSU are reported in Appendix 3, 4 and 7. The detailed research report of the research

aim, research methodology and research findings and how these proposed 32 KPIs are

explained in Appendix 1.

From this initial set of 32 proposed KPIs, it was reduced to a final list of 18 KSU Strategic

KPIs. This final list (Table 1) was selected based on the expertise recommendation of key

consultants and administrators in the Deanship of Quality (Appendix 7).

Table 1: Proposed Strategic KPIs for KSU that measures the strategic

performance of KSU

Key Categorical Areas where KPIs are important

Strategic Objectives of KSU

Proposed Strategic KPIs for KSU that measures strategic performance

Infrastructure / Technology / Resources

None were selected from proposed 32 KPIs

Student Focus (Student Experience) Strategic objective #3: Less

is more (Reduce KSU’s student volume, increase the share of graduate students and raise entry requirements)

Strategic objective #4:

Student satisfaction with university life experience

Retention and Graduation Time Series for undergraduate and PGs

4.12.3 Proportion of students entering undergraduate programs who complete those programs in minimum time (NCAAA 9 - Means average and Level achieved)

Research Report of KSU Key Performance Indicators Page 3 of 4

Stronger graduates (Enable KSU students to learn hard and soft skills throughout their academic life)

Strategic objective #6: Supportive learning environment (Create an engaging environment at KSU for faculty, students, and staff)

Community and University Environment

% of students involved with university community events

Financial / Institutional Sustainability Strategic objective #7:

Sustainable future (Build KSU’s endowment and diversity sources of funding)

Endowment Per FTE faculty / staff

Research Strategic objective #1:

Good everywhere; Great in focus areas (Strengthen our comprehensive university with academic areas of research and teaching excellence)

10.5.1 Number of refereed publications in the previous year per full time equivalent member of teaching staff. (Publications based on the formula in the Higher Council Bylaw excluding conference presentations) (NCAAA 26 - Ratio average and Level achieved)

10.5.2 Number of citations in refereed journals in the previous year per full time equivalent teaching staff. (NCAAA 27 - Ratio average and Level achieved)

10.5.5 Ratio of internal research and innovation funds in proportion to the total number of full-time faculty members

10.5.6 Ratio of external research and innovation funds in proportion to the total number of full-time faculty members (NCAAA 30 - Ratio average and Level achieved)

% of faculty who get research grant / contract funding

Education Offers (Teaching and Learning)

Faculty Student Ratio (Comparisons with Peers /

with mean of Peers / Ratios Using Different Faculty Inclusions –based on Faculty FTE)

Staff (Human Resource Management) Strategic objective #2:

Distinctive faculty (Attract and develop distinctive faculty)

3.6.2 Percentage of the full-time faculty members obtaining academic or professional awards at the national or international level. (%)

9.5.2 Percentage of full-time faculty members participating in professional development activities during the past year (NCAAA 25 – Ratio average and Level achieved)

% of support staff who participated in professional

Research Report of KSU Key Performance Indicators Page 4 of 4

developmental activities related to their work area

Internationalization Strategic objective #5:

Building bridges (Build bridges among KSU constituencies and externally with local and international groups)

Number of international visiting faculty scholar

Stakeholders/ Social / Society Engagement and Responsibilities

11.4.1 Evaluation of satisfaction of employers/ business operators/ users of graduates /alumni /parents/ graduates on competency of graduates (Means average and Level achieved based on survey)

11.4.3 Proportion of full time teaching and other

staff actively engaged in community service activities (NCAAA 32 - Ratio average and Level achieved)

Partnerships / Collaborations / Knowledge Transfer

# of signed and effective MOUs

Others (Innovation – 12; Access / Affordability – 6; Diversity – 18)

None were selected from proposed 32 KPIs

Governance, Leadership, Management, Planning Strategic objective #8:

Flexibility and Accountability (Create a performance contract between KSU and the government)

Strategic objective #9: Organizing for purpose (Establishing an organization and governance that supports KSU’s goals)

No KPIs were identified from the whole research as detailed in the research report appendixes that they are not typical in other HEIs

Total # of Proposed Strategic KPIs for KSU = 18 KPIs

Appendix 1 Research Report of Strategic KPIs

Introduction

Most HEIs have strategic and operational plans and these contain strategic objectives which usually relate to the performance outputs or outcomes that are measured at a relatively high level and mainly medium term in nature. A key aspect of performance management deals with performance measurement which is to “measure and monitor” progress or achievement against these pre-defined objectives which are normally SMART (Specific, Measurable, Achievable, Realistic and Time-framed). A key way to monitor academic progress is to “measure progress or trends” (e.g. retention rate has increased by 5% over the previous year”) or compare across different units (e.g. graduation rate of the Engineering doctorate is 10% higher than the Arts doctorate over the previous year). To determine and support these performances, normally a HEI will need to develop a set of strategic KPIs to ensure that they know their performance in areas of importance to the HEI. Though strategic KPIs are important, there are specific issues of:

Purpose and intent of KPIs – Basically, the intent of strategic KPIs (what is distinctive and important to the institution) is to ensure that the strategic direction (long term policies and goals rather than short term priorities) and its strategic measures provide information of strategic performance which is the primary intent of the Governing Board or Executive Management. The tactical implementations which are normally delegated to the President of the HEI and its team would mean that the Governing Board will ultimately be responsible for its delegation of “strategic performance management” to the executing board.

Relationships to Strategic Planning – Institutional KPIs are strategic rather than operational as it should “focus on what makes it distinctive” that reflects the mission of the HEI as opposed to being operational at the college or program levels. This dictates that strategic KPIs should flow from a well-constructed Institutional Strategic Plan and should be part of the HEI’s strategic planning process in key areas of importance.

Number of KPIs and its value – CUC (2006) identified 10 areas that the HEIs should focus on as the main areas of performance management for all HEIs and suggested a range of 10 – 20 high level indicators supported with more detailed performance indicators at the lower levels of operations for more in-depth, analytical and informed decisions making. These lower levels indicators in key operational areas are the direct owners of these PIs (Performance Indicators) that informs on and support the higher level PIs which is the strategic KPIs.

While KSU has a strategic plan, the KSU 2030 “Towards Excellence” Strategic Plan, it appears that no strategic KPIs were identified. Based on this ambiguity, ABC University would need to identify a set of strategic KPIs that helps the top management measure, monitor and manage its accomplishment and achievement of its longer term goals. As such, the research aim of this paper is, “To determine a set of Strategic KPIs for KSU”.

This research report will contain 5 parts as follows:

Appendix 1 – This will report on the research aim, research methodology and

research findings of the entire appending appendix 2 to 5. It will also report on

how the KSU KPIs are determined based on the analysis in the appendix 2 to 5,

and come up with a proposed set of KSU KPIs.

Appendix 2 – This will report on the mapping of the KSU 2030 Strategic

Objectives onto the related KPIs categories as discussed in Appendix 3 to 5 which

shows the main KPIs and PIs categories and illustrative KPIs from the overall

988 KPIs from two main research reports and 11 sampled HEI Strategic Plans

with the strategic goals, strategic objectives strategic initiatives and KPIs.

Appendix 3 – This will report on the KSU 2030 Strategic Plan to determine the

existence of strategic KPIs as related to its 9 Strategic Objectives in order to map

its similarities in the determination and utilization of KPIs based on widely

accepted and good practices in the development of KPIs. Basically, no strategic

KPis were identified in this report, so only the Strategic Objectives were used as

the main mapping parameter. With those in Appendix 4, 5, 6 and 7.

Appendix 4 – This report discuss in-depth the comparative analysis of KPIs to

identify 10 key and common areas of strategic and operational focus of a typical

HEI. It also reports on the categorical KPIs that are used in each of these key

areas of focus and provide a set of illustrative KPIs for each of them.

Appendix 5 – This report on the tabulation of the main KPIs of typical HEIs

and it came up with 19 main areas where KPIs were developed as performance

measures or performance indicators totaling 988, where similarity or

commonalities exists in its fundamental principles but were expressed using

different terminologies or methods of description in its computational

formulation.

Appendix 6 – This report is focused on the strategic plans and strategic KPIs of

the 10 benchmarked universities on KSU as noted in the KSU 2030. Only 1 of

them has a strategic plan with specific strategic KPIs, with 3 having only a

strategic with no definition of its strategic KPIs, while the remaining 6 has no

institutional strategic plans but do have strategic plans at the schools’ or

administrative units’ areas.

Appendix 7 – This report is focused on the reduction of the original proposed

set of 32 KSU Strategic KPIs by an expert opinion group consisting of 3 Saudi

administrators and 3 consultants in the quality management area. This arrived at

a final set of 18 Strategic KSU as shown in Table 1 in the main report.

Appendix 8 – This reports on the identification of KPIs that can be used to

compare and potentially “rank” the performance of the colleges in KSU, or for the

performance comparison of programs within a college, or for comparison of

programs within as similar category (like all the health science programs in the

Health Science Group. The basis of the KPIs were that they were: 1) Student

Focused; 2) Faculty focused; 3) Research Focused and 4) Stakeholder

Satisfaction / Community Service

Research Methodology

As the development approaches of strategic KPIs used by most HEIs is very diverse and multifarious, this research will use a secondary research approach that reviews two main sources of: 1) literature of research conducted on the development and design of strategic KPIs of a HEI and 2) those KPIs defined in the strategic plans of a typical HEI. The use of the research reports on strategic KPIs of HEI was to identify typical common issues and widely accepted practices in the issues and challenges, development and design, scope and utilization of strategic and operational KPIs. The initial literature review identified 5 research reports as follows:

1. Pollard, E., Williams, M., Williams, Joy., Bertram, C. and Buzzeo, J., of IES (Institute for Employment Studies) and Drever, E., Griggs, J. and Coutinho, S., of NatCen (National Center for Social and Economic Research, entitled:

a. How should we measure higher education? A fundamental review of the Performance Indicators Part One: The Synthesis Report (November 2013)

b. How should we measure higher education? A fundamental review of the Performance Indicators Part Two: The Evidence Report (November 2013)

2. CUC (Committee of University Chairs) titled: a. CUC Report on the Monitoring of Institutional Performance and the Use

of Key Performance Indicators (November 2006) b. CUC Report on the Implementation of Key Performance Indicators: Case

Study Experiences (June 2008) 3. HR (Hanover Research) on Non-academic Key Performance Indicators for

Administrative Support Units (used by a variety of U.S. universities to measure the performance of non-academic, administrative support units that cover the metrics for Finance, human Resources, student Administration/Student Services and Facilities units).

In the second main source of secondary data of identifying strategic KPIs in Strategic Plans, the key terms of: 1) “strategic plans with strategic KPIs" which resulted in 6,030,000 hits in 0.47 sec”, 2) “strategic KPIs with 3,820,000 hits in 0.22 sec”, 3) “Strategic KPIs for education with 9,510,000 hits in 0.22 sec”, 4) “Strategic KPIs for academic or education with 9,940,000 hits in 0.26 sec” were randomly goggled. The top 30 documents were selected and reviewed to identify whether the two main aspects of “strategic objectives” and “KPIs” exist in the same strategic plan or just "strategic KPIs" in any document, and this resulted in the following set of documents:

1. Strategic Plans with KPIs of: a. The Penn State Strategic Plan 2009 – 2014 (USA) b. The Pennsylvania State University (May 2008), Strategic Indicators:

Measuring and Improving University Performance (USA) c. University of Toronto Performance Indicators 2012 Comprehensive

Inventory (Canada) d. Manchester State University ASPIRE 2010 – 2014 Metrics and Key

Performance Indicators and ASPIRE III (2014 – 2018) (UK) e. NEIU (Northern Illinois University) KPI Progress Report for the Strategic

Plan (USA) f. University of Greenwich Strategic Plan 2012 – 2017: Summary (UK)

g. Manchester Metropolitan University Corporate Strategy 2012 – 2017 (UK)

h. Ball State University Strategic Plan 2012 – 2017, Education Redefined 2.0: Advancing Indiana (USA)

i. Lancaster University Strategic Plan 2009 – 2015 (UK) j. University of Wollongong Strategic Plan 2008 – 2010 (Australia) k. Binghamton University 2010 – 2015 Strategic Plan Key Performance

Indicators (USA) l. Qatar University Strategic Plan 2010 – 2013 (Middle East)

2. The 75 KPIs every Manager needs to know (September 05, 2013). 3. The Pennsylvania State University (2008) Innovation Insights, “Developing

Strategic Performance Indicators”, Office of Planning and Institutional Assessment (USA).

4. Georgiadou, E. of Middlesex University London (UK), power point presentation of “Role of Key Performance Indicators in Higher education Quality Enhancement”.

5. NASPA International Assessment & Retention Conference, Baltimore, Maryland (USA) (June 2010) power point presentation of “The Assessment movement toward key performance indicators”.

6. Seybert, J. A., of National Higher Education Benchmarking Institute, Johnson County Community College (USA), power point presentation of “Identifying Key Performance Indicators: The Foundation of an Institutional Dashboard”.

Research Findings

A stringent research methodology is not applied due to the diversity in the

understanding and application leading to the development of strategic plans and KPIs,

and the diversity in the use of terminology or the grouping of the focus areas which are

dependent on the institution’s context and aspirations and unique focus. Though a

stringent methodology is not used, a systematic approach based on the basic mission and

functioning of a typical HEI with stated strategic goals and strategic objectives and

related KPIs or PIs in each of the focus areas of operation is the main criteria used for the

first level basis of analysis.

A second level of analysis is the criteria used to determine the KPIs. This is based on the CUC (2006) reports of which the top 10 KPIs recommended were chosen as a set of coherent KPIs with the following criteria:

a. Critical to the success of the institution; b. Strategic – i.e. high-level and of interest to governance c. Relevant to all types of institution; d. Able to cover all the main areas of strategic activity and risk which governors or

executive management need to monitor on a continuing basis for a HEI.

In the description of KPIs (CUC, 2006), performance measures is defined as “where the numerical indicator is a precise or robust measure of the factor of interest (e.g. student number, building condition, financial outcomes) and performance indicators as “which are not necessarily a numerical indicator” (e.g. teaching quality, student satisfaction, or sustainability index) are included in this research. Normally for performance indicators which cannot be measured directly, a proxy measure is developed (e.g. absenteeism can be used as a proxy for staff commitment).

Based on this methodology, some of the key findings:

1. Analysis of KSU 2030 Strategic Plan and its KPIs – The KSU 2030 which

was officially published in May 2009 and revised in December 2012 (in its

revised but unpublished form) showed that there were 9 Strategic Objectives and

49 recommendations. In the revised unofficial version as of January 2014, 4 main

types of modifications were identified as: 1) No changes = 22; 2) Changes in

terminologies = 19; 3) Original recommendation removed = 3; and 4) New

recommendations added = 6 resulting in a set of 47 recommendations. Basically,

the KSU 2030 is more structured as an issue/recommendation framework which

is not typical of the structuring of a typical HEI Strategic Plan. As such, no

strategic or operational KPIs were identified in its KSU 2030. Details of the

changes and modifications are reported in Table 2.2 Appendix 3.

2. Mapping of KSU 2030 onto the widely accepted focus areas of KPIs –

While KSU do not specify its KPIs in the KSU 2030, the longer meaning of the

strategic objectives of the KSU 2030 are mapped onto the 12 generic areas where

KPIs are typically specified in their focus areas in their strategic plans. The next

to best and appropriate mapping and its results and its details (Table 2.1 in

Appendix 2) are:

a. Strategic objective #3: Less is more; Strategic objective #4: Stronger graduates and Strategic objective #6: Supportive learning environment are mapped into two key areas of Student Focus (Student Experience) and Community and University Environment

b. Strategic objective #7: Sustainable future is mapped onto Financial and Institutional Sustainability

c. Strategic objective #1: Good everywhere can be mapped onto Research and Educational Offers (Teaching and Learning)

d. Strategic objective #2: Distinctive faculty can be mapped onto Staff (Human Resource Management)

e. Strategic objective #5: Building bridges can be mapped onto Internationalization, Stakeholders/ Social / Society Engagement and Responsibilities and Partnerships / Collaborations / Knowledge Transfer

Though it is not related to Governance, Leadership, Management, Planning, Strategic objective #8: Flexibility and Accountability Strategic objective #9: Organizing for purpose were put in this category as this is not typical of what a HEI will put in a strategic plan or define any KPIs in these areas. Other areas that were not clearly or explicitly covered by KSU in the 12 generic areas were Infrastructure / Technology / Resources and Innovation /Access / Affordability / Diversity). This resulted in a set of 32 KPIs that have relevance to KSU based on the KSU 2030 nine Strategic Objectives.

3. KSU – QMS main KPIs used to determine and compare performance

– in its strive to provide a comparative and “ranking” of performance of the

colleges in KSU (Appendix 8), or the programs within a college, or to compare the

programs and colleges with a similar grouping like all the health science /

medical science / dentistry / pharmacy were group into a category called the

Health Science Group. A set of 14 selected KPIs from key groups of Student focus,

Faculty focus, and Research focus and the Stakeholder Satisfaction /Community

Service focus were selected from the KSU – QMS Internal Benchmarking System.

This was used in the mapping and identification of the KPIs in addition to the

KPIs as selected from (4) above.

4. Number of KPIs used – The number of KPIs identified from this secondary

research process ranged from a low end number of KPIs of North Illinois

University (12) and Manchester Metropolitan University (16) and University of

Wollongong (23) to the high end of Qatar University (138), Ball State (113),

University of Toronto (99) and Binghamton University (92) and Manchester

State University (63) with two in the middle end of University of Greenwich (32)

and Lancaster University (30). This can allude to the fact that there is a range of

KPIs which the HEI can set up based on their institution’s context and

requirements, noting that some of the higher end numbers could be re-classified

as operational KPIs due to the specific and more detailed focus areas of

measurement of performance. Details of the categorization of KPIs and strategic

objectives of each HEI and the diversity of the KPIs used are shown in detail in

Appendix 5.

5. Focus areas of coverage – The overall research from the main research in (1)

came up with 19 focus areas (Appendix 5) whereby these typical HEIs and later

reduced into 12 main focus areas (Appendix 4) would set their KPIs in:

a. # 1 Student Focus / Student Experience and Teaching and Learning (216);

b. # 2 Estates and Infrastructure (6) / Infrastructure and Technology (103

each = 206 in total) and Technology (34);

c. # 3 Academic Profile and Market Position (7) and Education (Teaching

and Learning) (87);

d. #4 Financial Health (86) and Institutional Stability (6);

e. # 5 Research (90);

f. # 6 Stakeholders/ Social / Society Engagement and Responsibilities (59);

g. # 7 Faculty / Staff and HRD (51);

h. # 8 Community and University Environment (48); and

i. # 9 Others (Innovation – 12; Access / Affordability – 6; Diversity – 18)

totaling 36;

j. # 10 Partnerships / Collaborations / Knowledge Transfer (19) and lastly

Governance, Leadership, Management, Planning (12) (Appendix 4).

This is only an approximate determination of the key focus areas where KPIs are

developed ranked in grouping of similar terminologies from the original 19 in Appendix

5. Most of the most frequently used KPIs as used by the HEIs are shown in Table 4.3 in

Appendix 4.

The overall selection of the proposed set of 32 KSU strategic KPIs was selected based on

the following criteria that the selected KPIs (Table 2.2 of Appendix 2):

Are within the requirements of the 9 Strategic Objectives of KSU

Comprehensively address the requirements of the main areas important and

critical to the key focus areas of a typical HEI.

From the original 32 sets, it underwent a further round of expert opinion of 3 Saudi

administrators and 3 consultants in quality management. This approach came up with a

final set of proposed 18 KSU Strategic KPIs as shown in Table 1.1 (Appendix 7). The

whole research yielded a total of 18 Strategic KPIs that are deemed relevant and critical

to provide an overall picture of performance of KSU comprehensively and holistically as

shown below:

Table 1.1 Proposed Strategic KPIs of KSU

Key Categorical Areas where KPIs are important

Strategic Objectives of KSU

Proposed Strategic KPIs for KSU that measures strategic performance

Infrastructure / Technology / Resources

% of internal / external clients “satisfied” or “strongly satisfied” with services by all functional units (finance, IT, HR, procurement, Business operation, Housing, Student services, Library, External relations, Institutional research)

Teaching and Research Space as a proportion of

Total Space

Student Focus (Student Experience) Strategic objective #3: Less

is more (Reduce KSU’s student volume, increase the share of graduate students and raise entry requirements)

Strategic objective #4: Stronger graduates (Enable KSU students to learn hard and soft skills throughout their academic life)

Strategic objective #6: Supportive learning environment (Create an engaging environment at KSU for faculty, students, and staff)

Student satisfaction with university life experience

Retention and Graduation Time Series for undergraduate and PGs

3.6.1 Percentage of students graduated in the last 3 years who are recognized in the areas of academics, or profession, or contribution to society at the national or international level (%)

4.12.3 Proportion of students entering undergraduate programs who complete those programs in minimum time (NCAAA 9 - Means average and Level achieved)

4.12.5 Students overall rating on the quality of their courses (Average rating of students on a 5 point scale overall evaluation of courses) (NCAAA 6 - Means average and Level achieved based on survey)

Community and University Environment

% of students involved with university community events

% of faculty / staff involved with university community events

Financial / Institutional Sustainability Strategic objective #7:

Endowment Per FTE faculty / staff

Sustainable future (Build KSU’s endowment and diversity sources of funding)

Total auxiliary and other revenue generated

Research Strategic objective #1:

Good everywhere; Great in focus areas (Strengthen our comprehensive university with academic areas of research and teaching excellence)

10.5.1 Number of refereed publications in the previous year per full time equivalent member of teaching staff. (Publications based on the formula in the Higher Council Bylaw excluding conference presentations) (NCAAA 26 - Ratio average and Level achieved)

10.5.2 Number of citations in refereed journals in the previous year per full time equivalent teaching staff. (NCAAA 27 - Ratio average and Level achieved)

10.5.3 Proportion of full time member of teaching staff with at least one refereed publications during the previous year (NCAAA 28 - Ratio average and Level achieved)

10.5.5 Ratio of internal research and innovation funds in proportion to the total number of full-time faculty members

10.5.6 Ratio of external research and innovation funds in proportion to the total number of full-time faculty members (NCAAA 30 - Ratio average and Level achieved)

PGR research performance in publications, presentations and posters

% of faculty who get research grant / contract funding

Education Offers (Teaching and Learning)

% of public who are “strongly or very satisfied” with academic standard demonstrated by university

Faculty Student Ratio (Comparisons with Peers /

with mean of Peers / Ratios Using Different Faculty Inclusions –based on Faculty FTE)

Graduate Enrolment as a Percentage of Total

Enrolment

Staff (Human Resource Management) Strategic objective #2:

Distinctive faculty (Attract and develop distinctive faculty)

3.6.2 Percentage of the full-time faculty members obtaining academic or professional awards at the national or international level. (%)

9.5.2 Percentage of full-time faculty members participating in professional development activities during the past year (NCAAA 25 – Ratio average and Level achieved)

% of support staff who participated in professional developmental activities related to their work area

Internationalization Strategic objective #5:

Percentage of students participating in Education

Building bridges (Build bridges among KSU constituencies and externally with local and international groups)

Abroad

Number of international visiting faculty scholar

Percentage of Total Undergraduate Enrollment by International Status

Percentage of Total Undergraduate / Graduate Enrollment by International Status

Stakeholders/ Social / Society Engagement and Responsibilities

11.4.1 Evaluation of satisfaction of employers/ business operators/ users of graduates /alumni /parents/ graduates on competency of graduates (Means average and Level achieved based on survey)

11.4.3 Proportion of full time teaching and other

staff actively engaged in community service activities (NCAAA 32 - Ratio average and Level achieved)

Partnerships / Collaborations / Knowledge Transfer

# of signed and effective MOUs

Others (Innovation – 12; Access / Affordability – 6; Diversity – 18)

% increase in # of new technologies / patents / intellectual property

Governance, Leadership, Management, Planning Strategic objective #8:

Flexibility and Accountability (Create a performance contract between KSU and the government)

Strategic objective #9: Organizing for purpose (Establishing an organization and governance that supports KSU’s goals)

(No KPIS were identified as explained earlier, they are not typical in other HEIs)

Total # of Proposed Strategic KPIs for KSU = 32 KPIs

And the final set of 18 Strategic KSU KPIs are highlighted in yellow

Conclusion

While there are many approaches whereby the strategic KPIs of a HEI can be developed, this paper attempts to present another approach whereby the case study HEI already has a strategic plan, but no strategic KPIs are defined in this plan. In order to identity the institution's KPIs, a secondary research into key literature in the development of strategic KPIs, and strategic plans with strategic KPIs of universities was used. These approaches identified a final set of 12 key categorical areas where strategic KPIs were developed, and the case study institution's strategic objectives was mapped into these 12 areas, with 32 frequently used strategic KPIs within the context of the institution, and a final set of 18 selected through a focus group opinion.

Appendix 2: Strategic KPIs of KSU

Table 2.1: Mapping of KSU’s Strategic Objectives into Key KPIs categories

Key Categorical Areas where KPIs are important

# of KPIs (similar occurrence) in each category

Strategic Objectives of KSU

Infrastructure / Technology / Resources

246

Student Focus (Student Experience) 216 Strategic objective #3: Less is more

(Reduce KSU’s student volume, increase the share of graduate students and raise entry requirements)

Strategic objective #4: Stronger graduates (Enable KSU students to learn hard and soft skills throughout their academic life)

Strategic objective #6: Supportive learning environment (Create an engaging environment at KSU for faculty, students, and staff)

Community and University Environment

48

Financial / Institutional Sustainability 99 Strategic objective #7: Sustainable future

(Build KSU’s endowment and diversity sources of funding)

Research 96 Strategic objective #1: Good everywhere;

Great in focus areas (Strengthen our comprehensive university with academic areas of research and teaching excellence)

Education Offers (Teaching and Learning)

94

Staff (Human Resource Management) 51 Strategic objective #2: Distinctive faculty

(Attract and develop distinctive faculty)

Internationalization 34 Strategic objective #5: Building bridges

(Build bridges among KSU constituencies and externally with local and international groups)

Stakeholders/ Social / Society Engagement and Responsibilities

59

Partnerships / Collaborations / Knowledge Transfer

19

Others (Innovation – 12; Access / Affordability – 6; Diversity – 18)

36

Governance, Leadership, Management, Planning

12 Strategic objective #8: Flexibility and

Accountability (Create a performance contract between KSU and the government)

Strategic objective #9: Organizing for purpose (Establishing an organization and governance that supports KSU’s goals)

Table 2.2: Development of Proposed Strategic KPIs of KSU

Key Categorical Areas where KPIs are important

Strategic Objectives of KSU

Proposed Strategic KPIs for KSU that

measures strategic performance

Proposed KPIs from KSU QMS

Infrastructure / Technology / Resources

% of administrative units that achieved their planned objectives

% of internal / external

clients “satisfied” or “strongly satisfied” with services by all functional units (finance, IT, HR, procurement, Business operation, Housing, Student services, Library, External relations, Institutional research)

Teaching and Research

Space as a proportion of Total Space

Student Focus (Student Experience) Strategic objective #3:

Less is more (Reduce KSU’s student volume, increase the share of graduate students and raise entry requirements)

Strategic objective #4: Stronger graduates (Enable KSU students to learn hard and soft skills throughout their academic life)

Strategic objective #6: Supportive learning environment (Create an engaging environment at KSU for faculty, students, and staff)

Student satisfaction with university life experience

Retention and Graduation Time Series

Graduate student completion rate

First year to Second Year Retention Rate

First year to Third Year Retention Rate

% Increase of students per year winning national scholarships / awards

3.6.1 Percentage of students graduated in the last 3 years who are recognized in the areas of academics, or profession, or contribution to society at the national or international level (%)

4.12.3 Proportion of students entering undergraduate programs who complete those programs in minimum time (NCAAA 9 - Means average and Level achieved)

4.12.5 Students overall rating on the quality of their courses (Average rating of students on a 5 point scale overall evaluation of courses) (NCAAA 6 - Means average and Level achieved based on survey)

4.12.9 Percentage of students entering programs who successfully complete first year (NCAAA 8 - Means average and Level achieved)

Community and University Environment

% of students involved with university community events

% of faculty / staff involved with university community events

Financial / Institutional Sustainability

Strategic objective #7: Sustainable future (Build KSU’s endowment and diversity sources of funding)

Endowment Per FTE faculty / staff

Total auxiliary and other revenue generated

Research Strategic objective #1:

Good everywhere; Great in focus areas (Strengthen our comprehensive university with academic areas of research and teaching excellence)

Research outputs by appropriate measure (publications in indexed journals, research impact factors)

Research income, total, % and by types of sponsors

Research active staff

PGR research performance in publications, presentations and posters

PGR level of satisfaction with research experience, services and facilities provided in program

% of faculty who apply for internal / external research funding

% of faculty who get research grant / contract funding

10.5.1 Number of refereed publications in the previous year per full time equivalent member of teaching staff. (Publications based on the formula in the Higher Council Bylaw excluding conference presentations) (NCAAA 26 - Ratio average and Level achieved)

10.5.2 Number of citations in refereed journals in the previous year per full time equivalent teaching staff. (NCAAA 27 - Ratio average and Level achieved)

10.5.3 Proportion of full time member of teaching staff with at least one refereed publications during the previous year (NCAAA 28 - Ratio average and Level achieved)

10.5.5 Ratio of internal research and innovation funds in proportion to the total number of full-time faculty members

10.5.6 Ratio of external research and innovation funds in proportion to the total number of full-time faculty members (NCAAA 30 - Ratio average and Level achieved)

Education Offers (Teaching and Learning)

% of employers perceiving academic programs as “high quality” programs

% of public who are “strongly or very satisfied” with academic standard demonstrated by university

Faculty Student Ratio

(Comparisons with Peers / with mean of Peers / Ratios Using Different Faculty Inclusions –based on Faculty FTE)

Graduate Enrolment as a

Percentage of Total Enrolment

Staff (Human Resource Management) Strategic objective #2:

Distinctive faculty (Attract and develop distinctive faculty)

Staff satisfaction (surveys, complaints and appeals, institutional experience)

% of students surveyed who report “excellent” or “very good” levels in teaching performance of faculty

% of support staff who participated in professional developmental activities related to their work area

% increase of faculty or professional staff with national / international recognition (awards, leadership positions, and editorial board memberships)

3.6.2 Percentage of the full-time faculty members obtaining academic or professional awards at the national or international level. (%)

9.5.1 Proportion of teaching staff leaving the institution in the past year for reasons other than age retirement (NCAAA 24 – Ratio average and Level achieved)

9.5.2 Percentage of full-time faculty members participating in professional development activities during the past year (NCAAA 25 – Ratio average and Level achieved)

Internationalization Strategic objective #5:

Building bridges (Build bridges among KSU constituencies and externally with local and international groups)

Number of students participating in Education Abroad

Percentage of students participating in Education Abroad

Number of international visiting faculty scholar

Percentage of Total Undergraduate Enrollment by International Status

Percentage of Total

Graduate Enrollment by International Status

Stakeholders/ Social / Society Engagement and Responsibilities

Stakeholder (alumni, parents, employment market) surveys

% increase of # of

companies impacted by university

% increase of # of

communities actively engaged with university

% of faculty / staff /

students involved with community service

11.4.1 Evaluation of satisfaction of employers/ business operators/ users of graduates /alumni /parents/ graduates on competency of graduates (Means average and Level achieved based on survey)

11.4.3 Proportion of full time teaching and other staff actively engaged in community service activities (NCAAA 32 - Ratio average and Level achieved)

Partnerships / Collaborations / Knowledge Transfer

# of signed and effective MOUs

Others (Innovation – 12; Access / Affordability – 6; Diversity – 18)

% increase in # of new technologies / patents / intellectual property

Governance, Leadership, Management, Planning

Strategic objective #8: Flexibility and Accountability (Create a performance contract between KSU and the government)

Strategic objective #9: Organizing for purpose (Establishing an organization and governance that supports KSU’s goals)

Total = 39 KPIs Total = 14 KPIs

Table 3.2: Proposed Strategic KPIs of KSU

(Using only the mapping from Table 3.1 of the frequently used KPIs and mapping with

that of the KSU – QMS KPIs, this is the resulting table that is similar to that of Table

1.1)

Key Categorical Areas where KPIs are important

Strategic Objectives of KSU

Proposed Strategic KPIs for KSU that measures strategic performance

Infrastructure / Technology / Resources

% of internal / external clients “satisfied” or “strongly satisfied” with services by all functional units (finance, IT, HR, procurement, Business operation, Housing, Student services, Library, External relations, Institutional research)

Teaching and Research Space as a proportion of

Total Space

Student Focus (Student Experience) Strategic objective #3: Less

is more (Reduce KSU’s student volume, increase the share of graduate students and raise entry requirements)

Strategic objective #4: Stronger graduates (Enable KSU students to learn hard and soft skills throughout their academic life)

Strategic objective #6: Supportive learning environment (Create an engaging environment at KSU for faculty, students, and staff)

Student satisfaction with university life experience

Retention and Graduation Time Series for undergraduate and PGs

3.6.1 Percentage of students graduated in the last 3 years who are recognized in the areas of academics, or profession, or contribution to society at the national or international level (%)

4.12.3 Proportion of students entering undergraduate programs who complete those programs in minimum time (NCAAA 9 - Means average and Level achieved)

4.12.5 Students overall rating on the quality of their courses (Average rating of students on a 5 point scale overall evaluation of courses) (NCAAA 6 - Means average and Level achieved based on survey)

Community and University Environment

% of students involved with university community events

% of faculty / staff involved with university community events

Financial / Institutional Sustainability Strategic objective #7:

Sustainable future (Build KSU’s endowment and diversity sources of funding)

Endowment Per FTE faculty / staff

Total auxiliary and other revenue generated

Research Strategic objective #1:

Good everywhere; Great in focus areas (Strengthen our comprehensive

10.5.1 Number of refereed publications in the previous year per full time equivalent member of teaching staff. (Publications based on the formula in the Higher Council Bylaw excluding conference presentations) (NCAAA 26 - Ratio

university with academic areas of research and teaching excellence)

average and Level achieved)

10.5.2 Number of citations in refereed journals in the previous year per full time equivalent teaching staff. (NCAAA 27 - Ratio average and Level achieved)

10.5.3 Proportion of full time member of teaching staff with at least one refereed publications during the previous year (NCAAA 28 - Ratio average and Level achieved)

10.5.5 Ratio of internal research and innovation funds in proportion to the total number of full-time faculty members

10.5.6 Ratio of external research and innovation funds in proportion to the total number of full-time faculty members (NCAAA 30 - Ratio average and Level achieved)

PGR research performance in publications, presentations and posters

% of faculty who get research grant / contract funding

Education Offers (Teaching and Learning)

% of public who are “strongly or very satisfied” with academic standard demonstrated by university

Faculty Student Ratio (Comparisons with Peers /

with mean of Peers / Ratios Using Different Faculty Inclusions –based on Faculty FTE)

Graduate Enrolment as a Percentage of Total

Enrolment

Staff (Human Resource Management) Strategic objective #2:

Distinctive faculty (Attract and develop distinctive faculty)

3.6.2 Percentage of the full-time faculty members obtaining academic or professional awards at the national or international level. (%)

9.5.2 Percentage of full-time faculty members participating in professional development activities during the past year (NCAAA 25 – Ratio average and Level achieved)

% of support staff who participated in professional developmental activities related to their work area

Internationalization Strategic objective #5:

Building bridges (Build bridges among KSU constituencies and externally with local and international groups)

Percentage of students participating in Education Abroad

Number of international visiting faculty scholar

Percentage of Total Undergraduate Enrollment by International Status

Percentage of Total UdergraguateGraduate Enrollment by International Status

Stakeholders/ Social / Society Engagement and Responsibilities

11.4.1 Evaluation of satisfaction of employers/ business operators/ users of graduates /alumni /parents/ graduates on competency of graduates (Means average and Level achieved based on survey)

11.4.3 Proportion of full time teaching and other

staff actively engaged in community service activities (NCAAA 32 - Ratio average and Level achieved)

Partnerships / Collaborations / Knowledge Transfer

# of signed and effective MOUs

Others (Innovation – 12; Access / Affordability – 6; Diversity – 18)

% increase in # of new technologies / patents / intellectual property

Governance, Leadership, Management, Planning Strategic objective #8:

Flexibility and Accountability (Create a performance contract between KSU and the government)

Strategic objective #9: Organizing for purpose (Establishing an organization and governance that supports KSU’s goals)

Total # of Proposed Strategic KPIs for KSU = 32 KPIs

Appendix 3: KSU 2030 Strategic Objectives and KPIs Analysis

Part 1: Analysis of KSU 2030 Strategic Plan

KSU initiated its KSU 2030 Strategic Plan and finalized it in May 2009, with changes

made to it in January 2014 as summarized in Table 3.1 which shows the summary of

changes made to recommendations January 2014. Table 3.1 is summarized from the

review of the types of changes made of the 9 Strategic Objectives and 49

recommendations as proposed in May 2009 with a final set of 47 recommendations as

shown in Table 3.2.

Observations

1. Constitution of a Strategic Plan: The KSU 2030 shows mainly a set of

analysis of the key issues facing KSU and come up with a set of 49

recommendations (with a few options for each of the recommendation for KSU to

select to implement). This deviates from the normal Strategic Plan proposed by

most HEI which follows the norms of having: SMART Goals / Objectives, Actions

/ Initiatives and KPIs. These : SMART Goals / Objectives, Actions / Initiatives

and KPIs were not found in the KSU 2030 as the structure of KSU 2030 has the

attributes of issues and recommendations rather than identifying goals /

objectives / action initiatives / responsible parties and tie frame for completion

and KPIs driving the strategic direction of the institution and its performance

management.

2. Lack of KPIs – Due to the nature of the KSU 2030 being an issues and

recommendations plan, it lacks measurable / SMART objectives or KPIs that can

used as a set of performance measure and management metrics.

3. Implementation aspects – Due to the nature of the KSU 2030, as there was

no details of responsible party with time frame for completion, it appears to be a

very difficult plan to be implemented or measured for performance.

4. Types of changes made in the January 2014 KSU 2030 – The analysis

as shown in Table 2 identified 4 types of major changes that were summarized in

Table 3.1 as

4.1 No changes made = (22 recommendations);

4.2 Changes / Modifications in terminologies used in the recommendation =

(19 recommendations);

4.3 Original recommendation removed = (2 recommendations) and

4.4 New recommendations added = (6 recommendations)

4.5 All these totaled to 47 sets of recommendation, with no specifications of

KPI, SMART objectives, responsible parties or time frame of actions and

competition.

5. Justifications of Changes – While there were modifications as changes noted in

Table 3.1 and 3.2, there was no evidence of justification of changes as the content

analysis and context of the original KSU 2030 remains intact.

Conclusion

In conclusion, due to these inadequacies, it is proposed that only the use of the 9

Strategic Objectives will be used to identify the institutional KPIs of KSU in this report.

Part 2: Analysis of changes to KSU 2030 Strategic Objectives and

Recommendations

Table 3.1: Summary of changes as of January 2014 (revised but unpublished

KSU 2030)

Types of Changes Recommendation # changes in New January 2014 Recommendation

Summary of # of Changes

1. No Changes 1.1 to 1.7

2.1 to 2.4

3.1, 3.2, 3.4 and 3.6

6.4 to 6.6

9.1, 9.2, 9.4, 9.5

= 7 = 4 = 4 = 3 = 4 Total # = 22

2. Changes / Modifications in Terminology

4.1 to 4.4

5.1 to 5.5

6.1 to 6.3

7.1 to 7.2

8.1 to 8.4

9.3

= 4 = 5 = 3 = 2 = 4 = 1 Total # = 19

3. Original Recommendation removed

3.1

7.2 and 7.4

= 1 = 2 Total # = 3

4. New Recommendations added

1.9

3.5

5.6 and 5.7

6.2

7.3

= 1 = 1 = 2 = 1 = 1 Total # = 6

# of recommendations in January 2014 = 47

Summary of revision:

# of old recommendations = 49, while revised version has 47 recommendations

2 recommendations were removed with the addition of 6 new recommendations

Table 3.2: Review of changes made in January 2014 of the KSU 2030

Strategic Objective

Original Recommendations (May 2009)

New Recommendations (December 2013)

Changes made to the original recommendations as of January 2014

Strategic objective #1: Good everywhere; Great in focus areas (Strengthen our comprehensive university with academic areas of research and teaching excellence)

1.1 Develop area of excellence: Healthcare

1.1 Develop area of excellence: Healthcare

No changes from 1.1 to 1.4

1.2 Develop area of excellence: Education

1.2 Develop area of excellence: Education

1.3 Develop area of excellence: Finance & insurance

1.3 Develop area of excellence: Finance & insurance

1.4 Develop area of excellence: Management

1.4 Develop area of excellence: Management

1.5 Develop area of excellence: Engineering / ICT

1.5 Develop area of excellence: ICT

Recommendations 1.5, 1.6 and 1.7 are similar except that “Engineering” has been deleted

Since only “Engineering” is deleted from the title, it is assumed that they remain the same.

1.6 Develop area of excellence: Engineering / Petrochemicals

1.6 Develop area of excellence: Petrochemicals

1.7 Develop area of excellence: Engineering / Water resources development and management

1.7 Develop area of excellence: Water resources development and management

1.8 Develop area of excellence in Urban Planning

1.8 Develop area of excellence in Urban Planning

No Change

1.9 Develop area of excellence in Nanotechnology Future technologies

New area of Excellence

Bottom line is only 1 new addition of Recommendation 1.9

Strategic Objective Original Recommendations (May 2009)

New Recommendations (December 2013)

Changes made to the original recommendations as of January 2014

Strategic objective #2: Distinctive faculty (Attract and develop distinctive faculty)

2.1 Strengthen faculty recruitment process to match international standards

2.1 Strengthen faculty recruitment process to match international standards

No Changes

2.2 Attract visiting professors in each department

2.2 Attract visiting professors in each department

2.3 Increase benefits and improve support for existing faculty members

2.3 Increase benefits and improve support for existing faculty members

2.4 Design and deploy new performance based faculty tracks

2.4 Design and deploy new performance based faculty tracks

Bottom-line: NO changes

Strategic Objective Original Recommendations (May 2009)

New Recommendations (December 2013)

Changes made to the original recommendations as of January 2014

Strategic objective #3: Less is more (Reduce KSU’s student volume, increase the share of graduate students and raise entry requirements)

3.1 Transform the existing branch campuses into stand-alone universities

3.1 Reduce the size of the student body at the Riyadh campuses

Original 3.1 was removed and old 3.2 became 3.1

3.2 Reduce the size of the student body at the Riyadh campuses

3.3 Form advisory committee to analyze higher education capacity and advise government

3.2 Form advisory committee to analyze higher education capacity and advise government

No Changes and 3.3 is missing due to wrong numbering

3.4 Build internal capacity at the Muzahmiya campus

3.4 Build internal capacity at the Muzahmiya campus

No Changes, but there is wrong numbering

3.5 Increase the number of graduate students in each academic program

Addition of 3.5

3.5 Expand current overseas graduate offering in each program

3.6 Expand current overseas graduate offering in each program

No Changes, but # should be 3.5

Bottom-line: Original 3.1 removed and replaced with new 3.5 (which should be 3.4 for correct numbering)

Strategic Objective Original Recommendations (May 2009)

New Recommendations (December 2013)

Changes made to the original recommendations as of January 2014

Strategic objective #4: Stronger graduates (Enable KSU students to learn hard and soft skills throughout their academic life)

4.1 Differentiate and Strengthen preparatory year between 3broad academic areas to increase its impact

4.1 Strengthen preparatory year capabilities

Basically similar to original as Prep Year has been separated into 3 broad areas

4.2 Embed innovative teaching methods throughout KSU academic programs (e.g. case-studies, problem based and cooperative-collaborative learning, student presentation, classroom technology)

4.2 Embed innovative teaching methods throughout KSU academic programs

No Changes except examples were removed

4.3 Launch Teacher's Academy to support and develop Teachers skills

4.3 Establish Teacher's Academy to support and develop Teachers skills

No changes except changing “launch” to “establish”

4.4 Raise English skills requirements for graduation

4.4 Improve English skills for students

Minimal changes as it applies to all students

Bottom-line: Since some of the initial recommendation was accomplished, there is minimal changes except to “strengthen” or “improve” practices in 4.1 and 4.4 respectively

Strategic Objective Original Recommendations (May 2009)

New Recommendations (December 2013)

Changes made to the original recommendations as of January 2014

Strategic objective #5: Building bridges (Build bridges among KSU constituencies and externally with local and international groups)

5.1 Create an Institutional advisory board

5.1 Create a University advisory board

Minimal changes reflected in terminology changes of “institutional” to “University”

5.2 Create advisory board for each faculty

5.2 Create advisory board for each College

Minimal changes reflected in terminology changes of “faculty” to “College”

5.3 Create external relations office and strategy

5.3 Create an office for International relations

Similar context except strategy is downplayed.

5.4 Create community relations program and strategy

5.4 Create an office to coordinate all community relations and strategy

New changes changed the original context of well planned and executed community relations, while new one is on creating an office for coordination

5.5 Provide competitive grants for Interdisciplinary research and programs

5.5 Create an Interdisciplinary knowledge sharing program

Complete change from “interdisciplinary research” to “knowledge sharing”

5.6 Create a career services office

New addition

5.7 Create Volunteer Program

New addition

Bottom-line: Terminology changes in 5.1 and 5.2, but changes in terminology of 5.3, 5.4 and 5.4 changed the original intention and context of the recommendation. Two new additions of 5.6 and 5.7

Strategic Objective Original Recommendations (May 2009)

New Recommendations (December 2013)

Changes made to the original recommendations as of January 2014

Strategic objective #6: Supportive learning environment (Create an engaging environment at KSU for faculty, students, and staff)

6.1 Launch campus infrastructure review and upgrade

6.1 Launch campus Physical infrastructure review and upgrade

Added in “physical” which can change original intention and context of recommendation

6.2 Launch campus IT infrastructure review and upgrade

New addition with “IT” separated from “physical” which makes little justification

6.2 Detail student, faculty and staff codes of conduct

6.3 Establish Code of conduct & Research Ethics

New changes in terminology can change the original intention and context of recommendation which is more generic and comprehensive

6.3 Develop extracurricular activities portfolio

6.4 Develop extracurricular activities portfolio

No Change

6.4 Create a student 6.5 Create a student No Change

governing body governing body

6.5 Launch annual environment and infrastructure survey

6.6 Launch annual environment and infrastructure survey

No Change

Bottom-line: Changed terminology in 6.1, 6.2 and 6.3 can change the original intention and context of recommendation. Basically only 1 new addition in 6.2, with no changes in 6.4, 6.5 and 6.6

Strategic Objective Original Recommendations (May 2009)

New Recommendations (December 2013)

Changes made to the original recommendations as of January 2014

Strategic objective #7: Sustainable future (Build KSU’s endowment and diversity sources of funding)

7.1 Diversify sources of

funding by cultivating

target donor

relationships

7.1 Strengthen the

capabilities of

fundraising activities

within KSU

New 7.1 and 7.2 can be combined together as they constitute all “fundraising” activities

New 7.1 and 7.2 is similar to original 7.1

Original 7.2 is removed

7.2 Create annual report

task force to

transparently publicize

endowment success and

usage

7.2 Strengthen the

capabilities of

Endowment Unit and its

strategy

7.3 Start donor

recognition program

7.3 Cultivate target

donor & Alumni

relationships

Changes made in terminology that can change original intention and context of recommendation

7.4 Build an organization to support all fundraising activities within KSU

7.4 Create annual report task force to transparently publicize endowment successes and usage

New 7.4 is same as original 7.2

Old 7.4 was removed

Bottom-line: Changes made in terminology in new 7.1, 7.2 and 7.3 can change original intention and context of recommendation of 7.1, 7.3 and 7.4, but original 7.2, 7.3 and 7.4 was removed with new 7.3

Strategic Objective Original Recommendations (May 2009)

New Recommendations (December 2013)

Changes made to the original recommendations as of January 2014

Strategic objective #8: Flexibility and Accountability (Create a performance contract between KSU and the government)

8.1 Develop a performance agreement with the Government

8.1 Develop partnership with Stakeholders in Government to increase autonomy

Changes made in terminology can change original intention and context of recommendation

8.2 Build KSU’s internal financial capabilities

8.2 Improve internal financial processes and efficiency in operations

Changes made in terminology can change original intention and context of recommendation

8.3 Build internal HR processes capabilities approach

8.3 Build internal HR processes and facilitate performance management approach

Changes made in terminology can change original intention and context of recommendation

8.4 Build procurement processes

8.4 Build efficient procurement processes

Change in terminology

Bottom-line: there are modifications in the new recommendation 8.1 to 8.4 and these Changes made in terminology can change the original intention and context of recommendation though they might seem similar. Other than that there appears to be no new additions

Strategic Objective Original Recommendations (May 2009)

New Recommendations (December 2013)

Changes made to the original recommendations as of January 2014

Strategic objective #9: Organizing for purpose (Establishing an organization and governance that supports KSU’s goals)

9.1 Consolidate complementary colleges into single faculties

9.1 Consolidate complementary colleges into single faculties

No change

9.2 Reduce number of Vice-rectors and Deans

9.2 Reduce number of Vice-rectors and Deans

No change

9.3 Introduce new governance model to solve male vs. female governance inefficiencies

9.3 Establish a Strategy for Female Section

Changes made in terminology can change original intention and context of recommendation

9.4 Simplify KSU’s council structure, membership and governance

9.4 Simplify KSU’s council structure, membership and governance

No change

9.5 Raise the quality of administrative support staff

9.5 Raise the quality of administrative support staff

No change

Bottom-line: Basically, there are no changes in 9.1, 9.2, 9.4 and 9.5, and Changes made in terminology in 9.3 can change original intention and context of recommendation

Appendix 4: Comparative Analysis of Institutional KPIs

Table 4.1: Comparative Analysis of most frequently used Institutional KPIs

CUC (Committee of University Chairman) Report 2006

# of KPIs

Most common indicators used in Dashboard of US Universities

# of KPIs

Research (2014) of 11 randomly selected universities

# of KPIs

Institutional Sustainability

7 Institutional Sustainability

6

Academic Profile and Market Position

7 Admissions

Enrolment

Academic Information

External Rating

Education (Teaching and Learning)

87

Student Experience and Teaching and Learning

8 Student Outcomes

Student Engagement

Satisfaction

Student Focus 208

Research 8 Research Research 82

Knowledge Transfer and Relationships

7 Partnership / Collaborations

12

Financial Health 8 Financial Indicators

Financial 78

Estates and Infrastructure

6 Physical Plant Infrastructure

Technology

Resources

103 34 103

Staff and HRD 6 Faculty

Satisfaction

Faculty

Staff

20 25

Community and University Environment

48

Governance, Leadership & Management

5 Planning / Governance

7

Internationalization 34

Stakeholders Engagement

11

Social / Society 33

Environmental 15

Innovation 12

Access / Affordability 6

Diversity 18

TOTAL 61 TOTAL 927

Table 4.2: Key Categorical Areas of KPIs

Key Categorical Areas where KPIs are important # of KPIs (similar occurrence) in each category

Infrastructure / Technology / Resources 246

Student Focus (Student Experience) 216

Financial / Institutional Sustainability 99

Research 96

Education Offers (Teaching and Learning) 94

Faculty / Staff (Human Resource Management) 51

Community and University Environment 48

Internationalization 34

Stakeholders/ Social / Society Engagement and Responsibilities

59

Others (Innovation – 12; Access / Affordability – 6; Diversity – 18)

36

Partnerships / Collaborations / Knowledge Transfer 19

Governance, Leadership, Management, Planning 12

TOTAL 988

Table 4.3: Indicator Groups for each of the Key Categorical KPIs Area

Key Categorical Areas where KPIs are important

Indicator Group Illustrative KPIs of Indicator Group

Infrastructure / Technology / Resources

Physical Plant

Investment in infrastructure

Cost Efficiency / Productivity

Proportion of modernized teaching rooms

Cost of maintenance

Utilization per sq. meter

Customer impact tools are utilized to gauge effectiveness of service delivery

Review of monthly compliance reports

Annual spending on infrastructure to agreed annual requirement

Maintenance condition and functional sustainability of estate

Wastage

Cost efficiency / Productivity

Utilization – square meters per student

Return on assets : income per square meter

Proportion of modernized rooms Adequacy of library resources for research

needs

Average space (in sq. meter) per research FTE by type of research facility (laboratories, office space)

Inventory of research-related capital is developed

Review, improvement and enforcement of university-wide safety related policies and procedures

Positions for research are reviewed and established at the college level

Faculty and research support staff satisfaction with research activity support

(protected time, funding, facilities, staff, equipment, etc.)

% of administrative units that achieved their planned objectives

% of internal / external clients “satisfied” or “strongly satisfied” with services by all functional units (finance, IT, HR, procurement, Business operation, Housing, Student services, Library, External relations, Institutional research)

% of staff (by functional units) attending customer-oriented training programs annually

Number of complaints / service failure about service provisions relating to time, quality, attitude / mind sets / capabilities

Teaching and Research Space as a proportion of Total Space

Room Utilization

Deferred Maintenance Backlog

Library Resources: LibQUAL Survey Results

Information Technology Costs

Central Administrative Costs

Usage and growth of digital repositories Percentage of faculty reporting use of Open

Educational Resources (OER) materials

Cost for "commodity" information technology services

Percentage of faculty and staff computers with anti-virus software, spyware detection software, and adware detection software installed

Percentage of faculty and staff laptops with full disk-drive encryption

Percentage of University’s merchants who are Payment Card Industry (PCI) compliant

Percentage of University units meeting current security standards

Utilization rate of classroom space

Utilization rate of research space

Housing Occupancy – percentage of available beds rented.

Percentage of faculty compensated at or above the average salary by rank and discipline.

Percentage of staff compensated at the average market salary based on employment category.

Percentage of total classroom renovations completed.

Percentage of total residence hall rooms renovated.

User satisfaction with learning resources

Strategic development funds as percentage of turnover

100% of faculty and students will use campus LMS

All departments will establish and implement an appropriate assessment process that utilizes available technology to

allow for efficient aggregate data collection and analysis

Increase the proportion of technical helps calls assisted by computer driven remote support to 60 % by 2017

Increase the % of students who make use of mobile alerts

% academic space higher than 5-year average

% organized research space higher than 5-year average

% decrease in metered energy consumption trends (electricity,) compared to 5 years average

% decrease in per capita/per building space trends to total campus energy

Average total paper count over 5 years average

Evidence of implementation and successful administration of assessment and utilization of information for improvements

Response time

Average hours changed

Turnaround time % building maintenance hours proactive

% of PM work completed

Estimate Versus Actual Job Plan performance

Work order planned start date completed

Minor projects backlog

Major process backlog

Hours worked minor and major projects

Use of service (tracking) Satisfaction surveys

Turnaround time for requests

Lost time inquiries

Time lost sick

Budget Vs. Actual

% of preventative maintenance work orders for Fire, Life or Safety (FLS) equipment completed by scheduled date

% of preventative maintenance work orders for Non-Fire, Life or Safety (Non-FLS) equipment completed by scheduled date

% of customer work orders completed by original / communicated due date

Quantity of Customer Custodial Concerns (CCC) brought to management attention where published standards were not met

% of CCC work orders completed and communicated within one business day

% of custodial staff inspections completed Quantity of major electrical outages, IT

service failures

% of preventative maintenance work orders acted on during the scheduled month

Reduce monthly the number of work orders exceeding the A (30 days), B (60 Days) and C (120 days) limits for completion

Keep within the dollar budget

Keep the running 12 moth average at 5% for labor overtime hours

Attain Level 1 Custodial Care

Reduce energy density as compared to previous years

Keep energy density below System Median

Student Focus (Student Experience)

Student Satisfaction

Student Progression

Graduation Rates

Retention Rates

Measures of Success

Awards

Student employability

Student demand, achievement and satisfaction

Student recruitment against plans

Quality of student entry

Student progression

Student achievement

Student Satisfaction Student perception

Employability and student destination

Level of employers’ satisfaction regarding communication, teamwork, leadership and IT skills

Present attitude towards Institution

Present attitude towards degree program

Active and Collaborative Learning

Critical thinking ability

% increase for senior students on NSSE benchmarks (active and collaborative learning, student/faculty interaction, supportive campus environment)

% students who meet / exceed expectations on critical thinking, composition, math/reasoning rubric

% of students achieving 80% on assessment of SLO

% of activities organized by students / student clubs

Student satisfaction with university life experience

Level of student involvement in campus governance

Level of enriching education experience reported by students

Level of employer satisfaction with post-graduate students

Undergraduate Student Awards

Scholarships from Federal Granting Councils

Retention and Graduation Time Series

Retention Compared to Selectivity Groupings

Graduation Compared to Selectivity Groupings

Foundational year programs

NSSE Benchmark-Level of Academic Challenge

NSSE Benchmark-Active and Collaborative Challenge

NSSE Benchmark-Student-Faculty Interaction

NSSE Benchmark-Enriching Educational Experiences

NSSE Benchmark-Supportive Campus Environment

Percentage of academic programs with specified learning objectives

Percentage of academic programs with a formal assessment plan

Percentage of undergraduates who have participated in academic research with faculty outside of class, written a thesis, or completed a capstone project

First-year and third-year undergraduate retention rates

Four-year and six-year undergraduate graduation rates

Graduate student completion rate

Average graduate student time-to-degree

Selected measures from the National Survey of Student Engagement (NSSE) such as "Level of Academic Challenge", "Active and Collaborative Learning", "Student-Faculty Interaction", "Enriching Educational Experiences", "Supportive Campus Environment" and "Percent of students reporting having completed a practicum, internship, field experience, co-op experience, or clinical assignment"

Percentage of students reporting that university contributed to their "developing a personal code of values and ethics"

Number of graduate assistantships and fellowships

Total funds available for graduate assistantships and fellowships

First year to Second Year Retention Rate

First year to Third Year Retention Rate

Six Year Graduation Rate

New Freshmen Enrolment Undergraduates with declared majors

Average ACT score of incoming freshmen.

Percentage of FTFTFR fully college ready.

Amount of funding applied to institution Scholarships awarded to students to which academic criteria is attached.

Number of students who receive scholarship first year and return with scholarship second year

A comparison of the success rate of students who took a developmental course in English, Math and/or Reading in their next course in that discipline compared to students who did not take a developmental course, what percentage pass the following course taken for credit.

Percentage of students participating in the Celebration of Student Scholarship. (% change from previous year.)

# of graduate assistantships

# of internships completed for credit as part of a course

# of undergraduate research fellowships awarded

Service learning (as measured by number of courses and sections offered annually)

# of students participating in athletics

# of students belonging to student organizations

# of FY Seminar sections offered each year

Avg. satisfaction rating of students enrolled in FYS courses during academic year

# of students receiving Honors Scholarship

# of students returning and retaining Honors Scholarship from first to second year

Undergraduate enrollment headcount

Graduate enrollment headcount

Total Transfers

Retention rate of FTPT Students cohort group

Retention rate of FTPT Students admitted with developmental needs

Retention Rate of FTPT students in low income group

Sophomore to junior retention rate

Junior to senior retention rate

Retention of veteran students Retention of underrepresented minority

students Average student debt incurred

Student average tariff entry score

% change in Student retention

% change in Student graduating with a good honors degree

Increase the 4 – year graduation rate to 50% by 2017

Achieve and maintain a 1st year retention rate of 80%

Redesign course with high drop/fail/withdraw rates to promote student achievement

% Increase of students per year winning national scholarships / awards

Student will have a 4 year curricular map supported by technology alerts available by 2015

Administer annual survey on graduates’ readiness to employers recruiting on campus

% increase of students’ participation in research, internships, student teaching or related professional experiential learning experiences (excluding immersive learning)

Total # of students clients served through one-on-one, walk-ins, groups, e-mail, and phone consultations

Total # of academic / career / personal consultations sessions offered to student clients

Level of confidence on pre and post sessions)

Total # of guest lectures, workshops, outreaches and job fairs offered

Cost per participant of workshops

Student employee opinion

# of program participants (new vs. return participants)

# of students with disabilities registered

# of students trained in assistive technology training center

# of medical cases

# of housing issues not addressed

Psychological Counseling Services (PCS) Outcome and satisfaction Survey

Financial / Institutional Sustainability

Endowment & Expenses Data

Advancement

Financial Aid Figures

Fee Tuition Data & Income Sources

Opportunities & Risk

Cost Efficiency / Productivity

Return on Assets – (CE / CP Ratio) Income growth, diversity and security

Balance of development opportunities and strategic risks

Aggregate surplus / deficit for past 3 years as % of income

Cash generated – last financial year

Forecast surplus for next / current FY

Liquidity (days expenditure available as cash)

Borrowing as % of income

Unfinanced capital investment requirement

Credit rating, quality of relationships with bankers and auditors

Annual Fundraising Achievement and Alumni Donors: Annual Fundraising Achievement by Sector

Endowment Per FTE faculty / staff

Value of endowment will have increased over 5-year average by 2017

Total Resources to Long-term Debt

Total Revenue per student

Revenue generated from "angel investor" initiatives

Percentage of recycled funds from vertical cuts

Number of Continuous Quality Improvement (CQI) teams

Surplus as a percentage of Income

Comparative Instructional Cost

Energy Usage

Institutional Support as % of Total Operating expenses

Endowment contributions Overall contributions to institution

Total endowment amount.

Private support from the MSU Foundation, Inc. transferred to support MSU operating needs.

Total auxiliary and other revenue generated

Reach an undergraduate alumni giving rate of at least 15% by 2017

Implement all-funds strategic budgeting practice by 2017

Audit results

Review of Internal / External / Ad Hoc audits by granting agencies

Customer satisfaction surveys

% of work completed accurately and on time

Research Research outputs

Research funding

Research Awards / Grants

Research outputs by appropriate measure (publications in indexed journals, research impact factors)

Research income, total, % and by types of sponsors

Research income per academic, trends and by academic area

Research active staff

Cost recovery on research, by sponsor type Success rates on research grants

applications # of PGR students

PGR Awards

PGR research performance in publications, presentations and posters

# of departments that contributes to PGR programs

PGR level of satisfaction with research experience, services and facilities provided in program

Doctoral stipend levels comparable to average of competing universities by 2017

# of undergraduate students who get research grants or support or joint research with faculty

Research priority plan is developed, accomplished and achieved

% of faculty who apply for internal / external research funding

% of faculty who get research grant / contract funding

Quality of support and assistance provided to help faculty with grant writing and budget preparation

# of new research centers / units / chairs established each year

% of center costs covered by external sources (research / non-research activities)

# of institutional research Degree of primary stakeholders satisfaction

with research outcomes Research grants for researchers and

programs from key stakeholders group

Research Rankings Comparison of International Rankings,

University and Peer Institutions Comparison of International Rankings, Top

25 International Institutions Times Higher Education (THE) World

University Rankings by Discipline

Number of Research Chairs Summary of Publication and Citation

Rankings, Selected Disciplines and Sub-fields

Number of Citations: Science Fields - Top 40 and Peer Institutions

Number of Citations: All Science Fields, University compared to Peer Institutions

Number of Publications: All Science Fields - Top 40 and Peer Institutions

Number of Publications: Science Fields, University compared to Peer Institutions

Research Funding from Industrial Sources

total Research funding awarded by sector

Graduate Publications and Presentations

Total research expenditures

Number of extramural research awards

Average amount of research awards Number of endowed chairs, professorships,

and faculty fellowships

Percentage of tenured faculty holding endowed chairs, professorships, and faculty fellowships

Total funds available for endowed chairs, professorships, and faculty fellowships

Total external research and development funding.

Percentage of external research and grant proposals funded.

Total F & A funds earned from external research and development awards.

% academic staff who are research active

% academic staff with internationally excellent research

By 2017, 10 articles will be published or papers presented at professional conferences reporting on immersive learning projects

Recognize immersive learning in promotion and tenure and salary documents at the department and college levels by 2017

Provide every undergraduate students with an immersive learning opportunity by maintaining a minimum of 4,200 students annually in immersive learning projects

All undergraduate programs will offer at least one immersive learning opportunity each year

Establish four annual university wide immersive learning awards

Appoint eight college-based immersive learning Presidential Fellows to support faculty by 2017

% increase of students’ presentation at national / regional disciplinary conferences

% increase in research expenditures

Education Offers (Teaching and Learning)

Peer Assessment Data

Admission Scores

Quality of Student entry

General Admission Tests

Graduate Admissions

Enrolment Figures

Academic

Teaching / Research Balance

Learning and Teaching performance

Evidence of academic distinctiveness

Position in peer group and league tables

Contribution of strategic academic relationships

Medium term academic ambitions

Results of external assessment % of academic programs accredited by

accreditation agencies

% of academic degree programs and core curriculum completing peer reviews according to university academic review

Information

Student Faculty Contact

Ranking

Academic Effectiveness process

policies

% of employers perceiving academic programs as “high quality” programs

University wide “Honors” program is established

% of graduate programs affiliated with internationally recognized universities

% of public who are “strongly or very satisfied” with academic standard demonstrated by university

% of programs linking SLO with market needs

University academic programs are aligned to meet educational and market needs (reviewed every 5 years)

Level of active and collaborative learning reported by students (average of freshman and seniors)

% of program that contain “capstone experience”, “industry internships” in support of SLOs

Faculty Student Ratio (Comparisons with Peers / with mean of Peers / Ratios Using Different Faculty Inclusions –based on Faculty FTE)

Results of Service-Learning Assessment Survey

Interdisciplinary Opportunities

Graduate Enrolment as a Percentage of Total Enrolment

Number of targeted reviews of academic programs

Number of targeted reviews of administrative programs

Number of baccalaureate degree programs that have been eliminated or consolidated

Number of graduate degree programs that have been eliminated or consolidated

Number of associate degree programs that have been eliminated or consolidated

Number of administrative programs that have been eliminated or consolidated

Percentage of academic units with transparent workload policies

Student credit hours per instructional faculty full-time equivalent

Cost/student credit hour

Percentage of sections that are under-enrolled

Percentage of sections taught by tenured or tenure-track faculty

Increase in % of entering freshmen who pursued Academic Honors or its equivalent to 80%

Increase in % of entering transfer students with GPAs of 3.0 or better

Increase in % of # of master’s program enrolled students who have GPAs of 3.5 or better

% increase in experiential and service learning participants by 10%

Increase science, technology, engineering and mathematics (STEM) and other high impact degree offerings

Increase graduate FTEs by 20% by 2017 % increase of employers engaged in on-

campus recruiting activities

Develop and implement an overall assessment of the core curriculum beyond the current course assessments

% of program that are ranked or recognized

% in number of publications and peer reviewed presentations in scholarship of teaching and learning

% increase in external funding of scholarship of teaching and learning

% increase of fully online FTE

Achieve national ranking and recognition of online efforts

% increase in-campus student enrolment in blinded courses

% increase in graduate enrolment

Average time completion to doctoral degree compared to national average by each discipline

% of number of students enrolled in interdisciplinary programs over the 5-year average

Faculty / Staff (Human Resource Management)

Faculty – General

Faculty Satisfaction

Staff Satisfaction

Cost of Staff as %

Staff / Faculty Turnover

Staff / Faculty Profile

Staff / Faculty Development expenditure

Staff scholarly activity

Cost of staffs as % of total cost

Staff turnover, absence, vacancies against plans

Staff age, skills and diversity profile

Expenditure on staff / faculty development and training

Pensions liability – funding coverage Staff satisfaction (surveys, complaints and

appeals, institutional experience) Staff engagement surveys

% of faculty promoted to higher ranks out of those who applied

Compensation package are at a level comparable to benchmarked institutions

% of students surveyed who report “excellent” or “very good” levels in teaching performance of faculty

% of faculty agreeing that institution image is better than other universities in the region

% of those candidates who were offered a contract have accepted it

% of new hires indicating that they are “satisfied” or “strongly satisfied” with recruitment process

Training needs assessment program aligned with training provision is developed and implemented

% of support staff who participated in professional developmental activities related to their work area

# of staff who hold affiliations with

professional associations

Faculty Honors by Award Teaching Fellowship Awards

Faculty & Staff Work/Life Balance

Percentage of full-time faculty with tenure or on the tenure-track

Percentage of full-time faculty on fixed-term, multi-year appointments

Tenure success rate

Percentage of staff on full-time, year-around appointments

New Teacher Excellence

Academic staff with and accredited teaching qualification

Academic staff with a doctorate

% increase of faculty or professional staff with national / international recognition (awards, leadership positions, and editorial board memberships)

% increase external funding for scholarly work

% increase of number of contract and grant proposal submission

Develop and implement tools (e.g. surveys, focus groups, forums, etc.) for measuring job satisfaction considering elements like workplace environment, salary and benefits, communications; establish a baseline and track improvements

Conduct a diversity climate survey; establish a baseline and track improvements

Achieve a 24:1 student to tenure/tenure-track faculty student ration or lower by 2017

Staff capability Staff perception

Number of policies reviewed and/or revised

Number of programs / requests

Number of program participants

Program evaluations

Focus groups Participation on relevant university

committees

Number of trained leaders Evaluation comments

Number of staff position classifications requests

Periodic review of processing issues

Monthly and quarterly reports of % delinquent staff development evaluations

Payroll authorizations processed by established payroll deadlines

Information on HR web-pages is accurate, up-to-date, and easily accessible

Improved and more efficient HR document processing via the web

HR network available to HR users

Adequate number of well-trained neutrals to serve as mediators

Training programs will be utilized and with satisfactory results.

Number of mediations conducted

Survey of employees

Survey of users of program and their supervisors

99% of annual legislative salary adjustments are applied accurately by HRM by published date

95% of payments are applied correctly and in the month earned

95% of probationary-to-permanent status conversions are initiated within the correct month

99% of university of payrolls will be paid on the scheduled pay date

<10% of all manual checks issued will be due to payroll office error

99% of new employee orientation (NEO) sessions are conducted as scheduled

% of NEO attendees requiring one-on-one sessions

90 % of vacancies with at least two well qualified candidates referral within reasonable time frame

% of requests for temporary employees to placements

90% of new positions actions will be classified and established within the turnaround time of 10 days

95% of employee reported complaints will be resolved avoiding the use of a formal grievance procedure

Community and University Environment

% of students involved with university community events

% of faculty / staff involved with university community events

Supportive Campus Environment Student participating in institution and

other social, sporting and support programs % of students on campus participation in co-

curricular programs

% increase of employee average participation in substantive wellness initiatives

% increase in participation in diversity programs

% increase in participation in cultural programs

% increase in participation in athletics programs

% increase in artistic and cultural events publicized in a wider community programs

Internationalization

International Student Enrolment International Students: Map

International Student Satisfaction with 4 areas of student experience

International Student Satisfaction - overall satisfaction and recommendation

Number of Participants in Study Abroad &

Exchange Programs

Global Engagement Network institutions with whom Penn State has a defined partnership

Number of students participating in Education Abroad

Percentage of students participating in Education Abroad

Number of international visiting faculty scholars

Percentage of Education Abroad participants by region of study

Percentage of undergraduate international students by region of home country

Percentage of graduate international students by region of home country

Number of courses identified with "International Cultures" designation

Number of courses with embedded international experiences

Number of students who pursue advanced foreign language

Percentage of Total Undergraduate Enrollment by International Status

Percentage of Total Graduate Enrollment by International Status

Double the number of International students

4 new partnerships per year Triple the number of study abroad students

% increase enrolment of international students

International recognition

% increase of exchange faculty / students / staff with strategic partners

% increase in # of student enrolled in study abroad programs

% increase in # of student enrolled in dual degrees programs

% increase in international students who engage in intercultural learning

Stakeholders/ Social / Society Engagement and Responsibilities

Proportion of Academic / Staff time on Social Responsibilities / Social Engagement activity

Stakeholder (alumni, parents, employment market) surveys

Community perception

Employer perception

Alumni preparation for present job

Alumni preparation for additional degree % increase in alumni participation in

universities activities

Quality of life beyond financial benefits

# of sponsorships and scholarships given to institution students

# of meetings with external constituents to gather information on societal needs and aspirations

Achieve Carnegie Community Engagement classifications

Establish a stakeholder engagement plan

Every college and professional program will

have an external advisory council

Every department will conduct alumni surveys every five years and solicit employer input where appropriate to aid in curriculum development

% increase of # of companies impacted by university

% increase of # of communities actively engaged with university

Survey to gather key stakeholders on societal and labor market needs, societal aspirations to which institution can contribute is developed, implemented and results analyzed

Series of focus group sessions with key stakeholders to better understand societal and labor market needs and aspirations to which institution can contribute is developed and implemented

% of faculty / staff / students involved with community service

Institution’s interactions with stakeholders to identify needs of non-degree course / programs

Satisfaction level with continuing education courses of institution

% increase in headcounts of students enrolled / completing continuing education courses

Outreach programs / services provided to stakeholders (library service, camps / open days, career day)

Academic seminars for public # of positive media mentions

Ratio of positive / negative media mentions

Image of institution survey

Alumni outreach programs (# of activities, # of alumni club members)

Policies / procedures to allow for leave of faculty and staff for community service

Number of online/blended learning courses

Headcount enrollment in online/blended learning courses with breakout for resident instruction

Percentage of resident instruction students taking World Campus courses

Number of community outreach functions co-located at a Penn State campus

Enrollment in academic programs shared within regions

Number of faculty and staff shared across campuses

Non-traditional student enrollments

"Return on Investment" for Outreach programs

Research focused on sustainability o Number of projects or grants o Dollar value of project or grants

Number of Academic Offerings focused on sustainability education

Number of Academic Offerings that

incorporate sustainability into the curriculum

Greenhouse gas emissions

Greenhouse gas reductions Quantity of environmentally-responsible

purchases versus standard purchases

Carbon emissions reduction Attendees at external events

Engagement of staff and students with external community activities

Contribute eight hours of community service per athlete per year with student athletes and coaches

Track and communicate annually the financial and service impact of student volunteer programs

Offer specific curricula in sustainability

Secure funding and complete environmental sustainability project

Monitor and benchmark energy efficiency and implement initiatives to continue energy-efficient improvements and sustainability efforts

% increase in students / faculty / staff in green projects

% increase in number of core instructional elements in environmental sustainability in university’s degree programs or

% increase of new programs in environmental sustainability

Others (Innovation – 12; Access / Affordability – 6; Diversity – 18)

New Invention Disclosures

% increase in # of new technologies / patents / intellectual property

Amount of flexible money available for innovation and experimentation above 5-years average

New Licenses

New Spin-off Companies

10 start-up companies will be created by 2017

Growth in patents filed and disclosures

% increase in number of Intellectual Property

% increase of licensable technologies

Student reported responses to visible minority/ethno cultural info questions

Estimated number of Visible Minority Students

Number of Students Registered

Student population – character and diversity

Academic Bridging Program: Academic Bridging Program Enrolment

Online course survey

Parental Income of First Year Students Scholarships and Bursaries as a Percentage

of Operating Expenses: Scholarships and Bursaries as a Percentage of Operating Expenses

Graduate Financial Support: Doctoral

Student Support: Average Financial Support

Percentage of students receiving need-based institutional scholarships

General Funds available for need-based aid Total funds available for need-based aid

Total unmet need

Progress in meeting the "Ensuring Student Opportunity" goal of the "For the Future" capital campaign

Percentage of full-time faculty by demographic group

Percentage of full-time staff by demographic group

Percentage of undergraduate enrollment by demographic group

Six-year baccalaureate degree graduation rates by demographic group

First-year and third-year retention rates by demographic group

Percentage of graduate enrollment by demographic group

Completion rates for graduate students by demographic group

Average time-to-degree for graduate students by demographic group

Tenure success rate of faculty by demographic group

Undergraduate enrollment of underrepresented minority students headcount

Graduate enrollment of underrepresented minority students headcount

Bachelor’s degrees awarded to underrepresented minorities

Bachelor's degrees awarded to low income students

Master’s degrees awarded to underrepresented minorities

Doctoral degrees awarded to underrepresented minorities

Bachelor’s graduation rate gap- Low income Bachelor’s graduation rate gap-

Underprepared

Bachelor’s graduation rate gap- Underrepresented Minority

Bachelor’s graduation rate gap- veterans/dependents

Every five years, complete an audit of campus services aimed at welcoming a diverse student body, faculty and staff and adjust as necessary

% increase enrolment of at-risk students

% increase graduation of at-risk students

Create / revise unit level diversity plans with faculty, professional personnel, classified staff, and service personnel recruitment targets

% increase enrolment of underrepresented students

% increase of entering students comes from

out of state

% increase enrolment of transfer students UG headcount by gender and ethnicity

Grad headcount by gender and ethnicity

Partnerships / Collaborations / Knowledge Transfer

Proportion of Academic time on “Opportunities” activity

Income from commercial sponsors

# and quality of partnerships

Strategic relationships and reputation,

Potential partners’ image of research capabilities of institution

Proportion of academic time on “O” Activity

% of Research Income from commercial sponsors

Measures of exploitation of IP – Intellectual Property (spin-outs, license agreements, patents)

# and quality of Strategic partnerships

Engagement with local, regional and professional communities

Success of Alumni, fund raising and sponsorship activity

# of signed and effective MOUs

Growth in knowledge transfer partnerships

Growth in patents filed and disclosures

Increase enterprise income

# of units participating in Productive Partnerships

# of goals and objectives in Productive Partnerships

Enterprise partnerships per year

External research and enterprise income growth

% student undertaking work placement each year

% increase in funding from sponsoring agencies

Overall increase in sponsored funds granted to university above 5-year average

Governance, Leadership, Management, Planning

Leadership Assessment

External Audit of Management

Successful delivery of projects

Leadership and adaptive capacity

Integration of academic and strategic planning

Results of external audits of management

Extent of leadership skills and training in senior management

Successful deliveries of strategies, projects and plans

Remuneration committee reports

Performance is monitored and assessed according to approved targets in strategic plan

% of colleges and department strategic plans developed in alignment with institution strategic plan

Levels of awareness of strategic plan, mission and visions and goals

Create a well-researched academic master plan by 2017 and invest in strategic academic offerings

Faculty and Units Plan

Adopt 3 identified best practices every year

% increase of manager who have undergone collaborative management principles and training

Evidence of data-driven decision making by all units by 2017

Evidence of informed decision making by all management by 2017

Evidence of increased collaborations across units

Appendix 5: Comparative Analysis of Key Performance Dimensions of Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# KPIs # KPIs # KPIs # KPIs # KPIs # KPIs # KPIs # KPIs # KPIs # KPIs # KPIs # KPIs # KPIs

Research 8 8 4 6 21 6 3 6 5 31 90 Education (teaching and learning)

7 8 12 22 6 7 6 3 5 18 87

Student Focus 64 8 10 31 42 3 43 8 3 12 216 Faculty 3 4 2 2 1 9 20 Staff 6 2 2 6 2 12 31 Community and Univ. Environment

22 14 6 6 48

Infrastructure 57 6 13 6 5 22 103 Technology 13 10 9 2 34 Resources 95 1 6 1 103 Financial / Institutional Sustainability

30 15 15 4 13 5 8 2 6 1 84

Planning 5 4 3 12 Internationalization 10 10 6 4 4 34 Partnerships / Collaborations

7 3 2 7 19

Stakeholders Engagement 9 2 11 Social / Society 8 1 24 33 Environmental 3 4 7 1 15 Innovation 5 3 4 12 Access / Affordability 6 6 Diversity 9 9 18 TOTAL 246 94 113 92 99 32 16 63 30 12 23 138 988

Comparative Analysis of Components of RESEARCH Key Performance Dimension of Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

RESEARCH 8 √ 5 √ 6 √ 3 √ 6 5 5 33 Interdisciplinary √ Research opportunities for students

√ √ √ 8 8

Quality research / performance

√ 1 √ 1 √ 10 √ √ √ 5 17

Infrastructure and financial support for research (Internal)

√ 4 √ 4 √ 4 12

Research focused faculty capacity

√ 3 √ 5 8

Competitive doctoral stipend

√ 1 1

Centers of Excellence √ 5 5 Post graduate Research programs on national issues

4 4

Funding Capacity √ 2 √ 1 √ 4 √ √ 7 Commercialization √ 3 √ 3 Knowledge Transfer / Exchange

Research Environment √ TOTAL 8 4 6 21 6 3 6 5 31 98

Comparative Analysis of Components of EDUCATION (TEACHING AND LEARNING) Key Performance Dimension of

Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

EDUCATION (TEACHING AND LEARNING)

7 7 11 6 12 √ 6 √ 7 √ 6 1 3 5 5 53

Active & Collaborative Learning

√ 1 √ 4 5

Diversify educational opportunities

1 √ 6 7

Instructional methodologies

Benchmark academic programs

√ 5 √ 3 √ 5 13

Programs meets market and international needs

√ √ √ 6 6

Learning Experience Meet Students’ needs √ 2 √ 1 3 Quality of T & L √ 4 √ √ 3 7 Innovative Program √ TOTAL 7 8 12 22 6 7 6 3 5 18 94

Comparative Analysis of Components of STUDENT FOCUS Key Performance Dimension of Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

STUDENT FOCUS 8 6 10 √ 8 1 8 3 37 Student Outcomes √ 2 19 √ 2 √ 21 Engagement in research √ √ 1 1 Student experience √ 1 7 √ 40 √ 3 √ √ 7 57 Advising √ Graduate education Ethics √ √ Progression / Retention /Graduation

√ √ 28 28

Enrolment growth √ 7 7 Student engagement √ Student exposure to global research & scholarship

√ 2 √ 2

Student administration / management

√ √

Student Services 15 56 56 Participation in University Life

Effective Student / University Communication

√ √ 4 4

Entrepreneurship / Employability

Student Affairs 8 8 √ 3 11 TOTAL 64 8 10 31 42 3 43 8 3 12 224

Comparative Analysis of Components of FACULTY Key Performance Dimension of Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

FACULTY Recruitment / Retention

√ 3 √ 9 12

Expertize 1 4 √ 4 Faculty Engagement √ 2 2 Development √ 2 √ 2 Performance Based Culture

TOTAL 3 4 2 2 9 20

Comparative Analysis of Components of STAFF Key Performance Dimension of Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

STAFF 6 √ 6 1 1 2 √ 12 27 Professional development

√ 2 √ 2

Staff Engagement √ 2 2 Adaptable workforce with skills aligned to strategic directions

Supportive, rewarding and equitable work environment

Performance Based Culture

TOTAL 6 2 2 6 1 2 12 31

Comparative Analysis of Components of COMMUNITY AND UNIV. ENVIRONMENT Key Performance Dimension of

Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

COMMUNITY AND UNIV. ENVIRONMENT

4 √ 6 √ 6 12

Supportive Campus Environment

√ 7 √ 3 √ 10

Vibrant and integrated University community

√ 12 √ 9 21

“State of Art” environment for research & education

√ 1 √ 1

Campus Culture √ 1 √ 1 Community engagement

√ 3 √ 3

TOTAL 22 14 6 6 48

Comparative Analysis of Components of INFRASTRUCTURE and FACILITIES Key Performance Dimension of

Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

INFRASTRUCTURE and FACILITIES

6 √ 6 √ 10 22

Improved infrastructure

√ 5 √ 5

Physical Plant 6 18 18 Administrative Outcomes

√ √ 2 2

Facilities Management

29 29

Service oriented culture

10 √ √ 7 17

Planned and development

√ √ 3 3

Registration / Admission

√ 13 √ 13

TOTAL 57 6 13 6 5 22 109

Comparative Analysis of Components of TECHNOLOGY Key Performance Dimension of Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

TECHNOLOGY √ √ 4 √ 2 6 IT infrastructure support T & L & R

√ 4 √ 1 5

IT Efficiency & Effectiveness

Security and Integrity

√ 4 4

Instructional Technology

√ 2 √ 10 12

Digitization of Information

√ 1 1

Leveraging IT for excellent services

√ 3 √ 3 6

TOTAL 13 10 9 2 34

Comparative Analysis of Components of RESOURCES Key Performance Dimension of Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

RESOURCES √ 1 1 Resource enhancement

√ 6 6

Human Resources 21 95 95 Library √ 1 1 TOTAL 95 1 6 1 103

Comparative Analysis of Components of FINANCIAL / INSTITUIONAL SUSTAINABILITY Key Performance Dimension of

Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

FINANCIAL 15 30 8 √ √ 2 √ 6 √ 1 47 Endowments √ 1 √ 4 √ 1 √ √ 1 7 Productivity √ 2 √ 2 Efficient Utilization √ 3 √ 1 4 Budgeting √ 4 4 Recycling √ 1 1 Resource Utilization √ 2 2 Quality improvements support

√ 1 1

Comparative Instructional Costs

√ 8 √ 1 √ 9

Energy Usage √ 1 1 Institutional sustainability

7 √ 2 √ 1 √ 1 √ 2 √ 13

Revenue flexibility √ 1 √ 1 Sponsored programs fund

√ 7 7

Risk Management TOTAL 30 15 15 4 13 5 8 2 6 1 99

Comparative Analysis of Components of PLANNING Performance Dimension of Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

Advancing and achieving Vision

5 1 3 √ √ 3 11

Decision making based on sound planning, governance and quality processes

√ 1 √ 1

Strategic Deployment of resources and information

TOTAL 5 4 3 12

Comparative Analysis of Components of INTERNATIONALIZATION Key Performance Dimension of Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

INTERNATIONALIZATION

√ 4 √ 4 8

Office responsible √ Partnerships √ 1 √ 3 √ 4 Visiting scholars International experience

√ 2 √ 2 √ 2 √ 6

International students

√ 5 √ 3 √ 2 10

University of Choice

√ √

International Recognition for quality, standards and outcomes

Internationalized Contents

√ 2 √ 2 √ 2 6

TOTAL 10 10 6 4 4 34

Comparative Analysis of Components of PARTNERSHIPS / COLLABORATIONS Key Performance Dimension of

Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

PARTNERSHIPS / COLLABORATIONS

7 7

Productive partnerships

√ 2 √ 2 √ 4

Research collaborations / partnerships

√ 1 √ √ √ 7 8

Government / Business

TOTAL 7 3 2 7 19

Comparative Analysis of Components of STAKEHOLDERS ENGAGEMENT Key Performance Dimension of Institutions

KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

STAKEHOLDERS ENGAGEMENT

√ 9 9

Promote use of research and scholarship by external community

International students & alumni network

Employers Perception

Professional development training for business

Alumni √ 2 2 TOTAL 9 2 11

Comparative Analysis of Components of SOCIAL / SOCIETY Key Performance Dimension of Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

SOCIAL / SOCIETY

4 1 1

Societal needs √ 2 √ √ 6 8 Community needs √ 2 √ √ 6 8 Non degree courses and programs for society

√ √ 5 5

University image √ 2 √ 7 9 Graduates equipped to contribute

√ 2 2

TOTAL 8 1 24 33

Comparative Analysis of Components of ENVIRONMENTAL KEY Performance Dimension of Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

ENVIRONMENTAL Sustainability √ 2 √ 4 √ 1 7 “Green” campus √ 1 √ 7 √ 8 TOTAL 3 4 7 1 15

Comparative Analysis of Components of INNOVATION Key Performance Dimension of Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

INNOVATION 1 3 √ 4 7 Innovations 1 5 5 Recognized leader Innovation Culture √ TOTAL 5 3 4 12

Comparative Analysis of Components of ACCESS / AFFORDABILITY Key Performance Dimension of Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

ACCESS / AFFORDABILITY

4

Access √ 1 1 Affordability √ 5 5 Selective investment in campus

TOTAL 6 6

Comparative Analysis of Components of DIVERSITY Key Performance Dimension of Institutions KPIs

Key Performance Dimensions

Han

ov

er

Res

earc

h

CU

C

Rep

ort

Pen

n S

tate

Bal

l S

tate

Bin

gh

amto

n

U.

U o

f

To

ron

to.

Un

iv. o

f

Gre

enw

ich

Man

ches

ter

Met

rop

oli

tan

U.

Man

ches

ter

Sta

te U

niv

.

Lan

cast

er U

.

No

rth

ern

Illi

nois

Un

iv.

U o

f

Wo

llong

ong

Qat

ar U

.

TO

TA

L

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

# O

bjs

.

# K

PIs

DIVERSITY √ 9 1 9 18 TOTAL 9 9 18

Appendix 6 Comparative Analysis of KSU’s Benchmarked Universities

In the KSU 2030 “Towards Excellence” Strategic Plan, 10 universities were selected as

benchmarks for the development of the KSU 2030. This part of the qualitative research

will try to identify the “Strategic Plan and strategic KPIs” of these benchmarked

universities.

Research aim: Identify the strategic KPIs of these 10 benchmarked universities

Research Methodology: The main page website of the universities was accessed to

determine the existence of any “strategic plan” or “strategic KPIs” of the institution.

Research Findings: (Tables 6.1 and 6.2)

1. Of the benchmarked universities, only University of California has a longer term strategic plan in 3 focused areas of Responsive Research, Teaching and Public Services, Expanded Pathways for Access and Success and Engaging and Healthy Campus Climate with (10 Strategic KPIs and 60 Specific KPIs)

2. 4 universities namely Oxford, Tokyo and University of Southern California has Strategic Plan but with no KPIs

3. The 5 remaining universities of Stanford, MIT, Harvard, Cambridge and NUS has no evidence of an institutional strategic plan, but do have strategic plans for by schools or administrative units. Only Tsinghua has no evidence of any type of strategic plan at all.

4. For the universities that have strategic plans, their focus areas are typical of those as shown in Appendix 4 Table 4.2 in the 12 key categorical areas.

5. Most of them do have facts sheets or statistical data to provide an overall view of the institution profile of its key statistics like those shown in Table 6.2 for Stanford, Oxford, UC Berkeley and U of Southern California.

Due to the limitations of the availability of the strategic plans and strategic KPIs of these

benchmarked universities, the basis of the determination of the strategic KPIs would be

based on the 2 major research reports and 11 selected universities for further study

(Appendix 4)

Table 6.1 Overall findings of benchmarked universities’ strategic plan and KPIs

Universities with no Institutional Strategic Plan or KPI but has some schools / administrative units plans

Universities with Strategic Plan only with NO KPIs

Universities with Strategic Plan and KPIs

Stanford University but has strategic plan by some schools

Oxford University University of California Berkeley

Massachusetts Institute of Technology but has strategic plan by some schools

University of Tokyo

Harvard University but has strategic plan by some schools

University of Southern California (old 2004 strategic plan)

Cambridge University but has strategic plan by some schools

Tsinghua University National University of Singapore but has strategic plan for administrative units

Table 6.2 Detailed findings of benchmarked universities’ strategic plan and KPIs

Benchmarked Universities

Strategic Plan Strategic KPIs

Stanford University No result on Strategic Plan but has one on Stanford University School of Medicine (2002 – 2004)

Stanford University School of Medicine has on Prioritized initiatives (with no specifications of KPIs but scheduled projects / programs in:

Medical Education with 5 sub-priorities

Graduate Education with 7 sub-priorities

Postdoctoral Training with 7 sub-priorities

Research with 8 sub-priorities

Clinical Care with 3 sub-priorities

Professoriate with 3 sub-priorities

Finance and Administration with 2 sub-priorities

Information Resources and Technology with 3 sub-priorities

Advocacy, Public Policy and Philanthropy with 8 sub-priorities

Stanford University at a glance

Student enrollment – undergraduate and graduate

Campus

Endowment

Research – external and total

leadership

Established 1885; opened 1891

Faculty: faculty student ratio Seven schools

Massachusetts Institute of Technology

No result on MIT Strategic Plan shows but show Results of MIT DUE (Undergraduate Program) and others mainly administrative units

MIT DUE Catalyze the Undergraduate Commons to define the

next generation of MIT student – 6 Objectives and 18 KPIs

Champion Information Technology (IT) for the provision of information to the students and faculty – 2 (+ 5 in Phase 2) Objectives and 3 (8 in Phase 2) KPIs

Develop a holistic student experience to produce leaders for the future – 4 Objectives and 6 KPIs

Transforming Learning through Research, Best Practices and Innovations in Pedagogy, Curricular Materials and Assessment – 3 Objectives and 6 KPIs

Harvard University No result on Strategic Plan shows but show Results of Strategic Plan by schools and admin units e.g. Harvard Medical School, Harvard Library and Harvard IT

HMS and HMDS Strategic Plan (Joint Committee on Status of Women) 2012 – 2016

Organizational Efficiency and Institutional Memory – 8 Objectives and 13 KPIs including 5 on Partnerships / Outreach / Collaborations

Career Satisfaction and Advocacy – 4 Objectives and 4 KPIs

Oxford University Result on Strategic Plan shows “Strategic Plan 2013 – 2018”

University of Oxford (2013 – 2018) has 2 overarching priorities 4 core strategies and 12 commitments and 5 enabling strategies and no specified KPIs but with 78 actions Overarching Priorities

Priority 1 – Global reach

Priority 2 – Networking, communications and interdisciplinary

Core Strategies

Research (3 commitments) Education (3 commitments)

Widening engagement (3 commitments)

Personnel (3 commitments) Enabling strategies

Finance, capital and value for money (2 enabling strategies)

Estates (1 enabling strategy)

IT infrastructure (1 enabling strategy)

Alumni relations and development (1 enabling strategy)

Oxford University Facts and Figures

Oxford at a glance

Undergraduate admissions and access

Financial support for undergraduates

Postgraduate admissions and support

Oxford international

Oxford research

Oxford awards and rankings

Oxford finance

Oxford colleges

Museums, collections and libraries

Cambridge University

No University Strategic Plan was evident but two documents on U of C T & L Strategy 2012 – 2015 and U of C School of Technology 2012 – 2017 found

University of Cambridge Learning and Teaching Strategy 2012 – 2015 Action Plans

Educational and Student Policy (with 8 aims)

Student Support (with 2 aims)

Undergraduate Provision (with 3 aims) Postgraduate Provision – Ph.D. (with 2 aims)

Postgraduate Provision – Masters (with 2 aims)

Lifelong Learning (with 2 aims)

Communication and Engagement (with 3 aims) University of Cambridge School of Technology 2013 – 2017

1. Objective 1 – Maintain and enhance the outstanding research undertaken by departments within the School (14 Actions and 4 KPIs)

2. Objective 2 – Recruit the best researchers (research students and post-doctoral staff) both nationally and internationally, giving them an excellent training in research and preparing them for a range of employment opportunities (14 Actions and 4 KPIs)

3. Objective 3 – Increase the provision for high-quality Master’s students in strategic areas across the School, addressing the learning needs of postgraduates, innovating and adapting as

necessary, taking a collaborative approach where appropriate to ensure efficient use of resources (10 Actions and 2 KPIs)

4. Objective 4 – Continuing the development of undergraduate education within the School through (a) inspiring lectures, (b) innovative laboratory exercises and mini-projects, (c) close coordination between the teaching in Departments and Colleges, (d) opportunities to experience the creative side of technology design. Some departments in School also wish to explore the links between departments and shared courses (both inside and outside school) that enhance the educational experience, and (f) efficient delivery, such as large class sizes or e-learning resources which do not compromise quality (15 Actions and 4 KPIs)

5. Objective 5 – to be an international leading provider in executive and professional education through the further development of:

a. Distinctive and compelling market offerings, reflecting the breadth and depth of the School’s expertize

b. Capability and capacity to develop and deliver world-class executive and professional education

c. Rigorous underpinning of course design and quality assurance framework

6. Objective 6 – Enhance and where appropriate, enlarge the School’s estate to achieve the objectives (16 Actions and 2 KPIs)

Tsinghua University No result on Strategic Plan or strategic KPIs

University of Tokyo Result on Strategic Plan shows Strategic Plan called “FOREST 2015”

University of Tokyo (FOREST 2015) with actions and initiatives and no KPIs

Ensure Academic diversity and Pursue Excellence (with 4 objectives, 4 main initiatives and 15 sub-initiatives)

Build a truly global campus Excellence (with 4 objectives, 5 main initiatives and 21 sub-initiatives)

Further develop collaboration with Society: from “Contributing knowledge to society” to “Joint creation of knowledge with society” (with 3 objectives, 5 main initiatives and 16 sub-initiatives)

Develop Todai Students with intellectual toughness and personal resilience (with 4 objectives, 5 main initiatives and 26 sub-initiatives)

Enhance Faculty Educational skills and sustain academic vigor (with 4 objectives, 4 main initiatives and 14 sub-initiatives)

Train administrative staffs as professionals (with 5 objectives, 5 main initiatives and 19 sub-initiatives)

Build a close-knit network with our alumni (with 3 objectives, 5 main initiatives and 14 sub-initiatives)

Enhance agility of management and reinforce the university’s foundations (with 6 objectives, 7 main initiatives and 27 sub-initiatives)

Reinforce Governance, compliance and environmental safety (with 4 objectives, 6 main initiatives and 22 sub-initiatives)

National University of Singapore

No result on Strategic Plan but shows Vision, Mission and Strategy with no KPIs

Have Corporate Information

Student body Class of 2013

Faculty and Staff Has Service Commitment KPIs on: NUS Service, Admission, Academic Administration, Student Learning Support, IT Support, Student Development and Non-Academic Services

University of California Berkeley

Result on Strategic Plan shows Strategic plan with KPIs

UC Berkeley Pathway to Excellence 2020 Responsive Research, Teaching and Public Services

(3 Strategic KPIs and 11 Specific KPIs) Expanded Pathways for Access and Success (3

Strategic KPIs and 40 Specific KPIs including Community College [6KPIs] /Undergraduate [8 KPIs] / PGR [7 KPIs] / Faculty [7 KPIs] / Staff [12 KPIs])

Engaging and Healthy Campus Climate (4 Strategic KPIs and 9 Specific KPIs)

Have UC Berkeley “Facts at a Glance” on:

Student body Number of students Undergraduate gender Graduate gender Degrees granted in 2012-13 Enrollment by ethnicity (Fall 2011) Student profiles: Undergraduate Graduate

Faculty Student-to-faculty ratio: 17 to 1 Undergraduate classes with fewer than 30 students: 77%

Profile of admitted freshmen

Fields of study Most popular majors Courses offered:

Measures of excellence Rankings:

Public service by students

Tuition, fees & financial aid Average undergraduate student budget Average graduate student budget

Campus budget & finances Market value of endowment

Research

Libraries and museums

Athletics Alumni

University of Southern California

Has old Strategic Plan of 2004 and new Strategic Vision: Matching Deeds to Ambitions with no strategic KPIs

Have USC Fact and Figures sheet on: Students Student Demographics

International Students

Freshman Class Freshman Profile and Admission Information 2012-13

Degrees Awarded Faculty and Alumni Academic Units

Undergraduate Tuition and Mandatory Fees

Financial Aid Expenditures Endowment University Budget Sponsored Research

University Annual Financial Reports

Appendix 7: Expert opinion on the determination of final 20 KSU Strategic KPIs

Once the proposed 32 Strategic KPIs were identified through the secondary research

review in the context of leading research reports, the KSU 2030 Strategic Plan and the

university benchmarked universities, and the 11 universities that have strategic plans and

strategic KPIs, it also underwent another reduction process through expert opinions.

These expert opinions represented 3 Saudi administrators and 3 consultants in the

quality assurance areas. They were asked to select 20 main strategic KPIs that they

opinioned are to be used as the strategic KPIs for KSU and the result are shown in Table

7.1. These 20 selected strategic KSU KPIs are then mapped back into Table 3.2. The final

proposed 20 Strategic KSU KI as shown in Table 1 in the main research report. The

frequencies of occurrences and its numbers of KPIs are:

2 KPIs with 6 frequencies showed unanimous opinion of importance and

inclusion that should be included as the final 20 KSU strategic KPIs;

7 KPIs with 5 frequencies showed opinion of high level of importance and

inclusion that should be included as the final 20 KSU strategic KPIs;

9 KPIs with 4 frequencies showed opinion of moderately high level of

importance and inclusion that should be included as the final 20 KSU strategic

KPIs; and

8 KPIs with 3 frequencies showed opinion of neutrality in level of importance

and inclusion that should be included as the final 20 KSU strategic KPIs;

As the intention was to select 20 KSU Strategic KPIs, the expert opinion group

shortlisted a final set of 18 Strategic KPIs based on frequencies of occurrences that are of

a high to moderately high level of importance and inclusion, it is recommended that

these will be the final set of 18 KSU Strategic KPIs. Those 8 KPIS with 3 frequencies of

occurrences would not be included in this final set. Basically the key results were ranked

in terms of their frequencies as follows:

Table 7.1: KPIs with the 6 frequencies of occurrences

Proposed Strategic KPIs for KSU that measures strategic

performance

EO 1 EO 2 EO 3 EO 4 EO 5 EO 6 Total

10.5.1 Number of refereed publications in the previous year per full time equivalent member of teaching staff. (Publications based on the formula in the Higher Council Bylaw excluding conference presentations) (NCAAA 26 - Ratio average and Level achieved)

√ √ √ √ √ 6

3.6.2 Percentage of the full-time faculty members obtaining academic or professional awards at the national or international level. (%)

√ √ √ √ √ √ 6

Table 7.2: KPIs with the 5 frequencies of occurrences

Proposed Strategic KPIs for KSU that measures strategic

performance

EO 1 EO 2 EO 3 EO 4 EO 5 EO 6 Total

% of students involved with university community events

√ √ √ √ √ 5

Endowment Per FTE faculty / staff √ √ √ √ √ 5

4.12.3 Proportion of students entering undergraduate programs who complete those programs in minimum time (NCAAA 9 - Means average and Level achieved)

√ √ √ √ √ 5

10.5.2 Number of citations in refereed journals in the previous year per full time equivalent teaching staff. (NCAAA 27 - Ratio average and Level achieved)

√ √ √ √ √ 5

10.5.6 Ratio of external research and innovation funds in proportion to the total number of full-time faculty members (NCAAA 30 - Ratio average and Level achieved)

√ √ √ √ √ 5

Faculty Student Ratio (Comparisons with Peers / with mean of Peers / Ratios Using Different Faculty Inclusions –based on Faculty FTE)

√ √ √ √ √ 5

11.4.3 Proportion of full time teaching and other staff actively engaged in community service activities (NCAAA 32 - Ratio average and Level achieved)

√ √ √ √ √ 5

Table 7.3: KPIs with the 4 frequencies of occurrences

Proposed Strategic KPIs for KSU that measures strategic

performance

EO 1 EO 2 EO 3 EO 4 EO 5 EO 6 Total

Student satisfaction with university life experience

√ √ √ √ 4

Retention and Graduation Time Series for undergraduate and PGs

√ √ √ √ 4

10.5.5 Ratio of internal research and innovation funds in proportion to the total number of full-time faculty members

√ √ √ √ 4

% of faculty who get research grant / contract funding

√ √ √ √ 4

9.5.2 Percentage of full-time faculty members participating in professional development activities during the past year (NCAAA 25 – Ratio average and Level achieved)

√ √ √ √ 4

Number of international visiting faculty scholar

√ √ √ √ 4

11.4.1 Evaluation of satisfaction of employers/ business operators/ users of graduates /alumni /parents/ graduates on competency of graduates (Means average and Level achieved based on survey)

√ √ √ √ 4

% of support staff who participated in professional developmental activities related to their work area

√ √ √ √ 4

# of signed and effective MOUs

√ √ √ √ 4

Table 7.4: KPIs with the 3 frequencies of occurrences

Proposed Strategic KPIs for KSU that measures strategic

performance

EO 1 EO 2 EO 3 EO 4 EO 5 EO 6 Total

% of internal / external clients “satisfied” or “strongly satisfied” with services by all functional units (finance, IT, HR, procurement, Business operation, Housing, Student services, Library, External relations, Institutional research)

√ √ √ 3

3.6.1 Percentage of students graduated in the last 3 years who are recognized in the areas of academics, or profession, or contribution to society at the national or international level (%)

√ √ √ 3

4.12.5 Students overall rating on the quality of their courses (Average rating of students on a 5 point scale overall evaluation of courses) (NCAAA 6 - Means average and Level achieved based on survey)

√ √ √ 3

% of faculty / staff involved with university community events

√ √ √ 3

10.5.3 Proportion of full time member of teaching staff with at least one refereed publications during the previous year (NCAAA 28 - Ratio average and Level achieved)

√ √ √ 3

Percentage of Total Undergraduate Enrollment by International Status

√ √ √ 3

Percentage of Total Undergraduate / Graduate Enrollment by International Status

√ √ √ 3

% increase in # of new technologies / patents / intellectual property

√ √ √ 3

Table 7.5: Frequencies of occurrences of KPIs selected

Proposed Strategic KPIs for KSU that measures strategic

performance

EO 1 EO 2 EO 3 EO 4 EO 5 EO 6 Total

% of internal / external clients “satisfied” or “strongly satisfied” with services by all functional units (finance, IT, HR, procurement, Business operation, Housing, Student services, Library, External relations, Institutional research)

√ √ √ 3

Teaching and Research Space as a

proportion of Total Space

√ 1

Student satisfaction with university life experience

√ √ √ √ 4

Retention and Graduation Time Series for undergraduate and PGs

√ √ √ √ 4

3.6.1 Percentage of students graduated in the last 3 years who are recognized in the areas of academics, or profession, or contribution to society at the national or international level (%)

√ √ √ 3

4.12.3 Proportion of students entering undergraduate programs who complete those programs in minimum time (NCAAA 9 - Means average and Level achieved)

√ √ √ √ √ 5

4.12.5 Students overall rating on the quality of their courses (Average rating of students on a 5 point scale overall evaluation of courses) (NCAAA 6 - Means average and Level achieved based on survey)

√ √ √ 3

% of students involved with university community events

√ √ √ √ √ 5

% of faculty / staff involved with √ √ √ 3

university community events

Endowment Per FTE faculty / staff √ √ √ √ √ 5

Total auxiliary and other revenue generated

√ √ √ 3

10.5.1 Number of refereed publications in the previous year per full time equivalent member of teaching staff. (Publications based on the formula in the Higher Council Bylaw excluding conference presentations) (NCAAA 26 - Ratio average and Level achieved)

√ √ √ √ √ √ 6

10.5.2 Number of citations in refereed journals in the previous year per full time equivalent teaching staff. (NCAAA 27 - Ratio average and Level achieved)

√ √ √ √ √ 5

10.5.3 Proportion of full time member of teaching staff with at least one refereed publications during the previous year (NCAAA 28 - Ratio average and Level achieved)

√ √ √ 3

10.5.5 Ratio of internal research and innovation funds in proportion to the total number of full-time faculty members

√ √ √ √ 4

10.5.6 Ratio of external research and innovation funds in proportion to the total number of full-time faculty members (NCAAA 30 - Ratio average and Level achieved)

√ √ √ √ √ 5

PGR research performance in publications, presentations and posters

√ √ 2

% of faculty who get research grant / contract funding

√ √ √ √ 4

% of public who are “strongly or very satisfied” with academic standard demonstrated by university

√ 1

Faculty Student Ratio (Comparisons with Peers / with mean of Peers / Ratios Using Different Faculty Inclusions –based on Faculty FTE)

√ √ √ √ √ 5

Graduate Enrolment as a Percentage of Total Enrolment

√ √ 2

3.6.2 Percentage of the full-time faculty members obtaining academic or professional awards at the national

√ √ √ √ √ √ 6

or international level. (%)

9.5.2 Percentage of full-time faculty members participating in professional development activities during the past year (NCAAA 25 – Ratio average and Level achieved)

√ √ √ √ 4

% of support staff who participated in professional developmental activities related to their work area

√ √ √ √ 4

Percentage of students participating in Education Abroad

√ √ 2

Number of international visiting faculty scholar

√ √ √ √ 4

Percentage of Total Undergraduate Enrollment by International Status

√ √ √ 3

Percentage of Total Undergraduate / Graduate Enrollment by International Status

√ √ √ 3

11.4.1 Evaluation of satisfaction of employers/ business operators/ users of graduates /alumni /parents/ graduates on competency of graduates (Means average and Level achieved based on survey)

√ √ √ √ 4

11.4.3 Proportion of full time teaching and other staff actively engaged in community service activities (NCAAA 32 - Ratio average and Level achieved)

√ √ √ √ √ 5

# of signed and effective MOUs

√ √ √ √ 4

% increase in # of new technologies / patents / intellectual property

√ √ √ 3

Total # of Proposed Strategic KPIs for KSU = 32 KPIs

Appendix 8: Determination of performance of Colleges and Programs using the KSU – QMS

Introduction

The basic principle behind performance assessment is to provide a snap shot at a point of time of “what and how” the college or programs are managing their quality towards continuous improvements over a period of time. The KSU – QMS provides this basis of performance assessment, based on its performance scoring of 1000 points and 56 KPIs across the 11 Standards that are critical to providing a holistic and objective picture of quality management performance.

The KSU – QMS which started its implementation in September 2013 has the aim for full implementation by all 21 Colleges and 86 Baccalaureate Programs by December 2016 coupled with the introduction E-QMS by December 2016 to support its continuous improvements practices. The KSU – QMS is intended to provide an objective assessment of quality management of its internal processes focused on key performance results of its performance scoring and KPIs. The use of the KSU – QMS to provide an objective determination of performance of the Colleges and the Programs based on the KSU – QMS performance scoring and KPIs with its full-fledged Internal Benchmarking System will be divided into 3 phases as shown in Figure 1:

IDPerformance Determination

PhasesStart Finish Duration

Q1 14 Q2 14 Q3 14 Q4 14 Q1 15 Q2 15 Q3 15 Q4 15 Q1 16 Q2 16 Q3 16 Q4 16

Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec

1 102.8w31/12/201513/1/2014

Phase 1: Academic Performance

Award based on KSU – QMS

KPI (6 KPIs)

2 104.4w30/12/20161/1/2015

Phase 2: College / Program

Performance Comparison and

Ranking based on KSU – QMS

KPI (15 KPIs)

3 104.2w29/12/20171/1/2016

Phase 3: Full Performance

Comparison and Ranking based

on KSU – QMS Performance

Scoring and KPIs (Internal

Benchmarking System)

Figure 1: Phases of Implementation of KSU – QMS Internal Benchmarking System

I. Phase 1 Use of KPIs from KSU – QMS as determinants of “Award” evaluation

In the initial Phase 1, 7 KPIs (which are more readily available and computable due to data availability) from the KSU – QMS will used as determinants of the “Academic Performance Award” established by the Rector of KSU to be awarded to well performing colleges in the academic area. The 7 KPIs that can provide an objective evaluation and assessment of academic performance selected on the basis of: 1) Student focused KPIs and 2) Faculty focused KPIs are:

Student Focused KPIs

3.6.1 Percentage of students graduated in the last 3 years who are recognized in the areas of academics, or profession, or contribution to society at the national or international level (%)

4.12.3 Proportion of students entering undergraduate programs who complete those programs in minimum time (NCAAA 9 - Means average and Level achieved)

4.12.5 Students overall rating on the quality of their courses (Average rating of students on a 5 point scale overall evaluation of courses) (NCAAA 6 - Means average and Level achieved based on survey)

4.12.9 Percentage of students entering programs who successfully complete first year (NCAAA 8 - Means average and Level achieved)

Faculty Focused KPIs

3.6.2 Percentage of the full-time faculty members obtaining academic or professional awards at the national or international level. (%)

9.5.1 Proportion of teaching staff leaving the institution in the past year for reasons other than age retirement (NCAAA 24 – Ratio average and Level achieved)

9.5.2 Percentage of full-time faculty members participating in professional development activities during the past year (NCAAA 25 – Ratio average and Level achieved)

While the Proposal for the “Academic Performance Award” has 8 criteria used as the basis to select the College for the Award, there are some key issues faced with these Criteria as follows:

Criteria Potential Issues

1. Readiness of College at beginning of Academic Year

This criterion tends to be rather subjective as there are many uncontrollable factors beyond the control of the College. These factors are like size of the College, number of students, external readiness of other support units, etc., etc.

2. Student Satisfaction of College Rather than determining the overall College, the determination of satisfaction of the course evaluation specific to the course would be better scoped as compared to the multifarious factors that affects the College and needs another new survey instrument. It is better to scope it to the course evaluation of the faculty.

3. Evaluation of Faculty Performance by Student

A lot of variables like workload, expertise and experience, learning resources that affect Faculty Performance might not be known to the students. It is better scoped to the course evaluation of the faculty as in Criterion 2.

4. Workshops, seminars and activities in the college

Too diverse and too complicated to measures due to the different nature, size and needs of these workshops, seminars and activities which varies across the colleges.

5. % of electronic course Having a great number of electronic courses does not mean better performance. The % only shows the use of IT to facilitate course instructions rather than evaluate college / faculty performance.

6. % of faculty who finalize Course Reports

The performance is in the use of the Course Reports to bring about continuous improvements or informed decision making, rather than evaluation of college / faculty performance.

7. % of faculty who finalize Course Specifications

Course Specifications of the course in itself as they do not show performance unless the courses are delivered and measured for performance as per the specifications in terms of teaching pedagogy, teaching assessment, feedbacks and course management.

8. % of academic programs that acquired accreditation (national and international)

About 78 of the 86programs have attained international accreditation, and the use of this would be biased towards a college with 1 program as opposed to another college with 8 programs which is inequitable.

Conclusion for Phase 1

The Deanship of Quality would recommend the use of the 7 selected KSU – QMS KPIs as the basis for the objective evaluation of performance for the selection of the College for the Rector’s “Academic Performance Award”. (Appendix 1)

II. Phase 2 Use of KPIs from KSU – QMS as determinants of College Ranking and Performance

In determining the performance of the Colleges / Programs for 1) ranking purposes, or as the basis for 2) allocation of resources, or 3) informed decision making on critical actions to be made, the KSU – QMS also present the same rational of the use of the KPIs to justify the performance determinants and informed decision making. While the KSU – QMS is implemented by 50 % of the colleges / programs by December 2015, the potential to use these KSU – QMS KPIs for comparative performance assessment leading to informed decision making is very high. These selected KPIs can be computed as they are supported by the performance metrics system in its computation of the KPIs. The key areas inclusive of the 7 KPIs in Phase 1, can include the 1) Research Focus and the 2) Community Service, all of these 4 areas underscore the key mission of the College in Teaching, Learning, research and Services to Society. The 14 KPIs in these 4 key performance areas that subscribe to the College performance and achievements of its mission are:

Student Focused KPIs

3.6.1 Percentage of students graduated in the last 3 years who are recognized in the areas of academics, or profession, or contribution to society at the national or international level (%)

4.12.3 Proportion of students entering undergraduate programs who complete those programs in minimum time (NCAAA 9 - Means average and Level achieved)

4.12.5 Students overall rating on the quality of their courses (Average rating of students on a 5 point scale overall evaluation of courses) (NCAAA 6 - Means average and Level achieved based on survey)

4.12.9 Percentage of students entering programs who successfully complete first year (NCAAA 8 - Means average and Level achieved)

Faculty Focused KPIs

3.6.2 Percentage of the full-time faculty members obtaining academic or professional awards at the national or international level. (%)

9.5.1 Proportion of teaching staff leaving the institution in the past year for reasons other than age retirement (NCAAA 24 – Ratio average and Level achieved)

9.5.2 Percentage of full-time faculty members participating in professional development activities during the past year (NCAAA 25 – Ratio average and Level achieved)

Research Focused KPIs

10.5.1 Number of refereed publications in the previous year per full time equivalent member of teaching staff. (Publications based on the formula in the Higher Council Bylaw excluding conference presentations) (NCAAA 26 - Ratio average and Level achieved)

10.5.2 Number of citations in refereed journals in the previous year per full time equivalent teaching staff. (NCAAA 27 - Ratio average and Level achieved)

10.5.3 Proportion of full time member of teaching staff with at least one refereed publications during the previous year (NCAAA 28 - Ratio average and Level achieved)

10.5.5 Ratio of internal research and innovation funds in proportion to the total number of full-time faculty members

10.5.6 Ratio of external research and innovation funds in proportion to the total number of full-time faculty members (NCAAA 30 - Ratio average and Level achieved)

Stakeholders Satisfaction and Community Service KPIs

11.4.1 Evaluation of satisfaction of employers/ business operators/ users of graduates /alumni /parents/ graduates on competency of graduates (Means average and Level achieved based on survey)

11.4.3 Proportion of full time teaching and other staff actively engaged in community service activities (NCAAA 32 - Ratio average and Level achieved)

Conclusion for Phase 2

The Deanship of Quality would recommend the use of these 14 KSU – QMS KPIs for comparative and evaluative performance assessment of the Colleges or Programs for informed decision making leading to “ranking” of colleges or programs and allocation of resources. (Appendix 2)

III. Phase 3 Use of KSU – QMS for holistic Internal Benchmarking

With the full input of the data from the support systems via the E-QMS for KPI computation by December 2016, and with 100% of the Colleges and Programs having implemented the KSU – QMS, KSU is ready to apply the KSU – QMS for Internal Benchmarking for comparative and evaluative performance. These internal benchmarks is based on the internal audit and assessment of the overall evaluation and assessments of the KSU – QMS 11 Standards and 58 core processes on 1000 points and the 56 KPIs.

The full mechanisms on the different types of performance analysis are described and illustrated in the attached KSU – QMS Internal Benchmarking System (December 2013) which will be used as of December 2016 for comparative and evaluation quality and performance management.

Conclusion for Phase 3

The Deanship of Quality would recommend the use of the full KSU – QMS Internal benchmarking System for comparative and evaluative performance assessment of the Colleges or Programs for informed decision making leading to “ranking” of colleges or programs and allocation of resources, or as needs dictates. (Appendix on KSU – QMS Internal Benchmarking System)