Measurement of information and communication technology experience and attitudes to e-learning of...

Post on 19-Jan-2023

0 views 0 download

Transcript of Measurement of information and communication technology experience and attitudes to e-learning of...

REVIEW PAPER

Measurement of information and communication technology

experience and attitudes to e-learning of students in the healthcare

professions: integrative review

Ann Wilkinson, Alison E. While & Julia Roberts

Accepted for publication 17 November 2008

Correspondence to A. Wilkinson:

e-mail: Ann.wilkinson@kcl.ac.uk

Ann Wilkinson BA MPhil RSW

Lecturer in Learning Technology

King’s College London, Florence Nightingale

School of Nursing and Midwifery, UK

Alison E While BSc PhD RN

Professor of Community Nursing

King’s College London, Florence Nightingale

School of Nursing and Midwifery, UK

Julia Roberts PhD RN RCNT

Senior Lecturer

Head of Department of Specialist Care,

King’s College London, Florence Nightingale

School of Nursing and Midwifery, UK

WILKINSON A., WHILE A.E.WILKINSON A., WHILE A.E. & ROBERTS J . (2009)ROBERTS J . (2009) Measurement of informa-

tion and communication technology experience and attitudes to e-learning of

students in the healthcare professions: integrative review. Journal of Advanced

Nursing 65(4), 755–772

doi: 10.1111/j.1365-2648.2008.04924.x

AbstractTitle. Measurement of information and communication technology experience and

attitudes to e-learning of students in the healthcare professions: integrative review.

Aim. This paper is a report of a review to describe and discuss the psychometric

properties of instruments used in healthcare education settings measuring expe-

rience and attitudes of healthcare students regarding their information and

communication technology skills and their use of computers and the Internet for

education.

Background. Healthcare professionals are expected to be computer and infor-

mation literate at registration. A previous review of evaluative studies of com-

puter-based learning suggests that methods of measuring learners’ attitudes to

computers and computer aided learning are problematic.

Data sources. A search of eight health and social science databases located 49

papers, the majority published between 1995 and January 2007, focusing on the

experience and attitudes of students in the healthcare professions towards com-

puters and e-learning.

Review methods. An integrative approach was adopted, with narrative descrip-

tion of findings. Criteria for inclusion were quantitative studies using survey tools

with samples of healthcare students and concerning computer and information

literacy skills, access to computers, experience with computers and use of com-

puters and the Internet for education purposes.

Results. Since the 1980s a number of instruments have been developed, mostly in

the United States of America, to measure attitudes to computers, anxiety about

computer use, information and communication technology skills, satisfaction and

more recently attitudes to the Internet and computers for education. The

psychometric properties are poorly described.

Conclusion. Advances in computers and technology mean that many earlier tools

are no longer valid. Measures of the experience and attitudes of healthcare

� 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd 755

J A N JOURNAL OF ADVANCED NURSING

students to the increased use of e-learning require development in line with

computer and technology advances.

Keywords: attitudes, e-learning, experience, health professions education,

information and communication technology, literature review, measurement,

nurse education

Introduction

Successive reports on emerging technologies relevant to

higher education (New Media Consortium, 2006, 2007,

2008) indicate that the information literacy of students

entering higher education is not improving and that

academics are not keeping pace with the potential of

mobile technologies for education. Universities are expected

to educate healthcare professionals who, at the point of

registration, are computer and information literate. In the

United Kingdom, the Knowledge and Skills Framework

(Department of Health, 2004) requires registered healthcare

professionals to be aware of and keep up-to-date with the

knowledge base of their professions. Core skills include the

ability to use electronic libraries, critically appraise evi-

dence for healthcare, and provide health information for

service users.

Studies worldwide suggest that healthcare professionals are

not confident at the point of qualification. For example, 53%

of graduating Finnish nurses reported positive attitudes to

using IT for nursing but inadequate IT skills for practice

(Saranto et al. 1997). Similarly, a Canadian study (Balen &

Jewesson 2004) showed that registered pharmacists required

additional information and communication technology (ICT)

skills for effective practice. Elsewhere it is reported that

medical students are disadvantaged by poor access to online

knowledge resources needed to improve health outcomes

(Bello et al. 2004, Samuel et al. 2004). A national study of

Australian nurses identified both limited preregistration

training and lack of confidence with computers by Registered

Nurses (Hegney et al. 2006).

A UK literature review of computer-based learning (CBL)

(Lewis et al. 2001) showed that there were difficulties in

measuring students’ attitudes to CBL and no reliable

instruments. In addition, Lewis et al. (2001) and Chum-

ley-Jones et al. (2002) in the United States of America

(USA) noted that there was no good method for differen-

tiating between different learners and that more careful

attention needed to be paid to these variables in future

studies.

The review

Aim

The aim of the review was to describe and discuss the

psychometric properties of instruments used in healthcare

education settings measuring experience and attitudes of

healthcare students’ regarding their ICT skills and their use of

computers and the Internet for education.

Design

A quantitative methodological review using an integrative

approach with narrative description of findings, as described

by Whitemore and Knafl (2005), was chosen to permit the

inclusion of studies using a variety of methods.

Search methods

The literature on computer experience and attitudes is

multidisciplinary; as a consequence, a separate search strategy

was formulated for each of the major bibliographic databases

in health, education and social science (Table 1). There were

three variables of interest: e-learning; attitude and experience;

and the healthcare professions. The search was limited to

papers written in English from 1995 to January 2007. This

timeframe coincides with the transition from small develop-

ments of CBL to ubiquitous Internet and ICTs (Smith 2005)

and worldwide expansion of higher education (Duke 2002,

Cornford & Pollock 2003). Preliminary searches, Zetoc Alerts

and reference tracking yielded earlier studies.

Search outcome

The results (n = 2628) were imported into Endnote and initial

filtering removed duplicates, non-peer reviewed papers, items

about patient education, staff/educator experience, satisfac-

tion studies and measures of learning styles, leaving 292 items

for detailed appraisal (Figure 1). The main exclusion criteria

were: instrument insufficiently described; experimental study

A. Wilkinson et al.

756 � 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd

with no measure of attitudes or experience of students; non-

health; and unpublished. Certain key papers pre-1995 which

provided evidence of a history of scale development (e.g.

Stronge & Brodt 1985, Parks et al. 1986) or instruments from

non-health settings which were adopted for healthcare educa-

tion (e.g. Maurer & Simonson 1984) were included.

Quality appraisal

Quality appraisal of individual studies was not undertaken as

the main purpose of the methodological review was to

determine psychometric properties of instruments. One

instrument has been extensively revalidated (Table 4).

Data abstraction and synthesis

Studies were synthesized under the following subheadings:

country, author and date of publication, study design, sample

and response rate, data collection instrument, number of

items in instrument and psychometric testing properties.

Where substantial data were missing, studies were excluded.

Forty-nine papers remained (Table 2).

Results

The studies originated from North America (n = 26), Europe

(n = 15) and the rest of the world (n = 8). Although there was

evidence that tool development was incremental, with

researchers drawing on previous studies, there was incon-

sistent reporting of the research methods used and it was not

always clear whether the instruments had been validated. The

majority of instruments reported originated in North

America and were derived from those first developed in the

1980s. Three approaches to instrumentation were identified;

first, the development and validation of instruments which

were subsequently used in healthcare education settings

(e.g. Loyd & Gressard 1984, Maurer & Simonson 1984,

Jayasuriya & Caputi 1996); second, those drawing on

previous studies to reproduce or revalidate a refined or

composite instrument (e.g. Agho & Williams 1995, Sinclair

& Gardner 1999, Lynch et al. 2000, Billings et al. 2001,

Cragg et al. 2003, DeBourgh 2003, Brumini et al. 2005, Sit

et al. 2005, Maag 2006); and, third, a small number of

instruments were author-created (e.g. Hollander 1999, Ray

& Hannigan 1999, Dorup, 2004; Balen & Jewesson 2004,

Bello et al. 2004).

Combined results of database searches (n = 2628)

Excluded (n = 2336)

Patient education, Staff/Faculty experience Satisfaction studies Measures of learning styles Qualitative studies Clinical education Simulation studies

Studies for evaluation (n = 292)

Included for review (n = 49)

Excluded (n = 247)

Instrument insufficiently described Experimental designs Non health discipline Unpublished

Figure 1 Selection of papers for review.

Table 1 Keywords used in database searches

Database Keywords

CINAHL Internet, World Wide Web, Information Technology,

Computers and Computerization’, computer literacy,

exp computerized educational testing or computerized

adaptive testing, Computer Environment, Computer

Assisted Instruction, virtual learning, VLE, (web-based

learning or web-based learning), (online adj3 learning),

(e-learning or elearning), (electronic adj3 learning),

(computer$ adj3 learn$), confidence, Fear, anxiety

or anticipatory anxiety, Aptitude, access to information

or remote access to information, expectation$, student

attitudes or student satisfaction, nursing education,

midwifery education, education, allied health or

education, dental hygiene or education, occupational

therapy or education, physical therapy or education,

physician assistants or education, social work

Specific search strategies were developed for BNI, Medline, ERIC,

BEI, AEI Web of Knowledge (ISI), PsycINFO and these may be

requested from the corresponding author.

JAN: REVIEW PAPER Literature review measurement tools

� 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd 757

Table

2In

stru

men

tsm

easu

ring

info

rmati

on

and

com

munic

ati

on

tech

nolo

gy

(IC

T)

skil

ls,

att

itude

toIC

Tand

ICT

for

educa

tion

Co.

Fir

st

Auth

or

(date

)

Stu

dy

des

ign

Sam

ple

,re

sponse

rate

Data

coll

ecti

on

inst

rum

ent

Item

sPsy

chom

etri

cte

stin

gpro

per

ties

US

Maure

r

(1984)

Surv

eyT

est–

rete

stC

olleg

est

uden

ts

(n=

25).

Surv

ey6

norm

gro

ups

Sta

teof

Iow

a

Com

pute

rA

nxie

tyIn

dex

(CA

IN).

Dev

elop

and

validate

ate

stof

com

pute

ranxie

ty

26

Tes

t–re

test

reliabilit

yr

=0Æ9

.

Inte

rnal

consi

sten

cy(I

C)

a=

0Æ9

4

US

Str

onge

(1985)

Surv

eyN

urs

ing

studen

ts(n

=48)

80%

resp

onse

Nurs

es’

att

itudes

tow

ard

sco

mpute

risa

tion

dev

elopm

ent

and

validati

on

of

inst

rum

ent

66

Red

uce

dto

20

item

sw

ith

index

of

dis

crim

inati

on

‡0Æ5

0Spea

rman

Bro

wn

spli

thalf

r=

0Æ9

1

US

Park

s

(1986)

Surv

eyN

urs

ing

studen

tsunder

gra

duate

(n=

124),

Mast

er’s

(n=

105),

nurs

eaca

dem

ics

(n=

71).

Sin

gle

univ

ersi

ty

Nurs

esknow

ledge

of

com

pute

rs(N

KC

)

curr

ent

and

des

ired

NK

C21

Usa

ge

7

Conte

nt

vali

dit

yby

panel

(n=

5).

8

com

ponen

tsIC

a=

0Æ9

1–0Æ9

5

US

Sch

wir

ian

(1989)

Surv

eyR

egis

tere

dnurs

es(n

=358)

nurs

ing

studen

ts(n

=353)

Nurs

es’

att

itudes

tow

ard

sco

mpute

risa

tion

(Str

onge

and

Bro

dt)

ques

tionnair

e.

Psy

chom

etri

cte

stin

gof

exis

ting

tool

17

a0Æ9

5fo

rre

fined

17

item

3fa

ctor

tool

wit

hnurs

es.

Thre

eit

ems

did

not

load

onto

any

fact

or

CN

Dover

(1991)

Surv

eyN

on-r

andom

sam

ple

Y3–4

pre

and

post

regis

trati

on

nurs

ing

studen

ts(p

ilot

n=

8;

n=

73).

Sin

gle

univ

ersi

ty

Ques

tionnai

reit

ems

dra

wn

from

pri

or

studie

s.U

sed

for

clin

ical

pra

ctic

e,

adm

inis

trat

ion

and

learn

ing,

com

fort

wit

h

and

use

of

com

pute

rs

142

Item

sam

ended

for

face

vali

dit

yPilot

wit

h8

studen

tsno

furt

her

vali

dati

on

US

Wil

son

(1991)

Surv

eyN

urs

ing

( n=

272)

from

5in

stit

uti

ons

Com

pute

rA

nxie

tyIn

dex

(Maure

rand

Sim

onso

n)

The

effe

ctof

hands-

on

com

pute

rex

per

ience

on

com

pute

ranxie

ty

26

3Fact

ors

reanxie

ty:

posi

tive

use

fuln

ess

(12

item

s);

expre

ssed

fear

of

com

pute

rs

(5it

ems)

;dis

like

and

mis

trust

of

com

pute

rs(9

item

s)

US

Sca

rpa

(1992)

Surv

eyH

osp

ital

Nurs

es(n

=136)

Nurs

es’

Att

itudes

tow

ard

sC

om

pute

risa

tion

(Str

onge

and

Bro

dt)

ques

tionnair

e.

Psy

chom

etri

cte

stin

gof

exis

ting

tool

20

a0Æ9

0.

Fiv

efa

ctors

iden

tified

but

3it

ems

did

not

load

onto

asi

ngle

fact

or

US

Agho

(1995)

Surv

eyR

andom

sam

ple

of

acc

redit

ed

Sch

ools

.

All

ied

hea

lth

studen

ts

Hle

vel

(n=

377)

1.

Maure

r&

Sim

onso

nC

om

pute

rO

pin

ion

Surv

ey(C

OS).

2.

Modifi

edPark

set

al.

Com

pute

rK

now

ledge

Surv

ey(C

KS)

tore

port

att

itudes

toco

mpute

rs

and

gaps

inco

mpute

rli

tera

cy.

1=

26

2=

NR

1.

CO

Sa

=0Æ9

4,

2.

CK

Sa

=0Æ9

5

US

Sto

ckto

n

(1995)

Surv

eyH

osp

ital

nurs

esT

1(n

=391)

45%

resp

onse

T2

(n=

265)

36%

resp

onse

.

Str

onge

&B

rodt

NA

TC

ques

tionnair

e.Pre

post

com

pute

risa

tion

enable

dfa

ctor

analy

sis

and

reli

abil

ity

test

20

T1

a=

0Æ9

3T

2a

=92

Thre

efa

ctors

iden

tified

:C

om

pute

rsand

pati

ent

care

,

Com

pute

rsand

per

sonal

secu

rity

,

Gen

eral

att

itude

AU

Jayasu

riya

(1996)

Surv

eyPhase

1under

graduate

nurs

es

(n=

145)

resp

onse

70%

Phase

2yea

r1

nurs

ing

studen

ts(n

=71)

hosp

ital

nurs

es(n

=99)

Nurs

es’

Com

pute

rA

ttit

udes

Inven

tory

(NC

AT

T)

and

Dam

bro

tsC

om

pute

rA

ttit

ude

Sca

le(C

AT

T)

tote

stco

ncu

rren

tvalidit

yR

efinin

gand

ass

essi

ng

inst

rum

ent

22

a=

0Æ9

5In

stru

men

tre

duce

dfr

om

40

to22

item

sfo

llow

ing

fact

or

anal

ysi

s.

Const

ruct

Com

pute

rA

ttit

udes

mult

idim

ensi

onal

A. Wilkinson et al.

758 � 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd

Table

2(C

onti

nued

)

Co.

Fir

st

Auth

or

(date

)

Stu

dy

des

ign

Sam

ple

,re

sponse

rate

Dat

aco

llec

tion

inst

rum

ent

Item

sPsy

chom

etri

cte

stin

gpro

per

ties

CN

McB

ride

(1996)

Surv

eyR

egis

tere

dnurs

es(n

=394),

42%

resp

onse

;nurs

ing

studen

ts

(n=

299),

60%

resp

onse

.H

osp

ital

and

univ

ersi

ty.

Nurs

es’

Att

itudes

tow

ard

sC

om

pute

risa

tion

(Str

onge

&B

rodt)

ques

tionnair

e.Psy

chom

etri

c

test

ing

of

exis

ting

tool

20

Tw

osu

b-s

cale

sin

studen

tsa

mple

poor

Inte

rnal

Consi

sten

cy.

Fact

or

analy

sis

sugges

ted

pro

ble

ms

wit

hco

nst

ruct

vali

dit

y.a

vari

edbet

wee

nsa

mple

s

and

sub-s

cale

s

US

Wil

liam

s

(1996)

Surv

eyR

andom

sam

ple

of

pro

gra

ms

(n=

5),

physi

oth

erapy

studen

ts(n

=160)

nati

onal

surv

ey

1.

Maure

r&

Sim

onso

nC

om

pute

rO

pin

ion

Surv

ey(C

OS)

2.

Park

set

al.

Com

pute

rK

now

ledge

Surv

ey

(CK

S)O

pin

ions

about

com

pute

rs,

self

ass

essm

ent

of

curr

ent

and

des

ired

know

ledge,

curr

ent

use

26

20

1.

CO

Sa

=0Æ9

4Sin

gle

fact

or

solu

tion

2.

CK

Sa

=0Æ9

5

FI

Sara

nto

(1997)

Surv

eyR

andom

sam

ple

from

nati

onal

cohort

gra

duat

ing

nurs

ing

studen

ts(n

=373)

resp

onse

62%

5part

ques

tionnair

eon

per

cepti

ons

of

learn

ing

envir

onm

ent

(LE

);L

earn

ing

IT(I

T)

and

vie

ws

on

com

pute

risa

tion

inhea

lth

care

(HC

).A

uth

or

dev

eloped

wit

hre

fere

nce

topre

vious

rese

arc

h

15

LE

18

IT

32

HC

Item

analy

sis

afo

rgro

ups

of

item

s

Neg

ati

ve

IT=

0Æ9

;IT

use

ful

=0Æ8

;

+ve

att

itude

tost

udyin

gIT

=0Æ7

;

�ve

att

itude

tost

udyin

gIT

=0Æ6

;

exper

ience

of

teac

hin

g=

0Æ7

;�

ve

ITfo

rnurs

epra

ctic

e=

0Æ6

;In

tere

st

use

of

IT=

0Æ5

US

Bach

man

(1998)

Pre

–post

surv

ey

RN

-MSN

nurs

ing

studen

ts(n

=20)

Non-e

quiv

ale

nt

contr

ol

( n=

23).

Sin

gle

univ

ersi

ty

Ques

tionnai

rein

cludin

gth

eStr

onge

&

Bro

dt

Nurs

es’

Att

itudes

Tow

ard

Com

pute

riza

tion

Ques

tionnair

euse

dfo

r

pil

ot

Inte

rnet

cours

eon

info

rmat

ion

syst

ems

inhea

lth

care

20

a=

0Æ9

0pre

test

0Æ8

6post

test

.

Per

ceiv

edco

mpute

rsk

illa

=0Æ8

9

and

0Æ8

8re

spec

tivel

y

UK

Gri

gg

(1999)

Surv

eyFin

al

yea

rden

tal

studen

ts1996

(n=

44)

88%

resp

onse

,1997

(n=

42)

86%

resp

onse

Ques

tionnai

re.

Per

cepti

on

of

ITsk

ills

and

att

itude

toIT

for

two

cohort

s

52

No

evid

ence

of

validati

on

US

Holl

ander

(1999)

Surv

eyM

edic

al

studen

ts(n

=208).

60%

resp

onse

.Sin

gle

inst

ituti

on

over

2yea

rs

E-m

ail

ques

tionnair

e.Four

cohort

sper

cepti

on

of

ITsk

ills

and

ow

ner

ship

of

com

pute

rs

NR

No

evid

ence

of

validati

on

IER

ay

(1999)

Surv

eyD

enta

lst

uden

ts(n

=140)

Ques

tionnai

reC

om

pute

rlite

racy

No

evid

ence

of

validati

on

UK

-NI

Sin

clai

r

(1999)

Surv

eyD

iplo

ma

nurs

es2

yea

r1

cohort

s

(n=

745)

resp

onse

100%

.

Sin

gle

univ

ersi

ty

Ques

tionnai

reder

ived

from

MacM

ahon,

unpubli

shed

data

(1997)

and

Loyd

and

Gre

ssard

(1984)

Sel

fass

ess

com

pet

ence

(SA

),att

itudes

(A)

again

stsi

mple

know

ledge

test

(K)

SA

=N

R

A=

20

K=

16

Fact

or

anal

ysi

sof

att

itude

item

s

show

edth

ree

fact

ors

;co

nfiden

ce

8it

ems,

a=

9;

moti

vati

on

touse

,

8it

ems

a=

0Æ8

,per

ceiv

edca

reer

rela

ted

import

ance

3it

ems

a=

0Æ7

JAN: REVIEW PAPER Literature review measurement tools

� 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd 759

Table

2(C

onti

nued

)

Co.

Fir

st

Auth

or

(date

)

Stu

dy

des

ign

Sam

ple

,re

sponse

rate

Data

collec

tion

inst

rum

ent

Item

sPsy

chom

etri

cte

stin

gpro

per

ties

US

Lynch

(2000)

Surv

eyY

ear

1–4

med

ical

studen

ts(n

=301),

resp

onse

90%

Item

sfr

om

Com

pute

rO

pin

ion

Surv

ey

(Loyd

and

Gre

ssard

)and

Com

pute

rA

ttit

ude

Sca

le(M

aure

rand

Sim

onso

n)

new

Opin

ions

About

Com

pute

rs(O

AC

)sc

ale

toex

am

ine

pre

pare

dnes

sfo

rco

mpute

rbase

dte

stin

g(C

BT

)

OA

C=

8O

AC

a=

0Æ7

9L

ow

erth

an

the

scale

s

from

whic

hder

ived

US

Bil

lings

(2001)

Pil

ot

surv

ey

Under

gra

duate

and

gra

duat

e

Nurs

ing

studen

ts(n

=219),

3sc

hools

of

nurs

ing

Evalu

ati

ng

Educa

tional

Use

sof

the

Inte

rnet

(EE

UW

IN)

adap

ted

from

Fla

shli

ght

pro

gra

mm

eC

urr

ent

Stu

den

t

Inven

tory

(CSI

)online

Ben

chm

ark

ing

WB

L

40

WB

L

10

dem

ogra

phic

data

a=

0Æ8

5

US

Dugga

n

(2001)

Surv

ey4-s

tep

sam

ple

(n=

395);

scala

bil

ity

(n=

70);

oper

ati

onali

sati

on

(n=

69),

pil

ot

(n=

68);

Fin

al(n

=188).

Sin

gle

univ

ersi

ty

Att

itudes

Tow

ard

Educa

tional

Use

of

Inte

rnet

(AT

EU

I)D

evel

opm

ent

and

vali

dati

on

of

inst

rum

ent

test

edw

ith

com

munic

ati

on

and

hea

lth

pro

moti

on

studen

ts

18

Fin

alA

TE

UIa

=0Æ9

CN

Ata

ck

(2002)

Surv

eyR

egis

tere

dN

urs

es(n

=28)

single

cours

e.R

esponse

49%

Auth

or

dev

eloped

Lea

rner

Dem

ogra

phic

(LD

)

Onli

ne

Lea

rner

Support

Inst

rum

ent

(OL

SI)

-

tom

easu

reIn

tera

ctio

n,

Cours

e,T

echnolo

gy,

Envir

onm

ent

and

Impre

ssio

ns.

Sin

gle

module

web

-bas

edpost

dip

lom

a

LD

=26

OL

SI

=56

a=

0Æ9

5fo

r45

item

OL

SI

wit

hout

Envir

onm

ent

subsc

ale

a=

06

work

envir

onm

ent

a=

0Æ8

hom

een

vir

onm

ent

IEC

urt

is

(2002)

Surv

eyPost

-reg

istr

ati

on

nurs

es.

Pilot

(n=

10)

Main

study

(n=

74).

Res

ponse

rate

62%

Univ

ersi

ty

Am

ended

ques

tionnair

eN

urs

ing

Stu

den

ts’

Exper

ience

sand

Att

itudes

toC

om

pute

rs

(Sin

clai

r&

Gard

ner

)

No

vali

dati

on.

Nurs

ing

Deg

ree

pro

gra

mm

e

50

Inst

rum

ent

revie

wed

by

2st

ati

stic

ians

and

ITco

nsu

ltant

pri

or

topil

ot.

SE

Matt

heo

s

(2002)

Surv

eyD

enta

lst

uden

ts(n

=590)

sam

ple

dfr

om

den

tal

schools

(n=

16).

Res

ponse

80–85%

.9

countr

ies

Euro

pea

nD

enta

lStu

den

tsA

ssoci

ati

on

(ED

SA

)

Ques

tionnair

e.C

om

pute

rco

mpet

ence

and

att

itudes

,E

uro

pea

nst

udy.

Furt

her

item

s(2

2)

reden

tal

educa

tion

not

dis

cuss

ed

10

per

son

data

and

ICT

No

evid

ence

of

vali

dati

on

US

Sea

go

(2002)

Surv

eyY

1m

edic

al

studen

tsaver

age

resp

onse

rate

81%

(n=

aver

age

171

per

annum

)

10

yea

rcy

cle

of

Med

ical

Stu

den

tC

om

pute

r

Exper

ience

Surv

ey1991–2000

16

Yea

r1

23

Yea

r10

No

evid

ence

of

vali

dati

on.

15

item

sco

mm

on

toall

surv

eys.

US

Ste

ele

(2002)

Surv

eyM

edic

al

studen

ts(n

=150)

single

univ

ersi

ty

Com

pute

rA

ttit

ude

Surv

ey&

Rez

ler

Lea

rnin

g

Pre

fere

nce

sIn

ven

tory

.C

AI

Angio

gra

phy

Cas-

g16

CA

S-e

10

Cas-

p20

Not

revalidate

d

UK

Wis

har

t

(2002)

Surv

eyN

urs

ing

studen

ts(n

=154)

and

teach

ers

(n=

128)

Ques

tionnair

ein

cludin

gD

utt

wei

ler’

sIn

tern

al

Locu

sof

Contr

ol

Index

(IL

CI)

,att

itudes

tow

ard

sco

mpute

rs(A

C)

ILC

I28

AC

7

ILC

pre

vio

usl

yvalidate

d(1

984)

no

furt

her

vali

dati

on

US

Blo

om

(2003)

Surv

eyN

urs

ing

studen

ts(n

=165)

studen

ts

inhea

lth

scie

nce

(n=

206).

Pil

ot

study

(n=

36)

Sin

gle

inst

ituti

on

Auth

or

dev

eloped

ques

tionnair

e.R

esponse

s

tote

chnolo

gy

enhance

dfa

ceto

face

educa

tion

36

intw

o

sect

ions

3unst

ruct

ure

d

Inst

rum

ent

revie

wed

by

mult

iple

rate

rs

from

inst

ituti

on.

Item

sre

exper

ience

and

com

fort

wit

hte

chnolo

gy

enhance

d

learn

ing

a=

0Æ8

5

A. Wilkinson et al.

760 � 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd

Table

2(C

onti

nued

)

Co.

Fir

st

Auth

or

(date

)

Stu

dy

des

ign

Sam

ple

,re

sponse

rate

Data

collec

tion

inst

rum

ent

Item

sPsy

chom

etri

cte

stin

gpro

per

ties

CN

Cra

gg

(2003)

Surv

eyR

andom

sam

ple

of

hosp

ital

(n=

291,

58%

)and

nurs

ing

studen

ts(n

=207)

Sourc

esof

Pra

ctic

eK

now

ledge

(SPK

);A

ttit

udes

Tow

ard

Com

pute

rs(A

C)

mult

idim

ensi

onal;

Com

pute

rand

Inte

rnet

Confiden

ceand

Com

pute

rand

Inte

rnet

Com

fort

.

Sca

les

modifi

edby

auth

ors

.

To

ass

ess

barr

iers

and

faci

lita

tors

of

web

-

base

ded

uca

tion

SPK

18

Oth

erit

ems

not

report

ed

Sub-s

cale

s:co

mfo

rta

=0Æ7

4,

effica

cy

a=

0Æ8

5,

inte

rest

a=

0Æ7

7,

uti

lity

bel

iefs

a=

0Æ7

2,

aff

ord

abil

ity

a=

0Æ6

4;

Com

pute

ra

=0Æ9

6and

Inte

rnet

confiden

cea

=0Æ9

8;

Com

pute

ra

=0Æ9

3

and

Inte

rnet

com

fort

a=

0Æ9

5

US

DeB

ourg

h

(2003)

Corr

elat-

ional

rese

arc

h

des

ign

Post

-gra

duat

enurs

es(n

=43,

100%

)

resp

onse

.U

niv

ersi

ty

Stu

den

tSati

sfact

ion

Surv

ey(S

SS)

adapte

d

from

Tel

ecours

eE

valu

ati

on

Ques

tionnair

e

(Bin

er).

Dis

tance

module

SSS

59

Tec

hnolo

gy

and

tech

nolo

gyco

mpet

ence

a=

0Æ7

8;

bet

wee

ncl

ass

use

of

com

munic

ati

on

tech

nolo

gies

a=

0Æ8

5;

sati

sfac

tion

a=

0Æ8

8;

inst

ruct

or/

inst

ruct

ion

a=

0Æ8

9;

cours

em

anagem

ent

a=

0Æ4

1;

exper

ience

wit

hte

chnolo

gy

cours

esa

=0Æ1

1

UK

Walm

sley

(2003)

Surv

eyY

ears

1–3

den

tal

studen

ts(n

=145)

81%

resp

onse

.st

aff

(n=

22)

100%

resp

onse

.Sin

gle

univ

ersi

ty

Ques

tionnair

ere

port

ing

staff

and

studen

t

att

itudes

toth

euse

of

the

Inte

rnet

.In

stru

men

t

publi

shed

19

som

e

qualita

tive

Pil

ot

study

no

oth

ervalidati

ons

report

ed

CN

Bale

n

(2004)

Surv

eyH

osp

ital

pharm

acis

ts(n

=58)

55%

resp

onse

rate

.T

wo

hosp

itals

Ass

essi

ng

base

line

com

pute

rsk

ills

,use

and

train

ing

nee

ds.

Item

sdra

wn

from

lite

ratu

re

84

No

evid

ence

of

validati

on

NG

Bel

lo

(2004)

Surv

eyM

edic

al

&hea

lth

reco

rdst

aff

&

studen

ts(n

=148)

resp

onse

rate

82%

Hosp

ital

Ques

tionnair

eass

essi

ng

level

of

train

ing

and

use

of

IT

19

com

pute

r

know

ledge

16

att

itude

and

uti

lisa

tion

No

evid

ence

of

validati

on

DK

Doru

p

(2004)

Longit

udin

al

surv

ey

Yea

r1

med

ical

studen

tsn

=1159

over

5yea

rs.

79%

resp

onse

.

Sin

gle

univ

ersi

ty

Web

-base

dques

tionnair

ere

late

dto

IT

acc

ess

and

att

itudes

tow

ard

susi

ng

IT

for

learn

ing.

Adm

inis

tere

din

ITsk

ills

cours

e

Appen

dix

20

mix

edit

ems

No

evid

ence

of

validati

on

NZ

Honey

(2004)

Surv

eyPost

-gra

duat

enurs

es(n

=146)

resp

onse

90%

.Sin

gle

school

of

nurs

ing

Ques

tionnair

ew

ith

item

sfr

om

earl

ier

studie

s.

Acc

ess,

pro

fici

ency

,sk

ills

,use

of

dig

ital

reso

urc

esand

barr

iers

.

Sco

pin

gfe

asi

bil

ity

of

intr

oduci

ng

flex

ible

learn

ing

36

item

s?N

ot

fully

report

ed

No

evid

ence

of

validati

on

FI

Vuore

la

(2004)

Pre

–post

surv

ey

Med

ical

(n=

21)

and

soci

olo

gy

(n=

21)

studen

ts.

Res

ponse

pre

test

90%

post

-tes

t76%

Att

itude

Tow

ard

Beh

avio

ur,

Com

pute

r

Sel

f-E

ffica

cySca

le(C

SE

)part

of

Appro

ach

es

and

Stu

dy

Skills

Inven

tory

(ASSI)

,C

om

pute

r

Sta

teA

nxie

ty(C

SA

),E

valu

ati

on

of

theo

ry

of

pla

nned

beh

avio

ur

(TPB

)as

expla

nati

on

of

studen

tuse

of

WB

L

Att

itude

16

CSE

10

CSA

20

ASSI

18

item

s

insu

bsc

ale

s

CSE

a=

0Æ9

4;

CSA

a=

0Æ9

2;

ASSIa

=0Æ5

2�

0Æ8

5

JAN: REVIEW PAPER Literature review measurement tools

� 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd 761

Table

2(C

onti

nued

)

Co.

Fir

st

Auth

or

(date

)

Stu

dy

des

ign

Sam

ple

,re

sponse

rate

Data

collec

tion

inst

rum

ent

Item

sPsy

chom

etri

cte

stin

gpro

per

ties

UK

Wil

kin

son

(2004)

Pre

–post

surv

ey

Reg

iste

red

nurs

es(p

ren

=29,

post

n=

28).

Sin

gle

inst

ituti

on

Auth

or

dev

eloped

pil

ot

ques

tionnair

e,

Explo

rati

on

of

per

cepti

ons

of

four

web

-bas

edle

arn

ing

cours

es

49

in7

subsc

ale

sA

lpha

for

sub-s

cale

svari

ed0Æ7

–0Æ0

Æ9.

Not

full

yvali

date

d

US

Bil

lings

etal

.(2

005)

Surv

eyG

raduate

and

under

graduate

nurs

ing

studen

ts(n

=558).

6sc

hools

of

nurs

ing

EE

UW

INonline

explo

ring

dif

fere

nce

sbet

wee

n

gra

duat

eand

under

gra

duate

exper

ience

57

a=

0Æ9

4.

Rel

iabil

ity

of

sub-s

cale

sra

nged

from

0Æ7

3–0Æ9

3

HR

Bru

min

i

(2005)

Surv

eyH

osp

ital

nurs

es(n

=1081).

Res

ponse

96%

Modifi

edStr

onge

and

Bro

dt

Nurs

es’

Att

itude

Tow

ard

Com

pute

rs(N

AT

C)

inst

rum

ent

use

d

inth

ew

ork

pla

ce

30

a=

0Æ8

6fo

rm

odifi

edN

AT

C

SE

Masi

ello

(2005)

Pre

–post

surv

ey

Yea

rone

med

ical

studen

ts(n

=54)

49%

resp

onse

rate

.Sin

gle

cours

e

ITle

arn

ing

ques

tionnair

e,base

don

pre

vio

us

and

auth

or

dev

eloped

item

s,to

mea

sure

readin

ess

and

att

itudes

tole

arn

ing.

Evalu

ati

on

of

ale

arn

ing

managem

ent

syst

emte

chnolo

gy.

Subsc

ale

sIT

Ori

enta

tion

(IT

);In

dep

enden

tO

rien

tati

on

(IO

)

IT6

+ve

IO7

+ve

BO

10

ITa

=0Æ7

3;

IOco

nce

rnin

gle

arn

ing

support

edby

tech

nolo

gy

a=

0Æ7

5;

Ble

nded

Ori

enta

tion

(BO

)re

gard

ing

the

com

bin

ati

on

ITand

face

tofa

ce

inte

ract

ion

wit

hst

aff

/stu

den

tsfo

r

learn

ing,

(a=

0Æ8

8)

CN

Math

ur

(2005)

Surv

eyQ

uali

fied

physi

cal

ther

apis

ts

(n=

732).

56%

resp

onse

.T

wo

stage

Pil

ot

(n=

31),

(n=

25)

Auth

or

dev

eloped

ques

tionnair

e;part

two

surv

eyed

inte

rest

indif

fere

nt

modes

of

learn

ing

Mea

suri

ng

inte

rest

inco

mpute

r

ass

iste

dle

arn

ing,

dis

tance

&C

D-R

OM

NR

2part

pil

ot

for

face

vali

dit

y.

No

test

–re

test

for

reli

abil

ity

JOR

aja

b

(2005)

Surv

eyY

ears

2–5

den

tal

studen

ts(n

=268)

resp

onse

81%

.si

ngle

univ

ersi

ty

Ques

tionnair

edra

wn

from

pre

vious

den

tal

surv

eys

inU

K.

Know

ledge

skil

lsand

exper

ience

of

ICT

28

No

evid

ence

of

vali

dati

on

AU

Sala

monso

n

(2005)

Surv

eyN

urs

esPil

ot

(n=

42)

main

(n=

143)

Sin

gle

univ

ersi

ty

Auth

or

dev

eloped

Stu

den

ts’

Pre

fere

nce

of

Cours

e

Form

at

(SPO

CF)

scale

.D

raw

nfr

om

pre

viousl

y

vali

date

dStu

den

ts’

Evalu

ati

on

of

Educa

tional

Quality

(SE

EQ

)su

rvey

item

bank

20

a=

0Æ9

3w

hole

scale

Fact

or

1Pre

fers

tradit

ional

form

ata

=0Æ8

7

Fact

or

2Pre

fers

hybri

dfo

rmat

a=

0Æ9

1

HK

Sit

(2005)

Surv

eyPost

regis

trati

on

nurs

es(n

=198)

resp

onse

50%

Ques

tionnair

ebase

don

Fla

shli

ght

pro

gra

m

CSI

and

focu

sgro

up.

onli

ne

learn

ing

27

No

evid

ence

of

vali

dati

on

IEA

dam

s

(2006)

Surv

eyPost

regis

trati

on

nurs

es(n

=32).

Res

ponse

73%

Sin

gle

univ

ersi

ty

Ques

tionnair

edev

eloped

from

lite

ratu

re

tore

port

changes

insk

ill

over

tim

eand

rela

tionsh

ips

bet

wee

nst

uden

tIT

skills

and

ara

nge

of

vari

able

s

32

a=

0Æ8

6

AU

Heg

ney

(2006)

Surv

eyN

ati

onal

surv

eyre

gis

tere

dnurs

es

n=

(4300).

Res

ponse

43%

Auth

or

des

igned

ques

tionnair

eT

odet

erm

ine

acc

ess,

use

and

barr

iers

touse

of

ITby

nurs

es

77

Face

and

conte

nt

validit

yvia

inte

rvie

ws

and

pil

ot

A. Wilkinson et al.

762 � 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd

The literature fell into two groups in focus and method:

studies from the fields of dentistry, medicine and pharmacy

and those from nursing and allied health professions.

Dentistry, medicine and pharmacy

Information and communication technology skills and

literacy

In dental, medical and pharmacy education the majority of

studies used self-report surveys of students’ ICT skills,

information literacy and computer ownership (Grigg &

Stephens 1999, Hollander 1999, Ray & Hannigan 1999,

Lynch et al. 2000, Dorup, 2001, Mattheos et al. 2002, Seago

et al. 2002, Walmsley et al. 2003, Balen & Jewesson 2004,

Bello et al. 2004, Rajab et al. 2005) rather than educational

use. Questionnaires, with the exception of that by Lynch

et al. (2000), were author-developed, with little reported on

validation. Samples were homogeneous and demographic

variables other than sex were rarely reported. A USA cross-

sectional survey of medical students (Lynch et al. 2000)

examined preparedness for computer-based testing (CBT)

using eight items taken from the Loyd and Gressard (1984)

Opinions about Computers Scale and Maurer and Simon-

son’s (1984) Computer Anxiety Scale. Internal consistency of

the modified scale (a=0Æ79), although good, was lower than

for the original scales (a = 0Æ94 and 0Æ95 respectively), which

raises questions about the reliability of the modified scale.

Lynch et al. (2000) isolated three predictive factors indicating

preparedness for CBT: opinions about computers; sex and

sex interacting with previous experience of CBT.

A number of researchers surveyed successive cohorts of

dental or medical students (Grigg & Stephens 1999, Seago

et al. 2002, Dorup 2004) or, simultaneously, several year-

groups (Hollander 1999, Lynch et al. 2000, Walmsley et al.

2003, Rajab et al. 2005). Repeated surveys indicated that

students’ reported that their ICT skills improved over time;

their skills were not always sufficient for their course, and

they needed further training (Grigg & Stephens 1999,

Mattheos et al. 2002). These studies clearly built on the

experiences in previous studies; for example, Rajab et al.

(2005) derived their items from three previous dental surveys

(Grigg & Stephens 1999, Mattheos et al. 2002, Walmsley

et al. 2003) but no psychometric data were reported.

E-learning in medicine

Four further studies explored attitudes to e-learning among

medical students. A US study of medical students (Steele et al.

2002) used a combination of two previously-published scales

to create a two-part Computer Attitude Survey (CAS). Sub-

scale CAS-g, previously validated with healthcareTable

2(C

onti

nued

)

Co.

Fir

st

Auth

or

(date

)

Stu

dy

des

ign

Sam

ple

,re

sponse

rate

Dat

aco

llec

tion

inst

rum

ent

Item

sPsy

chom

etri

cte

stin

gpro

per

ties

AT

Lin

k

(2006)

Surv

eyY

ear

1M

edic

al

studen

ts(n

=1160)

resp

onse

79%

single

inst

ituti

on

Ques

tionnai

reonli

ne.

Att

itude

and

exper

ience

of

e-le

arn

ing,

usa

ge

and

pri

vate

acc

ess

Com

ple

ted

duri

ng

intr

oduct

ory

cours

e

on

CB

T/W

BT

NR

3it

emsu

bsc

ale

use

fuln

ess

of

e-le

arn

ing

a=

0Æ6

5A

ddin

g2

furt

her

item

s

reduce

dre

liabil

ity

US

Maag

(2006)

Surv

eyC

onven

ience

sam

ple

under

gra

duate

and

gra

duat

enurs

est

uden

ts(n

=721)

�7%

resp

onse

.U

SSO

N(n

=21)

Ques

tionnai

repaper

and

onli

ne.

Incl

uded

modifi

edT

echnolo

gy

Att

itude

Sca

le(T

AS)

and

self

report

of

com

pute

rapplica

tion

educa

tion

TA

S15

20

item

TA

Sori

gin

all

yvali

date

dw

ith

teach

ers.

Conte

nt

validit

yby

auth

or.

Pil

ot

paper

only

a=

0Æ8

8.

Main

a=

0Æ8

9Fact

or

analy

sis

2fa

ctor

scale

:1.

posi

tive

TA

a=

0Æ9

1;

2.

neg

ativ

eT

Aa

=0Æ8

8

TW

Yu (2

006)

Surv

eyPubli

cH

ealt

hN

urs

es(P

HN

),

random

sam

ple

from

369

hea

lth

centr

es(n

=329)

resp

onse

84%

Auth

or

dev

eloped

Basi

cC

om

pute

r

Com

pet

ence

(BA

C)

and

Sca

leof

Att

itude

toW

eb-b

ase

dL

earn

ing

(AW

BL

)U

nder

standin

g

att

itudes

tow

eb-b

ased

learn

ing

BA

C26

AW

EU

16

BA

Ca

=0Æ9

2A

BW

La

=0Æ8

7

JAN: REVIEW PAPER Literature review measurement tools

� 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd 763

professionals and students in practice (Startsman & Robinson

1972), surveyed general attitudes to computers, and CAS-e

explored attitudes and comfort with computers for education.

Post-learning intervention respondents also completed CAS-p

evaluating the computer assisted instruction. No details of

validation of the modified scales were given, which compro-

mises the results, given the different sample and the time

elapsed since some items were developed. In Finland, Vuorela

and Nummenmaa (2004) explored medical and sociology

students’ performance and self-confidence in a web-based

collaborative learning environment, predicting that those who

reported positive attitudes and high computer self-efficacy

would engage with the environment. They used five scales:

attitude measurement; computer self-efficacy (Compeau &

Higgins 1995); approaches to learning; computer state anxi-

ety. Vuorela and Nummenmaa (2004) found that expectation,

confidence and learning approach could not be used to predict

outcomes in the learning environment in their sample.

A Swedish study (Masiello et al. 2005) employed an IT-

Learning Questionnaire, with items from two previous

studies and new items. Pre-existing scales were presumed to

be more reliable, although the papers cited (Dewhurst et al.

2000, Slotte et al. 2001) presented no information about

validation. The internal consistency of sub-scales was satis-

factory and three principal components were identified: IT

Orientation, Independent Orientation and Blended Orienta-

tion. These three constructs explained 49% of the variance,

which is just under the 50–60% required to agree factor

structure (Netemeyer et al. 2003). Finally, an online study of

Austrian medical students (Link et al. 2006) examined

computer literacy, computer and Internet use and attitudes

to e-learning. An index on usefulness of e-learning was found

to be moderately reliable, but including two additional items

reduced reliability. No further validation was reported.

Nursing and allied healthcare professions

More systematic efforts to develop or adapt instruments to

measure students’ attitudes to computers and experience of

e-learning are found in the nursing and allied healthcare

literature (Table 3). Few instruments, however, have been

repeatedly used and tested.

Attitudes to computers

The presence of anxiety is considered likely to affect perfor-

mance; thus, Maurer and Simonson (1984) sought items which

would describe behaviour likely to indicate anxiety. They drew

on previous measures of anxiety, and added new items

generated by students; these were then reduced and modified in

two pilot tests. The instrument was then tested for reliability

using test–retest a = 0Æ90, yielding internal consistency of

r = 0Æ94 on test-retest and r = 0Æ96 using a random sample

from a normative study. The new instrument was correlated

against responses to a separate generalized measure of anxiety

and observation of students using computers when they were

assessed as anxious; neutral or comfortable. The refined

instrument was then further validated in a state-wide norma-

tive study with computer professionals, computer users, school

and university students, staff and a non-specific group. It has

been used in studies in nursing (Wilson 1991), allied healthcare

(Agho & Williams 1995, Williams et al. 1996) and medicine

(Lynch et al. 2000). In a US study the unmodified Computer

Anxiety Index (CAIN) (Wilson 1991) was used to test levels of

computer anxiety experienced by students in five schools of

nursing, whether anxiety varied in relation to level of computer

experience and whether there were differences between degree

and associate degree students. While no difference was found

between associate and degree students, more practical experi-

ence of computers was associated with less anxiety. Wilson

(1991) concluded that the CAIN was a valid measure of anxiety

with computers and measured three separate factors: positive

usefulness, expressed fear of computers, and dislike and mis-

trust of computers. Agho and Williams (1995) and Williams

et al. (1996) explored US allied healthcare students’ attitudes to

computers and perceptions of computer literacy using CAIN

(Maurer & Simonson 1984) and a modified computer knowl-

edge survey (Parks et al. 1986). They found the instruments to

have high reliability in their study and the 26 items of Maurer

and Simonson (1984) formed a single factor (Table 2).

Stronge and Brodt (1985) developed the Nurses’ Attitudes

Towards Computerisation (NATC). The initial 66 item self-

report questionnaire was reduced to 20 items in a pilot study

in the workplace with US nursing students. They proposed

the instrument as a reliable 6-factor scale but the sub-scales

were challenged in later studies with larger samples. It has

been adopted, adapted or revalidated (Table 4) by a number

of authors for use with both Registered Nurses and nursing

students (Schwirian et al. 1989, Scarpa et al. 1992, Stockton

& Verhey 1995, Jayasuriya & Caputi 1996, McBride &

Nagle 1996, Bachman & Panzarine 1998, Brumini et al.

2005). Schwirian et al. (1989) used the NATC in a compar-

ative study of nursing students and Registered Nurses. While

confirming that overall reliability was high, they proposed

three subscales: Computers and Patient Care, Computers and

Personal Security, and General Attitude. Three items, how-

ever, did not fit into any construct and there were small

variations in the factor loadings between students and nurses.

A replication study (Scarpa et al. 1992) with a sample of

nurses with varying demographic profiles showed that

only previous computer experience was related to positive

A. Wilkinson et al.

764 � 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd

attitude. While they established similar reliability to that in

the previous study, their factor analysis identified five factors

different from those of Stronge and Brodt (1985). Three items

did not load on to a single factor and all positive items loaded

on to one factor. Further testing with larger samples was

proposed.

Stockton and Verhey (1995) conducted reliability testing of

the instrument using US hospital nurses in two phases over

16 months. There were personnel changes between Time 1

and Time 2, but the populations were described as demo-

graphically similar. They confirmed the instrument’s overall

high reliability but expressed doubts about the number of

sub-scales and, after factor analysis, questioned whether, out

of three identified, the factors were independent as the

reliability was reduced in two factors and all the positive

items were located in factor 1.

Jayasuriya and Caputi (1996) retrieved 72 items from

international studies, including Stronge and Brodt’s (1985)

instrument, and reduced the number using a review panel to

yield a 40-item instrument, the Nursing Computer Attitudes

Inventory (NCATT). The instrument was then administered

to nursing students. Following factor analysis, five factors

were identified which contributed to 57% of the variance.

They subsequently used the NCATT instrument with

Australian Registered Nurses in practice and nursing students

at university. The student sample also completed Dambrot

et al. (1985) Computer Attitude Scale (CATT), which was

extracted from a 20-item tool (a = 0Æ84). The NCATT scale

Table 3 Details of computer attitude self-report measures

Instrument Developed by Used or adapted by Used in

Computer Attitude

Scale (30 items,

3 factors, overall

Cronbach’s a = 0Æ95)

Loyd & Gressard

1984

Sinclair & Gardner 2004,

Lynch et al. 2000,

Curtis et al. 2002,

University & Schools;

education, medicine,

nursing

Computer Anxiety Index

(CAIN) (26 items,

test retest r = 0Æ90, overall

Cronbach’s a = 0Æ94)

Maurer & Simonson

1984

Wilson 1991, Williams

et al. 1996, Lynch

et al. 2000, Agho &

Williams 1995,

University, allied health,

medicine, nursing

Nurses attitude toward

Computerisation

(NATC) (20 items,

split half r = 0Æ90)

Stronge & Brodt

1985

Schwirian et al. (1989);

Scarpa et al. (1992);

Stockton & Verhey

1995, Jayasuriya &

Caputi 1996, McBride &

Nagle 1996, Bachman &

Panzarine 1998, Brumini

et al. 2005,

Hospital and University;

nursing

Computer knowledge

survey

Parks et al. 1986 Agho & Williams 1995,

Balen and Jewesson (2004)

drew some items

Staff, students and graduate

students School of Nursing

Computer self-efficacy

10 items IC of

constructs reported >0Æ8

Compeau and

Higgins (1995)

Masiello et al. 2005, Business computing,

medical education

Nursing computer attitudes

inventory (NCATT)

Jayasuriya and

Caputi (1996)

Registered Nurses and

nursing students

Current student inventory

(item bank, no psychometric

information)

Ehrmann, 1997 Billings et al. 2001

Evaluating Educational

Uses of the Internet

(EEUWIN); Sit et al.

2005; Billings et al. 2005,

Schools of Nursing

Technology Attitude Scale (TAS) McFarlane et al., 1997 modified by Maag (2006) Teachers, nursing students

Online Learner Support Instrument

(OLSI) a = 0Æ95

Atack & Rankin, 2002 Registered nurse students

Attitudes to the Educational use

of the Internet (ATEUI)

Duggan et al. 2001 Undergraduate students

(communication, health

promotion)

JAN: REVIEW PAPER Literature review measurement tools

� 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd 765

Table

4N

urs

es’

att

itudes

tow

ard

sco

mpute

risa

tion

(NA

TC

)

Auth

or/

sam

ple

Str

onge

&

Bro

dt

(1985)

n=

48

(80%

resp

onse

)

Sch

wir

ian

etal

.

(1989)

n=

358

nurs

es

n=

353

studen

t

Sca

rpa

etal

.(1

992)

n=

136

(40%

resp

onse

)

Rep

lica

tion

study

Sto

ckto

nand

Ver

hey

(1995)

T1

n=

391

T2

n=

265

(over

all

resp

onse

41%

)

Jayas

uri

ya

and

Caputi

(1996)

A.

n=

145

(70%

resp

onse

)

B.

n=

170

nurs

es

and

studen

ts

McB

ride

and

Nagle

(1996)

n=

362

nurs

es

(42%

)

n=

299

studen

t

(60%

)

Bach

man

and

Panza

rine

(1998)

n=

20

sam

ple

n=

23

non-

equiv

ale

nt

contr

ol

Bru

min

iet

al.

(2005)

(n=

1081)

Num

ber

of

Item

s

66

reduce

dto

20

(14�

ve)

20

reduce

dto

17

20

20

A.

40

renam

ed

(NC

AT

T)

incl

.

Str

onge

&B

rodt

B.

40

reduce

dto

22

20

20

30

(NA

TC

revis

ed

15�

ve

and

+ve)

Cro

nbach

’sa

Spea

rman

Bro

wn

a=

0Æ9

0

r=

0Æ9

0

refined

scale

a=

0Æ9

5nurs

es

a=

0Æ9

2T

1a

=0Æ 9

3

T2

a=

0Æ9

2

1.a

=0Æ9

5

2.a

=0Æ9

5

nurs

esa

=0Æ9

1

studen

ta

=0Æ8

5

pre

test

a=

0Æ9

0.

post

test

a=

0Æ8

6

a=

0Æ8

6

Fact

ors

(n)

Cate

gori

es

pro

pose

d

pre

pilot

them

es

from

lite

ratu

re

1.

Job

secu

rity

2.

Leg

al

ram

ifica

tions

3.

Qual

ity

of

pati

ent

care

4.

Capab

ilit

ies

of

com

pute

rs

5.

Em

plo

yee

wil

lingnes

sto

use

com

pute

rs

6.

Ben

efit

toth

e

inst

ituti

on

Fact

or

analy

sis:

ther

ew

as

vari

ati

on

bet

wee

nnurs

es

and

studen

ts

and

thre

eit

ems

did

not

fit

1.

Com

pute

rs&

pati

ent

care

(9)

a=

0Æ9

4

2.

Com

pute

rs&

Per

sonal

Sec

uri

ty

(4)a

=0Æ7

8

3.

Gen

eral

att

itude

(4)a

=0Æ8

5

Foll

ow

ing

Fact

or

Analy

sis

(63%

of

vari

ance

)

1.

nurs

ing

effici

ency

(5)

(r=

0Æ9

2)

2.

com

pute

r

inef

fici

ency

(5)

(r=

0Æ7

8)

3.

Agen

cy&

soci

etal

impact

(2)

(r=

0Æ8

5)

4.

Lim

itati

ons

of

com

pute

rs(3

)

(r=

0Æ7

8)

5.

Pati

ent

confiden

tiali

ty

(2)

(r=

0Æ9

5)

Thre

eit

ems

did

not

load

Foll

ow

ing

fact

or

analy

sis(

57%

of

vari

ance

)

1.

Com

pute

rs&

pati

ent

care

(8)

(T1

&T

2a

=0Æ9

2)

2.

Com

pute

rs&

per

sonal

secu

rity

(2)

(T1

a=

0Æ7

8,

T2

a=

0Æ7

5)

3.

Gen

eral

att

itude

(3)

(T1

a=

0Æ7

4,

T2

a=

0Æ7

8)

A.

Foll

ow

ing

fact

or

analy

sis

(57%

of

vari

ance

)

1.

Com

pute

rA

nxie

ty

2.

Com

pute

rs&

Pati

ent

Care

3.

Cost

&ef

fici

ency

toin

stit

uti

on

4.

Com

pute

rs&

expansi

on

of

inte

rest

5.

Pati

ent

Confiden

tiali

ty

B.

Foll

ow

ing

fact

or

analy

sis

(90%

of

vari

ance

)

1.

Pati

ent

care

(nurs

esa

=0Æ9

1,

studen

tsa

=0Æ8

0)

2.

Anxie

ty(n

urs

es

a=

0Æ8

8,

studen

tsa

=0Æ9

2)

3.

Confiden

tiali

ty

(nurs

esa

=0Æ7

2,

studen

tsa

=0Æ7

1)

Foll

ow

ing

fact

or

anal

ysi

s(5

3%

nurs

es,

49%

studen

tsof

vari

ance

)

1.

Nurs

esw

ork

(nurs

es7

a=

0Æ8

7,

studen

t6

a=

0Æ8

1)

2.

Org

anis

ati

onal

issu

es(n

urs

es

7a

=0Æ8

1,

4st

uden

ts

a=

0Æ7

4)

3.

Barr

iers

(nurs

es4

a=

0Æ7

4,

studen

ts5

a=

0Æ6

5)

4.

Effi

cien

cy

(stu

den

ts

4a

=0Æ5

4)

Nurs

es:

two

item

s

did

not

fit

Stu

den

ts:

one

dif

fere

nt

item

did

not

fit.

No

report

of

fact

or

analy

sis

Scr

eeplo

t

analy

sis

thre

ehig

hly

corr

elate

d

fact

ors

Pri

nci

pal

com

ponen

t

fact

or

analy

sis

gave

one

fact

or

solu

tion.

A. Wilkinson et al.

766 � 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd

was further reduced to 22 items following factor and item

analysis and correlation with the CATT scale. Jayasuriya and

Caputi (1996) identified three factors which contributed to

90% of the variance. One of the factors: Computer Anxiety

correlated highly with the CATT (r = 0Æ51). They reported

that none of the items were derived from the Stronge and

Brodt (1985) NATC items, which may be a further indication

that they had become dated.

The report of a Canadian cross-sectional study of Regis-

tered Nurses and nursing students also critiqued the Stronge

and Brodt instrument (McBride & Nagle 1996) following a

review of previous reported uses of the scale. The authors

questioned the validity of this scale since their findings could

only explain 50% of the variance for the Registered Nurses

and 48% for the students. This finding is congruent with that

of Stockton and Verhey (1995). McBride and Nagle (1996)

also found greater scale consistency for the Registered Nurses

than the student sample. They suggested that the lack of

consistency may in part be attributed to the age of the scale

reducing item validity. The findings from this group of studies

show considerable variability in the number of factors

identified, which may indicate that either the researchers

are using different criteria in conducting the analysis or that

individual items are not valid.

A US study of Registered Nurses undertaking an Internet-

based course on IT (Bachman & Panzarine 1998) used the

Stronge and Brodt instrument. The aim of the study was to

evaluate the impact of a pilot online course. Internal

consistency of the whole scale was different pre- and post-

intervention. Additional subscales on computer use, per-

ceived computer skill and knowledge of the Internet were

developed by the authors in the absence of appropriate

measures. Content validity was assessed by raters and the

reliability of the Perceived Computer Skill sub-scale was

reported (pre a = 0Æ89 post a = 0Æ88).

The Stronge and Brodt instrument focused predominantly

on the introduction of computers to the workplace and, as

well as being dated, it is also less likely to be valid in an

academic setting. In a two-site workplace study with

Croatian nurses, Brumini et al. (2005) used a modified

version of the NATC, with new items from an unpublished

study. Half the 30 items on attitudes to computers were

negatively phrased. Having performed factor analysis, they

decided to work with a 1-factor solution. Limitations of their

study included the cross-sectional design and respondents

being observed as they completed the survey.

Two nursing studies (Curtis et al. 2002, Sinclair &

Gardner 1999) drew on Loyd and Gressard’s (1984) Com-

puter Attitude Scale developed for use in schools. Sinclair and

Gardner (1999) surveyed diploma nursing students in North-

ern Ireland to measure their perceived competence, attitudes

and previous IT training against a knowledge test. Three

factors were identified: confidence in using computers,

motivation to use, and perception of career-related impor-

tance of computers. Those with previous knowledge and

training had statistically significantly higher levels of confi-

dence (P < 0Æ001) and motivation (P < 0Æ01) but there was

no statistically significant difference in their perception of

career-related importance. Sinclair and Gardner (1999)

recommended a change from identifying students’ basic skills

to identifying their ability to apply those skills in practice.

Curtis et al. (2002) used the scale with small amendments to

survey Irish undergraduate Registered Nurses and found

positive attitudes and moderate to high skills but did not

report confidence levels or validation. A further Irish study

(Adams & Timmins 2006) with Registered Nurses on a part-

time access to degree programme used an author-developed

instrument with items developed from the literature (a = 0Æ86)

to explore access to and use of computers and the Internet and

the relationship to demographic variables and usage patterns.

However, as no further psychometric data were reported there

was little potential to draw on or replicate these studies. A

subsequent US national study (Maag 2006) drew on Sinclair

and Gardner (1999) work and suggested that sound education

about the use of technology would have an impact on nursing

students’ future use of technology for patient care. To provide a

baseline for educators, they developed a modified Technology

Attitude Scale (TAS) to explore students’ attitudes and views

towards using technology. In common with previous studies,

the TAS addressed education to use computers and not

educational use.

e-Learning

A small number of recent studies have used instruments to

explore healthcare students’ experience of using computers

specifically for education. A US study (Duggan et al. 2001)

identified a lack of instruments to measure student attitudes to

the educational use of the Internet and the researchers devel-

oped and validated an 18-item scale, Attitudes to the Educa-

tional Use of the Internet (ATEUI), in three stages. Educational

literature provided a pool of 60 statements, subsequently

reduced to 33 and administered to students to determine the

scalability of items and then operationalised with a new sample

when 18 items were retained. The pilot AETUI, combined with

behavioural statements, was completed by a further student

sample (a = 0Æ89). The final instrument was administered with

a further group of students enrolled on communication and

health promotion courses (a = 0Æ91).

The findings of Duggan et al. (2001) suggest that students

who are in control of their learning have positive attitudes,

JAN: REVIEW PAPER Literature review measurement tools

� 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd 767

and this theme is echoed in a UK cross-sectional study with

postgraduate teacher trainees and pre and postregistration

nursing students (Wishart & Ward 2002), which suggested

that there was an association between attitude to computers

and user sense of internal control. Wishart and Ward (2002)

chose the previously-validated Duttweiler Internal Locus of

Control Index (Duttwieler 1984). An additional seven items

focused on computer attitudes and questions about their

computer use, ownership and experience. There is no

evidence that the amended instrument was validated as part

of the study.

Atack and Rankin (2002), in a pre and post-test evaluation

of web-based learning (WBL) by Canadian Registered

Nurses, developed a two-part instrument. Items on computer

skills and access were combined with five sub-scales measur-

ing interaction, design, technology, environment and impres-

sions. The authors highlighted the variation in responses

concerning interaction and learning from the work environ-

ment, which were congruent with the findings of larger

studies (DeBourgh 2003, Billings et al. 2005, Sit et al. 2005).

In a similar UK pre and post-test pilot study, Wilkinson et al.

(2004) used an author-developed instrument,with seven

subscales to explore computer use; online learning; distance

learning; evaluation (post); learning outcomes; support; and

utility with Registered Nurses on four courses. Respondents

reported more positive orientation to online (P = 0Æ04) and

distance learning (P = 0Æ02) post-course. Those who reported

prior use of ICTs were more likely to complete the course.

Both these studies were small, exploratory and uncontrolled

and had participant attrition.

Researchers have used the national evaluation programme

of the American Association of Higher Education (AAHE)

(Billings et al. 2001), which is focused on educational

technology. In this national evaluation programme conducted

by the AAHE and known as the Flashlight programme (now a

non-profit Teaching Learning Technology Group) an item

bank of ‘validated’ questions, the Current Student Inventory

Toolkit (CSI), on educational technology was created for

researchers to use (See http://www.tltgroup.org/flashlightP.

htm). Billings et al. (2001) drew upon this bank of questions to

develop and pilot an online 52-item instrument called Eval-

uating Educational Uses of the Internet (EEUWIN) to validate

an educational model with nursing students across three

universities. The reliability of the 52-item EEUWIN was good

but no data were reported for its sub-scales. In the pilot study

positive relationships were identified between student distance

from the campus, older age and convenience, satisfaction and

connectedness. In a later study, Billings et al. (2005) investi-

gated generational differences among nursing students across

six universities using a revised 57-item EEUWIN.

In a Hong Kong study with Registered Nurses taking one

or more online courses researchers also used 27 items from

the CSI to ask questions about overall satisfaction with

online courses and the perceived barriers to online study

(Sit et al. 2005). The items were reviewed by an educational

team for content validity related to six themes. Internal

consistency and test–retest reliability of the CSI were

evaluated but the data were not reported. The researchers

found seven facets which explained 54% of overall

satisfaction: convenience; confidence to tackle difficult tasks;

understanding concepts; taking responsibility for learning;

interactivity; supplementary face-to-face interaction; and

multimedia. Convenience was the most important factor in

satisfaction but a major hindrance was lack of face-to-face

interaction.

A US study of Registered Nurses (DeBourgh 2003) had

similar findings using a 59-item Student Satisfaction Survey

derived from an existing instrument, with added items on

computer-mediated communication identified from literature

searches on student satisfaction with distance education.

DeBourgh (2003) tested reliability coefficients for eight facets

(five student and three teacher characteristics) and these

varied from poor to good. Technical aspects cited as the most

frequent source of negative attitudes in the literature.

DeBourgh (2003), however, concluded that the human

interface issues represented by quality of the instructor

remained the most important factor in satisfaction with

distance learning. This study was limited by its small

homogeneous sample. The ability of teachers to apply

educational principles to the use of technology was a major

influence on students’ satisfaction in another US cross-

sectional study (Bloom & Hough 2003) exploring nurse

and health science students’ engagement with technology-

enhanced learning before and during their course and the

quality of the experience. The author-developed instrument

was validated by a rating panel and pilot test. Reliability for

the second part of the instrument concerning experience and

comfort with technology-enhanced learning was a = 0Æ85.

New studies are emerging from other regions of the world.

In a Canadian/Chinese study of Registered Nurses, Cragg

et al. (2003) combined and made small changes to existing

scales to measure Attitudes Toward Computers (ATC) The

authors developed a new scale Attitudes Towards the Internet

based on the ATC scale which, except for the affordability

sub-scale (a = 0Æ53), had similarly good to excellent reliabil-

ity. The scales were translated into Chinese and validated. In

New Zealand, Honey (2004) surveyed Registered Nurses

using an author-developed instrument incorporating items

from previous studies in a cross-sectional study to scope the

feasibility of introducing online learning. There was no

A. Wilkinson et al.

768 � 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd

description of instrument development or psychometric data,

although reference was made to previous research.

A Taiwanese study (Yu & Yang 2006) explored the

attitudes of a random sample of public health nurses to WBL

using an author-developed questionnaire with items gener-

ated from review of the literature, interview and expert panel

resulting in two sub-scales: Basic Computer Competence and

Attitude toward WBL. Overall, nurses were positive about

WBL but rural nurses were statistically significantly more

positive than those in urban settings. Those with computer

skills and access to computers in the workplace were more

positive. There were, however, indications that respondents

had concerns about the quality of learning materials and

being isolated, similar themes to those identified by

DeBourgh (2003) and Sit et al. (2005). A Canadian study

with physiotherapists (Mathur et al. 2005) employed an

author-developed instrument previously used by one of the

authors and amended for face validity and pilot tested but not

further validated. Level of education, level of access to the

Internet, frequency of use, skill and practice area were

positively related to interest in CAI. In contrast to the work of

Billings et al. (2001)and Yu and Yang (2006), distance from

education centres was not related to interest in CAI.

There is some emerging work on the development and

validation of instruments to explore student responses to use

of computers and the Internet for education (Table 3) but

currently no single instrument has been developed and refined

using large samples across a variety of settings. Furthermore,

few such instruments have been either reused or revalidated.

Discussion

The literature search identified instruments used to collect data

on four main topics: assessing ICT and information literacy

skills (e.g. Parks et al. 1986, Maag 2006); measuring attitudes

to computers or computerisation in practice (e.g. Stronge &

Brodt 1985, Jayasuriya & Caputi 1996); attitude and access to

computers and the Internet (e.g. Mattheos et al. 2002, Cragg

et al. 2003); and exploring attitudes to computers and the

Internet for education (e.g. Duggan et al. 2001, Atack &

Rankin 2002, Bloom & Hough 2003). All the studies were

cross-sectional or pre and post- test studies, with no longitu-

dinal studies with repeated measures, and the pre and post-test

intervention studies were of single units or modules of WBL

with consequential small sample sizes (Atack & Rankin 2002).

More recent studies have focused on attitudes to web-based

and distance education and have explored interrelationships

between all the above topics.

Methodological details of many studies were inadequately

described, creating concerns about instrument validity and

reliability (e.g. Grigg & Stephens 1999, Mattheos et al. 2002,

Seago et al. 2002, Hegney et al. 2006). In descriptions of the

instruments, face and content validity were more consistently

discussed than other aspects of validation and included the

use of subject experts, reference groups or themes derived

from the literature (e.g. Mathur et al. 2005, Hegney et al.

2006). Since the 1980s there have been substantial changes in

the capacity and incidence of ICT use in higher education,

and therefore items designed to report their usage, responses

to and comfort with ICT may have lost their validity over

time. The only instrument that was repeatedly tested in

healthcare education and practice (Stronge & Brodt 1985) is

now dated and proved more reliable with nurses working in

hospitals than with nursing students. The variation in factors

identified by successive investigators also limits comparison

across studies. Earlier instruments which were rigorously

developed had higher reliability than those described more

recently, but this may be the result of rapidly-changing ICT.

Methodological detail was reported less in the medical

literature than in the nursing and allied healthcare studies

included in the review. A number of reports, the majority

medical, gave limited information on instrument design, pilot

work or psychometric properties (Hollander 1999, Ray &

Hannigan 1999, Steele et al. 2002, Walmsley et al. 2003,

Bello et al. 2004). While items were often derived from

previous measures, it was not always clear where individual

items originated, and the final instrument was rarely pub-

lished (Curtis et al. 2002, Honey 2004). There are few studies

where the samples were derived from more than one

institution and/or discipline group, so that there are limits

to the transferability of findings. Replication of studies is

difficult as the work of Scarpa et al. (1992) demonstrated,

since prior reports did not give complete psychometric

information for useful comparative analysis. There was often

no consistency in the demographic sections of instruments,

and authors presented very varied and often limited infor-

mation about study samples. This may be a result of

homogeneous populations in many studies, but this is not

always made explicit; therefore, issues remain concerning

differentiating between groups of learners.

To date, no instrument has demonstrated high reliability in

measuring student attitudes to e-learning over more than one

group. However, studies are emerging from outside the US

which address the use of ICT for learning by different

populations (e.g. Sit et al. 2005, Link et al. 2006, Yu & Yang

2006). Online learning has been targeted by universities as an

area of growth, but there have been examples where such

initiatives have failed, for example the UK e-University

(House of Commons Education & Skills Committee 2005).

This review suggests that little is known about either the

JAN: REVIEW PAPER Literature review measurement tools

� 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd 769

preparedness or views of healthcare students in relation to

online education. Furthermore, the items in early instruments

no longer reflect terminology used in connection with current

ICT skills and rarely consider the use of communication other

than e-mail.

Conclusion

Further research is needed to identify what should be

measured. Previous tools used to gather reports of respondents’

ICT skills need to be updated if they are to be relevant and valid

for contemporary healthcare professionals. The requirement

for nurses, for example, to access information, critically

appraise and then synthesise it for others indicates that

instruments which survey students’ ability and confidence to

make more complex use of ICTs are required. ICT use is

becoming ubiquitous in higher education and the workplace,

and so educators need to know whether students on healthcare

programmes are equipped with the requisite skills.

While there have been a number of studies exploring the

skills, attitudes and experience of healthcare students regard-

ing ICTs and ICTs for education, there have been no large

scale or longitudinal studies exploring whether attitudes

change during and after education. Continued expansion of

web-based learning at all levels, the mobility of the healthcare

workforce and the need for this workforce to have flexible

modes of continued education mean that it is imperative to

develop and validate instruments to explore students’ expe-

riences with e-learning and to develop models for engaging

students in e-learning.

Funding

This research received no specific grant from any funding

agency in the public, commercial, or not-for-profit sectors.

Author contributions

AW, AEW & JR were responsible for the study conception

and design. AW performed the data collection. AW per-

formed the data analysis. AW was responsible for the

drafting of the manuscript. AEW & JR made critical revisions

to the paper for important intellectual content. AEW & JR

supervised the study.

References

Adams A. & Timmins F. (2006) Students views of integrating web-

based learning technology into the nursing curriculum. Nurse

Education in Practice 6(1), 12–22.

Agho A.O. & Williams A.M. (1995) Actual and desired computer

literacy among allied health students. Journal of Allied Health

24(2), 117–126.

Atack L. & Rankin J.A. (2002) A descriptive study of registered

nurses’ experiences with web-based learning. Journal of Advanced

Nursing 40(4), 457–465.

Bachman J.A. & Panzarine S. (1998) Enabling student nurses to use

the information superhighway. Journal of Nursing Education

37(4), 155–161.

Balen R.M. & Jewesson P.J. (2004) Pharmacist computer skills and

needs assessment survey. Journal of Medical Internet Research 6,

1. Retrieved from: http://www.jmir.org/2004/1/e11/ on 17 March

2008.

What is already known about this topic

• Healthcare professionals are expected to be computer

literate at the point of registration.

• There are few rigorous quantitative studies on the atti-

tudes and experience of healthcare professionals

regarding computers and use of computers for learning.

• Consistent methods of measuring attitudes of healthcare

professionals’ use of computers for learning have not

been established.

What this paper adds

• The majority of studies are cross-sectional and therefore

the development of students’ attitudes and experience

with information and communication technology and

online learning over time has not been explored.

• Future measurement tools need to address the infor-

mation literacy and preparedness for online education

of healthcare students, as well as their basic information

and communication technology skills.

• The quality of instruments is variable, with little

evidence of progressive development and validation.

Implications for practice and/or policy

• Information literacy is a key aspect of nursing practice

and nurses’ careers and therefore gaps in knowledge of

nursing students’ capabilities and attitudes are of

concern.

• Future research should focus on the impact of demo-

graphics on attitudes and experience of nursing

students.

• Further work is required to establish a valid instrument

to explore the attitudes and experience in relation to

information and communication technology of nursing

students.

A. Wilkinson et al.

770 � 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd

Bello I.S., Arogundade F.A., Sanusi A.A., Ezeoma I.T., Abioye-Kuteyi

E.A. & Akinsola A. (2004) Knowledge and utilization of infor-

mation technology among health care professionals and students in

Ile-Ife, Nigeria: A case study of a university teaching hospital.

Journal Of Medical Internet Research 6(4), 23.

Billings D., Connors H. & Skiba D. (2001) Benchmarking best

practices in web-based nursing courses. Advances in Nursing Sci-

ence 23, 41–52.

Billings D.M., Skiba D.J. & Connors H.R. (2005) Best practices in

web-based courses: Generational differences across undergraduate

and graduate nursing students. Journal of Professional Nursing

21(2), 126–133.

Bloom K.C. & Hough M.C. (2003) Student satisfaction with tech-

nology enhanced learning. CIN: Computers, Informatics Nursing

21(5), 241–246.

Brumini G., Kovic I., Zombori D., Lulic I. & Petrovecki M. (2005)

Nurses’ attitudes towards computers: Cross sectional questionnaire

study. Croatian Medical Journal 46(1), 101–104.

Chumley-Jones H.S., Dobbie S. & Alford C.L. (2002) Web-based

learning: sound educational method or hype? A review of the

evaluation of literature. Academic Medicine 77(10), S86–S93.

Compeau D.R. & Higgins C.A. (1995) Computer self-efficacy devel-

opment of a measure and initial test. MIS Quarterly 19, 189–211.

Cornford J. & Pollock N. (2003) Putting the University Online:

Information Technology and Organisational Change. OUP,

Buckingham.

Cragg C.E., Edwards N., Yue Z., Xin S. & Hui Z.D. (2003)

Integrating web-based technology into distance education for

nurses in China: Computer and Internet access and attitudes. CIN:

Computers Informatics Nursing 21(5), 265–274.

Curtis E., Hicks P. & Redmond R. (2002) Nursing students

experience and attitudes to computers: A survey of a cohort of

students on a Bachelor in nursing studies course. ITIN 14(2),

7–17.

Dambrot F.H., Watkins-Malek M.A., Silling S.M., Marshall R.S. &

Garver J.A. (1985) Correlates of sex differences in attitudes toward

and involvement with computers. Journal of Vocational Behavior

27(1), 71–86.

DeBourgh G.A. (2003) Predictors of student satisfaction in distance-

delivered graduate nursing courses: what matters most? Journal of

Professional Nursing 19(3), 149–163.

Department of Health (2004) The NHS Knowledge and skills frame-

work and the development review process. HMSO, London.

Retrieved from http://www.dh.gov.uk/assetRoot/04/09/08/61/

04090861.pdf on 11 May 06.

Dewhurst D.G., Macleod H.A. & Norris T.A.M. (2000) Independent

student learning aided by computers: an acceptable alternative to

lectures? Computers & Education 35, 223–241.

Dorup J. (2004) Experience and attitudes toward information

technology among first year medical students in Denmark: longi-

tudinal questionnaire survey. Journal of Medical Internet Research

6(1). Retrieved from http://www.jmir.org/2004/1/e10/ on 17 May

2006.

Dover L.V. & Boblin S. (1991) Student nurse computer experience

and preferences for learning. Computers in Nursing 9(2), 75–79.

Duggan A., Hess B., Morgan D., Sooyeon K. & Wilson K. (2001)

Measuring students attitudes towards educational use of the Inter-

net. Journal of Educational Computing Research 25(3), 267–281.

Duke C. (2002) Managing the Learning University. OUP, Bucking-

ham.

Duttwieler P.C. (1984) The internal control index: a newly developed

measure of locus of control. Educational and Psychological

Measurement 44, 209–221.

Ehrmann S.C. & Zuniga R.E. (1997) The Flashlight Evaluation

Handbook TLT group. Retrieved from http://www.tltgroup.org/

Flashlight/Handbook/Toc.htm on 5 December 2008.

Grigg P.A. & Stephens C.D. (1999) A survey of the IT skills and

attitudes of final year dental students at Bristol University in

1996 and 1997. European Journal of Dental Education 3(2),

64–73.

Hegney D., Eley R., Buikstra E., Fallon T., Isoar J. & Gilmore V. (2006)

Australian nurses access and attitudes to information technology.

Studies in health technology and informatics 122, 688–692.

Hollander S. (1999) Assessing and enhancing medical students’

computer skills: a two-year experience. Bulletin of the Medical

Library Association 67(1), 67–73.

Honey M. (2004) Flexible learning for postgraduate nurses: a basis

for planning. Nurse Education Today 24, 319–325.

House of Commons Education & Skills Committee (2005) UK

e–University: Third Report of Session 2004–05. The Stationery

Office Limited, London.

Jayasuriya R. & Caputi P. (1996) Computer attitude and computer

anxiety in nursing: validation of an instrument using and Austra-

lian sample. Computers in Nursing 14(6), 340–345.

Lewis M.J., Davies R., Jenkins D. & Tait M.I. (2001) A review of

evaluative studies of computer-based learning in nursing education.

Nurse Education Today 21, 26–37.

Link T.M., Marz R., Link T.M. & Marz R. (2006) Computer literacy

and attitudes towards e-learning among first year medical students.

BMC Medical Education 6, 34.

Loyd B.H. & Gressard C. (1984) Reliability and Factorial validity of

computer attitude scales. Educational and Psychological Mea-

surement 44, 501–505.

Lynch D.C., Whitley T.W., Emmerling D.A. & Brinn J.E. (2000)

Variables that may enhance medical students’ perceived pre-

paredness for computer-based testing. Journal of American Medi-

cal Informatics Association 7, 469–474.

Maag M.M. (2006) Nursing students attitudes toward technology: a

national study. Nurse Educator 31(3), 112–118.

Masiello I., Ramberg R. & Lonka K. (2005) Attitudes to the appli-

cation of a web-based learning system in a microbiology course.

Computers & Education 45(2), 171.

Mathur S., Stanton S. & Reid W.D. (2005) Canadian physical ther-

apists’ interest in web-based and computer-assisted continuing

education. Physical Therapy 85(3), 226.

Mattheos N., Nattestad A., Schittek M. & Attstrom R. (2002)

Computer literacy and attitudes among students in 16 European

dental schools: current aspects, regional differences and

future trends. European Journal of Dental Education 6, 30–

35.

Maurer M.M. & Simonson M.R. (1984) Development and Valida-

tion of a Measure of Computer Anxiety. Ames, Iowa.

McBride S. & Nagle L. (1996) Attitudes toward computers: a test of

construct validity. Computers in Nursing 14(3), 164–170.

McFarlane T.A., Hoffman E.R. & Green K.E. (1997) Teachers’

Attitudes towards Technology (A survey). Paper presented at the

JAN: REVIEW PAPER Literature review measurement tools

� 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd 771

American Educational Research Association, March 24th–28th,

Chicago, IL (ERIC #ED411279).

Netemeyer R.G., Bearden W.O. & Sharma S. (2003) Scaling Proce-

dures: Issues and Applications. Sage, Thousand Oaks.

New Media Consortium (2006) The Horizon Report. The New

Media Consortium and Educause Learning Initiative. Retrieved

from http://www.nmc.org/pdf/2006_Horizon_Report.pdf on 30

July 2007.

New Media Consortium (2007) The Horizon Report. The New

Media Consortium and Educause Learning Initiative. Retrieved

from http://www.nmc.org/pdf/2007_Horizon_Report.pdf on 30

July 2007.

New Media Consortium (2008) The Horizon Report. The New

Media Consortium and Educause Learning Initiative. Retrieved

from http://www.nmc.org/pdf/2008_Horizon_Report.pdf on 30

July 2007.

Parks P.L., Damrosch S.P., Heller B.R. & Romano C.A. (1986)

Faculty and student perceptions of computer applications in

nursing. Journal of Professional Nursing 2, 104–113.

Rajab L.D., Baqain Z.H., Rajab L.D. & Baqain Z.H. (2005) Use of

information and communication technology among dental

students at the University of Jordan. Journal of Dental Education

69(3), 387–398.

Ray N.J. & Hannigan A. (1999) A survey of the computer literacy of

undergraduate dental students at a University Dental School in

Ireland during the academic year 1997–98. European Journal of

Dental Education 3(2), 56–63.

Salamonson Y. & Lantz J. (2005) Factors influencing nursing stu-

dents’ preference for a hybrid format delivery in a pathophysiology

course. Nurse Education Today 25(1), 9–16.

Samuel M., Coombes J.C., Miranda J.J., Melvin R., Young E.J.W. &

Azarmina P. (2004) Assessing computer skills in Tanzanian

medical students: an elective experience. MBC Public Health 4: 37.

Retrieved from http://www.biomedcentral.com/1471-2458/4/37

on 28 October 2007.

Saranto K., Leino-Kilpi H. & Isoaho H. (1997) Learning environ-

ment in information technology the views of student nurses.

Computers in Nursing 15(6), 324–332.

Scarpa R., Smeltzer S.C. & Jasion B. (1992) Attitudes of nurses

toward computerisation: a replication. Computers in Nursing

10(2), 72–80.

Schwirian P.M., Malone J.A., Stone V.J., Nunley B. & Francisco T.

(1989) A comparison of the attitudes of nurses and nursing

students. Computers in Nursing 7(4), 168–177.

Seago B.L., Schlesinger J.B. & Hampton C.L. (2002) Using a

decade of data on medical student computer literacy for strategic

planning. Journal of Medical Library Association 90(2), 202–

209.

Sinclair M. & Gardner J. (1999) Planning for information technology

key skills in nurse education. Journal of Advanced Nursing 30(6),

1441–1450.

Sit J.W.H., Chung J.W.Y., Chow M.C.M. & Wong T.K.S. (2005)

Experiences of online learning: students’ perspective. Nurse Edu-

cation Today 25, 140–147.

Slotte V., Wangel M. & Lonka K. (2001) Information Technology in

medical education: a nationwide project on the opportunities of

new technology. Medical Education 35, 990–995.

Smith J. (2005) From flowers to palms: 40 years of policy for online

learning. ALT-J 13(2), 93–108.

Startsman T.S. & Robinson R.E. (1972) The attitudes of medical and

paramedical personnel toward computers. Computers and

Biomedical Research 5, 218–227.

Steele D.J., Johnson J.E.J., Palensky Lynch T.G., Lacy N.L. & Duffy

S.W. (2002) Learning preferences, computer attitudes, and student

evaluation of computerisation instruction. Medical Education 36,

225–232.

Stockton A.H. & Verhey M.P. (1995) A psychometric examination

of the Stronge-Brodt Nurses’ attitudes towards computers

questionnaire. Computers in Nursing 13(3), 109–113.

Stronge J.H. & Brodt A. (1985) Assessment of nurses’ attitudes

towards computerization. Computers in Nursing 3(4), 154–158.

Vuorela M. & Nummenmaa L. (2004) How undergraduate students

meet a new learning environment? Computers In Human Behavior

20(6), 763.

Walmsley A.D., White D.A., Eynon R. & Somerfield L. (2003) The

use of the Internet within a dental school. European Journal of

Dental Education 7(1), 27–33.

Whitemore R. & Knafl K. (2005) The integrative review: updated

methodology. Journal of Advanced Nursing 52(5), 546–553.

Wilkinson A., Forbes A., Bloomfield J. & Gee C.F. (2004) An

exploration of four web-based open and flexible learning modules

in post-registration nurse education. International Journal of

Nursing Studies 41(4), 411–424.

Williams A.M., Agho A.O. & McCloy C. (1996) Attitudes and

perceptions of computer applications among baccalaureate physi-

cal therapy students. Journal of Physical Therapy Education 10(1),

14–17.

Wilson B.A. (1991) Computer anxiety in nursing students. Journal of

Nursing Education 30(2), 52–56.

Wishart J. & Ward R. (2002) Individual differences in nurse and

teacher training students’ attitudes toward and use of information

technology. Nurse Education Today 22(3), 231–240.

Yu S. & Yang K.-F. (2006) Attitudes toward web-based

distance learning among public health nurses in Taiwan: A ques-

tionnaire survey. International Journal of Nursing Studies 43, 767–

774.

The Journal of Advanced Nursing (JAN) is an international, peer-reviewed, scientific journal. JAN contributes to the

advancement of evidence-based nursing, midwifery and health care by disseminating high quality research and

scholarship of contemporary relevance and with potential to advance knowledge for practice, education, management

or policy. JAN publishes research reviews, original research reports and methodological and theoretical papers.

For further information, please visit the journal web-site: http://www.journalofadvancednursing.com

A. Wilkinson et al.

772 � 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd