Post on 19-Jan-2023
REVIEW PAPER
Measurement of information and communication technology
experience and attitudes to e-learning of students in the healthcare
professions: integrative review
Ann Wilkinson, Alison E. While & Julia Roberts
Accepted for publication 17 November 2008
Correspondence to A. Wilkinson:
e-mail: Ann.wilkinson@kcl.ac.uk
Ann Wilkinson BA MPhil RSW
Lecturer in Learning Technology
King’s College London, Florence Nightingale
School of Nursing and Midwifery, UK
Alison E While BSc PhD RN
Professor of Community Nursing
King’s College London, Florence Nightingale
School of Nursing and Midwifery, UK
Julia Roberts PhD RN RCNT
Senior Lecturer
Head of Department of Specialist Care,
King’s College London, Florence Nightingale
School of Nursing and Midwifery, UK
WILKINSON A., WHILE A.E.WILKINSON A., WHILE A.E. & ROBERTS J . (2009)ROBERTS J . (2009) Measurement of informa-
tion and communication technology experience and attitudes to e-learning of
students in the healthcare professions: integrative review. Journal of Advanced
Nursing 65(4), 755–772
doi: 10.1111/j.1365-2648.2008.04924.x
AbstractTitle. Measurement of information and communication technology experience and
attitudes to e-learning of students in the healthcare professions: integrative review.
Aim. This paper is a report of a review to describe and discuss the psychometric
properties of instruments used in healthcare education settings measuring expe-
rience and attitudes of healthcare students regarding their information and
communication technology skills and their use of computers and the Internet for
education.
Background. Healthcare professionals are expected to be computer and infor-
mation literate at registration. A previous review of evaluative studies of com-
puter-based learning suggests that methods of measuring learners’ attitudes to
computers and computer aided learning are problematic.
Data sources. A search of eight health and social science databases located 49
papers, the majority published between 1995 and January 2007, focusing on the
experience and attitudes of students in the healthcare professions towards com-
puters and e-learning.
Review methods. An integrative approach was adopted, with narrative descrip-
tion of findings. Criteria for inclusion were quantitative studies using survey tools
with samples of healthcare students and concerning computer and information
literacy skills, access to computers, experience with computers and use of com-
puters and the Internet for education purposes.
Results. Since the 1980s a number of instruments have been developed, mostly in
the United States of America, to measure attitudes to computers, anxiety about
computer use, information and communication technology skills, satisfaction and
more recently attitudes to the Internet and computers for education. The
psychometric properties are poorly described.
Conclusion. Advances in computers and technology mean that many earlier tools
are no longer valid. Measures of the experience and attitudes of healthcare
� 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd 755
J A N JOURNAL OF ADVANCED NURSING
students to the increased use of e-learning require development in line with
computer and technology advances.
Keywords: attitudes, e-learning, experience, health professions education,
information and communication technology, literature review, measurement,
nurse education
Introduction
Successive reports on emerging technologies relevant to
higher education (New Media Consortium, 2006, 2007,
2008) indicate that the information literacy of students
entering higher education is not improving and that
academics are not keeping pace with the potential of
mobile technologies for education. Universities are expected
to educate healthcare professionals who, at the point of
registration, are computer and information literate. In the
United Kingdom, the Knowledge and Skills Framework
(Department of Health, 2004) requires registered healthcare
professionals to be aware of and keep up-to-date with the
knowledge base of their professions. Core skills include the
ability to use electronic libraries, critically appraise evi-
dence for healthcare, and provide health information for
service users.
Studies worldwide suggest that healthcare professionals are
not confident at the point of qualification. For example, 53%
of graduating Finnish nurses reported positive attitudes to
using IT for nursing but inadequate IT skills for practice
(Saranto et al. 1997). Similarly, a Canadian study (Balen &
Jewesson 2004) showed that registered pharmacists required
additional information and communication technology (ICT)
skills for effective practice. Elsewhere it is reported that
medical students are disadvantaged by poor access to online
knowledge resources needed to improve health outcomes
(Bello et al. 2004, Samuel et al. 2004). A national study of
Australian nurses identified both limited preregistration
training and lack of confidence with computers by Registered
Nurses (Hegney et al. 2006).
A UK literature review of computer-based learning (CBL)
(Lewis et al. 2001) showed that there were difficulties in
measuring students’ attitudes to CBL and no reliable
instruments. In addition, Lewis et al. (2001) and Chum-
ley-Jones et al. (2002) in the United States of America
(USA) noted that there was no good method for differen-
tiating between different learners and that more careful
attention needed to be paid to these variables in future
studies.
The review
Aim
The aim of the review was to describe and discuss the
psychometric properties of instruments used in healthcare
education settings measuring experience and attitudes of
healthcare students’ regarding their ICT skills and their use of
computers and the Internet for education.
Design
A quantitative methodological review using an integrative
approach with narrative description of findings, as described
by Whitemore and Knafl (2005), was chosen to permit the
inclusion of studies using a variety of methods.
Search methods
The literature on computer experience and attitudes is
multidisciplinary; as a consequence, a separate search strategy
was formulated for each of the major bibliographic databases
in health, education and social science (Table 1). There were
three variables of interest: e-learning; attitude and experience;
and the healthcare professions. The search was limited to
papers written in English from 1995 to January 2007. This
timeframe coincides with the transition from small develop-
ments of CBL to ubiquitous Internet and ICTs (Smith 2005)
and worldwide expansion of higher education (Duke 2002,
Cornford & Pollock 2003). Preliminary searches, Zetoc Alerts
and reference tracking yielded earlier studies.
Search outcome
The results (n = 2628) were imported into Endnote and initial
filtering removed duplicates, non-peer reviewed papers, items
about patient education, staff/educator experience, satisfac-
tion studies and measures of learning styles, leaving 292 items
for detailed appraisal (Figure 1). The main exclusion criteria
were: instrument insufficiently described; experimental study
A. Wilkinson et al.
756 � 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd
with no measure of attitudes or experience of students; non-
health; and unpublished. Certain key papers pre-1995 which
provided evidence of a history of scale development (e.g.
Stronge & Brodt 1985, Parks et al. 1986) or instruments from
non-health settings which were adopted for healthcare educa-
tion (e.g. Maurer & Simonson 1984) were included.
Quality appraisal
Quality appraisal of individual studies was not undertaken as
the main purpose of the methodological review was to
determine psychometric properties of instruments. One
instrument has been extensively revalidated (Table 4).
Data abstraction and synthesis
Studies were synthesized under the following subheadings:
country, author and date of publication, study design, sample
and response rate, data collection instrument, number of
items in instrument and psychometric testing properties.
Where substantial data were missing, studies were excluded.
Forty-nine papers remained (Table 2).
Results
The studies originated from North America (n = 26), Europe
(n = 15) and the rest of the world (n = 8). Although there was
evidence that tool development was incremental, with
researchers drawing on previous studies, there was incon-
sistent reporting of the research methods used and it was not
always clear whether the instruments had been validated. The
majority of instruments reported originated in North
America and were derived from those first developed in the
1980s. Three approaches to instrumentation were identified;
first, the development and validation of instruments which
were subsequently used in healthcare education settings
(e.g. Loyd & Gressard 1984, Maurer & Simonson 1984,
Jayasuriya & Caputi 1996); second, those drawing on
previous studies to reproduce or revalidate a refined or
composite instrument (e.g. Agho & Williams 1995, Sinclair
& Gardner 1999, Lynch et al. 2000, Billings et al. 2001,
Cragg et al. 2003, DeBourgh 2003, Brumini et al. 2005, Sit
et al. 2005, Maag 2006); and, third, a small number of
instruments were author-created (e.g. Hollander 1999, Ray
& Hannigan 1999, Dorup, 2004; Balen & Jewesson 2004,
Bello et al. 2004).
Combined results of database searches (n = 2628)
Excluded (n = 2336)
Patient education, Staff/Faculty experience Satisfaction studies Measures of learning styles Qualitative studies Clinical education Simulation studies
Studies for evaluation (n = 292)
Included for review (n = 49)
Excluded (n = 247)
Instrument insufficiently described Experimental designs Non health discipline Unpublished
Figure 1 Selection of papers for review.
Table 1 Keywords used in database searches
Database Keywords
CINAHL Internet, World Wide Web, Information Technology,
Computers and Computerization’, computer literacy,
exp computerized educational testing or computerized
adaptive testing, Computer Environment, Computer
Assisted Instruction, virtual learning, VLE, (web-based
learning or web-based learning), (online adj3 learning),
(e-learning or elearning), (electronic adj3 learning),
(computer$ adj3 learn$), confidence, Fear, anxiety
or anticipatory anxiety, Aptitude, access to information
or remote access to information, expectation$, student
attitudes or student satisfaction, nursing education,
midwifery education, education, allied health or
education, dental hygiene or education, occupational
therapy or education, physical therapy or education,
physician assistants or education, social work
Specific search strategies were developed for BNI, Medline, ERIC,
BEI, AEI Web of Knowledge (ISI), PsycINFO and these may be
requested from the corresponding author.
JAN: REVIEW PAPER Literature review measurement tools
� 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd 757
Table
2In
stru
men
tsm
easu
ring
info
rmati
on
and
com
munic
ati
on
tech
nolo
gy
(IC
T)
skil
ls,
att
itude
toIC
Tand
ICT
for
educa
tion
Co.
Fir
st
Auth
or
(date
)
Stu
dy
des
ign
Sam
ple
,re
sponse
rate
Data
coll
ecti
on
inst
rum
ent
Item
sPsy
chom
etri
cte
stin
gpro
per
ties
US
Maure
r
(1984)
Surv
eyT
est–
rete
stC
olleg
est
uden
ts
(n=
25).
Surv
ey6
norm
gro
ups
Sta
teof
Iow
a
Com
pute
rA
nxie
tyIn
dex
(CA
IN).
Dev
elop
and
validate
ate
stof
com
pute
ranxie
ty
26
Tes
t–re
test
reliabilit
yr
=0Æ9
.
Inte
rnal
consi
sten
cy(I
C)
a=
0Æ9
4
US
Str
onge
(1985)
Surv
eyN
urs
ing
studen
ts(n
=48)
80%
resp
onse
Nurs
es’
att
itudes
tow
ard
sco
mpute
risa
tion
dev
elopm
ent
and
validati
on
of
inst
rum
ent
66
Red
uce
dto
20
item
sw
ith
index
of
dis
crim
inati
on
‡0Æ5
0Spea
rman
Bro
wn
spli
thalf
r=
0Æ9
1
US
Park
s
(1986)
Surv
eyN
urs
ing
studen
tsunder
gra
duate
(n=
124),
Mast
er’s
(n=
105),
nurs
eaca
dem
ics
(n=
71).
Sin
gle
univ
ersi
ty
Nurs
esknow
ledge
of
com
pute
rs(N
KC
)
curr
ent
and
des
ired
NK
C21
Usa
ge
7
Conte
nt
vali
dit
yby
panel
(n=
5).
8
com
ponen
tsIC
a=
0Æ9
1–0Æ9
5
US
Sch
wir
ian
(1989)
Surv
eyR
egis
tere
dnurs
es(n
=358)
nurs
ing
studen
ts(n
=353)
Nurs
es’
att
itudes
tow
ard
sco
mpute
risa
tion
(Str
onge
and
Bro
dt)
ques
tionnair
e.
Psy
chom
etri
cte
stin
gof
exis
ting
tool
17
a0Æ9
5fo
rre
fined
17
item
3fa
ctor
tool
wit
hnurs
es.
Thre
eit
ems
did
not
load
onto
any
fact
or
CN
Dover
(1991)
Surv
eyN
on-r
andom
sam
ple
Y3–4
pre
and
post
regis
trati
on
nurs
ing
studen
ts(p
ilot
n=
8;
n=
73).
Sin
gle
univ
ersi
ty
Ques
tionnai
reit
ems
dra
wn
from
pri
or
studie
s.U
sed
for
clin
ical
pra
ctic
e,
adm
inis
trat
ion
and
learn
ing,
com
fort
wit
h
and
use
of
com
pute
rs
142
Item
sam
ended
for
face
vali
dit
yPilot
wit
h8
studen
tsno
furt
her
vali
dati
on
US
Wil
son
(1991)
Surv
eyN
urs
ing
( n=
272)
from
5in
stit
uti
ons
Com
pute
rA
nxie
tyIn
dex
(Maure
rand
Sim
onso
n)
The
effe
ctof
hands-
on
com
pute
rex
per
ience
on
com
pute
ranxie
ty
26
3Fact
ors
reanxie
ty:
posi
tive
use
fuln
ess
(12
item
s);
expre
ssed
fear
of
com
pute
rs
(5it
ems)
;dis
like
and
mis
trust
of
com
pute
rs(9
item
s)
US
Sca
rpa
(1992)
Surv
eyH
osp
ital
Nurs
es(n
=136)
Nurs
es’
Att
itudes
tow
ard
sC
om
pute
risa
tion
(Str
onge
and
Bro
dt)
ques
tionnair
e.
Psy
chom
etri
cte
stin
gof
exis
ting
tool
20
a0Æ9
0.
Fiv
efa
ctors
iden
tified
but
3it
ems
did
not
load
onto
asi
ngle
fact
or
US
Agho
(1995)
Surv
eyR
andom
sam
ple
of
acc
redit
ed
Sch
ools
.
All
ied
hea
lth
studen
ts
Hle
vel
(n=
377)
1.
Maure
r&
Sim
onso
nC
om
pute
rO
pin
ion
Surv
ey(C
OS).
2.
Modifi
edPark
set
al.
Com
pute
rK
now
ledge
Surv
ey(C
KS)
tore
port
att
itudes
toco
mpute
rs
and
gaps
inco
mpute
rli
tera
cy.
1=
26
2=
NR
1.
CO
Sa
=0Æ9
4,
2.
CK
Sa
=0Æ9
5
US
Sto
ckto
n
(1995)
Surv
eyH
osp
ital
nurs
esT
1(n
=391)
45%
resp
onse
T2
(n=
265)
36%
resp
onse
.
Str
onge
&B
rodt
NA
TC
ques
tionnair
e.Pre
post
com
pute
risa
tion
enable
dfa
ctor
analy
sis
and
reli
abil
ity
test
20
T1
a=
0Æ9
3T
2a
=92
Thre
efa
ctors
iden
tified
:C
om
pute
rsand
pati
ent
care
,
Com
pute
rsand
per
sonal
secu
rity
,
Gen
eral
att
itude
AU
Jayasu
riya
(1996)
Surv
eyPhase
1under
graduate
nurs
es
(n=
145)
resp
onse
70%
Phase
2yea
r1
nurs
ing
studen
ts(n
=71)
hosp
ital
nurs
es(n
=99)
Nurs
es’
Com
pute
rA
ttit
udes
Inven
tory
(NC
AT
T)
and
Dam
bro
tsC
om
pute
rA
ttit
ude
Sca
le(C
AT
T)
tote
stco
ncu
rren
tvalidit
yR
efinin
gand
ass
essi
ng
inst
rum
ent
22
a=
0Æ9
5In
stru
men
tre
duce
dfr
om
40
to22
item
sfo
llow
ing
fact
or
anal
ysi
s.
Const
ruct
Com
pute
rA
ttit
udes
mult
idim
ensi
onal
A. Wilkinson et al.
758 � 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd
Table
2(C
onti
nued
)
Co.
Fir
st
Auth
or
(date
)
Stu
dy
des
ign
Sam
ple
,re
sponse
rate
Dat
aco
llec
tion
inst
rum
ent
Item
sPsy
chom
etri
cte
stin
gpro
per
ties
CN
McB
ride
(1996)
Surv
eyR
egis
tere
dnurs
es(n
=394),
42%
resp
onse
;nurs
ing
studen
ts
(n=
299),
60%
resp
onse
.H
osp
ital
and
univ
ersi
ty.
Nurs
es’
Att
itudes
tow
ard
sC
om
pute
risa
tion
(Str
onge
&B
rodt)
ques
tionnair
e.Psy
chom
etri
c
test
ing
of
exis
ting
tool
20
Tw
osu
b-s
cale
sin
studen
tsa
mple
poor
Inte
rnal
Consi
sten
cy.
Fact
or
analy
sis
sugges
ted
pro
ble
ms
wit
hco
nst
ruct
vali
dit
y.a
vari
edbet
wee
nsa
mple
s
and
sub-s
cale
s
US
Wil
liam
s
(1996)
Surv
eyR
andom
sam
ple
of
pro
gra
ms
(n=
5),
physi
oth
erapy
studen
ts(n
=160)
nati
onal
surv
ey
1.
Maure
r&
Sim
onso
nC
om
pute
rO
pin
ion
Surv
ey(C
OS)
2.
Park
set
al.
Com
pute
rK
now
ledge
Surv
ey
(CK
S)O
pin
ions
about
com
pute
rs,
self
ass
essm
ent
of
curr
ent
and
des
ired
know
ledge,
curr
ent
use
26
20
1.
CO
Sa
=0Æ9
4Sin
gle
fact
or
solu
tion
2.
CK
Sa
=0Æ9
5
FI
Sara
nto
(1997)
Surv
eyR
andom
sam
ple
from
nati
onal
cohort
gra
duat
ing
nurs
ing
studen
ts(n
=373)
resp
onse
62%
5part
ques
tionnair
eon
per
cepti
ons
of
learn
ing
envir
onm
ent
(LE
);L
earn
ing
IT(I
T)
and
vie
ws
on
com
pute
risa
tion
inhea
lth
care
(HC
).A
uth
or
dev
eloped
wit
hre
fere
nce
topre
vious
rese
arc
h
15
LE
18
IT
32
HC
Item
analy
sis
afo
rgro
ups
of
item
s
Neg
ati
ve
IT=
0Æ9
;IT
use
ful
=0Æ8
;
+ve
att
itude
tost
udyin
gIT
=0Æ7
;
�ve
att
itude
tost
udyin
gIT
=0Æ6
;
exper
ience
of
teac
hin
g=
0Æ7
;�
ve
ITfo
rnurs
epra
ctic
e=
0Æ6
;In
tere
st
use
of
IT=
0Æ5
US
Bach
man
(1998)
Pre
–post
surv
ey
RN
-MSN
nurs
ing
studen
ts(n
=20)
Non-e
quiv
ale
nt
contr
ol
( n=
23).
Sin
gle
univ
ersi
ty
Ques
tionnai
rein
cludin
gth
eStr
onge
&
Bro
dt
Nurs
es’
Att
itudes
Tow
ard
Com
pute
riza
tion
Ques
tionnair
euse
dfo
r
pil
ot
Inte
rnet
cours
eon
info
rmat
ion
syst
ems
inhea
lth
care
20
a=
0Æ9
0pre
test
0Æ8
6post
test
.
Per
ceiv
edco
mpute
rsk
illa
=0Æ8
9
and
0Æ8
8re
spec
tivel
y
UK
Gri
gg
(1999)
Surv
eyFin
al
yea
rden
tal
studen
ts1996
(n=
44)
88%
resp
onse
,1997
(n=
42)
86%
resp
onse
Ques
tionnai
re.
Per
cepti
on
of
ITsk
ills
and
att
itude
toIT
for
two
cohort
s
52
No
evid
ence
of
validati
on
US
Holl
ander
(1999)
Surv
eyM
edic
al
studen
ts(n
=208).
60%
resp
onse
.Sin
gle
inst
ituti
on
over
2yea
rs
E-m
ail
ques
tionnair
e.Four
cohort
sper
cepti
on
of
ITsk
ills
and
ow
ner
ship
of
com
pute
rs
NR
No
evid
ence
of
validati
on
IER
ay
(1999)
Surv
eyD
enta
lst
uden
ts(n
=140)
Ques
tionnai
reC
om
pute
rlite
racy
No
evid
ence
of
validati
on
UK
-NI
Sin
clai
r
(1999)
Surv
eyD
iplo
ma
nurs
es2
yea
r1
cohort
s
(n=
745)
resp
onse
100%
.
Sin
gle
univ
ersi
ty
Ques
tionnai
reder
ived
from
MacM
ahon,
unpubli
shed
data
(1997)
and
Loyd
and
Gre
ssard
(1984)
Sel
fass
ess
com
pet
ence
(SA
),att
itudes
(A)
again
stsi
mple
know
ledge
test
(K)
SA
=N
R
A=
20
K=
16
Fact
or
anal
ysi
sof
att
itude
item
s
show
edth
ree
fact
ors
;co
nfiden
ce
8it
ems,
a=
9;
moti
vati
on
touse
,
8it
ems
a=
0Æ8
,per
ceiv
edca
reer
rela
ted
import
ance
3it
ems
a=
0Æ7
JAN: REVIEW PAPER Literature review measurement tools
� 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd 759
Table
2(C
onti
nued
)
Co.
Fir
st
Auth
or
(date
)
Stu
dy
des
ign
Sam
ple
,re
sponse
rate
Data
collec
tion
inst
rum
ent
Item
sPsy
chom
etri
cte
stin
gpro
per
ties
US
Lynch
(2000)
Surv
eyY
ear
1–4
med
ical
studen
ts(n
=301),
resp
onse
90%
Item
sfr
om
Com
pute
rO
pin
ion
Surv
ey
(Loyd
and
Gre
ssard
)and
Com
pute
rA
ttit
ude
Sca
le(M
aure
rand
Sim
onso
n)
new
Opin
ions
About
Com
pute
rs(O
AC
)sc
ale
toex
am
ine
pre
pare
dnes
sfo
rco
mpute
rbase
dte
stin
g(C
BT
)
OA
C=
8O
AC
a=
0Æ7
9L
ow
erth
an
the
scale
s
from
whic
hder
ived
US
Bil
lings
(2001)
Pil
ot
surv
ey
Under
gra
duate
and
gra
duat
e
Nurs
ing
studen
ts(n
=219),
3sc
hools
of
nurs
ing
Evalu
ati
ng
Educa
tional
Use
sof
the
Inte
rnet
(EE
UW
IN)
adap
ted
from
Fla
shli
ght
pro
gra
mm
eC
urr
ent
Stu
den
t
Inven
tory
(CSI
)online
Ben
chm
ark
ing
WB
L
40
WB
L
10
dem
ogra
phic
data
a=
0Æ8
5
US
Dugga
n
(2001)
Surv
ey4-s
tep
sam
ple
(n=
395);
scala
bil
ity
(n=
70);
oper
ati
onali
sati
on
(n=
69),
pil
ot
(n=
68);
Fin
al(n
=188).
Sin
gle
univ
ersi
ty
Att
itudes
Tow
ard
Educa
tional
Use
of
Inte
rnet
(AT
EU
I)D
evel
opm
ent
and
vali
dati
on
of
inst
rum
ent
test
edw
ith
com
munic
ati
on
and
hea
lth
pro
moti
on
studen
ts
18
Fin
alA
TE
UIa
=0Æ9
CN
Ata
ck
(2002)
Surv
eyR
egis
tere
dN
urs
es(n
=28)
single
cours
e.R
esponse
49%
Auth
or
dev
eloped
Lea
rner
Dem
ogra
phic
(LD
)
Onli
ne
Lea
rner
Support
Inst
rum
ent
(OL
SI)
-
tom
easu
reIn
tera
ctio
n,
Cours
e,T
echnolo
gy,
Envir
onm
ent
and
Impre
ssio
ns.
Sin
gle
module
web
-bas
edpost
dip
lom
a
LD
=26
OL
SI
=56
a=
0Æ9
5fo
r45
item
OL
SI
wit
hout
Envir
onm
ent
subsc
ale
a=
06
work
envir
onm
ent
a=
0Æ8
hom
een
vir
onm
ent
IEC
urt
is
(2002)
Surv
eyPost
-reg
istr
ati
on
nurs
es.
Pilot
(n=
10)
Main
study
(n=
74).
Res
ponse
rate
62%
Univ
ersi
ty
Am
ended
ques
tionnair
eN
urs
ing
Stu
den
ts’
Exper
ience
sand
Att
itudes
toC
om
pute
rs
(Sin
clai
r&
Gard
ner
)
No
vali
dati
on.
Nurs
ing
Deg
ree
pro
gra
mm
e
50
Inst
rum
ent
revie
wed
by
2st
ati
stic
ians
and
ITco
nsu
ltant
pri
or
topil
ot.
SE
Matt
heo
s
(2002)
Surv
eyD
enta
lst
uden
ts(n
=590)
sam
ple
dfr
om
den
tal
schools
(n=
16).
Res
ponse
80–85%
.9
countr
ies
Euro
pea
nD
enta
lStu
den
tsA
ssoci
ati
on
(ED
SA
)
Ques
tionnair
e.C
om
pute
rco
mpet
ence
and
att
itudes
,E
uro
pea
nst
udy.
Furt
her
item
s(2
2)
reden
tal
educa
tion
not
dis
cuss
ed
10
per
son
data
and
ICT
No
evid
ence
of
vali
dati
on
US
Sea
go
(2002)
Surv
eyY
1m
edic
al
studen
tsaver
age
resp
onse
rate
81%
(n=
aver
age
171
per
annum
)
10
yea
rcy
cle
of
Med
ical
Stu
den
tC
om
pute
r
Exper
ience
Surv
ey1991–2000
16
Yea
r1
23
Yea
r10
No
evid
ence
of
vali
dati
on.
15
item
sco
mm
on
toall
surv
eys.
US
Ste
ele
(2002)
Surv
eyM
edic
al
studen
ts(n
=150)
single
univ
ersi
ty
Com
pute
rA
ttit
ude
Surv
ey&
Rez
ler
Lea
rnin
g
Pre
fere
nce
sIn
ven
tory
.C
AI
Angio
gra
phy
Cas-
g16
CA
S-e
10
Cas-
p20
Not
revalidate
d
UK
Wis
har
t
(2002)
Surv
eyN
urs
ing
studen
ts(n
=154)
and
teach
ers
(n=
128)
Ques
tionnair
ein
cludin
gD
utt
wei
ler’
sIn
tern
al
Locu
sof
Contr
ol
Index
(IL
CI)
,att
itudes
tow
ard
sco
mpute
rs(A
C)
ILC
I28
AC
7
ILC
pre
vio
usl
yvalidate
d(1
984)
no
furt
her
vali
dati
on
US
Blo
om
(2003)
Surv
eyN
urs
ing
studen
ts(n
=165)
studen
ts
inhea
lth
scie
nce
(n=
206).
Pil
ot
study
(n=
36)
Sin
gle
inst
ituti
on
Auth
or
dev
eloped
ques
tionnair
e.R
esponse
s
tote
chnolo
gy
enhance
dfa
ceto
face
educa
tion
36
intw
o
sect
ions
3unst
ruct
ure
d
Inst
rum
ent
revie
wed
by
mult
iple
rate
rs
from
inst
ituti
on.
Item
sre
exper
ience
and
com
fort
wit
hte
chnolo
gy
enhance
d
learn
ing
a=
0Æ8
5
A. Wilkinson et al.
760 � 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd
Table
2(C
onti
nued
)
Co.
Fir
st
Auth
or
(date
)
Stu
dy
des
ign
Sam
ple
,re
sponse
rate
Data
collec
tion
inst
rum
ent
Item
sPsy
chom
etri
cte
stin
gpro
per
ties
CN
Cra
gg
(2003)
Surv
eyR
andom
sam
ple
of
hosp
ital
(n=
291,
58%
)and
nurs
ing
studen
ts(n
=207)
Sourc
esof
Pra
ctic
eK
now
ledge
(SPK
);A
ttit
udes
Tow
ard
Com
pute
rs(A
C)
mult
idim
ensi
onal;
Com
pute
rand
Inte
rnet
Confiden
ceand
Com
pute
rand
Inte
rnet
Com
fort
.
Sca
les
modifi
edby
auth
ors
.
To
ass
ess
barr
iers
and
faci
lita
tors
of
web
-
base
ded
uca
tion
SPK
18
Oth
erit
ems
not
report
ed
Sub-s
cale
s:co
mfo
rta
=0Æ7
4,
effica
cy
a=
0Æ8
5,
inte
rest
a=
0Æ7
7,
uti
lity
bel
iefs
a=
0Æ7
2,
aff
ord
abil
ity
a=
0Æ6
4;
Com
pute
ra
=0Æ9
6and
Inte
rnet
confiden
cea
=0Æ9
8;
Com
pute
ra
=0Æ9
3
and
Inte
rnet
com
fort
a=
0Æ9
5
US
DeB
ourg
h
(2003)
Corr
elat-
ional
rese
arc
h
des
ign
Post
-gra
duat
enurs
es(n
=43,
100%
)
resp
onse
.U
niv
ersi
ty
Stu
den
tSati
sfact
ion
Surv
ey(S
SS)
adapte
d
from
Tel
ecours
eE
valu
ati
on
Ques
tionnair
e
(Bin
er).
Dis
tance
module
SSS
59
Tec
hnolo
gy
and
tech
nolo
gyco
mpet
ence
a=
0Æ7
8;
bet
wee
ncl
ass
use
of
com
munic
ati
on
tech
nolo
gies
a=
0Æ8
5;
sati
sfac
tion
a=
0Æ8
8;
inst
ruct
or/
inst
ruct
ion
a=
0Æ8
9;
cours
em
anagem
ent
a=
0Æ4
1;
exper
ience
wit
hte
chnolo
gy
cours
esa
=0Æ1
1
UK
Walm
sley
(2003)
Surv
eyY
ears
1–3
den
tal
studen
ts(n
=145)
81%
resp
onse
.st
aff
(n=
22)
100%
resp
onse
.Sin
gle
univ
ersi
ty
Ques
tionnair
ere
port
ing
staff
and
studen
t
att
itudes
toth
euse
of
the
Inte
rnet
.In
stru
men
t
publi
shed
19
som
e
qualita
tive
Pil
ot
study
no
oth
ervalidati
ons
report
ed
CN
Bale
n
(2004)
Surv
eyH
osp
ital
pharm
acis
ts(n
=58)
55%
resp
onse
rate
.T
wo
hosp
itals
Ass
essi
ng
base
line
com
pute
rsk
ills
,use
and
train
ing
nee
ds.
Item
sdra
wn
from
lite
ratu
re
84
No
evid
ence
of
validati
on
NG
Bel
lo
(2004)
Surv
eyM
edic
al
&hea
lth
reco
rdst
aff
&
studen
ts(n
=148)
resp
onse
rate
82%
Hosp
ital
Ques
tionnair
eass
essi
ng
level
of
train
ing
and
use
of
IT
19
com
pute
r
know
ledge
16
att
itude
and
uti
lisa
tion
No
evid
ence
of
validati
on
DK
Doru
p
(2004)
Longit
udin
al
surv
ey
Yea
r1
med
ical
studen
tsn
=1159
over
5yea
rs.
79%
resp
onse
.
Sin
gle
univ
ersi
ty
Web
-base
dques
tionnair
ere
late
dto
IT
acc
ess
and
att
itudes
tow
ard
susi
ng
IT
for
learn
ing.
Adm
inis
tere
din
ITsk
ills
cours
e
Appen
dix
20
mix
edit
ems
No
evid
ence
of
validati
on
NZ
Honey
(2004)
Surv
eyPost
-gra
duat
enurs
es(n
=146)
resp
onse
90%
.Sin
gle
school
of
nurs
ing
Ques
tionnair
ew
ith
item
sfr
om
earl
ier
studie
s.
Acc
ess,
pro
fici
ency
,sk
ills
,use
of
dig
ital
reso
urc
esand
barr
iers
.
Sco
pin
gfe
asi
bil
ity
of
intr
oduci
ng
flex
ible
learn
ing
36
item
s?N
ot
fully
report
ed
No
evid
ence
of
validati
on
FI
Vuore
la
(2004)
Pre
–post
surv
ey
Med
ical
(n=
21)
and
soci
olo
gy
(n=
21)
studen
ts.
Res
ponse
pre
test
90%
post
-tes
t76%
Att
itude
Tow
ard
Beh
avio
ur,
Com
pute
r
Sel
f-E
ffica
cySca
le(C
SE
)part
of
Appro
ach
es
and
Stu
dy
Skills
Inven
tory
(ASSI)
,C
om
pute
r
Sta
teA
nxie
ty(C
SA
),E
valu
ati
on
of
theo
ry
of
pla
nned
beh
avio
ur
(TPB
)as
expla
nati
on
of
studen
tuse
of
WB
L
Att
itude
16
CSE
10
CSA
20
ASSI
18
item
s
insu
bsc
ale
s
CSE
a=
0Æ9
4;
CSA
a=
0Æ9
2;
ASSIa
=0Æ5
2�
0Æ8
5
JAN: REVIEW PAPER Literature review measurement tools
� 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd 761
Table
2(C
onti
nued
)
Co.
Fir
st
Auth
or
(date
)
Stu
dy
des
ign
Sam
ple
,re
sponse
rate
Data
collec
tion
inst
rum
ent
Item
sPsy
chom
etri
cte
stin
gpro
per
ties
UK
Wil
kin
son
(2004)
Pre
–post
surv
ey
Reg
iste
red
nurs
es(p
ren
=29,
post
n=
28).
Sin
gle
inst
ituti
on
Auth
or
dev
eloped
pil
ot
ques
tionnair
e,
Explo
rati
on
of
per
cepti
ons
of
four
web
-bas
edle
arn
ing
cours
es
49
in7
subsc
ale
sA
lpha
for
sub-s
cale
svari
ed0Æ7
–0Æ0
Æ9.
Not
full
yvali
date
d
US
Bil
lings
etal
.(2
005)
Surv
eyG
raduate
and
under
graduate
nurs
ing
studen
ts(n
=558).
6sc
hools
of
nurs
ing
EE
UW
INonline
explo
ring
dif
fere
nce
sbet
wee
n
gra
duat
eand
under
gra
duate
exper
ience
57
a=
0Æ9
4.
Rel
iabil
ity
of
sub-s
cale
sra
nged
from
0Æ7
3–0Æ9
3
HR
Bru
min
i
(2005)
Surv
eyH
osp
ital
nurs
es(n
=1081).
Res
ponse
96%
Modifi
edStr
onge
and
Bro
dt
Nurs
es’
Att
itude
Tow
ard
Com
pute
rs(N
AT
C)
inst
rum
ent
use
d
inth
ew
ork
pla
ce
30
a=
0Æ8
6fo
rm
odifi
edN
AT
C
SE
Masi
ello
(2005)
Pre
–post
surv
ey
Yea
rone
med
ical
studen
ts(n
=54)
49%
resp
onse
rate
.Sin
gle
cours
e
ITle
arn
ing
ques
tionnair
e,base
don
pre
vio
us
and
auth
or
dev
eloped
item
s,to
mea
sure
readin
ess
and
att
itudes
tole
arn
ing.
Evalu
ati
on
of
ale
arn
ing
managem
ent
syst
emte
chnolo
gy.
Subsc
ale
sIT
Ori
enta
tion
(IT
);In
dep
enden
tO
rien
tati
on
(IO
)
IT6
+ve
IO7
+ve
BO
10
ITa
=0Æ7
3;
IOco
nce
rnin
gle
arn
ing
support
edby
tech
nolo
gy
a=
0Æ7
5;
Ble
nded
Ori
enta
tion
(BO
)re
gard
ing
the
com
bin
ati
on
ITand
face
tofa
ce
inte
ract
ion
wit
hst
aff
/stu
den
tsfo
r
learn
ing,
(a=
0Æ8
8)
CN
Math
ur
(2005)
Surv
eyQ
uali
fied
physi
cal
ther
apis
ts
(n=
732).
56%
resp
onse
.T
wo
stage
Pil
ot
(n=
31),
(n=
25)
Auth
or
dev
eloped
ques
tionnair
e;part
two
surv
eyed
inte
rest
indif
fere
nt
modes
of
learn
ing
Mea
suri
ng
inte
rest
inco
mpute
r
ass
iste
dle
arn
ing,
dis
tance
&C
D-R
OM
NR
2part
pil
ot
for
face
vali
dit
y.
No
test
–re
test
for
reli
abil
ity
JOR
aja
b
(2005)
Surv
eyY
ears
2–5
den
tal
studen
ts(n
=268)
resp
onse
81%
.si
ngle
univ
ersi
ty
Ques
tionnair
edra
wn
from
pre
vious
den
tal
surv
eys
inU
K.
Know
ledge
skil
lsand
exper
ience
of
ICT
28
No
evid
ence
of
vali
dati
on
AU
Sala
monso
n
(2005)
Surv
eyN
urs
esPil
ot
(n=
42)
main
(n=
143)
Sin
gle
univ
ersi
ty
Auth
or
dev
eloped
Stu
den
ts’
Pre
fere
nce
of
Cours
e
Form
at
(SPO
CF)
scale
.D
raw
nfr
om
pre
viousl
y
vali
date
dStu
den
ts’
Evalu
ati
on
of
Educa
tional
Quality
(SE
EQ
)su
rvey
item
bank
20
a=
0Æ9
3w
hole
scale
Fact
or
1Pre
fers
tradit
ional
form
ata
=0Æ8
7
Fact
or
2Pre
fers
hybri
dfo
rmat
a=
0Æ9
1
HK
Sit
(2005)
Surv
eyPost
regis
trati
on
nurs
es(n
=198)
resp
onse
50%
Ques
tionnair
ebase
don
Fla
shli
ght
pro
gra
m
CSI
and
focu
sgro
up.
onli
ne
learn
ing
27
No
evid
ence
of
vali
dati
on
IEA
dam
s
(2006)
Surv
eyPost
regis
trati
on
nurs
es(n
=32).
Res
ponse
73%
Sin
gle
univ
ersi
ty
Ques
tionnair
edev
eloped
from
lite
ratu
re
tore
port
changes
insk
ill
over
tim
eand
rela
tionsh
ips
bet
wee
nst
uden
tIT
skills
and
ara
nge
of
vari
able
s
32
a=
0Æ8
6
AU
Heg
ney
(2006)
Surv
eyN
ati
onal
surv
eyre
gis
tere
dnurs
es
n=
(4300).
Res
ponse
43%
Auth
or
des
igned
ques
tionnair
eT
odet
erm
ine
acc
ess,
use
and
barr
iers
touse
of
ITby
nurs
es
77
Face
and
conte
nt
validit
yvia
inte
rvie
ws
and
pil
ot
A. Wilkinson et al.
762 � 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd
The literature fell into two groups in focus and method:
studies from the fields of dentistry, medicine and pharmacy
and those from nursing and allied health professions.
Dentistry, medicine and pharmacy
Information and communication technology skills and
literacy
In dental, medical and pharmacy education the majority of
studies used self-report surveys of students’ ICT skills,
information literacy and computer ownership (Grigg &
Stephens 1999, Hollander 1999, Ray & Hannigan 1999,
Lynch et al. 2000, Dorup, 2001, Mattheos et al. 2002, Seago
et al. 2002, Walmsley et al. 2003, Balen & Jewesson 2004,
Bello et al. 2004, Rajab et al. 2005) rather than educational
use. Questionnaires, with the exception of that by Lynch
et al. (2000), were author-developed, with little reported on
validation. Samples were homogeneous and demographic
variables other than sex were rarely reported. A USA cross-
sectional survey of medical students (Lynch et al. 2000)
examined preparedness for computer-based testing (CBT)
using eight items taken from the Loyd and Gressard (1984)
Opinions about Computers Scale and Maurer and Simon-
son’s (1984) Computer Anxiety Scale. Internal consistency of
the modified scale (a=0Æ79), although good, was lower than
for the original scales (a = 0Æ94 and 0Æ95 respectively), which
raises questions about the reliability of the modified scale.
Lynch et al. (2000) isolated three predictive factors indicating
preparedness for CBT: opinions about computers; sex and
sex interacting with previous experience of CBT.
A number of researchers surveyed successive cohorts of
dental or medical students (Grigg & Stephens 1999, Seago
et al. 2002, Dorup 2004) or, simultaneously, several year-
groups (Hollander 1999, Lynch et al. 2000, Walmsley et al.
2003, Rajab et al. 2005). Repeated surveys indicated that
students’ reported that their ICT skills improved over time;
their skills were not always sufficient for their course, and
they needed further training (Grigg & Stephens 1999,
Mattheos et al. 2002). These studies clearly built on the
experiences in previous studies; for example, Rajab et al.
(2005) derived their items from three previous dental surveys
(Grigg & Stephens 1999, Mattheos et al. 2002, Walmsley
et al. 2003) but no psychometric data were reported.
E-learning in medicine
Four further studies explored attitudes to e-learning among
medical students. A US study of medical students (Steele et al.
2002) used a combination of two previously-published scales
to create a two-part Computer Attitude Survey (CAS). Sub-
scale CAS-g, previously validated with healthcareTable
2(C
onti
nued
)
Co.
Fir
st
Auth
or
(date
)
Stu
dy
des
ign
Sam
ple
,re
sponse
rate
Dat
aco
llec
tion
inst
rum
ent
Item
sPsy
chom
etri
cte
stin
gpro
per
ties
AT
Lin
k
(2006)
Surv
eyY
ear
1M
edic
al
studen
ts(n
=1160)
resp
onse
79%
single
inst
ituti
on
Ques
tionnai
reonli
ne.
Att
itude
and
exper
ience
of
e-le
arn
ing,
usa
ge
and
pri
vate
acc
ess
Com
ple
ted
duri
ng
intr
oduct
ory
cours
e
on
CB
T/W
BT
NR
3it
emsu
bsc
ale
use
fuln
ess
of
e-le
arn
ing
a=
0Æ6
5A
ddin
g2
furt
her
item
s
reduce
dre
liabil
ity
US
Maag
(2006)
Surv
eyC
onven
ience
sam
ple
under
gra
duate
and
gra
duat
enurs
est
uden
ts(n
=721)
�7%
resp
onse
.U
SSO
N(n
=21)
Ques
tionnai
repaper
and
onli
ne.
Incl
uded
modifi
edT
echnolo
gy
Att
itude
Sca
le(T
AS)
and
self
report
of
com
pute
rapplica
tion
educa
tion
TA
S15
20
item
TA
Sori
gin
all
yvali
date
dw
ith
teach
ers.
Conte
nt
validit
yby
auth
or.
Pil
ot
paper
only
a=
0Æ8
8.
Main
a=
0Æ8
9Fact
or
analy
sis
2fa
ctor
scale
:1.
posi
tive
TA
a=
0Æ9
1;
2.
neg
ativ
eT
Aa
=0Æ8
8
TW
Yu (2
006)
Surv
eyPubli
cH
ealt
hN
urs
es(P
HN
),
random
sam
ple
from
369
hea
lth
centr
es(n
=329)
resp
onse
84%
Auth
or
dev
eloped
Basi
cC
om
pute
r
Com
pet
ence
(BA
C)
and
Sca
leof
Att
itude
toW
eb-b
ase
dL
earn
ing
(AW
BL
)U
nder
standin
g
att
itudes
tow
eb-b
ased
learn
ing
BA
C26
AW
EU
16
BA
Ca
=0Æ9
2A
BW
La
=0Æ8
7
JAN: REVIEW PAPER Literature review measurement tools
� 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd 763
professionals and students in practice (Startsman & Robinson
1972), surveyed general attitudes to computers, and CAS-e
explored attitudes and comfort with computers for education.
Post-learning intervention respondents also completed CAS-p
evaluating the computer assisted instruction. No details of
validation of the modified scales were given, which compro-
mises the results, given the different sample and the time
elapsed since some items were developed. In Finland, Vuorela
and Nummenmaa (2004) explored medical and sociology
students’ performance and self-confidence in a web-based
collaborative learning environment, predicting that those who
reported positive attitudes and high computer self-efficacy
would engage with the environment. They used five scales:
attitude measurement; computer self-efficacy (Compeau &
Higgins 1995); approaches to learning; computer state anxi-
ety. Vuorela and Nummenmaa (2004) found that expectation,
confidence and learning approach could not be used to predict
outcomes in the learning environment in their sample.
A Swedish study (Masiello et al. 2005) employed an IT-
Learning Questionnaire, with items from two previous
studies and new items. Pre-existing scales were presumed to
be more reliable, although the papers cited (Dewhurst et al.
2000, Slotte et al. 2001) presented no information about
validation. The internal consistency of sub-scales was satis-
factory and three principal components were identified: IT
Orientation, Independent Orientation and Blended Orienta-
tion. These three constructs explained 49% of the variance,
which is just under the 50–60% required to agree factor
structure (Netemeyer et al. 2003). Finally, an online study of
Austrian medical students (Link et al. 2006) examined
computer literacy, computer and Internet use and attitudes
to e-learning. An index on usefulness of e-learning was found
to be moderately reliable, but including two additional items
reduced reliability. No further validation was reported.
Nursing and allied healthcare professions
More systematic efforts to develop or adapt instruments to
measure students’ attitudes to computers and experience of
e-learning are found in the nursing and allied healthcare
literature (Table 3). Few instruments, however, have been
repeatedly used and tested.
Attitudes to computers
The presence of anxiety is considered likely to affect perfor-
mance; thus, Maurer and Simonson (1984) sought items which
would describe behaviour likely to indicate anxiety. They drew
on previous measures of anxiety, and added new items
generated by students; these were then reduced and modified in
two pilot tests. The instrument was then tested for reliability
using test–retest a = 0Æ90, yielding internal consistency of
r = 0Æ94 on test-retest and r = 0Æ96 using a random sample
from a normative study. The new instrument was correlated
against responses to a separate generalized measure of anxiety
and observation of students using computers when they were
assessed as anxious; neutral or comfortable. The refined
instrument was then further validated in a state-wide norma-
tive study with computer professionals, computer users, school
and university students, staff and a non-specific group. It has
been used in studies in nursing (Wilson 1991), allied healthcare
(Agho & Williams 1995, Williams et al. 1996) and medicine
(Lynch et al. 2000). In a US study the unmodified Computer
Anxiety Index (CAIN) (Wilson 1991) was used to test levels of
computer anxiety experienced by students in five schools of
nursing, whether anxiety varied in relation to level of computer
experience and whether there were differences between degree
and associate degree students. While no difference was found
between associate and degree students, more practical experi-
ence of computers was associated with less anxiety. Wilson
(1991) concluded that the CAIN was a valid measure of anxiety
with computers and measured three separate factors: positive
usefulness, expressed fear of computers, and dislike and mis-
trust of computers. Agho and Williams (1995) and Williams
et al. (1996) explored US allied healthcare students’ attitudes to
computers and perceptions of computer literacy using CAIN
(Maurer & Simonson 1984) and a modified computer knowl-
edge survey (Parks et al. 1986). They found the instruments to
have high reliability in their study and the 26 items of Maurer
and Simonson (1984) formed a single factor (Table 2).
Stronge and Brodt (1985) developed the Nurses’ Attitudes
Towards Computerisation (NATC). The initial 66 item self-
report questionnaire was reduced to 20 items in a pilot study
in the workplace with US nursing students. They proposed
the instrument as a reliable 6-factor scale but the sub-scales
were challenged in later studies with larger samples. It has
been adopted, adapted or revalidated (Table 4) by a number
of authors for use with both Registered Nurses and nursing
students (Schwirian et al. 1989, Scarpa et al. 1992, Stockton
& Verhey 1995, Jayasuriya & Caputi 1996, McBride &
Nagle 1996, Bachman & Panzarine 1998, Brumini et al.
2005). Schwirian et al. (1989) used the NATC in a compar-
ative study of nursing students and Registered Nurses. While
confirming that overall reliability was high, they proposed
three subscales: Computers and Patient Care, Computers and
Personal Security, and General Attitude. Three items, how-
ever, did not fit into any construct and there were small
variations in the factor loadings between students and nurses.
A replication study (Scarpa et al. 1992) with a sample of
nurses with varying demographic profiles showed that
only previous computer experience was related to positive
A. Wilkinson et al.
764 � 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd
attitude. While they established similar reliability to that in
the previous study, their factor analysis identified five factors
different from those of Stronge and Brodt (1985). Three items
did not load on to a single factor and all positive items loaded
on to one factor. Further testing with larger samples was
proposed.
Stockton and Verhey (1995) conducted reliability testing of
the instrument using US hospital nurses in two phases over
16 months. There were personnel changes between Time 1
and Time 2, but the populations were described as demo-
graphically similar. They confirmed the instrument’s overall
high reliability but expressed doubts about the number of
sub-scales and, after factor analysis, questioned whether, out
of three identified, the factors were independent as the
reliability was reduced in two factors and all the positive
items were located in factor 1.
Jayasuriya and Caputi (1996) retrieved 72 items from
international studies, including Stronge and Brodt’s (1985)
instrument, and reduced the number using a review panel to
yield a 40-item instrument, the Nursing Computer Attitudes
Inventory (NCATT). The instrument was then administered
to nursing students. Following factor analysis, five factors
were identified which contributed to 57% of the variance.
They subsequently used the NCATT instrument with
Australian Registered Nurses in practice and nursing students
at university. The student sample also completed Dambrot
et al. (1985) Computer Attitude Scale (CATT), which was
extracted from a 20-item tool (a = 0Æ84). The NCATT scale
Table 3 Details of computer attitude self-report measures
Instrument Developed by Used or adapted by Used in
Computer Attitude
Scale (30 items,
3 factors, overall
Cronbach’s a = 0Æ95)
Loyd & Gressard
1984
Sinclair & Gardner 2004,
Lynch et al. 2000,
Curtis et al. 2002,
University & Schools;
education, medicine,
nursing
Computer Anxiety Index
(CAIN) (26 items,
test retest r = 0Æ90, overall
Cronbach’s a = 0Æ94)
Maurer & Simonson
1984
Wilson 1991, Williams
et al. 1996, Lynch
et al. 2000, Agho &
Williams 1995,
University, allied health,
medicine, nursing
Nurses attitude toward
Computerisation
(NATC) (20 items,
split half r = 0Æ90)
Stronge & Brodt
1985
Schwirian et al. (1989);
Scarpa et al. (1992);
Stockton & Verhey
1995, Jayasuriya &
Caputi 1996, McBride &
Nagle 1996, Bachman &
Panzarine 1998, Brumini
et al. 2005,
Hospital and University;
nursing
Computer knowledge
survey
Parks et al. 1986 Agho & Williams 1995,
Balen and Jewesson (2004)
drew some items
Staff, students and graduate
students School of Nursing
Computer self-efficacy
10 items IC of
constructs reported >0Æ8
Compeau and
Higgins (1995)
Masiello et al. 2005, Business computing,
medical education
Nursing computer attitudes
inventory (NCATT)
Jayasuriya and
Caputi (1996)
Registered Nurses and
nursing students
Current student inventory
(item bank, no psychometric
information)
Ehrmann, 1997 Billings et al. 2001
Evaluating Educational
Uses of the Internet
(EEUWIN); Sit et al.
2005; Billings et al. 2005,
Schools of Nursing
Technology Attitude Scale (TAS) McFarlane et al., 1997 modified by Maag (2006) Teachers, nursing students
Online Learner Support Instrument
(OLSI) a = 0Æ95
Atack & Rankin, 2002 Registered nurse students
Attitudes to the Educational use
of the Internet (ATEUI)
Duggan et al. 2001 Undergraduate students
(communication, health
promotion)
JAN: REVIEW PAPER Literature review measurement tools
� 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd 765
Table
4N
urs
es’
att
itudes
tow
ard
sco
mpute
risa
tion
(NA
TC
)
Auth
or/
sam
ple
Str
onge
&
Bro
dt
(1985)
n=
48
(80%
resp
onse
)
Sch
wir
ian
etal
.
(1989)
n=
358
nurs
es
n=
353
studen
t
Sca
rpa
etal
.(1
992)
n=
136
(40%
resp
onse
)
Rep
lica
tion
study
Sto
ckto
nand
Ver
hey
(1995)
T1
n=
391
T2
n=
265
(over
all
resp
onse
41%
)
Jayas
uri
ya
and
Caputi
(1996)
A.
n=
145
(70%
resp
onse
)
B.
n=
170
nurs
es
and
studen
ts
McB
ride
and
Nagle
(1996)
n=
362
nurs
es
(42%
)
n=
299
studen
t
(60%
)
Bach
man
and
Panza
rine
(1998)
n=
20
sam
ple
n=
23
non-
equiv
ale
nt
contr
ol
Bru
min
iet
al.
(2005)
(n=
1081)
Num
ber
of
Item
s
66
reduce
dto
20
(14�
ve)
20
reduce
dto
17
20
20
A.
40
renam
ed
(NC
AT
T)
incl
.
Str
onge
&B
rodt
B.
40
reduce
dto
22
20
20
30
(NA
TC
revis
ed
15�
ve
and
+ve)
Cro
nbach
’sa
Spea
rman
Bro
wn
a=
0Æ9
0
r=
0Æ9
0
refined
scale
a=
0Æ9
5nurs
es
a=
0Æ9
2T
1a
=0Æ 9
3
T2
a=
0Æ9
2
1.a
=0Æ9
5
2.a
=0Æ9
5
nurs
esa
=0Æ9
1
studen
ta
=0Æ8
5
pre
test
a=
0Æ9
0.
post
test
a=
0Æ8
6
a=
0Æ8
6
Fact
ors
(n)
Cate
gori
es
pro
pose
d
pre
pilot
them
es
from
lite
ratu
re
1.
Job
secu
rity
2.
Leg
al
ram
ifica
tions
3.
Qual
ity
of
pati
ent
care
4.
Capab
ilit
ies
of
com
pute
rs
5.
Em
plo
yee
wil
lingnes
sto
use
com
pute
rs
6.
Ben
efit
toth
e
inst
ituti
on
Fact
or
analy
sis:
ther
ew
as
vari
ati
on
bet
wee
nnurs
es
and
studen
ts
and
thre
eit
ems
did
not
fit
1.
Com
pute
rs&
pati
ent
care
(9)
a=
0Æ9
4
2.
Com
pute
rs&
Per
sonal
Sec
uri
ty
(4)a
=0Æ7
8
3.
Gen
eral
att
itude
(4)a
=0Æ8
5
Foll
ow
ing
Fact
or
Analy
sis
(63%
of
vari
ance
)
1.
nurs
ing
effici
ency
(5)
(r=
0Æ9
2)
2.
com
pute
r
inef
fici
ency
(5)
(r=
0Æ7
8)
3.
Agen
cy&
soci
etal
impact
(2)
(r=
0Æ8
5)
4.
Lim
itati
ons
of
com
pute
rs(3
)
(r=
0Æ7
8)
5.
Pati
ent
confiden
tiali
ty
(2)
(r=
0Æ9
5)
Thre
eit
ems
did
not
load
Foll
ow
ing
fact
or
analy
sis(
57%
of
vari
ance
)
1.
Com
pute
rs&
pati
ent
care
(8)
(T1
&T
2a
=0Æ9
2)
2.
Com
pute
rs&
per
sonal
secu
rity
(2)
(T1
a=
0Æ7
8,
T2
a=
0Æ7
5)
3.
Gen
eral
att
itude
(3)
(T1
a=
0Æ7
4,
T2
a=
0Æ7
8)
A.
Foll
ow
ing
fact
or
analy
sis
(57%
of
vari
ance
)
1.
Com
pute
rA
nxie
ty
2.
Com
pute
rs&
Pati
ent
Care
3.
Cost
&ef
fici
ency
toin
stit
uti
on
4.
Com
pute
rs&
expansi
on
of
inte
rest
5.
Pati
ent
Confiden
tiali
ty
B.
Foll
ow
ing
fact
or
analy
sis
(90%
of
vari
ance
)
1.
Pati
ent
care
(nurs
esa
=0Æ9
1,
studen
tsa
=0Æ8
0)
2.
Anxie
ty(n
urs
es
a=
0Æ8
8,
studen
tsa
=0Æ9
2)
3.
Confiden
tiali
ty
(nurs
esa
=0Æ7
2,
studen
tsa
=0Æ7
1)
Foll
ow
ing
fact
or
anal
ysi
s(5
3%
nurs
es,
49%
studen
tsof
vari
ance
)
1.
Nurs
esw
ork
(nurs
es7
a=
0Æ8
7,
studen
t6
a=
0Æ8
1)
2.
Org
anis
ati
onal
issu
es(n
urs
es
7a
=0Æ8
1,
4st
uden
ts
a=
0Æ7
4)
3.
Barr
iers
(nurs
es4
a=
0Æ7
4,
studen
ts5
a=
0Æ6
5)
4.
Effi
cien
cy
(stu
den
ts
4a
=0Æ5
4)
Nurs
es:
two
item
s
did
not
fit
Stu
den
ts:
one
dif
fere
nt
item
did
not
fit.
No
report
of
fact
or
analy
sis
Scr
eeplo
t
analy
sis
thre
ehig
hly
corr
elate
d
fact
ors
Pri
nci
pal
com
ponen
t
fact
or
analy
sis
gave
one
fact
or
solu
tion.
A. Wilkinson et al.
766 � 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd
was further reduced to 22 items following factor and item
analysis and correlation with the CATT scale. Jayasuriya and
Caputi (1996) identified three factors which contributed to
90% of the variance. One of the factors: Computer Anxiety
correlated highly with the CATT (r = 0Æ51). They reported
that none of the items were derived from the Stronge and
Brodt (1985) NATC items, which may be a further indication
that they had become dated.
The report of a Canadian cross-sectional study of Regis-
tered Nurses and nursing students also critiqued the Stronge
and Brodt instrument (McBride & Nagle 1996) following a
review of previous reported uses of the scale. The authors
questioned the validity of this scale since their findings could
only explain 50% of the variance for the Registered Nurses
and 48% for the students. This finding is congruent with that
of Stockton and Verhey (1995). McBride and Nagle (1996)
also found greater scale consistency for the Registered Nurses
than the student sample. They suggested that the lack of
consistency may in part be attributed to the age of the scale
reducing item validity. The findings from this group of studies
show considerable variability in the number of factors
identified, which may indicate that either the researchers
are using different criteria in conducting the analysis or that
individual items are not valid.
A US study of Registered Nurses undertaking an Internet-
based course on IT (Bachman & Panzarine 1998) used the
Stronge and Brodt instrument. The aim of the study was to
evaluate the impact of a pilot online course. Internal
consistency of the whole scale was different pre- and post-
intervention. Additional subscales on computer use, per-
ceived computer skill and knowledge of the Internet were
developed by the authors in the absence of appropriate
measures. Content validity was assessed by raters and the
reliability of the Perceived Computer Skill sub-scale was
reported (pre a = 0Æ89 post a = 0Æ88).
The Stronge and Brodt instrument focused predominantly
on the introduction of computers to the workplace and, as
well as being dated, it is also less likely to be valid in an
academic setting. In a two-site workplace study with
Croatian nurses, Brumini et al. (2005) used a modified
version of the NATC, with new items from an unpublished
study. Half the 30 items on attitudes to computers were
negatively phrased. Having performed factor analysis, they
decided to work with a 1-factor solution. Limitations of their
study included the cross-sectional design and respondents
being observed as they completed the survey.
Two nursing studies (Curtis et al. 2002, Sinclair &
Gardner 1999) drew on Loyd and Gressard’s (1984) Com-
puter Attitude Scale developed for use in schools. Sinclair and
Gardner (1999) surveyed diploma nursing students in North-
ern Ireland to measure their perceived competence, attitudes
and previous IT training against a knowledge test. Three
factors were identified: confidence in using computers,
motivation to use, and perception of career-related impor-
tance of computers. Those with previous knowledge and
training had statistically significantly higher levels of confi-
dence (P < 0Æ001) and motivation (P < 0Æ01) but there was
no statistically significant difference in their perception of
career-related importance. Sinclair and Gardner (1999)
recommended a change from identifying students’ basic skills
to identifying their ability to apply those skills in practice.
Curtis et al. (2002) used the scale with small amendments to
survey Irish undergraduate Registered Nurses and found
positive attitudes and moderate to high skills but did not
report confidence levels or validation. A further Irish study
(Adams & Timmins 2006) with Registered Nurses on a part-
time access to degree programme used an author-developed
instrument with items developed from the literature (a = 0Æ86)
to explore access to and use of computers and the Internet and
the relationship to demographic variables and usage patterns.
However, as no further psychometric data were reported there
was little potential to draw on or replicate these studies. A
subsequent US national study (Maag 2006) drew on Sinclair
and Gardner (1999) work and suggested that sound education
about the use of technology would have an impact on nursing
students’ future use of technology for patient care. To provide a
baseline for educators, they developed a modified Technology
Attitude Scale (TAS) to explore students’ attitudes and views
towards using technology. In common with previous studies,
the TAS addressed education to use computers and not
educational use.
e-Learning
A small number of recent studies have used instruments to
explore healthcare students’ experience of using computers
specifically for education. A US study (Duggan et al. 2001)
identified a lack of instruments to measure student attitudes to
the educational use of the Internet and the researchers devel-
oped and validated an 18-item scale, Attitudes to the Educa-
tional Use of the Internet (ATEUI), in three stages. Educational
literature provided a pool of 60 statements, subsequently
reduced to 33 and administered to students to determine the
scalability of items and then operationalised with a new sample
when 18 items were retained. The pilot AETUI, combined with
behavioural statements, was completed by a further student
sample (a = 0Æ89). The final instrument was administered with
a further group of students enrolled on communication and
health promotion courses (a = 0Æ91).
The findings of Duggan et al. (2001) suggest that students
who are in control of their learning have positive attitudes,
JAN: REVIEW PAPER Literature review measurement tools
� 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd 767
and this theme is echoed in a UK cross-sectional study with
postgraduate teacher trainees and pre and postregistration
nursing students (Wishart & Ward 2002), which suggested
that there was an association between attitude to computers
and user sense of internal control. Wishart and Ward (2002)
chose the previously-validated Duttweiler Internal Locus of
Control Index (Duttwieler 1984). An additional seven items
focused on computer attitudes and questions about their
computer use, ownership and experience. There is no
evidence that the amended instrument was validated as part
of the study.
Atack and Rankin (2002), in a pre and post-test evaluation
of web-based learning (WBL) by Canadian Registered
Nurses, developed a two-part instrument. Items on computer
skills and access were combined with five sub-scales measur-
ing interaction, design, technology, environment and impres-
sions. The authors highlighted the variation in responses
concerning interaction and learning from the work environ-
ment, which were congruent with the findings of larger
studies (DeBourgh 2003, Billings et al. 2005, Sit et al. 2005).
In a similar UK pre and post-test pilot study, Wilkinson et al.
(2004) used an author-developed instrument,with seven
subscales to explore computer use; online learning; distance
learning; evaluation (post); learning outcomes; support; and
utility with Registered Nurses on four courses. Respondents
reported more positive orientation to online (P = 0Æ04) and
distance learning (P = 0Æ02) post-course. Those who reported
prior use of ICTs were more likely to complete the course.
Both these studies were small, exploratory and uncontrolled
and had participant attrition.
Researchers have used the national evaluation programme
of the American Association of Higher Education (AAHE)
(Billings et al. 2001), which is focused on educational
technology. In this national evaluation programme conducted
by the AAHE and known as the Flashlight programme (now a
non-profit Teaching Learning Technology Group) an item
bank of ‘validated’ questions, the Current Student Inventory
Toolkit (CSI), on educational technology was created for
researchers to use (See http://www.tltgroup.org/flashlightP.
htm). Billings et al. (2001) drew upon this bank of questions to
develop and pilot an online 52-item instrument called Eval-
uating Educational Uses of the Internet (EEUWIN) to validate
an educational model with nursing students across three
universities. The reliability of the 52-item EEUWIN was good
but no data were reported for its sub-scales. In the pilot study
positive relationships were identified between student distance
from the campus, older age and convenience, satisfaction and
connectedness. In a later study, Billings et al. (2005) investi-
gated generational differences among nursing students across
six universities using a revised 57-item EEUWIN.
In a Hong Kong study with Registered Nurses taking one
or more online courses researchers also used 27 items from
the CSI to ask questions about overall satisfaction with
online courses and the perceived barriers to online study
(Sit et al. 2005). The items were reviewed by an educational
team for content validity related to six themes. Internal
consistency and test–retest reliability of the CSI were
evaluated but the data were not reported. The researchers
found seven facets which explained 54% of overall
satisfaction: convenience; confidence to tackle difficult tasks;
understanding concepts; taking responsibility for learning;
interactivity; supplementary face-to-face interaction; and
multimedia. Convenience was the most important factor in
satisfaction but a major hindrance was lack of face-to-face
interaction.
A US study of Registered Nurses (DeBourgh 2003) had
similar findings using a 59-item Student Satisfaction Survey
derived from an existing instrument, with added items on
computer-mediated communication identified from literature
searches on student satisfaction with distance education.
DeBourgh (2003) tested reliability coefficients for eight facets
(five student and three teacher characteristics) and these
varied from poor to good. Technical aspects cited as the most
frequent source of negative attitudes in the literature.
DeBourgh (2003), however, concluded that the human
interface issues represented by quality of the instructor
remained the most important factor in satisfaction with
distance learning. This study was limited by its small
homogeneous sample. The ability of teachers to apply
educational principles to the use of technology was a major
influence on students’ satisfaction in another US cross-
sectional study (Bloom & Hough 2003) exploring nurse
and health science students’ engagement with technology-
enhanced learning before and during their course and the
quality of the experience. The author-developed instrument
was validated by a rating panel and pilot test. Reliability for
the second part of the instrument concerning experience and
comfort with technology-enhanced learning was a = 0Æ85.
New studies are emerging from other regions of the world.
In a Canadian/Chinese study of Registered Nurses, Cragg
et al. (2003) combined and made small changes to existing
scales to measure Attitudes Toward Computers (ATC) The
authors developed a new scale Attitudes Towards the Internet
based on the ATC scale which, except for the affordability
sub-scale (a = 0Æ53), had similarly good to excellent reliabil-
ity. The scales were translated into Chinese and validated. In
New Zealand, Honey (2004) surveyed Registered Nurses
using an author-developed instrument incorporating items
from previous studies in a cross-sectional study to scope the
feasibility of introducing online learning. There was no
A. Wilkinson et al.
768 � 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd
description of instrument development or psychometric data,
although reference was made to previous research.
A Taiwanese study (Yu & Yang 2006) explored the
attitudes of a random sample of public health nurses to WBL
using an author-developed questionnaire with items gener-
ated from review of the literature, interview and expert panel
resulting in two sub-scales: Basic Computer Competence and
Attitude toward WBL. Overall, nurses were positive about
WBL but rural nurses were statistically significantly more
positive than those in urban settings. Those with computer
skills and access to computers in the workplace were more
positive. There were, however, indications that respondents
had concerns about the quality of learning materials and
being isolated, similar themes to those identified by
DeBourgh (2003) and Sit et al. (2005). A Canadian study
with physiotherapists (Mathur et al. 2005) employed an
author-developed instrument previously used by one of the
authors and amended for face validity and pilot tested but not
further validated. Level of education, level of access to the
Internet, frequency of use, skill and practice area were
positively related to interest in CAI. In contrast to the work of
Billings et al. (2001)and Yu and Yang (2006), distance from
education centres was not related to interest in CAI.
There is some emerging work on the development and
validation of instruments to explore student responses to use
of computers and the Internet for education (Table 3) but
currently no single instrument has been developed and refined
using large samples across a variety of settings. Furthermore,
few such instruments have been either reused or revalidated.
Discussion
The literature search identified instruments used to collect data
on four main topics: assessing ICT and information literacy
skills (e.g. Parks et al. 1986, Maag 2006); measuring attitudes
to computers or computerisation in practice (e.g. Stronge &
Brodt 1985, Jayasuriya & Caputi 1996); attitude and access to
computers and the Internet (e.g. Mattheos et al. 2002, Cragg
et al. 2003); and exploring attitudes to computers and the
Internet for education (e.g. Duggan et al. 2001, Atack &
Rankin 2002, Bloom & Hough 2003). All the studies were
cross-sectional or pre and post- test studies, with no longitu-
dinal studies with repeated measures, and the pre and post-test
intervention studies were of single units or modules of WBL
with consequential small sample sizes (Atack & Rankin 2002).
More recent studies have focused on attitudes to web-based
and distance education and have explored interrelationships
between all the above topics.
Methodological details of many studies were inadequately
described, creating concerns about instrument validity and
reliability (e.g. Grigg & Stephens 1999, Mattheos et al. 2002,
Seago et al. 2002, Hegney et al. 2006). In descriptions of the
instruments, face and content validity were more consistently
discussed than other aspects of validation and included the
use of subject experts, reference groups or themes derived
from the literature (e.g. Mathur et al. 2005, Hegney et al.
2006). Since the 1980s there have been substantial changes in
the capacity and incidence of ICT use in higher education,
and therefore items designed to report their usage, responses
to and comfort with ICT may have lost their validity over
time. The only instrument that was repeatedly tested in
healthcare education and practice (Stronge & Brodt 1985) is
now dated and proved more reliable with nurses working in
hospitals than with nursing students. The variation in factors
identified by successive investigators also limits comparison
across studies. Earlier instruments which were rigorously
developed had higher reliability than those described more
recently, but this may be the result of rapidly-changing ICT.
Methodological detail was reported less in the medical
literature than in the nursing and allied healthcare studies
included in the review. A number of reports, the majority
medical, gave limited information on instrument design, pilot
work or psychometric properties (Hollander 1999, Ray &
Hannigan 1999, Steele et al. 2002, Walmsley et al. 2003,
Bello et al. 2004). While items were often derived from
previous measures, it was not always clear where individual
items originated, and the final instrument was rarely pub-
lished (Curtis et al. 2002, Honey 2004). There are few studies
where the samples were derived from more than one
institution and/or discipline group, so that there are limits
to the transferability of findings. Replication of studies is
difficult as the work of Scarpa et al. (1992) demonstrated,
since prior reports did not give complete psychometric
information for useful comparative analysis. There was often
no consistency in the demographic sections of instruments,
and authors presented very varied and often limited infor-
mation about study samples. This may be a result of
homogeneous populations in many studies, but this is not
always made explicit; therefore, issues remain concerning
differentiating between groups of learners.
To date, no instrument has demonstrated high reliability in
measuring student attitudes to e-learning over more than one
group. However, studies are emerging from outside the US
which address the use of ICT for learning by different
populations (e.g. Sit et al. 2005, Link et al. 2006, Yu & Yang
2006). Online learning has been targeted by universities as an
area of growth, but there have been examples where such
initiatives have failed, for example the UK e-University
(House of Commons Education & Skills Committee 2005).
This review suggests that little is known about either the
JAN: REVIEW PAPER Literature review measurement tools
� 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd 769
preparedness or views of healthcare students in relation to
online education. Furthermore, the items in early instruments
no longer reflect terminology used in connection with current
ICT skills and rarely consider the use of communication other
than e-mail.
Conclusion
Further research is needed to identify what should be
measured. Previous tools used to gather reports of respondents’
ICT skills need to be updated if they are to be relevant and valid
for contemporary healthcare professionals. The requirement
for nurses, for example, to access information, critically
appraise and then synthesise it for others indicates that
instruments which survey students’ ability and confidence to
make more complex use of ICTs are required. ICT use is
becoming ubiquitous in higher education and the workplace,
and so educators need to know whether students on healthcare
programmes are equipped with the requisite skills.
While there have been a number of studies exploring the
skills, attitudes and experience of healthcare students regard-
ing ICTs and ICTs for education, there have been no large
scale or longitudinal studies exploring whether attitudes
change during and after education. Continued expansion of
web-based learning at all levels, the mobility of the healthcare
workforce and the need for this workforce to have flexible
modes of continued education mean that it is imperative to
develop and validate instruments to explore students’ expe-
riences with e-learning and to develop models for engaging
students in e-learning.
Funding
This research received no specific grant from any funding
agency in the public, commercial, or not-for-profit sectors.
Author contributions
AW, AEW & JR were responsible for the study conception
and design. AW performed the data collection. AW per-
formed the data analysis. AW was responsible for the
drafting of the manuscript. AEW & JR made critical revisions
to the paper for important intellectual content. AEW & JR
supervised the study.
References
Adams A. & Timmins F. (2006) Students views of integrating web-
based learning technology into the nursing curriculum. Nurse
Education in Practice 6(1), 12–22.
Agho A.O. & Williams A.M. (1995) Actual and desired computer
literacy among allied health students. Journal of Allied Health
24(2), 117–126.
Atack L. & Rankin J.A. (2002) A descriptive study of registered
nurses’ experiences with web-based learning. Journal of Advanced
Nursing 40(4), 457–465.
Bachman J.A. & Panzarine S. (1998) Enabling student nurses to use
the information superhighway. Journal of Nursing Education
37(4), 155–161.
Balen R.M. & Jewesson P.J. (2004) Pharmacist computer skills and
needs assessment survey. Journal of Medical Internet Research 6,
1. Retrieved from: http://www.jmir.org/2004/1/e11/ on 17 March
2008.
What is already known about this topic
• Healthcare professionals are expected to be computer
literate at the point of registration.
• There are few rigorous quantitative studies on the atti-
tudes and experience of healthcare professionals
regarding computers and use of computers for learning.
• Consistent methods of measuring attitudes of healthcare
professionals’ use of computers for learning have not
been established.
What this paper adds
• The majority of studies are cross-sectional and therefore
the development of students’ attitudes and experience
with information and communication technology and
online learning over time has not been explored.
• Future measurement tools need to address the infor-
mation literacy and preparedness for online education
of healthcare students, as well as their basic information
and communication technology skills.
• The quality of instruments is variable, with little
evidence of progressive development and validation.
Implications for practice and/or policy
• Information literacy is a key aspect of nursing practice
and nurses’ careers and therefore gaps in knowledge of
nursing students’ capabilities and attitudes are of
concern.
• Future research should focus on the impact of demo-
graphics on attitudes and experience of nursing
students.
• Further work is required to establish a valid instrument
to explore the attitudes and experience in relation to
information and communication technology of nursing
students.
A. Wilkinson et al.
770 � 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd
Bello I.S., Arogundade F.A., Sanusi A.A., Ezeoma I.T., Abioye-Kuteyi
E.A. & Akinsola A. (2004) Knowledge and utilization of infor-
mation technology among health care professionals and students in
Ile-Ife, Nigeria: A case study of a university teaching hospital.
Journal Of Medical Internet Research 6(4), 23.
Billings D., Connors H. & Skiba D. (2001) Benchmarking best
practices in web-based nursing courses. Advances in Nursing Sci-
ence 23, 41–52.
Billings D.M., Skiba D.J. & Connors H.R. (2005) Best practices in
web-based courses: Generational differences across undergraduate
and graduate nursing students. Journal of Professional Nursing
21(2), 126–133.
Bloom K.C. & Hough M.C. (2003) Student satisfaction with tech-
nology enhanced learning. CIN: Computers, Informatics Nursing
21(5), 241–246.
Brumini G., Kovic I., Zombori D., Lulic I. & Petrovecki M. (2005)
Nurses’ attitudes towards computers: Cross sectional questionnaire
study. Croatian Medical Journal 46(1), 101–104.
Chumley-Jones H.S., Dobbie S. & Alford C.L. (2002) Web-based
learning: sound educational method or hype? A review of the
evaluation of literature. Academic Medicine 77(10), S86–S93.
Compeau D.R. & Higgins C.A. (1995) Computer self-efficacy devel-
opment of a measure and initial test. MIS Quarterly 19, 189–211.
Cornford J. & Pollock N. (2003) Putting the University Online:
Information Technology and Organisational Change. OUP,
Buckingham.
Cragg C.E., Edwards N., Yue Z., Xin S. & Hui Z.D. (2003)
Integrating web-based technology into distance education for
nurses in China: Computer and Internet access and attitudes. CIN:
Computers Informatics Nursing 21(5), 265–274.
Curtis E., Hicks P. & Redmond R. (2002) Nursing students
experience and attitudes to computers: A survey of a cohort of
students on a Bachelor in nursing studies course. ITIN 14(2),
7–17.
Dambrot F.H., Watkins-Malek M.A., Silling S.M., Marshall R.S. &
Garver J.A. (1985) Correlates of sex differences in attitudes toward
and involvement with computers. Journal of Vocational Behavior
27(1), 71–86.
DeBourgh G.A. (2003) Predictors of student satisfaction in distance-
delivered graduate nursing courses: what matters most? Journal of
Professional Nursing 19(3), 149–163.
Department of Health (2004) The NHS Knowledge and skills frame-
work and the development review process. HMSO, London.
Retrieved from http://www.dh.gov.uk/assetRoot/04/09/08/61/
04090861.pdf on 11 May 06.
Dewhurst D.G., Macleod H.A. & Norris T.A.M. (2000) Independent
student learning aided by computers: an acceptable alternative to
lectures? Computers & Education 35, 223–241.
Dorup J. (2004) Experience and attitudes toward information
technology among first year medical students in Denmark: longi-
tudinal questionnaire survey. Journal of Medical Internet Research
6(1). Retrieved from http://www.jmir.org/2004/1/e10/ on 17 May
2006.
Dover L.V. & Boblin S. (1991) Student nurse computer experience
and preferences for learning. Computers in Nursing 9(2), 75–79.
Duggan A., Hess B., Morgan D., Sooyeon K. & Wilson K. (2001)
Measuring students attitudes towards educational use of the Inter-
net. Journal of Educational Computing Research 25(3), 267–281.
Duke C. (2002) Managing the Learning University. OUP, Bucking-
ham.
Duttwieler P.C. (1984) The internal control index: a newly developed
measure of locus of control. Educational and Psychological
Measurement 44, 209–221.
Ehrmann S.C. & Zuniga R.E. (1997) The Flashlight Evaluation
Handbook TLT group. Retrieved from http://www.tltgroup.org/
Flashlight/Handbook/Toc.htm on 5 December 2008.
Grigg P.A. & Stephens C.D. (1999) A survey of the IT skills and
attitudes of final year dental students at Bristol University in
1996 and 1997. European Journal of Dental Education 3(2),
64–73.
Hegney D., Eley R., Buikstra E., Fallon T., Isoar J. & Gilmore V. (2006)
Australian nurses access and attitudes to information technology.
Studies in health technology and informatics 122, 688–692.
Hollander S. (1999) Assessing and enhancing medical students’
computer skills: a two-year experience. Bulletin of the Medical
Library Association 67(1), 67–73.
Honey M. (2004) Flexible learning for postgraduate nurses: a basis
for planning. Nurse Education Today 24, 319–325.
House of Commons Education & Skills Committee (2005) UK
e–University: Third Report of Session 2004–05. The Stationery
Office Limited, London.
Jayasuriya R. & Caputi P. (1996) Computer attitude and computer
anxiety in nursing: validation of an instrument using and Austra-
lian sample. Computers in Nursing 14(6), 340–345.
Lewis M.J., Davies R., Jenkins D. & Tait M.I. (2001) A review of
evaluative studies of computer-based learning in nursing education.
Nurse Education Today 21, 26–37.
Link T.M., Marz R., Link T.M. & Marz R. (2006) Computer literacy
and attitudes towards e-learning among first year medical students.
BMC Medical Education 6, 34.
Loyd B.H. & Gressard C. (1984) Reliability and Factorial validity of
computer attitude scales. Educational and Psychological Mea-
surement 44, 501–505.
Lynch D.C., Whitley T.W., Emmerling D.A. & Brinn J.E. (2000)
Variables that may enhance medical students’ perceived pre-
paredness for computer-based testing. Journal of American Medi-
cal Informatics Association 7, 469–474.
Maag M.M. (2006) Nursing students attitudes toward technology: a
national study. Nurse Educator 31(3), 112–118.
Masiello I., Ramberg R. & Lonka K. (2005) Attitudes to the appli-
cation of a web-based learning system in a microbiology course.
Computers & Education 45(2), 171.
Mathur S., Stanton S. & Reid W.D. (2005) Canadian physical ther-
apists’ interest in web-based and computer-assisted continuing
education. Physical Therapy 85(3), 226.
Mattheos N., Nattestad A., Schittek M. & Attstrom R. (2002)
Computer literacy and attitudes among students in 16 European
dental schools: current aspects, regional differences and
future trends. European Journal of Dental Education 6, 30–
35.
Maurer M.M. & Simonson M.R. (1984) Development and Valida-
tion of a Measure of Computer Anxiety. Ames, Iowa.
McBride S. & Nagle L. (1996) Attitudes toward computers: a test of
construct validity. Computers in Nursing 14(3), 164–170.
McFarlane T.A., Hoffman E.R. & Green K.E. (1997) Teachers’
Attitudes towards Technology (A survey). Paper presented at the
JAN: REVIEW PAPER Literature review measurement tools
� 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd 771
American Educational Research Association, March 24th–28th,
Chicago, IL (ERIC #ED411279).
Netemeyer R.G., Bearden W.O. & Sharma S. (2003) Scaling Proce-
dures: Issues and Applications. Sage, Thousand Oaks.
New Media Consortium (2006) The Horizon Report. The New
Media Consortium and Educause Learning Initiative. Retrieved
from http://www.nmc.org/pdf/2006_Horizon_Report.pdf on 30
July 2007.
New Media Consortium (2007) The Horizon Report. The New
Media Consortium and Educause Learning Initiative. Retrieved
from http://www.nmc.org/pdf/2007_Horizon_Report.pdf on 30
July 2007.
New Media Consortium (2008) The Horizon Report. The New
Media Consortium and Educause Learning Initiative. Retrieved
from http://www.nmc.org/pdf/2008_Horizon_Report.pdf on 30
July 2007.
Parks P.L., Damrosch S.P., Heller B.R. & Romano C.A. (1986)
Faculty and student perceptions of computer applications in
nursing. Journal of Professional Nursing 2, 104–113.
Rajab L.D., Baqain Z.H., Rajab L.D. & Baqain Z.H. (2005) Use of
information and communication technology among dental
students at the University of Jordan. Journal of Dental Education
69(3), 387–398.
Ray N.J. & Hannigan A. (1999) A survey of the computer literacy of
undergraduate dental students at a University Dental School in
Ireland during the academic year 1997–98. European Journal of
Dental Education 3(2), 56–63.
Salamonson Y. & Lantz J. (2005) Factors influencing nursing stu-
dents’ preference for a hybrid format delivery in a pathophysiology
course. Nurse Education Today 25(1), 9–16.
Samuel M., Coombes J.C., Miranda J.J., Melvin R., Young E.J.W. &
Azarmina P. (2004) Assessing computer skills in Tanzanian
medical students: an elective experience. MBC Public Health 4: 37.
Retrieved from http://www.biomedcentral.com/1471-2458/4/37
on 28 October 2007.
Saranto K., Leino-Kilpi H. & Isoaho H. (1997) Learning environ-
ment in information technology the views of student nurses.
Computers in Nursing 15(6), 324–332.
Scarpa R., Smeltzer S.C. & Jasion B. (1992) Attitudes of nurses
toward computerisation: a replication. Computers in Nursing
10(2), 72–80.
Schwirian P.M., Malone J.A., Stone V.J., Nunley B. & Francisco T.
(1989) A comparison of the attitudes of nurses and nursing
students. Computers in Nursing 7(4), 168–177.
Seago B.L., Schlesinger J.B. & Hampton C.L. (2002) Using a
decade of data on medical student computer literacy for strategic
planning. Journal of Medical Library Association 90(2), 202–
209.
Sinclair M. & Gardner J. (1999) Planning for information technology
key skills in nurse education. Journal of Advanced Nursing 30(6),
1441–1450.
Sit J.W.H., Chung J.W.Y., Chow M.C.M. & Wong T.K.S. (2005)
Experiences of online learning: students’ perspective. Nurse Edu-
cation Today 25, 140–147.
Slotte V., Wangel M. & Lonka K. (2001) Information Technology in
medical education: a nationwide project on the opportunities of
new technology. Medical Education 35, 990–995.
Smith J. (2005) From flowers to palms: 40 years of policy for online
learning. ALT-J 13(2), 93–108.
Startsman T.S. & Robinson R.E. (1972) The attitudes of medical and
paramedical personnel toward computers. Computers and
Biomedical Research 5, 218–227.
Steele D.J., Johnson J.E.J., Palensky Lynch T.G., Lacy N.L. & Duffy
S.W. (2002) Learning preferences, computer attitudes, and student
evaluation of computerisation instruction. Medical Education 36,
225–232.
Stockton A.H. & Verhey M.P. (1995) A psychometric examination
of the Stronge-Brodt Nurses’ attitudes towards computers
questionnaire. Computers in Nursing 13(3), 109–113.
Stronge J.H. & Brodt A. (1985) Assessment of nurses’ attitudes
towards computerization. Computers in Nursing 3(4), 154–158.
Vuorela M. & Nummenmaa L. (2004) How undergraduate students
meet a new learning environment? Computers In Human Behavior
20(6), 763.
Walmsley A.D., White D.A., Eynon R. & Somerfield L. (2003) The
use of the Internet within a dental school. European Journal of
Dental Education 7(1), 27–33.
Whitemore R. & Knafl K. (2005) The integrative review: updated
methodology. Journal of Advanced Nursing 52(5), 546–553.
Wilkinson A., Forbes A., Bloomfield J. & Gee C.F. (2004) An
exploration of four web-based open and flexible learning modules
in post-registration nurse education. International Journal of
Nursing Studies 41(4), 411–424.
Williams A.M., Agho A.O. & McCloy C. (1996) Attitudes and
perceptions of computer applications among baccalaureate physi-
cal therapy students. Journal of Physical Therapy Education 10(1),
14–17.
Wilson B.A. (1991) Computer anxiety in nursing students. Journal of
Nursing Education 30(2), 52–56.
Wishart J. & Ward R. (2002) Individual differences in nurse and
teacher training students’ attitudes toward and use of information
technology. Nurse Education Today 22(3), 231–240.
Yu S. & Yang K.-F. (2006) Attitudes toward web-based
distance learning among public health nurses in Taiwan: A ques-
tionnaire survey. International Journal of Nursing Studies 43, 767–
774.
The Journal of Advanced Nursing (JAN) is an international, peer-reviewed, scientific journal. JAN contributes to the
advancement of evidence-based nursing, midwifery and health care by disseminating high quality research and
scholarship of contemporary relevance and with potential to advance knowledge for practice, education, management
or policy. JAN publishes research reviews, original research reports and methodological and theoretical papers.
For further information, please visit the journal web-site: http://www.journalofadvancednursing.com
A. Wilkinson et al.
772 � 2009 The Authors. Journal compilation � 2009 Blackwell Publishing Ltd