The cognitive interview: A meta-analysis

27
This article was downloaded by: [212.175.88.16] On: 21 March 2014, At: 13:32 Publisher: Routledge Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered office: Mortimer House, 37-41 Mortimer Street, London W1T 3JH, UK Psychology, Crime & Law Publication details, including instructions for authors and subscription information: http://www.tandfonline.com/loi/gpcl20 The cognitive interview: A meta-analysis Günter Köhnken a , Rebecca Milne b , Amina Memon c & Ray Bull d a Institut für Psychologie, Universität Kiel , Germany b Institute of Police and Criminological Studies, University of Portsmouth , England c Department of Psychology , University of Texas , Dallas, USA d Department of Psychology , University of Portsmouth , England Published online: 04 Jan 2008. To cite this article: Günter Köhnken , Rebecca Milne , Amina Memon & Ray Bull (1999) The cognitive interview: A meta-analysis, Psychology, Crime & Law, 5:1-2, 3-27, DOI: 10.1080/10683169908414991 To link to this article: http://dx.doi.org/10.1080/10683169908414991 PLEASE SCROLL DOWN FOR ARTICLE Taylor & Francis makes every effort to ensure the accuracy of all the information (the “Content”) contained in the publications on our platform. However, Taylor & Francis, our agents, and our licensors make no representations or warranties whatsoever as to the accuracy, completeness, or suitability for any purpose of the Content. Any opinions and views expressed in this publication are the opinions and views of the authors, and are not the views of or endorsed by Taylor & Francis. The accuracy of the Content should not be relied upon and should be independently verified with primary sources of information. Taylor and Francis shall not be liable for any losses, actions, claims, proceedings, demands, costs, expenses, damages, and other liabilities whatsoever or howsoever caused arising directly or

Transcript of The cognitive interview: A meta-analysis

This article was downloaded by: [212.175.88.16]On: 21 March 2014, At: 13:32Publisher: RoutledgeInforma Ltd Registered in England and Wales Registered Number: 1072954Registered office: Mortimer House, 37-41 Mortimer Street, London W1T 3JH,UK

Psychology, Crime & LawPublication details, including instructions forauthors and subscription information:http://www.tandfonline.com/loi/gpcl20

The cognitive interview: Ameta-analysisGünter Köhnken a , Rebecca Milne b , Amina Memonc & Ray Bull da Institut für Psychologie, Universität Kiel , Germanyb Institute of Police and Criminological Studies,University of Portsmouth , Englandc Department of Psychology , University of Texas ,Dallas, USAd Department of Psychology , University ofPortsmouth , EnglandPublished online: 04 Jan 2008.

To cite this article: Günter Köhnken , Rebecca Milne , Amina Memon & Ray Bull(1999) The cognitive interview: A meta-analysis, Psychology, Crime & Law, 5:1-2,3-27, DOI: 10.1080/10683169908414991

To link to this article: http://dx.doi.org/10.1080/10683169908414991

PLEASE SCROLL DOWN FOR ARTICLE

Taylor & Francis makes every effort to ensure the accuracy of all theinformation (the “Content”) contained in the publications on our platform.However, Taylor & Francis, our agents, and our licensors make norepresentations or warranties whatsoever as to the accuracy, completeness,or suitability for any purpose of the Content. Any opinions and viewsexpressed in this publication are the opinions and views of the authors, andare not the views of or endorsed by Taylor & Francis. The accuracy of theContent should not be relied upon and should be independently verified withprimary sources of information. Taylor and Francis shall not be liable for anylosses, actions, claims, proceedings, demands, costs, expenses, damages,and other liabilities whatsoever or howsoever caused arising directly or

indirectly in connection with, in relation to or arising out of the use of theContent.

This article may be used for research, teaching, and private study purposes.Any substantial or systematic reproduction, redistribution, reselling, loan,sub-licensing, systematic supply, or distribution in any form to anyone isexpressly forbidden. Terms & Conditions of access and use can be found athttp://www.tandfonline.com/page/terms-and-conditions

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

P.sy'holoy,v Crime & LuM,. Vol. 5 . pp. 3-27 Reprints available directly From the publisher Photocopying permitted by license only

D 1999 OPA (Overseas Publishers Association) N.V. Published by license under

the Harwood Academic Publishers imprint, part of The Gordon and Breach Publishing Group.

Printed i n India.

THE COGNITIVE INTERVIEW: A META-ANALYSIS

GUNTER KOHNKEN '.*, REBECCA MILNE ', AMINA MEMON", and RAY BULLd

a Institut fur Psychologie, Universitut K i d , Germany; ' Institute of Police und Criminoloyical Studies,

University o j Portsmouth, Englund; Department of Psychologyy, University o f Te.uas, DaIIus, USA: Depurtment of Psychology, University ?f Portsmouth. England

A meta-analysis was performed on the effects of the cognitive interview on correct and incorrect recall. The database comprised 42 studies with 5 5 individual comparisons involving nearly 2500 interviewees. A strong overall effect size was found for the increase of correctly recalled details with the cognitive interview compared to a control interview ( d =0.87). The overall effect size for the increase in incorrect details, although consider- ably smaller, was also significant toward the cognitive interview (t /=0.28). However, the accuracy rates (proportion of correct details relative to the total amount of details reported) were almost identical in both types of interview (8S% for the cognitive interview and 82% for standard interviews, respectively). Taking methodological factors into consideration it was found that effect sizes for correct details were larger if staged events were used as the to-be-remembered episode (as compared to video films) and if the interviewees actively participated in the event. With regard to incorrect details effect sizes were larger for adults as compared to children. Furthermore. the enhanced version of the cognitive interview produced more errors than the original version.

Kebbell and Milne (1998) found that police officers are of the opinion that witnesses usually provide the central leads in criminal investiga- tions. A report by the Rand Corporation (1975) also noted that a major factor that determines whether or not a crime is solved is the completeness and accuracy of the witness account. Indeed law enforce- ment personnel were found to spend as much as 85% of their total working time talking to people. Thus, a critical component of effective law enforcement is the ability of police officers to obtain accurate and detailed information from witnesses. However, police officers have also reported that witnesses rarely provided as much information as the officers required for an investigation (Kebbcll and Milne, 1998). Thus, a technique which maximises the amount of information elicited

*Corresponding author

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

4 G . KOMNKEN P T A L

from witnesses and victims would be of crucial importance to the investigation process.

Due to the importance of witness accounts, the fallibility of witness memory (e.g. Loftus, 1979), and the lack of police training concern- ing how to interview witnesses (e.g. George, 1991), Geiselman and Fisher embarked on the development of a new interview procedure (Geiselman, Fisher, Firstenberg, Hutton, Sullivan, Avetissian and Prosk, 1984). As a consequence of the dearth of literature which developed formal models of the retrieval phase of memory into retrieval mnemonics, Geiselman and Fisher examined the general principles of cognition as a whole (Fisher, McCauley and Geiselman, 1992). The resultant set of techniques is collectively known as the cognitive interview, which aims to increase both the quantity and quality of information elicited from crime witnesses and victims (and possibly co-operative suspects).

The original version of the cognitive interview was a set of four instructions or mnemonics which were primarily derived froin two over-riding perspectives in cognitive theory: the encoding specificity principle (e.g. Tulving and Thomson, 1973) and the multicomponent view of the memory trace (e.g. Bower, 1967; Wickens, 1970). The encoding specificity principle maintains that the effectiveness of a retrieval probe is determined by its similarity to the encoding opera- tions. Thus, a retrieval environment that effectively reinstates the original encoding environment should enhance memory. The second view of memory poses that the memory trace is not a unitary, holistic representation of the original to-be-remembered event, but rather it is a complex array of many features. Thus, at a given point in time some features of a memory trace are accessible and some are not. This suggests that memories not accessible with one type of retrieval probe could be made accessible with another (Tulving, 1974).

The four resultant mnemonics which emanated from these two cognitive perspectives are; (i) the ‘report everything’ instruction which encourages interviewees to report as much detail as they can remember no matter how trivial they believe the information to be and even if they can only remember part of the information, (ii) the ’mental reinstatement of context’ instruction which asks the interviewees mentally to recreate both the internal (e.g. feelings) and external (e.g. surrounding features) contexts of the to-be-remembered event, (iii) the recalling of events in a variety of ‘different temporal orders’ which, for example, gets the interviewees to report the to-be-remembered event from the very last thing they can remember to the very first (reverse order recall), and (iv) the ‘change perspective’ technique, which attempts to gain recall from thc interviewees from the pcrspective of

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

META-ANALYSIS OF THE COGNlTlVE INTERVIEW 5

someone else who was present or from another location at the to-be-remembered event.

The original version of the cognitive interview, however, did not address all of the obstacles faced by police investigators in the field; such as anxious and inarticulate witnesses who seemed unsure of their role in the interview (Fisher, Chin and McCauley, 1990). The enhanced cognitive interview was therefore developed to counteract these observed witness problems and to tackle explicitly the poor interviewing strategies used by interviewing officers (e.g. George, 1991). Thus, principles from the social psychology of communication were considered and the techniques incorporated into the enhanced cognitive interview included rapport building, transferring control of the interview to the interviewee, the appropriate use of pauses and non-verbal behaviour, and the relative efficacy of different types of questions. The research examining the effectiveness of the original cognitive interview also revealed that there still existed a great amount of information that was in the original event but which was not being recalled. For example, in the cognitive interview condition of the Geiselman, Fisher, MacKinnon and Holland ( I 986) study, only twelve of the twenty most important facts were reported. Thus, several additional scientific principles from cognition (as well as those men- tioned above which formed the original version of the cognitive interview) were examined and were subsequently integrated into the enhanced cognitive interview in the form of: focused retrieval, imagery, witness compatible questioning, and varied and extensive retrieval techniques. As a consequence, several improvements of the original cognitive interview were developed and the enhanced cognitive inter- view became increasingly eclectic (Fisher and Geiselman, 1992; Fisher, McCauley and Geiselman, 1992).

How effective is the (enhanced) cognitive interview? Does it work? The paradigm used in empirical research which examines the effective- ness of the cognitive interview usually involves interviewees who view an event (e.g. filmed or staged). These interviewees are then randomly assigned to one of two conditions, the (enhanced) cognitive interview or the control condition. The interviewees recall the event and the resultant reported information is coded and scored as being correct, incorrect/ false or confabulated. Although this paradigm links all cognitive inter- view research, like an invisible thread, each study differs with respect to the different methodological procedures used within this research para- digm. The notable factors which typically differ are; length of delay, event presentation and theme, the control interview used (more will be mentioned about this later), type of interviewers and interviewees, type of the cognitive interview (original or enhanced version), scoring of the

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

6 G . KOHNKEN U A L .

resultant reports, and witness involvement. All these factors could help to explain the differences found between studies examining the effective- ness of the cognitive interview. Thus, it is imperative to examine critically the methodology used within each cognitive interview study.

Control Croup

A major source of variability in cognitive interview research concerns the type of control condition used. There exist two opposing though not incompatible view points. One concerns the ‘applied research view’ which believes that the cognitive interview needs to be compared against typical police procedures in order for the cognitive interview to be adequately tested. From this perspective it is only necessary for the cognitive interview to be found better than what is currently used in practice, for it to be claimed as beneficial to practitioners. The ’theoretical research view’ on the other hand believes that because the police interview is inadequate and typically consists of no comparable training, the cognitive interview effects may be simply due to moti- vational and training effects as opposed to cognitively determined mnemonic effects (though see Mello and Fisher (1996) for arguments against motivational effects). Kohnken, Thiirer and Zoberbier (1991) therefore introduced the “structured interview” as a control procedure. I t involves a training of the control group interviewers that is of comparable length and quality to the one applied in the cognitivc interview group. Participants who apply the structured interview are trained in basic interviewing and communication skills (as are the cognitive interviewers), but don’t receive any information regarding the ‘special’ cognitive interview mnemonic techniques.

This view does not defucto believe that the theory underpinning the cognitive interview is correct, and thus questions each and every onc of the original and enhanced cognitive interview’s ‘special’ techniques. This is in turn calls for a more stringent control group and an evaluation of cach of the (enhanced) cognitive interview components. Although some research has demonstrated the relative efficacy of some of the cognitive interview components (e.g. Boon and Nooii, 1994; Geiselman, Fisher, MacKinnon and Holland, 1986, expt. 2 ) much more research is needed in this realm.

Childrrw

When applying thc cognitive interview for use with child witnesses diffcrential findings havc been observed across studies. For example,

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

META-ANALYSIS OF THE COGNITIVE INTERVIEW 7

Geiselman and Padilla (1988) found an increase in correct information for the cognitive interview with no accopanying increases in incorrect details or confabulations reported (see also Milne, Bull, Kohnken and Memon, 1995; Saywitz, Geiselman and Bornstein, 1992 for similar findings). However, other researchers who too have found a cognitive interview superiority ef-fect for children have concomitantly found an increase in incorrect details (e.g. McCauley and Fisher, 1995; Memon, Wark, Bull and Kohnken, 1997) and in confabulations (Kohnken, Finger, Nitschke, Hofer and Aschermann, 1992).

Overall, the majority (though there are a few exceptions) of cognitive interview research has found that the cognitive interview elicits more correct information compared to a control interview. Cognitive interview studies have used varying types of interviewees; from adults in the general population (e.g. Mantwill, Kohnken and Aschermann, 1995; Milne, Clare and Bull, 1999) to children (Loohs, 1996; Saywitz, Geiselman and Bornstein, 1992), children and adults with learning disabilities (Milne and Bull, 1996; Milne, Clare and Bull, 1999; Brown and Geiselman, 1990) and the elderly (Mello and Fisher, 1996). The interviewers have been experienced police officers (e.g. Geiselman, Fisher, MacKinnon and Holland, 1986), students naive to interviewing (e.g. Kohnken, Thiirer and Zoberbier, 1991) and adults from the general population (Mantwill et ul., 1995). With regard to incorrect information the findings are however, less consistent. I t is believed by the authors of this paper that this could in part be due to differential coding and scoring systems used across studies.

Nevertheless, single studies are rarely definitive within the behav- ioural sciences, since there are more variations in phenomena, per- spectives and methodology compared to the physical sciences, thus producing a number of studies using hundreds of variations on a theme. This is also due to a complex design system which results from partially overlapping studies. In essence what can one conclusively say about all the studies documented so far i n this realm of C1 research? Literature reviews are, although important, also limited, as different studies use different definitions, variables, procedures, sani- ples and so forth. A meta-analysis on the other hand concerns an analysis of analyses, and assesses methodological differences across studies. Thus, this paper combined all the known studies, published and unpublished, which concern an examination of the effectiveness of the cognitive interview in an attempt to ascertain how effective the cognitive interview is overall as well as across differing methodo- logical settings.

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

8 G. KOHNKEN E T A L

METHOD

Surnplr of Studies

A literature search of Psycholo~~ical Abstracts from 1984 onwards was conducted to obtain references for studies on the effects of the cognitive interview. This was followed by a search of potentially relevant references cited in any of the publications acquired during step one. I n addition, several authors of primary articles were contac- ted and asked to send any relevant work, published or unpublished and names of other relevant researchers.

Criteria for including studies in the final sample were that (i) a full cognitive interview (either the original or the enhanced version) was conducted; (ii) its effects were compared with some form of standard interview; (iii) the effects of the type of interview were measured in a recall task rather than a recognition task; and (iv) the number of correctly and incorrectly recalled details were available. Thus, the studies by Fisher, Geiselman and Amador (1989) and the field study by George (1991) were excluded from the main analysis because, due to being field studics, correct and incorrect details could not be separated in the recall scores (because no records were available of the witnessed events). In the Fisher et al. (1987) study the enhanced version of the cognitive interview was compared with the original version rather than with a standard interview and it was thus elimi- nated. Some studies (e.g. Fisher and Quigley, 1992; McCauley, 1993) report recognition data along with recall performance. In these cases only the recall data were used for computing effect sizes.

The final sample consisted of 55 experimental comparisons from 42 empirical reports representing 2447 interviewees. Of these reports, 29 were published manuscripts (including those in press), 3 papers presented at conferences, 1 unpublished research report, 3 unpublished papers (including those submitted for publication), and 6 unpublished theses or dissertations (see Table I ) .

S t i r c f j , Chcirrir~r~~ristic,v

The following information was coded from each report: (a) date of publication; (b) sample size; (c) time delay between exposure to the stimulus event and the interview; (11) age of the intervicwees (adults or children below the age of 14 years); (e) presentation of the scenario (staged incident or video film); (f) involvement of the interviewees (witnesses versus participants); (g) type of cognitive interview (original

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

Tab

le I

.vo.

A u

rlior

s d

Clia

ncge

d

Clia

nge

A c

curn

q

Effe

ct s

izes

for

cor

rect

and

inco

rrec

t det

ails

. per

cent

cha

nge.

and

acc

urac

y ra

tes

for

stan

dard

and

cog

nitiv

e in

terv

iew

s

Acc

urac

y

inre

rrie

n.

inre

rr.ie

,c.

rn co

rrec

t co

rrec

t' in

corr

ect3

in

corr

ect'

stan

dard

co

gniti

ce

4 ;

1 G

eise

lman

. Fi

sher

. Fi

rste

nber

g,

1.07

22

.59%

0.

32

18.3

8%

83.9

0%8

84.3

7%

z ~ 2 H

utto

n. S

ulliv

an. A

vetis

sian

and

r

Pros

k, 1

984

2 G

eise

lman

, Fis

her.

Mac

Kin

non

and

1.21

39

.97%

0.

36

23.0

8%

81.8

9%

83.7

2%

v1

Hol

land

. 19

85

Hol

land

. 19

86

3 G

eise

lman

. Fi

sher

, M

acK

inno

n an

d

4 G

eise

lman

and

Pad

illa,

198

8 5

Sayw

itz, G

eise

lman

and

Bor

nste

in.

1992

(witn

ess.

7-8

ye

ars)

6

Sayw

itz.

Gei

selm

an a

nd B

orns

tein

. 19

92 (p

artic

ipan

ts 7

-8

year

s)

7 Sa

ywitz

. G

eise

lman

and

Bor

nste

in.

1992

(witn

esse

s, 1

0-11

yea

rs)

8 Sa

ywitz

. G

eise

lman

and

Bor

nste

in.

-

1992

(par

ticip

ants

. 1&

11

year

s)

9 Sa

ywitz

. G

eise

lman

and

Bor

nste

in.

0

14.8

6%

-0.1

5 -3

.06%

17

.09%

) 79

.95%

T

! 4

0.48

I

1.25

20

.85%

-0

.51

- 14

.94%

85

.47%

89

.31%

m r,

0

1.94

54

.56%

-0

.89

-26.

96T

81

.30%

90

.20%

Q

0.

94

21.7

7%

-0.2

5 -2

5.00

%

91.1

8%

94.3

8%

z 5 2.

00

42.1

39

-0.2

8 - 23

.084

93

.81%

96

.55%

<

rn

- -0

.14

-2.7

2%

- 0.

28

-40.

00%

94

.51%

96

.54%

z -i m

-0

.18

- 7.

45%

80

.31%

86

.38%

;F

) ~

1.61

44

.02%

I -

1992

(pra

ctic

e. 8

-9 y

ears

)

1992

(Dra

ctic

e, 1

1-12

yea

rs)

10

Sayw

itz.

Gei

selm

an a

nd B

orns

tein

. 2.

76

66.1

0%

0.14

7.

08%

86

.94%

91

.17%

2

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

11

12

13

I4

15

16

17

18

19

20

21

17

--

23

24

25

Koh

nken

. Th

Gre

r. an

d

Tass

ler,

Man

twill

. A

sche

rrna

nn.

and

Man

twill

. Koh

nken

. and

Asc

herm

ann.

Koh

nken

. M

antw

ill, A

sche

rman

n.

Koh

nken

. Fi

nger

. N

itsch

ke.

Hof

er

Koh

nken

. Sc

hirn

osse

k an

d A

sche

rman

n

Asc

herr

nann

. M

antw

ill. a

nd

Bro

wn

and

Gei

selr

nan.

199

0 M

emon

. C

roni

n, E

aves

, an

d B

ull.

1993

N

e\l-

land

s and

Mac

Leo

d. 1

992

Geo

rge.

199

1 M

antw

ill.

Asc

herm

ann.

and

K

ohnk

en.

1992

. Exp

erim

ent

2 M

antw

ill.

Asc

herm

ann.

and

K

ohnk

en.

1992

. Exp

erim

ent

4 Fi

sher

and

Qui

gley

. 199

2 A

kehu

rst.

Miln

e an

d K

ohnk

en.

Zob

erbi

er.

1994

Koh

nken

. 19

92

1995

and

Vie

weg

. 199

2

and

Asc

herm

ann.

199

2

and

Hof

er.

1994

Koh

nken

. 19

91

1993

(8-9

yea

rs)

Tabl

e 1

mtr

rrtu

rd

.vo.

.4

urh

ors

d C

ltang

e d

Cha

nge

A cc

urac

?.

A c

cura

cj.

corr

ect'

corr

ect'

inco

rrec

t3

inco

rrec

t4

stan

dard

co

yniti

ile

inre

rrie

w irz

rerr

~iew

0.93

52

.25%

0.

41

23.9

9%,

77.5

9%

80.9

5%

0.49

0.62

0.79

2.08

0.96

1 .oo

1.25

0.

02

1.05

2.

54

0.62

0.04

1.94

0.

52

18 6

8%

24.2

2%

28 7

6%

99 0

5%

35 8

6%

38.3

3%

32 0

5%

-0 5

2%

31 8

19

35 6

89

21 0

0%

147g

106 4

29

34

734

0.68

0.48

1.10

1.11

0.73

0.95

1.27

0.

78

0.52

0.

00

- 0.

60

-0.1

1

0.09

0.

25

47.5

0%

29.6

3%

75.2

9%

154.

68%

52.2

5%

23.8

9%

36.0

0%

30.3

7%

32.2

0%

0.00

%

- 21

.62%

.

-4.4

9%

4.73

%

16.1

38

85 9

7%

80.6

3%

91.0

3%

84.9

7%

85.5

8%

83.7

2%

75.9

3%

64 1

5%

80.1

9%

87.2

8%

75 5

7%

84 1

9%

77 7

9%

60 9

40;

83.1

3%

79.9

6%

88.1

7%

81.5

4%

84.1

2%

85.1

6%

75.3

8%

57.7

3%

80.1

5%

90.3

0%

82.6

996

84.9

8%

87.3

5%

64.4

1%

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

8OS

'Ll

8Zl'P

6

%06

'98

%f 8

'01

86

57

6

8IZ

.Il

%SE

'06

8LP

.06

bSP

'S6

80E

.61

811'

88

8t6'

PL

800'

001

%01

.06

%09

'E8

80L.

81

855'

68

BP

6'LL

8lS

'9P

80

0'18

%EO

'LL

%O

L'88

88

1'16

%

SL'P

6

8EL.

61

855'

88

89S

'Pl

%00

'001

%15

'16

896'

SL

%EE

.EC

8OO'

OP-

IL9.

92-

%E1

'6E-

89

P'8

f -

%8Z

.lE

%28

'Sf

%S2

'09

%68

'21

%Z6

'SZ

%ES

'9S

%19

'€1

%OO'O

%W

P6

8Lf'

IZ-

ZP.0

IP'O

-

SE'O

-

f 8'0

-

6P'O

-

68'0

IZ

'O

W.0

91

'0

PE '0

89'0

EO'I

00'0

P9.O

LZ.0

-

%11

'98

%99

'5 I

%P

L'Lf

800'

01

%P

6'P

l

BS2

.I

%81

'29

8P1'

9E

%8E

'65

809'

22

%6P

'C2

881'

11

%LE

'PS

%P

l'P9

% l8

'9Z

OP' I

16'0

62'1

61'1

11

'0

EO'O

OS

'Z

62'1

LO

"

85'0

65'0

SS'I

9S'f

2f'I

99'0

OP

6E

8E

LE

9E

St

Pt

EE

ct It

OE

6C

8C

LC

9Z

--

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

Tabl

e 1

conr

inue

d

.VO

. A

urli

ors

d C

liang

e d

Clia

nge

Acc

urac

j. A

ccur

acj,

corr

ect '

corr

ect'

inco

rrec

r3

inco

rrec

r4

stan

dard

co

gniti

ce

inte

rvie

w

inte

rcio

v

41

42

43

44

45

46

47

48

49

50

51

52

53

54

55

Mel

lo a

nd F

ishe

r (1

996)

M

emon

. War

k. H

olle

y.

Cam

ps

and

Alo

nso-

Que

cuty

(19

97b)

C

amp

s an

d A

lons

o-Q

uecu

ty (

1997

a)

Mem

on, H

olle

y, W

ark,

Bul

l an

d

Py. J

an

d Fe

rnan

des,

C (

1995

) M

emon

, War

k. B

ull

McA

lpin

e (1

996)

Lo

ohs

(199

6)

Koh

nken

. Hol

l and

War

nkin

g

Mdn

e. C

lare

and

Bul

l

Miln

e. C

lare

and

Bul

l

Miln

e an

d Bu

ll (1

996)

Py. G

met

. D

espe

nes

and

Cat

hey

Her

nand

ez-F

erna

ud a

nd

Alo

nso-

Que

cuty

(199

7)

Bull

and

Koh

nken

(19

97b)

Koh

nken

(19

96)

and

Koh

nken

(19

97a)

(199

7)

(199

9) (L

D)

(199

9) (G

P)

(199

7)

3.09

0.

49

1.09

1.

79

0.63

0.83

0.

24

0.53

2.

13

0.81

0.65

0.87

0.60

1.

00

1.87

102.

30%

12

.67%

60.4

3%

147.

70%

25

.03%

32.2

9%

11.5

0%

25.5

6%

82.0

0%

25.5

6%

43.2

4%

25.5

0%

36.5

3%

34.2

2%

98.8

9%

1.62

-0

.12

0.20

0.

33

0.50

-0.3

1 0.

04

0.57

-0

.79

0.23

0.43

0.19

0.17

0.

31

1.11

182.

46%

-1

1.74

%

- 18

.46%

37

.35%

40

.85%

- 14

.31%

2.

62%

38.5

6%

19.3

5%

64.9

8%

12.3

4%

9.00

%

12.9

2%

313.

19%

-48.

72%

89.2

24

88.1

64

85.8

3%

83.9

6%

79.2

1%

65.9

8%

66.1

94

88.4

7%

95.5

9%

79.2

1%

75.1

6%

87.2

2%

74.1

4%

73.3

84

95.8

04

87.8

3%

90.4

8%

92.2

6%

90.4

2%

80.0

3%

74.9

6%

68.0

3%

87.4

3%

98.7

2%

80.0

3%

72.4

3%

88.4

1%,

78.2

2%

76.6

2%

91.6

5%

* Pos

rive

d-s

core

s in

dica

te in

crea

ses

oi co

rrec

t de

tails

UI

cogn

itive

inte

rvie

ws.

ds

are

corr

ecte

d fo

r sa

mpl

e w

e.

' Pos

itme

sign

s ind

icat

e in

crea

se o

f cor

rect

det

ails

in c

ogni

tire

Inte

rvie

ws.

'P

ositi

\,e d

-sco

res

indi

cate

incr

ease

s of

mco

rrec

t det

als

III c

ogni

tive

mte

rvie

us: d

s ar

e ci

rrec

ied

for

sam

ple

me.

The

tabl

e en

trie

s for

inc

orre

ct d

etai

ls r

epre

sent

inc

orre

ct d

etai

ls a

nd

conf

abul

atio

ns c

ombi

ned

ii th

ese

had

been

rep

orte

d se

para

te15

in

the

ori

gnal

stu

dies

. 'P

osit

i\s

sign

s in

dica

te in

crea

ses o

f in

corr

ect d

emils

m c

ogni

tive

inte

nieu

s. T

he ta

ble

entr

ies f

or m

corr

ect d

eral

s re

pres

ent i

ncor

rect

det

ails

and

con

fabu

latio

n\ m

rnbi

nsd

d th

ese

had

been r

epon

rd s

epar

atel

y in

the

orig

inal

stu

dies

.

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

META-ANALYSIS OF THE COGNITlVE INTERVIEW 13

or enhanced version); (h) laboratory where the study was conducted (Geiselman, Fisher and colleagues or other labs), and (i) type of control group (trained or untrained standard interviewers). It was expected that the effect sizes for correct details would be greater for adults compared to children, if a staged incident had been used as the to-be-remembered event rather than a video film, if an enhanced cognitive interview had been used rather than the original version of the cognitive interview, if the interviewees had been involved in the event as participants rather than passive observers, and if untrained interviewers had conducted the interviews in the control condition rather than trained interviewers. No specific hypotheses were for- mulated with regard to the effect sizes for incorrect details.

Computation und Anulysis of Effect S i x s

The effects size calculated is g. This statistic represents the magnitude of an effect and is calculated from the difference between the means of correctly and incorrectly recalled details in cognitive and standard interviews, divided by the pooled standard deviation (Hedges and Olkin, 1985). Effect sizes associated with higher means in the cognitive inter- view were given a positive sign, and those associated with higher means in the standard interview were given a negative sign. Since the gs over- estimate the population effect size, particularly if they were derived from small samples, they were converted to ds (see Hedges and Olkin, 1985). Separate effect sizes were computed for correct and incorrect details.

For most studies means and standard deviations of the dependent variables were available and were thus used for the calculation of the effect sizes. Otherwise, calculation was based on F or t values. If means were reported separately for different categories of details ( e g Geiselman, Schaap and Woodruff, 1993), a grand mean was computed, the standard deviations were pooled and a single effect size was computed. In several studies incorrect details (i.e. details men- tioned in recall that are discrepant with the respective detail in the to-be-remembered event) and confabulated details (i.e. details that were mentioned by the interviewee but were not present in the event) are reported separately. Many previous researchers, however, have not reported data separately for (i) incorrect details and (ii) confabula- tions, but have combined these two different sorts of error into a single variable. For this analysis a single effect size was computed for total incorrect details. For those studies where incorrect and confabulated details were reported separately, the respective effect sizes were coni- puted individually and then pooled. Further, if a standard interview group was compared to more than one cognitive interview group

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

14 G . KOHNKEN E T A L

(e.g. Geiselman et a/., 1993) the resulting effect sizes were pooled and only a single composite effect size was used for the computation of the mean effect size. In case of a repeated measurement design where each participant had been interviewed twice (e.g. McCauley, 1993) only the effect size for the first interview was included in the analysis. Hence no subjects are represented more than once in the final analysis.

The mean of the 55 effect sizes was computed by weighting each d by the reciprocal of its variance. This procedure gives greater weight to effect sizes which are based on larger samples and can thus be assumed to be more reliable. In addition, the homogeneity of the effect sizes was examined. The overall result can only be adequately described with a single composite effect size if the set of effect sizes can be assumed to be homogenous (Hedges and Olkin, 1985). Therefore, outliers among the effect sizes were identified and sequentially removed until homogeneity was achieved (Hedges and Olkin, 1985). The removed studies were then examined with regard to study characteristics andlor methodological differences from other studies.

RESULTS

Anrily,vis of Eifect Sizes for Correct Details

A mean effect size for the difference in the number of correct details recalled was computed with each of the effect sizes weighted by the reciprocal of its variance (Hedges and Olkin, 1985). This resulted in a mean effect size d=0.93 with a 95% confidence interval from 0.85 to 1.02, indicating more correctly recalled details in a cognitive inter- view than in a standard interview. However, the examination of the homogeneity statistic Q,, which has an approximate chi-square dis- tribution with k - I degrees of freedom, where k is the number of effect sizes, showed that the set of effect sizes is heterogeneous (Q(35)= 246.115, p <O.OI). Therefore, the mean effect size cannot be regarded as an appropriate estimate of the population effect size (Hedges and Olkin, 1985). In order to attain homogeneity the largest outliers were identified and successively removed until homogeneity was achieved. The removal of nine study effect sizes (Brock and Fisher, 1994, first interview, study effect size d=1.55; Saywitz et d., 1992, 11-12 year olds with practice interview, study effect size d=2.76; Geiselman et d., 1993, study effect size d = 3.56; Aschermann c’t d., 1992, study effect size r/=0.04; Dannenberg, 1994, video condition, study effect size d = 2.52; Mello and Fisher, 1996, study effect size d=3.16; Memon ct id., 1996, study effect size tl=0.25; Loohs, 1996. study effect size r / = 2 . 1 7 ; Campos and Alonso-Quecuty, 1997a, study effect size d = 1.82) was necessary to achieve homogeneity (Q(45) = 64.593, p > 0.05).

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

META-ANALYSIS OF THE COGNlTlVE INTERVIEW 15

Analysing the remaining study effect sizes resulted in a mean effect size for correctly recalled details of d=0.87 in favour of the cognitive interview. The 95% confidence interval covers the range from 0.77 to 0.97. Thus, the mean effect size is significantly different from 0 ( p <0.01) which would indicate no effect.

Analysis of the Effects of Studji Churuc,teristic-s

A weighted least squares multiple regression with weights equal to the reciprocal of the variance of each effect size was calculated to examine the effects of interviewees’ age, delay, type of cognitive interview, type of scenario, type of control group, involvement of the interviewees, and the laboratory where the studies had been conducted. For each predictor a test of significance was calculated. Furthermore, a test of model specification was calculated which evaluates whether significant systematic variation remains unexplained in the regression model (Hedges, 1982; Hedges and Olkin, 1985). The sum of squares error statistic QE, which provides the test of model specification, has an approximate chi-square distribution with k -11 - 1 degrees of freedom, where k is the number of effect sizes and p is the number of predictors.

Table 2 shows the results of the multiple regression analysis. The overall regression effect proved to be significant ( p <0.01). The effect sizes for correct details are significantly influenced by the length of the delay between observing an event and the interview ( p <0.01), by the interviewees’ age ( p <0.01), by the involvement of the interviewees in the witnessed event (p<O.OI) and by the laboratory where the study has been carried out ( p < O . O I ) . The multiple R of 0.76 suggests that

Table 2 correct details as dependenl v;rriable

Results o f weighted least squares multiple regression with effect sizes for

Age Delay Type of CI Laboratory Scenario Control group Involvcment

Constar1 t Multiple R PI

B

- 0.30 - 0.0s - 0.03 -0.53

0.22 0.08 0.62

1.29 0.76

370.29*

Sl~rrrrl(rrrl Error 0.062 0.004 0.053 0.079 0.080 0. Oh 7 0.093

BCl(/

- 0.2027 - 0. 5070 -0.0203 - 0 . 3 10 I

0.1437 0.0642 0.3152

Z-VLrllrc~

-4.79” - 11.29 * -0.51 - 6.72 *

2.74 * 1.27 6.59 *

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

16 G . KOHNKEN E T A L

the model was moderately successful in accounting for the variability of the effect sizes.

For descriptive purposes additional categorical models according to study characteristics which had yielded significant effects in the multivariate analysis were Fitted to the data following the procedure suggested by Hedges and Olkin (1985). Differences in the effect sizes due to study characteristics can be evaluated through a comparison between classes (QJ, which is analogous to testing a main effect in an ANOVA. The estimate Qb han approximate chi-square distribution with p - l degrees of freedom, where p represents the number of classes. The homogeneity within each class is estimated by Q w , which has an approximate chi-square distribution with m - 1 degrees of freedom, where m is the number of effect sizes in the class (Hedges and Olkin, 1985).

Interviewees’ age Whereas the multivariate analysis revealed a highly significant effect for the interviewees’ age, a univariate comparison of effect sizes for correct recall obtained from 34 studies involving adults (aged 14 years and above) and children younger than 14 years (k = 21) just missed the significance level (adults: d =0.98, children: d =0.81; Qb=3.11, p<0.08).

Involvernent qf‘ interviewees In 43 of the studies the interviewees watched the episode as passive observers, whereas in 12 studies they actively participated in the event (e.g. a “Simon says” game in McCauley, 1993 and Saywitz et al., 1992). A comparison of these two groups revealed a significant difference in the mean effect sizes for correct details in both the multivariate and the univariate analysis. The mean effect size is larger for interviewees who had actively participated in the to-be-remembered event compared to passive witnesses (partici- pants: d = 1.42, witnesses: d =0.84; Qb=24.82, p<0.01).

Type of prcsmtufion The regression analysis revealed a significant effect for the type of presentation of the to-be-remembered event (staged event or video film). This result is mirrored in the univariate analysis. The 22 studies that used staged events obtained a mean effect size of (1 = I . I I ( n = 22), compared to r l = 0.85 resulting from 33 studies where video films were presented to the intcrviewecs (Qh =7.24. / J < 0.01).

Lcihoralory Comparing the study effect sizes that were obtained by Geiselman and Fisher and their colleagues with those from other laboratories resulted in a highly significant difference for correct recall

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

META-ANALYSIS OF THE COGNLTIVE INTERVIEW 17

with larger effects obtained by Fisher and Geiselman (Fisher/Geiselman labs: k = 16, d= 1.57, other labs: k=39, d=0.77, Q,=55.30, ptO.O1) .

Delay The effect size for correct details decreases as the delay between the observation of an event and the interview increases ( z = -11.29, p<0.01).

Interestingly, no significant differences were found for the type of cognitive interview (originals vs. enhanced version) nor for the type of control group (trained vs. untrained interviewers).

Anulysis of' Eftkct Sizes .for Incorrect Details

The mean effect size for incorrectly reported details is 61 = 0.28, indicat- ing that more incorrect details are reported in a cognitive than in a standard interview. The 95% confidence interval ranges from 0.20 to 0.36. Thus, this effect is significant. However, the homogeneity statistic Q , suggests a rejection of the hypothesis of homogeneity (Q,(54) =

125.96, p<0.01). In order to attain homogeneity the largest outliers were successively removed until homogeneity was achieved. The stu- dies removed were Chapman and Perry (1995), study effect size d = -0.49, Loohs (1996), study effect size d = -0.79, Mello and Fisher (1996), study effect size d = 1.63, Hernandez-Fernaud and Alonso- Quecuty (1997), study effect size d = 1.11, and Brock and Fisher (1994), study effect size t l = 1.03. The resulting homogeneity statistic showed that this procedure lead to sufficient homogeneity (Q,(49) = 69.031, p>O.O5). The mean effect size for this sample is d=0.24 with a 95% confidence interval from 0.15 to 0.32. Because this interval does not include zero, it indicates that the cognitive interview produces signifi- cantly more incorrect details than a standard interview.

As with the efl'ect sizes for correct details a weighted least squares multiple regression with weights equal to the reciprocal of the variance of each effect size was calculated with effect sizes for incorrect details as a dependent variable to test the effects of interviewees' age, delay, type of cognitive interview, type of presentation of the scenario, type of control group, irivolvement of the interviewees, and the laboratory where the studies had been conducted. Table 3 shows the results for this regression analysis.

The analysis yielded a significant overall regression effect ( p < 0.01). As can be seen from Table 3 the effect sizes for incorrect details are significantly influenced by the length of the delay between witnessing an event and the interview ( p <0.01), by the interviewees' age ( p <0.01), by the type of the cognitive interview used ( p <0.01), and by the laboratory

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

I X G. KOI-INKEN ETAL.

Table 3 incorrect details as dependent variable

Results of weighted least squares multiple regression with effect sizes tbI

Age Delay 'Type of CI Laboratory Scenario Control group Irivolvenient

constant Multiple R Q,

-0.258 -0.019

0.400 -0.278

0.074 0.027

-0.133

0.58 0.65

257.62'

S/ortdrrrcl Error

0.05586 0.00388 0.04869 0.06967 0.07033 0.05910 0.08588

-0,262440 - 0.30048 I

0.454237 -0.265791

0.076535 0.03 1490

- 0. I10480

-4.63 * -4.97 * - 8.12 * -4.01 *

I .05 0.47

- 1.56

where the studies had been conducted (p<0.01). No other predictor variable had a significant influence on the effect size for incorrect recall. The multiple R of 0.65 suggests that the model was moderately success- ful in accounting for the variability of the effect sizes.

For descriptive purposes additional categorical models according to study characteristics which had yielded significant effects i n the multivariate analysis were fitted to the data following the procedure suggested by Hedges and Olkin (1985).

ft~ter~iieiiw.~' uge Comparing the effect sizes from studies with adult interviewees and those resulting from children (aged younger than 14 years) shows significantly larger increases in incorrect recall for adults (adults: d =0.34, children: d=0.1.5, Q,=4.34, p <0.05).

Typc of r~q ln i t i r i c~ i n f m i e w Of the 5.5 experimental comparisons 27 had used the original version of the cognitive interview whereas 28 had applied the enhanced cognitive interview. Fitting a categorical model revealed a substantially larger effect of the enhanced version of the cognitive interview on incorrect details as compared to the original version (original: tl=0.12, enhanced: d = 0.42, QI, = 12.85, p < 0.01).

Lrrhorrrtorv Of the 5.5 effect sizes for incorrect details 16 were reported by Fisher and Geiselman and their colleagues whereas 39 ofthe studies included in this metn-analysis have been carried out in other labora- tories (mainly i n the United Kingdom. Gerniany, Spain, and Frilnce). Comparing the effect sizes from these two groups o f studies shows ;I

larger increase in incorrect recall i n studies carried oiit i n thc Fisher

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

META-ANALYSIS OF THE COGNITIVE INTERVIEW 19

and Geiselman laboratories (Fisher/Geiseiman: cl = 0.42, other labs: d=0.23, Q,,= 3.64, p =0.06). The multivariate analysis results in a clearly significant effect of this variable ( y < O.Ol) , whereas the univari- ate comparison just missed the 5% significance level.

Aclditionul Anuly.se,s

The impact of the cognitive interview on recall is in some studies expressed in terms of percent change of the amount of correct and incorrect information in comparison to a standard interview. Further- more, the majority of studies report the overall accuracy of the interviewees' accounts. Since these are important parameters for the evaluation of the effectiveness of the cognitive interview, the percent change in correct and incorrect details as well as the accuracy rates (i.e. the proportion of correct details relative to the total number of details reported by the interviewees) were calculated for standard and cognitive interviews whenever the required data were available. The results are displayed in Table 1.

Acctrrucy The unweighted mean accuracy rates are extremely similar for both types of interview: 85% for the cognitive interview and 82% for the standard interview, respectively. The correlation between these two sets of data is r =0.87 ( p < 0.01). For the majority of studies the proportion of incorrect details is less than 20% in both types of interview. Irrespective of interview type most of the higher error rates were found in studies involving children as interviewees (e.g., Memon rt ul., 1992; Akehurst et ul., 1993, 8-9 year olds) or people with learning disabilities (Brown and Geiselman, 1990). However, not all studies with child samples yielded low accuracy rates (e.g. Saywitz et d., 1993; McCauley, 1993). This indicates that appropriately adjusted interview techniques (like prior practice in some of the Saywitz et ul. conditions) may lead to remarkably high accuracy rates for children.

Prrcrnl ciictnge in correct U F K I inc'orrrct cietuil.s Across all studies included in this meta-analysis, 41% more correct details were recalled in the cognitive interview compared to a standard interview. Only four out of 55 studies found no difference between standard and cognitive interviews (Saywitz Lit d., 1993, 10 11 year olds; Memon et d. , 1992, 1994; Mantwill et d., 1992). In the remaining 51 studies, the increase in correctly recalled details ranged from 15% to 147%. The incorrectly recalled details, on the other hand, increased by an average of 25%. The variability of thc percent change in incorrect details is considerably

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

20 G . KdHNKEN E T A L .

larger than the one for correct details (incorrect details: S D = 59.5%, correct details: SD = 30.39%). The differences in incorrect details between cognitive and standard interviews cover a range from -40% (i.e. 40% ,fewer incorrect details generated in cognitive interviews compared to standard interviews) up to 313% more incorrect details in cognitive interviews (see Table I) .

No significant correlations were found between accuracy rates and percent increase. Similarly, the correlation of effect sizes for correct and incorrect details is small and not significant ( r =0.12; n.s.).

DISCUSSION

This meta-analysis reviewed 42 experimental studies with 55 compar- isons of the cognitive interview and a standard interview with a total of nearly 2,500 interviewees in order to estimate the overall effect of this type of interview on the recall of correct and incorrect details. The results of this analysis support the hypothesis that a cognitive inter- view generates substantially more correct details than a standard (or structured) interview. Following the classification suggested by Colien (1977), the overall mean effect size of d=O.87 is a very strong effect. Moreover, this effect is also remarkably stable and consistent. Only four experimental comparisons failed to produce a signiticant effect in favour of the cognitive interview and only in two of these studies (Memon rt d., 1993, 1994) did the amount of incorrect information increase substantially. Moreover, no experiment has been reported yet where a cognitive interview had resulted in fewer correct details compared to a standard interview. Thus, it can be concluded that the worst possible effect that may be obtained when a cognitive interview instead of a standard interview is applied is simply no effect at all. (Note also that the overall mean effect size of d=O.87 is a conservative estimate.) The nine study effect sizes that had to be removed in order to achieve homogeneity represent a mean effect size of 1.98. Inclusion of these effect sizes would have resulted in an overall mean effect size of d =0.93.

Why did some studies not find the usual increase in correct details? Mantwill i’t d. (1992) asked the participants to produce a written report of a lengthy event. Since other experiments reported by these authors using the same to-be-remembered event found significant effects for the cognitive interview with oral interviews the lack of improvement may be a result of the interviewecs’ low motivation. Memon ct r d . (1993) interviewed children as young as six years using the original version of the cognitive interview. This result, together with the findings of morc

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

META-ANALYSIS OF T H E COGNITIVE INTERVIEW 21

recent studies involving young children (e.g. Loohs, 1996) suggests that the traditional version of the cognitive interview may cause problems for children younger than seven years. However, appropriate modifications (Memon ef al., 1996; Milne ef d., 1995), the use of props (Loohs, 1996) or a practice session for interviewees (Saywitz et al., 1992) may improve its effectiveness even for preschoolers. Memon et al. (1994) used experi- enced police officers as interviewers who had received a short training in applying the cognitive interview. The authors argue that the training was of insufficient length and quality in order to change long established poor interviewing habits. Why Saywitz rt a/. (1992) did not find an effect in one of six comparisons is unclear (Geiselman, personal communication).

Relating effect sizes to a number of study characteristics shows that the effect of the cognitive interview on correct recall is influenced by the length of the delay between witnessing an event and the interview (smaller effect sizes for longer delays), by the interviewees’ age (smaller effect sizes found with children as interviewees as compared to adults), the type of presentation of the to-be-remembered event (larger effects for staged events compared to video films), the involvement of the interviewees in the to-be-remembered event (larger effects for partici- pants rather than passive observers), and the laboratory where the study has been carried out (larger effects reported in studies by Fisher and Geiselman compared to studies conducted in other labs). Surpris- ingly, the enhanced cognitive interview did not lead to larger effects than the original version of the cognitive interview. Also contrary to expectations, the effect of the cognitive interview does not decrease when in the control condition trained interviewers are used rather than untrained interviewers.

Interestingly, the memory enhancing effect of the cognitive interview on the recall of correct details is even greater in studies that applied more realistic experimental procedures as compared to laboratory conditions. The average effect size found in studies that used staged events as to-be-remembered episodes is d = I . I 1 a s compared to a mean effect size of d=0.87 when the interviewees had to remember the contents of a video film. Furthermore. if the interviewees had been actively involved in the episode the effect size is considerably larger than the one that IS obtained with passive observers (d = 1.42 for active participants as compared to r l = 0.84 for passive observers, respectively). Moreover, these larger effect sizes found for correct recall are not accompanied by a stronger increase in the number of incorrect details.

However, some of these results should be interpreted with appropri- ate caution. For example, the length of delay was found to have a

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

22 G . KOHNKEN E T A L

strong impact on the effect size for correct recall. However, the majority of studies used only short delays (Mt/n=2 days; 90% of the studies report delays of up to seven days). Any conclusions with regard to the impact of the effects of a cognitive interview for delays longer than seven days are, therefore, unjustified by these data. Moreover, therc are two studies with a comparatively long delay that did not find any increase in correct recall in a cognitive interview (3 weeks: Aschermann c’t d,, 1992; 12 days: Memon rt c d . , 1996). Because of the large n used in the prior study (Aschermann rt ul., 1992) the respective effect size receives a large weight in the data analysis. Eliminating this study effect size from the data set reduces the effect of delay length considerably. Furthermore, the Aschermann rt crl. (1992) study asked their interviewees to write down their responses which may have resulted in less recall due to motivational factors. In addition, recent research (Fisher, personal communication) has found the cog- nitive interview to be effective i n recovering memories that are up to 35 years old.

The effect sizes found with children (bclow the age of 14) are slightly smaller than the ones for adults (d=0.81 for children and d=0.98 for adults, respectively). However, because the majority of the child interviewees were aged seven years and above it is only safe to conclude from the available data that the traditional form of the (enhanced) cognitive interview improves recall from the age of seven years to a similar extent as for adults. For children younger than seven years a modified cognitive interview procedure and the use of props may be necessary to enhance correct recall (Loohs, 1996).

Across all studies included in this meta-analysis the cognitive interview also generated significantly more incorrect details (d = 0.24). Therefore, the conclusion drawn from earlier studies on the effects of the cognitive interview that incorrect recall is not affected by this type of interview is no longer justified. This effect is, however, not only considerably smaller than the average increase in correct recall, it is also less consistent. The individual study effect sizes for incorrectly recalled details cover a range from d = -0.89 up to d = 1.62 and a substantial number of studies report negative effect sizes (i.e. fewer incorrect details i n cognitive interviews than in standard interviews). For correctly recalled details, on the other hand, not a single signifi- cant negative effect size has been reported in the literature.

Comparing effect sizes for incorrect details according to various study characteristics showed significant differences for the inter- viewees’ age (smallcr increases in incorrect details for children than for adult interviewees), for the type of the cognitive interview (larger increases in studies that used the enhanced version) and for the

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

META-ANALYSIS OF THE COGNITIVE INTERVIEW 23

laboratory where the studies had been conducted (larger increases in studies reported by Fisher, Geiselman and colleagues as compared to experiments that had been carried out in other labs).

As can be seen in Table I , the larger effect sizes for incorrect recall in experiments conducted by Fisher, Geiselman and colleagues mainly appear in their more recent studies. These are also studies that employed the enhanced version of the cognitive interview. The early studies from the Fisher and Geiselman laboratory almost uniformly found no change or even small decreases in the number of errors. This pattern of results suggests that the additional components of the enhanced cognitive interview may have the potential to increase the production of errors. A possible explanation for this phenomenon could be a criterion shift for reporting details. People who are interviewed using an enhanced cognitive interview may feel inclined to report details even if they are unsure. As a consequence, the increase in correct details would be accompanied by a growth in errors. If this were the case, the effect sizes for correct and incorrect details should be correlated. However, this correlation was found to be small and not significant (Y =0.12) and, thus, does not support a criterion shift hypothesis. Furthermore, if interviewees interviewed with a cognitive interview lowered their criterion levels for output, it would in turn be expected to result in a decrease in the accuracy rate. However, the accuracy of the information (proportion of correct details relative to the total amount of details) obtained with a cognitive interview and a standard (or structured) interview is almost identical in nearly every single study (see Table 1). Overall, the average accuracy rate for information generated with a cognitive interview amounts to 85%, compared to 82% for a standard (or structured) interview. Taken together, this pattern of results strongly suggests the conclusion that a cognitive interview generates substantially more information than a standard interview and that this increased amount of detail is no less accurate than the information obtained in a standard interview.

The overall mean effect sizes for correct and incorrect details can be interpreted with some confidence. However, the results of the multiple regression analysis as well as of the categorical models should be viewed with some caution. The basic problem of this meta-analysis lies in the fact that most of the studies (41 of 55 experimental comparisons) were conducted by three research groups (Fisher, Gciselman and colleagues in the U.S., Kohnken, Aschermann, Mantwill and col- leagues in Germany, and Memon, Milne, Bull and colleagues in the U.K.). Each research group applied a set of certain expcrimental procedures and coding techniques which are more or less homo- geneous for studies conducted by one group and differ in several

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

74 G . KOHNKEN ET AL.

respects from the experimental procedures used in other groups. Some of the study characteristics that were included in the multiple regres- sion analysis and the analysis of categorical models are, therefore, confounded. As a consequence, it is very difficult to identify the effect of a particular study characteristic (e.g. the type of control group interview) and distinguish it from the effects produced by other vari- ables (e.g. type of the cognitive interview). For example, the European studies were more likely to use a structured interview as the control compared to Geiselman and Fisher who tended to use a ‘standard’ police interview. Also, the original version of the cognitive interview was typically compared against the standard police interview whereas fhe enhanced cognitive interview tended to be compared against the ‘better’ (compared to the ‘standard police interview’) structured inter- view. This latter confound could help to explain why there were no differences found in correct recall between the original and enhanced cognitive interview. Fisher et id. (1987) found that the enhanced cogni- tive interview elicited 45% more correct facts than the original cogni- tive interview in a direct comparative study.

The cognitive interview was developed by Geiselman and Fisher in order to help the police generate information from witnesses and victims in criminal investigations. However, the application of this interview technique is by no means restricted to this domain. It may be beneficial whenever the main purpose of an interview is to obtain information from an interviewee about events that have happened in the past and that now has to be retrieved from memory. This may be the case when, for example, in the course of medical examinations the exact circumstances of the onset of an illness have to be identified, when psychotherapists attempt to reconstruct the history of behav- ioural problems, when historians investigate historical events by means of oral reports, to name just a few potential fields of application. I n these and similar areas the cognitive interview may help to generate more information.

This revicw of the effects of the cognitive interview also helps to identify areas that require more research. I n particular, more studies are needed with longer time delays between experiencing ;in event arid being interviewed. Only very few studies have applied time delays longer than seven days. From the available data it is therefore difficult to draw any conclusions on the effects that the cognitive interview may have if people are interviewed later than a week al‘ter an event. Furthermore, there are indications that the common form of the cog- nitive interview may not work with children younger than seven years. Therefore, research is needed which examines the effectiveness of modified versions of the Cognitive interview for use with preschoolers.

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

META-ANALYSIS OF T H E COGNITIVE INTERVIEW 25

Finally, whereas the effect sizes for correct recall are remarkably robust, the meta-analysis shows considerable variations for the recall of incorrect details. The fact that a number of studies did not find increases (or even report decreases) in the amount of incorrect infor- mation while others report substantial increases in this variable sug- gests that it may be possible to limit the increase in incorrect details without sacrificing the gain in correct recall.

Rc f ' erences

Akehurst, L., Milne. R . arid Kohnken, G. (1994. July). The c:f/i,ct.s q/crgc~ unil c1elu.v on recall in ii cogni/ior interoiew. Paper presented at the International Congress of Applied Psychology in Madrid, Spain.

Aschermann, E.. Mantwill, M. and Kohnken, G. (1991). An independent replication of the effectiveness of the cognitive interview. Applied C'ognirivr P.syc/rology, 5 , 489-495.

Boon, J . C. W. and Noon, E. (1994). Changing perspectives in cognitive interviewing. P.syc~/io/o(~J~, Cri iw und Ltriv, I , 59- 69.

Bower, G. H. (1967). A niulticomponent view of a memory trace. In K. W. Spence and .I, T. Spence (Eds.). The p s y / d o y j ~ ~ o/ l c w t i i n g irnd i ~ t i ~ ~ / i ( ~ t t . Vol. ;. New York: Academic Press.

Brock. P. and Fisher. K . P. (1994, March). El/ i~c/i iwress o f ' / / IC cy/nir iuiJ irrleroicw i n LI

t~ru/ / ip/~- /c~.v/ i~ly . S ~ / U U / I ( J I L Paper presented at the Biennial meeting of the American Psychology and Law Society, Santa Fe.

Brown. C. L. and Geiselnian, R . E. (1990). Eyewitness memory of mentally retarded: effect of the cognitive interview. Journtrl of ' P oliiv uncl ('riniitrolo!iiccrI P.v.vi~holog~. 6. 14-22.

Campos. L. and Alonso-Quecuty. M. (1997a, i n press). Knowledge of crime context and cognitive interview: Improving the understanding 0 1 why the cognitive interview works. Mcrtlory.

Campos. L. and Alonso-Quecuty, M. (1999). The u@/ic~c, in/wcim,; Much twri' / / tun ,~ittip/y t r j ' uptit is Psyc~tiolo~/s. C'rinic, untl Luw. 5, 47- 59.

Chapman. A. J . and Perry, D. J . (1995). Applying the cognitive interview procedure to child and adult eyewitnesses of road accident witnesses. Appl ic~l P.sydioloql.v: An Infernu/iotztrl Riviiw,. 44, 283 ~ 294.

Cohen. J. (1977). S / t r / i . s / i i ~ t r / p w r t r n t r l ~ ~ . s i . s , / o r f / i e hchc~ ior i r l .sciencr~ (Rev. ed.). New York: Academic Press.

Dannen berg. U . (1994). Drts Koqniriiie / n / i w i e i t , trls M c ~ / h d e dc,r Er/itrqunq t r ~ o h i o - . Einc Uii/i~r.suc~liunq m n E I i ~ / I u / ~ i'on EiiX.oilirrhrdin(/irn!lpn L I I I I ~

Dissertation. Fisher. R. P., Chin, D. M. and McCauley. M. K . (1990). Enhancing eyewitness

recollection with the cognitive interview. N t ~ i ~ ~ t i t t l Pol ic .~ Ri,.scwrch Uiii/ Rrc Fisher, R. P. and Geiselman, R. E. (1992). Mi,i~/(Jr~,-c , t t / / [~i tc , i t i~/ /cc~lrnii/uc~.s / b r inc~i,sriqrr/iw

i t / /~,r i , ;~, i i , i i i~/: T/rc c,o<ini/ioc i t m v i i w * , Springfield. 111.: Charles c'. Thomas. Fisher, R. P., Geiselman K . E. and Aniador. M. (1989). Field test of the cognitive

interview: Enhancing thc recollection of iictu:il victims and witnesses o f Crime. J(Ju~ I /u / ( J / Applicd P . \ j ~ i h / o ~ / I ~ . 14. 722 ~ 727.

Fisher. R. P., Geiselman. R . E.. Raymond. D. S.. Jurkcvich, L. M. and Warhaftig. M. L. (19x7). Enhancing enhanced eyewitness memory: Refining the C'ognitive Interview. J ( i ~ / r n u l O/ P ( J / ~ w Sciiviw tnrt l A(ltl i it i i ,s/ri/ / i( ltt, IS. 2') I 297.

Fisher, R . P. and Quiglcy, K. L. (1992). Applying cognitive theory in public health investigations: Enhancing food recall. In J . Tanur ( E d . ) . QucWion.s trhorf/ c~ iws1 ior i .c - /ti~/L(i,./<'.\ l l / / l J / / W i.o</t/i//I'c' /X/.V<'.Y l J / .\/,fl'<:l'.\ (PP. 81 99). New Yolk: Sage.

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

26 G. KUHNKEN E T A L .

Fisher, R. P.. McCauley, M. R. and Geiselnian, R. E. (1992). Improving eyewitness memory with the cognitive interview. In D. Ross, J . D. Read, and M. T o g h (Eds.), Atlulr c~yt~i~-itne.ss tc>stiniony: Curretit trerir/.s rind [ / t~ i~~~/ ( ipt~ i i , i i / .s . New Y ork: Cambridge University Press.

Geiselnian, R. E., Fisher. R . P., Firstenberg. I., Hutton, L. A., Sullivan, S., Avctissian, 1. and Prosk, A. (1984). Enhancement of eyewitness memory: An empirical evaluation of the cognitive interview. Jourrid o / Po/ic<r Scic-nct~ und Ar/mitii.str[rtiori, 12. 74 -80.

Geiselman. R. E., Fisher, R . P., MacKinnon, D. P. and Holland. H. L. (1985). Eyewitness memory enhancement in the police interview: Cognitive retrieval ninc- nionics versus hypnosis. Jourtiul oj'App1ic.d P.syc/io/oqI~. 70. 401 ~ 412.

Geiselman, R . E.. Fisher, R. P., MacKinnon. D. P. and Iiolland, H . L. (1986). Enhancement of eyewitness memory with the cognitive interview. At~rcv+trtr Joirrrirrl

Geisclnian, R. E. and Padilla, J . (1988). Interviewing child witnesses with the cognitivc interview. Jourtitrl (is Policw Scietice cmtl Adniinistrririoti. 16, 236 ~ 242.

Geiselnian, R. E.. Taras, L., Schaap. R. and Woodruff, N. (1993). Recall of constituent cleiiients from multiple episodes of an event using the cognitive interview. Jourtid ( I / '

Policr trntl C'riniind P syi.ho/o:jy, 10, 1-7. George, R. ( 199 I). A ,/id(/ ttnd t~.rperimmtu/ c~r~aluurion of' t / i rw rriei/iot/.s o/' interttivviti<j

wi tnews rind iric,titm of' crime.. Unpublishcd master's thesis. Polytechnic of East London. England.

Gwyer, P. and Clifford. B. R. (1997). The effects of the cognitive interview on recall. identilication, confidence and the confidencc/accuracy relationship. Appl i td C'o; jni / i iv Ps)~t~/io/o~~,v, I I . 121- 145.

Iiedges. L. V. (lYX2). Fitting continuous models to effect size data. J(Jffrtld of Edrrc~trriontrl Stutistics. 7, 245-270.

Hedges, L. V. and Olkin. I. (1985). S/otistic,ri/ nict/iods fiir /rit~/ci-rrtro/.v.si.v. New York: Academic Press.

Hernindez-Fernaud, E. and Alonso-Quccuty, M , (1997). The cognitive interview and lie detection: A new magnifying glass for Sherlock Holines? Applicvl C'o{/wi/iue P.Y~c/Io/- q v . I I . 5.5-68.

Kebbell, M. and Milne, R. (1998). Police officers' perception of eyewitness factors i n forensic investigotions. Journrtl of Socitil Psyc/io/oqy, 138. 323-330.

Kiihnken. G.. Fingcr, M., Nitschke. N. HGfer. E. and Aschermann, E. (1992). Does (1

c'o{/nitiw ititeriritw ititrrfcre with u suhsrquenl SltrIetneni Vu/idity Antr/ysi.s'? Paper pre- sented at the Conference of the American Psychology and Law Society in San Diego.

Kohnken, G . . Mantwill, M., Aschermann, E. and Vieweg. I. (1992). Ein Vmqleich d t , s Kognitil't,ti l t i t i w i w . \ rnit citrtwi Str~~l i tur i t~rr rn /t i / iwicw utid cinor Kontrollgrirppc~ olirw Trtritziny [A comparison of the cognitive interview with a structured interview and a no training control group]. Univcrsitiit k e l : unpublished manuscript.

KGhnken, G . , Schimossek, E.. Ascherniann, E. and Hofer, E. (1995). Statement validity analysis and the cognitive interview. Joirrnul of Applied Psycliologi,. 80, 671 684.

Kcihnken, G., Thiirer, C. and Zoberbier, D. (1994). The cognitive interview: are the interviewers' memories enhanced, too? A / J p / i f d co(/fiififw P.syc'/io/o;/j,. 8. 13 ~ 24.

Loftus. E. F. (1979). Eyt,ivittws.s ttvtitnony. Cambridge. Mass.: Ilavard University Press. Loohs. S. (1996). I l i c Vtwwti(/u/i(/ .spc:j/i.scho Es~ilorci~iot~.s~~rt.ll,oclc.n xtr 6t:fkugiuy

kitit//ic~/ic~r Zi,uqtvi in7 Hitihlick rru/ Ci~t/tic~lirrii.slri.stuti~~, Suyf/r.stihi/itri't und dtrs Wirtli,rt,rketinoi IW? Ge.sic./itcwr [Effects of interview techniques on child witnesses' recall. suggestihiliiy and face recognition]. Regenshurg (Germany). unpublished doctoral dissertation.

M;intwill, M., Aschermann, E. and Kdinkcn. G. (1992). Drrs K o p i i t i i v /rirc,riYtw wid s t , l i c n l t i ( / c / r i t t r ~ , Eriniicrirrry [The cognitive interview and scheiw guided retrieval]. Universitit K i d , Cierniany: Final report for grant No. KO 882/3-1 from the Dcutsche Forsch uiigsgcnieiiiscliaft.

Mantwill. M.. Kdinken, G . and Aschermann. E. (1995). ElTects of the cognitive intcrview on the recall of Pamiliar and unfamiliar events. Joiir/irrl ( I / A / i p / i t d

o/ P.syihlo</,v, 99, 385 ~ 401.

/'.sl~,~/ro/o~/l'. 80, 6X 7x.

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4

META-ANALYSIS OF THE COGNITIVE INTERVIEW 27

McAlpine, S. (1996). Tlir r.ogni/iiv~ in/rruiciv trtd older p w p l r : DOCS i / c v i / i r r n c ~ c , r c ~ r r l l ? Leicester: Unpublished MSc dissertation.

McCauley. M . R. and Fisher. R . P. (1995). Facilitating children's eyewitness recall with the revised cognitive interview. Journtrl o / A p p / i c d P . s : , Y ~ ~ J / o ~ / J ~ , 80. 510-516.

Mello, E. W. and Fisher. R. P. (19%). Enhancing older adult eyewitness memory with the cognitive interview. App/ i r t / Coqniliw Pqdiu loqy . 10. 403 417.

Memon. A,. Cronin. O., Eaves. R . and Bull. R. (1993). The cognitive interview and child witnesses. I n N . K. Clark and G . M . Stephenson (Eds.). Cltilt/r.err. Eiitlcrii~c rrnt l Proi,d~rrc,. Leicester: British Psychological Society.

Memon, A., Holley, A,, Milne, R.. Kohnken. G . and Bull, R. (1994). Towards understanding thc effects of interviewer training in evaluating the cognitive interview. Applied ~ l J p l i / i l 1 0 P . s ~ 3 c ' / l o / O ~ / ~ , 8. 641 - 659.

Menion, A., Holley. A,. Wark. L.. Bull, R . and Kiihnken, G. (1996). Reducing suggestibility in child witness interviews. Applirtl C'o<qni/iw Ps,~cliologq~~, 10, 503- 518.

Memon, A,, Wark. L.. Bull. R. and Kohnken. G. (1997a). Isolating the effects of the cognitive interview techniques. Bri/r.sh Joirrntr/ of P

Memon, A,. Wdrk, L., Iiolley, A., Bull. R. and K performance in cognitive and structured interviews. Memory, 5. 639 6.56.

Milne. R . and Bull, R. (1996). Interviewing children with mild learning disability with the cognitive interview. I n N. K. Clark and G. M. Stephenson (Eds.). Inr~r.stiyuritr t r n d /[email protected] decision / n d i n q . Leicester: British Psychological Society.

Milne, R.. Bull. R.. Kohnken, G. and Memon. A. (1995). The cognitive interview and suggestibility. In G. M. Stephenson and N. K. Clark (Eds.). Critnind Bc/tutioiir: Pcrcv/~rions. A//rihu/ion.\ tint/ &// ion(r / i / j * . Division of Criminological and Legal Psychology Occasional Papers, No. 22. British Psychological Society, Leicester, UK.

Milne. R. , Clare. I . and Bull. R . (1999). Applying the cognitive interview for use with adults with mild learning disability. P.s jd io /o~ /~~ , C'rinw trntl Ltrw, 5, 81-99.

Newlands, P. and M ~ L c o d , M. D. (1992). Con/inuin</ ~ h r c , o q n i / i i ~ ~ inrerlirii,. Poster presented at the European Conference of Psychology and Law, Oxford, England.

Py, J.. Ginet. M.. Desperirs, C. and Cathcy. C. (1997). Cognitive encoding and cognitive interviewing in eyewitness testimony. Swis.s Journrrl o / P.qlv/io/oc/j~, 56, 33 41.

Py. J . and Fernandes, C. (1995). L'hypnose et I'entretien cognitif: deux techniques et7icaces d'amelioration d e la memoire dcs teinoins. P.~i~clrolo~qic, Frtni(wi.sc,, 40, 281 -294.

Rand Corporation. (1975). Tlw cr imind i w ~ v , s / i q ~ r / i o n /iroc'.ss. Vo/.\. /--Z. Rand Corpora- tion Technical Report R-1777-DOJ. Santa Monica.

Saywitz. K . J . . Geiselnian, R. E. and Bornstcin. G. K. (1992). Efl'ects of cognitive interviewing and practice on children's recall perforniance. Jorrrmrl of Ap/ i / i c~ l

Tasslcr, K., Mantwill. M., Aschermann. E. and Kbhnken, G . (1992). Effects of the cognitive interview a s compared t o a structured interview and a control group without interviewcr training. Universitaet Kiel, Unpublished manuscript.

Tulving. E. (1974). Cue-dependent forgetting. Anwricwi ,'kitw/i.s/, 62, 74- 82. Tulving, E. and Thomson. D. M. (1973). Encoding spccificity and retrieval processes i n

Wickens, D. (1970). Encoding categories of wortis: An empirical approach to meaning.

P.Sl'C/lO/O$/j'. 77, 744 756.

episodic memory. P s j ~ r ~ l r ~ ~ l o ~ q i i ~ t ~ I Rci, i iw, 80, 253 370.

Dow

nloa

ded

by [

212.

175.

88.1

6] a

t 13:

32 2

1 M

arch

201

4