Guided Internet-Based CBT for Common Mental Disorders
Transcript of Guided Internet-Based CBT for Common Mental Disorders
ORIGINAL PAPER
Guided Internet-Based CBT for Common Mental Disorders
Gerhard Andersson • Per Carlbring •
Brjann Ljotsson • Erik Hedman
Published online: 21 May 2013
� Springer Science+Business Media New York 2013
Abstract The Internet has become a part of most people’s
lives in many parts of the world. Since the late 1990s there
has been an intensive research activity in which psycho-
logical treatments, such as cognitive behavior therapy
(CBT), have been found to be effective when delivered via
the Internet. Most research studies indicate that the effects
are larger when some form of guidance is provided from a
therapist, and unguided treatments tend to lead to more
dropout and smaller effects. Guided Internet treatments
often consists of book length text materials, but can also
include other components such as audio files and video clips.
Homework assignment is often included and feedback is
given for completed homework. Guided Internet-based CBT
(iCBT) has been found to work for problems such as
depression, panic-, social anxiety-, and generalized anxiety
disorders. There are many research trials in which partici-
pants have been recruited via media, and there has been less
research conducted in representative clinical settings. Most
research has been conducted on adults and in university
settings with nationwide recruitment. There is a need for
treatments and studies on older adults, children and ado-
lescents. In conclusion, dissemination of the research find-
ings on guided iCBT to regular clinical settings is warranted.
Keywords Internet � Guided self-help � Mood disorders �Anxiety disorders
Introduction
Internet has become an integral part of our lives and with a
few exceptions a majority of the population in the indus-
trialized countries use the Internet daily to communicate
and share information (www.internetworldstats.com).
Within the field of cognitive behavior therapy (CBT) cli-
nicians and researchers realized early on that the Internet
would be of great importance (Riley and Veale 1999), and
psychological research involving the Internet started by the
end of the 1990s (Barak 1999). A background to the study
of Internet treatment is research on bibliotherapy, i.e.
treatment based on self-help texts, which has been shown
to have beneficial effects in studies on anxiety and mood
disorders (Watkins 2008). In the 1980s computerized
treatments were developed and tested (Marks et al. 1998),
but increasingly the field of self-help interventions has
moved on to do research on Internet-delivered CBT
(iCBT).
In this review paper, we will mainly focus on research
conducted in Sweden, in which guided iCBT has been
around for almost 15 years and the treatment has been
G. Andersson (&)
Department of Behavioural Sciences and Learning, Swedish
Institute for Disability Research, Linkoping University,
581 83 Linkoping, Sweden
e-mail: [email protected]
G. Andersson � B. Ljotsson � E. Hedman
Division of Psychiatry, Department of Clinical Neuroscience,
Karolinska Institutet, Stockholm, Sweden
P. Carlbring
Department of Psychology, Stockholm University, Stockholm,
Sweden
B. Ljotsson
Division of Psychology, Department of Clinical Neuroscience,
Karolinska Institutet, Stockholm, Sweden
E. Hedman
Department of Clinical Neuroscience, Osher Center
for Integrative Medicine, Karolinska Institutet,
Stockholm, Sweden
123
J Contemp Psychother (2013) 43:223–233
DOI 10.1007/s10879-013-9237-9
Author's personal copy
implemented in regular clinical practice. There is however
also an extensive international research (Hedman et al.
2012b), conducted mainly in Australia, The Netherlands
and Switzerland. This research will be mentioned as long
as it is the same treatment format (i.e., guided iCBT) that
has been tested. We will focus on mild to moderate mental
health problems as defined by the DSM-IV, but given the
extensive overlap between somatic and psychiatric disor-
ders, it is worth mentioning that iCBT also has been found
to be effective in the treatment of medical problems
(Cuijpers et al. 2008). In addition to describing the treat-
ment format we will review efficacy studies (regular
research studies) and effectiveness studies.
Description of the Treatment Format
To begin with, it is important to point out that there are
different forms of Internet treatment, and indeed of iCBT
as well. A first distinction is the difference between ‘‘open
access’’ programs and programs that require identification
(e.g., closed and not open to the public), are preceded by a
diagnostic interview, and careful screening procedures.
There is a blurred distinction between these formats of
Internet treatments, but an increasing amount of research
suggests that the latter form yields large treatment effects
(Andersson 2009), while open applications with no guid-
ance tend to have higher dropout rates and smaller effects
(Christensen et al. 2006a). Open access programs can be
justified because they can reach a large group of individ-
uals at a very low cost, for example to promote smoking
cessation (Munoz et al. 2012), but they may be less suitable
for more severe conditions and when self-reports need to
be supplemented with interviews to obtain an accurate
diagnosis. It is also possible that open Internet-based
treatment applications for severe conditions could be dif-
ficult to combine with high standards of patient safety and
that failure to respond to treatment could discourage the
patient to seek further therapist-guided treatment.
A second distinction is related to the degree of therapist
support when iCBT is given. The providers of open access
programs do usually not offer any guidance and the pro-
grams are often fully automated (Christensen et al. 2006b).
To date, there are clear empirical reasons to provide some
degree of support to clients in iCBT (Hedman et al. 2012b;
Johansson and Andersson 2012; Palmqvist et al. 2007;
Spek et al. 2007), as effects tend to be much larger. For
example, Spek et al. (2007) found that iCBT without
support had a pooled mean effect size of d = 0.24 whereas
iCBT with support had a large pooled mean effect size of
d = 1.00, and later reviews with a more specific focus
(e.g., depression) have found similar effects (Johansson
and Andersson 2012). As guided iCBT is the treatment
format that is focused in this review we will not comment
further on the unguided treatments, while acknowledging
that there is a room and place for such programs (e.g., the
smoking cessation example), and that future automated
programs may be developed that show sufficient evidence
in terms of treatment effects and that may mimic the char-
acteristics of guided treatments (e.g., therapist support).
The Role of Guidance
Not much has been written on the way guidance in iCBT
should be provided (Titov 2010). Support is usually given
on a regular basis in the form of answers to questions,
encouragement, and feedback on homework assignments
(Paxling et al. 2013). It is important to note that a majority
of the correspondence tends to be in the form of encour-
agement (Sanchez-Ortiz et al. 2011). Usually, the support
consists of short text messages, like email, about once a
week, which means that the therapist spends about 15 min
per patient each week (for example in a 10 week treatment
program). When therapist behaviors were analyzed in a
study on generalized anxiety disorder (GAD), we found
that flexibility with homework completion was negatively
associated with the outcome, and that encouragement was
positively related to the outcome (Paxling et al. 2013).
Thus, in the cases were therapists granted the patient extra
time to work on assignments patients were less improved,
potentially indicating that a clear deadline is an important
part of iCBT (see below for more on this topic). There is a
version of iCBT that is conducted in real time, which is
more like a form of ‘‘chat’’. This form of treatment has
been evaluated in a few studies and is likely effective
(Kessler et al. 2009). However, real time online treatment
does not save time for the therapist, but may be a conve-
nient option for clients who cannot reach a clinic easily.
For these patients, video conferencing, where therapist and
patient communicate using web cameras, might be a suit-
able treatment alternative if the clients are less comfortable
with text interaction. In one form of iCBT treatment called
‘‘Interapy’’ there is a significant amount of writing
assignments for the client, which the therapist reads and
comments on in detail (Ruwaard et al. 2011). This version
of iCBT requires more therapist time, but is about as
effective as treatments with minimal therapist contact (e.g.,
10 min or less per week). In one study the difference
between email-based treatment based on an individual
analysis and guided standardized iCBT for depression was
investigated (Vernmark et al. 2010). The individualized
email treatment worked well, but it can be debated whether
the added effect justified the substantially increased ther-
apist time that was needed.
224 J Contemp Psychother (2013) 43:223–233
123
Author's personal copy
Assessments
There are several key aspects of how guided iCBT can be
implemented in order to be effective. First, careful
assessments before treatment is important so that the per-
son can be matched to the correct treatment (Andersson
et al. 2009a). This assessment may include a diagnostic
evaluation and an assessment of the general requirements
in order to be able to take part of iCBT. One example of a
requirement could be that the person has the opportunity to
work with the treatment material at least a few hours a
week, and sometimes even every day, when engaging in
certain types of behavior change, such as behavioral acti-
vation for depression. Of note is that these requirements
generally do no differ from those that would be applied in
conventional face-to-face CBT.
An important part of Internet treatment is that self-report
inventories are completed online as well as the treatment.
Online data collection presents several advantages over
more traditional measurement methods with increased
more control, fewer data recording errors and more flexi-
bility. This is a research area in itself, where several studies
have demonstrated that psychometric properties are main-
tained when questionnaires are administered over the
Internet. For example, commonly used measures in
research on depression (Hollandare et al. 2010), panic-
(Carlbring et al. 2007a), and social anxiety disorders
(Hedman et al. 2010b) have been found to have adequate
psychometric properties when administered online. One
advantage of completing questionnaires on the Internet is
that items are not skipped (some clients can fail to report
the important issues or even accidentally miss to complete
a whole questionnaire page when they fill in ‘‘paper-and-
pencil’’ forms). Summary scores of the online question-
naires can also be calculated automatically and thus speed
up a screening process. Another important feature is that
iCBT is highly suitable for collecting symptom data on a
weekly basis throughout the treatment as the patient does
not have to log into a separate system, but is required to
complete assessments in order to access the treatment. At
the Internet Psychiatry Unit (IPSY) in Stockholm, Sweden,
the assessment system also has the advantage that it alerts
the therapist when a patient reports suicidal thoughts or
severe depressive symptoms. This is an important feature
of the clinical implementation of iCBT, as therapists tend
to treat several patients simultaneously. These patients may
not have started treatment at the same date, may not suffer
from the same diagnosis, and may be less ‘‘pure’’ in their
symptomatic presentation than participants in iCBT trials.
All these factors make it more difficult for the therapist to
keep track of their patients and automated alert systems are
therefore very valuable.
Data Security
Data security is important to consider when delivering
Internet-based treatments (Bennett et al. 2010). The sys-
tems that we work with are like the systems used when
paying bills online, that is, they are encrypted and use a
double authentication procedure at login. The latter is used
to reduce the probability of identity theft by not only
demanding a personal password to log in, but also a unique
single-use password that is sent automatically to the cli-
ent’s cell phone. All communication with the client is done
within a closed system and not the client’s personal email.
If email and SMS messages are used it is important that
they are designed so that they would not cause harm if
someone else would read the message without the patient’s
approval. An example of acceptable messages might be
simple reminders such as ‘‘You have a message in your
inbox’’. The systems used are continuously updated to meet
the latest security requirements. A possible danger is that
the more secure a system becomes, the more likely the
user-friendliness decreases. Hence, older people and indi-
viduals with only limited computer skills may have prob-
lems accessing very secure systems.
Treatment Contents
The contents of iCBT have gradually changed. When we
started with iCBT we used only PDF files that were
downloaded by the participants and then read. This was
necessary in the late 1990s, because few people had access
to high speed Internet connection by that time. Today, most
people using the Internet in Northern Europe have broad-
band access, and this allows for use of audio files, streamed
videos and interactive elements. However, the treatments
are still basically self-help texts that can either be down-
loaded or viewed directly on the screen. Interestingly, there
are no strong empirical reasons to believe that more
interactive programs would be better than mainly text-
based programs. One possible reason could be that some of
the more interactive programs have been fairly brief and
may therefore not convey the same amount of treatment as
in text-based iCBT. In the longer text-based treatments the
material has often been of book length, and with the
exception of the lesser input from the therapist, little has
been lost by going from face-to-face session to text (An-
dersson et al. 2009a). In fact, it may even be that the text
versions of the standard CBT treatments include more
information and components than is possible to present
during 1-h face-to-face sessions. The length of iCBT has
often been the same as in face-to-face CBT. For example, a
treatment for panic disorder may last for 10 weeks, which
is a fairly typical length of a face-to-face treatment for that
J Contemp Psychother (2013) 43:223–233 225
123
Author's personal copy
condition. Moreover, it is important to note that iCBT
probably is not easier or less demanding for a client than
when seeing a therapist. The active treatment mechanisms
are most likely not different from traditional CBT. Thus,
for example, when exposure and response prevention is the
central part of CBT for obsessive–compulsive disorder
(OCD), these treatment components are retained in iCBT
(Andersson et al. 2011b), and it is mainly the administra-
tion format that differs (i.e., instructions in a session versus
instructions via text). Guided iCBT can be seen as a form
of distance learning online. The client receives texts to read
(and sometimes videos to view), and tasks to complete in
real life. When the homework assignment is sent in the
client gets feedback from the therapists. In the clinical
application (IPSY), there is also an automatic tracking
system that signals when the client has not been active for a
while. For these cases, the clinician may send a reminder or
even make a phone call.
In guided iCBT the text chapters (called treatment
modules) have associated online features such as quizzes
on the text. Most programs contain between 6 and 15
modules that often follow a determined structure. Treat-
ment always begins with educational elements (psycho-
education), and ends with relapse prevention/termination.
In between are modules that are based on treatment man-
uals for specific disorders like OCD, depression and other
psychiatric conditions. Modules are constantly revised and
new features may be added or removed. For example,
mindfulness exercises can be added, whereas sometimes
modules are either extended or shortened to fit better with
the client population at hand. From having been based on
established CBT protocols for conditions such as panic
disorder, we have also developed more unique treatments
that are not based on earlier manuals. In these cases, an
Internet treatment may be preceded by a clinical face-to-
face study. Research on severe health anxiety (previously
known as hypochondriasis) is an example, when we first
conducted an open pilot study of group treatment (Hedman
et al. 2010a), and later went on with a controlled iCBT
study (Hedman et al. 2011a). Modules used in the treat-
ment may vary in length, from short summaries to longer
texts of more than 20 pages of text. Illustrations are often
included as well as case vignettes. Writing good self-help
texts is a challenge and goes beyond presenting facts and
clear instructions in terms of exercises. In addition, the
texts should convey empathy and understanding for the
reader (Richardson et al. 2010). Self-help texts in iCBT
need to be easy to understand, while still providing clear
behavioral instructions and fit the entire range of problems
that can be experienced within a diagnosis. For example, a
person with social anxiety disorder may receive much
support from close relatives but at the same time such help
can have the function of a safety behavior, which prevents
effective exposure. Both scenarios may need to be inclu-
ded in the text, that is, when a significant other can be
helpful and when the help is rather a maintaining factor of
the anxiety. Text modules also need to fit all types of
clients, from highly educated people who are used to
reading and understanding texts to persons who may have
a harder time reading and understanding instructions. To
handle this and other differences between clients (in par-
ticular in terms of comorbidity between different prob-
lems), we have developed a form of iCBT that tailors the
intervention according to patient preferences and symptom
profile (Carlbring et al. 2010). This has been possible since
we have modules developed for several different problem
areas, including somatic problems. The tailoring means
that the client gets a treatment that is personalized. Some
may be able to handle more modules and others fewer. In a
depression trial, we developed briefer versions of some
modules for the clients with less capacity to read much text
(Johansson et al. 2012b). For a specific client tailoring may
include standard modules on psychoeducation and termi-
nation of treatment. However, in between there is room for
individualization, and if a client has problems with social
anxiety, insomnia and stress it is possible to combined
modules to fit in with that specific symptom profile.
Modules need to be rewritten to fit this approach and some
problem areas include a set of modules that go together.
However, all references to specific disorders are removed,
making tailored iCBT an example of a transdiagnostic
treatment, as comorbidity is allowed and accounted for. In
one study, we found that it also worked when the client
could choose a large part of the treatment content
(Andersson et al. 2011a), making room for client prefer-
ences. This approach, where a client actually could decide
to work with stress problems and not work with what
would have been prescribed if the diagnosis had been the
main indicator of the treatment content, worked well.
Thus, being given the option to choose modules following
a short description did not appear to have a negative effect
on outcome.
The Role of a Deadline
One aspect of iCBT treatment, as we have implemented it,
is that there is a clear deadline for treatment completion
(Andersson et al. 2009a). It may not seem obvious, but
compared to face-to-face treatments it can be less clear for
a client when the treatment ends. We have found that a
distinct deadline and an interview in association at the end
of therapy fosters adherence and also reduces dropout
(Nordin et al. 2010). This is does not mean that all clients
complete the full treatments, but it reduces the risk of
postponing the difficult, perhaps anxiety-provoking parts of
the treatment.
226 J Contemp Psychother (2013) 43:223–233
123
Author's personal copy
In summary, iCBT is similar to bibliotherapy in that
text material is the primary treatment content. However,
the availability of support differs markedly from biblio-
therapy as it can be provided offline asynchronous, but
also rapidly outside of office hours. It is even the case that
iCBT provides greater opportunities for rapid feedback
than usual CBT provides. A client in iCBT can quickly
get feedback on homework and also get answers to
questions (which in face-to-face therapy can occur during
the next session if it is not very urgent). The client can go
back to read and repeat instructions which probably
facilitates learning (Andersson et al. 2012a). Indeed, it is
not clear how much a client remembers from a face-to-
face session, which can be problematic. In iCBT this is
probably less of a problem. In addition, in some cases, as
with social anxiety disorder, an advantage with iCBT is
when the psychologist is a source of anxiety in face-to-
face CBT, which could inhibit learning. Having described
the content and structure of iCBT we now turn to sum-
marizing the research support in the field of mild to
moderate psychiatric conditions.
Efficacy Studies
iCBT has been the subject of much research, and in the last
14 years a significant amount of randomized controlled
studies have been conducted for a range of clinical con-
ditions (Hedman et al. 2012b). Only in the areas of
depression, social anxiety-, and panic disorders, at least 40
randomized controlled trials have been conducted. In this
review, we will cover the support for guided iCBT for a
selection of psychiatric conditions, for which there is
empirical evidence in the form of randomized controlled
trials. In this section, we will cover efficacy studies, that is,
studies with research participants recruited via advertise-
ment from the general public. We focus on major depres-
sion, panic-, social anxiety disorder and GAD, but we also
mention research on clinical applications with somewhat
less evidence, such as the treatment of specific phobia,
OCD, severe health anxiety, and mixed anxiety. For each
condition, we ask three questions: (a) How good is the
treatment compared with untreated controls? (b) Do the
effects last? and (c) Is iCBT equally effective as traditional
face-to-face CBT?
Depression
There have been at least 20 controlled studies on iCBT for
mild to moderate depression (Johansson and Andersson
2012), although many have not been in the form of guided
iCBT. In the first study from Sweden, iCBT was com-
pared with a condition where clients participated in a
moderated online discussion group (Andersson et al.
2005). A total of 117 people participated in the study, and
the treatment lasted for 10 weeks. A between group effect
size of d = 0.88 was found at posttreatment. However,
there was relatively large dropout from the study (27 %),
which was addressed in later studies by being clear about
a deadline for completing the following survey. In a
subsequent study we compared guided self-help with
email-based therapy and a waiting list (Vernmark et al.
2010). In this study a total of 88 participants were
included. There was significant between group effect
between iCBT and control (d = 0.96 for email therapy
and d = 0.56 for guided self-help). Dropout from the
study was low (3 %). There was no significant difference
between the two active treatments, although the email
therapy appeared to be somewhat better. It should be
mentioned that the guidance provided was minimal for the
guided self-help group. Participants in the study were
followed up 3.5 years after treatment and depression
levels remained low for those who responded to the fol-
low-up, which was 58 % (Andersson et al. 2013a). The
third study from Sweden answered the question about the
difference between iCBT and face-to-face group CBT
(Andersson et al. 2013b). The study included 69 depres-
sed subjects who were randomized to either guided iCBT,
with the same program as mentioned above, or to a group
therapy condition. The study also included a 3-year fol-
low-up. The results showed that both treatments resulted
in significant effects with a within-group effect of d = 1.46
for the iCBT condition and d = 0.99 for group treatment
(pre- to posttreatment). The between group effect was in
favor of iCBT at posttreatment d = 0.58, and at 3-year
follow-up d = 0.55. Another trial has been published from
our group using a program that was based on acceptance-
oriented CBT and behavioral activation (Carlbring et al.
2013). This study showed a large between group effect
when the treatment was compared against a waiting list
control group. In a trial aimed at investigating if iCBT can
be effective in preventing relapse in depression, it was
found that persons who had residual symptoms of depres-
sion and had previously been treated for at least one
depression episode, could benefit from guided iCBT as a
form of relapse prevention (Hollandare et al. 2011). Sig-
nificantly fewer in the iCBT group relapsed a 6 months
follow-up (10.5 %), compared with a control group who
did not receive treatment where 37.8 % relapsed into
depression. The promising effects of guided iCBT for
depression has been replicated in other countries. Con-
trolled trials have been conducted in for example Australia
(Perini et al. 2009; Titov et al. 2010), The Netherlands
(Ruwaard et al. 2009), and Switzerland (Berger et al.
2011b). In sum, guided iCBT has been found to work in
controlled trials, a few studies show that effects last over
J Contemp Psychother (2013) 43:223–233 227
123
Author's personal copy
time and there are indications that guided iCBT can be as
effective as group CBT.
Panic Disorder
In the case of panic disorder, there are slightly fewer
studies than on depression. The first controlled trial was
completed and published more than 10 years ago (Carl-
bring et al. 2001). In that study iCBT was compared to a
waiting list condition (Carlbring et al. 2001), with a total of
41 individuals. Between group effects were strong for the
panic-related measures (e.g., d = 1.10). In another study,
the panic program was tested against applied relaxation
delivered via the Internet (Carlbring et al. 2003). This was
a small study (N = 22), and the feedback from the therapist
was minimal and had a rather long delay. Results showed
that both treatments yielded medium to large within-group
effects (Cohen’s d = 0.71 for applied relaxation and
d = 0.42 for iCBT), and that there was no statistically
significant difference between the two treatments. A third
iCBT study on panic disorder was a direct comparison
between guided iCBT and manualized face-to-face CBT
(Carlbring et al. 2005). This study included 49 participants.
Results showed large within-group effects (Cohen’s
d = 0.80 for the iCBT group and d = 0.93 for the face-to-
face treatment group), and there were no significant dif-
ferences between the two treatments. In a subsequent
fourth panic study from Sweden, we wanted to increase
adherence to the treatment protocol and introduced weekly
brief phone calls (Carlbring et al. 2006). A total of 60
participants were randomized to guided iCBT or to a
waiting list control condition. In line with the previous
studies between group effects were large, with an average
between group effect size of d = 1.0 (Carlbring et al.
2006). Other research groups have found very similar
results. Two separate groups in Australia have conducted
controlled trials and have found that guided iCBT leads to
improvements in clients with panic disorder (Klein and
Richards 2001; Klein et al. 2006; Wims et al. 2010). There
is also at least one direct comparative trial suggesting
equivalence between guided iCBT and face-to-face CBT
for panic disorder (Kiropoulos et al. 2008), and one addi-
tional Swedish effectiveness trial showing similar findings
(Bergstrom et al. 2010). In addition, there is a study from
The Netherlands on panic symptoms (Ruwaard et al. 2010).
With the exception of the Dutch study (Ruwaard et al.
2010) which reported 3 year follow-up data, the typical
panic trial has only provided 1-year follow-up data (Carl-
bring et al. 2005). Overall, there is established support in
efficacy studies that guided iCBT works for panic disorder
with or without agoraphobia. Moreover, the results appear
to be similar to face-to-face CBT. As with most studies on
iCBT it has mainly been adults who have been included in
the trials.
Social Anxiety Disorder
Social anxiety disorder (formerly called social phobia) has
been the subject of several studies since the first Swedish
study (Andersson et al. 2006), and also many studies from
other countries. In the first trial, a total of 64 persons with
social anxiety disorder were included out of which 70 %
had generalized social anxiety disorder. Participants were
randomized to guided iCBT or to a waiting list condition.
The treatment lasted for 9 weeks. Between group effects at
posttreatment showed a moderate effect size d = 0.70, and
results were sustained at 1-year follow-up. In should be
mentioned that the study included two face-to-face group
exposure sessions, but in the subsequent study which
included 57 participants there was no face-to-face meet-
ings, but instead brief telephone calls. Comparing against a
waiting list control condition the between group effect was
large, d = 0.95 (Carlbring et al. 2007b). A 1-year follow-
up showed that the results were maintained. Since then,
these findings have been replicated in several studies, some
of which have been large with over 200 participants
(Furmark et al. 2009). The most recent effectiveness study
from our group was a large controlled study (N = 204),
where guided iCBT was compared against participation in
an online discussion group (Andersson et al. 2012a). The
results were in line with previous studies with a large
between group effect (Hedges g = 0.75). A special feature
of the study was that knowledge about social anxiety was
measured before and after treatment. Results showed that
knowledge increased and that participants were more
confident in their knowledge after treatment. Another
aspect of the study was that experienced Internet therapists
were compared with those who had no prior experience of
guiding iCBT. There was no difference in effect between
the two categories of therapists, even if the experienced
therapists spent less time guiding their clients. When it
comes to the question of equivalence between guided iCBT
and face-to-face CBT there are not many studies but one
fairly large study compared guided iCBT against group
CBT (Hedman et al. 2011c). The trial included 126
participants and large significant within-group effects were
found for both treatments (d = 1.42 for iCBT and
d = 0.97 for group CBT). There was even a tendency for
iCBT to be more effective, with a between group effect of
d = 0.41 in favor of the iCBT condition. In addition to
1-year follow-up data, which often are included in the
primary trials, there are two long-term follow-ups. One
collected data 30 months after treatment completion
(Carlbring et al. 2009), and the second 5 years after the end
228 J Contemp Psychother (2013) 43:223–233
123
Author's personal copy
of treatment (Hedman et al. 2011d). Both studies showed
that the treatment effects were sustained. Research on
guided iCBT for social anxiety disorder has been con-
ducted at several places in the world and especially in
Australia, where numerous studies have been conducted
which have shown that iCBT can yield large improvements
(Titov et al. 2008), including showing that iCBT is as
effective as usual CBT (Andrews et al. 2011). Studies from
Switzerland (Berger et al. 2009, 2011a) and Spain (Botella
et al. 2010) support the notion that treatment of social
anxiety disorder via the Internet works. In sum, there is
substantial evidence from independent research groups that
iCBT leads to reduced symptoms of social anxiety disor-
der. Guided iCBT can be at least as good as conventional
CBT and effects appear to be sustained over time.
Generalized Anxiety Disorder
There are only a few studies of guided iCBT for GAD. The
first Swedish controlled study included a 3-year follow-up
when it was published (Paxling et al. 2011). The study
included 89 participants and the results after treatment
showed strong between-group effects (d = 1.11 compared
with a waiting list). The results at follow-up 1- and 3 years
after treatment showed that anxiety levels were further
reduced. The next study we conducted on GAD compared a
psychodynamically oriented guided self-help via the
Internet against iCBT and a waiting list control group (total
N = 81) (Andersson et al. 2012c). While there were sig-
nificant within-group effects (d [ 1.0) for both active
treatments, the waiting list group also improved which
resulted in small between group effects. There was no
difference between the active treatments. An 18-month
follow-up was conducted which showed that results were
sustained. This trial was the first to test psychodynamically
oriented Internet treatment and has been followed by a trial
on psychodynamic Internet treatment for depression
(Johansson et al. 2012a). In addition to these studies there
is just one group that have performed controlled studies on
iCBT for GAD (Robinson et al. 2010; Titov et al. 2009). In
these Australian studies, the effects were similar to those
we found in the Swedish studies. To our knowledge there is
no published comparison of iCBT versus face-to-face CBT
for GAD. In summary, there are as yet few studies on iCBT
for GAD, even if the results are promising in terms of
efficacy and long-term follow-up results.
Other Anxiety Disorders and Mixed Conditions
Guided iCBT has been tested for other anxiety disorders.
For example, there are trials on posttraumatic stress dis-
order and symptoms showing the guided iCBT works
(Lange et al. 2003; Spence et al. 2011b). For severe health
anxiety (previously called hypochondrias) there is one
controlled study (Hedman et al. 2011a). The study included
81 participants and the treatment, which had a strong focus
on exposure and response prevention, was compared with
an attention control condition (web-based discussion for-
ums). The between group effect on the main outcome
measure was d = 1.62, and results were maintained at
follow-up 1 year after the end of treatment (Hedman et al.
2013). OCD is a relatively new field for iCBT, at least if we
look at the number of published articles. There is at least
one controlled study (Andersson et al. 2012b), which
included 101 people with OCD. The between group effect
against waiting list control was d = 1.12. Little has been
done on specific phobia when it comes to guided iCBT,
with only one small study on spider phobia (Andersson
et al. 2009c).
There are also new studies on mixed conditions, moti-
vated by the fact that comorbidity is the rule rather than the
exception in anxiety and mood disorders. As mentioned we
have developed a form of iCBT that tailors the intervention
according to patient preferences and symptom profile. This
has the advantage that the treatment does not have to rely
as much on distinct diagnostic categories. For anxiety
comorbid with other psychiatric problems, there are two
controlled studies (Carlbring et al. 2010; Silfvernagel et al.
2012). The results from the first controlled study (N = 54)
showed that tailored treatment works with a between group
effect at the end of treatment of d = 0.69 when compared
to controls (Carlbring et al. 2010). The effects were sus-
tained at 1- and 2 years after treatment. Tailored guided
iCBT has also been tested for panic symptoms (Silfver-
nagel et al. 2012). In a depression trial tailored treatment
was directly compared against standard iCBT and a control
group (Johansson et al. 2012b). In that study (N = 121)
we found that tailored treatment was significantly better
than the standard treatment for those clients who had more
severe depressive symptoms. In addition to the Swedish
tailored treatment there is another related approach to
iCBT, developed and tested in Australia, where a ‘‘trans-
diagnostic’’ approach (with the option of additional mate-
rial) has been found to be effective (Titov et al. 2011).
In that study, which included 77 participants between-
groups effect sizes were moderate, ranging between 0.52
and 0.58.
In sum there are conditions for which only few con-
trolled trials on guided iCBT exists. Overall, there is to date
little research on severe health anxiety, OCD and specific
phobia. The preliminary results are promising, however,
but independent replications are needed. Two promising
approaches have been developed to handle the problem of
comorbidity and exclusion from trials that focus on specific
conditions. Both tailored guided iCBT and transdiagnostic
iCBT appears to be promising new treatments.
J Contemp Psychother (2013) 43:223–233 229
123
Author's personal copy
Effectiveness Studies
As seen in this review, the literature is dominated by
efficacy studies, but there are published effectiveness
studies showing that guided iCBT appears to work in more
regular clinical settings. It should be noted that the dis-
tinction between efficacy and effectiveness is not obvious
in iCBT studies, where participants are recruited from the
general public (Andersson et al. 2009b). There are however
studies from Sweden which have been conducted in a
regular clinical setting (Bergstrom et al. 2009, 2010;
Hedman et al. 2011c), and there are also effectiveness data
from clinics in Australia (Aydos et al. 2009), and The
Netherlands (Ruwaard et al. 2012). There are also studies
examining guided iCBT in primary care (Shandley et al.
2008). All of these studies support the notion that iCBT
works in more regular clinical settings. At the IPSY in
Stockholm guided iCBT has been provided as a standard
treatment since 2007. As the treatment includes outcome
monitoring there are now data from many clients with
specific conditions. In a recent report of this database, all
562 patients who had received treatment for their panic
disorders were included (Hedman et al. 2013). The results
showed within-group effects of d = 1.07–1.55. In a study
from Australia, effectiveness data were reported from 359
patients who had been prescribed the Sadness program for
depression (Williams and Andrews 2013). Results showed
medium to large within-group effect sizes d = 0.51–1.13.
In another report from the same research group similar
effects were found for the treatment of GAD (Mewton et al.
2012) in a clinical sample of 588 patients, with a within-
group effect size of d = 0.91 (based on data from 324
patients). A preliminary conclusion is that guided iCBT
works in everyday clinical settings for major depression,
social anxiety disorder, GAD, and panic disorder, but more
reports are needed and it needs to be said that it has mainly
been in specialist units and not in general practices or
clinics without previous experience of iCBT.
Discussion
Guided iCBT has quickly been established in research and
is gradually but slowly implemented in some countries,
mainly Sweden and Australia. Several challenges exist for
the future. First, it is clear that iCBT primarily has been
developed and tested for mild to moderate mental health
problems. For more severe problems, like bipolar disorder
and schizophrenia, very little has been done. For these
conditions, iCBT is more likely to be into form of a
complement. Another second aspect that has been tested in
Germany is to use the Internet for aftercare (Golkaramnay
et al. 2007), which could be useful as a booster treatment
after conventional CBT for conditions like OCD. Thirdly,
technology is developing rapidly, and today the Internet is
accessed not only via computers, but increasingly through
modern mobile phones. A challenge for the future is thus
the new technology with smartphones. New technologies
may open up new possibilities for the delivery of CBT and
research has begun in this field (Watts et al. 2013). A fourth
challenge for the future purpose is to transfer iCBT pro-
tocols into different languages. For example, since the
treatments often are text based it is fairly easy to translate
and adapt a treatment to another culture (Choi et al. 2012).
This could be a way to disseminate CBT to countries where
there are few trained CBT therapists or limited resources.
In addition to these challenges, there are yet few treatments
that are designed for children, adolescents and the elderly,
although studies are beginning to emerge (Spence et al.
2011a). In the present paper we did not review the cost-
effectiveness studies on iCBT. There is however an
increasing body of knowledge indicating that iCBT could
be a highly cost-effective treatment (Hedman et al. 2011b).
Finally, in this paper we did not focus on moderators and
mediators of treatment outcomes in relation to iCBT. There
is a growing literature on the role of the therapeutic alli-
ance in iCBT (Andersson et al. 2012d), patient predictors
(Andersson et al. 2008), the role of genetics (Hedman et al.
2012a), the need for a trained therapist versus a lay person
providing the guidance (Titov et al. 2010), and therapist
factors in general (Almlov et al. 2011). Studies on treat-
ment mechanisms will appear as iCBT may facilitate out-
come monitoring and mediator assessment on a weekly
basis, which is needed for robust mediator studies.
Conclusions
Based on the available evidence, partly reviewed in this
paper, the following conclusions can be drawn. Guided
iCBT has good research support for the treatment of
depression, social anxiety-, and panic disorders. For those
conditions guided iCBT could be an alternative to tradi-
tional CBT. There are also studies on GAD, severe health
anxiety, mixed anxiety, OCD and other anxiety disorders
which all point in the same direction. In the few studies that
directly have compared guided iCBT against conventional
face-to-face CBT there has usually been no differences in
effect. Studies conducted in more representative clinical
settings are few but indicate that guided iCBT works when
delivered as a regular treatment for typical psychiatric
patients. Given the potential benefits of increasing access to
evidence-based psychological treatment and the health
economic benefits of iCBT, this new treatment format
should be considered as a complement to conventional
CBT for mild to moderate mental health problems.
230 J Contemp Psychother (2013) 43:223–233
123
Author's personal copy
References
Almlov, J., Carlbring, P., Kallqvist, K., Paxling, B., Cuijpers, P., &
Andersson, G. (2011). Therapist effects in guided Internet-
delivered CBT for anxiety disorders. Behavioural and Cognitive
Psychotherapy, 39, 311–322.
Andersson, G. (2009). Using the Internet to provide cognitive
behaviour therapy. Behaviour Research and Therapy, 47,
175–180.
Andersson, G., Bergstrom, J., Hollandare, F., Carlbring, P., Kaldo, V.,
& Ekselius, L. (2005). Internet-based self-help for depression: A
randomised controlled trial. British Journal of Psychiatry, 187,
456–461.
Andersson, G., Carlbring, P., Berger, T., Almlov, J., & Cuijpers, P.
(2009a). What makes Internet therapy work? Cognitive Behav-
iour Therapy, 38(S1), 55–60.
Andersson, G., Carlbring, P., & Cuijpers, P. (2009b). Internet
interventions: Moving from efficacy to effectiveness. E-Journal
of Applied Psychology, 5, 18–24.
Andersson, G., Carlbring, P., Furmark, T., & On behalf of the SOFIE
Research Group. (2012a). Therapist experience and knowledge
acquisition in Internet-delivered CBT for social anxiety disorder:
A randomized controlled trial. PLoS ONE, 7(5), e37411.
Andersson, G., Carlbring, P., & Grimlund, A. (2008). Predicting
treatment outcome in Internet versus face to face treatment of
panic disorder. Computers in Human Behavior, 24, 1790–1801.
Andersson, G., Carlbring, P., Holmstrom, A., Sparthan, E., Furmark,
T., Nilsson-Ihrfelt, E., et al. (2006). Internet-based self-help with
therapist feedback and in vivo group exposure for social phobia:
A randomized controlled trial. Journal of Consulting and
Clinical Psychology, 74, 677–686.
Andersson, E., Enander, J., Andren, P., Hedman, E., Ljotsson, B.,
Hursti, T., et al. (2012b). Internet-based cognitive behaviour
therapy for obsessive–compulsive disorder: A randomised con-
trolled trial. Psychological Medicine, 42, 2193–2203.
Andersson, G., Estling, F., Jakobsson, E., Cuijpers, P., & Carlbring, P.
(2011a). Can the patient decide which modules to endorse? An
open trial of tailored Internet treatment of anxiety disorders.
Cognitive Behaviour Therapy, 40, 57–64.
Andersson, G., Hesser, H., Hummerdal, D., Bergman-Nordgren, L., &
Carlbring, P. (2013a). A 3.5-year follow-up of Internet-delivered
cognitive behaviour therapy for major depression. Journal of
Mental Health, 22, 155–164.
Andersson, G., Hesser, H., Veilord, A., Svedling, L., Andersson, F.,
Sleman, O., Mauritzson, L., Sarkohi, A., Claesson, E., Zetterq-
vist, V., Lamminen, M., Eriksson, T., & Carlbring, P. (2013b).
Randomized controlled non-inferiority trial with 3-year follow-
up of Internet-delivered versus face-to-face group cognitive
behavioural therapy for depression (submitted manuscript).
Andersson, E., Ljotsson, B., Hedman, E., Kaldo, V., Paxling, B.,
Lindefors, N., et al. (2011b). Internet-based cognitive behavior
therapy for obsessive compulsive disorder: A pilot study. BMC
Psychiatry, 11, 125.
Andersson, G., Paxling, B., Roch-Norlund, P., Ostman, G., Norgren,
A., Almlov, J., et al. (2012c). Internet-based psychodynamic vs.
cognitive behavioural guided self-help for generalized anxiety
disorder: A randomised controlled trial. Psychotherapy and
Psychosomatics, 81, 344–355.
Andersson, G., Paxling, B., Wiwe, M., Vernmark, K., Bertholds Felix,
C., Lundborg, L., et al. (2012d). Therapeutic alliance in guided
Internet-delivered cognitive behavioral treatment of depression,
generalized anxiety disorder and social anxiety disorder. Behav-
iour Research and Therapy, 50, 544–550.
Andersson, G., Waara, J., Jonsson, U., Malmaeus, F., Carlbring, P., &
Ost, L.-G. (2009c). Internet-based self-help vs. one-session
exposure in the treatment of spider phobia: A randomized
controlled trial. Cognitive Behaviour Therapy, 38, 114–120.
Andrews, G., Davies, M., & Titov, N. (2011). Effectiveness
randomized controlled trial of face to face versus Internet
cognitive behaviour therapy for social phobia. The Australian
and New Zealand Journal of Psychiatry, 45, 337–340.
Aydos, L., Titov, N., & Andrews, G. (2009). Shyness 5: The clinical
effectiveness of Internet-based clinician-assisted treatment of
social phobia. Australasian Psychiatry, 17, 488–492.
Barak, A. (1999). Psychological applications on the Internet: A
discipline on the threshold of a new millennium. Applied and
Preventive Psychology, 8, 231–245.
Bennett, K., Bennett, A. J., & Griffiths, K. M. (2010). Security
considerations for e-mental health interventions. Journal of
Medical Internet Research, 12(5), e61.
Berger, T., Caspar, F., Richardson, R., Kneubuhler, B., Sutter, D., &
Andersson, G. (2011a). Internet-based treatment of social
phobia: A randomized controlled trial comparing unguided with
two types of guided self-help. Behaviour Research and Therapy,
48, 158–169.
Berger, T., Hammerli, K., Gubser, N., Andersson, G., & Caspar, F.
(2011b). Internet-based treatment of depression: A randomized
controlled trial comparing guided with unguided self-help.
Cognitive Behaviour Therapy, 40, 251–266.
Berger, T., Hohl, E., & Caspar, F. (2009). Internet-based treatment for
social phobia: A randomized controlled trial. Journal of Clinical
Psychology, 65, 1021–1035.
Bergstrom, J., Andersson, G., Karlsson, A., Andreewitch, S., Ruck,
C., Carlbring, P., et al. (2009). An open study of the effective-
ness of Internet treatment for panic disorder delivered in a
psychiatric setting. Nordic Journal of Psychiatry, 63, 44–50.
Bergstrom, J., Andersson, G., Ljotsson, B., Ruck, C., Andreewitch, S.,
Karlsson, A., et al. (2010). Internet- versus group-administered
cognitive behaviour therapy for panic disorder in a psychiatric
setting: A randomised trial. BMC Psychiatry, 10, 54.
Botella, C., Gallego, M. J., Garcia-Palacios, A., Guillen, V., Banos, R.
M., Quero, S., et al. (2010). An Internet-based self-help treatment
for fear of public speaking: A controlled trial. Cyberpsychology,
Behavior and Social Networking, 13, 407–421.
Carlbring, P., Bergman Nordgren, L., Furmark, T., & Andersson, G.
(2009). Long term outcome of Internet delivered cognitive-
behavioural therapy for social anxiety disorder: A 30-month
follow-up. Behaviour Research and Therapy, 47, 848–850.
Carlbring, P., Bohman, S., Brunt, S., Buhrman, M., Westling, B. E.,
Ekselius, L., et al. (2006). Remote treatment of panic disorder: A
randomized trial of Internet-based cognitive behavioral therapy
supplemented with telephone calls. American Journal of Psy-
chiatry, 163, 2119–2125.
Carlbring, P., Brunt, S., Bohman, S., Austin, D., Richards, J. C., Ost,
L.-G., et al. (2007a). Internet vs. paper and pencil administration
of questionnaires commonly used in panic/agoraphobia research.
Computers in Human Behavior, 23, 1421–1434.
Carlbring, P., Ekselius, L., & Andersson, G. (2003). Treatment of
panic disorder via the Internet: A randomized trial of CBT vs.
applied relaxation. Journal of Behavior Therapy and Experi-
mental Psychiatry, 34, 129–140.Carlbring, P., Gunnarsdottir, M., Hedensjo, L., Andersson, G.,
Ekselius, L., & Furmark, T. (2007b). Treatment of social
phobia: Randomized trial of Internet delivered cognitive behav-
iour therapy and telephone support. British Journal of Psychi-
atry, 190, 123–128.
Carlbring, P., Hagglund, M., Luthstrom, A., Dahlin, M., Kadowaki, A.,
Vernmark, K., et al. (2013). Internet-based behavioral activation
and acceptance-based treatment for depression: A randomized
controlled trial. Journal of Affective Disorders, 148, 331–337.
J Contemp Psychother (2013) 43:223–233 231
123
Author's personal copy
Carlbring, P., Maurin, L., Torngren, C., Linna, E., Eriksson, T.,
Sparthan, E., et al. (2010). Individually tailored Internet-based
treatment for anxiety disorders: A randomized controlled trial.
Behaviour Research and Therapy, 49, 18–24.
Carlbring, P., Nilsson-Ihrfelt, E., Waara, J., Kollenstam, C., Buhrman,
M., Kaldo, V., et al. (2005). Treatment of panic disorder: Live
therapy vs. self-help via Internet. Behaviour Research and
Therapy, 43, 1321–1333.
Carlbring, P., Westling, B. E., Ljungstrand, P., Ekselius, L., &
Andersson, G. (2001). Treatment of panic disorder via the
Internet—a randomized trial of a self-help program. Behavior
Therapy, 32, 751–764.
Choi, I., Zou, J., Titov, N., Dear, B. F., Li, S., Johnston, L., et al.
(2012). Culturally attuned Internet treatment for depression
amongst Chinese Australians: A randomised controlled trial.
Journal of Affective Disorders, 136, 459–468.
Christensen, H., Griffiths, K., Groves, C., & Korten, A. (2006a). Free
range users and one hit wonders: Community users of an
Internet-based cognitive behaviour therapy program. The Aus-
tralian and New Zealand Journal of Psychiatry, 40, 59–62.
Christensen, H., Griffiths, K. M., Mackinnon, A. J., & Brittliffe, K.
(2006b). Online randomized trial of brief and full cognitive
behaviour therapy for depression. Psychological Medicine, 36,
1737–1746.
Cuijpers, P., van Straten, A.-M., & Andersson, G. (2008). Internet-
administered cognitive behavior therapy for health problems: A
systematic review. Journal of Behavioral Medicine, 31,
169–177.
Furmark, T., Carlbring, P., Hedman, E., Sonnenstein, A., Clevberger,
P., Bohman, B., et al. (2009). Guided and unguided self-help for
social anxiety disorder: Randomised controlled trial. British
Journal of Psychiatry, 195, 440–447.
Golkaramnay, V., Bauer, S., Haug, S., Wolf, M., & Kordy, H. (2007).
The exploration of the effectiveness of group therapy through an
Internet chat as aftercare: A controlled naturalistic study.
Psychotherapy and Psychosomatics, 76, 219–225.
Hedman, E., Andersson, E., Lindefors, N., Andersson, G., Ruck, C.,
& Ljotsson, B. (2013). Cost-effectiveness and long-term effec-
tiveness of Internet-based cognitive behaviour therapy for severe
health anxiety. Psychological Medicine, 43, 363–374.
Hedman, E., Andersson, E., Ljotsson, B., Andersson, G., Andersson,
E. M., Schalling, M., et al. (2012a). Clinical and genetic outcome
determinants of Internet- and group-based cognitive behavior
therapy for social anxiety disorder. Acta Psychiatrica Scandi-
navica, 126, 126–136.
Hedman, E., Andersson, G., Ljotsson, B., Andersson, E., Ruck, C.,
Asmundson, G. J. G., et al. (2011a). Internet-based cognitive-
behavioural therapy for severe health anxiety: Randomised
controlled trial. British Journal of Psychiatry, 198, 230–236.
Hedman, E., Andersson, E., Ljotsson, B., Andersson, G., Ruck, C., &
Lindefors, N. (2011b). Cost-effectiveness of Internet-based
cognitive behavior therapy vs. cognitive behavioral group
therapy for social anxiety disorder: Results from a randomized
controlled trial. Behaviour Research and Therapy, 49, 729–736.
Hedman, E., Andersson, G., Ljotsson, B., Andersson, E., Ruck, C.,
Mortberg, E., et al. (2011c). Internet-based cognitive behavior
therapy vs. cognitive behavioral group therapy for social anxiety
disorder: A randomized controlled non-inferiority trial. PLoS
ONE, 6(3), e18001.
Hedman, E., Furmark, T., Carlbring, P., Ljotsson, B., Ruck, C.,
Lindefors, N., et al. (2011d). Five-year follow-up of Internet-
based cognitive behaviour therapy for social anxiety disorder.
Journal of Medical Internet Research, 13(2), e39.
Hedman, E., Ljotsson, B., Andersson, E., Ruck, C., Andersson, G., &
Lindefors, N. (2010a). Effectiveness and cost offset analysis of
group CBT for hypochondriasis delivered in a psychiatric
setting—an open trial. Cognitive Behaviour Therapy, 39,
239–250.
Hedman, E., Ljotsson, B., & Lindefors, N. (2012b). Cognitive
behavior therapy via the Internet: A systematic review of
applications, clinical efficacy and cost-effectiveness. Expert
Review of Pharmacoeconomics and Outcomes Research, 12,
745–764.
Hedman, E., Ljotsson, B., Ruck, C., Bergstrom, J., Andersson, G.,
Kaldo, V., et al. (2013). Effectiveness of Internet-based cogni-
tive behaviour therapy for panic disorder in routine psychiatric
care. Acta Psychiatrica Scandinavica. doi:10.1111/acps.12079.
Hedman, E., Ljotsson, B., Ruck, C., Furmark, T., Carlbring, P.,
Lindefors, N., et al. (2010b). Internet administration of self-
report measures commonly used in research on social anxiety
disorder: A psychometric evaluation. Computers in Human
Behavior, 26, 736–740.
Hollandare, F., Andersson, G., & Engstrom, I. (2010). A comparison
of psychometric properties between Internet and paper versions
of two depression instruments (BDI-II and MADRS-S) admin-
istered to clinic patients. Journal of Medical Internet Research,
12(5), e49.
Hollandare, F., Johnsson, S., Randestad, M., Tillfors, M., Carlbring,
P., Andersson, G., et al. (2011). Randomized trial of Internet-
based relapse prevention for partially remitted depression. Acta
Psychiatrica Scandinavica, 124, 285–294.
Johansson, R., & Andersson, G. (2012). Internet-based psychological
treatments for depression. Expert Review of Neurotherapeutics,
12, 861–870.
Johansson, R., Ekbladh, S., Hebert, A., Lindstrom, M., Moller, S.,
Petitt, E., et al. (2012a). Psychodynamic guided self-help for
adult depression through the Internet: A randomised controlled
trial. PLoS ONE, 7(5), e38021.
Johansson, R., Sjoberg, E., Sjogren, M., Johnsson, E., Carlbring, P.,
Andersson, T., et al. (2012b). Tailored vs. standardized Internet-
based cognitive behavior therapy for depression and comorbid
symptoms: A randomized controlled trial. PLoS ONE, 7(5),
e36905.
Kessler, D., Lewis, G., Kaur, S., Wiles, N., King, M., Weich, S., et al.
(2009). Therapist-delivered Internet psychotherapy for depres-
sion in primary care: A randomised controlled trial. Lancet, 374,
628–634.
Kiropoulos, L. A., Klein, B., Austin, D. W., Gilson, K., Pier, C.,
Mitchell, J., et al. (2008). Is Internet-based CBT for panic
disorder and agoraphobia as effective as face-to-face CBT?
Journal of Anxiety Disorders, 22, 1273–1284.
Klein, B., & Richards, J. C. (2001). A brief Internet-based treatment
for panic disorder. Behavioural and Cognitive Psychotherapy,
29, 113–117.
Klein, B., Richards, J. C., & Austin, D. W. (2006). Efficacy of
Internet therapy for panic disorder. Journal of Behavior Therapy
and Experimental Psychiatry, 37, 213–238.
Lange, A., Rietdijk, D., Hudcovicova, M., van den Ven, J.-P.,
Schrieken, B., & Emmelkamp, P. M. G. (2003). Interapy: A
controlled randomized trial of the standardized treatment of
posttraumatic stress through the Internet. Journal of Consulting
and Clinical Psychology, 71, 901–909.
Marks, I. M., Shaw, S., & Parkin, R. (1998). Computer-assisted
treatments of mental health problems. Clinical Psychology:
Science and Practice, 5, 51–170.
Mewton, L., Wong, N., & Andrews, G. (2012). The effectiveness of
Internet cognitive behavioural therapy for generalized anxiety
disorder in clinical practice. Depression and Anxiety, 29(10),
843–849.
Munoz, R. F., Aguilera, A., Schueller, S. M., Leykin, Y., & Perez-
Stable, E. J. (2012). From online randomized controlled trials to
participant preference studies: Morphing the San Francisco stop
232 J Contemp Psychother (2013) 43:223–233
123
Author's personal copy
smoking site into a worldwide smoking cessation resource.
Journal of Medical Internet Research, 14, e64.
Nordin, S., Carlbring, P., Cuijpers, P., & Andersson, G. (2010).
Expanding the limits of bibliotherapy for panic disorder.
Randomized trial of self-help without support but with a clear
deadline. Behavior Therapy, 41, 267–276.
Palmqvist, B., Carlbring, P., & Andersson, G. (2007). Internet-
delivered treatments with or without therapist input: Does the
therapist factor have implications for efficacy and cost? Expert
Review of Pharmacoeconomics and Outcomes Research, 7,
291–297.
Paxling, B., Almlov, J., Dahlin, M., Carlbring, P., Breitholtz, E.,
Eriksson, T., et al. (2011). Guided Internet-delivered cognitive
behavior therapy for generalized anxiety disorder: A randomized
controlled trial. Cognitive Behaviour Therapy, 40, 159–173.
Paxling, B., Lundgren, S., Norman, A., Almlov, J., Carlbring, P.,
Cuijpers, P., et al. (2013). Therapist behaviours in Internet-
delivered cognitive behaviour therapy: Analyses of e-mail
correspondence in the treatment of generalized anxiety disorder.
Behavioural and Cognitive Psychotherapy, 41, 280–289.
Perini, S., Titov, N., & Andrews, G. (2009). Clinician-assisted
Internet-based treatment is effective for depression: Randomized
controlled trial. The Australian and New Zealand Journal of
Psychiatry, 43, 571–578.
Richardson, R., Richards, D. A., & Barkham, M. (2010). Self-help
books for people with depression: The role of the therapeutic
relationship. Behavioural and Cognitive Psychotherapy, 38,
67–81.
Riley, S., & Veale, D. (1999). The Internet and its relevance to
cognitive behavioural psychotherapists. Behavioural and Cog-
nitive Psychotherapy, 27, 37–46.
Robinson, E., Titov, N., Andrews, G., McIntyre, K., Schwencke, G.,
& Solley, K. (2010). Internet treatment for generalized anxiety
disorder: A randomized controlled trial comparing clinician vs.
technician assistance. PloS One, 5, e10942.
Ruwaard, J., Broeksteeg, J., Schrieken, B., Emmelkamp, P., & Lange,
A. (2010). Web-based therapist-assisted cognitive behavioral
treatment of panic symptoms: A randomized controlled trial with
a three-year follow-up. Journal of Anxiety Disorders, 24,
387–396.
Ruwaard, J., Lange, A., Schrieken, B., Dolan, C. V., & Emmelkamp,
P. (2012). The effectiveness of online cognitive behavioral
treatment in routine clinical practice. PLoS ONE, 7(7), e40089.
Ruwaard, J., Lange, A., Schrieken, B., & Emmelkamp, P. (2011).
Efficacy and effectiveness of online cognitive behavioral treat-
ment: A decade of Interapy research. Studies in Health
Technology and Informatics, 167, 9–14.
Ruwaard, J., Schrieken, B., Schrijver, M., Broeksteeg, J., Dekker, J.,
Vermeulen, H., et al. (2009). Standardized web-based CBT of
mild to moderate depression: A randomized controlled trial with
a long-term follow-up. Cognitive Behaviour Therapy, 38,
206–221.
Sanchez-Ortiz, V. C., Munro, C., Startup, H., Treasure, J., & Schmidt,
U. (2011). The role of email guidance in Internet-based
cognitive-behavioural self-care treatment for bulimia nervosa.
European Eating Disorders Review, 19, 342–348.
Shandley, K., Austin, D. W., Klein, B., Pier, C., Schattner, P., Pierce,
D., et al. (2008). Therapist-assisted, Internet-based treatment for
panic disorder: Can general practitioners achieve comparable
patient outcomes to psychologists? Journal of Medical Internet
Research, 10(2), e14.
Silfvernagel, K., Carlbring, P., Kabo, J., Edstrom, S., Eriksson, J.,
Manson, L., et al. (2012). Individually tailored Internet-based
treatment of young adults and adults with panic symptoms: A
randomized controlled trial. Journal of Medical Internet
Research, 14(3), e65.
Spek, V., Cuijpers, P., Nyklicek, I., Riper, H., Keyzer, J., & Pop, V.
(2007). Internet-based cognitive behaviour therapy for symptoms
of depression and anxiety: A meta-analysis. Psychological
Medicine, 37, 319–328.
Spence, S. H., Donovan, C. L., March, S., Gamble, A., Anderson, R.
E., Prosser, S., et al. (2011a). A randomized controlled trial of
online versus clinic-based CBT for adolescent anxiety. Journal
of Consulting and Clinical Psychology, 79(5), 629–642.
Spence, J., Titov, N., Dear, B. F., Johnston, L., Solley, K., Lorian, C.,
et al. (2011b). Randomized controlled trial of Internet-delivered
cognitive behavioral therapy for posttraumatic stress disorder.
Depression and Anxiety, 28(7), 541–550.
Titov, N. (2010). Email in low intensity CBT interventions. In J.
Bennett-Levy, H. Christensen, P. Farrand, K. Griffiths, D.
Kavanagh, B. Klein, M. Lau, J. Proudfoot, D. Richards, J. White,
& C. Williams (Eds.), Oxford guide to low intensity CBT
interventions (pp. 287–293). Oxford: Oxford University Press.
Titov, N., Andrews, G., Davies, M., McIntyre, K., Robinson, E., &
Solley, K. (2010). Internet treatment for depression: A random-
ized controlled trial comparing clinician vs. technician assis-
tance. PLoS ONE, 5, e10939.
Titov, N., Andrews, G., Robinson, E., Schwencke, G., Johnston, L.,
Solley, K., et al. (2009). Clinician-assisted internet-based
treatment is effective for generalized anxiety disorder: Random-
ized controlled trial. Australian and New Zealand Journal of
Psychiatry, 43, 905–912.
Titov, N., Andrews, G., Schwencke, G., Drobny, J., & Einstein, D.
(2008). Shyness 1: Distance treatment of social phobia over the
Internet. The Australian and New Zealand Journal of Psychiatry,
42, 585–594.
Titov, N., Dear, B. F., Schwencke, G., Andrews, G., Johnston, L.,
Craske, M. G., et al. (2011). Transdiagnostic Internet treatment
for anxiety and depression: A randomised controlled trial.
Behaviour Research and Therapy, 49, 441–452.
Vernmark, K., Lenndin, J., Bjarehed, J., Carlsson, M., Karlsson, J.,
Oberg, J., et al. (2010). Internet administered guided self-help
versus individualized e-mail therapy: A randomized trial of two
versions of CBT for major depression. Behaviour Research and
Therapy, 48, 368–376.
Watkins, P. L. (2008). Self-help therapies: Past and present. In P.
L. Watkins & G. A. Clum (Eds.), Handbook of self-help
therapies (pp. 1–24). New York: Routledge.
Watts, S., Mackenzie, A., Thomas, C., Griskaitis, A., Mewton, L.,
Williams, A., et al. (2013). CBT for depression: A pilot RCT
comparing mobile phone vs. computer. BMC Psychiatry, 13, 49.
Williams, A. D., & Andrews, G. (2013). The effectiveness of Internet
cognitive behavioural therapy (iCBT) for depression in primary
care: A quality assurance study. PLoS ONE, 8, e57447.
Wims, E., Titov, N., Andrews, G., & Choi, I. (2010). Clinician-
assisted Internet-based treatment is effective for panic: A
randomized controlled trial. The Australian and New Zealand
Journal of Psychiatry, 44(7), 599–607.
J Contemp Psychother (2013) 43:223–233 233
123
Author's personal copy