FACULTY EXPERIENCES IN MASSIVE OPEN ONLINE ...
-
Upload
khangminh22 -
Category
Documents
-
view
0 -
download
0
Transcript of FACULTY EXPERIENCES IN MASSIVE OPEN ONLINE ...
FACULTY EXPERIENCES IN MASSIVE OPEN ONLINE COURSES (MOOCS)
A DISSERTATION SUBMITTED TO THE GRADUATE DIVISION OF THE UNIVERSITY OF HAWAI‘I AT MĀNOA IN PARTIAL FULFILLMENT OF THE
REQUIREMENTS FOR THE DEGREE OF
DOCTOR OF PHILOSOPHY
IN
LEARNING DESIGN AND TECHNOLOGY
MARCH 2021
By
Youxin Zhang
Dissertation Committee:
Christine Sorensen Irvine, Chairperson Michael Menchaca
Seungoh Paek John Casken
Ashley Maynard
ii
DEDICATION
I would like to dedicate this work to my mom…this is my marathon. I made it! Now it’s your turn…Never give up!
iii
ACKNOWLEDGEMENTS
This dissertation is completed with the assistance of many individuals. Without their
insightful comments, generous help, and continuous encouragement, I would not have been able
to complete my research.
I would like to express my sincere gratitude to Dr. Christine Sorensen Irvine, my life-long
mentor in this rewarding and amazing doctoral journey. I have benefited immeasurably from
your wisdom, abundance of knowledge, vast experience, thoughtful insights, patient guidance,
encouragement, and advice. I am profoundly fortunate to have had an advisor who was
immensely supportive as always whenever I needed you and who cared so much about my work.
I cannot be grateful and thank you enough for your unconditional trust and confidence in me.
I am truly thankful to other committee members, Dr. Michael Menchaca, Dr. Seungoh
Paek, Dr. John Casken, and Dr. Ashley Maynard for their exceptional dedication, guidance, and
encouragement throughout my dissertation. Their professionalism and visions have inspired me
to keep the fire going within me.
I must also thank Dr. Kristin Betts, Dr. Suzannah Evans Comfort, and Dr. Jessica Gall
Myrick, upon whose work this study is based. In particular, I thank them for their permissions to
allow me to use the surveys they developed, which were adapted for this study.
My warmest and heartfelt thanks go to my parents for giving me life and unconditional
love throughout my whole life. Their support, strength, insights, encouragement, solace, and
company have carried me through many difficult times. To them, I owe more than words could
express.
Last, I want to thank myself for years of persistence, hard work, great courage and
determination in the face of various challenges throughout these years when I study abroad
iv
without my family present in Hawaii. I am proud of being who I am today and so grateful for all
the blessings I received!
v
ABSTRACT
Massive Open Online Courses (MOOCs), as an emerging educational innovation in the
field of online education, successfully garnered attention from the academic community since
2012. Studies in MOOCs primarily focused on learner experiences and insights, context and
impact as well as design. Little attention was placed on MOOC instructors.
This convergent parallel mixed methods study employed a web-based survey and semi-
structured interviews to explore the experience of higher education faculty members who had
taught a MOOC or were currently teaching a MOOC from 2013 to 2017 through edX and
Coursera (two primary MOOC platforms in the United States providing thousands of online
courses in a wide range of subjects). The samples (i.e., eighty-nine survey respondents and
twelve interviewees) were drawn from the target population with a criterion sampling strategy.
Findings included: 1) The majority of MOOC instructors were white males with an
average age of 54 years old. Over 75% held a doctorate degree in a given field. More than half
ranked at least assistant professor. Teaching an online or hybrid course was new to about half of
them before teaching a MOOC; 2) MOOC instructors were motivated by both intrinsic and
extrinsic factors to teach a MOOC, but mostly driven by intrinsic motivators; 3) MOOC
instructors perceived their MOOC teaching experience personally rewarding and professionally
beneficial; 4) The intention of teaching a MOOC included but not limited to reaching out to a
wide range of global learners, sharpening skills & expanding knowledge, and increasing personal
and institutional visibility nationally and globally; 5) Based on the four roles identified in
Berge’s Instructor’s Roles Model for online education, the role of a MOOC instructor was
largely pedagogical-oriented, especially at the planning, designing, and delivering stages through
multiple activities. The social role was identified only within a small number of MOOCs. The
vi
managerial and technical roles were taken over by specialists or assistants; 6) Benefits and
challenges of teaching a MOOC were identified and addressed. Implications for practice,
recommendations, and limitations were discussed to identify and prioritize future research.
vii
TABLE OF CONTENTS
DEDICATION ................................................................................................................................ ii
ACKNOWLEDGEMENTS ........................................................................................................... iii
ABSTRACT .................................................................................................................................... v
LIST OF TABLES ........................................................................................................................ xii
LIST OF FIGURES ..................................................................................................................... xiii
CHAPTER 1. INTRODUCTION ................................................................................................. 14
Statement of the Problem .......................................................................................................... 15
Purpose ...................................................................................................................................... 16
Research Questions ................................................................................................................... 16
Significance of the Study .......................................................................................................... 17
Conceptual Framework ............................................................................................................. 17
Summary of Methodology ........................................................................................................ 19
Role of the Researcher .............................................................................................................. 19
Limitations ................................................................................................................................ 20
Definition of Key Terms ........................................................................................................... 20
Summary ................................................................................................................................... 21
CHAPTER 2. REVIEW OF LITERATURE ................................................................................ 23
MOOC Overview ...................................................................................................................... 23
viii
Defining MOOCs .................................................................................................................. 23
Development of MOOCs and MOOC Providers .................................................................. 24
Types of MOOCs .................................................................................................................. 26
MOOC Learners .................................................................................................................... 31
Intentions for Participating in MOOCs ................................................................................. 33
MOOC Experiences .................................................................................................................. 36
Student Learning Experiences in MOOCs ............................................................................ 36
Teaching Experiences in MOOCs ........................................................................................ 38
MOOC Issues ............................................................................................................................ 40
High Dropout Rates .............................................................................................................. 40
Plagiarism ............................................................................................................................. 41
Assessment of Student Work ................................................................................................ 42
Sustainability......................................................................................................................... 44
Quality of MOOCs ................................................................................................................ 44
Motivating Factors for Participation in Online Education and MOOCs .................................. 45
Motivating Factors of Faculty Participation in Online Education ........................................ 45
Instructor’s Roles in Online Education and MOOCs ............................................................... 60
Instructor’s Roles in Online Education ................................................................................. 60
Roles of MOOC Instructors .................................................................................................. 68
Conceptual Framework ............................................................................................................. 70
Self-Determination Theory ................................................................................................... 70
Instructor’s Roles Model ....................................................................................................... 75
ix
Summary ................................................................................................................................... 78
CHAPTER 3. METHODOLOGY ................................................................................................ 79
Research Questions ................................................................................................................... 79
Research Design ........................................................................................................................ 80
Participants and Context ........................................................................................................... 84
Instrumentation and Procedures ................................................................................................ 86
Data Collection ......................................................................................................................... 90
Data Analysis ............................................................................................................................ 91
Rigor ......................................................................................................................................... 93
Summary ................................................................................................................................... 96
CHAPTER 4. QUANTITATIVE FINDINGS .............................................................................. 97
Demographics ........................................................................................................................... 97
Teaching Background ............................................................................................................... 99
Research Questions ................................................................................................................. 101
Research Question 1 ........................................................................................................... 101
Research Question 2 ........................................................................................................... 103
Research Question 3 ........................................................................................................... 106
Summary ................................................................................................................................. 112
CHAPTER 5. QUALITATIVE FINDINGS ............................................................................... 114
Demographics ......................................................................................................................... 114
x
Qualitative Results .................................................................................................................. 115
Research Question 1 ........................................................................................................... 115
Research Question 2 ........................................................................................................... 125
Research Question 3 ........................................................................................................... 157
Summary ................................................................................................................................. 174
CHAPTER 6. DISCUSSION AND CONCLUSIONS ............................................................... 175
Discussion of Findings ............................................................................................................ 175
Finding 1: MOOC Instructors, Who Are They? ................................................................. 176
Finding 2: Intrinsic Motivators and Extrinsic Motivators .................................................. 177
Finding 3: Satisfactory Experience in Teaching a MOOC ................................................. 178
Finding 4: Intention of Participating in a MOOC ............................................................... 179
Finding 5: MOOC Instructor’s Roles ................................................................................. 180
Finding 6: Benefits and Challenges of Teaching a MOOC ................................................ 183
Connection to the Conceptual Framework ............................................................................. 185
Implications for Practice ......................................................................................................... 186
Implications for MOOC Instructors and Higher Education Administrators ....................... 186
Implications for Instructional Designers and MOOC Platform Developers ....................... 188
Limitations .............................................................................................................................. 189
Recommendations for Future Research .................................................................................. 190
Investigate Experience of MOOC Instructors Who Drop Out after Teaching a MOOC .... 190
Investigate MOOC Instructors’ Experience of Delivering a MOOC in Developing Countries
............................................................................................................................................. 191
xi
Explore Attitudes and Perceptions of Administrators and Faculty from Higher Education
Institutions That Have Offered MOOCs ............................................................................. 191
Investigate MOOC Instructors’ Experience of Delivering a MOOC in a Different Language
Other Than English ............................................................................................................. 192
Conclusion and Summary ....................................................................................................... 192
APPENDIX A: Institutional Review Board Approval ............................................................... 196
APPENDIX B. Recruitment Emails ........................................................................................... 197
APPENDIX C. Consent Forms ................................................................................................... 199
APPENDIX D. Survey Instrument ............................................................................................. 203
APPENDIX E. Permission to Use Survey Instruments .............................................................. 211
APPENDIX F. Interview Protocol .............................................................................................. 215
REFERENCES ........................................................................................................................... 217
xii
LIST OF TABLES
Table 1. Summary of the Existing Literature Studies on the Roles of Faculty in Online Education
............................................................................................................................................... 65
Table 2. Summary of Six Types of Mixed Methods Research Design ......................................... 82
Table 3. Alignment of Research Questions and Instruments ........................................................ 89
Table 4. Summary of Statistical Analysis Technique ................................................................... 92
Table 5. The Terminology of Rigor in Quantitative and Qualitative Research ............................ 94
Table 6. Summary of Techniques Used to Enhance the Trustworthiness of Qualitative Strand .. 96
Table 7. Demographic Data of Sample Population (N=89) .......................................................... 97
Table 8. Participant’s Teaching Background (N=89) ................................................................... 99
Table 9. Descriptive Statistics for Intrinsic Factors (N=89) ....................................................... 101
Table 10. Descriptive Statistics of Extrinsic Factors (N=89) ..................................................... 103
Table 11. Participant’s Overall Impression of MOOC Teaching Experience (N=89) ............... 106
Table 12. Participant’s Beliefs about MOOC’s Academic Rigor & Online Courses (N=87) .... 107
Table 13. Participant’s MOOC Teaching Background Information (N=89) .............................. 109
Table 14. Role(s) of MOOC Instructor (N=89) .......................................................................... 110
Table 15. Communication Tools Used in MOOCs (N=89) ........................................................ 111
Table 16. Demographic Data of Interviewees (N=12)................................................................ 114
Table 17. Summary of Intrinsic and Extrinsic Factors Leading to Faculty Choice .................... 116
Table 18. Summary of Subthemes and Categories for Roles and Experiences .......................... 126
Table 19. Sub-steps and Products for Each Step ........................................................................ 175
xiii
LIST OF FIGURES
Figure 1. Conceptual Framework. ................................................................................................ 18
Figure 2. Development of MOOC Providers. Cited from “MOOCs-Massive Open Online
Courses” by Gaebel, 2014, EUA, p.4. .................................................................................. 26
Figure 3. Self-Determination Theory. Adapted from “Intrinsic and Extrinsic Motivations: Classic
Definitions and New Directions” by Ryan & Deci, 2000, Contemporary educational
psychology, 25, p.61. ............................................................................................................ 73
Figure 4. Instructor’s Roles Model by Berge (2008, p. 409) ........................................................ 76
Figure 5. Prototypical Version of the Convergent Parallel Design. Adapted from “Designing and
Conducting Mixed Methods Research” by Creswell & Plano Clark, 2010, p. 250. ............. 84
Figure 6. Participants’ Beliefs about Fully Online Courses Before and After Teaching a MOOC.
............................................................................................................................................. 108
14
CHAPTER 1. INTRODUCTION
Computer technology and the World Wide Web altered the education landscape
(Akdemir, 2008; Dabas, 2018; Herold, 2016; Nickerson, 2020; Selwyn, 2020; Schiffman,
Vignare, & Geith, 2007). Given the rapid development of educational technology, the
unprecedented growth of online education was seen as one of the most dramatic recent
developments in postsecondary education in the United States. Massive Open Online Courses
(MOOCs), the emerging educational innovation in the field of online education, first appeared in
the United States higher education community in 2008 and developed rapidly since 2012
(Barnes, 2013; Deng, Benckendorff, & Gannaway, 2019; Glass, Shiokawa‐Baklan, & Saltarelli,
2016; Jacoby, 2014; Lambert, 2020; Maya-Jariego, Holgado, González-Tinoco, Castaño-Muñoz,
& Punie, 2020; Sandeen, 2013). MOOCs successfully garnered attention from the academic
community since 2010. Many postsecondary institutions adopted MOOCs to help meet the
increased demand for online courses (Allen & Seaman, 2007; Al-Rahmi, Aldraiweesh, Yahaya,
Kamin, & Zeki, 2019; Daniel, 2012; Ebner, Schön, & Braun, 2020; Gaebel, 2014; Len-Urritia,
Cobos, & Dickens, 2018; Liyanagunawardena, Adams, & Williams, 2013; Tschofen &
Mackness, 2012).
Current estimates suggested that the number of postsecondary faculty engaged in online
education was as high as between one-fourth and one-third of all faculty (Allen, Seaman, Poulin,
& Straut, 2016; Marasi, Jones, & Parker, 2020; Mayadas, Bourne, & Bacsich, 2009; Seaman,
2009) prior to COVID-19 pandemic. The Chronicle surveyed 103 professors and found that the
majority of them who taught a MOOC had no prior experience with online instruction
(Kolowich, 2013). Previous studies showed that faculty members who decided to teach online
were not prepared physically or mentally (Bower, 2001; Lichoro, 2015; Outlaw, Rice, & Wright,
15
2017; Vang, Martin, & Wang, 2020). Considerable instructors used the same pedagogy and
approaches from their face-to-face classes to teach online courses, as they perceived that
teaching online was merely a change of environment (Choi & Park, 2006; Lichoro, 2015; Outlaw
et al., 2017; Vang et al., 2020). Lacking knowledge of online pedagogy and instructional design
impeded faculty in efforts to create quality online courses (Akdemir, 2008). The experience of
running a MOOC was different from teaching either a face-to-face class or an online class
because the scale and open nature of a MOOC changed the locus of control (Ferguson &
Sharples, 2014; Laurillard & Kennedy, 2017; Walker & Loch, 2014). Managing MOOCs’
massiveness was described as one of the challenging things in the literature (Hokanson &
McCluske, 2014; Ross, Sinclair, Knox, & Macleod, 2014; Walker & Loch, 2014).
While faculty members’ experiences with designing and teaching an online course were
documented in the literature, empirical studies regarding instructors’ experiences in MOOCs
were scarce. This study aimed to explore high education faculty members’ teaching experiences
in MOOCs from three aspects: what factors motivated them to teach a MOOC, what roles they
performed in delivering a MOOC, and what lessons they learned through the MOOC teaching
journey.
Statement of the Problem
Academic research on MOOCs started to emerge in the peer-reviewed literature in 2008,
with an increasing number of papers appearing each year since. A variety of themes concerning
MOOCs had already been widely discussed in recent years. Studies in MOOCs mostly focused
on learner perspectives (Alario-Hoyos, Pérez-Sanagustín, Delgado-Kloos, Parada, & Munoz-
Organero, 2014; Jordan, 2014; Kellogg, Booth, & Oliver, 2014; Kizilcec, Piech, & Schneider,
2013; Perna, Ruby, Boruch, Wang, Scull, Ahmad, & Evans, 2014; Reich, 2014), context and
16
impact (Bulfin, Pangrazio, & Selwyn, 2014; Hollands & Tirthali, 2014; Radford, Robles,
Cataylo, Horn, Thornton, & Whitfield, 2014; Subhi, Andresen, Bojsen, Nilsson, & Konge, 2014;
Wang, Paquette, & Baker, 2014) and design (Admiraal, Huisman, & Van de Ven, 2014; Cisel,
Bachelet, & Bruillard, 2013; Guo, Kim, & Rubin, 2014; Kim, Guo, Seaton, Mitros, Gajos, &
Miller, 2014; Yang, Piergallini, Howley, & Rose, 2014). While little attention had been paid to
MOOC instructors’ perceptions and experiences. The lack of empirical research on MOOC
instructors had been presented as a concern in the literature (Veletsianos & Shepherdson, 2016),
however, it had not been fully examined.
Purpose
The primary goal of this convergent parallel mixed methods study was to explore the
experiences of higher education faculty members who had taught a MOOC or were currently
teaching a MOOC via edX or Coursera (two MOOC providers in the United States that had been
providing thousands of online courses in a variety of disciplines). More specifically, this study
strove to identify intrinsic and extrinsic motivators that influenced higher education faculty to get
started with MOOCs, to understand the nature of their roles and the complex issues involved in
running MOOCs, and to learn more about the lessons they gained from the teaching experiences
of MOOCs through edX or Coursera. The findings of this study enriched the current literature
regarding MOOC instructors’ experiences as well as provided best practices, important
implications, and recommendations for future research.
Research Questions
In an effort to gain a deeper understanding of higher education faculty members’
experiences in teaching MOOCs, this research attempted to answer the following research
questions:
17
Research Questions for Quantitative Phase
1. What intrinsic factors motivate higher education faculty to teach a MOOC?
2. What extrinsic factors motivate higher education faculty to teach a MOOC?
3. What are faculty experiences teaching a MOOC?
Research Questions for Qualitative Phase
1. How do higher education faculty describe their decision-making process in terms of
participating in MOOCs?
2. What are the roles and experiences of higher education faculty encounter in delivering a
MOOC?
3. What lessons have higher education faculty learned through the experience of teaching a
MOOC?
Significance of the Study
Of the studies published related to MOOCs, a significant number of studies focused on
learner participation and experience. Little was known about MOOC instructors’ experiences
while designing, developing, and delivering MOOCs. It is critical to explore their experiences
and understand their intentions to participate in teaching MOOCs, how their roles changed
during the MOOC implementation process, and the lessons they learned from their MOOC
teaching. The results of this study contributed to a thorough understanding of MOOC instructors’
teaching experiences with edX or Coursera and can be used to guide stakeholders and inform
administrative decisions as well as help MOOC providers make continuous improvements.
Conceptual Framework
This convergent parallel mixed methods study intended to explore MOOC instructors’
teaching experiences from three perspectives (see Figure 1).
18
Figure 1. Conceptual Framework.
Self-Determination Theory (Ryan & Deci, 2017) and Instructor’s Roles Model (Berge,
1995) were employed to guide this research study. Self-determination theory, developed by
Edward L. Deci and Richard M. Ryan, which was widely applied to different disciplines since
the mid-1980s. It elaborated the relationship between human motivation and people’s innate
psychological needs and was used to examine what social-contextual factors facilitated or
undermined human being’s intrinsic motivation (Ryan & Deci, 2000). This theory was used to
identify and analyze the impact of intrinsic and extrinsic motivators on MOOC instructors’
psychological activities when they made decisions to teach MOOCs.
Berge (1995) developed a classification framework outlining four roles of instructors in
online education. The model, examining roles of an online instructor (pedagogical, social,
managerial, and technical), was grounded from previous scholars’ work and findings of Berge’s
research that acknowledged instructors performed different roles in various ways while teaching
online. This model was used to help identify the roles of MOOC instructors and shed light on
how these roles were carried out when running a MOOC.
19
Summary of Methodology
A convergent parallel mixed methods design was used, and it was a type of mixed
methods design in which quantitative and qualitative data were collected in parallel, analyzed
separately, and then merged at the interpretation stage. The target population of this study was all
MOOC instructors who had taught a MOOC or were currently teaching a MOOC via edX or
Coursera from 2013 to 2017. The samples were taken from the available population based on a
criterion sampling strategy. In this study, a web-based survey was administered to collect data
for the quantitative phase. Semi-structured interviews were conducted for the qualitative phase.
Data from both quantitative and qualitative strands helped the researcher bring valuable insights
into the research problem rather than eliciting information via either type of data alone (Creswell
and Plano Clark, 2007).
Role of the Researcher
I have been working as an instructional designer at a public higher education institution
in the United States. My responsibilities included providing pedagogical and technical support to
instructional faculty in designing, developing, delivering, evaluating online and/or hybrid
classes, and creating instructional materials to achieve various objectives; assisting in assessing
instructional, technical, and production requirements to determine the most appropriate
interactive media for online and/or hybrid courses; implementing institutional instructional
design plans, and so forth. I have been interested in hearing the experiences of instructional
faculty in various teaching environments.
My role as the researcher of this study was a complete stranger to all of the potential
participants as I did not know any of these MOOC instructors personally. Despite this, I might
have some biases due to my educational and professional background that I brought to the
20
interpretation of the data results. In an effort to minimize these potential biases, some strategies
were used to ensure rigor in both quantitative and qualitative phases. More details were provided
in the methodology chapter.
Limitations
The first limitation was the drawback of the convergent parallel research design used for
this study. Unequal sample sizes existed in the quantitative and qualitative strands for different
purposes (generalization vs. in-depth understanding) cannot be overlooked. The size of samples
for the quantitative phase in this study was larger than the counterpart for the qualitative phase
that was limited to a small number of interviewees for an in-depth understanding. The findings
derived from this study had limited ability to be generalized to all MOOC instructors. Second,
focusing on edX or Coursera was perceived as limited in scope for a research like this one. Care
was taken in generalizing the results and recommendations. Third, subjectivity was considered as
another limitation in this study. Due to the subjectiveness of interviewing, an interviewee might
bring his/her own biases into the answers. An interviewee might hesitate to reveal his/her
perceptions on a particular topic or subject (Alshenqeeti, 2014; Tashakkori & Teddlie, 2002),
he/she might have inaccurate memories of experiences when recalling, and he/she might be
untruthful or gave socially acceptable responses. However, the interviewer remained non-
judgmental to the responses provided by an interviewee in an effort to reduce a potentially
biasing effect (Tashakkori & Teddlie, 2002).
Definition of Key Terms
Intrinsic Motivation. For purposes of this study, from the definition of Deci and Ryan
(2017), intrinsic motivation was internal factors (e.g., curiosity, intellectual challenge, personal
interest) that drove an individual to behave in a certain way for inherent satisfaction.
21
Extrinsic Motivation. For purposes of this study, from the definition of Deci and Ryan
(2017), extrinsic motivation referred to external factors (e.g., monetary rewards, social approval,
avoidance of punishment, financial compensation) that stimulated an individual to take action for
separable consequence.
Faculty Member. For this study, a faculty member referred to an individual who was
“engaged directly in teaching, research or public service and held the academic rank of instructor
and above within American institutions of higher education” (Bowen & Schuster, 1986, p.11),
including part-time and full-time employment. Administrators, librarians, graduate students, and
non-professional staff were excluded from this study.
MOOCs. An acronym for “Massive Open Online Courses,” free online courses without
demanding prerequisite knowledge and formal entry requirements to bring together people who
had the same interest in a particular subject (Radford, Robles, Cataylo, Horn, Thornton, &
Whitfield, 2014).
Motivating Factors. For purposes of this study, motivating factors were factors (including
intrinsic and extrinsic) that encouraged higher education faculty members to participate in a
MOOC teaching activity (Maguire, 2005; Miller & Husmann, 1999; Parker, 2003).
Summary
The rapid growth of technology led to a boom in online education. The number of online
courses, programs, students, and faculty members continued to expand due to the increased
demand. MOOC, as an innovative delivery format of online education, attracted the attention of
many postsecondary institutions and academic communities. Higher education faculty members
who chose to teach a MOOC or had been considering diving in needed support and adequate
training to acquire and develop new skills and knowledge. The literature on instructors’
22
experiences in teaching face-to-face or online classes was well established, but little for MOOC.
Through a convergent parallel mixed methods research design, this study intended to identify
intrinsic and extrinsic motivators that encouraged higher education faculty in teaching a MOOC,
to understand their roles in MOOCs compared to traditional instruction, and to learn more about
the lessons they received from the MOOC teaching practices. The results of this study shed light
on the teaching experiences of higher education faculty members in MOOC and hopefully served
as a lighthouse to provide navigational aid for future studies.
In Chapter Two, a review of the literature including a MOOC overview, motivating
factors for faculty participation in online and MOOC environments, faculty roles in online and
MOOC contexts, and a conceptual framework was presented. A description of the methodology,
an explanation of procedures regarding the data collection, and data analysis were included in
Chapter Three. Chapters Four and Five presented an interpretation of quantitative and qualitative
data with details. The discussions of findings, the conclusion of this study, implications,
limitations, and recommendations for future research were stated in Chapter Six.
23
CHAPTER 2. REVIEW OF LITERATURE
This chapter covered comprehensive literature and introduced a conceptual framework
that was used to guide this research study. Both the literature review and conceptual framework
were crucial to explore higher education faculty members’ experiences in the context of MOOCs
and to serve as a stepping stone for further investigation on MOOC instructor’s teaching
experience. Content in the literature review included an overview of MOOCs, a review of
MOOC participation and experiences from the perspectives of students and instructors, MOOC
issues, an examination of motivating factors that influenced instructors and institutions to
participate in MOOCs, and roles instructors performed in online education and MOOCs. This
chapter ended with an introduction to the conceptual framework for the study.
MOOC Overview
This section provided an overview of MOOCs including a definition of MOOCs, the
development history of MOOCs and MOOC providers, types of MOOCs, MOOC participants
and their intentions of participating in MOOCs.
Defining MOOCs
“MOOC” was an acronym for “Massive Open Online Course.” This term was first coined
by Dave Cormier from the University of Prince Edward Island (Canada) as a result of a large
online course (i.e., Connectivism and Connective Knowledge, also known as CCK08) ran by
George Siemens and Stephen Downers in 2008 (Al-Rahmi, Aldraiweesh, Yahaya, Kamin, &
Zeki, 2019; Ebner, Schön, & Braun, 2020; Jacoby, 2014; Len-Urritia, Cobos, & Dickens, 2018;
McAuley, Stewart, Siemens, & Cormier, 2010; Richter & Krishnamurthi, 2014; Sangrà,
González-Sanmamed, & Anderson, 2015). MOOCs were free online courses without demanding
prerequisite knowledge and formal entry requirements. Generally, there were no enrollment
24
limits for a MOOC (Lineweaver, 2019; Meneses & Mac Fadden, 2020; Muthukumar & Bhalaji,
2020; Gaebel, 2013). Learners’ participation was completely voluntary and dependent on
interested individuals (Liyanagunawardena, Adams & Williams, 2012). The word “massive”
primarily referred to the number of enrollees for the course. In 2012, MOOC providers (e.g.,
Coursera, edX) started collaborating with a variety of public and elite universities, particularly in
North America, to develop and deliver MOOCs across multiple disciplines. The enrollment
number reached up to 50, 000 students per course. The most highly cited example was Stanford
University’s Artificial Intelligence course that attracted 160,000 students in 2011 for one
delivery (Rodriguez, 2012).
Development of MOOCs and MOOC Providers
The first MOOC (also known as cMOOC), was an online course offered through the
Learning Technologies Center and Extended Education at the University of Manitoba in Canada
and facilitated by George Siemens and Stephen Downes in 2008 (Hoy, 2014; Jacoby, 2014;
Joseph, 2020; McAuley et al., 2010; Motzo & Proudfoot, 2017; Pulist, 2020; Sargsyan &
Torrijos, 2017; Richter & Krishnamurthi, 2014; Sangrà et al., 2015; Zhang, 2013). This online
course consisted of 25 paid enrollments (for credit) in Extended Education at the University of
Manitoba with around 2,200 non-credit, non-fee paying students from the general public
(Liyanagunawardena et al., 2012). All course-related resources were available online for students
to access for free. A variety of collaborative tools (blog, threaded discussion, and meeting tools)
were provided for online students to interact with the instructors or their peers. Stanford
University launched three courses (i.e., Introduction into AI, Machine Learning, and Introduction
to Databases) in the fall of 2011 that attracted millions of enrollees (Croxton & Chow, 2015;
Kizilcec, Schneider, Cohen, & McFarland, 2014).
25
MOOCs providers (e.g., Coursera, edX, Udacity) started to appear on the higher
education horizon since 2012 (Gaebel, 2013) (see Figure 2). A company named “Udacity” was
established and launched in February 2012. It was a for-profit Silicon Valley start-up in North
America, led by Sebastian Thrun, David Stavens, and Mike Sokolsky (Gayoung, Sunyong,
Myungsun, Yoomi, & Ilju, 2016). As of August 2020, Udacity had 11.5 million users. A feature
of Udacity to differentiate it from other MOOC companies was that it primarily recruited
freelancing professors and full-time, in-house professionals to design and teach the company’s
offerings (Matthews, 2013). Not coincidentally, another company called “Coursera” was
founded by two other computer science professors Andrew Ng and Daphne Koller in April 2012.
It was a for-profit Silicon Valley start-up in North America that had at least 118 world-class
university partners including Princeton, Brown, Columbia, Duke, Stanford, Johns Hopkins, etc.
Coursera had registered 47 million enrollees in over 952 courses from at least 118 institutions
and saw 1.4 million course enrollments every month (Cusumano, 2013; EdSurge, 2019;
Liyanagunawardena et al., 2013; Morris, 2013; Stephens-Martinez, Hearst, & Fox, 2014). The
3rd MOOC provider in the market, edX, developed rapidly and evolved as a self-funded non-
profit consortium of universities built by Massachusetts Institute of Technology and Harvard
University in May 2012 and mainly led by MIT professors. As of August 2020, 33 million users
were taking courses online from the edX platform. Udacity and Coursera, as the leading MOOC
companies and both founded by Stanford University professors, had each received more than $15
million from venture capital firms (Bento, 2014; Matthews, 2013). EdX, as a not-for-profit
organization, was seeded by $30 million each from Harvard and MIT (Matthews, 2013). By
2014, there were as many as 20 MOOCs providers from other areas all over the world, like Asia,
26
Europe, and Australia (Najafi et al., 2015; Gasevic, Kovanovic, Joksimovic, & Siemens, 2014;
Veletsianos & Shepherdson, 2016).
Figure 2. Development of MOOC Providers. Cited from “MOOCs-Massive Open Online
Courses” by Gaebel, 2014, EUA, p.4.
Types of MOOCs
A substantial number of studies discussed the classifications of MOOCs (Admiraal,
Huisman, & Pilli, 2015; Bozkurt, Akgün-Özbek, & Zawacki-Richter, 2017; Clark 2013; Conole
2013; Lane, 2012; Wu & Chen, 2017). The two most widely recognized types of MOOCs were:
cMOOC and xMOOC (Clow, 2013; Conole, 2015; Daniel, 2012; Downes & Siemens, 2011;
García-Peñalvo, Fidalgo-Blanco & Sein-Echaluce, 2018; Hill, 2012; White, Davis, Dickens,
León, & Sánchez-Vera, 2014; Wang, Anderson, & Chen, 2018).
The first cMOOC model (known as Connectivist MOOC) was grounded on connectivism
philosophy (Daniel, 2012; Rodriguez, 2012), and it was a part of the open educational resource
movement that connected people across a common topic or field of discourse (Daniel, 2012;
27
Rodriguez, 2012; Zhang, 2012). Connectivist MOOC focused on knowledge creation and
generation (Daniel, 2012; Siemens, 2012) and emphasized connected, collaborative learning
(Barnard-Brak, Paton, & Lan, 2010; Horn, 2013; Lewin, 2012). Examples of cMOOC included
CCK08 (i.e., Connectivism and Connective Knowledge 2008) facilitated by Siemens and
Downes, Personal Learning Environments, MobiMOOC, and EduMOOC (Rodriguez, 2012).
Educational technologies and the internet were adopted for the early cMOOC model to improve
access to information for online learners and to increase the role of learning through connection
(Weller, Siemens, & Cormier, 2012). Therefore, cMOOC participants were encouraged to create
personal learning networks and a learning community to share materials and collaborate with
peers using any online tools they preferred (Conole, 2015; Means, Bakia, & Murphy, 2014).
However, critics (Kop, Fournier, & Mak, 2011) asserted that cMOOC posed challenges for
novice online learners because of the complexity of the unstructured networks. They believed the
range of topics, platforms, conversations, and assessment options were distracting and requested
more attention from learners. Other scholars (Waite, Mackness, Roberts, & Lovegrove, 2013;
Weller, 2011) argued that cMOOC had a transformative effect on learning because cMOOC
participants stayed and interacted within a constant network.
The second, currently more prevalent MOOC type was the xMOOC (known as extended
MOOC) which was grounded on the theories of behaviorism and cognitivism (Conole, 2015;
Kop, 2011). Extended MOOC stressed knowledge duplication (Daniel, 2012; Siemens, 2012)
and appeared more like a regular postsecondary course with emphasis on video lectures, tests
and quizzes, assignment, and discussion (Barnard-Brak et al., 2010; Conole, 2015; Horn, 2013;
Lewin, 2012; Siemens, 2012) which relied heavily on information transmission, computerized
assignment and peer assessment (Bates, 2012; Roscorla, 2012). Examples of xMOOC included
28
Introduction to Artificial Intelligence facilitated by Stanford University with more than 160,000
enrollees, Machine Learning, Introduction to Databases, and Python Programming and Building
a Search Engine courses (Rodriguez, 2012). The majority of the courses provided on Udacity,
Coursera, and edX were characterized as xMOOC. Jacoby (2014) argued that the design,
structure, and philosophy of xMOOC relied primarily on technology which was the fastest way
to meet learners’ needs and solve most of the problems. Learners from the xMOOC model
received information to build up their knowledge construction through pre-recorded videos,
tutorials, and quizzes developed by professionals in the subject field. They were granted much
autonomy for learning (e.g., go through the course content at their own pace) in the context of
xMOOC (Hew & Cheung, 2014). While critics pointed out that the design of xMOOC was
problematic as the xMOOC model followed a cognitivist-behaviorist approach, which was an
outdated concept of pedagogy (Bates, 2012). The cognitivist-behaviorist approach encouraged
information transmission rather than higher-order thinking. Given the difference between
cMOOC and xMOOC in design, structure, and philosophy, instructors had to tweak strategies to
teach MOOCs in order to meet various needs of MOOC learners.
In the context of cMOOC, course materials and content were defined by learners as the
course progressed (Rodriguez, 2012). The cMOOC instructor provided a course outline to
learners who had the autonomy to determine how much to engage with the cMOOC (Mackness,
Mak, & William, 2010), which resulted in multiple topics had to be examined to satisfy all
learners’ interests at different levels (Hew & Cheung, 2014). While the xMOOC emphasized a
more traditional learning approach through video presentations along with short quizzes and
other formative or summative assessments. Hence, xMOOC instructors appeared to design and
develop their instructions similarly to traditional higher education courses. For example, course
29
content generally consisted of pre-recorded video lectures (3-15 mins long), syllabus, readings,
discussions via online forums, quizzes, essays, group or individual projects, and tutorials
(Belanger & Thornton, 2013; Conole, 2015; Kaul, 2012; Wu & Chen, 2017). Some xMOOC
instructors integrated online simulations (e.g., circuits sandbox) or game-themed topics into their
MOOCs to further engage students (Agarwal, 2012; Frank, 2012). Online office hours (Martin,
2012; Rodriguez, 2012) and video chat rooms (Duneier, 2012) have been used by xMOOC
instructors to answer specific questions selected from a pool developed by students (Martin,
2012; Rodriguez, 2012) and to lead a synchronous seminar-style discussion of course readings
within a small group limited to 6-8 participants while other students may either listen to the live
stream or the recordings in their spare time (Duneier, 2012). Simply put, the cMOOC instructor
behaved more like a discussion moderator (Rodriguez, 2012), and the role of the xMOOC
instructor resembled more a facilitator (Cormier & Siemens, 2010; Chiam, 2016; McAuley et al.,
2010; Yuan & Powell, 2013) who fostered a community for students to connect with their peers
for learning purposes.
Not only MOOC instructors needed to adopt various strategies to prepare and deliver a
course in cMOOC or xMOOC, but MOOC learners also need to adapt themselves in a different
learning environment to reach their full potential and achieve their learning outcomes. Learners
in the cMOOC model were encouraged to build up personal learning networks and community to
collaborate with other learners (Conole, 2015). However, it became difficult for them to have
their work assessed for credits through cMOOC because all participants in the cMOOC were
doing different work (Rodriguez, 2012). Lacking a consistent system to assess student work was
identified as an issue since cMOOC was developed (Admiraal et al., 2015). Further, learners
were getting lost gradually in the decision-making process of determining if the selected course
30
was fit for them as course content of cMOOC normally evolved quickly while it was being
developed (Rodriguez, 2012).
Notably, xMOOC learners performed completely different from cMOOC counterparts.
Typically, they read the assigned course materials such as textbooks and articles (mostly digital
and free), attended online discussion forums, viewed the pre-recorded video lectures, took the
online tests and quizzes, and completed assignments (Admiraal et al., 2015; Hew & Cheung,
2014). Learners in xMOOC had the autonomy to determine how they learn and control the pace
of learning (Bates, 2014; Frank, 2012; Kop, 2011). Instructors of xMOOC tended to post their
requests/expectations at least once a week in online discussion forums to engage learners.
Learners could lead the discussion with interesting topics and emailed instructors with their
questions in xMOOC (Kolowich, 2013).
Scholars had argued that simply classifying MOOCs into either cMOOC or xMOOC was
not a scientific approach (Hew & Cheung, 2014) and they provided other alternative methods to
categorize MOOCs. For example, Lane (2012) suggested that MOOCs can be grouped into three
types: network-, task- and content-based. Clark (2013) proposed another typology of MOOCs
with eight types (transferMOOCs, madeMOOCs, synchMOOCs, asynchMOOCs,
adaptiveMOOCs, groupMOOCs, connectivistMOOCs, and miniMOOCs). Conole (2013) offered
another MOOC classification scheme encompassing 12 dimensions: 1) the degree of openness,
2) the scale of participation, 3) the amount of use of multimedia, 4) the amount of
communication, 5) the extent to which collaboration was included, 6) the type of learner pathway
(from learner-centered to teacher-centered and highly structured), 7) the level of quality
assurance, 8) the extent to which reflection was encouraged, 9) the level of assessment, 10) how
31
informal or formal it was, 11) autonomy, and 12) diversity. However, this classification scheme
needed more empirical studies to support its efficiency in a long-term development plan.
As noted, each MOOC type served a different purpose. Experts discussed other forms of
MOOCs in the literature. For example, ‘hybrid’ MOOC (Clark, 2013; Conole, 2015; Roberts,
Waite, Lovegrove, & Mackness, 2013; Tomkins & Getoor, 2019; Waite et al., 2013), ‘project’
MOOC (Barak & Watted, 2017; Haavind & Sistek-Chandler, 2015; Holotescu, Grosseck, &
Cretu, 2013), and ‘mini’ MOOC (Frick & Dagli, 2016; Haavind & Sistek-Chandler, 2015;
Touati, 2016). These new forms of MOOCs were used and integrated into traditional classes at
higher education institutions (Zutshi et al., 2013).
MOOC Learners
A considerable amount of research described the diversity of MOOC users regarding age
(Agarwal, 2014; Christensen, Steinmetz, Alcorn, Bennett, Woods, & Emanuel, 2013; Dillahunt,
Wang, & Teasley, 2014; Emanuel, 2013; Ho, Reich, Nesterko, Seaton, Mullaney, Waldo, &
Chuang, 2014; Macleod, Haywoord & Woodgate, 2015), gender (Christensen et al., 2013;
Dillahunt et al., 2014; Emanuel, 2013; Ho et al., 2014; Jiang, Schenke, Eccles, Xu, &
Warschauer, 2018; Seaton, Bergner, Chuang, Mitros, & Pritchard, 2014), origin (Breslow,
Pritchard, DeBoer, Stump, Ho, & Seaton, 2013; Christensen et al., 2013; Dillahunt et al., 2014;
University of Edinburgh, 2013), education (Belanger & Thornton, 2013; Christensen et al., 2013;
Dillahunt et al., 2014; Emanuel, 2013; Ho et al., 2014; Klawe & Schofield, 2014; Koller & Ng,
2013), employment status (Christensen et al., 2013; Emanuel, 2013; Gaebel, 2013; Kizilcec,
Piech & Schneider, 2013) and financial status (Emanuel, 2013). MOOC participants had been
predominantly characterized as well-educated, young, full-time working professionals from
developed countries looking to learn new skills in order to advance their careers (Bento, 2014;
32
Chadaj, Allison, & Baxter, 2014; Emanuel, 2013; Luik, Feklistova, Lepp, Tõnisson, Suviste,
Gaiduk, Säde, and Palts, 2019). Among them, males accounted for over 50% (Christensen et al.,
2013; Dillahunt et al., 2014; Ho et al., 2014).
Christensen et al. (2013) surveyed more than 40,000 individuals from 200 countries who
enrolled in 32 MOOC Coursera courses published by the University of Pennsylvania in
November of 2013. In these courses, researchers found that over 40% of active MOOC users
were under 30 years old, with less than 10% over 60. Interestingly, among these participants,
more than half (57%) were male, with a majority from developed countries. The findings also
pointed out that 83% of the learners from all the geographic regions had a two- or four-year
degree, 79% had a Bachelor’s degree or higher and 44% reported education further than a
Bachelor’s degree. Approximately 62% reported being employed full-time or self-employed,
while only 13% revealed being unemployed or retired. The respondents in this survey were from
all geographic regions (the United States, Non-US OECD Countries, BRICS Countries, and
other developing countries). The results suggested that the age of the MOOC students who came
from BRICS (Brazil, Russia, India, China, and South Africa) countries and other non-OECD
countries were significantly younger than their counterparts from OECD (Organization for
Economic Co-operation and Development) countries. The proportion of male students from
BRICS, US, and Non-US OECD countries in MOOCs accounted for 68%, 48%, and 58%
respectively.
Research by Belanger and Thornton (2013) from Duke University analyzed 12,000
enrollees representing 100 countries from their first MOOC course “Bioelectricity” delivered via
Coursera. In matters of education, they found that approximately 37% of enrolled students
reported holding at least a Bachelor’s degree; 27% had a Master’s degree and 8% had a doctoral
33
degree, and 18% responded as having some college education. Similar findings were reported by
Kizilcec et al. (2013), who investigated over 94,000 enrolled learners from three computer
science courses published by Stanford University via Coursera. The results indicated that the vast
majority of learners were male and employed full-time. And most learners from the
undergraduate-level computer science course reported that they held a Bachelor’s degree or
higher. Additionally, other scholars like Fowler (2013) and Ho et al. (2014) both identified
similar findings.
MOOCs were widely used by educators as a means of professional development to learn
more about the subjects they were teaching (Newton, 2015). The most engaged and committed
MOOC students tended to be elementary and secondary school teachers, college professors, and
graduate assistants (Velesianos & Shepherdson, 2015). Educators made up the largest portion of
professionals taking MOOCs in developing countries (Wildavsky, 2014).
Intentions for Participating in MOOCs
Much had been written about the benefits of participating in MOOCs from the lens of
MOOC learners (Baker, Nafukho, McCaleb, Becker, & Johnson, 2015; Becker, 2013; Blum,
Stenfors, & Palmgren, 2020; Leon-Urritia, Cobos, & Dickens, 2018; Iniesto, McAndrew,
Minocha, & Coughlan, 2016; Mallon, 2013; Rodriguez, 2012; Sonwalkar & Maheshkar, 2015).
Scholars found that learner’s choices varied to a large extent and depended on various individual
interests and needs. Among reasons, most learners enrolled in MOOCs because of the unique
features of MOOC, such as open access (White et al., 2014; Wilson, Orr, Hansen, Khoja, Bryant,
& Iyer, 2013), free or low cost (Chen, Barnett, & Stephens, 2013; White et al., 2014; Wilson et
al., 2013) and no prerequisites classes required (Vail, 2013). Learners also enrolled in MOOCs
because they were obsessed with elite colleges and well-known faculty. They stated that they
34
chose a specific MOOC because it was offered by a prestigious, highly ranked university
(Adamopoulos, 2013) or it was taught by knowledgeable, well-prepared, and organized
instructors (Adamopoulos, 2013; Wilson et al., 2013).
While some individuals signed up for a MOOC for honing their skills (Gaebel, 2013),
enhancing or advancing the current careers, or paving the way for getting a better job in future
(Bento, 2014; Gaebel, 2013; Macleod et al., 2015; University of Edinburgh, 2013). In many
cases, a considerable number of learners who enrolled in a MOOC did so for personal
considerations. For those who didn’t get a chance to attend a higher education institution, getting
college experience was highly cited as one of the benefits of enrolling in a MOOC (Cole &
Timmerman, 2015). Besides that, learners enrolled in MOOCs because of their curiosity about
MOOCs (Belanger & Thornton, 2013; Bento, 2014; Gaebel, 2013; Jacobs, 2013; Kay, Reimann,
Diebold, & Kummerfeld, 2013; Kirschner, 2012; Martin, 2012; Seaton et al., 2014; Weinhardt &
Sitzmann, 2019; Young, 2013; Zheng, Rosson, Shih, & Carroll, 2015). They had the desire to
learn about a certain topic, to increase their knowledge, to update what they had learned or to
learn a “just-in-time” topic (Agarwal, 2012; Allon, 2012; Belanger & Thornton, 2013; Breslow
et al., 2013; Fini, 2009; Kaul, 2012; Kolowich, 2013; Rice, 2013; University of Edinburgh,
2013). Other individuals expressed that they wanted to challenge themselves to see if they could
make it through the advanced levels of classes (Breslow et al., 2013; Wilson et al., 2013).
Interestingly, earning a certificate (Macleod et al., 2015; University of Edinburgh, 2013) or
winning as many course certificates as possible became one of the incentives for learners to sign
up for MOOCs as well (Young, 2013).
MOOCs were not only professionally beneficial to learners but to MOOC makers as well
as their institutions (Chea, 2016; Doo, Tang, Bonk, & Zhu, 2020; Evans & Myrick, 2015;
35
Hollands & Tirthali, 2014; Zheng, Wisniewski, Rosson, & Carrol, 2016). The analysis of
published literature suggested that 83% of institutions planned to partner with a MOOC provider,
such as edX, Coursera, or Udacity. Compared to the intentions of students for registering for
MOOCs, the purposes of instructors to teach MOOCs and institutions to offer MOOCs were
different.
Three primary reasons stood out to explain why instructors chose to teach MOOCs. First
and foremost, the instructors themselves were obsessed with MOOCs. They wanted to connect to
a large number of diverse participants to generate rich resources and informative data (Agarwal,
2012; Bonk, Zhu, & Sari, 2018; Lowenthal, Snelson, & Perkins, 2018; Mackness et al., 2010;
Roth, 2013; Sari, Bonk, Zhu, 2019; Watson, Loizzo, Watson, Mueller, Lim, & Ertmer, 2016) and
to gain teaching experience from MOOCs with vast anonymous online learners to enrich the
pedagogy in their regular on-campus classes typically with a small group of homogeneous
students (Belanger & Thornton, 2013; Doo, Tang, Bonk, & Zhu, 2020; Kolowich, 2013; Roth,
2013). Second, egoism was cited as one of the reasons for teaching MOOCs (Hew & Cheung,
2014). Through MOOCs, they could establish themselves as either the expert in a particular field
to increase their reputation or be the first one among their colleagues to increase their earnings or
get tenured (Kolowich, 2013). Third, the last reason for instructors to choose teaching MOOCs
was to increase student access to higher education throughout the world (Kolowich, 2013).
Wakefield et al. (2018) described that MOOCs became a channel for those online participants
who didn’t get a chance to attend college to get a higher education institution experience.
Besides looking at individuals’ intentions, empirical studies were conducted to
investigate the intentions of higher education institutions to offer MOOCs (Hollands & Tirthali,
2014; White et al., 2014). The analysis of published literature suggested that 83% of institutions
36
planned to join MOOC providers, such as edX, Coursera, or Udacity; 43% of schools considered
offering MOOCs (Afshar, 2013). Despite MOOC’s popularity, only a small portion of higher
education institutions engaged with MOOCs, and adoption levels seemed to be plateauing (Allen
& Seaman, 2016). These intentions for higher education institutions offered MOOCs included
strategic growth (Len-Urritia, Cobos, & Dickens, 2018; Marshall, 2013), marketing (Dellarocas
& Alstyne, 2013; Hollands & Tirthali, 2014), strategic collaboration (University of Edinburgh,
2013), organic growth or evolution (Hollands & Tirthali, 2014; Yuan & Powell, 2013), response
to learners (Castells, 1996; William et al., 2011), learner analytics (Barber & Sharkey, 2012;
Breslow et al., 2013; De Liddo, Shum, Quinto, Bachler, & Cannavacciuolo, 2011), educational
enhancement (Hollands & Tirthali, 2014; White et al., 2014), and researching teaching and
learning (Hollands & Tirthali, 2014).
MOOC Experiences
The following literature reviewed the student learning experience in MOOCs and the
instructor teaching experience in MOOCs.
Student Learning Experiences in MOOCs
Researchers have commented on the scarcity of empirical studies documenting the
learning experiences of enrollees who participated in MOOCs (Alario-Hoyos, Estévez-Ayres,
Pérez-Sanagustín, Kloos, & Fernández-Panadero, 2017; Adams, Yin, Madriz, & Mullen, 2014;
Eriksson, Adawi, & Stöhr, 2017; Gregori, Zhang, Galván-Fernández, & Fernández-Navarro,
2018; Jacoby, 2014; Saadatdoost, Jafarkarimi, Sim, & Hee, 2019; Sun, Guo, & Zhao, 2020;
Wang & Baker, 2018). Participant’s learning data had been collected in quantitative and
qualitative ways, such as surveys, self-report instruments, semi-structured interviews, and big
data tracked at the MOOC sites (Adams et al., 2014). The findings from published scholarly
37
articles revealed that blog/discussion forums had been designed as a way for MOOC participants
to record their learning experiences online (Adams et al., 2014; Guo, Sun, Wang, Gao, & Feng,
2019; Zutshi, O’Hare, & Rodafinos, 2013). The majority of participants responded that they
enjoyed online learning through MOOCs even if they did not complete the course. Grainger
(2013) adopted a rating scale with five-choices (poor, fair, good, very good, excellent) and asked
respondents to rate their learning experience with MOOCs in his study. The result indicated that
almost 66% of MOOC participants rated their learning experience as “Good”, and 44% rated it
as “Fair.” University of Edinburgh (2013) reported that more than 97% of participants rated the
MOOCs at the University of Edinburgh as satisfactory, which was interpreted as these courses
meeting most of the learners’ expectations to a certain extent. However, San Jose State
University implemented six-month high-profile experimentation to compare online learners
taking the Udacity courses with regular students who were not taking courses from Udacity. The
result suggested that online students who joined the Udacity courses did significantly worse than
their in-class peers (Rivard, 2013).
Although empirical studies suggested that most students’ learning experiences with
MOOCs were satisfactory (Khalil & Ebner, 2013), it was pointed out that students still faced
some challenges and needed some skills to survive in MOOCs. Self-guided and self-regulated
learners were more suitable for an online learning environment in the form of MOOCs (Kay et
al., 2013).
Studies showed that not only regular university students were intrigued by MOOCs, but
professional scholars were interested in taking MOOCs to test the water. Park, Jung, and Reeves
(2015) explored the experiences of three educational technology scholars who took MOOCs as
regular learners and proposed a refined Carroll model, which stressed “the degree of learning or
38
achievement is a function of the ratio of the time spent on learning to the time needed to learn”
(p.26). This study revealed that hundreds or even thousands of learners’ diverse needs could be
met if the MOOC design was flexible enough for individuals who came from different cultural
backgrounds, ability levels, and expectations (Park et al., 2015).
Teaching Experiences in MOOCs
Although the total number of empirical studies focused on MOOC instructors was
limited, the existing literature depicted a general picture of what a typical MOOC instructor
looked like and provided some evidence for a better understanding of who MOOC instructors
were. For example, Kolowich (2013) surveyed 103 instructors who had taught a MOOC and
found that about two-thirds of respondents were tenured faculty who had taught in college for at
least a decade. Of the 103 respondents, the majority of them were white and male. Another study
examined 142 MOOC instructors regarding their motivations to teach MOOCs and career
development needs (Doo, Tang, Bonk, & Zhu, 2020). Of 142 respondents, 64.43% self-identified
as male, and 35.57% self-identified as female. The age range of participants was from under 30
(2.01%), to 30s (16.11%), 40s (26.17%), 50s (28.19%), 60s (18.79%), and 70 or older (8.72%).
They came from different countries, such as “the United States, the United Kingdom (UK),
Canada, Australia, China (including Hong Kong), Spain, Germany, France, New Zealand,
Switzerland, Italy, Czech Republic, Mexico, Russia, Japan, the Netherlands, Denmark, Romania,
South Africa, Korea, and Singapore.” More than half of the respondents (52.82%) had taught at
least one MOOC, 19.72% had taught two MOOCs, 7.04% had taught three MOOCs, about
6.34% had taught four MOOCs, and 14.08% had taught more than five MOOCs. Additionally,
Zhu & Bonk (2018) investigated 139 MOOC instructors’ experience in designing MOOCs and
found that they had not had extensive experience in designing online courses before participating
39
in MOOCs. The majority of respondents (N=85, 61.2%) reported they had no experiences related
to designing fully online/hybrid courses before designing a MOOC, while 42 (30.2%) had some
experience.
Studies revealed that instructors’ teaching experiences in the context of MOOCs were
rewarding (Belanger & Thornton, 2013; Blackmon, 2018; Khalil & Ebner, 2013). Most MOOC
instructors were happy with their first MOOC experience. MOOC instructors reported that they
liked to connect with students via Discussion Forums to share, exchange, and discuss course-
related subjects. Teaching MOOCs brought professional benefits to MOOC makers, including
“opportunities to show leadership” in their subject areas and greater recognition for their
research work as well as making them reflect on ways of teaching the traditional face-to-face
classes (Blackmon, 2018).
While, the most widely cited challenging thing in teaching MOOCs was that it required a
significant amount of time to prepare the course (e.g., develop the video lectures and upload
them to MOOC platforms) than instructors had expected (Belanger & Thornton, 2013;
Blackmon, 2018; Head, 2013). Developing video lectures, participating in course planning,
designing course activities, assessing student learning outcomes, and troubleshooting problems
took the instructor’s attention away from focusing on engaging with the students (Belanger &
Thornton, 2013). The demands of time and energy required for getting MOOCs ready posed
potential problems for higher education faculty, particularly for those who were not tenured or
had no funding to support their MOOCs.
In addition to time management, most MOOC instructors expressed their concerns about
other issues, such as the technology glitches and being unfamiliar with new features of MOOC
platforms (Belanger & Thornton, 2013; Blackmon, 2018; Hew & Cheung, 2014); the lack of a
40
real audience of students with immediate feedback (Allon, 2012; Roth, 2013); the lack of student
responses in online discussion (Allon, 2012; Breslow et al., 2013; Koutropoulos, Gallagher,
Abajian, Waard, Hogue, Keskin, & Rodriguez, 2012); the lack of protocols to integrate for
MOOC teaching (Kolowich, 2013); and assessment of student work with large numbers of
students (Head, 2013; Wang, Fang, Jin, & Ma, 2019; Xiao, Qiu, & Cheng, 2019).
MOOC Issues
Given the hype of MOOCs, most attention focused on discussing the potential of
MOOCs, even though some challenges became evident (Li, 2019; Sari, Bonk, & Zhu, 2020;
Siemens, 2013; Zhang, Bonk, Reeves, & Reynolds, 2019). An extensive literature review
identified five major issues, namely high dropout rates, plagiarism, assessment of student work,
sustainability, and the quality of MOOCs.
High Dropout Rates
One particular concern about MOOCs was the extremely low rate of completion reported
by numerous researchers and studies (Adamopoulos, 2013; Asiri, 2014; Clow, 2013; Daniel,
2012; Downes, 2010; Gaebel, 2013; Hu, 2020; Lewin, 2013; Liyanagunawardena et al., 2013;
Hoy, 2014; Kizilcec, 2013; Kolowich, 2013; Malan, 2013; North, Richardson, & North, 2014;
Reich & Ruipérez-Valiente, 2019; Sahami, 2013; Vilkova, 2019; Yang, Sinha, Adamson, &
Rosé, 2013). MOOC providers, such as Coursera and edX, pointed out the average completion
rate of MOOCs was under 10% (Jordan, 2013), often closer to 5% (Koller et al., 2013). “Circuits
and Electronics” (6.002x) developed by MIT and Harvard, offered via edX, was launched in
2012, attracting 155,000 registered students. Fewer than 5% of the students who signed up at any
one time completed the course in the end (Breslow et al., 2013). Moreover, universities, like
Harvard and MIT, during 2012-2013, found that only 5% of the people enrolled for the first 17
41
edX courses completed the courses (Klawe & Schofield, 2014). The Graduate School of
Education at the University of Pennsylvania revealed that 4% of one million users of their
MOOCs earned a certificate of completion (Klawe & Schofield, 2014). In Fall 2012, Duke
University offered a “Bioelectricity” MOOC with 12,175 enrollees. However, only about 313
students finished the course at the end (Catropa, 2013; Jordan, 2013). Stanford University and
the University of California Berkeley both experienced high dropout rates with their MOOC
offerings (Yuan & Powell 2013). Consequently, the MOOC dropout rate was estimated from
91%-93%.
Researchers put a great deal of time and effort in modeling and predicting MOOC
dropout behavior in order to understand dropouts in MOOCs (Alamri, Alshehri, Cristea, Pereira,
Oliveira, Shi, & Stewart, 2019; Chen, Sonnert, Sadler, Sasselov, Fredericks, & Malan, 2020;
Feng, Tang, & Liu, 2019; Xie, 2019). In examining the issue of low completion rates in MOOCs,
Haber (2013) claimed that merely calculating the total number of students that received
certificates by the end of a course when analyzing MOOCs might be inappropriate. Some
students might just click “enroll” on the platform due to their curiosity or interest in an intriguing
topic or a specific professor from an elite university. Parr (2013) argued that many learners still
benefited from MOOCs although they were defined as MOOC non-completers. Therefore,
Koller et al. (2013) suggested considering the MOOC student completion rate from the
perspective of student intentions and commitments.
Plagiarism
Plagiarizing was discussed as a potential threat in MOOCs because alleged incidences of
plagiarism were rife in MOOCs (Bento, 2014; Dyumin, Voznenko, Gridnev, & Andrianova,
2018; Gibbs, 2012a; North et al., 2014; Young, 2012; Zhang, 2012). Cheating online was hard to
42
detect, thereby plagiarism-detection software became more used in detecting plagiarism (Belli,
Raventós, & Guarda, 2020; Parry, 2012; North et al., 2014). Two possible ways to eliminate
plagiarism were introduced by Hew & Cheung (2014): Signature Track and proctored
assessment. These two options were not free to students but demanded them to pay certain fees.
Both Udacity and edX partnered with Pearson’s testing centers to validate students taking
proctored tests (Bento, 2014; Kolowich, 2012; Parry, 2012).
Studies on exploring the knowledge, attitudes, and practices of plagiarism were
conducted with large culturally diverse samples of population (Hussien, Khalid, Hussin, &
Baharuddin, 2019; Kocdar, Karadeniz, Peytcheva-Forsyth, & Stoeva, 2018; Memon & Mavrinac,
2020). The concept of plagiarism, however, was not the same in all cultures (Adhikari, 2018).
Students in certain Asian countries did not view plagiarism as a serious ethical offense of
academic dishonesty, but a way to show their respect to the original author (Wilkinson, 2008).
Research suggested universities needed to clarify the principles of academic integrity at the very
beginning of a course and provide supporting services, not just incorporate the plagiarism
detection software in MOOCs without detailed explanations (North et al., 2014).
Assessment of Student Work
Given the “massive” nature of MOOCs, researchers claimed that many MOOC models
lacked high-quality assessments (Driscoll, 2001; Radenkovic, Krdžavac, & Devedžić, 2010;
Strither, 2002; Ren, 2019; White et al., 2014). The types of assessment varied across programs,
including multiple-choice responses (Conole, 2015) and short essays (Admiraal et al., 2015;
Comer & White, 2016). Shermis and Hammer (2012) conducted a study to compare more than
16,000 middle school test essays graded by human beings and computers. The results indicated
that computers were capable of scoring essays as well as people do. Based on that fact, some
43
experts believed that the era of the computer-grading system had arrived. However, Perelman
proposed a counter-argument that some automated essay-grading tools set a restriction on
judging what good writing is (Winerip, 2012). Nevertheless, educators suggested using peer-
reviewed assessment as a means to replace computer assessment (Cooper & Sahami, 2013;
Meek, Blakemore, & Marks, 2017). Despite some courses incorporating “peer-grading (peer
assessment)”, an adequate level of understanding about learner’s assessment couldn’t be assured
(Garcia-Loro, Martin, Ruiperez-Valiente, San Cristobal, & Castro, 2020; Meek, Blakemore, &
Marks, 2017; O’Toole, 2013). Furthermore, not receiving effective feedback was cited as another
challenging aspect of the learning process in the MOOC learning environment. Some MOOC
learners took the peer grading responsibility seriously and provided constructive feedback but
others (usually the majority) were hardly engaged at all (Krause, 2013). Some reported that
guidelines for evaluation or rubrics used for peer-reviewed assessments were not offered by the
instructors in the MOOC, which led to students’ lack of accountability in the process of grading
(Krause, 2013).
Two innovative examples, “assessment bank” (Levine, 2013) and “open badges”
(Conole, 2015) regarding MOOC assessment, deserved attention. In one example, students were
encouraged to collectively create course assignments and save them into an assessment bank.
These assignments were labeled based on a difficulty scale from 1-5. Participants were granted
the privilege to choose assignments from the assessment bank based on their preferences and
levels. ‘Open badges’ was another interesting innovation in MOOCs. Each badge was associated
with certain criteria. In order to receive a badge, learners were expected to demonstrate how they
met the criterion (complete one aspect of MOOC) and validated the process by peers (Conole,
2014).
44
Sustainability
Reviewers (Marginson, 2012; Young, 2012) drew parallels between MOOCs and other
successful business models (e.g., Google, Facebook, eBay) in terms of business sustainability.
They found that these Silicon Valley companies implemented common business strategies,
making early investments, providing free services, and making a substantial profit (White et al.,
2014). The top MOOCs usually attracted large investments, and thus, a higher rate of return was
expected in the long run. For example, Harvard and MIT invested $60 million in edX. Coursera
and Udacity were funded with $22 million and $16 million respectively (Ferriman 2013). A few
strategies were discussed in the study of Homes (2013) to monetize MOOCs. Ptascynsky (2012)
encouraged universities to develop and run MOOCs by themselves without the involvement of
third parties because some of these companies suffered in the dotcom bubble, which might cause
them to be unable to provide sufficient support (Weston, 2012). On the other hand, the findings
on the sustainability of learners’ participation deserved attention as well. Costs might be covered
by institutions, governments, and prospective employers as this novel sustainable business model
targeted high numbers of students to enroll and they paid for assessment and certification
(Lawton & Katsomitros, 2013).
Quality of MOOCs
The quality of MOOCs was another challenge that remained to be resolved in the
literature. Many reviews suggested that MOOCs lacked student engagement, as well as student-
instructor support. For example, Jacobs (2013) reported that the interactions with his professors
in 11 MOOCs in which he enrolled was little. Others reported that MOOC students had no
chance to work with professors or teaching assistants offline (Hew & Cheung, 2014). Student-
instructor interaction, as a form of student-instructor support, was seen as an essential part of
45
online learning because it provided opportunities for students to have their questions answered
by instructors directly (Martin, 2012). Meanwhile, peer interaction, as another crucial support in
MOOCs, generated a series of extracurricular activities that encouraging students to discuss and
exchange ideas of a particular topic, and broadening students’ understanding (Hew & Cheung,
2014). An interesting finding from Davidson (2013) suggested seminar discussions could be
reproduced successfully in a web-based environment. However, Hew & Cheung (2012) argued
that the mere presence of a discussion forum did not automatically foster active interaction.
Certain factors need to be taken into consideration in order to promote a robust learning
community in MOOCs. Notably, the research focus in recent years shifted to explore how to
enhance the MOOC leaners’ experience and improve quality of MOOCs (Conole, 2016; Hood &
Littlejohn, 2016; Stracke, 2017; Stracke & Tan, 2018).
Motivating Factors for Participation in Online Education and MOOCs
During the past decade, considerable research had been done regarding faculty
participation in online education. Massive Open Online Courses (MOOCs) presented itself as an
innovative form of online delivery where research had been conducted. The following review of
the literature provided an overview of intrinsic and extrinsic motivators that influenced the
participation of higher education faculty members in online education. Additionally, motivating
factors for institutional participation in MOOCs were examined in the subsequent section.
Motivating Factors of Faculty Participation in Online Education
Based on previous studies (Betts, 2014; Bruner, 2007; Chapman 2011; Cook, 2019;
Cook, Ley, Crawford & Warner, 2009; Gautreau, 2011; Green, Alejandro & Brown, 2009;
Hoffman, 2013; Huang & Hsia, 2009; Kampov-Polevoi, 2010; Lesht & Windes, 2011; Orr,
Williams, & Pennington, 2009; Osika, Johnson, & Buteau, 2009; Pinkerton, 2008; Schopieray,
46
2006; Schroeder, 2008; Shea, 2007; Stevenson, 2007; Ulmer, Watson, & Derby, 2007), a
substantial number of motivating factors regarding faculty participation in online education have
been identified in both intrinsic and extrinsic form. The intrinsic motivators cited in the literature
included faculty opinions and beliefs about online courses (Hoffman, 2013; Walters, Grover,
Turner, & Alexander, 2017), the intellectual challenge (Cook et al., 2009; Green et al., 2009;
Pinkerton, 2008; Schopieray, 2006; Schroeder, 2008), and one’s personal motivation to use
technology (Betts, 2014; Cook et al., 2009; Pinkerton, 2008; Schroeder, 2008; Schulz, Isabwe, &
Reichert, 2015; Sharma & Srivastava, 2019; Stevenson, 2007), opportunities to develop new
ideas about teaching and the learning processes (Cook et al., 2009; Pinkerton, 2008; Schopieray,
2006; Schroeder, 2008; Stevenson, 2007), opportunities to improve and enhance online teaching
skills (Chapman, 2011; Cook et al., 2009; Green et al., 2009; Pinkerton, 2008; Schopieray, 2006;
Stevenson, 2007), opportunities to learn and use technology (Chapman, 2011; Green et al., 2009;
Schroeder, 2008), opportunities to use personal research as a teaching tool (Pinkerton, 2008;
Schroeder, 2008), opportunities to share knowledge with others and develop new competencies
(Green et al., 2009), as well as opportunities for scholarly pursuit, career exploration, and
opportunities for career development (Chapman, 2011; Green et al., 2009; Lesht & Windes,
2011; Pinkerton, 2008; Schopieray, 2006; Schroeder, 2008).
The literature also identified several factors that could be considered as extrinsic
motivators, such as the ability to reach new audiences who weren’t able to attend classes on
campus (Betts, 2014; Cook et al., 2009; Pinkerton, 2008; Schopieray, 2006; Schroeder, 2008;
Stevenson, 2007), greater course flexibility (Betts, 2014; Chapman, 2011; Hoffman, 2013; Lesht
& Windes, 2011; Pinkerton, 2008; Schopieray, 2006; Schroeder, 2008; Stevenson, 2007), a
variety of support including technical support, pedagogical support, and institutional or
47
departmental support (Betts, 2014; Bruner, 2007; Cook et al., 2009; Pinkerton, 2008; Schopieray,
2006; Schroeder, 2008), and financial rewards (Betts, 2014; Bruner, 2007; Chapman, 2011;
Cook et al., 2009; Green et al., 2009; Lesht & Windes, 2011; Pinkerton, 2008; Schopieray, 2006;
Schroeder, 2008; Stevenson, 2007).
Intrinsic motivators for faculty participation in online education. As noted, intrinsic
motivators played a critical role in faculty decisions to participate in online education. Intrinsic
motivators were grouped into three categories (personal factors, professional development, and
career consideration) and were discussed in the following sections.
Personal factors. A spectrum of intrinsic factors had been found to influence faculty
participation in distance education. The range of factors included faculty opinions and beliefs
about online course delivery (Koenig, 2010; Regan, Evmenova, Baker, Marci, Spencer, Lawson,
& Werner, 2012; Styron, Wang, & Styron, 2009; Ward, Peters, & Shelley, 2010), the intellectual
challenges (Cook et al., 2009; Green et al., 2009; Pinkerton, 2008; Schopieray, 2006; Schroeder,
2008), and one’s motivations to use technology (Betts, 2014; Cook et al., 2009; Pinkerton, 2008;
Stevenson, 2007).
Although online courses had become more prevalent in higher education, a recent
nationwide report indicated that faculty acceptance of online education remained low (Allen &
Seaman, 2016). Higher education faculty members were reluctant to “accept the value and
legitimacy of online education (Allen & Seaman, 2016, p.26)” or harbored negative perceptions
(Koenig, 2010; Regan et al., 2012; Styron et al., 2009; Ward et al., 2010). Considering the
important role faculty played in distance education, the impact of faculty opinions and beliefs on
participation was important and had been studied (Cook et al., 2009; Osika et al., 2009; Panda &
Mishra, 2007; Styron et al., 2009; Wickersham & McElhany, 2010). For example, faculty
48
members with a moderately positive attitude towards online education were more likely to adopt,
use and recommend online courses to their students (Mandernach, Mason, Forest & Hackathorn,
2012; Panda & Mishra, 2007). A negative perception of online education was identified as the
primary inhibitor for faculty involvement (Oskia, 2009). Cook et al. (2009) found that faculty
concerns about the quality of online courses inhibited their participation. A positive or negative
perception regarding the quality of online education was found to be critical in determining
faculty acceptance and participation.
Teaching online had been perceived as an intellectual challenge by faculty (Cook et al.,
2009; Green et al., 2009; Pinkerton, 2008; Schopieray, 2006; Schroeder, 2008). In a study by
Schopieray (2006), the “intellectual challenge of learning a new way of teaching” had been rated
among the top four motivating factors for teaching online. Similarly, Schroeder (2008) found
several facilitating factors that motivated adjunct faculty to participate in online instruction.
“Intellectual challenge” received a high score and ranked in third place among these motivating
factors. In a study by Pinkerton (2008), the intellectual challenge was found to be an intrinsic
motivation that affected the decisions of faculty to teach online. Cook et al. (2009) arrived at a
similar conclusion when stating that for faculty at four different institutions of higher education,
the intellectual challenge was the motivating factor when considering online teaching. Results
from a survey administered by Green et al. (2009) agreed with the aforementioned findings
suggesting that faculty members (including part-time, full-time non-tenured, tenure-track, and
tenured faculty) were all motivated to teach online courses because it was an intellectual
challenge for them.
A considerable amount of literature had been published examining the relationship
between faculty participation in distance education and their motivation to use technology (Betts,
49
2014; Cook et al., 2009; Pinkerton, 2008; Schroeder, 2008; Stevenson, 2007). For instance, in
her recent institutional study, Betts (2014) found that personal motivation to use technology was
rated highly rated solely by those faculty members who had participated in distance education.
This finding was consistent with what Stevenson (2007) claimed in his dissertation that personal
motivation to use technology was embraced by faculty participants who had previously taught an
online class. Similarly, Cook, et al. (2009) argued that faculty participation in distance education
was positively tied to the extent a faculty member personally desired to use technology.
Likewise, Schroeder (2008) stated that adjunct faculty members were highly motivated by the
personal motivation to use technology in online teaching practices. In reviewing all the above
studies, the personal desire to use technology was recognized as being a critical and intrinsic
motivating factor underlying an instructor’s willingness to participate in online teaching.
Professional development. Studies had indicated that opportunities for professional
growth (development) had a positive impact on increasing faculty participation in online
education (Betts, 2014; Chapman, 2011; Conceição, 2006; Elliott, Rhoades, & Jackson, 2015;
Hiltz, Kim, & Shea, 2007; Kampov-Polevoi, 2010; Lesht & Winders, 2011; Pinkerton, 2008;
Schopieray, 2006; Schroeder, 2008; Stevenson, 2007; Wasilik & Bolliger, 2009). These
professional development considerations included opportunities to develop new ideas about
teaching and learning processes (Cook et al., 2009; Pinkerton, 2008; Schopieray, 2006;
Schroeder, 2008; Stevenson, 2007), opportunities to improve and enhance online teaching skills
(DiPaola & Wagner, 2018; Green et al., 2009; Pinkerton, 2008; Schopieray, 2006), opportunities
to learn how to use new technologies (Chapman, 2011; Li & Wong, 2019; Killion, 2016),
opportunities for scholarly pursuit (Lesht & Windes, 2011), opportunities to develop new
50
competencies (Hoffman, 2013), and opportunities to share knowledge with others and to use
personal research as a teaching tool (Schroeder, 2008).
Compared to brick-and-mortar classrooms on campus, distance education offered faculty
a variety of opportunities to incorporate different ideas into their daily teaching with a wide
range of distant learners with different backgrounds (Pinkerton, 2008; Schopieray, 2006;
Schroeder, 2008; Stevenson, 2007). Stevenson (2007) conducted a study with two different
groups of faculty members (a participator group and a non-participatory group) at two
institutions of higher education. His study indicated that faculty who answered “currently
participating” or “previously have participated” in the survey were more likely to be motivated
with opportunities to incorporate different ideas into their pedagogy (p.73). One of the appealing
aspects of participating in online education was to develop new ideas. Pinkerton (2008) found
that faculty members with and without prior online teaching experience cited online teaching as
helpful in forming new ideas. Similarly, Schroeder (2008) concluded that adjunct faculty rated
the opportunity to develop new ideas as a key factor that motivated them to participate in online
instruction. Interestingly, Schopieray (2006) noted that faculty who had not previously taught an
online course would consider the opportunity to develop new ideas as a motivating factor in their
decision to participate in online education.
Traditional faculty models required instructors to possess different skills in many diverse
areas to meet learner needs at all levels (Tucker & Neely, 2015). Therefore, faculty who engaged
in online education were expected to have opportunities to hone their teaching skills in order to
facilitate student learning (Chapman, 2011; Cook et al., 2009; Green et al., 2009; Pinkerton,
2008; Schopieray, 2006; Stevenson, 2007). Given that expectation, opportunities to improve or
enhance online teaching skills became an important factor for faculty when considering teaching
51
online (Chapman, 2011; Cook et al., 2009; Green et al., 2009; Pinkerton, 2008; Schopieray,
2006; Stevenson, 2007). Green, Alejandro, and Brown (2009) examined the factor of
opportunities to improve or enhance online teaching skills with four faculty groups (tenured,
tenure-track, full-time non-tenured, and adjunct/part-time) across the United States. The results
indicated that this factor had a positive impact on faculty members’ proclivity to be involved in
distance education. In other words, faculty members were highly motivated by opportunities to
improve or enhance their online teaching skills through online education. Findings from a study
conducted by Chapman (2011) agreed with Green, Alejandro, and Brown’s findings, which
suggested that both tenured/tenure-track and contingent faculty identified the opportunity to
improve or enhance online teaching skills as an intrinsic motivating factor when choosing to
participate in online education.
With the growth, popularity, and accessibility of technology in educational settings, a
considerable number of instructors began to integrate technology into their teaching practice
(Allen & Seaman, 2010; Baran, Correia, & Thompson, 2013; Benson & Ward, 2013; Hero,
2019; Niess, 2011; Regan, Evmenova, Sacco, Schwartzer, Chirinos, & Hughes, 2019; Tatli,
Akbulut, & Altinisik, 2019). The existing body of research suggested that previous experiences
in using technology in the physical classroom would influence faculty’s perception and
motivation to participate in online education (Huang & Hsia, 2009; Kampov-Polevoi, 2010;
Osika et al., 2009; Ulmer et al., 2007; Wasilik & Bolliger, 2009). Therefore, opportunities to
learn and use technology had been identified as a highly motivating factor in stimulating faculty
to participate in online teaching (Chapman, 2011; Green et al., 2009; Schroeder, 2008). For
example, a quantitative study with 64 adjunct faculty members at a midwestern university
suggested that respondents were intrinsically motivated to teach in distance education courses if
52
the opportunity to learn new technology was offered (Schroeder, 2008). Similarly, Chapman
(2011) concluded that the opportunity to learn new technology played an important motivational
role in the faculty’s decision to participate in online classes. This finding was supported by
Green, Alejandro, and Brown (2009) with a survey administered across the United States. The
survey revealed that faculty members were motivated to teach online courses as a result of the
opportunity to learn and use new technology.
Previous research had established that the initial planning, designing, and development of
an online course took more time and effort away from faculty than they planned to spend on
conducting research (Akdemir, 2008; Bailey & Card, 2009; Bussmann, Johnson, Oliver,
Forsythe, Grandjean, Lebsock, & Luster, 2017; Clark-Ibanez & Scott, 2008; Fein & Logan,
2010; Hoffman, 2012; Hsieh, 2010; Li & Irby, 2008; Lowery & Spector, 2014; Orr et al., 2009;
Salimi, 2007). Additional evidence found that faculty might prefer to teach an upper level or
graduate course in their area of expertise, rather than a general undergraduate course (Ortagus &
Stedrak, 2013). As a result, the opportunity for scholarly pursuit through online teaching
practices was documented as a critical motivating factor for faculty participating in online
instruction (Lesht & Winder, 2011). Pinkerton (2008) studied full-time faculty who had
participated and those who had not participated in online teaching at a community college. Both
groups agreed that the opportunity for scholarly pursuit was a critical factor for them to consider
when making decisions to participate in online teaching. This result was consistent with
Schroeder’s (2008) findings with a population of adjunct faculty. The findings suggested that the
opportunity for scholarly pursuit was one of the intrinsic motivating factors that encouraged
faculty to consider engaging in online education. Furthermore, Schopieray (2006) assessed this
factor with instructors who had not previously taught courses online. The results showed that the
53
opportunity for scholarly pursuit had been a key factor when instructors considered teaching a
future online course.
Additionally, a few other intrinsic factors documented in the literature had been found to
have an impact on faculty decisions to participate in online education. For example, the
opportunity to use personal research as a teaching tool was considered as an intrinsic motivator
by different groups of faculty members (Pinkerton, 2008; Schroeder, 2008). Green et al. (2009)
illustrated that a majority of the instructors in their study indicated that they were more likely to
participate in online classes if they received the opportunity to share knowledge with other peers.
Moreover, the opportunity to develop new competencies was ranked with a higher score in
Chapman’s (2011) study. Both contingent and tenured/tenure-track faculty who taught distance
courses at a public university found that the opportunities to develop new competencies were
essential to boost their motivation to teach online courses.
Career considerations. Online education was seen by faculty as an opportunity to carve
out a niche for their career and increase their visibility and reputation across states and at the
national levels (Bruner, 2007; Lowenthal, Snelson, & Perkins, 2018; Hoffman, 2013).
Opportunities for career development or advancement had been identified as one of the intrinsic
factors encouraging higher education faculty to consider participating in online education
(Chapman, 2011; Green et al., 2009; Pinkerton, 2008). Chapman (2011) attempted to identify the
incentives and motivators that would encourage online education participation between
contingent and tenured/tenure-track instructors. The results indicated that the opportunity for
career advancement was selected by both groups as a critical factor in motivating instructors to
engage in online education. This finding was also supported by what Green et al. (2009) found in
their quantitative study. Green et al. (2009) examined many factors within a survey that
54
encouraged or discouraged faculty involvement in teaching online courses. The study results
showed that all respondents agreed that they were more likely to be motivated to participate in
online education if they had the opportunity to develop their careers. The majority of participants
in this study had a positive attitude towards distance education and embraced the potential
benefits it would bring to their careers. Pinkerton (2008) collected responses from a community
college evaluating 29 possible factors that might impact faculty participation in teaching online
courses. She described that the opportunity for career exploration had a strong positive influence
on faculty with and without prior online teaching experience.
Extrinsic motivators for faculty participation in online education. Although much of
the literature had supported the vital role of intrinsic motivators for faculty to decide to
participate in online teaching, the topic of extrinsic motivators had received considerable
attention as well. Extrinsic motivators documented in the literature, such as the ability to reach
new audiences, the greater course flexibility, support, and financial rewards were discussed in
the following sections.
The ability to reach new audiences. Literature was abundant regarding the inherent
strengths of implementing online courses in distance education. Greater course flexibility (Betts,
2014; Chapman, 2011; Sheail, 2018; Schopieray, 2006; Veletsianos & Houlden, 2019) and the
ability to reach new audiences who were unable to attend classes physically (Bakayev,
Vasilyeva, Kalmykova, & Razinkina, 2018; Cook et al., 2009; Dumford & Miller, 2018;
Schroeder, 2008) were cited as the biggest strengths of teaching online.
The ability to reach new audiences could influence faculty perception and participation in
online education (Betts, 2014; Cook et al., 2009; Pinkerton, 2008; Schopieray, 2006; Schroeder,
2008; Stevenson, 2007). Efforts had been made by researchers to investigate the influence. The
55
results showed that the ability to reach a new audience unable to attend physical classes on
campus positively influenced faculty participation (Betts, 2014; Schroeder, 2008). Faculty with
online teaching experiences at George Washington University stated that the ability to reach new
students through teaching online highly motivated them to participate in online education (Betts,
2014). This finding was supported by other studies (Cook et al., 2009; Dumford & Miller, 2018;
Pinkerton, 2008; Schroeder, 2008). It was not surprising to see that the majority of researchers
categorized the ability to reach new audiences as an extrinsic motivator in this domain.
Interestingly, Stevenson (2007) put this factor as an intrinsic motivator in the literature review of
his dissertation. His study suggested that reaching a wide audience received a higher score
among the top five motivating factors by faculty who had online teaching experience but not by
faculty who did not have online teaching experience.
Greater course flexibility. Online education provided greater flexibility than a traditional
face-to-face classroom in terms of time, location, and faculty schedule. For example, flexibility
was seen in less time spent on driving to campus (Schroeder, 2008; Sheail, 2018; Veletsianos &
Houlden, 2019), less money spent on fuel for commuting (Schroeder, 2008), and flexible work
scheduling (Betts, 2014; Green et al., 2009; Pinkerton, 2008; Schroeder, 2008; Stevenson, 2007).
These strengths allowed online faculty to have greater flexibility to deliver classes.
Empirical studies had identified the flexibility of teaching online as a powerful
motivating factor encouraging faculty to participate in online education (Betts, 2014; Chapman,
2011; Green et al., 2009; Hoffman, 2013; Pinkerton, 2008; Schopieray, 2006; Schroeder, 2008;
Stevenson, 2007). Most of the participants from these studies claimed that they valued the
flexibility of time and location through online teaching. These participants also expressed that
flexible working conditions were critical to their decision-making process (Betts, 2014; Green et
56
al., 2009; Pinkerton, 2008; Schopieray, 2006). The flexible schedule afforded by online
education offered greater flexibility for faculty to juggle teaching, research, community services,
and other commitments (Duncan, 2009; Johnson, Stewart, & Bachman, 2015; Lesht & Windes,
2011).
Furthermore, course flexibility for students was identified in the literature as a key factor
influencing faculty decisions to teach online (Lesht & Windes, 2011; Pinkerton, 2008). Betts
(2014) pointed out that greater course flexibility for students had an impact on faculty
participation in online teaching practices. Participants in her study who had prior online teaching
experience were more likely to consider course flexibility for students when they planned for
future online teaching development. Additionally, adjunct faculty in a study rated greater course
flexibility for students as the highest facilitating factor motivating them to participate in online
courses (Schroeder, 2008). The notion that greater course flexibility for students appeared to
influence faculty was supported from an administrative perspective. Lesht and Windes (2011)
reviewed a series of facilitating and inhibiting factors in terms of online course teaching from an
administrative perspective. Responses from administrators in the study indicated that the
flexibility of online education provided to students associated closely with faculty participation
in teaching online.
Support. Technical support (Betts, 2014; Cook et al., 2009; Pinkerton, 2008; Porter &
Graham, 2016; Schopieray, 2006), pedagogical support (Bruner, 2007; Porter & Graham, 2016;
Schopieray, 2006; Schroeder, 2008), and other forms of support from institutional or
departmental levels (Pinkerton, 2008; Schopieray, 2006) had been documented as significant
extrinsic motivators in the literature. Previous studies suggested that effective technical support
would facilitate faculty in accomplishing some of the goals they set for their courses (Betts,
57
2014; Cook et al., 2009; Pinkerton, 2008; Schopieray, 2006). Lacking technical support was
documented as a major issue for faculty attempting to teach in an online environment (Betts,
1998; Schifter, 2004). Betts (2014) identified the lack of technical support as the primary
inhibiting factor by three groups of respondents from two different educational settings in a
comparison study. Her findings suggested that quality technical support would motivate faculty
participation in online education. Similarly, in Schopieray’s (2006) study, the majority of
respondents emphasized the importance of technical support and quality technical support as the
highest motivator for teaching online courses. This study stressed that the continued technical
support fostered an environment for faculty to seek help when confronted with technology
problems. As a result, it helped maintain their motivation to continue to teach online. Pinkerton’s
(2008) findings also supported the notion that technical support was an important motivator in
faculty decision to teach online. The responses from faculty members who had taught and who
had not taught in distance education courses indicated that faculty members were more likely to
be motivated to participate in online teaching if sufficient technical support was offered in place.
Along with technical support, equipment provided by colleges to assist faculty in online teaching
had also been discussed (Betts, 2014; Cook et al., 2009; Schopieray, 2006). Faculty without prior
online teaching experience ranked equipment provided by their college as one of the highest
motivators in considering teaching a distance course (Schopieray, 2006). Interestingly, the results
from the same study revealed that female faculty who had not taught online previously gave a
higher score for this particular item in the survey than males.
In order to provide quality online programs, faculty members needed to have the
technical and pedagogical expertise to effectively facilitate student online learning (Brinkley-
Etzkorn, 2018; Wang, Gould, & King, 2009). To develop quality online teaching activities,
58
instructors sought out advice and pedagogical support from specialists whom they could turn to
(Boettcher, J. V., & Conrad, 2016; Orr, Williams, & Pennington, 2009). The demand for greater
pedagogical support within universities had been increasingly expanding as enrollment for online
courses had increased exponentially in recent years (Seaman, Allen, & Seaman, 2018; Shea,
2007).
Instructors appeared to be aware that they needed pedagogical training and support to
acquire knowledge and develop skills for online teaching. Their willingness to embrace training,
professional development and support at the institutional level largely influenced the success or
failure of distance education programs (Allen & Seaman, 2012; Bruner, 2007; Major, 2010; Ray,
2009). Receiving training in online education (including pedagogy and technology) was seen as
one of the highest-rated motivating factors for considering teaching online by faculty without
any online teaching experience (Pinkerton, 2008; Schmidt, Tschida, & Hodge, 2016).
Furthermore, training for teaching in online education programs was recognized as an essential
extrinsic motivator (Bruner, 2007; Pinkerton, 2008; Schopieray, 2006; Schroeder, 2008). This
was the case not only for faculty but also for administrators to consider (Lesht & Windes, 2011;
Schmidt, Tschida, & Hodge, 2016).
Empirical studies also identified that support and encouragement from colleagues, deans,
and other administrators were seen as important as other motivating factors (Betts, 1998a, 2014;
Pinkerton, 2008; Schifter, 2000; Schroeder, 2008). Pinkerton (2008) found that more than half of
the respondents in the study agreed that receiving support and encouragement from colleagues,
deans, and other administrators would encourage faculty to join the online teaching movement.
Similarly, Schroeder (2008) confirmed Pinkerton’s findings that support and encouragement
from peers and administrators had a positive impact on instructors and specifically on adjunct
59
faculty. This was the case since adjunct faculty worked mostly on a part-time basis and they
were not as closely connected to campus life as other full-time faculty.
Financial rewards. The majority of faculty members were inherently motivated to help
students (Betts, 2014; Cook et al., 2009; Pinkerton, 2008; Schroeder, 2008; Stevenson, 2007).
However, financial rewards had an impact on influencing faculty participation in online teaching
practices (Betts, 2014; Bruner, 2007; Chapman, 2011; Cook et al., 2009; Green et al., 2009;
Herman, 2013; Lesht & Windes, 2011; Pinkerton, 2008; Schopieray, 2006; Schroeder, 2008;
Stevenson, 2007). A variety of financial incentives were adopted at different institutions to
encourage faculty participation in distance education, for example, the use of departmental funds
for materials and expenses (Pinkerton, 2008; Schopieray, 2006), merit pay (Betts, 2014; Bruner,
2007; Cook et al., 2009; Hoffman, 2013; Pinkerton, 2008; Schopieray, 2006; Schroeder, 2008;
Stevenson, 2007), increase in salary (Betts, 2014; Cook et al., 2009; Green et al., 2009; Hoffman,
2013; Schopieray, 2006; Schroeder, 2008; Shea, 2007; Stevenson, 2007), stipends during
summer (Bruner, 2007), and other forms of financial support for participation (Betts, 2014;
Hoffman, 2013; Shea, 2007; Stevenson, 2007).
Studies had been conducted to examine the relationship between financial rewards and
faculty participation in online education (Betts, 2014; Bruner, 2007; Chapman, 2011; Cook et al.,
2009; Green et al., 2009; Lesht & Windes, 2011; Pinkerton, 2008; Schopieray, 2006; Schroeder,
2008; Stevenson, 2007). Bruner (2007) found that younger faculty between the ages of 30-39
were more likely to teach online courses if additional pay was offered. Interestingly, Cook et al.
(2009) reported similar findings for second-generation distance education faculty who were more
likely to be motivated by merit pay and salary increases. Although merit pay had been rated as
one of the top motivators by faculty in some studies (Pinkerton, 2008; Stevenson, 2007), Betts
60
(2014) pointed out that merit pay did not significantly influence faculty who have taught online
courses in her research.
Instructor’s Roles in Online Education and MOOCs
This section reviewed the literature in terms of instructors’ roles in the online education
and MOOC environment. The subsequent section discussed the numerous roles instructors
performed while teaching in the MOOC context.
Instructor’s Roles in Online Education
The growth of online education was seen as one of the most dramatic recent
developments in postsecondary education in the United States. Given the rapid development of
educational technology, the demand for online education increased rapidly over the past decade
(Seaman, Allen, & Seaman, 2018; Allison, 2015; Bell & Federman, 2013). More and more
universities were offering different online courses and programs to meet online learners’ needs at
different levels (Allen & Seaman, 2008; Han, Ryan, & Manley, 2019; Seaman, Allen, &
Seaman, 2018; West, Waddoups, & Graham, 2007; Young, DeMarco, Nyysti, Harpool, &
Mendez, 2019; Zakharov & Maybee, 2019). The number of postsecondary faculty were engaged
in online education was listed as high as between one-third and one-fourth from the estimates
(Allen, Seaman, Poulin, & Straut, 2016; Marasi, Jones, & Parker, 2020; Mayadas, Bourne, &
Bacsich, 2009; Seaman, 2009). Notably, nearly all educators had to teach online or remotely
during the COVID-19 pandemic (Bao, 2020; Basilaia & Kvavadze, 2020; Daniel, 2020;
Moorhouse, 2020). As the number of online faculty increased rapidly, the awareness of roles
faculty performed in online teaching increased as well. Studies addressing online faculty roles
showed that faculty members played a key role in the following domains, such as the student’s
satisfaction (Fedynich, Bradley, & Bradley, 2015), the success of distance learning (Major,
61
2010), the determinant on whether online learning would become an enduring part of higher
education’s instructional mission (Major, 2010), the learning community building (Compton,
2009), the successful design, development, and delivery of online instruction (Wright, 2014), the
success of online teaching (Allen & Seaman, 2013; Johnson, Hewapathirana, & Bowen, 2019;
Maquire, 2005; Seaman, 2009), and the reflection on current trends and issues in an online
learning environment (Lee, 2011). Moreover, it was widely agreed that faculty roles were critical
in managing instruction and in leading learners to achieve learning goals, explanations on the
instructor’s role in detail were essential (Goold, Coldwell, & Craig, 2010; Keengwe & Kidd,
2010; Lim & Lee, 2008; McQuiggan, 2007; Tao & Yeh, 2008).
Over the years, different taxonomies and models had been created to specify numerous
online faculty roles that needed to perform while teaching online. Researchers documented
numerous online faculty roles in the literature using different classification approaches. Although
literature showed variety in the context regarding online teacher’s roles, commonalities were
found to address these roles that online instructors assumed as they teach.
An effective online course expected faculty to possess a multi-dimensional role and a
varied and wide range of competencies (Albrahim, 2020; Davidson, 2019; Lee, 2011). Over the
years, numerous roles and functions had been assumed by instructors: administrator (Bawane &
Spector, 2009; Goodyear, Salmon, Spector, Steeples, & Tickner, 2001; Martin, Budhrani,
Kumar, & Ritzhaupt, 2019), coach (Alvarez, Guasch, & Espasa, 2009; Bonk, Wisher, & Lee,
2004; Collins, 2006; Volman, 2005; Lim & Lee, 2008; Zhu, Valcke, & Schellens, 2010),
community organizer (Siemens, 2008), consultant (Bonk, Wisher, & Lee, 2004; Goodyear et al.,
2001; Martin, Budhrani, Kumar, & Ritzhaupt, 2019), counsellor (Bawane & Spector, 2009;
Martin, Budhrani, Kumar, & Ritzhaupt, 2019), evaluator (Bawane & Spector, 2009), facilitator
62
(Alvarez et al., 2009; Aydin 2005; Berge, 2008; Bonk, Wisher, & Lee, 2004; Lim & Lee, 2008;
Martin, Budhrani, Kumar, & Ritzhaupt, 2019; Zhu, Valcke, & Schellens, 2010), helper (Lim &
Lee, 2008; Martin, Budhrani, Kumar, & Ritzhaupt, 2019; Zhu, Valcke, & Schellens, 2010),
instructional designer (Aydin 2005; Chang, Shen, & Liu, 2014; Egan & Akdere, 2005; Marcelo,
2006; Martin, Budhrani, Kumar, & Ritzhaupt, 2019; Williams, 2003), mediator (Alvarez et al.,
2009), mentor (Berge, 2008), moderator of learning (Alvarez et al., 2009; Collins, 2006;
Volman, 2005), observer (Berge, 2008), professional (Bawane & Spector, 2009), researcher
(Bawane & Spector, 2009; Goodyear et al., 2001), supervisor (Zhu, Valcke, & Schellens, 2010),
supplier of resources (Berge, 2008; Bonk, Wisher, & Lee, 2004), technologist (Bawane &
Spector, 2009; Martin, Budhrani, Kumar, & Ritzhaupt, 2019), tutor (Alvarez et al., 2009) in
which the debates were more frequent and intense. To a certain extent, these roles overlapped in
terms of their functions and tasks in online teaching practice. Given that, some researchers
separated teaching-related tasks and proposed an individual role for every single task. For
instance, a technologist for providing technological help to learners (Bawane & Spector, 2009),
an instructional designer for designing course contents (Baran, Corriea, & Thompson, 2011), a
career coach for identifying a personal goal and developing leadership skills (Barrett, 2012).
Conversely, other researchers grouped relevant teaching tasks to have one role for multiple tasks,
such as facilitating and sustaining student’s participation and motivation (Bawane & Spector,
2009).
To create a successful online course, instructors had to shift roles. The expansion of
online education at this extremely rapid rate resulted in a dramatic evolution in instructor roles.
The instructor’s role in online learning shifted from the ‘sage of the stage’ to the ‘guide on the
side (Chiasson, Terras, & Smart, 2015).’ In other words, they were no longer an information
63
dispenser, but a cheerleader (Mazzolini & Maddison, 2007; Martin, Budhrani, Kumar, &
Ritzhaupt, 2019) or a course facilitator (Burkle & Cleveland-Innes, 2013; Chiasson et al., 2015;
Martin, Budhrani, Kumar, & Ritzhaupt, 2019; O’Neil, 2006). These new roles brought faculty
into a new venue that they lost a certain autonomy commonly existed in which didactic learning
occurred, but became a member of a team, asking probing questions to guide students to find
answers independently.
One of the early models dealing with instructors’ roles in online education was put forth
by Berge. He developed the Instructor’s Roles Model in 1995 and identified the online
instructor’s roles in four areas (pedagogical, social, managerial, and technical). The pedagogical
role mainly focused on facilitating effective learning, keeping the discussion on track,
contributing insights, and maintaining group harmony (Berge, 1995; Berge, 2008). The
pedagogical role was ranked as the top one among eight comprehensive roles by a group of
experts with multicultural backgrounds in a study conducted by Bawane and Spector (2009).
Social role dealt with creating a friendly social environment for online learners to promote
human relationships, develop group cohesiveness, maintain the group as a whole and help team
members to achieve the success of any online learning activities (Guasch, Alvarez, & Espasa,
2010; Major, 2010). The managerial role involved all the work related to agenda setting,
objective setting, procedural rules making, decision making, and interaction managing (Guasch
et al., 2010). Sometimes, the managerial role was tied to establishing rules and regulations to
function as the administration role (Bawane & Spector, 2009). The technical role was expected
to ensure the technology (hardware and software) was accessible to online learners and provide
help when learners needed it. However, most of the technical issues were handled by technology
support specialist or staff in many universities as online education expand rapidly and grow
64
maturely. Some functions and roles overlapped or could be placed in more than one category
because they were not always neatly fit into one in teaching practice. These roles were defined
within the online discussion context and were suggested at a time when online education just
grew up. Therefore, changes in the roles for this model were needed to update and reflect the
current needs. Berge (2008) advocated making changes in his model to focus more on “informal,
collaborative, reflective learning, with user-generated content” (p.412).
Researchers used Berge’s finding guiding different studies with various approaches and
populations (Coppola, Hiltz & Rotter, 2002; Klein, Spector, Grabbowski, & De la Teja, 2004;
Martin, Wang, & Sadaf, 2018; Oyarzun, Martin, & Moore, 2020; Williams, 2003). However,
researchers explored other necessary faculty roles that students perceived as significant in an
online learning environment. For example, Alvarez et al. (2009) reviewed existing studies via
several databases (ERIC, ICYT, and ISOC) and summarized five categories of instructor’s role:
planning and design role, social role, cognitive role, technical role, and managerial role. The
cognitive role was first addressed in focusing on dealing with mental processes in terms of
learning, perception, information storage, memory, critical thinking, and problem-solving skills.
A list of competencies for each faculty role category was discussed and included in the study to
guide teacher training directions. Moreover, Lee (2011) collected responses via a survey from
384 university students in Korea and found five instructor’s roles, namely pedagogical,
managerial, technical, affective, and differentiating roles, were perceived as critical in a
multicultural online learning environment. It’s worth noting that affective differentiating roles
were not addressed in previous research. They were rated as important as pedagogical,
managerial, and technical roles by participants in Lee’s study. The affective role stressed the
relationship between instructors and students, which appeared like the social role in Berge’s
65
model. While the differentiating role focused on adopting multiple strategies to teach students
with different abilities and interests to help them achieve their learning goals.
Sfard (1998) identified two different models (acquisition model and participation model)
to examine the instructor’s changing role from knowledge dispenser to facilitator through the use
of information technology. Acquiring pre-specified knowledge and developing an understanding
of predetermined concepts were the two main foci in the acquisition model. Therefore, the
primary role of an instructor in this model was to deliver, suggest, and clarify concepts. On the
other hand, learning through interaction and student-centered was seen as the core value in the
participation model. Instructors were described as facilitators, mentors, expert participants, and
guardians of practice/discourse.
Except for the roles aforementioned, additional peripheral roles were highly considered
by instructors for quality teaching. Table 1 presented online instructor roles as suggested in the
literature. This table was adapted from Bawane and Spector’s (2009) study, a literature review of
online instructor roles (Muñoz-Carril, González-Sanmamed, and Hernández-Sellés, 2013), and
other studies focusing on faculty roles in online teaching practice (Baran et al., 2011; Chang et
al., 2014; Lee, 2011).
Table 1. Summary of the Existing Literature Studies on the Roles of Faculty in Online Education
Studies Roles
Chang et al., 2014 Content expert, instructional designer, learning assessor,
administrative manager
Lee, 2011 Pedagogical, managerial, technical, affective, differentiating
Guasch et al., 2010 Design/planning, social, instructive, technological, managerial
66
Bawane & Spector, 2009 Professional, pedagogical, social, evaluator, administrator,
technologist, advisor/counselor, researcher
Berge, 2008 Pedagogical, social, managerial, technical
Varvel, 2007 Administrative, personal, technological, instructional design,
pedagogical, assessment, social roles
Marcelo, 2006
Advisor, counselor, tutor, designer-planner/instructional
designer/organizer, manager/administrator/administrative
manager, course manager, technological expert/technologist
Aydin, 2005
Content expert, process facilitator, instructional designer,
advisor/counselor, technologist, assessor, material producer,
administrator
Egan & Akdere, 2005
Designer-planner/instructional designer/organizer, evaluator/
assessor/evaluation specialist, facilitator/site facilitator-
proctor/process facilitator, graphic designer, direct instructor/
Instructor/instructor-facilitator/pedagogical, leader/change
agent, librarian, manager/administrator/administrative manager,
course manager, media publisher, editor, systems expert,
technician, technological expert/technologist, trainer
Salmon, 2004
Knowledgeable about online processes, content expert,
interpersonal communicator/communicator, personal (personal
qualities and characteristics), technological expert/technologist
Williams, 2003
Administrative manager, instructor/facilitator, instructional
designer, trainer, leader/change agent, technology expert,
graphic designer, media publisher/editor, technician, support
staff, librarian, evaluation specialist, site facilitator/proctor
Coppola et al., 2002 Cognitive, affective, managerial
67
Anderson et al., 2001 Instructional design, facilitating discourse, direct instruction
Goodyear et al., 2001 Process facilitator, advisor/counselor, assessor, researcher,
content facilitator, technologist, designer,
manager/administrator
Salmon, 2000 Knowledgeable about online processes, content expert,
interpersonal communicator/communicator, personal (personal
qualities and characteristics), technological expert/technologist
Wiesenberg & Hutton,
1996
Direct instructor/instructor/instructor-facilitator/pedagogical,
manager/administrator/administrative manager, course
manager, social/discourse facilitator, technological
expert/technologist
Berge, 1995 Pedagogical, social, managerial, technical
Thach & Murphy, 1995
Designer-planner/instructional designer/organizer,
evaluator/assessor/evaluation specialist, facilitator/site
facilitator-proctor/process facilitator, graphic designer, direct
instructor/instructor/instructor-facilitator/pedagogical, librarian,
manager/administrator/administrative manager, course
manager, media publisher, editor, support staff, technician,
technological expert/technologist
Several aspects of instruction, including assessment strategies, course content,
communication, methods, interaction, and teacher roles, all had been changed because of online
education (Burkle & Cleveland-Innes, 2013; Chang et al., 2014; Johnson & Meehan, 2013).
Online education presented many opportunities and challenges for instructors. Adapting to new
roles had been cited as one challenge for instructors to transit from traditional brick and mortar
classrooms to online teaching (Allison, 2015; Holly, Legg, Mueller, & Adelman, 2008). While
some instructors welcomed this challenge in online teaching, some felt lost and uncertain about
68
how to support students in an online learning environment. Literature is abundant regarding the
secret of success in teaching online but a relative paucity of research deeply exploring
instructor’s perceptions about their roles in the online context.
There were 277 instructors from 20 universities in Taiwan with experience in teaching
online courses that had been surveyed (Chang et al., 2014). Change et al. (2014) explored the
perceptions of these e-instructors towards their roles in online teaching activities. They found
that “content expertise” and “instruction designer” were considered as the most important two
roles of e-instructors. Moreover, “learning assessor” and “administrative manager” were rated as
the third and fourth most important role. Interestingly, they found gender made significant
differences in instructor’s perception toward the roles in online instruction. Female instructors
held a more positive attitude than males toward their online teaching roles. However, from the
quantitative results of this study, no significant differences were found among the participants
with different rank, experiences, and training support. In other words, ranks, length of teaching
experiences, and training support did not affect the instructor’s perception of their roles in online
instruction.
Roles of MOOC Instructors
Studies of instructors’ roles in the MOOC environment derived from traditional online
courses. Early research of online learning focused on student achievement and outcomes (Dell,
Low, & Wilker, 2010; Jahng, Krug, & Zhang, 2007; Lei, 2010), and dynamic interaction (Cho &
Kim, 2013; He, 2013; Zimmerman, 2012). As MOOCs emerged, the role and responsibility of an
instructor for engaging learners in MOOCs continued to be questioned as to the instructor’s role
in MOOCs differed from the regular online learning environment (Haavind & Sistek-Chandler,
69
2015). Empirical research regarding instructors’ roles in MOOCs was relatively scarce compared
to their counterparts in other modalities.
Each MOOC type served a different purpose regardless of a variety of classifications that
had emerged to describe MOOCs. Existing studies of teacher typology were discussed mostly in
cMOOC and xMOOC as these two MOOC modalities represented the primary forms of the
current MOOC practice. The core value of cMOOC was embodied in the student-centered
pedagogy, advocating facilitating student’s self-directed learning and offering more opportunities
for students to connect (Barnard-Brak et al., 2010; Daniel, 2012; Horn, 2013; Joksimović,
Dowell, Poquet, Kovanović, Gašević, Dawson, & Graesser, 2018; Lewin, 2012; Rodriguez,
2012; Zhang, 2012). The instructor’s role in cMOOC was highly interactive, even if the contact
between the instructor and student was low and indirect (Haavind & Sistek-Chandler, 2015). The
instructor in cMOOC was expected to instruct less and facilitate and guide students through self-
directed learning. A few empirical studies interviewed MOOC instructors and investigated their
perceptions of their roles in cMOOC (Haavind & Sistek-Chandler, 2015). Ultimately, terms such
as “captain of a ship” and “working on a nest in a forest” had been used by interviewees to
describe their instructor experience in cMOOC.
While the goal of xMOOC was set mainly to deliver content and broadcast, which
emphasized in lecture-centered (Bates, 2012; Barnard-Brak et al., 2010; Conole, 2015; Horn,
2013; Lewin, 2012; Roscorla, 2012; Siemens, 2012). Therefore, the instructor’s role in the
xMOOC was more like a designer and content producer (Haavind & Sistek-Chandler, 2015),
which differed from that of a traditional online course instructor. “Distant academic celebrity”
(Ross, Sinclair, Knox, Bayne, & Macleod, 2014, p. 60) and “actor-producer” (Rodriguez, 2012,
p.7) were two cited examples to describe instructor’s roles in xMOOC by researchers.
70
Conceptual Framework
A compilation of two theories formed a conceptual framework by which faculty
participation in MOOC could be analyzed. Deci and Ryan’s (1985) Theory of Self-
Determination provided a great perspective for understanding how intrinsic and extrinsic factors
affected human being’s motivation to engage in activities. Berge’s (1995) Instructor’s Roles
Model provided a framework to examine the roles that instructors performed in different stages
of teaching practice in the context of MOOC. Each of these theories was leveraged to develop a
conceptual framework for gaining a better understanding of MOOC instructors’ teaching
experience in this study.
Self-Determination Theory
Self-Determination Theory (SDT) had been one of the predominant motivational theories
since its formal introduction made by Dr. Edward Deci and Dr. Richard Ryan in 1985. SDT
espoused that human beings were intrinsically motivated to engage in activities that would
satisfy innate psychological needs under specific conditions. SDT was specifically developed to
look at how and what social-contextual factors facilitated or undermined human being’s intrinsic
motivation (Ryan & Deci, 2000).
Autonomy, competence, and relatedness were the three basic psychological needs SDT
identified as influencing human beings' health and well-being (Ryan & Deci, 2017). Autonomy
described a perceived locus of control over the process of making choices. Competence
described a perceived capacity to effectively complete tasks and manage the environment.
Relatedness described the sense of belongingness and connectedness to significant others, social
groups, culture, and community (Ryan & Deci, 2000; Ryan, 1995). An example of relatedness
would be the perceived sense or feeling of acceptance by faculty who participated in online
71
education when recognized by peers, colleagues, and the institution. These three needs were
regarded as universal for the development of self-determined motivational behaviors and were
observed in individuals from different cultures (Ryan & Deci, 2017). SDT asserted that the
satisfaction of the three basic psychological needs would facilitate intrinsic motivation and
promote the internalization of extrinsic motivation (Ryan & Deci, 2000; Ryan & Deci, 2017).
There were six mini-theories developed within SDT: Cognitive Evaluation Theory
(CET), Organismic Integration Theory (OIT), Causality Orientations Theory (COT), Basic
Psychological Needs (BPN), Goal Contents Theory (GCT), and Relationships Motivation Theory
(RMT). Among them, CET exclusively focused on intrinsic motivation and OIT addressed
extrinsic motivation. Consequently, these two mini-theories could be used as the basis for
guiding the present study.
Intrinsic motivation. The concept of intrinsic motivation was addressed in the Cognitive
Evaluation Theory (CET) which was a sub-theory of the Self-Determination Theory. CET was
primarily concerned with how social and environmental factors (e.g., rewards, evaluations, or
feedback) influenced intrinsic motivation (Ryan & Deci, 2017). Initially, scholars struggled to
reach consensus in defining intrinsic motivation as a result of two dominant and competing
behavioral theories in the field of psychology between 1940 and 1960: Learning Theory &
Operant Theory. The Learning Theory (Hull, 1943) posited that all human behavior was
motivated by their innate psychological needs. As a result, researchers defined intrinsic
motivation as the innate satisfaction of gratifying individual psychological drives. While, the
Operant Theory (Skinner, 1953) maintained that all human behavior was motivated by external
rewards. Therefore, Skinner defined intrinsic motivation as an activity being interesting because
the reward was in the activity itself. Given that Ryan and Deci (2000) focused primarily on
72
human psychological needs, they defined intrinsic motivation as “the doing of an activity for its
inherent satisfactions rather than for some separable consequence” (p. 56).
It had been found that the intrinsic motivation of human beings increased when their
basic psychological needs were satisfied (Deci & Ryan, 2000; Ryan, 1995). Within the area of
Cognitive Evaluation Theory (CET), Ryan and Deci reviewed a substantial number of studies
and laboratory experiments. As a result, they pointed out several social and environmental
factors that promoted or detracted from the intrinsic motivation of people. For example, it was
found that competence accompanied by autonomy facilitated intrinsic motivation, and that
intrinsic motivation was enhanced by positive performance feedback. It was further found that
choice and the opportunity for self-direction appeared to have an impact on intrinsic motivation
as well. By comparison, it was claimed that extrinsic rewards, such as tangible rewards, threats,
deadlines, directives, and competition pressure, could diminish intrinsic motivation because
these factors would shift a person’s perceived autonomy from internal to external.
Ryan and Deci (2000) noted that different levels of motivation were developed through a
specific process that fell along a continuum of regulations ranging from controlled to
autonomous (see Figure 3). The transformation process of going from a regulation that was
driven by external factors to a completely autonomous internal regulation was theorized as being
that of Internalization and Integration.
73
Figure 3. Self-Determination Theory. Adapted from “Intrinsic and Extrinsic Motivations: Classic
Definitions and New Directions” by Ryan & Deci, 2000, Contemporary educational psychology,
25, p.61.
Based on degrees of autonomy or self-determination, Ryan and Deci (2000) grouped
three types of motivation (amotivation, extrinsic motivation, and intrinsic motivation) into two
categories: controlled motivation and autonomous motivation. Not a surprise, the graph depicts
intrinsic motivation as being the most autonomous of the three.
Extrinsic motivation. As another major construct within Self-Determination Theory
(SDT), Organismic Integration Theory (OIT) primarily focused on extrinsic motivation. Whereas
intrinsically motivated people were governed by personal interest, it was found that extrinsically
motivated behaviors were directed by external incentives. People were extrinsically motivated to
engage in an activity because of the incentives’ instrumental value and obtain additional
outcomes (Ryan & Deci, 2000).
74
Ryan and Deci (2000) found that extrinsic motivation varied greatly based on the degree
of autonomy. Therefore, they divided extrinsic motivation into four major types of motivational
regulation: external, introjection, identification, and integration.
First, external regulation was identified as being the least autonomous type of extrinsic
motivation. At this level, human behaviors were perceived as being ‘controlled’ because they
were dependent on external contingency (e.g., reward or punishment). The control power of
rewards and punishments placed on people's behavior resulted in two major problems of external
regulation: ineffectiveness and lack of maintenance. Individuals would participate in activities
and sustained their behaviors overtime only when the contingency was in place (Ryan & Deci,
2000; Ryan & Deci, 2017).
Second, although introjection regulation was seen as being barely autonomous, in terms
of the degree to act with self-determination, it was more autonomous than external regulation.
OIT suggested that efforts to avoid a sense of guilt or to maintain a feeling of approval were the
major reasons for individuals to take action in activities at this level (Ryan & Deci, 2000; Ryan
& Deci, 2017).
Third, identification regulation was characterized as having more autonomy than either
external or introjection regulation. People performed acts at this level because they realized the
value and importance of actions that would help them progress toward their ultimate goals (Ryan
& Deci, 2000; Ryan & Deci, 2017).
Fourth, integration regulation was the last type of extrinsic motivation identified and the
one found to be the most autonomous within OIT. With this type of motivation, individuals saw
the connection between psychological needs, values, identifications, and activities. People used
high-order reflection to conduct self-examinations and to bring new values into congruence with
75
other needs in order to internalize their reasons for actions. This regulation remained an extrinsic
motivation because the reasons for the activity were based on presumed instrumental value, and
the outcomes of the behaviors were separated from the behavior itself (Ryan & Deci, 2000; Ryan
& Deci, 2017).
Depending on an individual’s prior experience and situational factors, people didn’t need
to go through each stage of internalization according to the continuum. Ryan and Connell (1989)
found that an inter-correlated relationship existed among these four types of regulations that to a
large extent served to provide the evidence necessary for explaining the control-autonomy
continuum. The theory of self-determination has been applied to different domains (e.g.,
education, business, athletics, health care, and religion) in order to analyze the issue of human
needs, as well as to gain a better understanding concerning the central issue of people’s
behaviors as motivation.
Instructor’s Roles Model
Instructor’s Roles Model, put forth by Zane L. Berge (1995), was one of the early models
dealing with instructor’s roles in online education. This model was initially developed to identify
the roles and functions of the online instructors in the context of computer conferencing,
particularly for online discussion in Berge’s (1995) study. Berge’s model categorized teacher
roles into four areas (pedagogical, social, managerial, and technical) when they facilitate online
discussions (see Figure 4).
76
Figure 4. Instructor’s Roles Model by Berge (2008, p. 409)
Pedagogical role. The pedagogical role mainly revolved around facilitating effective
learning, keeping the discussion on track, contributing insights, and maintaining group harmony
(Berge, 2008). The pedagogical role was ranked as the top one among eight comprehensive roles
by a group of experts with multicultural backgrounds in a recent study conducted by Bawane and
Spector (2009).
Social role. Social role dealt with creating a friendly social environment for online
learners to promote human relationships, develop group cohesiveness, maintain the group as a
whole and help team members to achieve the success of any online learning activities (Guasch et
al., 2010; Major, 2010; Tang, Wang, Qian, & Peck, 2016).
77
Managerial role. The managerial role involved all the work related to agenda setting,
objective setting, procedural rules making, decision making, and interaction managing (Guasch
et al., 2010; Tang, Wang, Qian, & Peck, 2016). Sometimes, the managerial role was tied to
establish rules and regulations to function as the administration role (Bawane & Spector, 2009).
Technical role. The technical role was expected to ensure the technology (hardware and
software) was accessible to online learners and provide help when learners need. However,
technology support specialist or staff in many universities handled most of the technical issues as
online education grew maturely and expanded rapidly (Berge, 2008).
Some functions and roles in this model overlapped or could be placed in more than one
category because they were not always neatly fit into one in teaching practice. These roles were
defined within the online discussion context and were suggested at a time when online education
just grew up. Therefore, changes in the roles for this model were needed to update and reflect the
current needs. Berge advocates making changes in his model to focus more on “informal,
collaborative, reflective learning, with user-generated content” (Berge, 2008, p.412).
The instructor’s roles model was founded based on Berge’s research experience and other
scholars’ work (Gulley, 1968; Hyman, 1980; Mason, 1991). They all acknowledged the fact that
instructors performed pedagogical, social, and managerial roles in various ways when they
taught online. Whereas, Berge added the fourth one “technical role” in his model as he found the
instructor role tied closely with technology integration in an online learning environment. He
advocated that the use of technology was secondary in the process of developing and delivering
online instruction.
Although some researchers pointed out that Berge’s roles model failed to link the
instructor’s roles to defined competencies (Feeler, 2012; Parker, 2014), Berge’s model had been
78
widely applied to a myriad of empirical studies to identify faculty perceptions and experiences in
terms of their roles in the development of online instruction as well as provide guidance
regarding facilitation skills for online courses. This model had set a foundation for future
research to look at the online instructor’s competencies in higher education and pave a path to
reshape the instructor’s roles in online teaching and learning compared to the traditional teaching
modality.
Summary
The rise of MOOCs reshaped online teaching. Although MOOCs’ potential and MOOC
learners’ experience had been widely discussed, there remained a paucity of empirical studies on
investigating MOOC instructors’ teaching experiences in MOOCs. Chapter Two reviewed
literature including an overview of MOOC, MOOC experiences, MOOC issues, motivating
factors for participation in online education and MOOCs, instructor’s roles in online education
and MOOCs, and the conceptual framework used to guide this study. In Chapter Three, a review
of the methodology used in this study was included along with a detailed description of the
research design. Both the participants and context were addressed with a sampling plan. Data
collection, including procedures for the survey instrument and interview protocol, was explained.
Data analysis procedures were outlined with details for each of the data types. Rigor measures,
including validity, reliability, dependability, credibility, transferability, and confirmability were
discussed.
79
CHAPTER 3. METHODOLOGY
This mixed methods study focused on MOOC instructors’ experiences. A convergent
parallel research design was employed, and it’s a type of design in which quantitative and
qualitative data were collected in parallel, analyzed separately, and then merged at the
interpretation stage. In this study, a web-based survey and semi-structured interviews were used
to identify the intrinsic and extrinsic motivators that influenced MOOC instructors to teach a
MOOC, understand the nature of roles performed in teaching MOOCs, and to learn more about
the lessons MOOC instructors received from the MOOC teaching experience. Collecting both
quantitative and qualitative data helped the researcher bring greater insights into the research
problem than eliciting information through either type of data separately (Creswell and Plano
Clark, 2007). This chapter reviewed the research questions and described the research
methodology, including the research paradigm, participants and context, instrumentation and
procedures, data collection and analysis, and strategies to ensure rigor in both quantitative and
qualitative strands.
Research Questions
The goal of the study was to explore the experiences of higher education faculty members
who had previously taught a MOOC or who were currently teaching a MOOC via edX or
Coursera from 2013 to 2017. The following research questions were addressed in this study.
Research Questions for Quantitative Phase
1. What intrinsic factors motivate higher education faculty to teach a MOOC?
2. What extrinsic factors motivate higher education faculty to teach a MOOC?
3. What are faculty experiences teaching a MOOC?
Research Questions for Qualitative Phase
80
1. How do higher education faculty describe their decision-making process in terms of
participating in MOOC?
2. What are the roles and experiences higher education faculty encounter in delivering a
MOOC?
3. What lessons have higher education faculty learned through the experience of
teaching a MOOC?
Research Design
A convergent parallel mixed methods research design was used in this study. Creswell
and Plano Clark (2007) defined mixed methods research as:
“Mixed methods research is a research design with philosophical assumptions as well as
methods of inquiry. As a methodology, it involves philosophical assumptions that guide
the direction of the collection and analysis and the mixture of qualitative and quantitative
approaches in many phases of the research process. As a method, it focuses on collecting,
analyzing, and mixing both quantitative and qualitative data in a single study or series of
studies. Its central premise is that the use of quantitative and qualitative approaches, in
combination, provides a better understanding of research problems than either approach
alone (p.5).”
The mixed methods approach was grounded in psychology and was widely used by
researchers in the late 1980s because they recognized the limitations of single methods brought
to the study and the biases caused by these limitations (Creswell & Plano Clark, 2010). The
mixed methods research approach incorporated many of the strengths of the two main research
paradigms (i.e., quantitative and qualitative) to address complex social inquiries in diverse areas
of social science, including health, education, nursing, sociology, and immigration (Hudson,
81
2013). Creswell and Plano Clark (2007) stated that the blended design of quantitative and
qualitative strands could help better understand a research problem than either approach alone.
The rationale for the utilization of mixed methods research included: a) its capability of
providing answers to research questions that the other methods cannot supply, b) its capability to
make stronger inferences and c) its capability to present a greater diversity of divergent views
(Creswell & Plano Clark, 2010). The advantages of the mixed methods design had been widely
discussed and well-documented in the literature (Collins & O’Cathain, 2009; Symonds &
Gorard, 2010).
The rationale behind employing a mixed methods approach for this study was threefold.
First, the research of MOOC instructors’ experiences was a complex phenomenon in social
science affected by a multitude of factors. The quantitative or qualitative method might not
thoroughly examine the problem and answer the research questions. A mixed methods approach
provided strengths that could make up for the weakness of using one approach alone (Creswell
and Plano Clark, 2007). Second, with the complexity of the research problem addressed,
different points of view toward this phenomenon were needed for the analysis and interpretation.
Mixed method research advocated “the use of multiple worldviews or paradigms (i.e., beliefs and
values) rather than the typical association of certain paradigm with quantitative research and
others for qualitative research (Creswell and Plano Clark, 2007, p.13).” Diversity of divergent
views were approached by using the combination of two different research paradigms. Finally,
the quantitative method was to generalize from the sample in its nature. While the qualitative
method tended not to do so but to develop an in-depth understanding of a small number of
people. The inferences made from two different methods converged were stronger than using
either one alone.
82
Creswell and Plano Clark (2011) classified mixed methods research into six types:
convergent parallel design, explanatory sequential design, exploratory sequential design,
embedded design, transformative design, and multiphase design (see Table 2).
Table 2. Summary of Six Types of Mixed Methods Research Design
Type of
Design
Purpose Priority of the
Strands
Data Collection Data
Analysis
Convergent
Design
To corroborate,
compare or relate
two sets of findings
of a topic
Equal emphasis One phase,
concurrent
Merging
analysis
Explanatory
Design
To explain
quantitative results
Quantitative
emphasis
Two distinct
phases
Sequential
analysis
Exploratory
Design
To test or measure
qualitative
exploratory
findings
Qualitative
emphasis
Two distinct
phases
Sequential
analysis
Embedded
Design
To gain a more
complete
understanding of an
experimental trial
Either quantitative
or qualitative
emphasis
Either concurrent
or sequential
Merging
or
sequential
analysis
Transformative
Design
To identify and
challenge social
injustices
Equal, quantitative
or qualitative
emphasis
Either concurrent
or sequential
Merging
or
sequential
analysis
Multiphase
Design
To implement
multiple phases to
Equal emphasis Multiphase
combination
Merging
or
83
address a program
objective
sequential
analysis
Convergent Parallel Research Design
This study adopted a convergent parallel design to acquire complementary quantitative
and qualitative data with equal weight (i.e., the same level of priority) on the same topic to
produce a more thorough and in-depth understanding of higher education faculty members’
teaching experiences in MOOCs. The convergent parallel design had been called by other names,
such as simultaneous triangulation (Morse, 1991), parallel study (Tashakkori & Teddlie, 1998),
convergence model (Creswell, 1999), and concurrent triangulation (Creswell, Plano Clark, et al.,
2003). It had been widely used across different disciplines such as education, social science,
psychology, business, and nursing (Creswell & Plano Clark, 2010). This research design aimed
at corroborating, comparing, or relating two sets of data through collecting quantitative and
qualitative data concurrently during the same phase of the research. As shown in Figure 5, the
results from quantitative and qualitative strands were compared to determine convergence,
divergence, or a combination of the two. An overall interpretation was made based on the
completion of the analysis.
84
Figure 5. Prototypical Version of the Convergent Parallel Design. Adapted from “Designing and
Conducting Mixed Methods Research” by Creswell & Plano Clark, 2010, p. 250.
Participants and Context
The target population for the quantitative phase in this study was all MOOC instructors
who were currently teaching or had previously taught a MOOC from 2013 to 2017 via edX or
Coursera in the following subject areas (edX: Computer Science, Business and Management,
Engineering, Social Sciences, Humanities, Science, Data Analysis and Statistics, Economics and
Finance, Biology and Life Science, and Physics; Coursera: Arts and Humanities, Business,
Computer Science, Data Science, Life Sciences, Math and Logic, Personal Development,
Physical Science and Engineering, Social Sciences, and Language Learning). These subjects or
categories ranked as the top disciplines that provided the largest number of course offerings on
edX or Coursera (two primary MOOC providers in the United States with a massive number of
enrolles from all over the world).
A criterion sampling strategy was used to draw the samples. The samples were taken
from those who were currently affiliated with a higher education institution and spoke English.
Email was the primary means to reach out to these potential participants. Based on the
information on the websites of edX and Coursera, the researcher generated a list containing all
eligible participants’ names, email addresses, institutions, position titles, and other pertinent
information.
85
While for the qualitative phase, prospective interviewees (from the same pool of the
target population) who had the knowledge and experience to provide information about the area
being studied and with all characteristics needed for the nature of this study were considered.
Criteria for selecting the interviewees included: 1) the willingness to participate in the interview;
2) ability to speak English; 3) currently teaching or had taught a MOOC via edX or Coursera; 4)
MOOC taught by him/her was delivered in English; 5) currently affiliated with a higher
education institution. The researcher gave priority to those who were currently teaching a MOOC
via edX or Coursera in 2017 because these MOOC instructors might have a fresh memory than
those who taught in early years.
IRB approval (see Appendix A) was obtained from the Institutional Review Board of the
University of Hawaiʻi at Mānoa prior to the recruitment of participants for this study. Potential
participants for quantitative and qualitative phases were reached out by recruitment emails (see
Appendix B) based on the list of names and email addresses the researcher compiled. The
recruitment email clearly stated the purpose of the study and provided instructions on how to
participate. The researcher created two consent forms (see Appendix C) for both quantitative and
qualitative strands. For the quantitative phase, the consent form was shared and embedded in the
landing page of the web-based survey. For the qualitative phase, the consent form was sent via
email to the interested interviewees ahead of the interviews asking them to sign and return the
digital form to the researcher before or on the scheduled interview date. The consent form for
interviewees outlining the purpose of the study, time commitment, benefits and risks, as well as
confidentiality and privacy terms. Interested individuals’ participation for both strands was on a
completely voluntary basis in this study.
86
Instrumentation and Procedures
The instruments for collecting responses from survey participants and interviewees were
a web-based survey and semi-structured interviews. Items in the web-based survey were drawn
from the work of previous studies and adapted to the purpose and scope of this research. An
interview protocol (Appendix F) was developed and used to guide all interviews.
Quantitative Instrument
A web-based survey enabled a researcher to reach out to thousands of potential
participants located in different geographical regions in a short amount of time (Taylor, 2000;
Yun & Trumbo, 2000), helped a researcher save time on collecting data (Llieva, Baron, &
Healey, 2002), and reduced the cost compared to a traditional paper and pencil survey (Couper,
2000; Llieva et al., 2002; Yun & Trumbo, 2000). Survey items in this study were synthesized
and adapted based on two pre-developed instruments from the works of Dr. Kristen Betts (1998)
and Drs. Suzannah Evans and Jessica Gall Myrick (2015). Dr. Betts created a survey for her
dissertation study at George Washington University, aiming to elicit information from faculty
and administrators concerning what factors motivate and inhibit faculty participation in distance
education. Her instrument encompassed four sections: demographic, distance education
background, faculty self-assessment, and faculty response. A variety of studies used Dr. Betts’
survey to identify the motivators and inhibitors of faculty participation in distance education
(Adams, 2016; Ball, 2013; Baker, 2020; Collins, Weber, & Zambrano; DiSanto & Guevara,
2019; Hoffman, 2013; Hunt, Davis, Richardson, Hammock, Akins, & Russ, 2014; Mamun,
Danaher, & Rahman, 2015; Pinkerton, 2008; Schopieray, 2006; Schroeder, 2008; Song, 2019;
Stevenson, 2007; Walters, Grover, Turner, & Alexander, 2017; Windes & Lesht, 2014). Given
the MOOC context, questions were modified to fit the theme.
87
The second instrument was developed by Drs. Evans and Myrick in a 2015 published
journal article entitled How MOOC instructors view the pedagogy and purpose of massive open
online courses. They looked at the instructors’ perceptions of MOOCs, their beliefs, satisfaction,
and experiences. Permissions (see Appendix D) were obtained from Drs. Betts, Evans, and
Myrick via email to use and adapt their questions from the two instruments aforementioned. The
web-based survey (see Appendix E) used for this study included five sections: introduction,
teaching background, MOOC background, self-assessment, and demographic.
Section I: Introduction. Section one provided an overview of the study (e.g., purpose,
type of questions, time needed for completion, researcher’s contact, etc.) and a consent form.
Section II: Teaching Background. Section two included five questions investigating the
participant’s previous teaching experience in postsecondary education with a focus on online
education.
Section III: MOOC Background. This section aimed to collect information from
participants understanding their previous MOOC teaching experiences. Thirteen items in this
section were drawn from the instrument developed by Drs. Evans and Myrick in a study focusing
on the MOOC instructor’s perceptions of MOOCs.
Section IV: Self-Assessment. This section was completely pulled from Dr. Betts’ survey
(section III, part 1) and was modified accordingly to fit the context of MOOC. The information
yielded from this part helped the researcher gain insights into the intrinsic and extrinsic
motivators that affected faculty participation in MOOC teaching. The original survey from Dr.
Betts was comprised of two parts with 53 variables on a five-point Likert Scale basis (‘1’
representing maximum disagreement and ‘5’ indicating maximum agreement). The first part with
34 items (9 intrinsic factors, 21 extrinsic factors, and 4 unidentified factors) focused on
88
motivating factors. The second part with 19 items focused on inhibiting factors that were not
considered and included in this study. Given the purpose and scale of this study, only part one of
Dr. Betts’s instrument was adopted in this study. The researcher measured intrinsic motivators
using the 9 variables from Dr. Betts’ survey and 3 additional ones derived from a synthesis of
previous studies. Twenty-three extrinsic motivators were drawn directly from Dr. Betts’ survey.
Section V: Demographics. Section five focused on the participant’s demographic data,
such as gender, age, ethnicity, and etc.
A Cronbach’s alpha reliability coefficient showed the internal consistency for the entire
survey was .82 with the values for individual sections on intrinsic and extrinsic motivators and
beliefs about fully online courses equalled to .92 and .78 respectively.
Qualitative Instrument
The qualitative data was collected through semi-structured interviews that were widely
used as they offered greater opportunities for the researcher to explore a broader range of topics
than structured interviews (Hawkins, 2011; Heyl, 2001; Watson, 2014) and they were good for
interviewees to openly share their insights (Esterberg, 2002; Schopieray, 2006). The semi-
structured interview included sixteen open-ended questions developed based on previous studies
and literature. An interview protocol (see Appendix F) was developed and reviewed by the
researcher’s committee. Necessary adjustments to the interview protocol were made after the
committee’s review. Interviewees were encouraged to share their stories, experiences, opinions,
or anything related to their teaching in MOOCs through the interviews. Given the semi-
structured nature, the researcher had the opportunity to ask probing questions for seeking
clarification as needed.
89
Table 3 (see below) outlined the relationships among the research questions, instruments,
survey questions, and sources.
Table 3. Alignment of Research Questions and Instruments
Research Questions
(Quantitative Strand)
Instruments Items/Questions Source/Original
Authors
RQ1: What intrinsic factors
motivate higher education
faculty to teach a MOOC?
A web-based
survey
Question #19 Dr. Bett
1998
RQ2: What extrinsic factors
motivate higher education
faculty to teach a MOOC?
A web-based
survey
Question #19 Dr. Bett
1998
RQ3: What are faculty
experiences teaching a MOOC?
A web-based
survey
Question #6 to #18 Drs. Evans &
Myrich,
2015
Research Questions
(Qualitative Strand)
RQ1: How do higher education
faculty describe their decision-
making process in terms of
participating in MOOC?
Semi-structured
Interviews
Question #3 to #5 Previous studies
RQ2: What are the roles and
experiences higher education
faculty encounter in delivering
a MOOC?
Semi-structured
Interviews
Question #1 to #2
Question #6 to #11
Previous studies
RQ3: What lessons have higher
education faculty learned
through the experience of
teaching a MOOC?
Semi-structured
Interviews
Question #12 to #15 Previous studies
90
Data Collection
This study adopted the convergent parallel design that was designed for collecting
quantitative and qualitative data concurrently with equal priority given to both strands. A
research protocol was submitted and approved by the Institutional Review Board of the
University of Hawaii (UH IRB) prior to the data collection.
Quantitative Phase
The researcher generated a list including prospective MOOC instructors’ names, email
addresses, institutions, position titles, and so forth. These names were obtained from the websites
of edX or Coursera and were sifted through the criteria aforementioned. The researcher then used
Google to search these names and verify their email addresses one by one.
According to the list, the researcher reached out to all potential participants via email.
The recruitment email stated the purpose of the study and included a brief introduction of the
researcher, a link to the web-based survey, and instructions on how to participate. The web-based
survey remained active for four weeks. The researcher sent out two reminder emails within the
four-week timeframe. The researcher used Google Forms to administer the web-based survey
and stored responses for later analysis.
Qualitative Phase
Data for the qualitative phase was collected concurrently through semi-structured
interviews while quantitative data collection was in process. An interview protocol was
developed including sixteen open-ended questions for interviewees to share their teaching
experiences of MOOCs. The researcher asked some probing questions during the interviews that
helped elicit additional information regarding the topic.
91
Recruitment emails were sent out to all prospective interviewees at the same time when
the open call for survey participants was made. Interviewees were drawn from the same pool of
the target population based on a first-reply-first-picked basis. Once the prospective interviewee
responded to the recruitment email, the researcher would send out a follow-up email inviting to
schedule a time for the interview along with a digital consent form. The consent form explained
to the interviewees about their rights, benefits, and risks. Prospective interviewees were asked to
sign and return the form to the researcher prior to or on the scheduled interview date. Each
interview took about an hour (on average) and was recorded by a video-conferencing tool named
Zoom. The recordings were stored in a secure space for later word-for-word transcription and
analysis. Interviewees’ names, departments, institutions where they were employed, and any
additional identification information were coded for confidentiality. The researcher also took
notes to record non-audible responses and wrote memos based on the interviews and statements
made by the interviewees that might be helpful to the later analysis.
Data Analysis
Quantitative Phase
Responses from the web-based survey were exported from Google Forms and entered
into a statistical analysis software (i.e., SPSS version 22.0) for analysis. All data entry errors or
incomplete data were removed. A codebook was developed to document variables, numbered
responses, definitions, and the names assigned to the variable. The researcher read the data
thoroughly to look for trends and distributions. Descriptive statistics were utilized as the
statistical analysis technique (see Table 4) for data representation. Frequencies and percentages
were determined for categorical variables and reported in tabular format. Means and standard
deviations were used on ordinal and ratio variables.
92
Table 4. Summary of Statistical Analysis Technique
Section Questions Data type Statistical Analysis Technique
Section 2
Teaching Background
Q1-5 Nominal & Ordinal Descriptive statistics
Section 3
MOOC Background
Q6-18 Nominal Descriptive statistics
Section 4
Self-assessment
Q19 Scale Descriptive statistics
Section 5 Demographic Q20-25 Nominal & Ordinal Descriptive statistics
Qualitative Phase
Interview recordings were transcribed and checked for accuracy before being analyzed.
Following a thematic synthesis method developed by Thomas & Harden (2008), the researcher
coded the transcriptions and combined similar codes to develop categories that helped develop
relevant themes. Thomas and Harden’s thematic synthesis included three stages: free line-by-line
coding, the development of free codes into related categories, and the generation of analytic
themes. More specifically, the researcher read the transcriptions line-by-line first and combined
the analytic memos took during the interviews to develop a codebook for initial theme
development. Labels and colors were assigned to different codes. Codes were grouped into
categories and then merged into themes. The researcher used specific quotes from interviewees
to address each theme. Numbers were assigned to each interviewee during the qualitative
analysis to ensure confidentiality. Data interpretation was made based on the discussion of the
qualitative findings, research questions, the conceptual framework, and literature stated in
Chapter 2.
93
Rigor
Rigor in both quantitative and qualitative strands was ensured through the following
techniques in this study.
Validity & Reliability
Validity and reliability are critical to all research. Poor measurement of validity and
reliability can result in ambiguous, inconsistent, and useless data (McMillan & Schumacher,
1989). Rigor for the quantitative phase in this study was addressed in several ways, including the
use of previously developed and published instruments. The reliability and validity of the
instruments had tested with different techniques. For example, Dr. Betts conducted a Delphi
study, several interviews, and pilot tests to ensure the rigor of her instrument. In addition, she
formed a group of educators to reflect on the survey items, definition, instrument direction, and
item consistency to enhance the content validity. Cronbach Alpha was used to measure the
internal consistency in her study. The second instrument used in this study was developed by
Drs. Evans and Myrick, which had no statistical reliability values reported in their study.
However, the researcher emailed Drs. Evans and Myrick and was told that all items in their
instrument were descriptive and the scales in their instrument were developed based on previous
measures.
The items used in the web-based survey were reviewed by the researcher’s committee
chair first and forwarded to the remaining committee members for additional reviews to establish
validity. In an effort to enhance the content validity (Cohen, Manion & Morrison, 2011), the
web-based survey was sent to a group of doctoral students in different disciplines at the
University of Hawaiʻi at Mānoa as an additional measure for collecting insights in terms of the
definitions, directions, item clarity, and etc. The survey was revised based on their feedback and
94
returned to the same group of individuals for the second review before going out to the target
population. Proper revisions were made in response to address the additional feedback received.
Reliability concerned precision and accuracy. It dealt with dependability, consistency,
and replicability over time, instruments, and respondents. There were three major types of
reliability in a quantitative study: stability, equivalence, and internal consistency. Measures of
internal consistency were in two main forms: the split-half technique and the alpha coefficient.
The reliability of the web-based survey instrument in this study was established by using the
alpha coefficient (also called Cronbach’s alpha). Cronbach’s alpha measured the internal
consistency among items. It provided “a coefficient of each item with the sum of all the other
relevant items” (p. 201). It was suggested that an instrument reliability level of .70 or higher was
acceptable (Gall, Gall & Borg, 2003). SPSS was utilized to run the Cronbach’s alpha and
indicated the constructs and overall reliability of the web-based survey.
Dependability, Credibility, Transferability, and Confirmability
While, in qualitative research, different terminology (see Table 5) was suggested by
Lincoln and Guba (1985) to replace “reliability” and “validity” because the nature of knowledge
within the quantitative (rationalistic) paradigm was different from the knowledge in qualitative
(naturalistic) paradigm (Guba & Lincoln, 1981). Hence, the qualitative researchers argued that
the quality of a study in each paradigm should be evaluated by new criteria (Altheide & Johnson,
1998; Davies & Dodd, 2002; Healy & Perry, 2000; Leininger, 1994; Rubin & Rubin, 1995).
Table 5. The Terminology of Rigor in Quantitative and Qualitative Research
Qualitative Approach Quantitative Approach
Dependability Reliability
Credibility Internal Validity
Transferability External Validity
95
Confirmability Objectivity
A parallel term for rigor in the qualitative study, “trustworthiness,” was developed by
Guba and Lincoln (1981), including four elements: dependability, credibility, transferability, and
confirmability. These four approaches had been used as the new criteria and fundamental
standards to evaluate the quality of qualitative inquiry. The concept of dependability, often
compared to the reliability in quantitative research, was based on the assumption of replicability,
and it referred to the stability of the data (Graneheim & Lundman 2004; Tobin & Begley, 2004;
Shah & Corley, 2006; Rolfe, 2006). Credibility meant whether the findings represented the
original views drawn from the perspective of the participant in the research (Graneheim &
Lundman, 2004; Lincoln & Guba, 1985). It could be examined in two processes: whether the
research was conducted believably and whether the credibility was addressed in the research or
not (Houghton, Casey, Shaw, & Murphy, 2013). Transferability discussed the degree to which
the results of the qualitative research could be generalized or transferred to other contexts or
settings (Leininger, 1994). Confirmability, closely linked to dependability, referred to the degree
to which the results could be confirmed or corroborated by others (Baxter & Eyles, 1997;
Houghton, Casey, Shaw, & Murphy, 2013).
Specific methodological strategies were adopted by qualitative researchers to ensure the
“trustworthiness” of the findings. For example, negative case analysis, peer debriefing,
prolonged engagement, persisted observation, audit trails, member checks, structural
corroboration, and referential material adequacy (Guba & Lincoln, 1981; Lincoln & Guba, 1985;
Guba & Lincoln, 1982). In order to achieve greater credibility in the qualitative strand, as semi-
structured interviews were adopted as the primary approach for data collection, the following
strategies (see Table 6) were utilized to enhance the trustworthiness of my study.
96
Table 6. Summary of Techniques Used to Enhance the Trustworthiness of Qualitative Strand
Qualitative (Interview) Techniques
Dependability Code-recode
Credibility Reflexivity (field journal)
Transferability Thick, rich description
The researcher used a code-recode strategy when coding the interview data, left it along
for a few weeks, then recoded and compared the coding results to ensure consistency. Keeping a
reflective journal also helped enhance the credibility and confirmability of the study. Providing a
detailed description of the interviewees and using quotes from them helped increase the
thickness of the data interpretation and providing a rich understanding of the study.
Summary
Chapter Three described the methodology used to achieve the purpose of the study. It
was comprised of the research design, participants and context, instrumentation and procedures,
data collection, data analysis, and rigor. A web-based survey and semi-structured interviews
were employed to solicit information from the target population. The survey instrument was a
compilation of two pre-developed instruments and was grounded in the theoretical framework
and literature review described in Chapter Two.
The results of the study had the potential to provide information for informing
administrative decisions about MOOCs, assisting instructional designers to consider proper
trainings and supporting resources, offering MOOC platforms opportunities to improve the
services, enabling new and veteran MOOC instructors to expand the open and free educational
opportunities to a wide range of learners who were seeking convenient and flexible access to
(free) educational resources.
97
CHAPTER 4. QUANTITATIVE FINDINGS
This chapter described the quantitative findings of this study. It began with demographics
and teaching background of survey participants, followed by descriptive statistics to answer the
three research questions for the quantitative phase.
Quantitative data were collected from July to November in 2018 by administering a web-
based survey, to MOOC instructors who were currently teaching a MOOC or had taught a
MOOC previously via edX or Coursera over the course of 2013-2017. The quantitative data was
analyzed using SPSS, a statistical analysis software. Descriptive statistics and frequencies were
used to identify trends and characteristics of the given datasets. The web-based survey was sent
to a pool of 1,807 MOOC instructors selected from edX and Coursera who met the participating
criteria (see Chapter 3). Of the 1,807 participants who were invited to take part in, 89
respondents completed the survey in its entirety, and one participant provided incomplete data.
Although the 89 survey respondents only represented a small proportion of the target population,
the samples achieved a certain degree of representativeness of the target population in this study
because they matched demographically the previous findings regarding MOOC instructors.
Demographics
Participants were asked to specify their gender, age, ethnicity, educational background,
and academic rank. Table 7 provided the breakdown of survey respondents by demographic
variables and percentages.
Table 7. Demographic Data of Sample Population (N=89)
Demographic Variable % Gender Female 32.6 Male 66.3
98
Other 1.1 Agea 30-39 12.6 40-49 20.7 50-59 32.3 60-69 25.3 70-79 8.0 80 & above 1.1 Ethnicitya Asian 9.3 African American 1.1 Latino 2.3 Caucasian 83.9 Other 3.4 Education Master 13.5 Doctorate 76.4 Professional Degree 10.1 Academic Rank Distinguished, Endowed or University Professor 10.1 Professor (Full Professor) 34.8 Associate Professor 22.5 Assistant Professor 6.7 Instructor 7.9 Lecturer 13.5 Other 4.5
a The total number of responses received for these items was 87.
Of the 89 respondents, two declined to provide demographic information related to age
and ethnicity. Among the respondents, 59 (66.3%) self-identified as male and 29 (32.6%) were
female. One participant (1.1%) selected “Other” to this question. The age of participants ranged
from 30 years old to 80 years, with the average age being 54 years.
There were no respondents who self-identified as being American Indian/Alaska Native or
Native Hawaiian/Pacific Islander. The majority self-identified as Caucasian (N= 73, 83.9%),
99
followed by Asian (N= 8, 9.2%), Latino (N= 2, 2.3%), and African American (N= 1, 1.1%).
Additionally, three (3.4%) respondents selected “Other;” one self-identified as being Agnostic
Catholic, another as being Middle Eastern, and one wrote in “Asian and White.”
The majority of respondents (N= 68, 76.4%) had earned a doctoral degree, while 12
(13.5%) had completed a Master’s degree, and 9 individuals (10.1%) claimed they had a
professional degree, for instance, MD (Doctor of Medicine). Out of 89 respondents, 31 (34.8%)
stated they were full professors, 20 (22.5%) said they were associate professors, 12 (13.5%)
reported as being lecturers, 9 (10.1%) indicated distinguished, endowed or university professors,
7 (7.9%) described themselves as instructors, 6 (6.7%) were assistant professors, and 4 (4.5%)
responded “Other,” for instance, senior teaching fellow or clinical professor.
Teaching Background
Table 8 provided information regarding participants’ teaching background.
Table 8. Participant’s Teaching Background (N=89)
Variable % Years of teaching experience in postsecondary educationa 1 - 10 years 26.2 11 - 20 years 28.6 21 - 30 years 23.8 31 - 40 years 15.5 41 - 50 years 6.0 Level of courses they teachb Undergraduate 12.6 Master 4.6 Doctorate 1.1 Undergraduate, Master, and Doctorate 44.8 Undergraduate and Master 20.7 Master and Doctorate 13.8 Undergraduate and Doctorate 1.1
100
Other 1.1 Previous experience of teaching an online/blended course before MOOC Yes 49.4 No 49.4 Other 1.1 Previous experience of taking an online course Yes 47.2 No 52.8 Previous experience of receiving an online degree/certificatec Yes 15.2 No 84.8 a The total number of responses received for this item was 84.
b The total number of responses received for this item was 87.
c The total number of responses received for this item was 79.
About a quarter of the respondents indicated they had 1-10 years of teaching experience
(N= 22, 26.2%), 11-20 years of experience (N= 24, 28.6%), or 21-30 years of experience (N= 20,
23.8%) in postsecondary education. About 13 MOOC instructors claimed they had more than 30
years but less than 40 years of experience, and only 5 reported having more than 40 years of
teaching experience. Thirty-nine respondents (44.8%) indicated they had taught courses at all
levels: undergraduate, master, and doctorate. Eighteen participants (20.7%) said they taught
undergraduate and master’s. Twelve (13.8%) stated master’s and doctorate courses were the
primary course types they had offered. Eleven participants (12.6%) taught undergraduate courses
only. Four (4.6%) claimed they offered master’s courses only. One respondent (1.1%) identified
doctorate-level, another (1.1%) checked undergraduate and doctorate, and one (1.1%) selected
‘Other’ and indicated “public audiences” as the answer.
When asked about their previous teaching experience in online courses, results were
equally divided with 44 respondents (49.4%), having taught online or blended courses before
101
participating in a MOOC, and 44 respondents (49.4%) with no such experience before joining a
MOOC. One participant (1.1%) selected ‘Other’ and indicated this question was not clear. Forty-
two respondents (47.2%) stated they had taken online courses before, and forty-seven (52.8%)
reported they had not taken any online course. Participants were asked to indicate whether they
received any online degree or certificate in the past. Sixty-seven respondents (84.8%) said they
had not received any online degree or certificate themselves and twelve (15.2%) reported that
they had.
Research Questions
Three research questions for the quantitative phase were addressed with associated
frequencies statistics in the following section.
Research Question 1
What intrinsic factors motivate higher education faculty to teach a MOOC?
Participants were asked to respond on a Likert scale from 1 to 5 (strongly disagree =1,
strongly agree =5) what intrinsic factors best described their motivations to teach a MOOC. The
results were shown in Table 9.
Table 9. Descriptive Statistics for Intrinsic Factors (N=89)
Intrinsic Variable % Strongly
Disagree
% Disagree
% Neutral
% Agree
% Strongly
Agree
Mean SD
1. Opportunity to share
knowledge with others
2.2 1.1 3.4 32.6 60.7 4.48 0.81
2. Opportunity to develop
new ideas about teaching
the learning processes
2.2 5.6 6.7 51.7 33.7 4.09 0.91
3. Personal motivation to
learn and use technology
2.2 6.7 7.9 53.9 29.2 4.01 0.92
102
4. Intellectual challenge 1.1 4.5 13.5 49.4 31.5 4.06 0.86
5. Opportunity to improve
and enhance online
teaching skills
3.4 4.5 13.5 46.1 32.6 4.00 0.98
6. Develop new
competencies
4.5 3.4 13.5 56.2 22.5 3.89 0.95
7. Overall job satisfaction 4.5 2.2 21.3 57.3 14.6 3.75 0.90
8. Opportunity to
influence social change
9.0 7.9 21.3 40.4 21.3 3.57 1.18
9. Career
exploration/development
11.2 7.9 25.8 44.9 10.1 3.35 1.13
10. Opportunity for
scholarly pursuit
5.6 13.5 29.2 43.8 7.9 3.35 1.00
11. Opportunity to use
personal research as a
teaching tool
10.1 23.6 25.8 30.3 10.1 3.07 1.17
12. Faculty opinions and
beliefs about online
coursesa
9.1 28.4 35.2 22.7 4.5 2.85 1.02
a The total number of responses received for this item was 88.
Among the 12 intrinsic variables being measured in the self-assessment, over 75% of
respondents strongly agreed or agreed that six factors intrinsically motivated them to teach a
MOOC the most: opportunity to share knowledge with others (93.3%), opportunity to develop
new ideas about teaching the learning processes (85.4%), personal motivation to learn and use
technology (83.1%), intellectual challenge (80.9%), and opportunity to improve and enhance
online teaching skills (78.7%), and develop new competencies (78.7%).
Between half and three-quarters indicated the following four motivated them to teach a
MOOC: overall job satisfaction (71.9%), opportunity to influence social change (61.7%), career
exploration/development (55%), and opportunity for scholarly pursuit (51.7%).
103
Fewer than half suggested an opportunity to use personal research as a teaching tool
(40.4%) and faculty opinions and beliefs about online courses (27.2%) were important
motivators to help make their decisions to teach a MOOC.
Research Question 2
What extrinsic factors motivate higher education faculty to teach a MOOC?
In the survey, all participants were asked to indicate their agreement on a Likert scale
from 1 to 5 (strongly disagree =1, strongly agree =5) for additional 23 extrinsic motivators.
Frequencies and descriptive statistics were calculated for each variable (see Table 10).
Table 10. Descriptive Statistics of Extrinsic Factors (N=89)
Extrinsic Variable % Strongly
Disagree
% Disagree
% Neutral
% Agree
% Strongly
Agree
Mean SD
1. Ability to reach new
audiences globally
2.2 3.4 0.0 28.1 66.3 4.56 0.77
2. Technical support
provided by the
institution
1.1 11.2 9.0 37.1 41.6 4.07 1.03
3. Greater course
flexibility for studentsa
3.4 8.0 11.4 39.8 37.5 4.00 1.06
4. Opportunity to
diversify program
offeringsa
4.5 12.5 11.4 53.4 18.2 3.68 1.06
5. Support and
encouragement from
institutional
administrators
3.4 6.7 23.6 33.7 32.6 3.85 1.06
6. Support and
encouragement from
6.7 11.2 27.0 30.3 24.7 3.55 1.18
104
school dean or
department chair
7. Support and
encouragement from
school or departmental
colleagues
7.9 13.5 27.0 31.5 20.2 3.43 1.19
8. Professional prestige
and status
12.4 19.1 18.0 39.3 11.2 3.18 1.23
9. Visibility among
colleagues within their
disciplinea
9.1 15.9 26.1 42.0 6.8 3.22 1.09
10. MOOC training
provided by the
institution
13.5 18.0 23.6 25.8 19.1 3.19 1.31
11. Grants for MOOC
materials/expenses
19.1 19.1 20.2 27.0 14.6 2.99 1.35
12. Monetary support for
participation (stipend,
overload)
23.6 20.2 20.2 23.6 12.4 2.81 1.36
13. Recognition and
awards
19.1 15.7 32.6 27.0 5.6 2.84 1.19
14. Expectation by
university that faculty
participate
12.4 18.0 40.4 22.5 6.7 2.93 1.09
15. Visibility for jobs at
other
institutions/organizationsa
19.3 20.5 37.5 18.2 4.5 2.68 1.12
16. Job security 24.7 27.0 30.3 13.5 4.5 2.46 1.14
17. Credit toward
promotion and tenure
37.1 21.3 23.6 11.2 6.7 2.29 1.26
18. Royalties on
copyrighted materials
37.1 25.8 20.2 12.4 4.5 2.21 1.20
105
19. Requirement by
departmenta
39.8 22.7 26.1 8.0 3.4 2.13 1.13
20. Merit payb 39.1 25.3 24.1 8.0 3.4 2.11 1.13
21. Release time 42.7 18.0 31.5 4.5 3.4 2.08 1.11
22. Reduced teaching
loada
47.2 22.5 22.5 5.6 2.2 1.93 1.06
23. Increase in salarya 38.6 26.1 30.7 3.4 1.1 2.02 0.97 a The total number of responses received for this item was 88.
b The total number of responses received for this item was 87.
Of 23 extrinsic variables, more than 75% of respondents strongly agreed or agreed that
three factors extrinsically motivated them to teach a MOOC the most: ability to reach new
audiences globally (94.4%), technical support provided by the institution (78.7%), and greater
course flexibility for students (77.3%).
Between half and three-quarters indicated the following five motivated them to teach a
MOOC: opportunity to diversify program offerings (71.6%), support and encouragement from
institutional administrators (66.3%), support and encouragement from school dean or
department chair (55%), support and encouragement from school or departmental colleagues
(51.7%), and professional prestige and status (50.5%).
About one-quarter and half suggested visibility among colleagues within their discipline
(48.8%), MOOC training provided by the institution (44.9%), grants for MOOC
materials/expenses (41.6%), monetary support for participation (36%), recognition and awards
(32.6%), and expectation by university that faculty participate (29.2%) were important extrinsic
motivators to making their decisions to teach a MOOC.
Less than a quarter reported that the following nine played an integral role when
considering teaching a MOOC: visibility for jobs at other institutions/organizations (22.7%), job
106
security (18%), credit toward promotion and tenure (17.9%), royalties on copyrighted materials
(16.9%), requirement by department (11.4%), merit pay (11.4%), release time (7.9%), reduced
teaching load (7.8%), and increase in salary (4.5%).
Overall, five intrinsic motivators (sharing knowledge, developing new teaching ideas,
motivation to use technology, intellectual challenge, improving online teaching skills) had a
mean score above 4.0 while three extrinsic motivators (reach new audiences, technical support,
course flexibility) had scores above 4.0. Among the twelve intrinsic factors, only one item had a
mean score below 3.0 (faculty opinions about online courses). Thirteen of the twenty-three
extrinsic factors had scored below 3.0.
Research Question 3
What are faculty experiences teaching a MOOC?
Participants were invited to share impressions of their MOOC teaching experience in the
survey. The results were shown in Table 11.
Table 11. Participant’s Overall Impression of MOOC Teaching Experience (N=89)
Item % Yes % No % Other
Satisfaction teaching first MOOCa 88.5 11.5 0.0
Willingness to teach a MOOC again 78.7 15.7 5.6
Teaching a MOOC inspired change in teaching in general 65.2 23.6 11.2 a The total number of responses received for this item was 87.
Of 89 responses, about 88.5% stated that they felt satisfied having taught their first
MOOC. Over 75% of respondents reported that they would consider teaching a MOOC again.
Five participants (5.6%) indicated their uncertainty with provided answers like “unsure,”
“depends on subject matter and compensation,” and “depends on who is in charge of the
107
organization of it.” More than half of participants (65.2%) claimed that the experience of
teaching a MOOC had inspired them to change the way they teach in general.
Participants were asked in the survey to indicate their agreement on whether MOOCs
were academically as rigorous as traditional classes. The table below showed the results.
Table 12. Participant’s Beliefs about MOOC’s Academic Rigor & Online Courses (N=87)
Item % Beliefs that MOOCs are as academically rigorous as traditional classes Yes 42.5
No 43.7 Other 13.8
Results were approximately equally divided with 37 participants (42.5%) said “Yes,” and
38 (43.7%) chose “No.” About 13.8% of respondents selected “Other.” Examples of their
answers included: “the material was as rigorous, but the MOOC used less than half the material,”
“the learning is as rigorous, the assessment is not,” “it is not an academic course,” “yes, for those
that do the capstone. No, for those that are just listening to lectures,” “tough question, is the
content the same? Yes. Is the experience as rigorous? No.”
Participants were invited to share their beliefs about fully online courses, specifically
before and after teaching a MOOC, on a 4-point Likert scale (1= very skeptical, 4= very
enthusiastic). The results were summarized in the figure below.
108
Figure 6. Participants’ Beliefs about Fully Online Courses Before and After Teaching a MOOC.
Data showed that a quarter of participants (25.8%, N= 23) were very enthusiastic about
fully online courses before teaching a MOOC, and this number increased to 33.7% (N= 30) after
they completed delivering a MOOC.
About 37.1% of participants (N= 33) were somewhat enthusiastic about fully online
courses before getting involved in MOOC teaching activity. This number went up to 41.6% (N=
37) after teaching a MOOC. In addition, for those respondents who were somewhat skeptical, the
number dropped from 30.3% (N= 27) to 19.1% (N= 17) after they taught a MOOC. The
percentage of respondents who indicated that they were very skeptical about fully online courses
before participating in a MOOC slightly decreased from 6.7% (N= 6) to 5.6% (N= 5) after
teaching a MOOC.
Data concerning the MOOC teaching history of participants was obtained and could be
viewed in table 13 below.
33.7%
41.6%
19.1%
5.6%
25.8%
37.1%
30.3%
6.7%
Very enthusiastic
Somewhat enthusiastic
Somewhat skeptical
Very skeptical
BEFORE AFTER
109
Table 13. Participant’s MOOC Teaching Background Information (N=89)
Item % Years of teaching MOOC via edX/Courseraa Less than 1 year 2.3
1 - 5 years 90.8 6 - 10 years 6.9 Student enrollment of your first MOOCb 1 - 1,000 16.0 1,001 - 10,000 46.9 10,001 - 100,000 34.6 100,001 - 1,000,000 2.5 Had taught/were teaching MOOC(s) via other providers (edX/Coursera excluded)c
Yes 11.6 No 88.4
a The total number of responses received for this item was 87.
b The total number of responses received for this item was 81.
c The total number of responses received for this item was 86.
When asked how many years of experience in teaching MOOC they had via edX or
Coursera, 87 out of 89 participants responded. Most respondents, 79 participants (90.8%) stated
they had at least 1-5 years of experience in delivering MOOC, six participants (6.9%) said ‘6 to
10 years’ and two participants (2.3%) replied with ‘less than 1 year.’
Participants were asked about the student enrollment of their first MOOC. Thirteen
respondents (16%) stated they had less than 1,000 students in their first MOOC. Thirty-eight
respondents (46.9%) said the number of students for their first MOOC ranged from 1,001 to
10,000. Twenty-eight participants (34.6%) had the enrollment of their first MOOC resided
between 10,001 to 100,000. There were two remaining respondents (2.5%) claimed that they had
more than 100,001 students for their first MOOC offering.
110
Results indicated that edX or Coursera appeared to be the sole MOOC platform used by
76 participants (88.4%) in delivering a MOOC, no one was cross-teaching between these two
platforms. Ten respondents (11.6%) stated that they had taught a MOOC via a third MOOC
provider, for example, Stanford Online, eCollege.com, Canvas, and Swayam.
Participants were asked to identify their role(s) in delivering a MOOC. More than one
response option was allowed in this question. Table 14 showed the results of this question.
Table 14. Role(s) of MOOC Instructor (N=89)
Role(s) of MOOC Instructor % of Multiple Responses Primary instructor 41.2 Primary designer 20.6 Co-instructor 18.6 Co-designer 11.3 Work behind the scene 4.1 Other 4.1
As noted, “Primary instructor” received the highest scores of multiple responses,
approximately 41.2%. “Primary designer” and “Co-instructor” seemed to have the second and
third highest responses of 20.6% and 18.6%, respectively. The responses of “Co-designer”
accounted for 11.3% of the whole. The remaining responses “Work behind the scene” and
“Other,” made up 4.1% of each.
The answers from those who indicated “Other” included “I did everything above,” “I
wrote up about the material, participated in the taping, and have been involved only marginally
in interacting with the participants,” “I supervise a staff of 4 MOOC developers/instructors and
also develop content and teach MOOCs,” and “co-instructor/designer in one; primary
instructor/designer in the other.”
111
Participants were asked to describe the communication tool(s) they offered to students in
their MOOC(s). This closed-ended question made it possible for participants to select more than
one answer as appropriate. The results were shown in the table below.
Table 15. Communication Tools Used in MOOCs (N=89)
Communication Tools % of Multiple Responses
Online message board/Discussion forum 41.5 Email 31.7 Video conferencing tools 11.3 None 9.2 Virtual office hours 3.5 Other 2.8 Phone 0.0 Instant messenger 0.0
The top three communication tools used most by the respondents were online message
board/discussion forum (41.5%), email (31.7%), and video conferencing tools (11.3%). “None”
was in 9.2% of the responses, followed by virtual office hours (3.5%). About 2.8% of responses
aligned with “Other” stating that they used Piazza, social media (e.g., Facebook, Wechat), and
webinars to interact with learners. Phone and Instant messenger were not used at all by
participants.
The top two tools (i.e., online message board/discussion forum, and email) most
commonly used to engage students were asynchronous. Tools that provided for synchronous
interactions were only used by 11% or fewer MOOC instructors.
112
Summary
Chapter four presented the quantitative findings of this study including demographics of
participants, teaching background, and descriptive statistics to address the three research
questions listed below.
RQ 1. What intrinsic factors motivate higher education faculty to teach a MOOC?
RQ 2. What extrinsic factors motivate higher education faculty to teach a MOOC?
RQ 3. What are faculty experiences teaching a MOOC?
Twelve intrinsic and twenty-three extrinsic motivators were examined and evaluated by
89 participants on a Likert scale measurement. Faculty’s experience of teaching a MOOC, which
included their overall impression, beliefs that MOOCs were as academically rigorous as
traditional classes, the roles performed, communication tools used, and MOOC teaching
background were examined.
In terms of who responded, the majority were mid-career aged 30 years old to 60 years
(85.6%), Caucasian (83.9%), males (66%), holding a doctorate (76.4%), and serving as an
associate or full professor (57.3%). About a quarter of the respondents each reported teaching 1-
10, 11-20, or 21-30 years in postsecondary education with most teaching both undergraduate and
graduate courses (65.5%). There was about a 50 to 50 split on whether they had taught online or
blended courses before teaching a MOOC. The majority had not taken an online course
themselves (52.8%) and had no online degree or certificate (84.8%).
In describing their experiences in teaching a MOOC, most had been teaching MOOCs for
1-5 years (90.8%) and the majority had taught courses with enrollments of 10,000 or less
(62.9%). The majority were teaching MOOCs for only one provider (88.4%). Most served in a
pedagogical role as a primary instructor or co-instructor (59.9%) with roles as primary or co-
113
designer reported by about a third (32.9%). Primary communication tools that were used in
MOOCs included online message boards or discussion forums (41.5%) and email (31.7%),
asynchronous tools.
Overall, respondents were satisfied with their MOOC experience (88.5%), willing to teach
a MOOC again (78.7%) and said teaching a MOOC changed their teaching approaches in
general (65.2%). The opinion was split on whether MOOCs were as rigorous as traditional
classes (42.5% yes, 43.7% no). The level of skepticism about MOOCs was reduced and
enthusiasm for MOOCs increased after teaching a MOOC.
Intrinsic motivators appeared to play a more significant role in the decision making to
teach a MOOC compared to extrinsic ones. Intrinsic motivators cited by more than 80% of
respondents included an opportunity to share knowledge with others (93.3%), opportunity to
develop new ideas about teaching and learning processes (85.4%), personal motivation to learn
and use technology (83.1%), and intellectual challenge (80.9%); only one extrinsic motivator
was cited by more than 80% of respondents, ability to reach new audiences globally (94.4%).
However, one might argue that the extrinsic one seemed similar to the intrinsic one of “the
opportunity to share knowledge with others.” In Chapter Five, qualitative findings with
associated categories and themes were presented.
114
CHAPTER 5. QUALITATIVE FINDINGS
This chapter described the qualitative findings of this study. It began with demographics
of interviewees, followed by the qualitative results, and concluded with a summary. Qualitative
data were captured through semi-structured interviews, with twelve interviewees who were
teaching MOOCs or had previously taught MOOCs via edX or Coursera. The interviewees were
from diverse higher education institutions and varied geographical regions. The findings were
derived from the interview transcriptions and responses obtained from two open-ended questions
(see below) in the web-based survey. The two open-ended questions received eight-nine and
forty-one responses respectively.
1. Would you teach a MOOC again? Please specify your reason(s).
2. What else would you like to share with me (optional)?
Demographics
The following table described the interviewees’ demographic data.
Table 16. Demographic Data of Interviewees (N=12)
Demographic Variable N % Gender Female 5 41.7 Male 7 58.3 Academic Position Lecturer 2 16.7 Research Faculty 1 8.3 Associate Professor 3 25.0 Professor 6 50.0 Working Location United States 9 75.0 Asia 2 16.7 Europe 1 8.3 Institution Type
115
Public 5 41.7 Private 7 58.3 MOOC platform used edX 7 58.3 Coursera 5 41.7
Among the 12 respondents, five (41.7%) were female, and seven (58.3%) self-identified
males. About half self-identified as professor (N=6, 50%), followed by associate professor (N=3,
25%), lecturer (N=2, 16.7%), and research faculty (N=1, 8.3%). The majority of respondents
(N=9, 75%) were employed in the United States, while two (16.7%) were in Asia, and one
(8.3%) was in Europe at the time of the interview. More than half of the participants (N=7,
58.3%) indicated they worked for private institutions, while the remaining five (41.7%) were
affiliated with public ones. As shown in the table, seven respondents (58.3%) reported using edX
to deliver their MOOCs, and five (41.7%) stayed with Coursera.
Qualitative Results
Qualitative results were reported in the sequence of three research questions. For the sake
of confidentiality, interviewees’ real names, departments, institutions, and any identifying
information were not reported, and respondents from the survey were identified by numerical
numbers or anonymous in the quotations appeared in this chapter. Twelve interviews were
transcribed, coded, and categorized into themes using thematic analysis (Thomas & Harden,
2008). Open-ended responses from the web-based survey were also coded. Themes and
categories were presented in the following sections.
Research Question 1
How do higher education faculty members describe their decision-making process in terms of
participating in MOOCs?
116
When interviewees were asked about how they got started teaching a MOOC, a significant
number of factors stood out through their responses. These factors were thoroughly examined,
coded, and categorized into groups under two main themes. Qualitative analysis revealed that
faculty members were driven to participate in MOOCs either because of intrinsic motivators
(theme 1) or due to extrinsic motivators (theme 2). Within these two main themes, associated
categories and reasons as to why faculty members chose to teach a MOOC were summarized in
table 17 as follows.
Table 17. Summary of Intrinsic and Extrinsic Factors Leading to Faculty Choice
Factors Leading to Faculty Choice to Teach a MOOC
Intrinsic Factors
(Theme 1)
1. The desire to reach a wider audience 2. A desire to showcase/share expertise 3. Passion for teaching with technology
Extrinsic Factors
(Theme 2)
1. Institutional decisions/MOOC partnerships 2. Others invited/encouraged participation 3. External rewards
Intrinsic Factors.
Interviewees indicated that they chose to teach a MOOC due to internal factors or intrinsic
motivation. These intrinsic motivators included: 1) the desire to reach a wider audience; 2) a
desire to showcase or share expertise such as research, experts, programs, personal visibility; and
3) passion for teaching with technology.
The desire to reach a wider audience.
Due to the rapid development of technology in the world, MOOCs received worldwide
attention and inspired many educators in different ways. Interviewees identified the desire to
reach a wider range of learners as being the most predominant motivator for the majority of them
to teach a MOOC. Comments of survey participants and interviewees in this regard were
provided below.
117
Anonymous survey participant: I was happy with the product, and so far, we have reached
>27,000 learners from 182 countries. I never thought that we could have such reach.
Interviewee 02: The other motivation was you get onto a platform like edX, and you
deliver MOOCs, um, you reach a hugely that I would call a heterogeneous audience from
several countries. Um, for example, the MOOCs that I run has thousands of, ah,
enrollments. Um, they are from hundreds of countries, um, ah, the age group from 20 to
50, undergraduates to doctors, PhDs.
Interviewee 07: And I feel that in order to get our research strengths out there to people
that one of the best ways to do it is MOOC because it has a global reach.
Several interviewees further explained that teaching MOOCs enabled them to connect
with learners that in reality they would not be able to physically meet due to geographical
limitations. This became an intrinsic motivation for them to expand their reach through teaching
a MOOC. Their comments were provided below.
Interviewee 06: So, a lot of the motivation came from reaching an audience that we
otherwise would not be able to reach.
Interviewee 08: The first, the first reason is that I think that at [institution’s name], like all
of, you know, universities especially ‘A-one’ universities, we understand that providing
MOOCs is really a way, ah, first to reach out to communities beyond our local geography.
Interviewee 10: Um, because I, I didn’t know a lot about MOOCs, but I knew enough to
know that the material and the content would reach a lot more people if it was delivered
through an online course content program.
A desire to showcase or share expertise.
It was found in this study that MOOCs were orientated to showcase expertise in research
and programs, share experts, and enhance a faculty member’s visibility. A desire to share
expertise with others seemed to give interviewees a strong incentive to teach MOOCs.
By doing a MOOC, an instructor received the opportunity to share his/her latest research
findings or a successful program in a subject area. Examples of interview comments are provided
below.
118
Interviewee 06: Okay, so um, a big part of that has to do with the fact that we want to
share our research results with the world, and how we think about the topic is somewhat
different than how other people in my research area think about it. So, in part, we created
the Massive Open Online Course to educate people to think the way we do so we can then
better share with them more advanced ideas of ours which actually we’re now doing
through a progression of Massive Open Online Courses um, which builds on the first one.
Interviewee 07: And I wanted people all over the world to know, get to know [institution’s
name] is a research hub in this area. So that’s the reason why I did it.
Interviewee 08: So, we thought that it would be a good idea to leverage this strength and
really put out our brand of [subject’s name] in um, cyberspace, or whatever. And so, um,
at the time I was the lead [subject’s name] coordinator, and so to me, it seemed like a
natural next step [mm-hmm] to teach this course. I really felt like this is our opportunity to
share, you know, our way of understanding user-centered design with the world.
It comes as no surprise to see that teaching MOOCs enhanced the personal exposure of the
instructor or the social image of the institution where he/she worked. Examples of interviewee
comments in this regard are provided below.
Interviewee 02: Um, at a very personal level, um, I think I am a lot more, can I use the
word, ah, visible and known? And I get, as a result of this, I get invitations to come and
talk in-in conferences, in forums, not just on technology in education, but on my course
subject of [subject’s name].
Interviewee 05: The other motivation was that, well, it increases our visibility obviously.
People get to know about us um, eh, who would otherwise not notice that we exist. So we
decided to get um, all the big names on board that we were aware of in [country’s name]
at that time when we planned the project to create a MOOC, and we have the one
pronounced expert in a specific footage of the chapters of the, of the MOOC. So, it would
be fairly fundamental, and each chapter would be something, would be one chapter on
speech, for example, one chapter on-site [subject’s name] um, and so forth. So that’s fairly
different um, ah, sub-domains. So, we wanted to come, join forces across [country’s
name] and, so that there’s more interaction between university and also that the entire
topic just gains more visibility.
119
Passion for teaching with technology.
Keeping an eye on the development of digital platforms and possessing a passion for
teaching intrinsically motivated two interviewees to engage in MOOCs.
Interview 01: Well, um, it was, it’s always been the case I-I’ve been, my earliest training
is I was a computer scientist by training a million years ago. And I had a, I’ve always
maintained an eye on the use of digital platforms to support learning. So, I’ve been
following the development of MOOCs and curious about them.
Interviewee 03: I teach a lot, and so I do many different kinds of teaching. I do um,
integrated courses where you put [subject’s names] together. I do online courses where
you do a boot camp for three weeks of teaching, and then you send them off online for a
year, and then they come back for three weeks, and they go off for a year, and then they
come back for three weeks, and they get a masters at the end of that. Um, I do flipped
courses where they watch the films, and then they come in and you discuss them. Um
again, a degree program, a degree program course. Um, I do, I guess that’s sort of that’s
flipped. And then I do, I guess they’re calling the ones where you do them in person and
then they go online like I think they call those hybrid courses, [mm-hmm] when you
combine the two.
Extrinsic Factors.
In addition to these intrinsic motivators, the findings of the qualitative analysis suggested
that the choice of higher education faculty members to take part in a MOOC was influenced by
several extrinsic motivators including 1) institutional decisions/MOOC partnerships; 2) others
invited/encouraged participation; and 3) external rewards.
Institutional decision/MOOC partnership.
A few interviewees noted that the final decision to offer MOOCs was made by their
institutions rather than by them. The institutions’ interests in running MOOCs happened to be a
‘catalyst’ potentially accelerating the change and encouraging interested faculty to jump in on a
MOOC. Their opinions are provided below.
120
Interviewee 03: So, I’m involved in whatever the school is teaching because I want to
teach. And so, if there’s if they’re changing the format, then I’ll try the format. They were
just coming into the edX program, and we’re actually the second edX that was done in the
first from the [school’s name]. And so, my colleague, who was asked to do the edX
program, just said to me you want to do some lectures? And I said sure. I mean, you
know, it’s the same material, that I would teach in front of students, um, except I just film
it. I mean I just go ahead and record it. So, it doesn’t matter to me if he needed somebody.
I-I do clinical trials, so I tend to do lectures on clinical trials and interpret clinical trials.
And so, um, you know I was more than willing to help out and I was sort of curious as to
what it would be.
Interviewee 07: Ah, I think they really need to um, have access to deep pockets at their
institution. They need to have access to money, and then also facilities, and institutional
will. If I were teaching anywhere else, there’s no way I would have done, been able to do
this MOOC, you know. And when I knew that we were doing, we were going to do
MOOCs from [institution’s name], it was an institutional decision, it wasn’t my decision.
So, anyone who wants to do a MOOC, it can’t be an individual decision, it has to be an
institutional will, it has to be a group decision.
Interviewee 12: Ah, yes. A few years ago, [university’s name], [university’s name] got
very interested in, in MOOCs and was encouraging faculty members to create, create
MOOCs and they were really looking primarily at the, at topics that would have both, well
obviously that would appeal to a broad population, but topics that they also thought would
be important for people in general to understand.
Several interviewees admitted a fact that a pre-existing partnership between their
institutions and a MOOC provider was a crucial determinant, extrinsically and explicitly leading
to the decision making. Given that, faculty members have no autonomy or flexibility in the
selection of choosing a preferred MOOC provider over another. They commented,
Interviewee 01: Another is our university who’s an active collaborator with edX, and we
have a very, very serious office of academic innovation at the university level and they
were active.
121
Interviewee 05: Um, that’s very simple, because two of the contributing universities that
have an exclusive contract with edX. So that both, there’s two, two of the four universities
in [country’s name] they have an online learning department basically that has a contract
with edX, so they eh, and it happened to be edX in both universities, so that there was no
discussion about this.
Interviewee 10: Um, [institution’s name] has a contract with Coursera, and so all the
courses are running through Coursera.
Interviewee 11: So, we chose Coursera as the platform. [institution’s name] already had a
relationship with Coursera.
Others invited/encouraged participation.
It turned out that the best way for recruiting universities/colleges/schools or individuals to
make MOOCs was to send invitations through a MOOC provider. For instance, interviewee 01
said,
Um, at that time, [person’s name] at edX was beginning to recruit universities to be
partners in experimenting with the MicroMaster concept. And so they asked the [school’s
name] and my Dean asked me is there some way that we can build on the success of this
first course which we hadn’t even built yet, we just got the money for it, and develop a
MicroMaster’s program which would be five courses um, that met the standards for
graduate education at the [institution’s name], that if students completed successfully they
would actually get graduate credit at the [institution’s name].
Exciting conversations regarding what subjects were appropriate to be offered as a MOOC
or what programs could be designed and delivered through MOOCs happened through social
networking opportunities. For example, one interviewee had a social dining experience with a
Coursera representative introduced to him by his dean. Their interactions/discussions helped
craft a general plan of running a MOOC in the subject of social media marketing. Interviewee 09
explained,
And then when he was getting ready to leave, he got, he had a call from Coursera who
said we need a [subject’s name] program. So just as a quick aside, they, the people came
122
in from Coursera and we had dinner, and I started talking, and you know the guy, one of
the Coursera folks, said what do you do? I said well, I teach [subject’s name]. And so, we
started talking and he started writing things down on his napkin. And it turned out he then
sent out an RFP that said basically they wanted the course just like mine. So that’s how I
got to do the bigger one which is [subject’s name] MOOC.
While, for those interviewees who didn’t buy in at the early stage, they were inspired or
invited to get involved in MOOCs by different parties such as the head of an institution,
colleagues or a former supervisor/co-worker who tried MOOCs, or even by students’ requests.
Several interviewees explained,
Interviewee 02: Okay. Um, I got started on this about four years ago. Um, the then head of
our institution, ah, used to teach at the [institution’s name]. Um, so when he came and
joined us, um, he connected with edX because he had been working with them earlier.
And he asked myself and two or three of my colleagues to actually travel to [city’s name]
to get the experience of ah, you know, what, what is MOOCs all about and how is it
benefit a large community of students. So, we attended the workshop, we interacted with
the faculty at [institution’s name] and [institution’s name].
Interviewee 03: And so, my colleague, who was asked to do the edX program, just said to
me you want to do some lectures? And I said sure. I mean, you know, it’s the same
material, that I would teach in front of students, um, except I just film it. I mean I just go
ahead and record it. So, it doesn’t matter to me if he needed somebody. I-I do clinical
trials, so I tend to do lectures on clinical trials and interpret clinical trials. And so um, you
know I was more than willing to help out and I was sort of curious as to what it would be.
Interviewee 05: Umm-hmm, so, the, the original instigation to start the project um, was by
my former Ph.D. supervisor, a professor um, [person’s name] is his name in, he is at
[institution’s name]. And his idea, so he had several, several, ah, um, aspects that
motivated him to, to instigate the project.
Interviewee 10: Um, and at the end of the second summer, um, I got a phone call from the
director of the online learning, um, platform at [institution’s name], at [institution’s name]
asking me if I would be interested in teaching a MOOC um, with another professor who
was at [institution’s name] um, on the topic of um, how to create an [subject’s name].
123
Interviewee 02: Um, I also had the opportunity to talk to a lot of the students, ahem, in
some of the universities ah, where the faculty had used the, ah, what we called the flipped
classroom. So, they watched the videos before coming to class, and then, you know, use
that learning in the classroom. So, as I-I was quite clued onto-to this. And, and then when
I got back here, ah, I talked to some of my students. They said, um-um, look, whatever we
don’t understand when the teacher/instructor teaches us in the class, we anyway go back
to our homes or hostels, dorms, and we just look for the subject and they get videos and
we watch them and that’s the way we learn. So, my motivation was, if students can watch
other videos to learn what I teach and why don’t I produce my own videos and, that
founded the basis for the students to learn.
Interviewee 09: And so, I think that I always keep that in mind is that, there are some
people out there that are killing themselves to get to the education that we’re putting out
there. And so, it just amazes me you know, that they have that much drive to do it. But
they do, and therefore I as an instructor should at least give back that amount of effort.
And so that drives me. I mean it’s like you know this is really life-changing for people and
it’s something that they don’t, you know I mean if you came to [institution’s name] you
have to spend what thirty thousand a year, you know and they don’t have that. And they
don’t have to spend anything, but I give them the same quality of education because they
deserve it.
External rewards.
External rewards, such as funding, grants, and support of the Dean, were reported as being
significant motives for interviewees in this study.
The Dean’s involvement in providing sufficient and pertinent pre-training to get MOOC
instructors prepared made a huge difference in their decision-making process. Interviewees
found it very inspiring if they could receive support from their supervisors. Several of their
comments are given below.
Interviewee 01: And so, the-the motivation was um, through um, two things. One is our
dean’s office, about three things actually, one is our dean’s office, um, we had a new dean
who was interested to get into this space.
124
Interviewee 09: When ah, two, two Deans’ ago if you will, ah, we hired a Dean, his
name’s [person’s full name]. And [person’s first name] came in and ah, basically pulled
the whole faculty together and said you know we’re way behind times, we aren’t into
videos, we aren’t into audio, and you’re gonna all get there. So, he actually made the
faculty come to classes on Saturdays, and what he did is he gave us a video camera and
we learned how to edit and shoot video. He gave us audio. We had to go out and record
interviews and edit those down. And so, um, as he got going, he was putting together, um,
the first MOOC that I was involved in. So, I, my Dean pulled me into it and, and uh, I was
really you know really impressed with his ah, you know wanting to go cutting-edge. And
so, I did that. I suddenly saw you know that social was taking off. And so, I took my class
which was essential, it was the essentials of [subject’s name] and moved it over into
[subject’s name]. And then I’ve been keeping it cutting edge. I rewrite the course every,
every quarter, and then I ah, I changed my, I swap out my videos all the time.
Interviewee 10: Um so, I checked with my Dean, and she said, I said you know can I do
this; it would technically be an overload for me, and she said sure. And so, I got
permission and so I proceeded to go ahead and, and um say yes and to start um, ah, getting
ready to do the MOOC.
Financial support was an integral role in the decision-making process when MOOC
instructors decided whether to join. The design, development, and implementation of one single
MOOC called for a large amount of money to recruit a team of experts from different subject
areas to collaborate closely together for a period of time. Ideally, a content expert, an
instructional designer, a technology specialist, and a video producer would be considered to have
in this group. Without monetary support, creating a quality MOOC was challenging. Three
interviewees mentioned that they received financial support in their MOOCs. Their comments
are as follows:
Interviewee 01: And an opportunity presented itself, to work with our university to
develop a, to write a grant program to Microsoft to develop one MOOC in um, leading
125
change in education. And we applied for that grant and received it. We were going to
develop one course.
Interviewee 06: So, the [institution’s name] decided to buy into the edX partnership. And
as part of that the [institution’s name] was willing to give a few groups money to develop
initial MOOCs to then be offered on the edX platform. So that then gave us the seed
money and the ah, incentive to actually put the first Massive Open Online Course together
and that’s how we ended up with our first course.
Interviewee 11: So back in 2016, we had an opportunity to be funded by the
[organization’s name] to get all of our security courses online, or a good majority of the
computer security courses online. At that time actually, I actually taught two out of the
nine that they wanted to put online.
Furthermore, one interviewee shared that when he offered to do a MOOC, he was very
fortunate to have an academic network with a third-party organization that financially helped
him form the team and paid everyone on the team. Interviewee 01 stated,
And so, I said, um, certainly and I was very interested in that, and again I have this
appointment with the [foundation’s name] and I asked if they would be interested in
supporting this and I recruited a whole bunch of other people to help. And um, so we said
we’ll do that… And then it was my interest in my work with the [Foundation’s name] they
gave us the content and the substance for this program. So, it was those three things I
would say working together.
Research Question 2
What are the roles and experiences higher education faculty encounter in delivering a MOOC?
When interviewees were asked to share their roles and experiences in teaching a MOOC,
findings concerning this question were coded for two themes. These themes included roles
higher education faculty performed in teaching a MOOC (theme 1), and experiences they
encountered in delivering a MOOC (theme 2). The sub-themes and categories are outlined in
Table 18.
126
Table 18. Summary of Subthemes and Categories for Roles and Experiences
Themes Subthemes & Categories
1. Roles higher education faculty
performed in teaching a MOOC
o Solo designer and lecturer
o Lead designer and lecturer
o Shared designer and lecturer
o Lecturer only
2. Experiences higher education
faculty encountered in delivering
a MOOC
o More support was needed to do MOOCs
o Training and feedback
o Content support
o Video production
o Assistants (GA/TA)
o Specific competencies were required to do
MOOCs
o Commitment (Time and Effort)
o Content expertise
o Understanding of online teaching context
o Camera presence
o Language accessibility
o Instructional design was essential to MOOCs
o Attention span
o Supplemental materials
o Engagement and interaction
o Challenges faced in delivering MOOCs
o Feeling overwhelmed
o One size does not fit all
o Understanding copyright and fair use
o Assessment
o High enrollment and low completion rates
127
Roles higher education faculty performed in teaching a MOOC.
An online instructor is expected to possess multi-dimensional roles and varied
competencies to craft engaging online courses for students. Interviewees discussed the roles they
performed while teaching in the MOOC context. As a result, four pedagogical roles were
identified, namely solo designer and lecturer, lead designer and lecturer, shared designer and
lecturer, and lecturer only.
Solo designer and lecturer.
Two interviewees said they preferred to design and run MOOCs alone from beginning to
end. They found it worked out well for them.
Interviewee 02: Yeah, um, I, all my MOOCs are run by me solo. I-I don’t have a, um, co-
ins…I mean a co-instructor. Because, I-I tell you the reason why. I think teaching methods
are different. Ah, one, two, ah, the way I come across in front of a camera, very different
from the way somebody else comes across ah, in front of the camera. And three, the one
lesson I have learned through doing a MOOC, is-which is a mistake a lot of MOOC
instructors commit, they bring in too many things into the MOOC. They have um, ah,
PowerPoint presentation, an Excel spreadsheet, animations, interviews. My own
experience has been, and I have done some kind of dip-stick research with some of my
past learners. I think, using too many methods in a MOOC and ah, too many instructors in
a MOOC, ah, tends to dilute the learning experience. Ah, the reason is very simple. Unlike
in the classroom where you’ve got fifty, seventy, a hundred students sitting there, and
there is an instructor, and then there is an interaction at one level. In a MOOC,
interestingly it is a very-very personalized interaction if you know what I mean. It’s, it’s
me on the video, on the screen, and the student watching. Now got to do everything at my
command to make sure that I am able to sustain his interests ah, or her interests during
that period and that the learning is maximized. It’s short bursts but it’s got to be very
focused. And if you have too many distractions the learning quotient, you know, drops
significantly. Ah, and none of my MOOC videos ah, is, the biggest one I’ve done is 11 to
12 minutes. Most of them are between 6 and 10 minutes because that’s the attention span
128
so people who learn by watching YouTube videos. Nobody wants to watch a 16-minute
YouTube video. Um, so, a lot has to go into-into in the MOOC design. You know you
take a topic, you know that it can’t be delivered in 8 minutes, so you gotta figure it out
into three or four MOOCs of eight MOOCs each, maintain the continuity. Now, all of this
I find very difficult to do it with co-instructors. So, like an artist at work, I know exactly
what my end product is going to be. And I’d rather play solo.
Interviewee 12: I am it. I am it. I mean we have a center at [institution’s name], we have a
center for instructional technol-, instructional technology, and they worked with me. But
no, I did it on my own without any support.
However, one interviewee collaborated closely with his wife who was also a faculty
member working in the same institution with a background in education. They decided to run the
MOOC together because they saw the maximum efficiency of working exclusively with each
other. They used to work with others such as a graduate student, which turned out to be
dissatisfying outcomes.
Interviewee 06: I put this together with my wife who’s also a faculty member here. Um,
we-we pretty much ran the MOOCs ourselves, we ourselves are on the, on the-on the
discussion boards. Ah, we’re very particular about being involved with the participants,
and we’re very concerned that when people ask questions that the answers are precise.
And as a result, we don’t feel comfortable handing that over to graduate students for
example to do that. You really as the developer have to be involved if you really want to
make this a quality experience for participants. And I think we’re quite unique in that,
there are very few course developers you know that, the typical offering of our course
which you know is a 16-week course, in a typical offering between my wife and I, we will
answer thousands of questions on the discussion forum, which no other instructor that we
know of actually does. So, our dynamics are very different, we don’t have staff because
we don’t want to have staff. We want control, okay? And fortunately, we can manage to
do this.
Lead designer and lecturer.
129
Moreover, some interviewees claimed that they had the experience in leading the work of
designing and lecturing MOOCs. In particular, they invited subject matter experts to give
presentations on different topics and to interact with students in their MOOCs. Their comments
were provided below.
Interviewee 01: I was a lead designer of all of them. Um, I enlisted the help of colleagues
at the [institution’s name] and one of the courses, um, I’m also I have an appointment as a
senior fellow at the [Foundation’s name] for the advancement of teaching. So, I work in
collaboration with um, colleagues from the [foundation’s name] on two of the courses.
Um, they were the principal, um, I was the primary designer of both courses, but they did
the presentations for one, and um, they did half of the presen-half of the video
presentation component for the second.
Interviewee 04: At that time, I was it, and I would say that the undergraduates who
worked with me [mm-hmm] so, I mean, in terms of content and organization, recording
the lectures, create, yes, I was the designer. The students were quick critics.
Interviewee 05: So we decided to get um, all the big names on board that we were aware
of in [country’s name] at that time when we planned the project to create a MOOC, and
we have the one pronounced expert in a specific footage of the chapters of the, of the
MOOC. So, it would be fairly fundamental, and each chapter would be something, would
be one chapter on speech, for example, one chapter on [subject’s name] um, and so forth.
So that’s fairly different um, ah, sub-domains. So, we wanted to come, join forces across
[country’s name] and, so that there’s more interaction between university and also that the
entire topic just gains more visibility. We chose people from [country’s name] so that we
can use the um, the course, the MOOC in the curricula at the universities. And, that’s
actually what it was possible.
Interviewee 07: I-I created the project and I brought on board [person’s full name], as well
as [person’s full name], who is my co-teachers, so they teach units as well. And [person’s
first name] also, because she has a doctorate in education as well as in history, she’s got
two doctorates um, I asked her to serve as our primary, um, um, member of the teaching
team to oversee all the assessment activities. So, she was really happily involved from the
130
beginning with the assessment activity. So, it’s pretty much a team effort even though I
initiated it and handle most of the oversight.
Interviewee 08: No, no. I don’t have any co-instructors to teach together. There was some
support from, you know, instructional faculty or whatever. So, there’s, um, there was a
promise of help. And so, I got them to build a little you know, a little video for me, but
that was it [mm-hmm]. But like I said, for us, you know, we’re not taking best practices in
MOOCs to the extent that we didn’t change. So, you know the course content, we
basically, I basically formatted it so that I could make it in these little chunks that are
more ah, digestible to the MOOC community.
Interviewee 09: Well first off, I designed it, and I used my class. And so, I brought in
experts on every topic, imaginable. I mean everything I wanted. I had a huge network of
people that in my class I brought in using video just like we’re doing. And so, you see that
I’m more of the emcee, and I take it, take it as they do that, I relate it to the topic, I kind of
keep everything flowing. And so, there are some that I, I did the lecture on. But I also had
people from all over the world who were experts in gamification and different topics that I
thought would be useful for the class. And so, it’s a very, it’s a very diverse group of
people that put it all together. But I was glue and I wrote everything. And so, they’d send
me their PowerPoints and I’d cut it down and adjust it, so it fits into the course. But they
basically said what they wanted to say.
Shared designer and lecturer.
Often hiring MOOC instructors was a pre-determined decision made at the department or
institutional level because of the selected individual’s expertise or research strengths. Thus, this
might require a MOOC instructor to co-design and co-teach a MOOC with another instructor or
a team of lecturers. A case shared by interviewee 10 disclosed that the director of the online
learning unit from a higher education institution she used to work at invited her to co-develop a
MOOC with another content expert.
Interviewee 10: At the end of the second summer, um, I got a phone call from the director
of the online learning um, platform at [institution’s name], at [institution’s name] asking
me if I would be interested in teaching a MOOC um, with another professor who was at
131
[institution’s name] um, on the topic of um, how to create an [subject’s name] workplace.
So, we talked it through, and they explained that I would be teaching um, a course that
would be four modules. I would develop all the material and all the content with another
instructor who teaches at [institution’s name].
Lecturer only.
Interviewee 03 was invited to give lectures on a specific topic through a MOOC
developed by her colleagues. This interviewee didn’t engage in any decision-making or
recruiting endeavors. She labeled herself as a pure MOOC lecturer.
Interviewee 03: Okay, um, I want to make clear this is okay. I taught in a MOOC I never
taught a MOOC. So, I was always giving lectures in a MOOC, but I was never the
program director. Um, and so what I have done, I’ve been involved in two MOOCs. In
both of them, I gave lectures.
Experiences higher education faculty encountered in delivering a MOOC.
Overall, interviewees stated that they had a satisfactory experience of teaching MOOCs.
During the conversations, words and phrases such as “positive,” “very rewarding,” “incredibly
pleasant thing,” “I really enjoy doing it,” “I really like it,” “a really good learning experience,”
“it makes me a better teacher,” were cited many times by interviewees when they talked about
their MOOC experiences. For instance, interviewee 02 said, “as a teacher, I find that a very
rewarding experience.” Similarly, interviewee 07 stated her overall impression on MOOC was “I
love it. I really enjoy doing it. Uh, I feel that I would like to see more.” Interviewee 09 expressed
that his participation in MOOCs changed the way he used to teach and interact with students. He
said, “It’s a very different way of teaching, but I really like it. So, you know I found that learning
how to do MOOCs really change the way I taught. And the way that I interacted with students.”
Interviewee 10 made a statement that he thrived from the interactions with students through
MOOCs. He said, “I don’t think I would ever construct my entire teaching career around MOOC.
132
Because I really thrive from the interaction I get with my students. And it makes me a better
teacher, and it makes me stay on top of my game and my material.”
The findings reflected from these positive experiences were very close to the results
gathered from the open-ended questions in the survey. Comments from anonymous survey
respondents were provided below.
Anonymous survey respondent: Was a fantastic experience that all instructors should go
through.
Anonymous survey respondent: Working on the MOOC Team was one of the most
exciting learning experiences of my career.
Anonymous survey respondent: Teaching a MOOC has been the most gratifying
experience in higher education of my 26+ year experience in university education!
Anonymous survey respondent: MOOC with Coursera was a rewarding experience.
Preparation for the course took many, many hours! But was ultimately worthwhile.
Interviewees suggested that although they had extensive experiences in delivering
MOOCs, they still had a demand for support. They shared there was a need for specific
competencies to teach MOOCs and stressed the integral role of instructional design support, and
the challenges they faced. These sharing were considered and summarized into four subthemes:
1) more support was needed to do MOOCs; 2) specific competencies were required to do
MOOCs; 3) instructional design was essential to MOOCs; and 4) challenges faced in delivering
MOOCs. Those subthemes and associated categories were further discussed in the following
section.
More support was needed to do MOOCs.
Regardless of how experienced these MOOC instructors claimed for themselves, the need
for support arose as a pivotal one from the conversation flow. The following four categories were
identified and discussed under the sub-theme more support was needed to do MOOCs, coded for
133
training and feedback, content support, video production, and assistants such as Teaching
Assistants (TAs), Research Assistants (RAs), and Graduate Assistants (GAs).
Training and feedback. It could be a daunting task for instructors to design and develop an
online course that involved a lot of work that went beyond one’s area of expertise. Interviewees
stated that they used existing faculty support services at their institutions or were offered various
opportunities for professional development to get adequate training for teaching MOOCs.
Interviewee 01: So, the [institution’s name] has an, a central office that is affiliated with
our Provost’s office, called the Office of Academic Innovation. In this-this office,
supports um, online programming across the entire university. It’s a team that includes, I
don’t know the exact numbers maybe 30 people. It includes um, instructional designers,
video, um…Media production and right, it includes people whose job it is to do the-the
course build on edX or Coursera or another platform. Um, it includes people whose job it
is to um, publicize, and promote MOOCs. It, it’s um, it includes people who look for
funding opportunities. So, it’s-it’s a very um, highly developed central function of the
university, and ah we, and with that, none of the individual colleges and schools have their
own capabilities for this. It’s very centralized.
Interviewee 05: We started some, we had, none of the contributors had prior experience
with MOOCs. So, this is why we decided to, to, we met several times with people from
the Online Learning Department at one of the universities. So, people who have seen
MOOCs and how they have created and experienced with that. So that they would give us
advice on how to do it. And we wanted it to be as ah, like self-operational as possible. So,
when ah, we wanted to minimize the interaction and the maintenance, and, and, and
instructor interaction.
Interviewee 02: I got started on this about four years ago. Um, the then head of our
institution, ah, used to teach at the [institution’s name]. Um, so when he came and joined
us, um, he connected with edX because he had been working with them earlier. And he
asked myself and two or three of my colleagues to actually travel to [city’s name] to get
the experience of ah, you know, what, what is MOOCs all about and how is it benefit a
134
large community of students. So, we attended the workshop, we interacted with the
faculty at [institution’s name] and [institution’s name].
Interviewee11: So, we, we did go, we flew out to Coursera’s headquarters and they, um,
they trained us for I think three days. Um, through Coursera ah, they were able to help us
out with, even though a lot of their material is online to help you out understand ah, what
you need to put into your courses, we could always go back to our, not Account Manager,
I can’t remember what we call them. But um, we went back to our reps at Coursera and
we could ask them any questions that we-we wanted to. And they were also looking at
does this course meet their expectations as well.
Seeking advice and obtaining input from professionals or learners were considered an
enormous help by MOOC instructors in this study, especially to those who were well-organized
individuals and required strict adherence to deadlines.
Participant 11: Nope, just me. And in fact, we didn’t even have instructional designers to
help us with the first, any of the MOOCs. So, if we had the instructional design, I think we
would have had a lot less headache, um, going back through, and looking at content, and
making sure that um, it’s understood by everybody. Ah, we do have instructional
designers for the university. But they are not focused on MOOC development. I’m in a
unique situation as well. I, I am very, because I run, I tend to believe I-I run a business
inside the university. It’s not just teaching. I’m running massive systems um, for the
university. For IT, I organize things much better than I think some of the faculty do to be
candid about that. Um, and I have deadlines, and I have, I have things that I need to get
done. So, if I’m not constantly setting those deadlines and making sure that my, what I’m
understanding or what I’m putting forward is understood by others, then it’s very difficult.
So, I got mine my two done, ah, before the others finished theirs, [wow] just one. So, um,
because I have deadlines, and because I push it quite a bit. Now that’s not to say, you
know full-time faculty have a huge amount of work anyway, it’s not a, obviously, it’s not
a cushy job to just have a, a faculty position you got to do a lot of work. And so, it’s not,
it’s not that they don’t have a lot of work to do, it’s just that I have a, I have to make sure
that I’m on track with everything that I need to get done.
135
Interviewee 04: I was the designer. The students were quick critics. And so, for example,
they said you know because the-the material is complex, and so the slides are dense, and
they said and I-I tried being the talking head and decided I was going to shoot myself and
I wasn’t gonna do that, and so they said okay, you have to make wrappers. And so if you
go in and look at the course, at the, at the beginning and the end of most lectures, there is,
I’m saying something about what’s coming and something in so they so the students who
were watching it saw me [yeah, yeah]. And so the students were wonderful in giving those
kinds of suggestion, and of course, they said you know you need cartoons to go with that,
and you know they had these ideas and somebody knew somebody who could do that and
of course, it never happened and so I ended up during all the cartoons, so yeah. I spent a
lot of time on the course. They were very helpful, and I couldn’t have done it without
them.
Content support. A course with well-developed content not only helped instructors but
also enhanced the learning experience of students. Interviewees stated that they received support
in content development either from professionals at their institutions or from Coursera, which
was the key to a MOOC’s success. Examples of interview comments were given below.
Interviewee 03: And, edX, which is over in the main [institution’s name], which is in
[city’s name], they also have people who know how to do it. So, we had someone come
over and just tell us, you know, you don’t just stand up and give an hour lecture. You take
an hour lecture, you break it down into little chunks, and then you do your chunk and then
you do the last slide saying that in the next chunk we’re gonna do this and then you go
welcome back, um, you know. And so, they told us how to do it, then they looked over
our slides to make sure the chunks were the right way and everything like that. Then they
were there, when we were filming them, and especially at the very beginning, you do it
really badly. So, you know, you do your first chunk and they look at it and they go, mmm-
no. Um, and so you can redo it, you can redo any of the chunks that you want to. So
they’re there with you the whole time and they’re sitting there listening and going, I think
you stumbled over a word or, in this segment, you said this, and in this segment, you’re
saying that, and then you just go in right there and change it. So, um literally, my job is to,
they tell me what to wear, okay don’t wear stripes, don’t wear this color, and so I get
136
dressed properly, um, [laugh] I stand there, I look into the monitor um, I give my thing,
and then they take it from there um, and do it.
Interviewee 10: If you go on to the Coursera platform as an instructor, there are some
resources on there about how to develop content and deliver content. Um, the people at
[institution’s name] were very, um I mean they have a whole operation there with a lot of
people who are working with faculty to develop content and to push it out through
Coursera. So, I knew that they would help me, and they told me they would help me. They
told me you know you don’t need to worry about learning how to do this. Video production. Using videos was one of the predominant means of delivering
knowledge in MOOCs. Discussions were held on how to produce videos in the context of
MOOC and what support/training was needed for video production, mainly focusing on how to
make an engaging and high-quality video as well as how to give a lecture in front of a camera.
Comments from the interviewees were provided below.
Interviewee 04: I tried being the talking head and decided I was going to shoot myself and
I wasn’t gonna do that, and so they said okay, you have to make wrappers. And so, if you
go in and look at the course, at the, at the beginning and the end of most lectures, there is,
I’m saying something about what’s coming and something in so they so the students who
were watching it saw me. And so the students were wonderful in giving those kinds of
suggestion, and of course, they said you know you need cartoons to go with that, and you
know they had these ideas and somebody knew somebody who could do that and of
course, it never happened and so I ended up during all the cartoons, so yeah. I spent a lot
of time on the course. They were very helpful, and I couldn’t have done it without them.
Interviewee 05: So, interestingly, um, luckily, and so I recorded the videos while I was
already shortly after I arrived here at [institution’s name], although the university is not
directly involved in the MOOC, and, but it happened such that they also have a contract
with edX. That’s just like a, like a curiosity on the side, but they have, so they have an
online learning department, and they have a small video studio, and they were surprised to
record the videos with me free of charge. So that the videos are very good quality, and
137
therefore camera and lighting and stuff. So, yes, they, I was able to do the videos with
them.
Interviewee 08: So, we have, we actually have a, you know, a complete video production
enterprise at [institution’s name]. We do have um, ah, different programs that are based on
kind of a teleconference format. And we also have many other MOOCs, so this was not
the first MOOC that was being produced. There was the whole machinery to support my
work.
Interviewee 09: Well first off, you have to understand I’m in a journalism school. So, what
happened was the ah, one of the top people in the IT department, they had a team of
production people and, and a director. And so, they brought in a team of five and Coursera
gave us X amount of dollars which the university was just gonna, thought we’d just spend.
And I went in and tripled the amount of money. I said you got a kick in this you know
double the amount. And we put it together. So, we hired a very professional team, we had
our own music brought in, we ah, we shot, we had a makeup person, we had several that
we’re doing scripting, as well as, ah, director and a producer. We had professional
lighting, I mean, it was done on a professional set. And we had the, you know, I had the
script you know that I could read as it was going. And so, we would do a lot of shooting
the ins and outs as well as you know recording the, the speakers. But then we would edit it
all down and really get to the really good stuff.
Interviewee 11: So, we have an on-campus TV studio, um, which is, believe it or not, the
best, the best TV studio in the city we have. Um, so we did it here video, the students
filmed it. They’re part of the um, they’re part of the film classes that we have here. Ah,
and then the second one, I just couldn’t, I need to speed up the production. So um, we
went with an outside company to do that. The university paid for it, and, um, yeah and
then the university was repaid from, ah, the monetary whatever they got from Coursera.
Interviewee 12: They, well they used my video, yes. And then they helped to refine it, cut
it down, put it together. Likewise, they taught me how to use the equipment for recording
the MOOCs, set it up in my office, and I recorded on my own. But they would then take
the video, edit it, cut it down, and make it look ah, make it look good.
Assistants. Keeping students engaged with the instructor, the content, and one another
promoted student success in an online learning environment. MOOCs recruited research
138
assistants (RAs), teaching assistants (TAs), graduate assistants (GAs), or student workers to
enhance student engagement and the instructor’s presence, provide prompt feedback, answer
common questions, post replies, moderate online discussions, and unleash gradebook.
Interviewee 01: Well, we raised some money, I mean, I had to get a grant to get the
graduate student support that I needed. I got a lot of voluntary support from other graduate
students.
Interviewee 02: Yeah, I have a filtering mechanism. Um, my research assistants both of
whom have very high domain knowledge, and who have now also switched on to, ah you
know, the HTML coding and everything that goes with turning a raw video into an edited
finished product. So, they are an integral part of it. Um, I ask them to go through the
discussion board. Ah, so whenever the discussions appear on the discussion boards, one of
my research assistants who’s helping me with the course, if it’s an easy question, it’s just
one clarification, etc., she responds to it herself. Ah, if it’s a tough one, it could be a little
controversial or difficult to argue, those get passed up to me. They just send me the-the
hyperlink, ah, so in my free time, I just go into it, look at the question, give a response,
and be done with it. So, I’d say about 70% of the ah, questions they get posted on the
discussion board are handled by my very capable research assistants. Ah, maybe 30 %
comes up to me and that takes a lot of effort to respond. Ah, That’s-that’s the way it goes.
Interviewee 03: So, we had teaching assistants who did all that, so the teaching assistants
would run seminars um, on a regular basis, they would do office hours, and then there
were homework assignments that they needed to, um, they needed to do and then would
send back.
Interviewee 04: But we had, that was another thing that I used ah, students that had taken
the class, so they knew the material to monitor the discussion session.
Interviewee 09: The way Cours-, I don’t. The way Coursera works though is they pick
some of the better graduates, and they become mentors. We generally have two to three
mentors in the course at any given time across all of the different MOOCs.
Interviewee 11: So, Coursera actually offers Tas. I have rarely stepped into the discussion
forums. Coursera offers instructors, um yes, people to help out with the course. But they
have taken the course before. They’re not in Coursera employees, as far as I know.
139
Nonetheless, unlike most of interviewees who embraced support enthusiastically in
developing and delivering MOOCs, two interviewees explicitly stated that they preferred to do
some MOOC work independently because they felt that getting someone to assist was not as
effective as other interviewees experienced.
Interviewee 05: Ahem, when the MOOC I do it myself since um, the MOOC contains a lot
of different topics, um, usually the teaching assistants they’re not, they’re not experts
enough in everything, may or maybe not in the topics also. So that it, it seems easier for
me to just do it myself rather than have somebody always have to ask me. Um, yeah, so
many I-I-I many times if it’s, if it’s, if it’s a significant effort to delegate something I
rather do it myself because um, it’s, that’s more, more efficient and more rewarding than
just tell somebody and then this person might not be able to perform the task.
Interviewee 06: The fact that the first time we did have such help, and it was a disaster
only convinced us that we don’t want it.
Specific competencies were required to do MOOCs.
Teaching a MOOC was considerably different from teaching a face-to-face class. MOOC
instructors were expected to have some core competencies and skills to facilitate student
learning. Therefore, interviewees suggested several competencies needed by MOOC instructors
in the following five categories: 1) commitment (time and effort); 2) content expertise; 3)
understanding of online teaching context; 4) camera presence; and 5) language accessibility.
Commitment (time and effort). Teaching online required a significant amount of time,
effort, and preparation, especially in MOOCs characterized with a massive number of
enrollments. To architect a good learning experience for students, MOOC instructors needed to
integrate instructionally sound learning theories and frameworks, project planning, content
expertise, communication, writing, and various technologies. One of the interviewees shared his
insights on what qualities a MOOC instructor needed to have.
140
Interviewee 06: So, I think you have to have a willingness to really think deeply about
how to scaffold the material so that learners can learn independently, and so that they sort
of gain the insights through experience as opposed to through um you know, conventional
means. Um, so it takes a lot of time, it takes a lot of thought, and it takes a lot of desire to
really, you know have the student discover the material and the on the, gain the
understanding independently as opposed to using the model of you know, God passes
knowledge to the instructor and the instructor passes it to the student which is the
traditional way of doing it.
Content expertise. Interviewees stated that MOOC instructors should be capable of
demonstrating an in-depth knowledge of the subject that helped students achieve their learning
goals.
Interviewee 07: You need to know your discipline. You need to have a course that you
feel is your best course in terms of communicating to students. I would argue that unless
you’re at a place that’s really dedicated to doing a lot of MOOCs, that it should be
specialized in some way reflecting a research interest or something that your institution’s
known for.
Interviewee 08: As a MOOC instructor you have to know what level you’re hoping to, ah,
what level of knowledge you want to convey. And so, I think that the most important
thing is that the instructor is clear on what the goal is of the class. But I think that’s the
same thing ah, for teaching, ah, you know students.
Interviewee 10: I think um, I think a really strong command of your subject I think, is
important.
Understanding of online teaching context. Being a MOOC instructor, knowing the
pedagogy of online teaching, such as how to teach online, both synchronously and
asynchronously, would help deliver a successful MOOC. Three interviewees shared their
opinions in this regard such as how to respond to learners, how to meet the needs of international
learners, and how to engage students.
141
Interviewee 08: So, I think that um, if I think about the competencies, I think that you
have to be, um, you have to be responsive to the medium. And by that, I mean that,
understanding that this is asynchronous. It’s really important because that means that you
have to be very direct and explicit about what the goals are for your class. Because you
know that people can’t ask you questions in a sense. If you’re in class, you can imagine
that you can have goals for the class. But if these goals are not being met, that you’ll have
feedback, either quizzes or you know a student is looking confused or whatever. But that’s
not the case with, you know, with a completely asynchronous you know, or more than
asynchronous with um, this, this kind of a platform. So that means that ah, I have to be
very deliberate about what my goals are, and how each lesson is meeting that goal [right].
Yeah. Beyond that, I mean it’s the same, I don’t think there’s anything different to tell you
the truth.
Interviewee 10: One is a strong sense of how to structure, organize and talk about a topic
for an international audience who will have a great variety of educational, um, educational
levels and linguistic skills. So, in other words, how to, how to meet as many of those
needs from a heterogeneous audience as possible.
Interviewee 11: They should understand how students learn online. And I think that, and
one of the things that I’ve told my leadership, um, if we’re gonna keep on doing more of
these, is that everybody needs to either have an instructional designer helping them, or at
least they need to go through a ‘Quality Matters’ preparation course like I did to
understand what it really takes um, and to show that these things are trying to be helpful
for students because we don’t see the objectives in um, what are you supposed to learn
this week? What are you supposed to be learning over the course of the entire um, class
period, or the entire semester? Um, we don’t do that enough. Um, so I think that
instructors really need to understand how their students learn. And understand that it is a
lot of work to try to understand the breadth of instruction that you are gonna have to do to
make sure that it’s understood by everyone, not just the students who are your target
students.
142
Three interviewees discussed actionable strategies to meet the needs of learners and to
build connections with them. Specific approaches for engaging students were discussed as
follows.
Interviewee 02: Students are an abstraction in the MOOCs to me, and your ability to make
connections in that abstraction ah, makes a huge difference. Um, the ability to connect the
students who you don’t even see. They should be, feel very personalized, you know. So,
the question in the discussion board, the way you respond, always [voice cut out] their
name, make it a very personal communication.
Interviewee 09: You know what it makes you human, and it makes it a very humanistic
learning experience. And so, students are just amazed that they can go out on Twitter and
ask me a question and I’ll answer it the same day. But I do, I work on it every morning,
afternoon and evening just for a few minutes. But I’ll answer every one of their
comments, and I give them advice as to how to get, you know, they say “but I can’t get
anybody to do my peer things.” It’s like here are the resources you go to. And if those
resources don’t work, then I’ll get involved and take care of it. Because I want to have
them satisfied.
Interviewee 10: Um, the only other thing I would say is, if you have the ability to stay
engaged with the MOOC, in other words, if it’s a part of your job and not something
you’re doing as a side gig like I did, I think it would be important to spend more time
going on the site, be part of a discussion board, um, engaging with learners. Because, we
know for a fact that online learning is really only engaging when, when faculty stay
involved with it.
Camera presence. Interviewees revealed that presenting in front of people as opposed to a
camera were two completely different things. When asked to speak in front of a camera, MOOC
instructors usually didn’t know how to behave accordingly or transfer their public speaking skills
to talking to a monitor. Mostly when the recording was on, they got trapped because the face
froze, words stumbled, and the brain blocked, although most of them were seasoned presenters
143
with rich experience in giving lectures. Interviewees shared their funny stories of recording
MOOCs and made recommendations below.
Interviewee 02: The challenge is, ah, the ability to stand in front of a camera and deliver a
course and turn it into an engaging MOOC. Ah, being able to handle the camera is only
one part of it. Turning into an engaging MOOC requires a group of people who you work
with very closely to deliver. For the first few videos that I produced, I was still on the
learning curve. [Ahh] But, as I went along, it-it got better. And by the time I thought I am
doing a reasonably good job, most of my videos had already been produced and [voice
lost]. That-that’s the way it is. Um, so that’s the challenge actually. A lot of instructors
who have been teaching in the classroom for very long. This is a barrier. My, a lot of my
colleagues refused to get into doing the MOOCs for exactly the same reason.
Interviewee 03: It’s very disconcerting to teach to a monitor. You know to (unintelligible)
– you know, that is the most occult thing about doing it, it is realizing it doesn’t matter for
you if it’s online, if it’s online filming as opposed to online where you actually WebEx,
give a teaching. Um, for me, the hardest thing was not having eye contact with the
student, no, no way to, no way to understand to know if they understood it or not, if they
didn’t should I be giving another example, can I stop giving examples, and that you have
to look at a light on a monitor, and communicate with it. And ah, that takes a little getting
used to basically.
Interviewee 12: The second one I think, is the ability to, is the ability to give a lecture to a
screen while being able to pretend that you have students on the other end watching you.
Because it’s, it’s very lonely and miserable and strange work otherwise you know. Language accessibility. In addition to English, a considerable number of MOOCs had
been distributed in multiple languages. Interviewee 10 claimed that accessibility of languages
deserved particular attention when involving international enrollees in MOOCs.
Interviewee 10: Now that I know how many people read or watch MOOC are rational
learners, I think it would be really important to think about language accessibility. Um, I
didn’t think about that because I, it didn’t occur to me, and the people at [institution’s
name] didn’t say oh by the way most of the people will be from other countries. Ah, but
144
now that I know what I know, I think if I were going to give someone advice, and they
were doing the same thing I did like using a platform that goes out, gets pushed out
through a big international research university, I would recommend that they really think
hard about you know making the language maybe 10th-grade level. Because at the end of
the day, it was an undergraduate-level course, but it was primarily international learners.
So, I do think that you have to take that into account.
Another interviewee, however, used Google Translate successfully, interacting with
students who spoke a different language other than English in his MOOC.
Interviewee 02: I tried something ah, really interesting. I have a bunch of Portuguese and
Spanish students signed on to my course. Ah, they posted their questions in Portuguese,
and somebody else did it in Spanish. So, I didn’t know what it was. I couldn’t understand
their languages. So, I copied and pasted that into Google, I prepared my response,
translated it into Portuguese, and I posted it on the discussion board.
[unintelligible]…non-Portuguese I said this question is in Portuguese, and here is the
English language equivalent, and then here is the answer. And to the Portuguese student I
told him in Portuguese, thanks to google translator, this is my answer, forgive me if the
Portuguese is, is not grammatically correct. Yeah, that guy sent me a response with you
know smiles and so on and so forth. Ah, in Portuguese, it said fantastic professor, you
know.
Instructional Design was essential to MOOCs.
Online education could be beneficial and rewarding if suitable methods of instructional
design were used to engage students. Interviewees elaborated on why instructional design was
essential from three perspectives of MOOCs: attention span, supplemental materials, and
engagement and interaction.
Attention span. Videos were commonly used to engage students and effectively improve
their learning in the online environment. In general, the optimal length of an instructional video
was approximately 6 or 7 minutes. The interest of a viewer dropped rapidly after 7 minutes. This
was noted by four interviewees.
145
Interviewee 05: Um, longest one would be somewhere I think on nine and a half minutes,
the shortest would be more like two minutes, so kind of five-ish six minutes is kind of the
mean or median or something. But sometimes it’s short, sometimes it’s a little longer.
Interviewee 08: I think that basically for every, I think for every lesson right, where a
lesson might be I forget like seven minutes right, yeah or even shorter because that’s the
attention span, right, you should be able to ride out, you know a trolley from one course to
the other and finish a lesson.
Interviewee 09: We broke everything into seven-minute videos. So, most of mine are in
the four to five-minute range. But I agree if you go over seven you know. It’s just like I, I
had a company that they sent me their videos and they were half-hour videos. And I said
nobody’s gonna watch a half-hour.
Interviewee 12: Um, it could be anywhere from 5 minutes to 20 minutes. For the most
part, we had hoped to keep them between 8 and 10 minutes, because that seems to be how
people function the best.
On the contrary, one interviewee stated that she did not like to limit the content to 20
minutes or less because it was challenging for her to compress meaningful and necessary content
in a short video. She commented,
Interviewee 10: And I think that the goal of the people at [institution’s name] was that the
recorded time would be under 20 minutes. And then we had like supplemental readings
and other materials that we used also that were, um, you know, that were used to enhance
the students’ learning. Um, you know it-it was a little funky because I’ve never taught a
class before that only lasted 20 minutes. Um, and I didn’t, you know, I didn’t exactly love,
hold on, I’m just plugging back in here. I didn’t exactly love that because you know, it’s
really hard um, to cover a lot of meaningful content in 20 minutes. And we had and, that
was kind of all we could do.
Supplemental materials. MOOC instructors invested in a plethora of thoughts, time, and
effort, as well as incorporated high-quality learning resources while creating a MOOC. Without
question, they would recycle some of the well-crafted MOOC content to promote student
learning in their face-to-face courses as needed. Below were examples of their remarks.
146
Interviewee 04: Well, if you, if you couple it with, with your classroom teaching, I think it
adds benefits to the classroom. You can, you can put the lecture, you know you can put
the material that you want them to have, available and be able to talk about, you can put
that out in the video. Then you can spend class time, and you can do other things online,
but you can spend class time on taking that material and putting it in a different context
and think about the material itself.
Interviewee 05: But they, but I sometimes, I some of the video since, since the topics of
the MOOC are fairly fundamental, and um, I can make use of, the, especially the video of
it in my regular teaching, so that, that’s kind of a like a secondary, second-life use of the
materials.
Interviewee 07: What happened was is that after I did the MOOC, I began to incorporate
more flipped learning into my classes. So now we do flip learning and we do more hybrid
materials in that Common Core class I mentioned. So, the students will interact with
learners from the MOOC, and I get to know these international, kind of, fellow learners,
and then they’ll work together with that in that kind of time.
Interviewee 08: So now I basically tell people if you wanted to get, you know basically a
sense of what’s gonna be going on in class, or if you missed something in class, you can
always go to the Coursera material [mm-hm]. So, I give them the option to um, you know
ah, to use a material to supplement their in-class time.
Interviewee 09: Not only do I use it, and I still have some that I kept because certain
foundational things don’t change, um, I other, other professors in the ah, in the schools
have used them as well. And so, we made them available to any, to anybody. And, uh,
yeah. And so, a lot of the, lot of the other professors liked it because I had modules on
data governance and data security and if it was appropriate, they could use that in their
classes.
Engagement and interaction. MOOC learners had varied preferences for the interactions
of learner-content, learner-instructor, and learner-learner. They might select one type over the
other for varying reasons. Interviewees found engaging with learners in MOOCs challenging and
time-consuming, especially in those MOOCs with a massive number of enrollees. One
147
interviewee stated that he attempted to run a “self-operational” model in his MOOC to minimize
the interaction. Interviewee 05 stated,
And we wanted it to be as ah, like self-operational as possible. So, when ah, we wanted to
minimize the interaction and the maintenance, and, and, and instructor interaction.
MOOC communication was concerned. Interviewees’ responses differ from each other.
Interviewee 10, for instance, said,
I think it would be important to spend more time going on the site, be part of a discussion
board, um, engaging with learners. Because, we know for a fact that online learning is
really only engaging when, when faculty stay involved with it. And had [institution’s
name] paid me more, then basically a small fee to develop the content, I probably would
have done that, and I think, look, I would have had a more engaging experience, but more
importantly, my students would have. Um, and you know I talked to Julie I don’t know
maybe six months after the MOOC launched and I said, hey have you ever gotten the
discussion board and she said, oh you know I just hadn’t even thought about it. I’m so
busy with my own teaching. And, we’re gonna only give most of our attention to the, the
students who are right in front of us. So, if people who teach MOOCs were compensated
enough, and we’re committed enough, I think it could be a much better experience.
Interviewee 11: But I’m not, I’m not in the discussion forums all the time at all.
Interviewee 12: I have a TA from Coursera and if questions come up and he can’t answer
them, he notifies me, and I will go on once in a while and answer a question that he can’t.
But for the most part, it runs on its own. So, I am not, it is not a MOOC in which I’m
actively involved.
In comparison, three interviewees stated that they were very interested in engaging
learners through virtual office hours, discussion boards, or additional communicative tools
regardless of a massive number of learners. They were enthusiastic about the experience of
communicating with MOOC learners. Their comments were provided below.
Interviewee 01: The first time I did morning office hours, a woman who was from Paris,
who was actually in Quebec who was working as a school leader in Quebec, you know
148
she was the only one who checked in so we had coffee together and, and had a wonderful
morning. And she went her way, and I, I had mine. And it was a pretty incredible way to
spend a morning, mmm, from here and my humble little [city’s name] bedroom office. So,
anyway, [I like your office] I put EEOC’s on it. Oh, thank you. I mean, I, I do find it
really exciting though I mean it’s, um, you just realized that there really is a lot of
potential in all of us.
Interviewee 02: Um, I-I will always be very active in my discussions. The-the, ah, my
research assistants are told every question you must give a response ASAP. And whatever
is not done, send them up to me if you find that question difficult or tricking. I’ll handle it
and I’ll make sure I get back in 48 hours. I, I learned this ah, from ah, Allen Agrawal
who’s actually the person behind the edX initiative at MIT. I mean he’s the one who
started all this off. Ah, so when I met Allen, ah, one of the things he told me was, he said
PC when you’re doing a MOOC, make sure you as the course instructor is active on the
discussion board. Ah, that’s the way you connect with your students/learners. And the
webinar, you know the reason why I thought of the webinar was it’s, a -it’s a way for
them to ah, see me in a different mode. So, I’m in a t-shirt from the webinar you know I
don’t wear a suit and a jacket and a tie. Very informal and it helps. So those are, if I look
back, those are the two or three things that appear as a challenge, but we cracked it and it
worked. And it worked very well.
Interviewee 09: I have a team of people who are always engaged with the discussion
boards as well as with the s, with the students or the participants, to make sure things are
going well for them and answer any questions they have. Um, I do a lot of engagement
with the students that are ah-um, through the forums, and they helped me to understand
that where I’m efficient, where I’m not. And so, it’s a- it’s a very different way of
teaching, but I really like it. Um, this even the students in my courses now say these
videos are great you know, much better than wa-, than reading. And I think that that’s
probably true.
One interviewee suggested that learners in a MOOC should be given clear communication
explaining how quickly the instructor would respond. Because a successful learning experience
was heavily dependent on effective communication between students and the instructor.
149
Interviewee 03: If there’s going to be um, communication, between them and you, like-
like the Tas except even for them but for me to you-you have to put limits on when they
can contact you, or more importantly how soon you’re going to get back to them because,
with 5,000 people, you simply cannot be at their beck and call every time when they want
to write you. So upfront, you have to say I’ll get back to you within 24 hours or something
on that or you have to put limits. I mean, you almost have to put limits when you’re
teaching a course in person but you really have to put some sort of expectations in place
when you’re doing something where there are time zones all over the world and we got
5,000 people who are actively doing something. I-I think you can’t answer the questions
all the time. We did in one of them put in a discussion board, and it turned out that it was
very useful because with 5,000 people if someone puts up a question someone else from
the class will answer it.
Challenges faced in delivering MOOCs.
Some major issues, such as feeling overwhelmed, one-size does not fit all, copyright and
fair use, assessment, high enrollment and low completion rates presented obstacles for MOOC
instructors.
Feeling overwhelmed. Several interviewees and survey respondents claimed that
developing and participating in a MOOC made they feel overwhelmed due to a shortage of time,
immense workload, the difficulty to get MOOC work recognized and justifying the expense.
Their statements were given below.
Anonymous survey respondent: Weekly preparation time was after the MOOC was
designed and completed. Creating the MOOC in the first place was VERY time
consuming - I spent most of the summer and a semester constructing the MOOC.
Anonymous survey respondent: I would like to take a more active role in my MOOC
someday, but right now I just don’t have the time because of all the teaching and research
responsibilities I have for my job.
150
Anonymous survey respondent: Developing MOOC material is more time-intensive than
for traditional teaching, especially professional-grade multimedia. The return on
investment is marginal at best from a financial perspective.
Interviewee 02: In fact, now I keep getting query saying prof, can you do one more
MOOC course on this topic. You know, ah, some of the emerging subjects. Um, so I said
yeah. I mean it challenges me to do it and, very time-consuming the first time around, you
know. To put together a good MOOC, it takes about six hours, six months. To
conceptualize it, to turn it into sessions, videos in each session, the comprehensiveness of
each video, the quizzes, work on the summary of each week, the quiz, ah, you know it’s-
it’s hugely time-consuming.
Interviewee 04: I spent a lot of time on the course. I mean it was overwhelmingly
consuming in terms of time. It, at-at least what I did and how I did it. There may be other
ways to do it, but I watched other people around me do it, and everyone says it’s very
time-consuming.
Interviewee 06: So, creating the course, took, 12 months of working 12 hours a day, seven
days a week. We worked on Christmas, we worked on Easter, we worked when we were
running a 103-degree fever, ah, this was a continuous one year of both of us working on
this essentially continuously. Once the course sort of stabilized, I would say that now we
probably spent still between 20 and 30 minutes a day just answering questions on the
discussion board, but it’s much more manageable now obviously.
Interviewee 07: So, it’s quite you know, it’s labor-intensive to keep ah, the MOOC afresh
and to respond to what’s going on on the MOOC.
Interviewee 10: I’m gonna estimate that I put about 20 to 30 hours of work into writing the
script, and so going over them with Julie, before, before I flew to Pittsburgh to record
them. And that was, that was a full day. So, the full day of the time the studio, um, plus
maybe 30 hours of work, um, to write the scripts, to edit them, to add graphics, to put you
know the charts and the, all the pictures in. Um, so maybe yeah, a total of 40 hours. Um,
and then as I said, I wasn’t asked or expected to go into the discussion board, I did it a
couple of times because I was curious. But I didn’t spend very much time in the
discussion board. So, I did, I did what I would call a respectable job, but I didn’t, it wasn’t
a huge output of labor.
151
Interviewee 11: I don’t have the time to grade everything um, on Coursera.
Interviewee 12: Um, if I had known how much work it was going to be when I agreed to
do it, I probably wouldn’t have done it. And in fact, the only way, the only way the reason
that I am revising it right now, is that my University gave me next semester off. So, they
gave, they gave me, yea, they gave me time off. I did not have time off when I did it. I did
it on the side. But I frankly refused. I was simply, I told them either I’m gonna take it
down, or I’m gonna need, you know credit, for revising it. And they and they gave me
credit because it’s brought so many graduate students to, to our program.
The workload of a MOOC instructor was huge during the course development and
instruction cycle, such as scaffolding the course structure, writing the learning outcomes,
drafting weekly lesson plans, designing activities and assessments, crafting lectures and
recording them. Statements from survey respondents and interviewees were given below.
Anonymous survey respondent: Developing a MOOC is very labor-intensive, and even
with a great team of undergraduates, it was an exhausting enterprise.
Anonymous survey respondent: Developing a MOOC was MUCH more work than I ever
imagined!
Anonymous survey respondent: I cannot say the number taking the MOOC hence why I
put in 0000 to this question. I know it is over 1,000.
Anonymous survey respondent: It took 15 months of hard work to develop our MOOC.
Anonymous survey respondent: When I said “0” for hours preparing, that’s now that my
course is live. Of course, there were many, many hours required to produce the course.
Interviewee 11: Challenges, it’s a lot of upfront work, it is a lot of work to anticipate.
According to survey respondents and interviewees, making MOOC work acknowledged
by their institutions seemed to be laborious. They suggested that junior faculty could initiate a
conversation with administration or university to share this concern prior to start the MOOC
development work. Comments from the survey respondents and interviewees were as follows.
152
Anonymous survey respondent: I only wish my university would consider this part of my
regular teaching load (the university considers it a “spare-time” project). I wonder how
many MOOC instructors are in a similar circumstance with their university.
Anonymous survey respondent: Sadly, my university has stepped back from MOOC
development, and there was no monetary or other recognition from my department or the
university for the work we did. I am glad I did it, and I would like to do more. But the
incentive structure does not exist.
Interviewee 03: If they’re a junior person, I would want to make sure that their university
valued teaching in a MOOC because teaching is required for all of us. But if the university
doesn’t think that MOOCs are as valuable as teaching a class in person, I don’t want them
putting all that time in to find out that when it came they came up for promotion they just
said that was just a MOOC, you know you didn’t interact with students or something on
that order. So, I think it’s very important to understand how the teaching in a MOOC will
be, um, interpreted by the promotion’s committee where they are.
Interviewee 04: Well. I-I’d tell junior faculty do not do it, [laugh, okay] unless you’re
planning to put your course as a flipped course, and you start from scratch and think about
the MOOC and the course at the same time. Understand what the MOOC requires and
understand what the course requires and see where those interfaces. [mm-hmm] Um,
because it is, I mean it was overwhelmingly consuming in terms of time. It, at-at least
what I did and how I did it. There may be other ways to do it, but I watched other people
around me do it, and everyone says it’s very time-consuming. So, an assistant professor
cannot afford the time unless they’re going to be judged on their teaching unless they’re
encouraged and will be rewarded by their department for doing it.
Interviewee 12: Well, my main, my main suggestion is not to, to faculty members but to
administrators, and that is to recognize that this is very different and that it is important to
incentivize, recognize, and reward faculty for doing what I think is a public service. Um,
and for faculty members, I would say that they need to negotiate that with the
administrators, and in particular make the case that this is not, I’d only help you know
disseminate knowledge about a particular topic, but it’s actually an excellent branding
opportunity for any university.
153
One interviewee said she had a tough time to justify her MOOC work to her institution,
especially the MOOC expenses. A similar comment was made by an anonymous survey
respondent. Their claims were laid out below.
Interviewee 07: Um, I think that the expenses involved, I think, ah, are oftentimes hard to
justify for my own institution. So, I’ve always constantly tried to justify what I’m doing.
Anonymous survey respondent: In engineering and technical fields, producing a good
quality MOOC takes an enormous amount of time and effort. It is worthwhile for the
impact it has, but without the possibility of royalty payments very few would undertake
such a large task. There isn’t a way to justify the time otherwise unless time off is given
for development.
One size does not fit all. Interviewees indicated that MOOCs were not one-size-fits-all
models in all subject areas and levels of academic degrees. This might be considered by
educators who are interested in making a MOOC. Comments from the survey and interviews
were provided below.
Anonymous survey respondent: A MOOC is a great way to teach the theoretical
component of a professional course that also has a practical workplace component.
Anonymous survey respondent: I think that it is good that MOOC exists, but I see them as
a complement to traditional courses, not as a replacement.
Anonymous survey respondent: I think MOOC’s fill a very nice gap. People can learn new
things and then decide if this might be a course they could take on a more formal basis. I
do not think it will replace traditional classes. However, it could serve to augment them in
many significant ways.
Interviewee 02: There are courses I agree which are highly intellectual in their orientation
like a high-end research ah-ahem course, I wouldn’t do that using a MOOC, because it
calls for a lot of interaction in the class. But something like Econometrics research
methodology, marketing research techniques, you can easily deliver that through a
MOOC.
Interviewee 03: To be honest, I don’t think much with a MOOC, um, you know there
might be better MOOCs than ours. Ours were really to introduce people to the field and
154
give them an opportunity to get some basic understanding and then maybe they could go
back to an online degree program or something on that order. Um, I don’t know, I’m not
as knowledgeable as you are about what-what is the distribution of MOOCs, you know,
how, can you, can you get a degree with a MOOC, or is there a deeper MOOC you know
where you really go into a testing center and you really do it much more rigorously. But
for what I know the MOOCs that we’ve got to do no more than this, I, I don’t think they
would fulfill degree program requirements.
Understanding copyright and fair use. MOOC instructors were plagued by fear and
uncertainty about copyright law in MOOCs compared to face-to-face or online classes. Some
universities provided MOOC copyright guidelines for instructors to follow, some were not clear
on this. Several institutions told their MOOC instructors that the intellectual property of MOOC
content belonged to the employer (i.e., the school/college/university). For example, interviewee
03 said,
The videos are the schools. I mean, I can’t take the video anywhere. There’s no way to
take a video anywhere. So, the question is though, when you’re doing a flipped course,
where you want them to watch videos and come to class, can you have them watching
these videos? Is that, is the MOOC course gonna stay open forever so that the student can
go in and watch something, and then you can use it and it’s only very, I’d say within the
last few months that the word has come down, that the videos can be put into a library,
and the students, any student would have access to it. It means we can use them now for
the other courses. So, if I were talking to anybody who is gonna do a MOOC course or an
online course, it doesn’t really matter, I would tell them to ask the first question is, what
are your rights in terms of the material? Will you be able to use the material again? And I
understand why they wouldn’t want us to have the videos because once they go to all this
trouble, and it costs money to do this, you have to have a studio, you have to have people
doing it. Let’s say I get hit by a bus or let us say I decided to go elsewhere, they want to
still give the course. So, they have to own the copyright to the videos so that they can
continue to give the course even if I’m not part of the institution. I understand it very-very
clearly. But on the other hand, I need that material to go ahead, yeah, but I did it, but I did
155
it with their equipment. So, it’s just a little bit different than teaching in a class because
again written material, exercises and all that no one would disagree that material is
intellectual yours. But the videos, it’s hard to know who the videos are, so it’s just worth
always somebody checking before they do it.
Interviewee 04: You know I had sort of the basic course, but we had to put it online which
turns out if your slides, which I already had if you use fair use in education, you don’t
need permission. If you put it on a MOOC, you need permission. So, every image in my
slides we had to get permission or pay for it, copyright, right. So that had to be done.
Well, one thing is that I had to renew a, um, a resource, um, an image attribution, and I
have to change the attribution because one company obtained the other company and now,
they wanted in their name.
Assessment. Personalized feedback from an instructor benefited students in various ways.
However, this presented a challenge for MOOC instructors to grade and provide in-depth
feedback in a short amount of time to hundreds or thousands of submissions. MOOCs offered
automatic input in the form of online quizzes. One interviewee used to grade assessments herself.
When she first launched a MOOC, she felt awkward at automatic grading. She (interviewee 10)
said,
Um, we didn’t, the part that I thought was really strange, and I still don’t feel great about
is, I didn’t, I didn’t grade any of the assessments. You know they were set up in such a
way as to be able to kind of be automatically graded I guess, or evaluated, um, by the
technology that Coursera has. And, I still feel kind of funny about that. Like I don’t, I’ve
never had the experience before of kind of turning over that part of teaching to a machine,
right? But I, but I also knew, I mean, the other day I got an update from Coursera, they
send you periodically a list of how many people have taken your course and it’s in there
like 5,000 now. So, there’s no way I could have ever graded all of them.
Little evidence tells us if the peer-review technique was appropriate as a form of
assessment and how efficient it was in MOOCs. One interviewee stated that he noticed a sharp
156
drop-off in student enrollment when he announced a peer-reviewed assignment in his MOOC.
He (interviewee 11) stated,
I see a very interesting trend in my own classes where I have peer-reviewed assignments. I
see a very sharp drop off whenever there’s a peer-reviewed assignment because I think
there’s a big problem with the language barrier and fear of not being able to pass the
course because their English, since that’s the language everybody’s submitting their
homework in, um, it is not the same as um, how they’re actually reading it, how they’re
listening to it, and they may not be able to articulate the content well enough for their
peers. Ah, so I do see a massive drop-off for when I have peer-reviewed assignments
which is lucky, and I’m going to be changing some of those here shortly um, to make sure
that it’s not peer-reviewed and it has a, even though that. I think the peer-reviewed
assignments, you can get away with a lot of, do a lot of work, and it’s very hard in
computer science I think to do the, I don’t have the time to grade everything um, on
Coursera. So how do I build that into my courses um, where it’s not peer-reviewed and
it’s, and it’s not um, oh what I am trying to say? It’s not a set answer, it’s not just one
answer, it’s interpreted very differently from student to student.
High enrollment and low completion rates. With a few mouse clicks, learners could sign
up for any MOOC at no cost and gained immediate access to course materials. High enrollment
numbers for courses did not make MOOC instructors feel excited as much as when they saw the
massive figure of enrollees for their first MOOC. Interviewees commented,
Interviewee 01: Um, it’s like any MOOC course, you know, the-the number of enrollees is
very high, the number of completers is, is low, the amount of discussion board and team
participation is generally low.
Interviewee 02: Um, the one thing I found is, well, you may have, and I’m sure this is the,
this is the experience of MOOC instructors worldwide. I’m never excited by the number
of people who registered for my course, frankly, whether it’s 5,000 or 100,000. It doesn’t
matter. Because in the end, there will be only a couple of hundred serious learners who
take it all the way through, and they complete the exam.
157
Research Question 3
What lessons have higher education faculty learned through the experience of teaching a
MOOC?
Findings concerning what lessons interviewees learned through the experience of teaching
a MOOC were derived from interview results, and were coded for five topics: Teaching a
MOOC improved my academic reputation (theme 1), MOOCs served opportunities for learning
(theme 2), it was a challenge to get MOOC participants to engage (theme 3), preparing to teach a
MOOC was time consuming (theme 4), and working with others in MOOCs helped (theme 5).
Subthemes and categories were presented in the following paragraphs.
Teaching a MOOC improved my academic reputation.
Little research focused on addressing MOOC benefits from a MOOC maker’s perspective.
Interviewees in this study stated that their academic reputation was strengthened through
teaching a MOOC in two ways: 1) they became more academically visible, and 2) they were a
better instructor.
I became more academically visible (research, publications, expanded network).
Several interviewees reported that the MOOC teaching experience made them more
academically visible in research and publications as well as helped them expand professional
networks.
Interviewee 02: Um, at a very personal level, um, I think I am a lot more, can I use the
word, ah, visible and known? Across several geographies, not just the countries that I
worked, everywhere. And um, you know not just students, ah bankers, risk managers, um,
heads of ahem, learning and development organizations in populations. It’s amazing. And
I getting, as a result of this, I get invitations to come and talk in-in conferences, in forums,
not just on technology in education, but on my course subject of banking, finance, and risk
management. Ah, and I’m going to be reaching out to an audience I would never have met
158
otherwise. So yeah, in some sense, actual visibility goes up, ah, significantly. But these
are, you know when I started out on MOOCs, I didn’t have all this in mind. These are all
outcomes.
Interviewee 05: Um, visibility, I think, is, is one benefit. And I, I think the, or the initially
expected benefit to reach out people who are less privileged somewhere in the world um,
that expectation was not really fulfilled, because if you look at who participates in our
MOOC with people from wealthy regions in the world ahem, because presumably people
from less privileged ah part of the world they have other things to worry about then the
contents of our MOOC. So, um, for me it’s mostly visibility it doesn’t really, it doesn’t
really save much teaching time, much face-to-face time for me, um, oh yeah, that’s kind
of it.
Interviewee 07: I also feel that we’re very strong in terms of globalization and global
cultures. And I feel that in order to get our research strengths out there to people, that one
of the best ways to do it is MOOC, because a MOOC has global reach. And I wanted
people all over the world to know, get to know Hong Kong U is a research hub in this
area.
Teaching a MOOC sparked great ideas and aroused interest in publishing research papers
or writing book chapters. For example, interviewee 02 stated,
In fact, that discussion resulted in me actually ah, doing a research paper on the back of
ah, you know, some of the learnings that I got from the learners in that... And, so yeah, I
mean it’s-it’s, it’s been a very positive experience as far as I’m concerned.
Notably, teaching a MOOC expanded the academic network for MOOC instructors. One
of the interviewees was invited to give speeches at other universities because the inviter used to
take his MOOC. He (interviewee 02) said,
Some of such teachers have actually written to me and said can you come and interact
with our students. In fact, mid of October, I’m going to one of the other universities ah,
because one of the ladies who did my MOOCs, ah, and she was here. There are people
who write to say I’m coming to Bangalore, I’d like to meet you because they’ve used my
videos or they’ve ah, participated in one of my MOOCs. And, and, that the ability to
159
network and connect professionally for a very positive cause ah, I don’t think I’ve
achieved but for getting into this MOOCs space.
I became a better instructor (explore strategies, more efficient, reconceptualize
curriculum).
A good teacher always seeks to expand the boundaries of his/her knowledge in order to
promote student success. According to interviewees, teaching a MOOC opened the window for
him/her to receive feedback from global learners, explored new teaching strategies, became an
efficient educator, reconceptualized curriculum, and increased the level of education in a
particular discipline. Interviewees stated that student feedback helped them understand the
learning experience of students and improve their teaching.
Interviewee 06: Another thing that’s very pleasant is that you end up interacting with very
different kinds of people. The two people who over the years have been the most involved
in the class, in all of our classes and have given us the most feedback, were all, were both
senior lawyers. One is the Deputy District Attorney of California, and another one is a
corporate lawyer in New York State. And these people meticulously went through the
material, gave us details feedback in a very gentle way on how to improve things. And
you really get to know these people, and these people are looking forward to the next
MOOC we do because they want to be involved again. And you know it’s, it’s, it’s really
pleasant interacting with people that way. People who really care, and people who don’t
want to be paid for it, they just want to contribute back in their own way.
Interviewee 09: I think. I think that it, I mean it really changed my professionalism in the
way I teach. Um, I also get feedback from people all over the world. And a lot of times
when I travel, I’ll say hey I’m going to this hotel, come by and let’s talk and it always be
20 to 50 people there, who will just want to talk. And so, um, I think it’s, it’s really an
interesting and very fascinating media form, and it really does work. I mean, the students
are really engaged, they learn a lot. And for a lot of them, it’s a career change for them.
And so, I, that’s, I think that’s one of the great benefits of it.
160
Over the past decade, technology had changed exponentially. Improvements in teaching
strategies to accommodate the increasing demands of various learners were pressing.
Interviewees found that MOOC teaching experience reshaped the way they learned and inspired
them to explore new approaches to teaching. They said,
Interviewee 03: So, it wasn’t that I sought out doing it, but it was necessary for somebody
to do it and it gave me an opportunity to explore a new way of teaching that I didn’t know
anything about.
Interviewee 06: And that’s, that’s you know one thing that you learned is that it changes
how you teach yourself in the classroom.
Interviewee 09: And as I got into it, I began to learn the power of doing you know
effective videos, and how to integrate different media into the program, which then
allowed me to you know not only did I do the MOOCs but as we’ll talk about here in a bit,
I used a lot of the technologies in my on-ground classes as well. And so, you know I
found that learning how to do MOOCs really change the way I taught. And the way that I
interacted with students.
Several interviewees shared, based on the experience of teaching a MOOC, that they
worked more efficiently as they had to keep the content concise and to the point in their lectures.
Their statements were given below.
Interviewee 06: So, I-I think the benefit to the university is that it changed how I teach
myself. I-I’d like to think I’m a more effective teacher now.
Interviewee 09: Um, what I found to be either the real takeaway, was that learning how to
do a MOOC forced me as an educator to cut things to the essence, and be extremely
efficient with what I was, what I teach. In other words, I used to teach, you know, I do a
half-hour or an hour and just kind of drone on. Um, but MOOCs taught me that you had to
break things down into seven-minute intervals. And so, what it did was we took extremely
complex topics and we broke them into little nuggets of information that let people do it.
Interviewee 10: So, at the end of the day, I, um, I feel sort of, um, I feel like it’s a better
way for students to have opportunities to revisit material repeatedly um, and it’s efficient
for me. And, I don’t have, I don’t have a bunch of people sitting there, in there, in my
161
classroom with their iPhone up recording me. Right? And so, so if-if what I care about is
making sure that students learn concepts and can apply them, and if I understand that I do,
then that means often revisiting them repeatedly. That to me is the benefit of-of offering
MOOCs, have a learning strategy. Um, ah, students can revisit material multiple times,
they can review, and it can refresh. Um, it’s just not something you can do in a live
classroom. Right? From a learner’s perspective, I think it’s efficient, it’s easy, they can do
it from their home in their you know, their pajamas or whatever. Um, they don’t have to
travel to a campus, they don’t have to park, they don’t have to get childcare. Um, I mean
it’s a very democratic way of delivering course content.
Interviewees indicated that teaching a MOOC enabled them to acquire new knowledge
and beef up their out-of-the-box thinking skills, which turned into the driving force for them to
reconceptualize the course.
Interviewee 08: Um, well I think one of the, one of the biggest benefits for me is that it
really, in teaching these tiny little modules, I really had to reconceptualize all of these
other things about my course [mm-hmm]. So, and, and actually one of the nice things was
that in teaching this course, I basically learned some things that I hadn’t. You know after
having teaching this course you know seven years or whatever, right, I’ve been teaching
this course a long time, it’s one of my, the courses I teach once a year, and yet, you know
I think that maybe it’s in preparing this in a different way I had to really think differently
about the material [mm-hmm]. Right? So, I think that was one of the best parts.
Interviewee 10: So, um, I would say that you know the opportunities to really think hard
about um, crystallizing content into a manageable set of concepts and delivering it in a, in
a way that students can go back and watch it again and again and again. I mean, in life in
my view, that’s the thing that makes MOOCs kind of most um, actually useful in higher
ed.
Moreover, one interviewee pointed out that teaching a MOOC allowed him to share his
knowledge and expertise in a specific subject area that may increase the overall educational level
of the discipline. Interviewee 12 shared,
162
Well, I think the greater, the greatest benefit is something that I said earlier, and that really
is, is, is sharing and increasing the general level of education about a topic that you care
about.
MOOCs served opportunities for learning.
MOOCs were seen as a good learning opportunity with great potential because MOOCs
served the needs of various learners, such as adult learners, full-time professionals as well as
underrepresented individuals.
MOOCs served adult learners and professional needs.
MOOCs gave an instructor a chance to serve adult learners by fostering a learning
community. Adult learners were connected with other professionals who shared similar learning
goals and pursued professional growth through a robust learning community. As interviewee 01
stated,
And what we said was, what I said was, no, what we need to think this is an opportunity to
create a community of people, who want to do a certain type of work and who, who begin
to do that work. And what we’re trying to do is create a community. And so, when I think
about, what my role, my role, part of my role was to sort of create the space in which this
community needs. That’s our course.
Interviewees asserted that MOOCs bridged education for national and global learners by
engaging in discussion, reflection, and collaborative teamwork. Their statements were given as
follows.
Interviewee 01: And so, ah, October of last year when the first course was up and running
when we got an email from the US Embassy in the Philippines, and, they had 800 Filipino
teachers who wanted to complete the first course together. And they had some U.S.
teachers on the ground who would, who would help them, and, could I help them launch
this and sort of provide the kind of motivation and inspiration to work together to do this
really hard work together? And, and, and they took 800 people teachers from all over the
Philippines, um, that were organized into little teams um, through the course. But they
163
didn’t get through it because the content is that exciting, they got through it because it was
a social experience for them. And, and so that’s, that’s a very, I mean, so I just, I mean
when I think about my role, it’s sort of like, the social constitution by creating the space.
And yeah, yeah, right. So, so that’s how we, that’s how I think about it.
Interviewee 03: Yeah-yeah, and I actually thought from a social justice perspective it’s
wonderful. I mean, it really means that people who do not have access to schools or
money to go to a school or time to go to a school can access a course and get information
that they wouldn’t otherwise be able to get. And from that standpoint, it’s phenomenal.
There’s no question about it.
Interviewee 09: One of the stories that blew me away because we asked students to give
stories you know about what they thought of the class. They, we had two nuns who lived in
Afghanistan, and they would take a portable computer, and they would drive nearly an hour
to get to where they could get online. They would download the videos cuz you could
download, you can do that through Coursera. They downloaded the videos for the week,
drove an hour back, and this is in a war-torn country. They would then work through during
the week and watch the videos on their little portable computer. Erase them after they did
the assignments, and then drive an hour to go, you know an hour and a half to go back and
do it again. And they did that for months. And it was like that is just amazing, you know
that people would go to that length to get the education that we offer online. But you know,
they would never get it unless there were MOOCs around. And so, I think that, I always
keep that in mind is that, there are some people out there that are killing themselves to get
to the education that we’re putting out there. And so, it just amazes me you know, that they
have that much drive to do it.
Interviewee 11: Um, the reason I like them is because they provide opportunities that you
don’t normally get everywhere. You can learn from a variety of instructors, a lot of
different universities, a lot of backgrounds, a lot of them are either focused on theory or
they’re focused practically. Um, and it’s different than the college experience that you
would get learning on your own and being able to self-pace.
MOOCs extended learning opportunities for those less well served.
164
MOOC providers worked with universities to expand their global reach. Interviewees
reached out to a diverse global audience, particularly for those who were less privileged. Their
opinions were provided below.
Interviewee 02: And, and, just to put it in perspective, I mean the number of students from
countries like Angola, Zambia, I would never have been able to reach them but for this
platform, you know. I would not even able to reach out to so many universities and
teachers and so many universities without this. So, I’m looking at a much ah, broader
perspective and in the process, I dare say that my brand as a teacher is also enhanced.
Interviewee 10: I knew it would be, um, a way to reach a lot more people.
Interviewee 11: I really think it’s being able to teach those that don’t have the resources
where they’re at. So that’s, that’s where I, that’s where I see it. I don’t care if, I mean the
University, I’m sure, cares of people pay for it. But if you’re helping just one person better
themselves, then you’ve done a, than you’ve done an okay job. So that’s, that’s the main
benefit I see.
Nonetheless, two interviewees revealed that the expectation of reaching out to less-
privileged learners was not fully fulfilled in their MOOCs.
Interviewee 05: I think the, or the initially expected benefit to reach out people who are
less privileged somewhere in the world um, that expectation was not really fulfilled,
because if you look at who participates in our MOOC with people from wealthy regions in
the world ahem, because presumably people from less privileged ah part of the world they
have other things to worry about then the contents of our MOOC.
Interviewee 06: And the other thing is when we started all of this, we really wanted to
reach people who did not have access to quality education and give them that opportunity.
And it’s very clear that’s almost exclusively people who use MOOCs to further their
education or people who already are very capable of independent learning for whom this
is simply yet another way in which they can learn independently. So, I don’t think we
have broadened the audience for education. I-I and, it is third case that platforms like edX
and Coursera are so focused on their own survival, and coming up with the model by
which they can raise enough money, that’s actually reaching that really important
165
demographic that, that we really, we got involved with MOOCs for. When we found out,
you know, I think more than two-thirds of the people who take her course already have a
bachelor’s degree. These are lifelong learners; these are not the people who need us.
Every once in a while, you end up with a really bright middle school student or high
school students who you really then help along and that’s, that is one of the groups that we
really always were after. But invariably, these are high school students who already had a
lot of support from home to learn and therefore this is just another way for them to get
ahead. And that’s really frustrating that you, you’re not reaching the person from a poor
village in Africa and giving them the opportunity. It’s, it’s, it’s just not there. And it was
to us frustrating enough that after the first time that we offered the MOOC, we almost
decided not to even bother anymore because we really were disappointed with that
particular aspect of the whole thing. And we’re still very, very disappointed with that.
That’s the frustration.
It was a challenge to get MOOC participants to engage.
Interviewees reported that getting MOOC participants engaged was challenging. This
problem was addressed from two aspects: 1) there was less opportunity for active participation
and student feedback; 2) language barriers and gender issues might inhibit participation.
There was less opportunity for active participation and student feedback.
Although MOOC educators were connected with heterogeneous groups of learners
through a MOOC, interviewees recited that they had difficulty getting individuals engaged.
Some learners actively participated in a MOOC, such as asking questions, volunteering answers,
or contributing to discussions, whereas others did not. Getting all learners to engage and talk was
not easy in a MOOC. For instance, interviewee 01 stated,
One challenge is getting everybody to talk I mean getting people engaged you know, our,
the-the type of assessment that we liked most do is to, is to talk to people about what’s on
their minds and the rate can help, [to share ideas] yeah, right. So, but, and then like you
know really making a hard call or a tough assessment on who learned what.
166
The most explicit approach to help an instructor check student understanding, clarify
questions and address issues seemed to be receiving an immediate response from them.
However, interviewees claimed that they could not get sufficient feedback from students in
MOOCs to assess learning outcomes. Their comments were provided below.
Interviewee 11: Um, I think as you’re developing the MOOC, it’s, it’s hard to understand
if students like the course or not, and I don’t have that many reviews. I know that other
MOOCs have way more reviews, but I only have several, several hundred out of all of
them. Ahhh, let’s see if I go to, where’s my most popular one here… yeah, I only have a
hundred and nine on my most popular one, reviews. And it’s hard to, hard to understand if
over two thousand, five thousand people have taken these courses, what does this actually
look like? Um, are they benefiting from it? So, it’s hard to anticipate. I know what they’re
gonna say on campus, I don’t know what they’re necessarily gonna say off-campus.
Interviewee 12: The challenge is that, the challenge is that you don’t have the immediacy
of exchange and response. And you can’t take students in an individual way um, through a
learning experience. And for someone like me, um, I love being in the classroom. I like
being in front of people. So, the MOOC became ch-, is challenging because I don’t, as I
said, get the kind of immediate gratification and feedback that I like so much.
Language barriers and gender issues might inhibit participation.
Interviewees were concerned about learners who were from non-native English-speaking
countries because English was the primary language for over 80% of the courses offered by
Coursera or edX. Comments by these interviewees were provided below.
Interviewee 10: And what I realized was a lot of the people watching the course, taking
the course were not native English speakers [mm-hmm]. And I think we’re having a little
bit of difficulty um, you know, understanding some of the concepts. And it was a kind of
complex language. So, if he weren’t a native English speaker, I think it would have been a
little hard to wrap your head around. Um, even though we tried very hard to make sure
that we, uh, that wasn’t just U.S.-based contexts. So, we were very conscious to add in
167
international references [um-hmm]. Um, but you know there’s only so much we can do to
make, to make the language more accessible, I guess.
Interviewee 11: I see a very sharp drop off whenever there’s a peer-reviewed assignment
because I think there’s a big problem with the language barrier and fear of not being able
to pass the course because their English, since that’s the language everybody’s submitting
their homework in, um, it is not the same as um, how they’re actually reading it, how
they’re listening to it, and they may not be able to articulate the content well enough for
their peers.
The male-female student ratio varied from subject to subject in MOOCs. Women
outnumbered men in certain disciplines. One interviewee pointed out that his MOOC had a
relatively low number of female students, which could inhibit their participation. He hoped that
his course would have more females.
Interviewee 06: The biggest challenge that we have had is getting participation from
female students. It is, I don’t know if you’ve seen statistics on this, but the, the number of
female participants in a course fluctuates between 15% and 18%, one five, one eight. Just
tiny and apparently this is um, par for the course when it comes to online education. And
we’ve actually, Maggie once, you know for one semester she went really out of her way
trying to attract more female students into the course, and we ended up with the fewest we
ever did, percentage wise. So, there’s something about… Now obviously how many
people register is very different from the number of people who actually complete. We
believe that the number of female students who complete is actually quite a bit higher,
maybe one-third. But still, it is um, unfortunate that we, that there are, whole um,
demographics that we just aren’t reaching.
Preparing to teach a MOOC was time-consuming.
A tremendous amount of effort and preparation was required in teaching a MOOC,
particularly time investment. Therefore, interviewees summarized three things that MOOC
instructors needed to be aware of. First, starting early and noticing the learning curve was
important. Second, figuring out how to break up the content and keep it current was helpful.
168
Last, thinking about timing, comprehensiveness, and assessment was critical to the development
of a MOOC.
Start early and beware of the learning curve.
Interviewees stated that starting MOOC preparation early provided them sufficient time to
plan, explore options, tinker with changes, research fresh ideas, and pilot everything in order to
ensure they were prepared adequately. Their comments were as follows.
Interviewee 03: Um, you have to make sure that you set these courses up enough in
advance. So, you cannot start a MOOC course in June and need it in July, it-it takes too
long to do this. So, you have to, if-if somebody we’re going to say I’m gonna do a MOOC
course, I would tell them that if you’re gonna give it in the, even if you’re gonna give it in
the fall you should be taping in the spring.
Interviewee 05: Probably one, it was at least one year before that so, is when we started
ah-ah, developing the idea, and contacting people. So probably it was one year before the
course was supposed to start that we had the team complete with everybody committing to
the project.
You must figure out how to break up the content and keep it current.
Interviewees said they faced challenges in dividing content into small portions to keep the
recorded lectures succinct and to the point. Examples of interviewee comments were provided
below.
Interviewee 08: The fact that now you have to understand you know when do I break up
this, how do I take this lesson and break it up into three to seven-minute chunks that are
useful and usable? [mm-hm] I think that’s really the greatest challenge.
Interviewee 10: Well, one thing I learned is, because you only have that 20 minutes you
know, four or five pages of text, and to, to actually deliver content, and you have to be
really choosy about what you include. Keeping MOOC content updated all the time has
been identified by interviewees as another problem because the landscape changes rapidly
and frequently in some particular fields. Comments by these interviewees are provided
below.
169
Interviewee 07: And then, the follow up has been challenging, keeping it fresh, keeping it,
ah, trying to get new learners interested in it, kind of keeping the numbers up, keeping,
keeping up with all that.
Interviewee 09: My biggest challenge is, is keeping it current. You know, I mean, things
that we, we planned on went away. And so, well, you know, I see a number of these
MOOCs that are really dated and they’re still around. And they haven’t been changed, and
I just think that that’s dangerous. I mean, you’re, you are acting as though this, you know
what you recorded in 2012 is still the rule in, you know 2018. And I think that’s a huge
challenge, you know I think that I don’t want to be associated with it.
You had to really think about timing, comprehensiveness, and assessment.
The development of a MOOC took a lot of time away from the instructor. Therefore,
interviewees asserted that it was essential to develop a reasonable and manageable timeline in
advance for getting all course prep work completed on time. Interviewees shared their experience
in this regard as follows.
Interviewee 02: In fact, now I keep getting query saying prof, can you do one more
MOOC course on this topic. You know, ah, some of the emerging subjects. Um, so I said
yeah. I mean it challenges me to do it and, very time-consuming the first time around, you
know. To put together a good MOOC, it takes about six hours, six months. To
conceptualize it, to turn it into sessions, videos in each session, the comprehensiveness of
each video, the quizzes, work on the summary of each week, the quiz, ah, you know it’s-
it’s hugely time-consuming.
Interviewee 04: I spent a lot of time on the course. I mean it was overwhelmingly
consuming in terms of time. It, at-at least what I did and how I did it. There may be other
ways to do it, but I watched other people around me do it, and everyone says it’s very
time-consuming.
Interviewee 07: So, it’s quite you know, it’s labor-intensive to keep ah, the MOOC afresh
and to respond to what’s going on, on, the MOOC.
Interviewee 10: I’m gonna estimate that I put about 20 to 30 hours of work into writing the
script, and so going over them with Julie, before, before I flew to Pittsburgh to record
170
them. And that was, that was a full day. So, the full day of the time the studio, um, plus
maybe 30 hours of work, um, to write the scripts, to edit them, to add graphics, to put you
know the charts and the, all the pictures in. Um, so maybe yeah, a total of 40 hours. Um,
and then as I said, I wasn’t asked or expected to go into the discussion board, I did it a
couple of times because I was curious. But I didn’t spend very much time in the
discussion board. So, I did, I did what I would call a respectable job, but I didn’t, it wasn’t
a huge output of labor.
Most MOOCs were created to introduce fundamental concepts and skills. Thus, one
interviewee contended that making the content thorough was necessary for a MOOC. An
anonymous survey participant also commented that MOOC was great for theoretical knowledge.
Their comments were provided below.
Interviewee 05: I think the risk is always that you’re not thorough enough um, or not
comprehensive enough. Ah, that applies, also I mean, for example, if you, if I advise, see
presentations by researchers at a conference, some, sometimes people expect too much
prior knowledge or it’s too or they expect the prior knowledge to be available like, like
really, on the spot. Um, I think it’s worth um, even if you’re expecting if you clearly state
people if you want to do my course you have to know this. It’s still worth quickly
summarizing or referring to something so that people get to, get into the mindset that they
need. So, I think good advice is to be more comprehensive than you think is necessary,
and more self-contained than you think it’s necessary. I think that makes it easier for
learners to consume the content.
Anonymous survey participant: A MOOC is a great way to teach the theoretical
component of a professional course that also has a practical workplace component.
Assessments might vary from course to course in the context of MOOC. In developing
formative and summative assessments, MOOC instructors put in a plethora of thoughts that
could take a lot of time. It was suggested to start working on the development of assessments as
early as possible. Examples of interview comments were given below.
171
Interviewee 02: Um, assessment, at the end of every video that they see, ah, we have a set
of ah, multiple-choice questions or ‘True or False’, and we give them two chances, ah, if
they don’t get it right then we gently not nudge them to say you know to go back and look
at this video and come back. Ah, at the end of every week, we have a graded quiz, the-the
quizzes that they do at the end of every video is ungraded. I mean it does not include if
any credit. It’s just to, for the guy to test himself that he has understood the contents in
that video. Um, at the end of the week, remember MOOC has five, four, five, or six
weeks. At the end of every week, we give them um, a weekly graded quiz, a weekly
graded quiz. At the end of the course which is at the end of week 4 or week 5, in fact, one
of the MOOCs, the end of course quizzes in progress right now, they’re doing it. They do
it whenever they want. Um, in some cases we do this a proctored exam, in some other
cases, we let them go back and look at the contents if they have to. Because the whole
idea is not to be very punitive but to make sure the learning is reinforced.
Interviewee 04: We had videos, each video, in each lecture or each week has either four or
five videos [okay] and after each of those videos, there are two to four questions that-that
ask about material that was, that was in the video [mm-hmm]. So, as they’re going along,
we’re asking them to give us something back. At the end of each video, there are
reflection questions. So, you know, what do you think about or how does this fit with, um,
that sort of thing. So, we have reflection questions and then content questions. Um, in
addition to those, there are, with-with each of these there is either, um, there-there’s
something that is-is that on which we can test them, [mm-hmm] that is we can test their
knowledge by asking questions [assessment], assessment, right. And so, we give them a
case.
Interviewee 09: So, one of the things that I would give you as a tip, we created our own
Twitter page, our own LinkedIn page, our own Instagram, and we have the students go out
and they comment on things that are in the class of what they’re told to. So, I say watch
this video and pick the most important trend, and tweet that out. Then I retweet them, and
they suddenly begin to see they can pick up followers just by doing those sorts of actions,
and we do that every class. Then the ah, each MOOC which [voice lost] I have five
MOOCs and then a specialization, the capstone, the five MOOCs are divided into four
sections, each section has an assignment and a quiz. They have to go through, go through
172
the quiz. And so, and then so they basically do a tweet, they go through and do an
assignment, and then they go through and do the quiz. The specialization, they actually
build a complete marketing plan for any business they want anywhere in the world. And
all of the different assignments we put together, ah they, teams of peers who grade it, and
then we have, I have a team of people who are always engaged with the discussion boards
as well as with the s, with the students or the participants, to make sure things are going
well for them and answer any questions they have.
Interviewee 11: Oh, I can make more, I can make more ah, [quizzes] yeah, more quizzes,
more formative, and more summative assessments. Um, could do a better job of getting
into discussion questions. But then that’s again, that’s a lot of work. Um, and students are
learning now, so I don’t know how much I want to change it. I may do my next course
completely different because that’s um, something new.
Furthermore, one interviewee recommended prospective MOOC instructors taking a
MOOC before teaching one, which might help gain some learning experience.
Interviewee 07: And I think that it (the experience of completing a MOOC) gave me really
a lot of insight into ah, what’s acceptable in terms of designing the MOOC and the range
of approaches that people take to it. And then also some of the difficulties the learners
encounter and actually doing the assessments. When I designed the assessment, I was very
cognizant of that.
Working with others helped.
Interviewees reported that working with other experts such as inviting guest speakers and
collaborating with co-instructors led to the success of their MOOCs.
Team approaches to developing a MOOC helped.
Under certain MOOC circumstances, interviewees found out that having a team to support
them was crucial to the success of MOOCs. They commented,
Interviewee 02: Ahem, the team is key. I mean I keep saying that. Ahem, most MOOC
instructors did exactly the opposite. They have multiple instructors but a very lean team.
Interviewee 04: Try to have a team that can give you advice and information and input.
173
Interviewee 07: Because even though there are many people who kind of believe MOOCs,
there’s a lot of group efforts, like making a film, you need to have a crew, you need to
have a lot of people involved. So that’s what I would say.
It was good to incorporate guests and co-instructors.
It was common to see that a MOOC had multiple lecturers when you searched for courses
via Coursera or edX. MOOC instructors tended to collaborate with other subject matter experts
for crafting presentations, recording lectures, sharing research findings, and interacting with
learners in order to enrich their learning experience. Interviewees suggested this kind of
partnership helped. Several examples of interview comments were given below.
Interviewee 07: So, anyone who wants to do a MOOC, it can’t be a, an individual
decision, it has to be an institutional will, it has to be a group decision. Because even
though there are many people who kind of believe MOOCs, there’s a lot of group efforts,
like making a film, you need to have a crew, you need to have a lot of people involved. So
that’s what I would say. Now for people who are not in institutions like this, there is still
hope. What I would recommend is a partner with someone, add an institution that’s
already doing MOOCs, a colleague and then they have that colleague float the idea, and
then do something where they’re part of a team doing a MOOC elsewhere.
Interviewee 09: Yeah, but part of the things though that I found really useful was to bring
in guests, and you see I have a lot of guests in mine. Um, simply because that made me
become the student, and my thing was just ask the questions do they… So, I started with
me looking directly into the camera and I got the, do the introduction. Then I swing
around and sitting next to me would be the guest. Then I could just lay back and ask the
questions that I know the students would want to ask, which kind of changed the role. So,
it was kind of fun to do it that way as well. I think a lot of times, we as, as professors think
we’ve got it, we’ve got all the answers. But I think bringing in some people gives you
credibility.
174
Summary
This convergent parallel mixed methods study aimed to explore the higher education
faculty members’ teaching experiences in MOOCs. Qualitative findings from each research
question were outlined in this chapter. Themes included:
RQ 1. How do higher education faculty describe their decision-making process in terms of
participating in MOOCs?
Theme 1: Intrinsic Factors
Theme 2: Extrinsic Factors
RQ 2. What are roles and experiences higher education faculty encounter in delivering a
MOOC?
Theme 1: Roles higher education faculty performed in teaching a MOOC
Theme 2: Experience higher education faculty encounter in delivering a MOOC
RQ 3. What lessons have higher education faculty learned through the experience of
teaching a MOOC?
Theme 1: Teaching a MOOC improved my academic reputation
Theme 2: MOOC served opportunities for learning
Theme 3: It was a challenge to get MOOC participants to engage
Theme 4: Preparing to teach a MOOC was time-consuming
Theme 5: Working with others helped
Interviewees’ shared experiences were coded and categorized into themes in order to
address the three research questions for the qualitative strand. Each theme was analyzed in detail
with thick descriptions that used fragments of the conversation from the interviews and survey
answers. In Chapter Six, the results of the study with associated findings were discussed.
175
CHAPTER 6. DISCUSSION AND CONCLUSIONS
The purpose of this convergent parallel mixed methods study was to explore the
experience of higher education faculty members who had taught a MOOC or were currently
teaching a MOOC via edX or Coursera. This chapter included a discussion of major findings as
related to the literature, followed by implications for practice and a discussion of the limitations
of the study. It concluded with recommendations for future research and a summary.
Discussion of Findings
Quantitative and qualitative data were collected and analyzed simultaneously and
independently as the convergent parallel design was executed in this study. The researcher gave
equal weight to quantitative and qualitative data and looked for pattens and contradictions by
comparing and contrasting the results received from both strands. The final interpretation was
made based on the merged results through a matrix including quantitative variables and
qualitative themes. The researcher used the matrix to outline all quantitative variables and all
qualitative themes and subthemes to determine to what extent and in what ways both sets of data
converged, diverged, or related to each other. Convergent data were highlighted in a same color
and synthesized, whereas divergent data was identified and differentiated with special symbols
and numbers. Data related to each other was grouped together for final interpretation. The table
below provided the detailed steps and the products generated at each step throughout the research
process.
Table 19. Sub-steps and Products for Each Step
Convergent Parallel Mixed Methods Design
Quantitative Qualitative
Step 1: Data Collection
176
Sub-steps Surveys (89 responses) Interviews (12 interviewees)
Products Numerical scores Transcripts
Step 2: Data Analysis
Sub-steps Descriptive statistics Coding & thematic analysis
Products Means, frequencies, percentages, SD Quotes, pattens, categories, themes
Step 3: Results Compare/Relate
Sub-steps Cross-tabulation of derived qualitative themes with quantitative variables
Products A matrix of quantitative variables and qualitative themes
Step 4: Interpretation
Sub-steps Use merged results to produce a comprehensive understanding
Products Findings & Discussion
The following six research questions guided this study. The discussion of findings of this
study were presented in the sequence of the research questions as follows.
(RQ1): What intrinsic factors motivate higher education faculty to teach a MOOC?
(RQ2): What extrinsic factors motivate higher education faculty to teach a MOOC?
(RQ3): What are faculty experiences teaching a MOOC?
(RQ4): How do higher education faculty members describe their decision-making process in
terms of participating in MOOCs?
(RQ5): What are the roles and experiences higher education faculty encounter in delivering a
MOOC?
(RQ6): What lessons have higher education faculty learned through the experience of teaching a
MOOC?
Finding 1: MOOC Instructors, Who Are They?
Previous studies revealed that most MOOC instructors were tenured faculty with over ten
years of experience of teaching at the college level (Kolowich, 2013) and the majority were
white males in their 40s to 60s (Doo, Tang, Bonk, & Zhu, 2020). Only a small percentage of
177
MOOC instructors had experience in designing fully online/hybrid courses before designing a
MOOC (Zhu & Bonk, 2018). Survey findings from this study were similar to previous research.
There were more male MOOC instructors than female, and most of them were Caucasian. Their
ages ranged from 30 years old to 80, generally fell between 30 years old to 69. Over 75% of
MOOC instructors held a terminal degree (i.e., doctorate) and more than two-thirds (67.4%)
were ranked as associate professors or above. Teaching an online/hybrid course was new to
about half of respondents, although over 90% indicated they had 1-5 years of experience in
teaching a MOOC via edX or Coursera with courses generally enrolling a range of 1,001 to
10,000 students. The eight-nine survey respondents in this study were representative because
they matched demographically the previous findings about MOOC instructors in other studies.
The twelve interviewees might not be representative because demographic data such as age and
ethnicity were unknown.
Finding 2: Intrinsic Motivators and Extrinsic Motivators
Empirical research had been done to identify intrinsic and extrinsic factors that affected
faculty members’ participation in online education. Green et al. (2009) stated that an opportunity
to share knowledge with others was a pivotal intrinsic motivator for faculty to teach online
courses. Faculty members were highly motivated to participate in online education to develop
new ideas about teaching and learning (Cook et al., 2009; Pinkerton, 2008; Schopieray, 2006).
Having the personal motivation to learn and use technology was cited as a highly motivating
factor for faculty to teach online (Chapman, 2011; Green et al., 2009; Schroeder, 2008).
Schopieray (2006) reported that the intellectual challenge of learning to teach in new ways was
one of the top four intrinsic motivators for instructors to teach online. Faculty perceived the
178
intellectual challenge as a motivating factor when considering online instructions (Cook et al.,
2009; Green et al., 2009; Pinkerton, 2008; Schroeder, 2008).
The results of this study corroborated these earlier findings, although MOOC differed
from a regular online class due to its openness, massiveness, and other noteworthy
characteristics. Results revealed that the majority of higher education faculty members were
more intrinsically motivated rather than extrinsically motivated to teach a MOOC. This was
consistent with studies that had shown that intrinsic motivators had a greater impact on
instructors’ decision making to teach MOOCs (Doo et al., 2020; Lowenthal et al., 2018; Najafi et
al., 2015). This finding resonated with the Self-Determination Theory that suggested humans
were intrinsically motivated to take part in activities that fulfilled their innate psychological
needs.
The survey results indicated that more than 80% of respondents were motivated by
intrinsic factors in the decision of teaching a MOOC. The importance of intrinsic factors was
borne out in the twelve interviews. The intrinsic factors most mentioned during the interviews
included a desire to reach a wider audience, a desire to showcase or share expertise, and a
passion for teaching with technology. Interviewees (and survey respondents) did bring up some
extrinsic motivators, such as institutional decisions and institutional MOOC partnerships,
encouragement by others and external rewards. However, it appeared that the extrinsic factors
came into play or were taken into consideration after they were triggered by an intrinsic interest
in teaching a MOOC.
Finding 3: Satisfactory Experience in Teaching a MOOC
The vast majority of higher education faculty members in this study claimed the MOOC
teaching experience was personally rewarding and professionally beneficial. This finding was
179
consistent with that of Belanger and Thornton (2013) and Khalil and Ebner (2013) who stated
that most of the MOOC instructors’ teaching experience was satisfying.
Nearly 90% of participants in this study reported that they were satisfied with their first
MOOC and over 75% said that they would consider teaching a MOOC again. More than half of
the participants shared that the MOOC teaching experience greatly inspired them to change the
approaches they used to teach. Participants’ beliefs about fully online courses were assessed
before and after they had taught a MOOC. The results showed that participants’ enthusiasm level
for fully online courses increased after they taught a MOOC. The results obtained from
interviewees regarding MOOC teaching experience were very close to the survey results.
Overall, interviewees stated that they had a pleasant and rewarding experience teaching MOOCs
and learned valuable lessons throughout their MOOC teaching adventures.
Finding 4: Intention of Participating in a MOOC
Previous literature showed that the primary intention of MOOC instructors to teach a
MOOC was threefold: connecting to a larger number of diverse participants (Agarwal, 2012;
Mackness et al., 2010; Roth, 2012), egoism (Hew & Cheung, 2014), and increasing student
access to higher education resources globally (Belanger & Thoronton, 2013; Lowenthal et al.,
2018; Sari et al., 2019; Watson et al., 2016). Consistent with previous work, this study found that
higher education faculty members chose to teach MOOCs for similar reasons. For example,
survey participants and interviewees in this study noted that MOOC was an effective medium to
build connections with a wide range of global learners beyond the geographical limitation. They
sharpened skills and expanded knowledge about how to teach a MOOC, which inspired them to
make improvements in traditional teaching practices. Additionally, they received national and
global attention from others in the academic field. They were granted opportunities to establish
180
their brands, advertise their academic programs, and promote the reputations of the institutions
where they worked.
Finding 5: MOOC Instructor’s Roles
Online faculty roles had been examined and documented in a variety of studies. Specific
taxonomies and models were developed to describe roles faculty needed to perform while
teaching online, such as administrator (Bawane & Spector, 2009), coach (Zhu, Valcke, &
Schellens, 2010), facilitator (Johnson, 2013), and content expert (Change et al., 2014. One of the
early models concerned with the instructor’s roles in online education was the Instructor’s Roles
Model, put forth by Berge (1995). Initially, this model was created to define the roles and
functions of online instructors. Later, this model was widely adopted and applied to a myriad of
empirical studies to identify student and/or faculty perceptions, experiences, and competencies in
terms of the roles in the development of online instruction (Ching, Hsu, & Baldwin, 2018;
Dehghani, Sheikhi Fini, Zeinalipour, & Rezaei, 2020; Gómez-Rey, Barbera, & Fernández-
Navarro, 2017; Gómez-Rey, Barbera, & Fernández-Navarro, 2018) and provide guidance in
practices on facilitating skills for online courses (Adebisi & Oyeleke, 2018; Blanchette, 2016;
Farmer & Ramsdale, 2016). For example, Gómez-Rey et al. (2018) used a bottom-up approach
to examine the roles of online instructors from a student perspective. Respondents were asked to
score on six roles (pedagogical, managerial, social, technical, course designer, life skills
promoter) in a questionnaire. The results suggested that the managerial role received the highest
average score, followed by technical role, pedagogical role, course designer, social role, and life
skills promotor which presented itself as a new role. Dehghani et al. (2020) used Berge’s model
to identify expected competencies in MOOC context and found that MOOC instructors needed to
181
be prepared in four dimensions (i.e., knowledge, professional skills, professional attitude, and
personality).
This study revealed that the four roles (pedagogical, managerial, social, and technical)
were deconstructed in the delivery of MOOCs compared to what Berge presented in his model.
These four roles were carried out by different individuals or groups in each stage of running a
MOOC but still functioning in the same way as they were in a regular online course regardless of
the massive number of learners and other key characteristics that differentiated MOOCs from
traditional online courses. The role of a MOOC instructor was largely pedagogical-oriented,
especially at the planning, designing, and delivering stages through scaffolding the course
structure, developing recorded lectures, curating learning resources, designing formative and
summative assessments, facilitating learning by keeping the discussion on track or contributing
insights. Once the MOOC was up and running in a self-paced mode (a predominant course
delivery format for edX and Coursera), most MOOC instructors’ engagement dropped
dramatically. According to Berge’s descriptions of each role, the social role was identified only
within far fewer MOOCs in this study. The results showed a trend that over a half of MOOC
instructors spent no or little time fostering a welcoming, engaging, and supportive social
environment for learners to develop individual connections or group cohesiveness. Reasons for
not doing that included a shortage of time, heavy workload, other competing priorities, no
compensation for the time spent on engaging with students, language barriers, time difference,
and insufficient student feedback. In addition, the majority of MOOCs reviewed in this study
were self-paced xMOOCs with predominantly automated grading or peer-reviewed assignments.
Given this prescribed design, MOOC instructors were not inclined to promote human
relationships and develop group cohesiveness in a xMOOC environment. The managerial role
182
was mostly taken over by assistants employed with the MOOC platform or the student
workers/graduate assistants assigned by the MOOC instructor. The technical role was shifted
over to the IT support services from different MOOC platforms.
Participants in the survey were asked to self-identify their pedagogical roles in delivering
a MOOC. About 40% identified themselves as the “primary instructor”, about 20% were the
“primary designer” and about 20% responded they were “co-instructors.” The analysis suggested
that the roles, in general, were divided into two types: teaching solo or co-teaching with other
subject experts. Among those who co-taught with others, some played a lead role in designing
and developing the MOOC and some did not.
Only a few interviewees indicated that they engaged with learners in their MOOCs
through multiple ways. The rest of them (over a half) stressed the importance of interacting with
students and expressed their concerns about the lack of student engagement in MOOCs although
they elaborated the reasons for not doing that in their MOOCs. These reasons echoed the
findings documented in the existing literature (Allon, 2012; Belanger & Thornton, 2013;
Blackmon, 2018; Hew & Cheung, 2014; Wang et al., 2019). Additionally, interviewees
discussed the competencies needed for a MOOC instructor based on their first-hand experiences.
For example, commitment (time and effort required for MOOC development), content expertise,
understanding of the online teaching context, camera presence, and language accessibility. The
results aligned with what was known from previous work by Johnson (2013), who advocated that
competencies in technology, instructor role transition, and community building were necessary
for online teaching. Lacking knowledge in technology and pedagogy in terms of online teaching
and learning was identified as a significant barrier in his study. However, lacking knowledge in
technology was not reported by participants as a major barrier in this study. Notably, most of the
183
MOOCs were designed and delivered in an asynchronous and self-paced format with pre-cooked
learning resources and activities, such as pre-recorded lectures, readings, and automated quizzes.
MOOC instructors might not experience feelings of inadequacy or nervousness and have to deal
with the technology glitches that usually occured in synchronous online meetings (Belanger &
Thornton, 2013; Blackmon, 2018; Hew & Cheung, 2014). MOOC providers normally had
equipped with a tech support center. The technology support was taken care of by a group of
specialists.
Finding 6: Benefits and Challenges of Teaching a MOOC
Benefits of taking a MOOC from a learner’s perspective were well-documented in the
current literature (Baker et al., 2015; Becker, 2013; Leon-Urritia et.al., 2018; Iniesto et al., 2016;
Mallon, 2013; Rodriguez, 2012; Sonwalkar & Maheshkar, 2015). However, there was a dearth of
empirical studies focusing on describing the experience of MOOC instructors and the benefits
and challenges they received through the teaching process. This study provided some insights
and practical strategies and considerations to address these unsolved issues.
One of the most intriguing findings was that teaching a MOOC offered opportunities to
showcase research strengths and improve the academic reputation of these individuals or the
institutions where they worked. MOOC instructors wanted to be acknowledged by their
colleagues and administrators for the hard work involved in MOOCs. The experience of teaching
a MOOC led to continuous improvement in their face-to-face and regular online instruction.
They were granted opportunities to reassess their teaching practices. These findings reinforced
the belief that MOOCs were not only beneficial to learners but can be helpful to MOOC
instructors, as well as their institutions (Evans & Myrick, 2015; Zheng et al., 2016).
184
Regardless of these tangible benefits, MOOC instructors had been challenged with
various issues, such as feeling overwhelmed due to a shortage of time for course development,
immense workload in developing the MOOC, not getting acknowledged for the hard work, and
financial concerns (Alario-Hoyos et al., 2014). Participants in this study stated that MOOCs were
not a good fit for all subjects and levels of academic degrees. Understanding copyright and fair
use in the context of MOOC was cited as a concern in this study. The design and development of
proper assessments (Najafi et al., 2015; Yuan & Powell, 2013) as well as low completion rates
(Asiri, 2014; Hu, 2020; Reich & Ruipérez-Valiente, 2019; Vilkova) remained challenges for
MOOC instructors.
The results indicated that preparing to teach a MOOC, just like planning any online
course, was time-consuming, which conformed to previous research (Bonk & Lee, 2017; Gulatee
& Nilsook, 2016). How to get MOOC learners engaged and how to work more efficiently and
productively given the significant amount of time requested for creating a MOOC were
discussed. One of the suggestions for prospective MOOC instructors to consider was to start
planning earlier if possible and develop a manageable timeline to keep track of work no matter
choosing to be a solo MOOC instructor or a co-MOOC instructor with others.
Lacking adequate professional preparation or experience was documented as a barrier in
teaching MOOCs (Doo et al., 2020; Zhu, Bonk, & Sari, 2019). The findings of this study
suggested that MOOC instructors had limited experience in teaching online/hybrid classes before
diving into a MOOC. Most of them had to seek help from professionals, such as instructional
designers, educational technologists, or technological specialists to design and develop their
MOOCs.
185
Connection to the Conceptual Framework
The Conceptual Framework (see Chapter 2) in this study was grounded in two theories:
Deci and Ryan’s Self-Determination Theory (1985) and Berge’s Model of Instructor’s Roles
(1995). The findings of this study supported what Deci and Ryan advocated in the Self-
Determination Theory and provided different views when looking at Berge’s model in a MOOC
context to identify the roles of MOOC instructors.
The Self-Determination Theory posited that human beings were intrinsically driven to
engage in activities that would satisfy innate psychological needs (i.e., autonomy, competence,
relatedness) which led to enhanced self-motivation and well-being. In terms of who participated
in the survey and interviews, intrinsic motivators were deemed to have a greater impact in the
decision making to teach a MOOC than extrinsic ones. The findings thus supported what the
Self-Determination Theory stated about the impact of intrinsic motivation on human behavior.
Berge’s model was initially developed to identify the roles and functions of online
instructors in the context of online discussion to facilitate students’ learning. His model classified
online instructor’s roles into four types: pedagogical, social, managerial, and technical,
specifically for facilitating online discussion activities. These roles were not exclusive to each
other. As a matter of fact, some functions and roles in the model overlapped with teaching
practices. That said, the findings of the study were partially aligned with Berge’s statements. The
results found that MOOC instructors used limited strategies to engage learners and foster a
supportive social environment and those efforts happened in only a few MOOCs due to various
barriers such as a shortage of time, heavy workload caused by the massive number of enrollees
per MOOC, low participation of learners, insufficient feedback from learners, no compensation
for the time spent engaging with students, language barriers, time differences, as well as other
186
competing duties and responsibilities as a higher education faculty member. The social role was
identified in this study but only in a small number of MOOCs. While evidence revealed that the
primary role performed by a MOOC instructor was pedagogically orientated at the stages of
planning, designing, and delivering a MOOC through multiple activities. The remaining roles
such as technical and/or managerial roles were shifted to a team of professionals from MOOC
providers or student assistants affiliated with the MOOC instructors.
Recommendations for current and prospective MOOC instructors, higher education
administrators, instructional designers, and MOOC platform developers, and implications for
practice were presented in the following sections.
Implications for Practice
Findings from this study had implications for various stakeholders involved in the
development and delivery of MOOCs. In this section, implication for MOOC instructors and
institutional administrators were presented followed by implications for instructional designers
and MOOC platform developers.
Implications for MOOC Instructors and Higher Education Administrators
Empirical studies had shown that creating an online course (including MOOCs) took a
significant amount of time away from the instructor (Asunda et al., 2018; Crawford-Ferre &
Wiest, 2012; Johnson, 2013; Kenny & Fluck, 2017; Pickering, et al., 2017; Shaver, 2017). Many
participants in this study commented that preparing to teach and developing a MOOC were time-
consuming. It is therefore critical for the prospective MOOC instructor to know that in advance
and start the MOOC work as early as possible in order to allocate sufficient time to plan, explore
options, pilot everything, and tinker with changes. This is particularly noteworthy for those
tenure-track junior faculty who are interested in teaching MOOCs but have to juggle competing
187
priorities. Developing a realistic timeline and actionable goals may help complete all course
planning work on time. Seasoned MOOC instructors pointed out that forming a team with
professionals, such as instructional designers, video producers, and educational technologists
was crucial to the success of developing their MOOCs. These experts helped ensure the accuracy
of the work and accelerate the development process. It was common to see that one MOOC had
multiple instructors in searches of a course via edX or Coursera. Collaborating with multiple
instructors for crafting content and recording lectures or inviting guest speakers to share the
latest trends in a MOOC is highly recommended. Prospective or veteran MOOC instructors who
feel overwhelmed with heavy workload may consider this advice.
Compared to prospective MOOC instructors, the implications for veteran MOOC
instructors focus on things like keeping content fresh and up to date and increasing student
engagement using various approaches. According to MOOC instructors in this study, constantly
updating content was one way to keep students engaged. The majority of the MOOC instructors
reported that they had difficulty getting learners engaged and obtaining feedback from them in
MOOCs. Only a few of them had built successful learner-to-instructor interactions. A trend
emerged from the MOOCs with a high level of learner engagement was to provide a variety of
opportunities for learners to connect with the content, their peers, and the instructor(s). Some
approaches cited by MOOC instructors in engaging learners including hosting online webinars,
using social media (e.g., Twitter), and offering virtual office hours or offline meeting
opportunities in a specific location.
Regardless of various reasons for MOOC instructors to teach a MOOC, it was found that
MOOC work was not necessarily well understood and acknowledged by administrators or
institutions where MOOC instructors worked. Participants in this study hoped that administrators
188
could gain a better understanding of what they had been doing in MOOCs and acknowledge their
hard work in a proper way, such as compensating their time for developing MOOCs, allowing
them to trade off the time spent on delivering a MOOC, or considering adding MOOC work to
their regular teaching load. In addition, they stressed the lack of acknowledgment of MOOC
work in the tenure and promotion reviews. Being recognized and appreciated could encourage
faculty to offer more MOOCs and help them receive more resources to develop MOOCs.
Administrative leaders could promote greater awareness of the effort higher education faculty
members had put together to deliver a MOOC. Acknowledging MOOC work would send a
powerful message to faculty members and keep them motivated to make more. Interviewees in
this study indicated that they had a rewarding experience participating in MOOCs, but they
needed more support in various aspects, such as pre-training, content development, video
production, and recruiting assistants for daily maintenance. These needs can be addressed by
offering professional development training for faculty to attend, recruiting instructional designers
and video producers to work with them, hiring student workers or graduate students or providing
funding for them to use. It was suggested that prospective and experienced MOOC instructors
initiate a conversation with their department chairs (or deans) clarifying how much time and
work needed to create a MOOC before committing to teach one solo or collaboratively.
Implications for Instructional Designers and MOOC Platform Developers
In addition to the implications for MOOC instructors and higher education administrators,
the results had practical implications for instructional designers and MOOC platform developers.
Given MOOCs differed from traditional online courses, instructional designers need to consider
altering approaches used for traditional online classes when working with MOOC instructors.
Registering for one or two MOOC(s) from different MOOC platforms may help gain some
189
insights, get a first-hand learner experience, and spark off ideas to help faculty reassess learner
needs, support learner-to-instructor interactions, and promote adequate feedback loops.
It would be helpful to see opportunities are given to MOOC platform developers to
communicate with MOOC instructors (content experts) and instructional designers so that they
have a chance to learn more about the needs of MOOC instructors and instructional designers.
MOOC instructors may want to hear more from MOOC platform developers about what they can
and cannot achieve from the programming standpoint in an effort to incorporate more engaging
approaches and tools into strengthening the learning experience. Prospective MOOC instructors
may be interested in attending an open information session to learn about how to become a
MOOC instructor or look for collaborators to co-teach a MOOC. Perceptions and feedback
collected from MOOC instructors should be considered and included in a thorough analysis
when the platform makes optimization and upgrading.
Limitations
Given this research used a convergent parallel mixed method design, the first limitation
was attributed to the research design. For quantitative and qualitative phases, unequal sample
sizes were adopted to serve different purposes (generalization vs. in-depth understanding). The
size of the quantitative samples was larger than the counterpart in qualitative phase that limited
to a small number of interviewees to gain an in-depth understanding of a given subject.
The findings derived from this study had limited ability to be generalized to all higher
education institutions because this study was delimited to MOOC instructors who were currently
teaching a MOOC or had taught a MOOC previously via edX or Coursera from 2013 to 2017.
Findings were not intended to be representative of all MOOC instructors outside of this context.
190
For a study of this type, focusing on edX and Coursera was perceived as limited in scope. The
generalization of the results and recommendations should be considered with caution.
Conclusions were drawn based on the perceptions of study participants. Surveys and
interviews yielded self-reported data and included participant biases to some degree. Participants
might have inaccurate memories of experiences, they might hesitate to reveal their perceptions
on a particular topic, and they might be untruthful or give socially acceptable responses.
It is impossible to develop a meaningful understanding of human experience without
considering how it is affected by the values and beliefs of the researcher (Ary, Jacobs, Irvine, &
Walker, 2013). Another limitation of this study was the researcher’s bias toward data analysis
might influence things like the questions explored and the themes identified in the process of
coding and analysis.
The data collection timing might harm the response rates since recruitment emails were
distributed during the summer break. Some prospective participants (i.e., higher education
faculty members) were off-duty and responded to the recruitment with an automatic reply during
the data collection period.
Recommendations for Future Research
Given the findings and first-hand evidence, some future research endeavors are needed.
In this section, recommendation for future research and framework development are explored.
Investigate Experience of MOOC Instructors Who Drop Out after Teaching a MOOC
While studies (although a few) have explored the experience of MOOC instructors who
had taught a MOOC, far fewer research had investigated why higher education faculty members
drop out of teaching MOOCs after offering at least one. It is recommended that future studies
could focus on exploring the intention of this group of MOOC instructors to gain a better
191
understanding of their attitudes and perceptions of MOOCs as well as the challenges or causes
that may lead them not to stay teaching MOOCs.
Investigate MOOC Instructors’ Experience of Delivering a MOOC in Developing
Countries
A comparative study could investigate MOOC instructors’ experience in developed
countries and developing countries. With the rapid development of technologies in online
education, MOOCs emerged as a worldwide educational innovation. Exploring MOOC
instructors’ experiences from all over the world to inform best practices in this field can be
meaningful.
Explore Attitudes and Perceptions of Administrators and Faculty from Higher Education
Institutions That Have Offered MOOCs
Participants in this study relayed a common message that they found getting their hard
work in MOOCs acknowledged by colleagues or administrators considerably challenging. There
is a need for investigation of administrators and more faculty at higher education institutions
regarding their attitudes toward MOOCs and how MOOC teaching work is handled in the tenure
and promotion reviews. Faculty has the majority of voices regarding tenure and promotion
decisions, as well as various assessments and curricula. It would be great to hear more voices
from them to further explore this research topic. A better understanding of higher education
administrators’ perceptions of MOOCs could help make informed decisions and pedagogical,
technological, psychological, and financial support MOOC instructors.
192
Investigate MOOC Instructors’ Experience of Delivering a MOOC in a Different Language
Other Than English
The current study draws on participants from MOOCs delivered in English only. Future
studies could be framed to explore MOOC instructors’ experience in delivering a MOOC in
other languages to see if languages have any impact on teaching MOOCs. Courses on edX are
offered in 18 languages, such as Spanish, French, Chinese Mandarin, and so forth.
Develop a Role Model for MOOC Instructors
Future research is suggested to focus on developing a role model for MOOC instructors
in an effort to help them understand what roles and competencies are needed to perform in
MOOC teaching activities and guide them through different stages of making a MOOC, as well
as revamping the definitions of each role defined in Berge’s work to reflect the uniqueness of
MOOC instructors.
Conclusion and Summary
Distance Education (DE) has been introduced and implemented in the United States for
several decades. MOOCs (Massive Open Online Courses) emerged as an innovative form of DE
and proliferated since 2012. This new modality empowered knowledge providers to reach out to
diverse audiences who enjoy the open educational opportunities and flexibility of learning
anytime/anywhere at their own pace.
This study explored the experiences of higher education faculty members who had taught
a MOOC or were currently teaching a MOOC via edX and Coursera, including identifying the
motivators that influenced them most to participate in teaching MOOCs, understanding the
nature of their roles and the potential issues involved in delivering MOOCs, and learning about
the lessons they received from their MOOC journeys. This study responded to the need to
193
explore the experience of MOOC instructors in order to close the gaps between theory and
practice as well as share best practices in supporting higher education faculty members in
MOOC development and delivery.
Through a convergent parallel research design incorporating a web-based survey and
semi-structured interviews, I better understood the intention of higher education faculty members
to teach a MOOC, identified the intrinsic and extrinsic motivators that influenced them to
participate, discussed their roles and competencies needed for teaching a MOOC, interpreted
their experience, and analyzed benefits and challenges of teaching a MOOC.
I learned that the majority of the participants in this study have found their MOOC
teaching experience professionally rewarding and personally beneficial and have expressed their
willingness to teach a MOOC again and upscale their MOOCs. Using the Self-Determination
Theory, I found that participants in this study opted for teaching a MOOC primarily due to the
following intrinsic and extrinsic motivators: a) an opportunity/desire to share
knowledge/expertise with others, b) an opportunity to develop new ideas about teaching and
learning processes, c) a passion for teaching with technology, d) intellectual challenge, e) ability
to reach new audience globally, f) institutional decisions, g) others encouraged participation, and
h) external rewards. It was clear, however, that it’s primarily intrinsic motivation that drove their
wills to teach MOOCs.
Although the application of Berge’s model of Instructor’s Roles was not a good fit for
this study, I managed to identify competencies needed for a MOOC instructor: a) commitment;
b) content expertise; c) understanding of online teaching context; d) camera presence, and e)
language accessibility. There may be better models or frameworks of instructor roles that might
fit MOOC or there may be a need to develop a new model for MOOC instructors.
194
Benefits and challenges were thoroughly examined from the perspectives of novice and
veteran MOOC instructors in this study. Based on the participants’ statements, tangible benefits
included a) teaching a MOOC helped a MOOC instructor become more academically visible and
a better teacher; b) MOOCs gave the instructor a chance to serve adult learners and professional
needs, and c) MOOCs helped the instructor to reach a less privileged audience from all over the
world. Challenges in teaching a MOOC were mostly revolved around MOOC instructors,
MOOC learners, and MOOC design factors, including a) MOOCs made instructors feel
overwhelmed due to immerse workload, shortage of time, the difficulty to get work
acknowledged, and the expense; b) the preparation of a MOOC was time-consuming; c) getting
MOOC learners to engage was difficult; d) the MOOC mode did not fit for all; e) rules about
copyright and fair use were unclear in the MOOC context; f) insufficient design of assessments
in MOOCs, and g) high enrollment and low completion rates as well as insufficient learner
feedback. Additionally, this study addressed the significance of instructional design in MOOCs
and faculty members’ critical needs for support in four areas: a) training and feedback; b) content
support; c) video production, and d) assistants/student workers.
Based on the above findings, I have proposed several recommendations for MOOC
instructors (novice and veteran), higher education administrators, instructional designers, and
MOOC platform developers. For instance, creating a manageable timeline and actionable goals,
forming a team with professionals, collaborating with other content experts, engaging MOOC
learners via various channels, developing and providing professional development training to
MOOC instructors in advance, recruiting graduate assistants or student workers to help daily
maintenance work, initiating conversations and clarifying expectations with department head
before committing to teaching MOOCs, offering opportunities for MOOC instructors,
195
instructional designers, and MOOC platform developers to exchange insights getting to know
more about each other’s needs.
197
APPENDIX B. RECRUITMENT EMAILS
Recruitment Letter (Quantitative Phase) Dear MOOC instructor,
I hope this email finds you very well.
My name is Youxin Zhang. I am a doctoral student at the University of Hawaiʻi at Mānoa
in the Department of Learning Design and Technology. I am conducting a research study to
understand the teaching experience of higher education faculty members who have taught a
MOOC or are currently teaching a MOOC via. This study is comprised of two phases: a
quantitative questionnaire and a qualitative interview. You are being asked to participate in the
online questionnaire. The questionnaire is to identify factors that influence faculty participation
in teaching MOOCs. Completing the questionnaire will take approximately 15-20 minutes. The
questionnaire questions are mainly multiple-choice.
If you would be interested in taking this survey, please click on this link:
https://tinyurl.com/MOOCs-UH-Manoa. A consent form and instructions for completing the
questionnaire will be provided on the web page. After reviewing the consent information,
responding to the questionnaire will be considered as your consent to participate in this study.
If you have any questions about the study, feel free to call or email me at 808.956.4922 or
[email protected]. You may also contact my advisor, Dr. Christine Sorensen-Irvine, at
808.956.3910 or [email protected] or the UH Human Studies Program at 808.956.5007 or
[email protected] to discuss problems, concerns and questions; obtain information; or offer
input with an informed individual who is unaffiliated with the specific research protocol.
Thank you in advance for your time and participation!
Sincerely,
Youxin Zhang
198
Recruitment Letter (Qualitative Phase) Dear [Participant’s First Name],
My name is Youxin Zhang. I am a doctoral student at the University of Hawaiʻi at Mānoa
in the Department of Learning Design and Technology. I am conducting a research study to
understand the teaching experience of higher education faculty members who have taught a
MOOC or are currently teaching a MOOC via edX (a MOOC platform provided over thousands
of online courses in a variety of disciplines). This study is comprised of two phases: a
quantitative questionnaire and a qualitative interview. You are being asked to participate in the
interview phase. The qualitative phase will use semi-structured interviews conducted online to
explore the faculty members’ experiences delivering a MOOC. Completing the interview will
take approximately an hour with 16 open-ended questions.
If you would be interested in participating in the interview, you may reply to this email
and indicate the best way for me to contact you to make arrangements for the interview. Detailed
information about the interview will be provided in another follow-up email once I hear from
you. The University of Hawaiʻi at Mānoa Institutional Review Board requires informed consent
from research participants. Therefore, an electronic copy of the consent form will be sent to you
via email requiring your signature. Please return it to me prior to the interview date.
If you have any questions about the study, feel free to call or email me at 808.956.4922 or
[email protected]. You may also contact my advisor, Dr. Christine Sorensen-Irvine, at
808.956.3910 or [email protected] or the UH Human Studies Program at 808.956.5007 or
[email protected] to discuss problems, concerns and questions; obtain information; or offer
input with an informed individual who is unaffiliated with the specific research protocol.
Thank you in advance for your time and participation!
Sincerely,
Youxin Zhang
199
APPENDIX C. CONSENT FORMS
University of Hawai'i Consent to Participate in a Research Project
Youxin Zhang, Principal Investigator Project title: Higher Education Faculty Experiences in Teaching MOOCs (Massive Open Online Courses) Hello! My name is Youxin Zhang and you are cordially invited to take part in a research study. I am a doctoral student at the University of Hawai'i at Mānoa in the Department of Learning Design and Technology. As part of the requirements for finishing my dissertation, I am doing a research project. The purpose of my project is to understand the teaching experience of the higher education faculty members who have taught a MOOC or are currently teaching a MOOC via edX. I am asking you to participate because you are listed as the instructor on the website of edX, and you are at least 18 years old. Project Description – Activities and Time Commitment: If you decide to take part in this project, you will be asked to fill out an online questionnaire. The questionnaire questions are mainly multiple-choice. However, there will be a few questions where you may add an open-ended response. The questionnaire is accessed on a website to which I will provide you a link. Completing the questionnaire will take approximately 15-20 minutes. Benefits and Risks: There will be no direct benefit to you for taking part in this project. The findings from this project may be of use to inform administrative decisions about MOOCs and help faculty considering MOOCs to better understand the experience and inform design for better facilitating MOOC learning. There is little risk to you for participating in this project. Confidentiality and Privacy: I will not ask you for any personal information, such as your name or address. All responses will be kept confidential. Voluntary Participation: You can freely choose to take part or to not take part in this questionnaire. There will be no penalty or loss of benefits for either decision. If you do agree to participate, you can stop at any time. Questions: If you have any questions about this study, please call or email me at 808.956.4922 or [email protected]. You may also contact my advisor, Dr. Christine Sorensen-Irvine, at 808.956.3910 or [email protected], or the UH Human Studies Program at 808.956.5007 or [email protected] to discuss problems, concerns and questions. Please visit https://www.hawaii.edu/researchcompliance/information- research-participants for more information on your rights as a research participant. To Access the Questionnaire: https://tinyurl.com/MOOCs-UH-Manoa. Going to the first page of the questionnaire will be considered as your consent to participate in this study. Please print a copy of this page for your reference. Thank you for your participation!
200
University of Hawai'i Consent to Participate in a Research Project
Youxin Zhang, Principal Investigator Project title: Higher Education Faculty Experiences in Teaching MOOCs (Massive Open Online Courses) Hello! My name is Youxin Zhang and you are invited to take part in a research study. I am a doctoral student at the University of Hawai'i at Mānoa in the Department of Learning Design and Technology. As part of the requirements for finishing my dissertation, I am doing a research project. The purpose of my project is to understand the teaching experience of the higher education faculty members who have taught a MOOC or are currently teaching a MOOC via edX. I am asking you to participate because you are listed as the instructor on the website of edX, and you are at least 18 years old. Activities and Time Commitment: If you volunteer to participate in this project, I will meet with you for an online interview at a time that is most convenient for you. The interview will consist of 16 open-ended questions and I anticipate it will take about an hour. Interview questions will include questions like, “Can you describe your role or roles in developing and teaching MOOCs?” “What do you see as the greatest benefits/challenges of teaching a MOOC?” Only you and I will be present during the interview. With your permission, I will audio-record the interview so that I can later transcribe the interview and analyze the responses. You will be one of about 20 people I will interview for this study. Benefits and Risks: There will be no direct benefit to you for participating in this interview. You may, however, gain personal insights into your MOOC experience. The results of this project may inform administrative decisions about MOOCs and help faculty considering MOOCs to better understand the experience and inform design for better facilitating MOOC learning. I believe there is little risk to you for participating in this research project. If you become stressed or uncomfortable answering any of the interview questions or discussing topics with me during the interview, you can skip the question or take a break. You can also stop the interview or you can withdraw from the project altogether. Privacy and Confidentiality: I will keep all study data secure in a locked filing cabinet and on an encrypted password protected computer. Only my University of Hawai'i advisor and I will have access to the information. Other agencies that have legal permission have the right to review research records. The University of Hawai'i Human Studies Program has the right to review research records for this study. After I transcribe the interview, I will erase or destroy the audio-recordings. When I report the results of my research project, I will not use your name. I will not use any other personal identifying information. I will use pseudonyms (fake names) and report my findings in a way that protects your privacy and confidentiality to the extent allowed by law.
201
Voluntary Participation: Your participation in this project is completely voluntary. You may stop participating at any time. If you stop being in the study, there will be no penalty or loss to you. Your choice to participate or not participate will not affect your rights to teach at edX or Coursera.
202
University of Hawai'i
Consent to Participate in a Research Project Youxin Zhang, Principal Investigator
Project title: Higher Education Faculty Experiences in Teaching MOOCs (Massive Open Online Courses) Questions: If you have any questions about this study, please call or email me at 808.956.4922 or [email protected]. You may also contact my advisor, Dr. Christine Sorensen-Irvine, at 808.956.3910 or [email protected], or the UH Human Studies Program at 808.956.5007 or [email protected] to discuss problems, concerns and questions; obtain information; or offer input with an informed individual who is unaffiliated with the specific research protocol. Please visit https://www.hawaii.edu/researchcompliance/information- research-participants for more information on your rights as a research participant. If you agree to participate in this project, please sign and date this signature page and return it to: Youxin Zhang ([email protected]) Keep this copy of the informed consent for your records and reference. Signature(s) for Consent: I give permission to join the research project entitled, “Higher Education Faculty Experiences in Teaching MOOCs (Massive Open Online Courses).” Please initial next to either “Yes” or “No” to the following: Yes No I consent to be audio-recorded for the interview portion of this research. Name of Participant (Print): __________________________________________ Participant’s Signature: _____________________________________________ Signature of the Person Obtaining Consent: ___________________________________ Date: ____________________________ Thank you for your participation!
203
APPENDIX D. SURVEY INSTRUMENT
Survey Title: Higher Education Faculty Experience in Teaching MOOCs (Massive Open Online Courses) Aloha (Hello), The purpose of this study is to understand the teaching experience of higher education faculty members who have taught a MOOC or are currently teaching a MOOC via edX. If you decide to participate in this study, you will be asked to fill out an online survey (next page). The survey questions are mainly multiple-choice. However, there will be a few questions where you may add an open-ended response. Completing the questionnaire will take approximately 10-15 minutes. There will be no direct benefit to you for taking part in this survey. The findings from this study may be used to help guide administrative decisions concerning MOOCs. The findings may also be used to help higher education faculty considering MOOCs to better understand the MOOC experience, as well as aide in design decisions to better facilitate MOOC learning. I will not ask you for any personal information such as your name or address. All responses will be kept anonymous and confidential. You can freely choose to take part or to not take part in this survey. There will be no penalty or loss of benefits for either decision. You can stop at any time in spite of your agreement to participate. If you have any questions about this study, please reach me at [email protected], or my advisor Dr. Christine Sorensen-Irvine at [email protected]. Thank you very much for your consideration. Please indicate your consent to participating
Yes, I agree to participate.
No, I do not agree. Section 2 Teaching Background
1. How many years have you been teaching in post-secondary education?
2. What level of student(s) do you teach? Please check all that apply.
Undergraduate
Master
Doctorate
204
Other
3. Before you taught a MOOC, had you taught an online/blended(hybrid) course previously?
Yes
No
Other
4. Have you taken any online/hybrid courses before?
Yes
No
Other
5. Have you received any online degrees/certificates? Please specify.
Section 3 MOOC Background
6. How many years have you been teaching MOOC(s) via edX?
7. How many students did you have for your first MOOC?
8. Have you taught/are you teaching any MOOC(s) via a MOOC provider other than edX?
Please specify.
9. What subjects have you taught via MOOCs? Please check all that apply.
Architecture
Art & Culture
Biology & Life Sciences
Business & Management
Chemistry
Communication
Computer Science
Data Analysis & Statistics
205
Design
Economics & Finance
Education & Teacher Training
Electronics
Energy & Earth Sciences
Engineering
Environmental Studies
Ethics
Food & Nutrition
Health & Safety
History
Humanities
Language
Law
Literature
Math
Medicine
Music
Philosophy & Ethics
Physics
Science
Social Sciences
Other
206
10. On average, how many hours per week do you spend preparing for your MOOC(s)?
11. How would you best describe your role in delivering MOOC(s)?
I am the primary instructor.
I am the primary designer for the course.
I am the co-instructor.
I am the co-designer.
I work more behind the scenes: preparing materials, assisting students, grading, etc.,
similar to the role of a TA (teaching assistant).
Other
12. What communication tool(s) do you provide for students to contact you in your MOOC? Please check all that apply.
Phone
Instant messenger
Video conferencing tool or Skype
Online message board or discussion forum
Virtual office hours
Noe
Other
13. Do you believe your MOOC is as academically rigorous as the traditional classroom version of the course?
Yes
No
Other
207
14. Before teaching your MOOC, which of the following best described your beliefs about fully online courses?
Very skeptical
Somewhat skeptical
Somewhat enthusiastic
Very enthusiastic
15. Which of the following best describes your beliefs about fully online courses now?
Very skeptical
Somewhat skeptical
Somewhat enthusiastic
Very enthusiastic
16. Has the experience of teaching a MOOC inspired you to change the way you teach in
general?
Yes
No
Other
17. Do you feel satisfied having taught your first MOOC?
Yes
No
18. Would you teach a MOOC again? Please specify your reason(s). Section 4 Self-Assessment
19. Please rate the extent to which you agree or disagree with the following factors motivating you to teach MOOCs.
208
Strongly
disagree
Disagree Neutral Agree Strongly
Agree
Opportunity for scholarly pursuit
Opportunity to develop new ideas about
teaching the learning processes
Opportunity to use personal research as a
teaching tool
Opportunity to improve and enhance online
teaching skills
Opportunity to influence social change
Opportunity to share knowledge with
others
Opportunity to diversify program offerings
Support and encouragement from
school/department dean or chair
Support and encouragement from
school/departmental colleagues
Support and encouragement from
institution administrators
Technical support provided by the
institution
MOOC training provided by the institution
Faculty opinions and beliefs about online
courses
Expectation by university that faculty
participate
Requirement by department
Visibility among colleagues within their
discipline
Visibility for jobs at other
institutions/organizations
209
Strongly
disagree
Disagree Neutral Agree Strongly
Agree
Monetary support for participation
(stipend, overload)
Grants for MOOC materials/expenses
Increase in salary
Merit pay
Credit toward promotion and tenure
Professional prestige and status
Recognition and awards
Personal motivation to learn and use
technology
Intellectual challenge
Royalties on copyrighted materials
Develop new competencies
Ability to reach new audiences globally
Greater course flexibility for students
Reduced teaching load
Release time
Overall job satisfaction
Job security
Career exploration/development
Section 5 Demographics
20. Gender
Male
Female
Other
21. Age
22. Ethnicity
210
American Indian or Alaska Native
Asian
Black or African American
Hispanic or Latino
Native Hawaiian or Pacific Islander
White/Caucasian
Other
23. Education (indicate the highest level of education you have completed)
Bachelor's Degree (e.g., BA, BS)
Master's Degree (e.g., MA, MS, MEd)
Doctorate (e.g., PhD, EdD)
Professional Degree (e.g., MD, DDS, DVM)
Other
24. Position title at your current institution
Distinguished, Endowed or University Professor
Professor (full professor)
Associate Professor
Assistant Professor
Research Associate
Instructor
Lecturer
Other
25. What else would you like to share with me?
215
APPENDIX F. INTERVIEW PROTOCOL
Script for the beginning of the interview.
Hello, my name is Youxin Zhang. I am a doctoral student from the department of Learning
Design and Technology at the University of Hawaii at Manoa. I am here to learn more about the
teaching experience of higher education faculty members who taught a MOOC (Massive Open
Online Courses) or are currently teaching a MOOC via edX. Thank you very much for returning
the consent form via email and for taking the time to talk with me today.
There are no desirable or undesirable answers in today’s interview. I would like you to feel
comfortable saying what you really think and how you really feel. I will be recording our
conversation today if that’s okay with you. I will make a transcript of the audio recording to be
used for analysis. No identifying information will be included in the transcript.
Everything you say will remain confidential. Only my committee chair and myself will have
access to the transcript data. Do you have questions for me before we get started?
Interview questions
1. How long have you been teaching a MOOC?
2. Can you briefly describe each of the MOOCs you have taught, including approximately
how many students were enrolled and the content?
3. How did you get started teaching MOOCs?
4. What factors did you consider in making your decision to teach a MOOC?
5. What was the most compelling factor in the final decision to teach a MOOC?
6. Can you describe your role or roles in developing and teaching MOOCs?
7. Can you describe what you do in a typical week in terms of preparing for and teaching a
MOOC?
8. How is teaching a MOOC similar to or different from teaching non-MOOC classes?
9. What characteristics do you think are important to be an effective instructor in a MOOC?
10. What teaching strategies have you found to be effective or ineffective?
11. Can you tell me an interesting story about an experience you have as a MOOC instructor?
12. What do you see as the greatest benefits of teaching a MOOC?
13. What do you see as the greatest challenges of teaching a MOOC?
14. What do you wish you had known before teaching your first MOOC?
216
15. If you have an opportunity to teach a MOOC in the future, what might you do
differently?
16. Is there anything else you would like to share about your experience teaching a MOOC?
Script for the end of the interview.
Thank you very much for meeting with me today. I enjoyed talking with you. Your time is
very much appreciated and your insights have been very helpful in understanding more about the
experiences of higher education faculty teaching MOOCs. Just as a reminder, I will keep your
responses confidential and you will be kept anonymous in all reports of this study. Feel free to
email me or call me (put my contact information on the sharing-screen) if you have any
questions. There may be a subsequent contact if there is a need for me to clarify. Again, thank
you very much for your participation. Have a great day!
217
REFERENCES
Adamopoulos, P. (2013, December). What makes a great MOOC? An interdisciplinary analysis of student retention in online courses [Paper presentation]. International Conference on Information Systems, Milan, Italy.
Adams, C., Yin, Y., Vargas Madriz, L. F., & Mullen, C. S. (2014). A phenomenology of learning large: The tutorial sphere of xMOOC video lectures. Distance Education, 35(2), 202–216.
Adams, D. S. (2016). Teaching distance education in library science: A comparative study of faculty satisfaction, teaching effectiveness, and support services (Publication No. 10127007) [Doctoral dissertation, University of South Carolina]. ProQuest Digital Dissertations.
Adebisi, T. A., & Oyeleke, O. (2018). Promoting effective teaching and learning in online environment: A blend of pedagogical and andragogical models. Bulgarian Journal of Science & Education Policy, 12(1).
Admiraal, W., Huisman, B., & Pilli, O. (2015). Assessment in massive open online courses. Electronic Journal of E-Learning, 13(4), 207-216.
Admiraal, W., Huisman, B., & Van de Ven, M. (2014). Self- and peer assessment in massive open online courses. International Journal of Higher Education, 3(3), 119–128.
Afshar, V. (2017, December 06). Adoption of massive open online courses [Worldwide Survey]. Huffpost. https://www.huffpost.com/entry/infographic-adoption-of-m_b_3303789
Agarwal, A. (2012). Circuits and electronics, MITx. Chronicle of Higher Education, 59(6), B10.
Akdemir, O. (2008). Teaching in online courses: Experiences of instructional technology faculty members. Online Submission, 9(2), 97-108.
Al-Rahmi, W., Aldraiweesh, A., Yahaya, N., Kamin, Y. B., & Zeki, A. M. (2019). Massive open online courses (MOOCs): Data on higher education. Data in brief, 22, 118-125.
Alario-Hoyos, C., Estévez-Ayres, I., Pérez-Sanagustín, M., Kloos, C. D., & Fernández-Panadero, C. (2017). Understanding learners’ motivation and learning strategies in MOOCs. The International Review of Research in Open and Distributed Learning, 18(3).
Alario-Hoyos, C., Pérez-Sanagustín, M., Delgado-Kloos, C., & Munoz-Organero, M. (2014). Delving into participants’ profiles and use of social tools in MOOCs. IEEE Transactions on Learning Technologies, 7(3), 260-266.
Albrahim, F. A. (2020). Online teaching skills and competencies. Turkish Online Journal of Educational Technology, 19(1), 9-20.
218
Allen, I. E., & Seaman, J. (2007, October). Online nation: Five years of growth in online learning. The Sloan Consortium. Retrieved from http://files.eric.ed.gov/fulltext/ED529699.pdf
Allen, I. E., & Seaman, J. (2008, November). Staying the course: Online education in the United States. The Sloan Consortium. https://onlinelearningsurvey.com/reports/staying-the-course.pdf
Allen, I. E., & Seaman, J. (2012, June). Conflicted: Faculty and online education, 2012. Babson Survey Research Group and Inside Higher Ed. https://www.insidehighered.com/sites/default/server_files/files/IHE-BSRG-Conflict.pdf
Allen, I. E., Seaman, J., Poulin, R., & Straut, T. T. (2016, February). Online report card: Tracking online education in the United States. Babson Park, MA: Babson Survey Research Group and Quahog Research Group, LLC. Babson Survey Research Group. https://onlinelearningsurvey.com/reports/onlinereportcard.pdf
Allen, I., & Seaman, A. (2010, January). Learning on demand: Online education in the United States, 2009. The Sloan Consortium and Babson Survey Research Group. https://files.eric.ed.gov/fulltext/ED529931.pdf
Allen, I.E. and Seaman, J. (2013, January). Changing Course: Ten years of tracking online education in the United States. The Sloan Consortium and Babson Survey Research Group. https://www.onlinelearningsurvey.com/reports/changingcourse.pdf
Allison, C. L. (2015). An Investigation into the Experiences of Traditional Higher Education Instructors Transitioning into Effective Online Instructors (Publication No. 3707563) [Doctoral dissertation, Northcentral University]. ProQuest Digital Dissertations.
Allon, G. (2012). Operations management, Udemy. Chronicle of Higher Education, 59(6), B10–11.
Alshenqeeti, H. (2014). Interviewing as a data collection method: A critical review. English Linguistics Research, 3(1), 39.
Alvarez, I., Guasch, T., & Espasa, A. (2009). University teacher roles and competencies in online learning environments: A theoretical analysis of teaching and learning practices. European Journal of Teacher Education, 32(3), 321-336.
Ary, D., Jacobs, L. C., Irvine, C. K. S., & Walker, D. (2018). Introduction to research in education. Cengage Learning.
Asiri, O. I. (2014). A comparison between international and US graduate students’ attitudes and experiences using massive open online courses (MOOCs) (Publication No. 1563399) [Master’s thesis, Rochester Institute of Technology]. ProQuest Digital Dissertations.
Asunda, P. A., Calvin, J., & Johanson, R. (2018). Preparing for online and distance learning courses. In K. Jared, S. Gary, & K. Kenneth (Eds.), Cross-cultural online learning in higher
219
education and corporate training (pp. 229-243). IGI Global. https://doi.org/10.4018/978-1-4666-5023-7
Baggaley, J. (2013). MOOC rampant. Distance Education, 34(3), 368-378.
Bailey, C. J., & Card, K. A. (2009). Effective pedagogical practices for online teaching: Perception of experienced instructors. The Internet and Higher Education, 12(3), 152-155.
Bakayev, V., Vasilyeva, V., Kalmykova, S., & Razinkina, E. (2018). Theory of physical culture-a massive open online course in educational process. Journal of Physical Education and Sport, 18(1), 293-297.
Baker, b. W. (2020). A case study assessing performance differences between economically impacted African American and white students in high school algebra II classes in the Tucson unified school district [Unpublished doctoral dissertation]. University of North Texas.
Baker, C., Nafukho, F., McCaleb, K., Becker, M., & Johnson, M. (2015). The tangible and intangible benefits of offering massive open online courses: Faculty perspectives. Internet Learning Journal, 4(2).
Ball, J. W. (2013). Factors affecting adoption and diffusion of distance education among health education faculty (Publication No. 3587954) [Doctoral dissertation, Southern Illinois University at Carbondale]. ProQuest Digital Dissertations.
Bao, W. (2020). COVID‐19 and online teaching in higher education: A case study of Peking University. Human Behavior and Emerging Technologies, 2(2), 113-115.
Barak, M., & Watted, A. (2017). Project-based MOOC: Enhancing knowledge construction and motivation to learn. In L. Ilya & T. Dina (Eds.), Digital tools and solutions for inquiry-based STEM learning (pp. 282-307). IGI Global. https://doi.org/10.4018/978-1-5225-2525-7.ch011
Baran, E. (2011). The transformation of online teaching practice: Tracing successful online teaching in higher education (Publication No. 3472990) [Doctoral dissertation, Iowa State University]. ProQuest Digital Dissertations.
Baran, E., Correia, A. P., & Thompson, A. (2011). Transforming online teaching practice: Critical analysis of the literature on the roles and competencies of online teachers. Distance Education, 32(3), 421-439.
Baran, E., Correia, A. P., & Thompson, A. (2013). Tracing successful online teaching in higher education: Voices of exemplary online teachers. Teachers College Record, 115(3), 1-41.
Barber, R., & Sharkey, M. (2012, April). Course correction: Using analytics to predict course success [Paper presentation]. International Conference on Learning Analytics and Knowledge, New York, NY, United States.
220
Barnard-Brak, L., Paton, V. O., & Lan, W. Y. (2010). Profiles in self-regulated learning in the online learning environment. The International Review of Research in Open and Distributed Learning, 11(1), 61-80.
Barnes, C. (2013). MOOCs: The challenges for academic librarians. Australian Academic & Research Libraries, 44(3), 163-175.
Basilaia, G., & Kvavadze, D. (2020). Transition to online education in schools during a SARS-cov-2 coronavirus (COVID-19) pandemic in Georgia. Pedagogical Research, 5(4), 1-9.
Bates, T. (2012, August 5). What’s right and what’s wrong about Coursera-style MOOCs. https://www.tonybates.ca/2012/08/05/whats-right-and-whats-wrong-about-coursera-style-moocs/
Bates, T. (2014, October 13). Comparing xMOOCs and cMOOCs: Philosophy and practice. https://www.tonybates.ca/2014/10/13/comparing-xmoocs-and-cmoocs-philosophy-and-practice/
Bawane, J., & Spector, J. M. (2009). Prioritization of online instructor roles: Implications for competency‐based teacher education programs. Distance Education, 30(3), 383-397.
Baxter, J., & Eyles, J. (1997). Evaluating qualitative research in social geography: Establishing ‘rigor’ in interview analysis. Transactions of the Institute of British Geographers, 22(4), 505-525.
Becker, B. W. (2013). Connecting MOOCs and library services. Behavioral & Social Sciences Librarian, 32(2), 135-138.
Belanger, Y., & Thornton, J. (2013). Bioelectricity: A quantitative approach Duke University’s first MOOC. Duke University Libraries. http://dukespace.lib.duke.edu/dspace/bitstream/handle/10161/6216/Duke_Bioelectricity_MOOC_Fall2012.pdf?utm_campaign=elearningindustry.com&utm_source=/good-bad-ugly-side-of-corporate-mooc&utm_medium=link
Bell, B. S., Federman, J. E. (2013). E-learning in postsecondary education. The Future of Children, 23(1), 165–185.
Benson, S. N. K., & Ward, C. L. (2013). Teaching with technology: Using TPACK to understand teaching expertise in online higher education. Journal of Educational Computing Research, 48(2), 153-172.
Bento, L. D. M. S. (2014). What are the key success factors of MOOC platforms? [Unpublished master’s thesis]. Católica Lisbon School of Business and Economics, Portugal. https://repositorio.ucp.pt/bitstream/10400.14/16593/1/Master's%20Thesis%20-%20Louren%c3%a7o%20Bento.pdf
Berge, Z. L. (1995). Facilitating computer conferencing: Recommendations from the field. Educational Technology, 35(1), 22-30.
221
Berge, Z. L. (2008). Changing instructor’s roles in virtual worlds. Quarterly Review of Distance Education, 9(4), 407-414.
Betts, K. (2014). Factors influencing faculty participation & retention in online & blended education. Online Journal of Distance Learning Administration, 17(1), 1-20.
Betts, K. S. (1998). An institutional overview: Factors influencing faculty participation in distance education in postsecondary education in the United States: An institutional study. Online Journal of Distance Learning Administration, 1(3).
Betts, K. S. (1998). Factors influencing faculty participation in distance education in postsecondary education in the United States: An institutional study (Publication No. 9900013) [Doctoral dissertation, The George Washington University]. ProQuest Digital Dissertations.
Blackmon, S. (2018). MOOC makers: Professors’ experiences with developing and delivering MOOCs. International Review of Research in Open and Distributed Learning, 19(4).
Blanchette, K. (2016). Investigating faculty management of shifting roles in blended learning environments (Publication No. 10102202) [Doctoral dissertation, Southern New Hampshire University]. ProQuest Digital Dissertations.
Blanchette, K. (2016). Investigating faculty management of shifting roles in blended learning environments (Publication No. 10102202) [Doctoral dissertation, Southern New Hampshire University]. ProQuest Digital Dissertations.
Blum, E. R., Stenfors, T., & Palmgren, P. J. (2020). Benefits of massive open online course participation: Deductive thematic analysis. Journal of Medical Internet Research, 22(7), e17318.
Boettcher, J. V., & Conrad, R. M. (2016). The online teaching survival guide: Simple and practical pedagogical tips. John Wiley & Sons.
Bolliger, D. U., & Wasilik, O. (2009). Factors influencing faculty satisfaction with online teaching and learning in higher education. Distance Education, 30(1), 103-116.
Bonk, C. J., & Lee, M. M. (2017). Motivations, achievements, and challenges of self-directed informal learners in open educational environments and MOOCs. Journal of Learning for Development, 4(1).
Bonk, C. J., Wisher, R. A., & Lee, J. Y. (2004). Moderating learner-centered e-learning: Problems and solutions, benefits and implications. Online collaborative learning: Theory and practice, 54-85.
Bowen, H. R., & Schuster, J. H. (1986). American professors: A national resource imperiled. New York: Oxford University Press.
222
Bower, B. L. (2001). Distance education: Facing the faculty challenge. Online Journal of Distance Learning Administration, 4(2), 1-6.
Bozkurt, A., Akgün-Özbek, E., & Zawacki-Richter, O. (2017). Trends and patterns in massive open online courses: Review and content analysis of research on MOOCs (2008-2015). International Review of Research in Open and Distributed Learning, 18(5), 118-147.
Breslow, L. (2016). MOOC research: Some of what we know and avenues for the future. Portland Press Limited. http://www.portlandpresspublishing.com/sites/default/files/Editorial/Wenner/PPL_Wenner_Ch05.pdf
Breslow, L., Pritchard, D. E., DeBoer, J., Stump, G. S., Ho, A. D., & Seaton, D. T. (2013). Studying learning in the worldwide classroom: Research into edX's first MOOC. Research & Practice in Assessment, 8, 13-25.
Brinkley-Etzkorn, K. E. (2018). Learning to teach online: Measuring the influence of faculty development training on teaching effectiveness through a TPACK lens. The Internet and Higher Education, 38, 28-35.
Bruner, J. (2007). Factors motivating and inhibiting faculty in offering their courses via distance education. Online Journal of Distance Learning Administration, 10(2), 1-18.
Bulfin, S., Pangrazio, L., & Selwyn, N. (2014). Making ‘MOOCs’: The construction of a new digital higher education within news media discourse. The International Review of Research in Open and Distributed Learning, 15(5), 290-305.
Burkle, M., & Cleveland-Innes, M. (2013). Defining the role adjustment profile of learners and instructors online. Journal of Asynchronous Learning Networks, 17(1), 73-87.
Bussmann, S., Johnson, S. R., Oliver, R., Forsythe, K., Grandjean, M., Lebsock, M., & Luster, T. (2017). On the recognition of quality online course design in promotion and tenure: A survey of higher Ed institutions in the western United States. Online Journal of Distance Learning Administration, 20(1).
Carril, P. C. M., Sanmamed, M. G., & Sellés, N. H. (2013). Pedagogical roles and competencies of university teachers practicing in the e-learning environment. The International Review of Research in Open and Distributed Learning, 14(3), 462-487.
Catropa, D. (2013, February 24). Big (MOOC) data. Inside Higher Education. https://www.insidehighered.com/blogs/stratedgy/big-mooc-data
Chadaj, M., Allison, C., & Baxter, G. (2014, October). MOOCs with attitudes: Insights from a practitioner based investigation [Paper presentation]. Frontiers in Education Conference, Madrid, Spain.
223
Chang, C., Shen, H. Y., & Liu, Z. F. (2014). University faculty’s perspectives on the roles of e-instructors and their online instruction practice. The International Review of Research in Open and Distributed Learning, 15(3).
Chapman, D. D. (2011). Contingent and tenured/tenure-track faculty: Motivations and incentives to teach distance education courses. Online Journal of Distance Learning Administration, 14(3), n3.
Chen, X., Barnett, D. R., & Stephens, C. (2013, September). Fad or future: The advantages and challenges of massive open online courses (MOOCs) [Paper presentation]. Research-to-Practice Conference in Adult and Higher Education, St. Charles, Missouri.
Chiam, C. C. (2016). Benefits and challenges of massive open online courses. ASEAN Journal of Open & Distance Learning, 8(1), 16-23.
Chiasson, K., Terras, K., & Smart, K. (2015). Faculty perceptions of moving a face-to-face course to online instruction. Journal of College Teaching & Learning, 12(3), 231-240. https://doi.org/10.19030/tlc.v12i3.9315
Ching, Y. H., Hsu, Y. C., & Baldwin, S. (2018). Becoming an online teacher: An analysis of prospective online instructors’ reflections. Journal of Interactive Learning Research, 29(2), 145-168.
Cho, M. H., & Kim, B. J. (2013). Students' self-regulation for interaction with others in online learning environments. The Internet and Higher Education, 17, 69-75. https://doi.org/10.1016/j.iheduc.2012.11.001
Choi, H. J., & Park, J. H. (2006). Difficulties that a novice online instructor faced. Quarterly Review of Distance Education, 7(3), 317-322.
Christensen, G., Steinmetz, A., Alcorn, B., Bennett, A., Woods, D., & Emanuel, E. J. (2014, April 18). The MOOC phenomenon: Who takes massive open online courses and why? SSRN. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2350964
Cisel, M., Bachelet, R., & Bruillard, E. (2014). Peer assessment in the first French MOOC: Analyzing assessors' behavior [Paper presentation]. International Conference on Educational Data Mining. London, UK.
Clark-Ibanez, M., & Scott, L. (2008). Learning to teach online. Teaching Sociology, 36(1), 34-41.
Clark, D. (2013). MOOCs: Taxonomy of 8 types of MOOC. Blogspot. http://donaldclarkplanb.blogspot.ca/2013/04/moocs-taxonomy-of-8-types-of-mooc.html
Clow, D. (2013). MOOCs and the Funnel of Participation [Paper presentation] International Conference on Learning Analytics and Knowledge, Leuven, Belgium.
224
Cohen, L., Manion, L., & Morrison, K. (2013). Surveys, longitudinal, cross-sectional and trend studies. Research Methods in Education. Routledge. https://doi.org/10.4324/9780203720967
Cohen, L., Manion, L., & Morrison, K. (2013). Surveys, longitudinal, cross-sectional and trend studies. Research methods in education (pp. 256-289). Routledge.
Cole, A. W., & Timmerman, C. E. (2015). What do current college students think about MOOCs. MERLOT Journal of Online Learning and Teaching, 11(2), 188-201.
Collins, D., Weber, J., & Zambrano, R. (2014). Teaching business ethics online: Perspectives on course design, delivery, student engagement, and assessment. Journal of Business Ethics, 125(3), 513-529.
Compton, L. K. (2009). Preparing language teachers to teach language online: A look at skills, roles, and responsibilities. Computer Assisted Language Learning, 22(1), 73-99.
Conceição, S. C. (2006). Faculty lived experiences in the online environment. Adult Education Quarterly, 57(1), 26-45.
Conole, G. (2014). A new classification schema for MOOCs. The International Journal for Innovation and Quality in Learning, 2(3), 65-77.
Conole, G. G. (2015). MOOCs as disruptive technologies: Strategies for enhancing the learner experience and quality of MOOCs. Revista de Educación a Distancia, (39).
Cook, J. M. (2019). Factors that motivate community college faculty to teach online with implications for access and equity (Publication No. 13858438) [Doctoral dissertation, University of Massachusetts Boston]. ProQuest Digital Dissertations.
Cook, R. G., Ley, K., Crawford, C., & Warner, A. (2009). Motivators and inhibitors for university faculty in distance and e‐learning. British Journal of Educational Technology, 40(1), 149-163.
Cooper, S., & Sahami, M. (2013). Reflections on Stanford’s MOOCs. Communications of the ACM, 56(2), 28–30.
Cormier, D., & Siemens, G. (2010). The open course: Through the open door-open courses as research, learning, and engagement. Educause Review, 45(4), 30-32.
Couper, M. P. (2000). Web surveys: A review of issues and approaches. The Public Opinion Quarterly, 64(4), 464-494.
Crawford-Ferre, H. G., & Wiest, L. R. (2012). Effective online instruction in higher education. Quarterly Review of Distance Education, 13(1), 11.
Creswell, J. W. (2003). Research design: Qualitative, quantitative, and mixed method approaches. Thousand Oaks, CA: Sage.
225
Creswell, J. W. (2009). Research design: Qualitative, quantitative, and mixed methods approaches. Thousand Oaks, CA: Sage.
Creswell, J. W. (2012). Qualitative inquiry et research design: Choosing among five approaches. Thousand Oaks, CA: Sage.
Creswell, J. W., & Clark, V. L. P. (2007). Designing and conducting mixed methods research. SAGE.
Creswell, J. W., Plano Clark, V. L., Gutmann, M., and Hanson, W. (2003). Advanced mixed methods research designs. In Tashakkori, A., and Teddlie, C. (Eds.), Handbook of mixed methods in social and behavioral research (pp. 209-240). Thousand Oaks, CA: Sage.
Croxton, R. A., & Chow, A. S. (2015). Using ADDIE and systems thinking as the framework for developing a MOOC: A case study. Quarterly Review of Distance Education, 16(4), 83-96.
Cusumano, M. (2013). Are the costs of ‘free’ too high in online education? Communications of the ACM, 56(4), 26–29.
Dabas, N. (2018). Role of computer and information technology in education system. International Journal of Engineering and Technique, 4(1), 570-574.
Daniel, J. (2012). Making sense of MOOCs: Musings in a maze of myth, paradox and possibility. Journal of Interactive Media in education, (3).
Daniel, S. J. (2020, April). Education and the COVID-19 pandemic. Prospects. https://doi.org/10.1007/s11125-020-09464-3
Davidson, P. (2019). Future online faculty competencies: Student perspectives. International Journal on E-Learning, 18(3), 233-250.
Davison, C. (2013, June 11). Clearing up some myths about MOOCs. Hastac. https://www.hastac.org/blogs/cathy-davidson/2013/06/11/clearing-some-myths-about-moocs
De Liddo, A., Shum, S. B., Quinto, I., Bachler, M., & Cannavacciuolo, L. (2011, February). Discourse-centric learning analytics [Paper presentation]. International Conference on Learning Analytics and Knowledge, New York, NY, United States.
Deci, E. L., & Ryan, R. M. (1985). Intrinsic motivation and self-determination in human behavior. New York: Plenum.
Dehghani, S., Sheikhi Fini, A. A., Zeinalipour, H., & Rezaei, E. (2020). The competencies expected of instructors in massive open online courses (MOOCs). Interdisciplinary Journal of Virtual Learning in Medical Sciences, 11(2), 69-83.
Dell, C. A., Low, C., & Wilker, J. F. (2010). Comparing student achievement in online and face-to-face classes. Journal of Online Learning and Teaching, 6(1), 30.
226
Dellarocas, C., & Van Alstyne, M. (2013). Money models for MOOCs. Communications of the ACM, 56(8), 25-28.
Deng, R., Benckendorff, P., & Gannaway, D. (2019). Progress and new directions for teaching and learning in MOOCs. Computers & Education, 129, 48-60.
Dillahunt, T. R., Wang, B. Z., & Teasley, S. (2014). Democratizing higher education: Exploring MOOC use among those who cannot afford a formal education. The International Review of Research in Open and Distributed Learning, 15, 177–196.
Dipaola, M., & Wagner, C. A. (2018). Improving instruction through supervision, evaluation, and professional development (2nd ed.). Information Age Publishing (IAP).
Disanto, J. M., & Guevara, C. (2019). The online learning initiative: Training the early adopters. In Wolfe K., Lyons K., Guevara C. (Eds.), Developing Educational Technology at an Urban Community College (pp. 79-93). Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-030-17038-7_7
Doo, M. Y., Tang, Y., Bonk, C. J., & Zhu, M. (2020). MOOC instructor motivation and career development. Distance Education, 1-22.
Downes, S. (2010). Learning networks and connective knowledge. Collective Intelligence and E-learning (2), 1-26.
Downes, S., & Siemens, G. (2011). The MOOC guide. Google site. https://sites.google.com/site/themoocguide/
Dumford, A. D., & Miller, A. L. (2018). Online learning in higher education: Exploring advantages and disadvantages for engagement. Journal of Computing in Higher Education, 30(3), 452-465.
Duncan, H. E., & Young, S. (2009). Online pedagogy and practice: Challenges and strategies. The Researcher, 22(1), 17-32.
Duneier, M. (2012). Teaching to the world from central New Jersey. Chronicle of Higher Education, 59(2), 24.
Ebner, M., Schön, S., & Braun, C. (2020). More than a MOOC-seven learning and teaching scenarios to use MOOCs in higher education and beyond. In S. Yu, M. Ally, & A. Tsinakos (Eds.), Emerging Technologies and Pedagogies in the Curriculum (pp. 75-87). Springer.
Elliott, M., Rhoades, N., Jackson, C. M., & Mandernach, B. J. (2015). Professional development: Designing initiatives to meet the needs of online faculty. Journal of Educators Online, 12(1).
Emanuel, E. J. (2013). Online education: MOOCs taken by educated few. Nature, 503(342).
227
Eriksson, T., Adawi, T., & Stöhr, C. (2017). “Time is the bottleneck”: A qualitative study exploring why learners drop out of MOOCs. Journal of Computing in Higher Education, 29(1), 133-146.
Esterberg, K. G. (2002). Qualitative methods in social research. Boston, MA: McGraw-Hill.
Evans, S., & Myrick, J. G. (2015). How MOOC instructors view the pedagogy and purposes of massive open online courses. Distance Education, 36(3), 295-311.
Farmer, H., & Ramsdale, J. (2016). Teaching competencies for the online environment. Canadian Journal of Learning and Technology, 42(3).
Fedynich, L., Bradley, K. S., & Bradley, J. (2015). Graduate students' perceptions of online learning. Research in Higher Education Journal, 27.
Fein, A. D., & Logan, M. C. (2010). Preparing instructors for online instruction. Facilitating learning in online environments, 45-55.
Ferguson R., Sharples M. (2014). Innovative pedagogy at massive scale: Teaching and learning in MOOCs [Paper presentation]. In: Rensing C., de Freitas S., Ley T., Muñoz-Merino P.J. (eds). Open Learning and Teaching in Educational Communities. European Conference on Technology Enhanced Learning, Graz, Austria (pp. 98-111). Springer, Cham.
Fini, A. (2009). The technological dimension of a massive open online course: The case of the CCK08 course tools. International Review of Research in Open and Distance Learning, 10(5), 1–26.
Fowler, G. (2013). Most MOOC users well-educated, study finds. The Wall Street Journal. https://www.wsj.com/articles/most-mooc-users-welleducated-study-finds-1384997595
Frank, S. J. (2012). Review: MITx's online circuit and analysis course. Institute of Electrical and Electronics Engineers. http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=6281124
Frick, T., & Dagli, C. (2016). MOOCs for research: The case of the Indiana University plagiarism tutorials and tests. Technology, Knowledge and Learning, 21(2), 255-276.
Gaebel, M. (2014). MOOCs: Massive open online courses. European University Association. https://eua.eu/downloads/publications/moocs%20-%20massive%20open%20online%20courses.pdf
García-Peñalvo, F. J., Fidalgo-Blanco, Á., & Sein-Echaluce, M. L. (2018). An adaptive hybrid MOOC model: Disrupting the MOOC concept in higher education. Telematics and Informatics, 35(4), 1018-1030.
Gasevic, D., Kovanovic, V., Joksimovic, S., & Siemens, G. (2014). Where is research on massive open online courses headed? A data analysis of the MOOC research initiative. The International Review of Research in Open and Distributed Learning, 15(5). https://doi.org/10.19173/irrodl.v15i5.1954
228
Gautreau, C. (2011). Motivational factors affecting the integration of a learning management system by faculty. Journal of Educators Online, 8(1), 1-25.
Gayoung, L. E. E., Sunyoung, K. E. U. M., Myungsun, K. I. M., Yoomi, C. H. O. I., & Ilju, R. H. A. (2016). A study on the development of a MOOC design model. Educational Technology International, 17(1), 1-37.
Glass, C., Shiokawa‐Baklan, M., & Saltarelli, A. (2016). Who takes MOOCs? New Directions for Institutional Research, 2015(167), 41–55. https://doi.org/10.1002/ir.20153
Gómez-Rey, P., Barbera, E., & Fernández-Navarro, F. (2017). Student voices on the roles of instructors in asynchronous learning environments in the 21st Century. International Review of Research in Open and Distributed Learning, 18(2), 234-251.
Gómez-Rey, P., Barbera, E., & Fernández-Navarro, F. (2018). Students' perceptions about online teaching effectiveness: A bottom-up approach for identifying online instructors’ roles. Australasian Journal of Educational Technology, 34(1).
Goold, A., Coldwell, J., & Craig, A. (2010). An examination of the role of the e-tutor. Australasian Journal of Educational Technology, 26(5), 704-716.
Grainger, B. (2013). Massive open online course (MOOC) report 2013. University of London. http://dl.icdst.org/pdfs/files/79569ff0bc29fad63749a955ed7c15d8.pdf
Graneheim, U. H., & Lundman, B. (2004). Qualitative content analysis in nursing research: Concepts, procedures and measures to achieve trustworthiness. Nurse Education Today, 24(2), 105-112.
Green, T., Alejandro, J., & Brown, A. H. (2009). The retention of experienced faculty in online distance education programs: Understanding factors that impact their involvement. The International Review of Research in Open and Distributed Learning, 10(3).
Gregori, E. B., Zhang, J., Galván-Fernández, C., & Fernández-Navarro, F. (2018). Learner support in MOOCs: Identifying variables linked to completion. Computers & Education, 122, 153-168.
Guasch, T., Alvarez, I., & Espasa, A. (2010). University teacher competencies in a virtual teaching/learning environment: Analysis of a teacher training experience. Teaching and Teacher Education, 26(2), 199-206.
Gulatee, Y., & Nilsook, P. (2016). MOOC's barriers and enables. International Journal of Information and Education Technology, 6(10), 826-830.
Gulley, H. E. (1968). Discussion, conference, and group process. Holt, Rinehart and Winston.
Guo, P. J., Kim, J., & Rubin, R. (2014). How video production affects student engagement: An empirical study of MOOC videos [Paper presentation]. First ACM Conference on Learning @ Scale Conference. New York, NY, United States.
229
Guo, S. X., Sun, X., Wang, S. X., Gao, Y., & Feng, J. (2019). Attention-based character-word hybrid neural networks with semantic and structural information for identifying of urgent posts in MOOC discussion forums. IEEE Access. https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=8764349
Haavind, S., & Sistek-Chandler, C. (2015). The emergent role of the MOOC instructor: A qualitative study of trends toward improving future practice. International Journal on E-Learning, 14(3), 331-350.
Han, Y., Ryan, M. P., & Manley, K. (2019). Online course enrolment and tuition: Empirical evidence from public colleges in Georgia, USA. International Journal of Education Economics and Development, 10(1), 1-21.
Hawkins, A. (2011). We’re definitely on our own: Interaction and disconnection in a virtual high school (Publication No. 3450137) [Doctoral dissertation, Brigham Young University]. ProQuest Digital Dissertations.
He, W. (2013). Examining students’ online interaction in a live video streaming environment using data mining and text mining. Computers in Human Behavior, 29(1), 90-102.
Head, K. (2013). Massive open online adventure. Chronicle of Higher Education, 59(34), B24–25.
Herman, J. H. (2013). Faculty incentives for online course design, delivery, and professional development. Innovative Higher Education, 38(5), 397-410.
Hero, J. L. (2019). The impact of technology integration in teaching performance. Online Submission, 48(1), 101-114.
Herold, B. (2016). Technology in education: An overview. Education Week, 20, 129-141.
Hew, K. F., & Cheung, W. S. (2012). Student participation in online discussions: Challenges, solutions, and future research. Springer.
Hew, K. F., & Cheung, W. S. (2014). Students’ and instructors’ use of massive open online courses (MOOCs): Motivations and challenges. Educational Research Review, 12, 45-58.
Heyl, B. (2001). Ethnographic Interview. In P. Atkinson, A. Coffey, S. Delamont, & L. Lofland (Eds.), Handbook of Ethnography (pp. 369-383). London, UK: Sage.
Hill, P. (2012). Four Barriers that MOOCs must overcome to build a sustainable model. Eliterate. http://mfeldstein.com/four-barriers-that-moocs-must-overcome-to-become-sustainable-model/
Hill, P. (2013). Emerging student patterns in MOOCs: A (revised) graphical view. Eliterate. http://mfeldstein.com/emerging-student-patterns-in-moocs-a-revised-graphical-view/
230
Hiltz, S. R., Kim, E., & Shea, P. (2007, January). Faculty motivators and demotivators for teaching online: Results of focus group interviews at one university [Paper presentation]. Annual Hawaii International Conference, Waikoloa, HI, United States.
Ho, A. D., Reich, J., Nesterko, S. O., Seaton, D. T., Mullaney, T., Waldo, J., & Chuang, I. (2014). HarvardX and MITx: The first year of open online courses. Harvard Library. https://dash.harvard.edu/bitstream/handle/1/11987422/1%20HarvardX%20MITx%20Report.pdf?sequence=1
Hoffman, M. S. (2013). An examination of motivating factors on faculty participation in online higher education (Publication No. 3563616) [Doctoral dissertation, Northeastern University]. ProQuest Digital Dissertations.
Hoffmann, R. L., & Dudjak, L. A. (2012). From onsite to online: Lessons learned from faculty pioneers. Journal of Professional Nursing, 28(4), 255-258.
Hokanson, B., & McCluske, M. (2014). Creativity and a massive course: Experience and observations with teaching a MOOC. Educational technology: The Magazine for Managers of Change in Education, 54(5), 22-29.
Hollands, F. M., & Tirthali, D. (2014). Resource requirements and costs of developing and delivering MOOCs. International Review of Research in Open and Distributed Learning, 15(5), 113-133.
Holly, C., Legg, T. J., Mueller, D., & Adelman, D. S. (2008). Online teaching: Challenges for a new faculty role. Journal of Professional Nursing, 24(4), 254-258.
Holotescu, C., Grosseck, G., & Cretu, V. (2013, April). MOOC’s anatomy: Microblogging as the MOOC’s control center [Paper presentation]. International Scientific Conference: Elearning and Software for Education, Bucharest, Romania.
Horn, D. (2013, August 15). Failing fast, not spectacularly. Forbes. http://www.forbes.com/sites/michaelhorn/2013/08/15/fail-fast-not-spectacularly/
Houghton, C., Casey, D., Shaw, D., & Murphy, K. (2013). Rigor in qualitative case-study research. Nurse researcher. 20(4), 12-17.
Hoy, M. B. (2014). MOOCs 101: An introduction to massive open online courses. Medical Reference Services Quarterly, 33(1), 85-91.
Hsieh, P. H. (2010). Globally-perceived experiences of online instructors: A preliminary exploration. Computers & Education, 54(1), 27-36.
Huang, Y., & Hsia, T. (2009). The willingness of faculty in higher education in Taiwan to implement web-based instruction. Journal of Education Research, 2(4), 357-407.
Hull, C. L. (1943). Principles of behavior. Appleton–Century–Crofts.
231
Hunt, D., Davis, K., Richardson, D., Hammock, G., Akins, M., & Russ, L. (2014). It is (more) about the students: Faculty motivations and concerns regarding teaching online. Online Journal of Distance Learning Administration, 17(2).
Hyman, R. T. (1980). Improving discussion leadership. New York, NY: Teachers College Press.
Ilieva, J., Baron, S., & Healey, N. M. (2002). Online surveys in marketing research: Pros and cons. International Journal of Market Research, 44(3), 361-383.
Iniesto, F., McAndrew, P., Minocha, S., & Coughlan, T. (2016). Accessibility of MOOCs: Understanding the provider perspective. Journal of Interactive Media in Education, 2016(1).
Jacobs, A. J. (2013, April 20). Two cheers for Web U. New York Times. https://www.nytimes.com/2013/04/21/opinion/sunday/grading-the-mooc-university.html
Jacoby, J. (2014). The disruptive potential of the massive open online course: A literature review. Journal of Open, Flexible and Distance Learning, 18(1), 73-85.
Jahng, N., Krug, D., & Zhang, Z. (2007). Student achievement in online distance education compared to face-to-face education. European Journal of Open, Distance and E-Learning, 10(1).
Jiang, S., Schenke, K., Eccles, J. S., Xu, D., & Warschauer, M. (2018). Cross-national comparison of gender differences in the enrollment in and completion of science, technology, engineering, and mathematics massive open online courses. Plos One, 13(9).
Johnson, A. E., & Meehan, N. K. (2013). Faculty preparation for teaching online. Distance education in nursing, 17-31.
Johnson, K. R., Hewapathirana, G. I., & Bowen, M. M. (2019, January). Faculty development for online teaching. Handbook of Research on Virtual Training and Mentoring of Online Instructors (pp. 40-55). IGI Global. https://doi.org/10.4018/978-1-5225-6322-8.ch003
Johnson, R., Stewart, C., & Bachman, C. (2015). What drives students to complete online courses? What drives faculty to teach online? Validating a measure of motivation orientation in university students and faculty. Interactive Learning Environments, 23(4), 528-543.
Joksimović, S., Dowell, N., Poquet, O., Kovanović, V., Gašević, D., Dawson, S., & Graesser, A. C. (2018). Exploring development of social capital in a cMOOC through language and discourse. The Internet and Higher Education, 36, 54-64.
Jordan, K. (2013). MOOC completion rates: The data. E-learning and innovative pedagogies. http://www.katyjordan.com/MOOCproject.html
Jordan, K. (2014). Initial trends in enrolment and completion of massive open online courses. The International Review of Research in Open and Distributed Learning, 15(1), 133-160.
232
Joseph, M. R. (2020). Role of MOOCs in modern education. Journal of Applied Science and Research, 8(2), 13-17.
Kampov-Polevoi, J. (2010). Considerations for supporting faculty in transitioning a course to online format. Online Journal of Distance Learning Administration, 13(2).
Kaul, G. (2012). ‘Introduction to finance’, Coursera. Chronicle of Higher Education, 59(6), B8.
Kay, J., Reimann, P., Diebold, E., & Kummerfeld, B. (2013). MOOCs: So many learners, so much potential. IEEE Intelligent Systems, 28(3), 70–77.
Keengwe, J., & Kidd, Terry T. (2010). Towards best practices in online learning and teaching in higher education. Journal of Online Learning and Teaching, 6(2), 533-541.
Kellogg, S., Booth, S., & Oliver, K. (2014). A social network perspective on peer supported learning in MOOCs for educators. The International Review of Research in Open and Distributed Learning, 15(5).
Kenny, J. D. J., & Fluck, A. (2017). Online courses ‘more time-consuming’ to prepare for, study says. The Times Higher Education Supplement. https://www.timeshighereducation.com/news/online-courses-more-time-consuming-prepare-study-says
Khalil, H. & Ebner, M. (2013, June). How satisfied are you with your MOOC [Paper presentation]? Proceedings of EdMedia + Innovative Learning. Victoria, Canada (pp. 830-839). Association for the Advancement of Computing in Education (AACE).
Killion, J. (2016). When teachers learn to use technology, students benefit. The Learning Professional, 37(4), 64.
Kim, J., Guo, P. J., Seaton, D. T., Mitros, P., Gajos, K. Z., & Miller, R. C. (2014, March). Understanding in-video dropouts and interaction peaks in online lecture videos [Paper presentation]. ACM Conference on Learning @ Scale Conference. New York, NY, United States.
Kirschner, A. (2012). A pioneer in online education tries a MOOC. Chronicle of Higher Education, 59(6), B21–22.
Kizilcec, R. F., Piech, C., & Schneider, E. (2013, April). Deconstructing disengagement: analyzing learner subpopulations in massive open online courses [Paper presentation]. International Conference on Learning Analytics and Knowledge, Leuven, Belgium.
Kizilcec, R. F., Schneider, E., Cohen, G. L., & McFarland, D. A. (2014). Encouraging forum participation in online courses with collectivist, individualist and neutral motivational framings [Paper presentation]. European MOOC Stakeholder Summit, Lausanne, Switzerland.
Klawe, M., & Schofield, E. (2014). The evolving MOOC. Educause Rev, 49(2), 8-9.
233
Koller, D. (2012). MOOCs on the Move: How Coursera Is Disrupting the Traditional Classroom [Podcast]. University of Pennsylvania Wharton. https://knowledge.wharton.upenn.edu/article/moocs-on-the-move-how-coursera-is-disrupting-the-traditional-classroom/
Koller, D., & Ng, A. (2013, January). The online revolution: Education for everyone [Powerpoint slides]. http://sites.nationalacademies.org/cs/groups/pgasite/documents/webpage/pga_072888.pdf
Koller, D., Ng, A., Do, C., & Chen, Z. (2013). Retention and intention in massive open online courses: In depth. Educause Review, 48(3), 62-63.
Kolowich, S. (2012). MOOCing on site. Inside Higher Ed. https://www.insidehighered.com/news/2012/09/07/site-based-testing-deals-strengthen-case-granting-credit-mooc-students
Kolowich, S. (2013). The professors who make the MOOCs. Chronicle of Higher Education, 59(28), A20–A23.
Kop, R. (2011). The challenges to connectivist learning on open online networks: Learning experiences during a massive open online course. The International Review of Research in Open and Distributed Learning, 12(3), 19-38.
Kop, R., Fournier, H., & Mak, J. S. F. (2011). A pedagogy of abundance or a pedagogy to support human beings? Participant support on massive open online courses. The International Review of Research in Open and Distributed Learning, 12(7), 74-93.
Koutropoulos, A., Gallagher, M. S., Abajian, S. C., de Waard, I., Hogue, R. J., Keskin, N. Ö., & Rodriguez, C. O. (2012). Emotive vocabulary in MOOCs: Context & participant retention. European Journal of Open, Distance and E-Learning, 15(1).
Krause, S. D. (2013). MOOC response about “Listening to World Music.” College Composition and Communication, 64(4), 689–695.
Lambert, S. R. (2020). Do MOOCs contribute to student equity and social inclusion? A systematic review 2014–18. Computers & Education, 145, 103693.
Lane, L. (2012). Three kinds of MOOCs. http://lisahistory.net/wordpress/2012/08/three-kinds-of-moocs/
Laurillard, D., & Kennedy, E. (2017). The potential of MOOCs for learning at scale in the Global South. Centre for Global Higher Education. https://www.researchcghe.org/perch/resources/publications/wp31.pdf
Lee, D. Y. (2011). Korean and foreign students’ perceptions of the teacher’s role in a multicultural online learning environment in Korea. Educational Technology Research and Development, 59(6), 913-935.
234
Lei, J. (2010). Quantity versus quality: A new approach to examine the relationship between technology use and student outcomes. British Journal of Educational Technology, 41(3), 455-472.
Leininger, M. (1994). Evaluation criteria and critique of qualitative research studies. In J. Morse (Ed), Critical Issues in Qualitative Research Methods. Sage Publications, Thousand Oaks CA.
Len-Urritia, M., Cobos, R., & Dickens, K. (2018). MOOCs and their influence on higher education institutions: Perspectives from the insiders. Journal of New Approaches in Educational Research, 7(1), 40-45.
León-Urritia, M., Cobos, R., & Dickens, K. (2018). MOOCs and their influence on higher education institutions: Perspectives from the insiders. New Approaches in Educational Research, 7(1), 40-45. https://doi.org/10.7821/naer.2018.1.252.
Lesht, F., & Windes, D. L. (2011). Administrators' views on factors influencing full-time faculty members' participation in online education. Online Journal of Distance Learning Administration, 14(5).
Levine, A. (2013). DS106: Not a course, not like any MOOC. Educause Review, 48(1), 54-55.
Lewin, T. (2012, March 4). Instruction for masses knocks down campus walls. The New York Times. https://www.nytimes.com/2012/03/05/education/moocs-large-courses-open-to-all-topple-campus-walls.html?_r=3&pagewanted=1
Lewin, T. (2013, February 20). Universities abroad join partnerships on the web. The New York Times. https://www.nytimes.com/2013/02/21/education/universities-abroad-join-mooc-course-projects.html
Li, C. S., & Irby, B. (2008). An overview of online education: Attractiveness, benefits, challenges, concerns and recommendations. College Student Journal, 42(2), 449.
Li, K. C., & Wong, B. T. M. (2019). The professional development needs for the use of educational technology. Interactive Technology and Smart Education, 16(2), 159-171. https://doi.org/10.1108/ITSE-10-2018-0089
Li, Y. (2019, May). MOOCs in higher education: Opportunities and challenges. 2019 5th International Conference on Humanities and Social Science Research (ICHSSR 2019). Guilin, China (pp. 48-55). Atlantis Press.
Lichoro, D. M. (2015). Faculty preparedness for transition to teaching online courses in the Iowa Community College Online Consortium. (Publication No. 3712611) [Doctoral dissertation, Iowa State University]. ProQuest Dissertations Publishing.
Lim, K., & Lee, D. Y. (2008). A comprehensive approach to the teacher's role in computer supported learning environments. Technology and Teacher Education Annual, 19(7), 4208.
235
Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. Sage Publications, Thousand Oaks CA.
Lineweaver, C. H. (2019, February). Making a Massive Open Online Course (MOOC) about astrobiology: Why? for whom? how? The International Symposium on Education in Astronomy and Astrobiology (ISE2A 2017). EDP Sciences.
Littlejohn, A. (2013). Understanding massive open online courses. CEMCA EdTech Notes, 1-12.
Liyanagunawardena, T. R., Adams, A. A., & Williams, S. A. (2013). MOOCs: A systematic study of the published literature 2008-2012. The International Review of Research in Open and Distributed Learning, 14(3), 202-227.
Liyanagunawardena, T. R., Lundqvist, K., Mitchell, R., Warburton, S., & Williams, S. A. (2019). A MOOC taxonomy based on classification schemes of MOOCs. European Journal of Open, Distance and E-learning, 22(1), 85-103.
Liyanagunawardena, T. R., Parslow, P., & Williams, S. (2014, February). Dropout: MOOC participants’ perspective [Paper presented]. MOOC European Stakeholders Summit, Lausanne, Switzerland. http://centaur.reading.ac.uk/36002/2/MOOC%20Dropout%20Participants%20Perspective.pp95-100.pdf
Lowenthal, P., Snelson, C., & Perkins, R. (2018). Teaching massive, open, online, courses (MOOCs): Tales from the front line. International Review of Research in Open and Distributed Learning, 19(3).
Lowenthal, P., Snelson, C., & Perkins, R. (2018). Teaching massive, open, online, courses (moocs): Tales from the front line. International Review of Research in Open and Distributed Learning, 19(3).
Lowery, B., & Spector, N. (2014). Regulatory implications and recommendations for distance education in prelicensure nursing programs. Journal of Nursing Regulation, 5(3), 24-33.
Luik, P., Feklistova, L., Lepp, M., Tõnisson, E., Suviste, R., Gaiduk, M., & Palts, T. (2019). Participants and completers in programming MOOCs. Education and Information Technologies, 24(6), 3689-3706.
Mackness, J., S. F. J. Mak, and J. Williams. (2010). The ideals and reality of participating in a MOOC [Paper presentation]. International Conference on Networked Learning, University of Lancaster, United Kingdom.
Macleod, H., Haywood, J., Woodgate, A., & Alkhatnai, M. (2015). Emerging patterns in MOOCs: Learners, course designs and directions. TechTrends, 59(1), 56.
Maguire, L. L. (2005). Literature review-faculty participation in online distance education: Barriers and motivators. Online Journal of Distance Learning Administration, 8(1), 1-16.
236
Major, C. H. (2010). Do virtual professors dream of electric students? University faculty experiences with online distance education. Teachers College Record, 112(8), 2154-2208.
Malan, D.J. (2013). Implementing a massive open online course (MOOC), tutorial presentation, Journal of Computing Sciences in Colleges, 28(6), 136-137.
Mallon, M. (2013). MOOCs. Public Services Quarterly, 9(1), 46-53.
Mamun, S. A. K., Danaher, P. A., & Rahman, M. M. (2015). University teachers’ interactions with their online students at an Australian university. Handbook of Research on Advancing Critical Thinking in Higher Education, 142-169.
Mandernach, B. J., Mason, T., Forrest, K. D., & Hackathorn, J. (2012). Faculty views on the appropriateness of teaching undergraduate psychology courses online. Teaching of Psychology, 39(3), 203-208.
Marasi, S., Jones, B., & Parker, J. M. (2020). Faculty satisfaction with online teaching: A comprehensive study with American faculty. Studies in Higher Education, 1-13.
Marginson, S. (2012). Online open education: Yes, this is the game changer. The Conversation, 16, 23-25.
Marshall, S. (2013). Evaluating the strategic and leadership challenges of MOOCs. Journal of Online Learning and Teaching, 9(2), 216–227.
Martin, F. G. (2012). Will massive open online courses change how we teach? Communications of the ACM, 55(8), 26–28
Martin, F., Budhrani, K., Kumar, S., & Ritzhaupt, A. (2019). Award-winning faculty online teaching practices: Roles and competencies. Online Learning, 23(1), 184-205.
Martin, F., Wang, C., & Sadaf, A. (2018). Student perception of helpfulness of facilitation strategies that enhance instructor presence, connectedness, engagement and learning in online courses. The Internet and Higher Education, 37, 52-65.
Mason, R. (1991). Moderating educational computer conferencing. Deosnews, 1(19), 1-16.
Matthews, J. N. (2013). Internet startups look to reinvent higher education. Physics Today, 66(3), 26-28.
Maya-Jariego, I., Holgado, D., González-Tinoco, E., Castaño-Muñoz, J., & Punie, Y. (2020). Typology of motivation and learning intentions of users in MOOCs: The MOOC knowledge study. Educational Technology Research and Development, 68(1), 203-224.
Mayadas, A. F., Bourne, J., & Bacsich, P. (2009). Online education today. Science, 323(5910), 85-89.
237
Mazzolini, M., & Maddison, S. (2007). When to jump in: The role of the instructor in online discussion forums. Computers & Education, 49(2), 193-213.
McAuley, A., Stewart, B., Siemens, G., & Cormier, D. (2010). The MOOC model for digital practice. https://www.oerknowledgecloud.org/archive/MOOC_Final.pdf
McMillan, J. H., & Schumacher, S. (2000). Research in education: A conceptual introduction. Allyn & Bacon.
McQuiggan, C. A. (2007). The role of faculty development in online teaching’s potential to question teaching beliefs and assumptions. Online Journal of Distance Administration, 5(3).
Means, B., Bakia, M., & Murphy, R. (2014). Learning online: What research tells us about whether, when and how. Routledge.
Meneses, E. L., Cano, E. V., & Mac Fadden, I. (2020). MOOC in Higher Education from the Students’ Perspective. A Sustainable Model? In Sarasola Sánchez-Serrano J., Maturo F., Hošková-Mayerová Š. Qualitative and Quantitative Models in Socio-Economic Systems and Social Work (pp. 207-223).Springer. https://doi.org/10.1007/978-3-030-18593-0_17
Miller, M. T., & Husmann, D. E. (1999). Faculty incentives to participate in distance education. The Michigan Community College Journal, 35-42.
Moorhouse, B. L. (2020). Adaptations to a face-to-face initial teacher education course ‘forced’ online due to the COVID-19 pandemic. Journal of Education for Teaching, 1-3.
Morris, L. V. (2013). MOOCs, emerging technologies, and quality. Innovative Higher Education, 38(4), 251-252.
Morse, J. M. (1991). Approaches to qualitative-quantitative methodological triangulation. Nursing research, 40(2), 120-123.
Motzo, A., & Proudfoot, A. (2017). MOOCs for language learning–opportunities and challenges: The case of the open university Italian beginners’ MOOCs. In K. Qian & S. Bax (Eds.), Beyond the language classroom: researching MOOCs and other innovations (pp. 85-98). Research-publishing.net. https://doi.org/10.14705/rpnet.2017.mooc2016.673
Muthukumar, V., & Bhalaji, N. (2020). Moocversity - deep learning based dropout prediction in MOOCs over weeks. Journal of Soft Computing Paradigm, 2(03), 140-152.
Najafi, H., Rolheiser, C., Harrison, L., & Håklev, S. (2015). University of Toronto instructors’ experiences with developing MOOCs. The International Review of Research in Open and Distributed Learning, 16(3).
238
Newton, D. (2015). The (accidental) power of MOOCs. The Atlantic. https://www.theatlantic.com/education/archive/2015/06/the-secret-power-of-moocs/396608/
Nickerson, R. S. (2020). Technology in education in 2020: Thinking about the not-distant future. Technology in Education: Looking Toward, 1-9.
Niess, M. L. (2011). Investigating TPACK: Knowledge growth in teaching with technology. Journal of Educational Computing Research, 44(3), 299-317.
North, S. M., Richardson, R., & North, M. M. (2014). To adapt MOOCs, or not? That is no longer the question. Universal Journal of Educational Research, 2(1), 69-72.
O'Toole, R. (2013). Pedagogical strategies and technologies for peer assessment in Massively Open Online Courses (MOOCs). The University of Warwick. http://wrap.warwick.ac.uk/54602/7/WRAP_O'toole_ROToole%20Peer%20Assessment%20in%20MOOCs%20(1).pdf
O’Neil, T. (2006, June). How distance education has changed teaching and the role of the instructor [Paper presentation]. E-Leader Conference, Bratislava, Slovakia.
Onwuegbuzie, A. J., & Johnson, R. B. (2006). The validity issue in mixed research. Research in the Schools, 13(1), 48-63.
Orr, R., Williams, M., & Pennington, K. (2009). Institutional efforts to support faculty in online teaching. Innovative Higher Education, 34(4), 257-268.
Ortagus, J. C., & Stedrak, L. J. (2013). Online education and contingent faculty: An exploratory analysis of issues and challenges for higher education administrators. Educational Considerations, 40(3), 30-33.
Osika, E. R., Johnson, R. Y., & Buteau, R. (2009). Factors influencing faculty use of technology in online instruction: A case study. Online Journal of Distance Learning Administration, 12(1).
Outlaw, V., Rice, M. L., & Wright, V. H. (2017). Exploration of faculty's perceptions on technology change: Implications for faculty preparedness to teach online courses. Technology Adoption and Social Issues: Concepts, Methodologies, Tools, and Applications (pp. 175-190). IGI Global. https://doi.org/10.4018/978-1-5225-5201-7.ch010
Oyarzun, B., Martin, F., & Moore, R. L. (2020). Time management matters: Online faculty perceptions of helpfulness of time management strategies. Distance Education, 41(1), 106-127.
Panda, S., & Mishra, S. (2007). E‐learning in a mega open university: Faculty attitude, barriers and motivators. Educational Media International, 44(4), 323-338.
239
Park, Y., Jung, I., & Reeves, T. C. (2015). Learning from MOOCs: A qualitative case study from the learners’ perspectives. Educational Media International, 52(2), 72-87.
Parker, A. (2003). Motivation and incentives for distance faculty. Online Journal of Distance Learning Administration, 6(3).
Parker, M. L. (2014). Role and constructivist competencies of an online instructor: Elements of an online learning course (Publication No. 9900013) [Doctoral dissertation, Wayne State University]. ProQuest Digital Dissertations.
Parry, M. (2012). EdX offers proctored exams for open online course. The Chronicle of Higher Education. http://chronicle.com/blogs/wiredcampus/edx-offers-proctored-exams-for-open-online-course/39656
Perna, L. W., Ruby, A., Boruch, R. F., Wang, N., Scull, J., Ahmad, S., & Evans, C. (2014). Moving through MOOCs: Understanding the progression of users in massive open online courses. Educational Researcher, 43(9), 421–432.
Pickering, J. D., Henningsohn, L., DeRuiter, M. C., de Jong, P. G., & Reinders, M. E. (2017). Twelve tips for developing and delivering a massive open online course in medical education. Medical Teacher, 39(7), 691-696.
Pinkerton, S. L. (2008). Motivating factors related to faculty participation in online education as reported by community college faculty (Publication No. 3310446) [Doctoral dissertation, New Mexico State University]. ProQuest Digital Dissertations.
Porter, W. W., & Graham, C. R. (2016). Institutional drivers and barriers to faculty adoption of blended learning in higher education. British Journal of Educational Technology, 47(4), 748-762.
Pulist, S. K. (2020). Open educational resources (including MOOCs). Quality Education, 591-599.
Radenkovic, S., Krzavac, N. & Devedzic, V. (2010). An assessment system on the semantic web. In V. Devedzic, & D. Gasevic (Eds.), Web 2.0 and Semantic Web, annals of information systems. Springer. https://doi.org/0.1007/978-1-4419-1219-0_8
Radford, A. W., Robles, J., Cataylo, S., Horn, L., Thornton, J., & Whitfield, K. E. (2014). The employer potential of MOOCs: A mixed-methods study of human resource professionals’ thinking on MOOCs. International Review of Research in Open and Distributed Learning, 15(5), 1–25.
Regan, K., Evmenova, A. S., Sacco, D., Schwartzer, J., Chirinos, D. S., & Hughes, M. D. (2019). Teacher perceptions of integrating technology in writing. Technology, Pedagogy and Education, 28(1), 1-19.
240
Regan, K., Evmenova, A., Baker, P., Marci, K. J., Spencer, V., Lawson, H., & Werner, T. (2012). Experiences of instructors in online learning environments: Identifying and regulating emotions. The Internet and Higher Education, 15, 204-212.
Reich, J. (2014). MOOC completion and retention in the context of student intent. EDUCAUSE Review Online. https://www.educause.edu/ero/article/mooc-completion-and-retention-context-student-intent
Rice, J. (2013). What I learned in MOOC. College Composition and Communication, 64(4), 695–703.
Richter, S. L., & Krishnamurthi, M. (2014). Preparing faculty for teaching a MOOC: Recommendations from research and experience. International Journal of Information and Education Technology, 4(5), 411.
Rivard, R. (2013). Udacity project on ‘pause’. Inside Higher Ed. https://www.insidehighered.com/news/2013/07/18/citing-disappointing-student-outcomes-san-jose-state-pauses-work-udacity
Roberts, G., Waite, M., Lovegrove, E., & Mackness, J. (2013, March). Xvc: Hybrid learning in, through and about MOOCs [Paper presentation]. OER’13: Creating a Virtuous Circle, University of Nottingham.
Rodriguez, C. O. (2012). MOOCs and the AI-Stanford like courses: Two successful and distinct course formats for massive open online courses. European Journal of Open, Distance and E-Learning, 1-13.
Rolfe, G. (2006). Validity, trustworthiness and rigor: Quality and the idea of qualitative research. Journal of Advanced Nursing. 3(3), 304-310.
Roscorla, T. (2012). Massively open online courses are ‘here to stay.’ Center for Digital Education. http://www.centerdigitaled.com/policy/MOOCs-Here-to-Stay.html
Ross, J., Sinclair, C., Knox, J., & Macleod, H. (2014). Teacher experiences and academic identity: The missing components of MOOC pedagogy. Journal of Online Learning and Teaching, 10(1), 57-69.
Roth, M. S. (2013). My modern experience teaching a MOOC. Chronicle of Higher Education, 59(34), B18–21.
Ryan, R. M., & Connell, J. P. (1989). Perceived locus of causality and internalization: Examining reasons for acting in two domains. Journal of Personality and Social Psychology, 57, 749–761.
Ryan, R. M., & Deci, E. L. (2000). Intrinsic and extrinsic motivation: Classic definitions and new directions. Contemporary Educational Psychology, 25(1), 54-67.
241
Ryan, R. M., & Deci, E. L. (2017). Self-determination theory: Basic psychological needs in motivation, development, and wellness. The Guilford Press.
Ryan, R.M. (1995), Psychological needs and the facilitation of intrinsic motivation, social development and well-being. American Psychologist, 63, 397-427.
Saadatdoost, R., Jafarkarimi, H., Sim, A. T. H., & Hee, J. M. (2019). Understanding MOOC learners: Insights from participation in Coursera MOOC. International Journal of Web-Based Learning and Teaching Technologies, 14(1), 93-112.
Sahami, M., Guzdial, M., Martin, F. G., & Parlante, N. (2013, March). The revolution will be televised: Perspectives on massive open online education [Paper presentation]. ACM Technical Symposium on Computer Science Education, Denver, Colorado.
Salimi, A. Y. (2007). The promise and challenges for distance education in accounting. Strategic Finance, 88(7), 19.
Sandeen, C. (2013). Assessment's place in the new MOOC world. Research & Practice in Assessment, 8(2), 5-12.
Sangrà, A., González-Sanmamed, M., & Anderson, T. (2015). Meta-analysis of the research about MOOC during 2013-2014. Educación XX1, 18(2).
Sargsyan, R. G., & Torrijos, M. B. (2017). Massive online courses (MOOCs) and their role in the digitalized era. International Journal of Science and Engineering, 3(5), 44-53.
Sari, A. R., Bonk, C. J., & Zhu, M. (2020). MOOC instructor designs and challenges: What can be learned from existing MOOCs in Indonesia and Malaysia? Asia Pacific Education Review, 1-24.
Schiffman, S., Vignare, K., & Geith, B. (2007). Why do higher-education institutions pursue online education? Journal of Asynchronous Learning Networks, 11(2), 61-71.
Schifter, C. C. (2004). Compensation models in distance education: National survey questionnaire revisited. Online Journal of Distance Learning Administration, 7(1), 1-14.
Schmidt, S. W., Tschida, C. M., & Hodge, E. M. (2016). How faculty learn to teach online: What administrators need to know. Online Journal of Distance Learning Administration, 19(1), 1-10.
Schopieray, S. E. (2006). Understanding faculty motivation to teach online courses (Publication No. 3236419) [Doctoral dissertation, Michigan State University]. ProQuest Digital Dissertations.
Schroeder, L. (2008). Factors influencing adjunct faculty participation in online instruction at a midwestern university (Publication No. 3311258) [Doctoral dissertation, Capella University]. ProQuest Digital Dissertations.
242
Schulz, R., Isabwe, G. M., & Reichert, F. (2015, September). Investigating teachers’ motivation to use ICT tools in higher education [Paper presentation]. International Conference on Internet Technologies and Applications, Wrexham, UK.
Seaman, J. (2009). Online learning as a strategic asset. Volume II: The Paradox of Faculty Voices: Views and experiences with online learning. ERIC Database. https://files.eric.ed.gov/fulltext/ED517311.pdf
Seaman, J. E., Allen, I. E., & Seaman, J. (2018). Grade increase: Tracking distance education in the United States. Babson Survey Research Group.
Seaton, D. T., Bergner, Y., Chuang, I., Mitros, P., & Pritchard, D. E. (2014). Who does what in a massive open online course? Communications of the ACM, 57(4), 58-65.
Selwyn, N. (2020). Telling tales on technology: Qualitative studies of technology and education. Routledge.
Sfard, A. (1998, March). On two metaphors for learning and the dangers of choosing just one. Educational Researcher, 27(2), 4–13.
Shah, D. (2019, January 2). Year of MOOC-based degrees: A review of MOOC stats and trends in 2018. EdSurge. https://www.edsurge.com/news/2019-01-02-year-of-mooc-based-degrees-a-review-of-mooc-stats-and-trends-in-2018
Shah, S. K., & Corley, K.G. (2006). Building better theory by bridging the quantitative-qualitative divide. Journal of Management Studies. 43(8), 1822-1835.
Sharma, L., & Srivastava, M. (2019). Teachers’ motivation to adopt technology in higher education. Journal of Applied Research in Higher Education. https://doi.org/10.1108/JARHE-07-2018-0156
Shaver, D. (2017). The added value of conducting learning design meeting to the online course development process. TechTrends, 61(5), 438-443.
Shea, P. (2007). Bridges and barriers to teaching online college courses: A study of experienced online faculty in thirty-six colleges. Journal of Asynchronous Learning Networks, 11(2), 73-128.
Sheail, P. (2018). Temporal flexibility in the digital university: Full-time, part-time, flexi time. Distance Education, 39(4), 462-479.
Shermis, M. D., & Hamner, B. (2012, April). Contrasting state-of-the-art automated scoring of essays: Analysis [Paper presentation]. National Council on Measurement in Education Meeting, British Columbia, Canada.
Siemens, G. (2008). Learning and knowing in networks: Changing roles for educators and designers [Paper presentation]. University of Georgia IT Forum, Athens, GA.
243
Siemens, G. (2012). Massive open online courses as new educative practice. Blog Elearnspace. http://www.elearnspace.org/blog/2012/02/29/massive-open-online-courses-as-new-educative-practice.
Siemens, G. (2012). MOOCs are really a platform. Blog Elearnspace. http://www.elearnspace.org/blog/2012/07/25/moocs-are-really-a-platform
Siemens, G. (2013). Massive open online courses: Innovation in education. Open Educational Resources: Innovation, Research and Practice, 5, 5-15.
Skinner, B. F. (1953). Science and human behavior. New York: Macmillan.
Song, M. (2019). Learning online for teaching online: A formative program evaluation of a hybrid faculty training program (Publication No. 13901617) [Doctoral dissertation, University of Pittsburgh]. ProQuest Digital Dissertations.
Sonwalkar, J., & Maheshkar, C. (2015). MOOCS: A massive platform for collaborative learning in globalized way. Journal of Management Research and Analysis, 2(2), 142-149.
Stephens-Martinez, K., Hearst, M. A., & Fox, A. (2014). Monitoring MOOCs: Which information sources do instructors value [Paper presentation]? ACM Conference on Learning@ Scale Conference, New York, NY, United States.
Stevenson, K. N. (2007). Motivating and inhibiting factors affecting faculty participation in online distance education (Publication No. 3285215) [Doctoral dissertation, East Carolina University]. ProQuest Digital Dissertations.
Styron, J. L., Wang, S., & Styron Jr., R. A. (2009). Considerations of distance education integration: A qualitative study. Journal of Educational Technology Development & Exchange, 2(1), 79-97.
Subhi, Y., Andresen, K., Bojsen, S. R., Nilsson, P. M., & Konge, L. (2014). Massive open online courses are relevant for postgraduate medical training. Danish Medical Journal, 61(10), 1-5.
Sun, Y., Guo, Y., & Zhao, Y. (2020). Understanding the determinants of learner engagement in MOOCs: An adaptive structuration perspective. Computers & Education, 157, 1-11. https://doi.org/10.1016/j.compedu.2020.103963
Tang, H., Wang, S., Qian, Y., & Peck, K. L. (2016). Student’ perceptions of the online instructors’ roles in a Massive Open Online Course. In S. D’Agustino (Ed). Creating Teacher Immediacy in Online Learning Environments (pp. 273-289). IGI Global. https://doi.org/10.4018/978-1-4666-9995-3.ch014
Tao, Y. H. & Yeh, C. C. (2008). Typology of teacher perception toward distance education issues - a study of college information department teachers in Taiwan. Computers and Education, 50(1), 23-36.
244
Tashakkori, A. (2007). Handbook of mixed methods in social & behavioral research. Thousand Oaks, California: Sage Publications.
Tashakkori, A., & Teddlie, C. (1998). Mixed methodology: Combining qualitative and quantitative approaches. Thousand Oaks, CA: Sage.
Tatli, Z., Akbulut, H. İ., & Altinisik, D. (2019). Changing attitudes towards educational technology usage in classroom: Web 2.0 Tools. Malaysian Online Journal of Educational Technology, 7(2), 1-19.
Taylor, J. A. (2000). Adult degree completion programs: A report to the board of trustees from the task force on adult degree completion programs and the award of credit for prior learning at the baccalaureate level. North Central Association of Colleges and Schools, Chicago, IL. Commission on Institutions of Higher Education.
Teddlie, C., & Yu, F. (2007). Mixed methods sampling: A typology with examples. Journal of Mixed Methods Research, 1(1), 77-100.
Thomas, J., & Harden, A. (2008). Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Medical Research Methodology, 8(1), 45.
Tobin, G. A., Begley, C. M. (2004) Methodological rigor within a qualitative framework. Journal of Advanced Nursing. 48(4), 388-396.
Tomkins, S., & Getoor, L. (2019). Understanding hybrid-MOOC effectiveness with a collective socio-behavioral model. Journal of Educational Data Mining, 11(3), 42-77.
Touati, A. (2016). Self-directed learning in MOOCS: A disconnect between theory and practice. Education, 16.
Tschofen, C., & Mackness, J. (2012). Connectivism and dimensions of individual experience. The International Review of Research in Open and Distributed Learning, 13(1), 124-143.
Tucker, J., Au, A., & Neely, P. (2015). A Comparison of Traditional vs. Competency-based Education Faculty Roles [Paper presentation]. Society for Information Technology & Teacher Education International Conference, Las Vegas, NV, United States.
Ulmer, L. W., Watson, L. W., & Derby, D. (2007). Perceptions of higher education faculty members on the value of distance education. The Quarterly Review of Distance Education, 8(1), 59-70.
University of Edinburgh MOOC teams. (2013). MOOCs @ Edinburgh 2013-Report #1. https://www.era.lib.ed.ac.uk/bitstream/handle/1842/6683/Edinburgh_MOOCs_Report2013_no1.pdf?sequence=1&isAllowed=y
Vail, R. (2013). Who is afraid of a big bad MOOC? Colorado Mesa University. http://cmubiznews.org/uploads/facultyinsights/Vail_Who_is_afraid_of_a_MOOC_Febru ary_2013.pdf
245
Vang, K., Martin, F., & Wang, C. (2020). Examining community college faculty perceptions of their preparedness to teach online. Journal of Applied Research in the Community College, 27(1), 45-63.
Veletsianos, G., & Houlden, S. (2019). An analysis of flexible learning and flexibility over the last 40 years of distance education. Distance Education, 40(4), 454-468.
Veletsianos, G., & Shepherdson, P. (2015). Who studies MOOCs? Interdisciplinarity in MOOC research and its changes over time. International Review of Research in Open and Distributed Learning, 16(3), 1–17.
Veletsianos, G., & Shepherdson, P. (2016). A systematic analysis and synthesis of the empirical MOOC literature published in 2013–2015. The International Review of Research in Open and Distributed Learning, 17(2).
Waite, M., Mackness, J., Roberts, G., & Lovegrove, E. (2013). Liminal participants and skilled orienteers: Learner participation in a MOOC for new lecturers. Journal of Online Learning and Teaching, 9(2), 200.
Wakefield, A., Cartney, P., Christie, J., Smyth, R., Cooke, A., Jones, T., ... & Kennedy, J. (2018). Do MOOCs encourage corporate social responsibility or are they simply a marketing opportunity? Nurse education in practice, 33, 37-41.
Walker, J., & Brooks, C. (2014). Better Understanding through Data: Completion, Motivation, and Learning in Minnesota MOOCs. SEI Case Study. https://net.educause.edu/ir/library/pdf/SEI1402. pdf
Walker, L. & Loch, B. (2014). Academics’ perceptions on the quality of MOOCs: An empirical study. The International Journal for Innovation and Quality in Learning, 2(3), 53-64.
Walters, S., Grover, K. S., Turner, R. C., & Alexander, J. C. (2017). Faculty perceptions related to teaching online: A starting point for designing faculty development initiatives. Turkish Online Journal of Distance Education, 18(4), 4-19.
Wang, H., Gould, L. V., & King, D. (2009). Positioning faculty support as a strategy in assuring quality online education. Journal of Online Education, 5(6), 5.
Wang, Y., & Baker, R. (2018). Grit and intention: Why do learners complete MOOCs? The International Review of Research in Open and Distributed Learning, 19(3). https://doi.org/10.19173/irrodl.v19i3.3393
Wang, Y., Fang, H., Jin, Q., & Ma, J. (2019). SSPA: An effective semi-supervised peer assessment method for large scale MOOCs. Interactive Learning Environments, 1-19.
Wang, Y., Paquette, L., & Baker, R. (2014). A longitudinal study on learner career advancement in MOOCs. Journal of Learning Analytics, 1(3), 203-206.
246
Wang, Z., Anderson, T., & Chen, L. (2018). How learners participate in connectivist learning: An analysis of the interaction traces from a cMOOC. International Review of Research in Open and Distributed Learning, 19(1).
Ward, M. E., Peters, G., & Shelley, K. (2010). Student and faculty perceptions of the quality of online learning experiences. International Review of Research in Open & Distance Learning, 11(3), 57-77.
Watson, A. M. (2014). Perceptions of academic and social integration of first-generation college students at a less-selective private faith-based university (Publication No. 3624004) [Doctoral dissertation, Clemson University]. ProQuest Digital Dissertations.
Watson, S. L., Loizzo, J., Watson, W. R., Mueller, C., Lim, J., & Ertmer, P. A. (2016). Instructional design, facilitation, and perceived learning outcomes: An exploratory case study of a human trafficking MOOC for attitudinal change. Educational Technology Research and Development, 64(6), 1273-1300.
Weinhardt, J. M., & Sitzmann, T. (2019). Revolutionizing training and education? Three questions regarding massive open online courses (MOOCs). Human Resource Management Review, 29(2), 218-225.
Weller, M. (2011). The digital scholar: How technology is transforming scholarly practice. Bloomsbury Academic.
Weller, M., Siemens, G., & Cormier, D. (2012, October 15). MOOCS: An interview with Dave Cormier and George Siemens [Video]. Streaming Service. https://youtu.be/l1G4SUblnbo
West, R. E., Waddoups, G., & Graham, C. R. (2007). Understanding the experiences of instructors as they adopt a course management system. Educational Technology Research and Development, 55(1), 1-26.
Weston, C. (2012, December 29). MOOCs and other ed-tech bubbles. Tech Now. http://edtechnow.net/2012/12/29/moocs-and-other-ed-tech-bubbles
White, S., Davis, H., Dickens, K., León, M., & Sánchez-Vera, M. M. (2014). MOOCs: what motivates the producers and participants [Paper presentation]? International Conference on Computer Supported Education, Barcelona, Spain.
Wickersham, L. E., & McElhany, J. A. (2010). Bridging the divide: Reconciling administrator and faculty concerns regarding online education. The Quarterly Review of Distance Education, 11(1), 1-12.
Wildavsky, B. (2014). Evolving toward significance or MOOC ado about nothing? International Educator, 23(3), 74.
Wilkinson, L. R. (2008). ESL academic writing and plagiarism. The Internet TESL Journal, 14(7).
247
Wilkowski, J., Deutsch, A., & Russell, D. M. (2014, March). Student skill and goal achievement in the mapping with google MOOC [Paper presentation]. ACM Conference on Learning@ Scale Conference, New York, NY, United States.
Williams, R., Karousou, R., & Mackness, J. (2011). Emergent learning and learning ecologies in Web 2.0. International Review of Research in Open and Distance Learning, 12(3), 39-59.
Wilson, B., Orr, J., Hansen, D., Khoja, S., Bryant, R., & Iyer, G. (2013). MOOCs and their impact on CS education. Journal of Computing Sciences in Colleges, 29(1), 110–112.
Windes, D. L., & Lesht, F. L. (2014). The effects of online teaching experience and institution type on faculty perceptions of teaching online. Online Journal of Distance Learning Administration, 17(1).
Winerip, M. (2012). Facing a robot-grader? Just keep obfuscating mellifluously. New York Times, 22.
Wright, J. M. (2014). Planning to meet the expanding volume of online learners: An examination of faculty motivation to teach online. Educational Planning, 21(4), 35-49.
Wu, B., & Chen, X. (2017). Continuance intention to use MOOCs: Integrating the technology acceptance model (TAM) and task technology fit (TTF) model. Computers in Human Behavior, 67, 221-232.
Xiao, C., Qiu, H., & Cheng, S. M. (2019). Challenges and opportunities for effective assessments within a quality assurance framework for MOOCs. Journal of Hospitality, Leisure, Sport & Tourism Education, 24, 1-16.
Yang, D., Piergallini, M., Howley, I., & Rose, C. (2014, July). Forum thread recommendation for massive open online courses [Paper presentation]. International Conference on Educational Data Mining. London, UK.
Yang, D., Sinha, T., Adamson, D., & Rosé, C. P. (2013, December). Turn on, tune in, drop out: Anticipating student dropouts in massive open online courses [Paper presentation]. 2013 NIPS Data-driven education workshop, Lake Tahoe, Nevada.
Youn, S. J. (2013). Validating task-based assessment of L2 pragmatics in interaction using mixed methods (Publication No. 3577270) [Doctoral dissertation, University of Hawai‘i at Manoa]. ProQuest Digital Dissertations.
Young, C., demarco, C., Nyysti, K., Harpool, A., & Mendez, T. (2019). The role of faculty development in online universities. In K. Walters & P. Henry (Eds). Fostering Multiple Levels of Engagement in Higher Education Environments (pp. 260-275). IGI Global. https://doi.org/10.4018/978-1-5225-7470-5.ch012
Young, J. (2012). Dozens of plagiarism incidents are reported in Coursera’s free online courses. The Chronicle of Higher Education, 16.
248
Young, J. R. (2012). Inside the Coursera contract: How an upstart company might profit from free courses. The Chronicle of Higher Education, 19(07), 2012.
Young, J. R. (2013). What professors can learn from ‘hard core’ MOOC students. Chronicle of Higher Education, 59(37), A4.
Yuan, L., Powell, S. (2013, March). MOOCs and open education: Implications for higher education. CETIS White Paper. https://e-space.mmu.ac.uk/619735/1/MOOCs-and-Open-Education.pdf
Yun, G. W., & Trumbo, C. W. (2000). Comparative response to a survey executed by post, e‐mail, & web form. Journal of Computer‐Mediated Communication, 6(1).
Zakharov, W., & Maybee, C. (2019). Bridging the gap: Information literacy and learning in online undergraduate courses. Journal of Library & Information Services in Distance Learning, 13(1-2), 215-225.
Zhang, K., Bonk, C. J., Reeves, T. C., & Reynolds, T. H. (Eds.). (2019). MOOCs and open education in the Global South: Challenges, successes, and opportunities. Routledge.
Zhang, Y. (2013, June). Benefiting from MOOC [Paper presentation]. EdMedia: World Conference on Educational Media and Technology, Victoria, Canada.
Zheng, S., Rosson, M. B., Shih, P. C., & Carroll, J. M. (2015, February). Understanding student motivation, behaviors and perceptions in MOOCs [Paper presented]. ACM Conference on Computer Supported Cooperative Work & Social Computing, Vancouver, Canada.
Zheng, S., Wisniewski, P., Rosson, M. B., & Carroll, J. M. (2016, February). Ask the instructors: Motivations and challenges of teaching massive open online courses. CSCW’16 Companion: Computer-supported cooperative work and social computing. 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, San Francisco, California, United States (pp. 206-221). Association for Computing Machinery (ACM).
Zhu, C., Valcke, M., & Schellens, T. (2010). A cross‐cultural study of teacher perspectives on teacher roles and adoption of online collaborative learning in higher education. European Journal of Teacher Education, 33(2), 147-165.
Zhu, M., Bonk, C., & Sari, A. (2019). Massive open online course instructor motivations, innovations, and designs: Surveys, interviews, and course reviews. Canadian Journal of Learning and Technology, 45(1).
Zhu, M., Bonk, C.J., & Sari, A.R. (2018). Instructor experiences designing MOOCs in higher education: Pedagogical, resource, and logistical considerations and challenges. Online Learning, 22(4), 203-241. https://doi:10.24059/olj.v22i4.1495
249
Zimmerman, T. D. (2012). Exploring learner to content interaction as a success factor in online courses. The International Review of Research in Open and Distributed Learning, 13(4), 152-165.
Zutshi, S., O'Hare, S., & Rodafinos, A. (2013). Experiences in MOOCs: The perspective of students. American Journal of Distance Education, 27(4), 218-227.