Evaluation of a rural self-learning English program in Chile

15
Look into Everything, Explore & Examine www.lieee.org Enjoy Teaching Journal ISSN: 2345 - 4962 www.etj.lieee.org Vol. 2, No. 2; June 2014, pp. 4- 18 4 Evaluation of a rural self-learning English program in Chile by Andrea Lizasoain Conejeros & Claudia Becchi Mansilla Evaluation of a rural self-learning English program in Chile *Andrea Lizasoain Conejeros & Claudia Becchi Mansilla Instituto de Lingüística y Literatura, Universidad Austral de Chile, Valdivia, Chile *Email: [email protected] Article Information: Article history : Received 10, June, 2014 Accepted 27, June, 2014 Published 30, June, 2014 Abstract Until recently, rural areas had been neglected by the Chilean Ministry of Education with respect to the teaching of English as a Foreign Language. In 2010, it implemented an audiovisual tool called It’s my Turn! in rural schools, believing that ICTs would come to solve the lack of English teachers in the country side. However, the efficiency and effectiveness of the program had not been evaluated, which this action research study sought to address. Based on data obtained through a survey and pre- and post-tests, we drew the conclusion that the ICT tool does promote the learning of English, although some changes need to be urgently made regarding its implementation, as it was also found that rural teachers were not using the teaching tool systematically. Key Words: It’s my Turn!, ICTs, rural education, EFL, learning, evaluation

Transcript of Evaluation of a rural self-learning English program in Chile

Look into Everything, Explore & Examine www.lieee.org

Enjoy Teaching Journal ISSN: 2345 - 4962 www.etj.lieee.org Vol. 2, No. 2; June 2014, pp. 4- 18

4

Evaluation of a rural self-learning English program in Chile by Andrea Lizasoain Conejeros & Claudia Becchi Mansilla

Evaluation of a rural self-learning English program in Chile

*Andrea Lizasoain Conejeros

&

Claudia Becchi Mansilla

Instituto de Lingüística y Literatura, Universidad Austral de Chile, Valdivia, Chile

*Email: [email protected]

Article Information:

Article history :

Received 10, June, 2014

Accepted 27, June, 2014

Published 30, June, 2014

Abstract

Until recently, rural areas had been neglected by the Chilean Ministry of Education with respect to the teaching

of English as a Foreign Language. In 2010, it implemented an audiovisual tool called It’s my Turn! in rural schools,

believing that ICTs would come to solve the lack of English teachers in the country side. However, the efficiency

and effectiveness of the program had not been evaluated, which this action research study sought to address. Based

on data obtained through a survey and pre- and post-tests, we drew the conclusion that the ICT tool does promote

the learning of English, although some changes need to be urgently made regarding its implementation, as it was

also found that rural teachers were not using the teaching tool systematically.

Key Words: It’s my Turn!, ICTs, rural education, EFL, learning, evaluation

Look into Everything, Explore & Examine www.lieee.org

Enjoy Teaching Journal ISSN: 2345 - 4962 www.etj.lieee.org Vol. 2, No. 2; June 2014, pp. 4- 18

5

Evaluation of a rural self-learning English program in Chile by Andrea Lizasoain Conejeros & Claudia Becchi Mansilla

1. Introduction

In 2004, the Chilean Government issued an

ambitious decree that sought to turn Chile into a

bilingual country by 2012 with the aim to provide

the Chilean people with more and better job

opportunities. The English Opens Door Program

was then launched by the Ministry of Education

(MINEDUC) and several opportunities started to

be offered to students and teachers to learn and

improve English proficiency levels, which were

very low. By 2007, though, only 2% of Chileans

spoke English proficiently (Dowling 2007) and in

2013, the English First English Proficiency Index

(EF EPI) still classified Chile among the countries

with a ‘very low level’ of English (English First

2013). Therefore, nothing has changed much since

2004.

Rural schools had been left aside in this

strive for becoming a bilingual country until 2010

when the audiovisual self-learning tool It’s my

Turn! was launched and implemented by the

MINEDUC in all rural schools in the country. In

fact, English had not been a compulsory subject

matter in this context until then. Given that most

rural school teachers do not speak English, the ICT

tool was thought to teach English to rural students

in an autonomous, fun and resource-efficient way.

Thus, many teachers would become students of

English at the same time, which was in fact one of

the goals of the Ministry (MINEDUC 2014).

Computer-assisted language teaching has

developed since the 70s (Warschauer, Shetzer &

Meloni 2004), attracting attention from teachers

and researchers from then on. Today, Information

and Communication Technologies (ICTs) are

considered to be crucial to meet teaching and

learning needs related to the acquisition of

languages. In this line, Chile has been

implementing several ICT-based educational

programs, such as ENLACES and EducarChile,

which allow communication among people

involved in the education field and access to many

teaching and learning ICT resources. However,

traditionally, their usefulness and effectiveness

remain unexplored in the country.

In general, however, ICTs have shown to

be powerful tools to teach and learn. Hepp (2013),

for instance, has asserted that ICTs foster learning

autonomy making students more responsible of

their own academic progress, because they allow

more transparency in the setting of goals,

achievements and self-assessment (García,

Ferrerira & Morales 2012), without the constant

presence and regulation by a teacher. At the same

time, Álvarez & Álvarez (2012) consider that

ICTs’ mixed nature of verbal and visual messages

favors information storing in the brain, thus

facilitating learning; by saving it in different ways,

‘there are more possibilities to remember

information if presented in two different formats’

(Álvarez & Álvarez 2012: 222).

In the Teaching English as a Foreign

Language (TEFL) area, García, Ferreira and

Morales’s (2012) results go in the same direction.

Their research shows that ICTs use in the

classroom fosters students’ autonomous learning,

on the one hand, and makes it more meaningful, on

the other, since these environments are familiar to

students, especially the youngest ones. Besides,

contrary to what usually happens in the Chilean

classroom, which fosters no student participation,

‘technological advancement has allowed foreign

language learning to be more interactive and

dynamic’ (García et al. 2012), turning the teacher

into another participant with the same social power

as students in the communicative situation. In this

line, Clavijo, Quintana and Quinteros (2012) have

stated that virtual learning environments allow

effective student-student and student-teacher

communication and the use of English in a context

of knowledge exchange that is natural to everyone

and, therefore, meaningful for students.

However, there are some studies that point

to the need to train both students and teachers in the

use of educational ICTs in order to be efficient and

effective (García et al. 2012; Fernández 2011;

Schirmer 2010; Warschaurer et al. 2000);

otherwise, results are worse in comparison to the

traditional classrooms (Schirmer 2010) or are

simply not accomplished. Spitzer (2013) shows a

similar concern and warns that learning cannot be

left to technology alone, since learning demands ‘to

explore with a critical spirit, to ponder, to browse

Look into Everything, Explore & Examine www.lieee.org

Enjoy Teaching Journal ISSN: 2345 - 4962 www.etj.lieee.org Vol. 2, No. 2; June 2014, pp. 4- 18

6

Evaluation of a rural self-learning English program in Chile by Andrea Lizasoain Conejeros & Claudia Becchi Mansilla

the original sources, to put a puzzle together in

order to get the whole picture’ (p. 17). The latter

requires the learner’s personal effort and the

expert’s orientation. Therefore, the use of ICTs by

no means should leave teachers out of the

classroom, which was kept in mind when It’s my

Turn! was created.

The program was designed by a group of

university teachers of English as a Foreign

Language to promote the acquisition of English in

5th and 6th graders (MINEDUC 2014) in rural areas.

The two kits are composed by a set of audiovisual

lessons, a guideline to use the program, a workbook

for students, a teacher’s book (with the planning

and keys), a CD-ROM with songs and rhymes, and

a bilingual dictionary. The MINEDUC also

provides schools with a computer and a beamer to

project the audiovisual material in the classrooms.

The rationale is that by watching videos in English

with content that has been contextualized in rural

areas, students will learn the foreign language in a

meaningful and appealing way, since they are

familiar with the countryside and technology.

Because the Ministry of Education does

not count with any documentation on the

theoretical or methodological bases of the program,

it has been assumed that the underlying teaching

approaches are based on theories of language

acquisition that promote implicit and staged

learning of vocabulary and grammar (Lightbown &

Spada 2006; Richards & Rodgers 2001; Halliday

1975; Krashen 1981 & 1982). Lessons are

contextualized in a typical rural classroom where

Mr. Campos (whose name means ‘farms’) plays the

role of a teacher of English who teaches EFL to

both children and unreal characters (a little monster

and a robot) in a context similar to their daily life

experience (MINEDUC 2014). The digital tool has

been used during four years already, but there is

little evidence –if any– of its effectiveness. Thus,

there is a need to evaluate the impact that it has had

on rural students in Chile in order to check if it

actually works and if changes are needed.

In consequence, in 2012, a case study was

designed to be carried out in ten rural schools in the

South of Chile, seeking to measure the

effectiveness of the program. However, it was

found that, although implementation had been

made compulsory nationwide, most schools were

not using the program, so the case study changed

into action research. In consequence, three rural

schools were chosen and one of the researchers

implemented the program in the classrooms in

order to see if students learnt English by watching

the videos and working with the other material

provided.

This paper first describes the State of the

Art of English as a Foreign Language in Chile,

followed by a contextualization of the teaching of

English in rural areas. Then, an explanation of the

key constructs that are believed to support It’s my

Turn! and that will sustain the discussion of results

is presented. The document then moves to the

Methodology section, Results presentation, and

Discussion of results, finishing with the

Conclusions section.

1.1 State of the art

1.1.1 English linguistic competence in Chile

Since 2004, the Ministry of Education has applied

standardized tests to assess comprehension skills in

English in high school students along the country.

Results systematically point to the fact that both

urban and rural public and subsidized schools do

not reach the English proficiency levels that the

Ministry of Education demands by the end of the

school years –A2 y B1 according to the CEFR, –

which correlate the EF EPI figures. This means that

Chilean students are not able to communicate in

basic job or travel contexts.

1.1.2 English as a foreign language in the

classroom

In relation to teachers, the standardized test applied

in 2004 (in charge of Cambridge ESOL

Examinations), which also included a

questionnaire to them, pointed out that their role in

the classroom was crucial: Those students who had

actively participated in class by speaking and

writing and who had been assessed through

different methods (both traditional and alternative)

had gotten better results in the test (Red Maestros

de Maestros 2004). This coincides with Manzi,

González and Sun (2011), who found out that most

classroom interaction in Chile does not foster

critical thinking nor any kind of learning.

Look into Everything, Explore & Examine www.lieee.org

Enjoy Teaching Journal ISSN: 2345 - 4962 www.etj.lieee.org Vol. 2, No. 2; June 2014, pp. 4- 18

7

Evaluation of a rural self-learning English program in Chile by Andrea Lizasoain Conejeros & Claudia Becchi Mansilla

Furthermore, the majority of teachers base their

teaching only on textbooks, ascribing little time to

creative experiences (Lizasoain & Ortiz de Zárate

2009), authentic materials (Lizasoain, Ortiz de

Zárate, Yilorm & Walper 2011) and ICTs (Flores

2012; Arancibia 2002, Pérez 2000), giving way to

passive participation by students, which does not

lead to new knowledge.

This is accompanied by the fact that

several teachers of English in Chile do not actually

speak the language. In this regard, the English

Opens Door Program allow all teachers to take a

proficiency test to certify their English levels.

However, results are personal (Programa Inglés

Abre Puertas 2014), so nationwide English

teachers’ proficiency levels are unknown. It is

known, however, that there is a deficit of English

teachers in the country, who are replaced by people

who speak the language without being teachers, or

by teachers of other subjects. In the first decade of

the 21st century 9,552 schools taught English with

9,056 subjects in charge of the English subject.

Nonetheless, only 4,671 were actually English

teachers (Páez 2012).

1.1.3 Rural education in Latin America and Chile

A rural school is an educational setting located in a

rural area, usually isolated from basic services such

as running water and light, although this can vary

depending on the geographical area. Facilities are

usually basic, having few rooms to teach in and few

teachers, who are not specialized in one matter but

in many. Another characteristic of rural schools is

the lack of resources to teach, such as books,

textbooks, computers, and the Internet.

For centuries, rural areas have had to deal

with many difficulties that have impeded access to

appropriate health, economy and education

conditions. However, international organizations

have recently started to seriously address this

reality. The World Food Summit of 1996, for

instance, highlighted the need to improve education

in rural areas in order to eradicate poverty and

make sustainable development possible (De Muro

& Burchi 2007). By the same token, the

Millennium Summit in 2000 paid special attention

to the development of better educational conditions

for rural areas, since education helps people to

eliminate poverty and hunger (FAO 2004).

Following this line, the Education for Rural People

(ERP) partnership had been set up in 2002.

The ERP is directed by FAO and, with the

collaboration of UNESCO, works all over the

world to carry out research studies to depict the

reality of rural education in the countries of Latin

America, among other initiatives. In 2004, a case

study conducted in seven countries in the region

provided an overview of education in non-urban

settings. It was found that rural students present

lower results in standardized tests in comparison

with urban school students, because of a lack of

access to quality education (FAO 2004). In 2014,

this reality has not changed much in Chile.

According to FAO (2004), 14% of the

population in Chile lives in rural areas. The number

of rural schools in Chile is about 4,500 out of a total

of 9,000 (MINEDUC 2014), and most of these

schools (3,589 out of 4,345) are multilevel

classrooms (Moreno 2007), which means that the

same contents are given to students from 6 to 12

years old, which may prevent progress. Students’

academic performance is also related to their rural

teachers’ expertise (Eyzaguirre & Fontaine 2008),

who in most of the cases are poorly prepared to face

the harsh reality of rural settings, let alone teach

English. Therefore, if academic success is poorer in

rural schools in comparison to urban schools, is the

teaching and learning of English possible through a

self-learning virtual program with no expert’s

orientation?

2. Theoretical framework

2.1 ICTs

The use of ICTs in the classroom is based on the

premise that they allow any child, being rural or

urban, to access more information than any

scientist could have accessed in the past century

(Warschauer et al. 2004). In this sense, we are ‘in

the midst of another revolution in human

communication, based on the development and

spread of computers and the Internet’ (p. 1).

Besides, the use of technology to access

entertainment and education is basic today, since

student nowadays are considered to be “digital

natives” (Prensky 2001), “screenagers” (Jukes &

Dosaj 2006) or “digital residents” (White & Le

Look into Everything, Explore & Examine www.lieee.org

Enjoy Teaching Journal ISSN: 2345 - 4962 www.etj.lieee.org Vol. 2, No. 2; June 2014, pp. 4- 18

8

Evaluation of a rural self-learning English program in Chile by Andrea Lizasoain Conejeros & Claudia Becchi Mansilla

Cornu 2010). This means current students explore,

know and learn through technology with

naturalness (Fernández 2011). Therefore, the use of

ICTs such as computers, smart phones, the TV, e-

mail accounts, and social networks, to mention

some, is unavoidable if meaningful and long-

lasting learning is the goal (Shelly, Gunter &

Gunter 2010).

Research points to the fact that ICTs foster

collaborative work, communicative competence,

autonomous learning and foreign language

acquisition (Hepp 2013, García et al. 2012; Clavijo

et al. 2012; Warschauer et al. 2004; among many

others), besides other skills and abilities.

Nonetheless, they can also lead to cognitive

maladjustments in concentration, language

development and intelligence (Spitzer 2013) if not

used with caution and expertise.

2.2 Learning styles

Apart from including both verbal and

visual features that support meaningful learning

(Álvarez & Álvarez 2012), ICTs are powerful

because they point at students’ different learning

styles (visual, auditory, kinesthetic), defined as the

natural way to access new information and develop

skills (Nunan 2003), also known as multiple

intelligences (Armostrong 2009, Gardner 1993).

Thus, a visual learner will best learn through

written texts or images; an auditory learner will

best acquire new knowledge by listening to

information; and a kinesthetic learner will be more

comfortable experimenting new knowledge by him

or herself through their body (Gardner 1993).

The digital revolution (Warschauer et al.

2004) has changed the way human beings behave,

think and perceive the world (Fernández 2011) and

it is even possible that the brain has structurally

changed (Spitzer 2013, Prensky 2001). In fact, it is

usually asserted that students today tend to be more

visual than some decades ago, when teaching was

based on auditory input offered by the teacher.

This new generation of digital learners has

been defined as ‘(1) hyper communicators who use

multiple tools to communicate, (2) multitaskers

who do several things at once with ease, and (3)

goal oriented as they pursue multiple goals’ (Shelly

et al. 2010: 15). Therefore, if teachers want to catch

students’ attention, they must use ICTs to ‘enhance

students’ achievement and assist them in meeting

learning objectives’ (Shelly et al. 2010: 11), which

obliges educational forces to include them in the

curricula so citizens are all literate in digital terms.

2.3 Digital literacy

Literacy is understood as a set of linguistic and

cognitive mechanisms that are necessary to

actively participate in different discourse practices

(Errázuriz & Fuentes 2012) that relate to specific

sociocultural contexts, such as the school and the

workplace. Among these mechanisms, using a

computer, writing e-mails and interacting through

digital interfaces are crucial. The classroom, then,

must be a place where digital literacy is developed

so students are prepared to interact with efficiency

in their communities of practice. What is more, it is

important that citizens are not only literate in

digital terms but they should also master the lingua

franca at least at a basic level in order to have

access to information which is only available in

English.

2.4 The Natural Approach

Although foreign languages are usually learnt in

artificial or formal environments like the

classroom, the process of acquisition of the mother

tongue can actually be emulated if certain criteria

are met. The Natural Approach (Krashen & Terrel

1977) fosters the natural acquisition of second or

foreign languages by exposing students to

authentic samples of the target language, teaching

vocabulary and syntax in an implicit way and

highlighting fluency over accuracy. This way,

learners can incorporate new knowledge

unconsciously, same as children do when learning

their mother tongue. Thus, instead of learning

about the language, the will learn it.

The Natural Approach also seeks to

provide a stress-free learning environment, so

students’ affective filter (anxiety, fear,

embarrassment, etc.) is low (Krashen 1985). In this

view, language output should not be forced but

allowed to emerge spontaneously after students

have been exposed to large amounts of

comprehensible language input.

2.5 Content-based Instruction

Look into Everything, Explore & Examine www.lieee.org

Enjoy Teaching Journal ISSN: 2345 - 4962 www.etj.lieee.org Vol. 2, No. 2; June 2014, pp. 4- 18

9

Evaluation of a rural self-learning English program in Chile by Andrea Lizasoain Conejeros & Claudia Becchi Mansilla

It has already been said that students learn

best and can communicate more effectively when

authentic communication contexts are provided.

Content-based Instruction promotes the acquisition

of second or foreign languages based on topics that

are related to other subject matters (Ramos &

Espinoza 2006; Arancibia 2002; Stryker & Leaver

1997), with the aim of contextualizing language

and creating communication situations that are

natural an appropriate to students’ needs and

previous knowledge. At the same time,

collaboration among teachers is promoted and

strengthened since they must work together to

achieve educational goals. For example, teachers of

English can work with teachers of mathematics to

teach the numbers to preschoolers.

3. Methodology

3.1 Research method

An evaluative case study (Cohen, Manion &

Morrison 2007, Stenhouse 1983) was designed to

be carried out in ten schools in the Region of the

Rivers (Región de los Ríos) in Chile to check the

efficiency and effectiveness of the governmental

software It’s my Turn! in the learning of English as

a Foreign Language. Since implementation was

compulsory, it was assumed that all of the schools

were using it as they had actually claimed to be

doing. However, it was found out that schools had

not yet implemented the program, so the study

turned into action research. In consequence, three

multilevel classroom schools were chosen to apply

the program during four weeks in November, 2012,

when students were taught English through three

lessons of the program.

3.2 Subjects

The study involved 35 rural students in 5th and 6th

grades, who attended school with children in lower

grades. All of the students spoke Chilean Spanish

as their first and only language. They were all

taught English through the 5th grade kit of It’s my

Turn!, since the Government had not yet provided

all schools with the 6th grade kit and students were

not familiarized with the program nor with the

English language. At this point, it must be

explained that a multilevel classroom holds

students in all levels but activities are usually

customized to each level. However, in the case of

the English subject, all students are exposed to the

same material, although only students in 5th and 6th

grade have workbooks, since English is

compulsory from 5th grade onwards only.

Therefore, students in lower levels are only able to

watch and be quiet.

3.3 Research tools

A survey. An eight-question survey was used to

determine students’ exposition to ICTs and decide

whether they could be regarded as digital learners.

Their motivation towards the learning of English

was also explored.

It’s my Turn! Since the program had not

been implemented, one of the researchers attended

the three participant schools twice a week for a

month and used the program in the English

classrooms. Three lessons of the 5th grade kit were

used in the same way as the teacher of English of

the school should have done it. That is, the teacher

spoke in Spanish to have students open their

workbooks at a certain page and watch the videos

in English. Students had to work on their exercises

on their own while the videos were playing and/or

after they had been stopped. The picture 1

illustrates how the program should work.

Look into Everything, Explore & Examine www.lieee.org

Enjoy Teaching Journal ISSN: 2345 - 4962 www.etj.lieee.org Vol. 2, No. 2; June 2014, pp. 4- 18

10

Evaluation of a rural self-learning English program in Chile by Andrea Lizasoain Conejeros & Claudia Becchi Mansilla

Picture1, The classroom program

Pre- and post-tests. To measure how

much students had learnt after working with It’s my

Turn!, pre- and post-tests were applied on three

different occasions. Tests were similar in terms of

content, but different in format to prevent learners

from remembering the items from the first test, thus

providing it with validity and reliability (Gass &

Mackey 2007). They included open questions,

matching, and multiple choice items, among other

elicitation techniques, following the rationale of the

program’s workbook. Maximum score also varied,

so results were expressed in marks from 1 to 7,

according to the Chilean grading system.

3.4 Data Analysis

Data was statistically analyzed in the software

STATGRAPHICS Centurion. In relation to the

surveys, ‘yes’ and ‘no’ answers were counted and

then turned into percentages. Regarding pre- and

post-tests, students’ grades obtained before and

after the lessons were organized decreasingly and

averages per school were calculated to contrast

them. A t-test was applied to all of the results in

pre- and post-tests to put the significance

of variances to trial.

In the discussion section, information

obtained through informal conversations with the

teachers in charge of the English subject at the

schools involved in this study was also included in

order to shed light on some numeric results.

4. Results

4.1 Surveys

Surveys yielded that students are highly exposed to

ICTs. One question pointed at the amount of hours

that students watched television a day and it was

found that 77% did for more than 5 hours. At the

same time, all of them watched television on a

regular basis even if for less than 2 hours.

Students were also asked about the

frequency with which they used computers a week

at home. It was assumed that if asked about hours

a day, results were not going to be relevant. Results

yielded that 43% of the students used computers for

less than 2 hours a week, 23% did between 2 and 5

hours, and 14% did for more than 5 hours. There

were some students who said they did not use

computers (20%). Therefore, computers were not

Look into Everything, Explore & Examine www.lieee.org

Enjoy Teaching Journal ISSN: 2345 - 4962 www.etj.lieee.org Vol. 2, No. 2; June 2014, pp. 4- 18

11

Evaluation of a rural self-learning English program in Chile by Andrea Lizasoain Conejeros & Claudia Becchi Mansilla

considered to be used in such a regular basis as in

the city. At the same time, in an informal

conversation, one of the teachers explained that

students had access to a computer at school during

classes and/or during break time but that it was only

used to play.

Another question had to do with the

amount of hours that children spent manipulating

cell phones. The survey showed that 23% of the

students used them for less than 2 hours a day, 17%

did between 2 and 5 hours, 49% did for more than

5 hours, and 11% said they did not have a cell

phone. This showed that students were normally

exposed to this device. In consequence, the

subjects in this study showed to be highly exposed

to ICTs, especially cell phones. However, it was

not determined whether its use had learning goals.

We also wanted to know whether students

liked English or not to see if they were motivated

to learn the language. It was found that most

students liked English (66%), while a significant

amount (34%) did not. The latter answered that

they found it unpleasant (67%) or difficult (33%).

Therefore, most students did like the subject, but

there was a significant number who did not.

In this regard, in an informal conversation,

one of the teachers said that students did not like

It’s my Turn!, because ‘they didn’t understand

anything’ (personal communication, November

2012), so she did not use it in class. Instead, she

tried to teach them English based on what she had

learnt in a training course offered by the

MINEDUC she had attended for a semester.

Another teacher said that students received formal

English instruction from a teacher of English who

came sometimes. In consequence, students did not

cover the contents that the curriculum required. At

another school, the teacher in charge of the subject

said that the school never received the rural English

program, even though they had written and phoned

several times to different people to ask for the

resource. They borrowed the program from another

school, but there were not enough copies of the

textbooks for all the students. In consequence,

students felt this language was unfamiliar to them.

4.2 Tests

Three pre-tests and post-tests were applied before

and after the lessons in every school. In general,

pre-test results were low, with an average mark of

3.5 (lower than the passing mark in Chile, which is

4.0 out of 7.0). However, post-tests, whose results

were also low (average 4.2), were better. Figure 1

shows the differences per school.

Figure 1. Average mark in pre- and post-tests per school

The figure shows that schools increased their test

results after working with the program. Schools 1

and 2 improved 1 point; School 3, however, only

improved 0.2 points. In order to test the

Average pre School 1؛ 3/6؛ Average pre School 2؛ 2/9؛ Average pre؛ School 34/0؛

Average post School 1؛ 4/6؛ Average post School 2؛ 3/9؛ Average post School 3؛ 4/2؛

Average pre Average post

Look into Everything, Explore & Examine www.lieee.org

Enjoy Teaching Journal ISSN: 2345 - 4962 www.etj.lieee.org Vol. 2, No. 2; June 2014, pp. 4- 18

13

Evaluation of a rural self-learning English program in Chile by Andrea Lizasoain Conejeros & Claudia Becchi Mansilla

significance of the results between pre- and post-

tests, they were processed in the statistical software

STATGRAPHICS Centurion. A t-test yielded that

the difference between the pre- and post-test means

was significant (t (105) = 0,4248; p <0.05). This

significance is illustrated in Figure 2 below.

Figure 2. Statistical significance between pre- and post-tests differences

The boxes in Figure 2 represent the range of the

marks that the 35 participants obtained in the pre-

and post-tests. The left whisker of each box shows

the lowest marks achieved by students (25% of

scores); thus, the lowest grade of the pre-tests is a

1.4, and a 2.2 in the post- evaluations. The width of

the boxes differs depending on the variability of the

grades. Thus, the post-tests box is larger than the

pre-tests box, because variation among marks

increased. The blue vertical line in the boxes shows

the median of the data; and the red ‘plus’ signs

represent the average grade of the results: In the

pre-tests it is 3.6 and in the post-test it is 4.3. In the

case of the post-tests, the median and the average

grade were different owing to the fact that the

dispersion of the results was higher than in the pre-

tests, where the results had concentrated in a lower

range of grades. The second whisker at the right

shows the highest grades obtained by the

participants (25% of scores). This is a 6.1 in the

pre-tests and 6.5 in the post-tests (out of a

maximum score of 7). Results, then, evinced that

after having worked with the rural English

program, the range of the grades varied not only in

terms of means, but also when comparing lowest

and highest grades.

In general, results yielded that when

students worked with the rural English program,

they improved their results in the post-tests. In

Look into Everything, Explore & Examine www.lieee.org

Enjoy Teaching Journal ISSN: 2345 - 4962 www.etj.lieee.org Vol. 2, No. 2; June 2014, pp. 4- 18

13

Evaluation of a rural self-learning English program in Chile by Andrea Lizasoain Conejeros & Claudia Becchi Mansilla

other words, it can be said that this self-learning

tool implemented by the MINEDUC is an effective

tool for teaching EFL in the rural areas of Chile,

since students actually learned vocabulary and

basic structures of English.

5. Discussion

The study showed that participants did have regular

contact with ICTs; therefore, they can be

considered digital natives (Prensky, 2001) able to

manipulate and interact with digital resources. At

the same time, being exposed to ICTs on a regular

basis, especially cell phones, it is assumed that they

can also learn through them (Fernández 2011,

Jukes & Dosaj 2006) since their brains have been

probably adapted to them (Spitzer 2013, Prensky

2001). In fact, it was shown that students did learn

through It’s my Turn!. Although this increase was

not high, it must be remembered that it was the first

time that these students were exposed to the

English language in a formal setting and that the

program had not been implemented before, so they

were learning two new things at the same time:

They were learning English and learning to learn

through a digital resource.

In relation to the above said, English is the

lingua franca to communicate worldwide, but rural

areas in Chile are usually isolated from situations

where the English language is required. For

example, cable TV is not common in these areas,

and the domestic TV networks broadcast in

Spanish. At the same time, English is only

compulsory from 5th grade onwards so the subject

and the language itself were probably completely

new to these children who live in the South of

Chile, which is rainy and keeps people in their

homes, isolated from experiences that demand the

use and understanding of a foreign language. At the

same time, contrary to what was expected, rural

students had been in regular contact with digital

resources such as TVs, computers and cell phones.

Nonetheless, their use had had entertainment

purposes only. Therefore, it was enlightening to see

that ICTs can actually have educational ends in

rural areas same as in urban areas.

However, marks obtained by students

were low, bordering the minimum mark to pass a

course in Chile (4.0 out of 7.0). This is consistent

with the literature, which has found that rural

students tend to get low results in standardized tests

(Eyzaguirre & Fantuzzi 2008; FAO 2004) due to

rural teachers’ lack of expertise, shortage of

resources, students’ poverty and all of its

implications, etc.

Although poor, nonetheless, results from

tests showed that schools with higher rates of

vulnerability improved more than schools with

lower rates. For example, in School 1 (with a

vulnerability rate of 100%), students got an average

of 2.9 in the pre-test, which increased to 3.9 (1

point) after having worked with the program. In

contrast, School 3 (with a vulnerability rate of

87%) only improved 0.2 points (see Figure 1).

Therefore, it can be seen that the school with a

higher vulnerability rate improved more than the

one with a lower rate. This is consistent with the

finding of the Chilean Fondef D08i-1074 (2012)

project, which yielded that schools with higher

levels of vulnerability rate learnt more when they

were exposed to improvements in the pedagogical

praxis, because the impact is stronger.

In relation to the teachers’ lack of

expertise previously mentioned, most teachers in

rural areas do not speak English and that is why the

program was designed to facilitate their job, on the

one hand, and teach them the foreign language, on

the other (MINEDUC 2014). Given that rural

teachers many times perform more than teaching-

related tasks in rural schools, having this ready-

made tool at hand can help them in their daily jobs.

However, it was found that teachers did

not actually use the program and that is why the

case study first designed to evaluate It’s my Turn!

had to be changed into an action research study.

Among the reasons teachers mentioned for not

using the program, teachers and students lack of

understanding of the language –accompanied by

lack of motivation to learn it,– teachers’

inexperience with ICTs and shortage of resources

in the classroom were highlighted. Although the

program was designed to teach English to teachers

and students together, the former felt awkward

when students asked questions and they did not

know what to answer. At the same time, students

felt lost without expert orientation. Besides, it was

Look into Everything, Explore & Examine www.lieee.org

Enjoy Teaching Journal ISSN: 2345 - 4962 www.etj.lieee.org Vol. 2, No. 2; June 2014, pp. 4- 18

14

Evaluation of a rural self-learning English program in Chile by Andrea Lizasoain Conejeros & Claudia Becchi Mansilla

observed that not all of the students had their own

material, thus preventing them from getting the

most from autonomous learning (García et al.

2012). Notwithstanding, the questionnaire yielded

that most students liked English (66%), probably

appealed by the characteristics of the program. In

this regard, it was also seen that students rapidly

grew accustomed to sitting in front of the screen to

watch the lessons, while they had their notebooks

and workbooks open on their desks; it was

observed then that they were natural multitaskers

(Shelly et al. 2010). As a consequence, teachers

should not lose their traditional role in the

classroom as the environment gets unnatural, thus

preventing effective student-student and student-

teacher communication (Clavijo et al. 2012) from

happening. At the same time, enough resources

must be available for students to work and learn on

their own.

Resources are highly significant when

learning something on one’s own as they are the

only source of input. Since rural teachers do not

speak the language that students are supposed to be

learning, the only comprehensible input (Krashen

1982) comes from the educational material that

students count with. One of the rationales of It’s my

Turn! is that students are going to learn English by

watching appealing videos where characters

similar to the people they usually interact with

communicate in English (except from the little

monsters, of course), and by systematizing this

knowledge through their work with the exercise

book; in other words, for learning to occur,

students’ must also make an effort (Spitzer 2013).

Furthermore, learning is reinforced when

coming from different sources or in different

formats (Álvarez & Álvarez 2012) as students can

best remember new knowledge when information

has been stored in different formats which, in this

case, are auditory and visual. Auditory input is

unavoidable since all of the students are exposed to

the videos and can listen to them (unless, of course,

they are deaf). However, if students do not count

with their own workbooks, one important format is

left out, which is written input.

The latter is directly related to students’

learning styles. It’s my Turn! does appeal to visual

and auditory learning but leaves kinesthetic

learners aside. That is, students who best learn by

listening to or watching new information (both

verbal and nonverbal) will probably get better

results than those who need to experiment new

knowledge themselves, which is usually made by

moving. In other words, the program repeats the

traditional pattern of a Chilean classroom with

students sitting in rows in front of a source of

knowledge, which leads, again, to lack of effective

communication among the participants of the

communicative situation (van Dijk 2008).

Notwithstanding, from the perspective of

using ICTs to foster the learning of English, it was

found that the program has the potential to be

successful nationwide and that it can actually help

bridge the gap between urban and non-urban

schools in Chile. It’s my Turn! is actually a source

of comprehensible input, because it presents

communicative situations familiar to 5th grade rural

students; contents that have been contextualized

according to their natural environment, which can

also be related to other school subjects (Ramos &

Espinoza 2006; Arancibia 2002; Stryker & Leaver

1997) and staged according to students’

proficiency in the language (Halliday 1975). This

allows for implicit learning of linguistic content

and leads to natural acquisition of the language

(Krashen & Terrell 1977). In fact, students not only

recognized and identified the new concepts

included in the lessons –they remembered,– but

also used them in some basic oral and written tasks,

without having received formal instruction, i.e. the

explicit teaching of grammar –they learnt.

6. Conclusions

In its endeavor to turn Chile into a bilingual nation,

the Chilean State has implemented many programs

to take English everywhere in the country; It’s my

Turn! is one of them.

This study attempted to evaluate the

impact the self-learning program has on rural

students through a case study. However, it was

found that schools were not using the resource for

several reasons such as apprehension to ICTs, lack

of proficiency in English and shortage of material.

Therefore, the study turned into an action research

study through which one of the researchers

Look into Everything, Explore & Examine www.lieee.org

Enjoy Teaching Journal ISSN: 2345 - 4962 www.etj.lieee.org Vol. 2, No. 2; June 2014, pp. 4- 18

15

Evaluation of a rural self-learning English program in Chile by Andrea Lizasoain Conejeros & Claudia Becchi Mansilla

implemented It’s my Turn! to check its

effectiveness.

It was found that the resource has a

positive impact on students, whose results in pre-

and post-tests improved, showing that they had

learnt English by using the program. In other

words, they remember linguistic content (words

and structures) and could also use it. The study also

showed that rural students are exposed to ICTs on

a regular basis and that they can use them not only

to play but also to learn.

However, students’ results were low,

being on the edge of the passing mark in Chile. This

can be ascribed to many factors. In the first place,

students had not used the program before and they

were not familiar with using an ICT with learning

purposes. Secondly, English is taught for the first

time in 5th grade in Chile, so students had not had

previous contact with the language. Thirdly, not all

of the students were in possession of the workbook,

thus preventing them from reinforcing what they

had learnt from the videos by means of a different

format, which could have strengthened learning,

according to the literature. Finally, some of the

students did not like English (34%) so they were

probably unwilling to process the new information.

Therefore, many steps need to be taken in

order to take advantage of It’s my Turn! For

instance, it would be ideal to have rural teachers

who can actually speak English so they present

themselves as experts in front of their students, thus

orienting them in the learning process and, at the

same time, feeling at ease with the resource.

Besides, more training to implement the program is

needed from the side of the State, since the

irresponsible use of ICTs for educational purposes

has a negative impact. Apart from that, the Ministry

of Education has to monitor their teaching and

learning programs in order to check if changes need

to be made, which is usually not done. In this case,

apart from the already mentioned possible

improvements, the MINEDUC needs to make sure

that all of the schools have the necessary material

to implement the program and that all of them are

actually implementing it.

Many elements were left unexplored in

this study. For example, it would be interesting to

further explore the rural teachers’ perception of this

program and how they feel about learning English

together with their students. Through informal

conversations it was hinted that they felt awkward

not only because they did not speak English and

were in charge of the subject, but also because they

were unfamiliar with ICTs for educational

purposes. It would also be sensible to reproduce the

study at a larger scale to know what is going on in

other regions of the country, thus feeding the

MINEDUC with information to improve the

quality of education in Chile, which has lately been

under a magnifying glass, based on empirical

research rather on the idea that improvisation of

methodologies equals innovation in the curriculum.

Look into Everything, Explore & Examine www.lieee.org

Enjoy Teaching Journal ISSN: 2345 - 4962 www.etj.lieee.org Vol. 2, No. 2; June 2014, pp. 4- 18

16

Evaluation of a rural self-learning English program in Chile by Andrea Lizasoain Conejeros & Claudia Becchi Mansilla

References

Álvarez, G. & Álvarez, G.M. (2012). Hacia una

propuesta de análisis semiótico integral de

ambientes virtuales de aprendizaje.

Onomázein 25(1): 219-239.

Arancibia, M. (2002). Transformaciones en las

organizaciones educativas que posibiliten

aprendizajes transdisciplinarios con

utilización de recursos informáticos.

Estudios Pedagógicos 28: 143-156.

Armostrong, T. (2009). Multiple Intelligences in

the Classroom. 3rd ed. Virginia: ASCD.

Clavijo, A., Quintana, A. & Quintero, L. 2012.

Enseñanza del inglés y medios digitales:

nuevos retos y posibilidades para la

escuela. Bogotá: Editorial UD.

Cohen, L., Manion, L. & Morrison, K. (2007).

Research Methods in Education. 6th ed.

London and New York: Routledge.

De Muro, P. & Burchi, F. (2007). Education for

Rural People and Food Security. A Cross

Country Analysis. Rome: FAO

Publishing.

Dowling, J. (2007). La enseñanza del inglés en

Chile: una asignatura pendiente. Business

Chile. Retrieved from

http://www.businesschile.cl/es/noticia/rep

ortaje-principal/la-ensenanza-del-ingles-

en-chile-una-asignatura-pendiente

(accessed 20 February 2014)

English First. (2013). EF English Proficiency Index

2013. Retrieved from

http://www.ef.com/epi (accessed 20

February 2014)

Eyzaguirre, B. & Fontaine, L. (2008). Las escuelas

que tenemos. Chile: Centro de Estudios

Públicos.

Errázuriz, C. & Fuentes, L. (2012). Diseño,

implementación y evaluación de una

propuesta de intervención en

alfabetización académica en primer año de

Pedagogía General Básica en la sede

Villarrica de la UC. Onomázein 25(1):

287-313.

Fernández, C. (2011). Elementos que contribuyen

a la construcción de un modelo curricular

para la integración de TIC en el segundo

ciclo de educación parvularia. REXE

10(20): 109-125.

Flores, P. (2012). Aprendizaje mediado por

tecnologías: Impacto de estrategias

pedagógicas apoyadas por la Web en

estudiantes de la Escuela México

Valdivia, Región de Los Ríos. (Master’s

degree). Universidad Austral de Chile,

Valdivia.

Food and Agricultural Organization of the United

Nations. (2004). Educación para la

Población Rural en Brasil, Chile,

Colombia, Honduras, México, Paraguay y

Perú. Rome: FAO Publishing.

García, J., Ferreira, A. & Morales, S. (2012).

Autonomía en el aprendizaje de lenguas

extranjeras en contextos de enseñanza

mediatizados por la tecnología.

Onomázein 25(1): 15-50.

Gardner, H. (1993). Frames of Mind: The Theory

of Multiple Intelligences. New York:

BasicBooks.

Gass, S. & Mackey, S. (2007). Data Elicitation for

Second Language Research. New Jersey:

Lawrence Erlbaum.

Halliday, M.A.K. (1975). Learning How to Mean:

Explorations in the Development of

Language. London: Edward Arnold

Publishers Ltd.

Hepp, P. January,( 2013). Ideas Festival.

Seminario profesores innovadores.

Seminar at the Universidad Austral de

Chile.

Jukes, I. & Dosaj, A. (2006). Understanding

Digital Children (DKs). Teaching &

Learning in the new Digital Landscape.

Retrieved from

http://www.wright.edu/~marguerite.veres

/786syl/growingupdigit.pdf (accessed 21

April 2012)

Krashen, S. (1982). Principles and Practice in

Second Language Acquisition. New York:

Pergamon.

Look into Everything, Explore & Examine www.lieee.org

Enjoy Teaching Journal ISSN: 2345 - 4962 www.etj.lieee.org Vol. 2, No. 2; June 2014, pp. 4- 18

17

Evaluation of a rural self-learning English program in Chile by Andrea Lizasoain Conejeros & Claudia Becchi Mansilla

Krashen, S. (1981). Second Language Acquisition

and Second Language Learning. Oxford:

Pergamon.

Krashen, S. & Terrell, T. (1977). The Natural

Approach: Language Acquisition in the

Classroom. Oxford: Pergamon Press Inc.

Lightbown, P. & Spada N. (2006). How Languages

are Learned. New York: Oxford University

Press.

Lizasoain, A., Ortiz de Zárate, A., Yilorm, Y. &

Walper, K. (2011). Estudio descriptivo y

exploratorio de un taller de introducción a

las técnicas teatrales para la

Enseñanza/aprendizaje de una lengua

extranjera. Estudios Pedagógicos 27(2):

123-133.

Lizasoain, A. & Ortiz de Zárate, A. (2009).

Efficiency and Effectiveness of Drama

Techniques. ERIC.

Manzi, J., González, R. & Sun, Y. (2011). La

evaluación docente en Chile. Santiago de

Chile: PUC, Mide UC.

Ministerio de Educación. (2014). Indicadores

Educativos para la Comunidad. Retrieved

from http://data.mineduc.cl/ (accessed 25

February 2014)

Moreno, C. (2007). Las escuelas rurales en Chile:

la municipalización y sus fortalezas y

debilidades. Revista Digital eRural,

Educación, Cultura y Desarrollo Rural.

Retrieved from

http://www.revistaerural.cl/municipalizac

ionerurales.html (accessed 28 February

2014)

Nunan, D. (2003). Practical English Language

Teaching. New York: McGraw-Hill.

Páez, A. 2012. PowerPoint Chilean Curriculum.

Santiago, Chile.

Pérez, J. M. (2000). Las escuelas y la enseñanza en

la sociedad de la información. En Pérez,

J.M. Comunicación y educación en la

sociedad de la información. Barcelona:

Ediciones Paidós Ibérica, S.A.

Prensky, M. (2001). Digital Natives, Digital

Immigrants, Part II: Do They Really

Think Differently? RELC 16(1): 82-100.

Programa Inglés Abre Puertas. (2014). Recurso

Educativo It’s my Turn! Retrieved from

http://www.ingles.mineduc.cl/index2.php

?id_portal=49&id_seccion=3370&id_con

tenido=13776 (accessed 21 February

2014)

Ramos, L. & Espinoza, M. (2006). El profesor de

inglés y su labor pedagógica en un mundo

globalizado. Retrieved from

http://www.buenastareas.com/ensayos/El

-Profesor-De-Ingl%C3%A9s-y-

Su/4355082.html (accessed 28 February

2014)

Red Maestros de Maestros. (2004). Resultados

Nacionales del Diagnóstico en Inglés.

Retrieved from

http://www.rmm.cl/usuarios/jriva/doc/20

0609251337550.cambridge_resultados_si

mce.pdf (accessed 28 February 2014)

Richards, J. & Rodgers, T. (2001). Approaches and

Methods in Language Teaching. New

York: Cambridge University Press.

Schirmer, A. (2010). Modelo de enseñanza de

asignaturas b-learning en Universidad

Tecnológica de Chile-INACAP

Concepción-Talcahuano. Resultados

académicos de 4 años de experiencia.

REXE 9(18): 137-155.

Shelly, G., Gunter, G. & Gunter, R. (2010).

Teachers Discovering Computers.

Integrating Technology and Digital

Media in the Classroom. 6th ed. Boston:

Course Technology, Inc.

Spitzer, M. (2013). Demencia digit@l. El peligro

de las nuevas tecnologías. Barcelona:

Grupo Beta.

Stenhouse, L. (1983). Authority, Education and

Emancipation. London: Heinemann.

Stryker, S. & Leaver, B. (1997). Introduction. In

Content-Based Instruction in Foreign

Language Education: Models and

Methods. Washington, D.C.: Georgetown

University Press.

Look into Everything, Explore & Examine www.lieee.org

Enjoy Teaching Journal ISSN: 2345 - 4962 www.etj.lieee.org Vol. 2, No. 2; June 2014, pp. 4- 18

18

Evaluation of a rural self-learning English program in Chile by Andrea Lizasoain Conejeros & Claudia Becchi Mansilla

Van Dijk, T. (2008). Discourse and Context.

Cambridge: Cambridge University Press.

Warschauer, M., Shetzer, H. & Meloni, C. 2004.

Internet for English Teaching.

Washington D.C.: TESOL.

White, D. & Le Cornu, A. (2011). Visitantes y

residentes: una nueva tipología para el

usuario digital. Retrieved from

http://ciiepatagones.com.ar/sitio/wp-

content/uploads/2013/02/Visitantes-y-

Residentes-una-nueva-

tipolog%C3%ADa-para-el-usuario-

digital-.-D.White_.-A.Le-Cornu.pdf

(accessed 28 February 2014)