From an EFL Milieu to Write in an ESL Context

253
2 nd International Conference on Foreign Language Learning and Teaching Conference Proceedings FLLT 2011 Organized by Language Institute, Thammasat University March 1112, 2011 The Ambassador Hotel, Bangkok, Thailand “Strengthening Ties between Research and Foreign Language Classroom Practices”

Transcript of From an EFL Milieu to Write in an ESL Context

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

2nd International Conference on Foreign Language Learning and Teaching 

Conference Proceedings

     FLLT 2011

Organized by Language Institute, Thammasat University 

March 11‐12, 2011The Ambassador Hotel, Bangkok, Thailand 

“Strengthening Ties between Research and 

Foreign Language Classroom Practices” 

Foreword Welcome to you all to the second international conference organized by the Language Institute of Thammasat University (LITU). The main objective of this biennial conference is to enhance the collaboration between language research and pedagogical approaches as explicitly spelled out in its theme of “Strengthening Ties between Research and Foreign Language Classroom Practices”. Marking one of the celebrations for LITU’s 25th Anniversary, this international conference is among the Institute’s prominent academic projects that accommodate the dissemination of relevant research studies in the contexts of language learning and teaching. FLLT 2011 will build on the success of the previous conference, which was held in 2009 in Bangkok, and will maintain the quality of the inaugural conference while incorporating new features to provide all participants with richer and more valuable experience. All presentations will address issues in a wide range of topics including language acquisition, linguistic analysis, and teaching methodologies. They will also cater to specific needs of language teachers and researchers in integrating theoretical concepts and empirical research findings in language acquisition and learning for application to actual educational practices. This conference offers an excellent opportunity for all the presenters and participants to meet with other language researchers and teachers from all over the world, share their respective research interests, and create a forum for networking, collaboration, the sharing of practical information, and the building of trust relationships. It should provide knowledge and insights into language awareness, language skill development, learning strategies, and motivation for language learning. The publication of FLLT 2011 Conference Proceedings marks the culmination of an arduous year long process involving conference planning, screening of presentation abstracts, the FLLT Conference itself in March 2011, and the preparation of the Conference Proceedings. The conference has attracted a great number of highly academic papers from presenters worldwide, and the selected papers, one of which is contributed by our conference plenary speaker, have finally been published in the proceedings. The published papers are of various interesting topics, including language pedagogy, language testing and assessment, linguistics, applied linguistics, etc. We would like to express our gratitude to the fine work of our contributing presenters upon which the accomplishment of the FLLT 2011 Conference Proceedings depends. We applaud their considerable effort and thank each author for regarding our publication as a venue for sharing their insights. FLLT 2011 Committee March 1, 2011

FFLLLLTT 22001111 PPrroocceeeeddiinnggss

TTaabbllee ooff CCoonntteennttss

Articles Page The Interface between Language Testing and Assessment and English Classroom Practices: What Research Says By Professor Achara Wongsothorn, Ph.D

1

A Study of Thai Students’ Motivation to Study English By Chutigarn Raktham

10

Applying Consciousness-Raising Method to a Writing Class By Patrisius Istiarto Djiwandono

17

Applying Reflective Teaching Theory to ESL Teaching By Chen Meihua & Zhu Shanhua

25

Challenges That Thai Teachers and Learners Face When Moving from L1 to L2 and How to Handle Them By Sukina Ar-lae & Cecilia M. Valdez

32

Content-Task Based Teaching in an English Science Course By Hamid Marashi & Ghazal Hatam

39

Cultivating Learner-centered Autonomy By Zhu Shanhua & Chen Meihua

46

Dyadic Interaction in Writing: On-line or Off-line Feedback? By Mehran Davaribina & Biook Behnam

53

Effective Approach to Macro Skills at the English Department By Max Renyaan & Ifan Iskandar

61

Effects of Peer-Tutoring on Students’ Foreign Language Classroom By Fasawang Pattanapichet

72

Enhancing EFL Students’ Intercultural and Critical Awareness By Amporn Sa-ngiamwibool

81

Foreign Teachers’ Foreigner Talk By Burcu Simsek Benderli

98

From an EFL Milieu to Write in an ESL Context By Parviz Ahmadi & Roselan bin Baki

106

Indirect Speech Act Comprehension in English as a Foreign Language By Boonjeera Chiravate

111

Articles Page

Language Learning Autonomy and Action Research

By MV. Joyce Merawati

120

Learning L2s among Southeast Asian Immigrant Women in Taiwan: The Case of

Chinese L2 Classroom Practices Contested by First L2 Effect

By Yu-Hsiu (Hugo) Lee

128

On the Effect of Background Knowledge on Reading Comprehension and Recall

Process of a Group of Iranian Intermediate Students

By Mahboobeh Khosrojerdi

136

Oral Performance: Effect of Comprehensible Input and Output

By Seyed Omid Tabatabaei & Parvin Musavian Hejazi

144

Power Relations in Pedagogy: A Constraint on EFL Speakers’ Identity

Confidence and Identity Anxiety

By Noparat Tananuraksakul

164

Questions: Interpersonal Interactive Feature in Science Lecture Discourse in L2

Setting

By Akhyar Rido

171

Relationship between Vocabulary Size and Reading Comprehension

By Preawpan Pringprom & Buppha Obchuae

182

Self Assessment of Essay Writing

By Asghar Kargar & Mortaza Yamini

192

Short-Term Training Model of Academic Writing to High School Teachers

By Rita Inderawati and Rita Hayati

206

Simplified Literature in Language Teacher Education

By Liesel Hermes

215

Test Taker Feedback on the Appropriateness of a Reading Test

By Sutilak Meeampol

222

The Effect of Text Familiarity on Summary Writing Skill By Abbas Pourhosein Gilakjani & Seyedeh Masoumeh Ahmadi

231

The Efficacy of Immediate and Delayed Corrective Feedback in the Correct Use of

English Definite and Indefinite Articles

By Afshin Soori & Arshad Abd. Samad

240

1

FLLT 2011 Proceedings

The Interface between Language Testing and Assessment and

English Classroom Practices: What Research Says

Professor Achara Wongsothorn, Ph.D

Chulalongkorn University Language Institute

[email protected]

Abstract This paper addresses classroom-centered research (CCR) in terms of its purposes,

methodology, and research outcomes focusing on usefulness and applications of outcomes.

Being goal-oriented, CCR interfaces with English language learning and teaching to fulfill the

learners‘, the teachers‘, and institutional demand for English excellence. Testing and

assessment are evaluative mechanisms that drive classroom implementation of materials and

methods including evaluative loops for goal fulfillment. Various CCR testing and assessment

projects here and abroad will be discussed and crystallized.

Introduction

The two strands of testing and evaluation within the classroom have always intertwine to

make learner evaluation complete ,i.e., learner variables consisting of typical performance and

maximal ability are tapped. Brown (1970) categorized learning assessment as typical if it

assesses such variables as motivation, personality, attitude, opinion, self-concept, anxiety,

pride, self-confidence, etc. and as maximal ability if it assesses such variables as English

language proficiency, achievement, and language aptitude. The former uses self-

manifestation method of assessment while the latter employs externally developed

instruments to assess learner cognitive domain benchmarking it against set criteria such as

pass-fail, low-achiever and high-achiever, and grades A, C, F.

The typical performance strand consists of assessment of such variables as self-assessment of

one‘s own language abilities and skills, self-report inventories of one‘s motivation, attitude,

opinion, levels of readiness, anxiety, teacher reflection (Ellis, l1977), learner reflection,

(Lightbown and Spada, 2001), student academic self-concept or learners‘ perceptions of his or

her academic abilities (House, 1992, Hamacheck, 1995), self-esteem (Loeb and Magee,

1993), etc. have been found to be impacting language learning achievement.

The maximal ability strand consists of assessment of language components: vocabulary,

sound, and grammar and assessment of language skills: listening, speaking, reading, writing

in both unitary and integrative modes. The common practice is to use both psychometrically

sound objective test items like multiple choice, true-false, matching, and sequencing and

required reliability confirmation subjective test items like short answers, paragraph and essay

writings, and real cloze. (Wongsothorn, 2003a).

The diagram below conceptualizes the system of practice in language teaching and learning,

which in turn guides the interface between language research assessment and language

classroom practice.

2

FLLT 2011 Proceedings

Diagram 1: The System of Practice in Language Teaching and Learning

From van Lier (1996:5)

The left-hand column of the 6 As principles consisting of awareness, autonomy, and

authenticity impinge upon the ―typical performance” variables with its psycholinguistic

underpinnings focusing on both the teacher and the learner variables intertwined to make

assessment and learning realistic, authentic, and exist within the realm of possible learner

linguistic development. Allwright (1984:9) commented that "it may be that interaction is

what somehow produces linguistic development", and that "success ……includes

….."customer satisfaction", when learners are confident, motivated, independent, and more

aware of the language-learning process and are satisfied with the tools they have to go on

with their learning.

The right-hand column of the 6 As principles consisting of assessment, achievement, and

accountability mean ―maximal ability‖ point to assessment of knowledge and skills in

language use for interaction, communication, inferencing, and evaluating through analyses

and syntheses. Language knowledge consists of forms and functions while language skills

consist of unitary and integrating skills of listening, speaking, reading, and writing.

Periodical formative assessment and evaluation when combined with summative assessment

and evaluation yield reliable grading, reporting, exiting, and remedial systems in a continuous

loop.

3

FLLT 2011 Proceedings

In terms of strategies, contingent interaction requires information or data from both sides to

enable teachers and administrators to plan adequate program for language learning success,

alongside with scaffolding, critical thinking, and learner training. Pinpointing on learner

readiness, self-concept, learning styles, learning strategies, modality preference, and

motivation a module can be built to alleviate learner lack, serve learner needs and wants, and

suit learner learning styles and strategies.

Regarding action, the activities are varied and planned to be well-rounded rendering reliability

and validity to the tasks, field work, portfolios, conversation, negotiation, stories, genre

variation, and team work, which are tools for assessment and evaluation of both aspects:

typical performance and maximal ability.

Thus this van Lier‘s model serves as framework for the discussion on the interface.

Trends in Language Assessment Research

To update needs for language testing research, the Millennium International Survey was

conducted using the Internet as the means of data collection by Wongsothorn in 2003,

(Wongsothorn, 2003b). To update these findings in 2009, another survey was conducted by

the same researcher on approximately 50 respondents belonging to various governmental and

private universities. Again the Internet was the research tool. The instrument for the survey

was a questionnaire consisting of 4 parts: Respondent Information, Directions in Language

Research, Thrusts of Language Testing and Evaluation Research, and Problems and

Concerns.

On the issue of the interface between language assessment and evaluation, the following areas

discovered to be of high relevance to language learning were:

Typical Performance Variables: teacher needs,; learning styles, strategies, learning

preferences, and readiness; test anxiety; self-concept; self-esteem; familiarity with ICT for

assessment purposes; self-assessment and self-evaluation; self-reflection by both the teacher

and the learner.

Maximal Ability Variables: Effectiveness of collaborative learning, usefulness of scaffolding

on language skills development, study skills, impact of backward design methodology on

language learning, interrelationships among grammar-syntax-lexis in the realm of pedagogy.

The Survey Research Findings Interfacing with Language Learning in the Classroom Context

Leo van Lier (2004) stresses the significance of meaningful context and activities in the

emergence of language abilities on the one hand; on the other hand the emergence of

grammaring through social interaction and quality dynamics of language interaction has been

found to be powerful in learner language emergence. In Leo van Lier‘s emergentist

perspective, grammar is not a prerequisite of communication, rather it is a byproduct of

communication (Hopper, 1998). Regularity and systematicity are ―produced by the partial

settling or sedimentation of frequently used forms into temporary subsystems‖ (Hopper, 1998:

158). Diane Larsen Freeman‘s Teaching Language from Grammar to Grammaring (2003)

views grammar as something which is organic and evolving. Then how are these emergents

from research related to classroom assessment and evaluation and learning?

4

FLLT 2011 Proceedings

Domain of Typical Performance and Maximal Ability

The role of self-assessment and self-evaluation emerge forcefully in CCR for action

outcomes. Diagram 2 taken from Roheiser & Ross presents the flow from self-evaluation to

self-confidence, a variable strongly and significantly related to motivation and learning

achievement (Ross & Rolheiser, 1998 b).

Diagram 2: The Flow from Self-Evaluation to Self-Confidence

From Rolheiser & Ross, Student self-evaluation: What research says and what practice shows

The model above has a loop starting from the combination of goals and effort to achievement,

self-evaluation, self-judgment, self-reaction, and self-confidence. It is clear that the model

demands learner training and self-training to acquire knowledge and skills of self-assessment

and evaluation, which form basis for achievement Ross & Rolheiser, 1998a, b).

Based on the model and the findings, learner perceptions and beliefs are crucial to designing

the content and method of learning. According to Williams & Burden, 1996: 205) beliefs

―or perceptions‖ (present author) are important factors in determining what students learn

and how they learn it (Williams & Burden 1996:205). Principles of authentic assessment

using self-assessment and peer –assessment gradually become integrated in the learning

process. Kohonen (1999) promotes learning through the process of on-going feedback on

learning in the form of ―learning conversation‖, in which students discuss their goals and

achievement (Harri-Augstein & Thomas, 1991). Self-assessment then intertwines with peer-

assessment and teacher feedback leading to final summative evaluation taking the form of oral

5

FLLT 2011 Proceedings

tests" and formal final paper and pencil examination with determined share towards the final

grade. Examination or assessment and evaluation results yield information for the students

rather than about them.

In the academic year 2009, the present author conducted a CCR on the relationships among

peer-assessment, self-assessment, and teacher assessment on a group of 10 participants who

were graduate students taking ―Consolidating Skills for Science Graduates‖ course at the

Chulalongkorn University Language Institute. The course members consisted of 5 males

and 5 females in the fields of civil engineering, electrical engineering, environmental

engineering, biology, and bio-chemistry. The objectives of the research were to find whether

students‘ academic self-perceptions of academic abilities would be related positively to

academic achievement as evaluated by peers and teacher in each student‘s individual oral

presentation of research project in each student‘s field of study. As the number was small,

Kendall‘s Tau and Spearman‘s Rho correlations for non-parametric statistics were used to

study the significance of relationships. The ratings by self- and peers were plotted and

compared in the initial stage, then with the teacher rating in the middle stage, then with the

summative final test scores in the final stage. The rating consisted of overall, system,

delivery, body language, and visual aids. The 3 scale rating scale: 0=not at all, 1=somewhat,

2=much, 3=very much was used. The student final test scores were also converted into a 3-

scale with 60-65 for 1, 66-75 for 2, and 76-85 for 3. The cutting point for pass-fail was at

60%. All students received the P rating.

Table 1: Plots of ratings by self-, peer, teacher, and final examination rating are presented in

the table below. The last column presents the degree of relationships among the category as

judged by the researcher: H for high relationship, M for medium relationship, and L for low

relationship

Student Teacher Self-

Rating

Peer-

rating

Final Relationship

K 3 3 3 3 H

N 2.5 2 2.5 2 M

C 3 2.5 3 3 H

Wach 2.7 2.5 2.5 2 H

Ch 2 2 2.5 2 H

D 2.5 2.5 2.5 2.5 H

P 3 3 3 3 H

S 2 2 2.5 2 H

T 2.5 2 2.5 2 H

Sa 2 2 2.5 2 H

Among the ten cases, the interrelationships were 90% high and only 10% medium.

The preliminary findings did not contradict the findings of Hamachek (1995) and House

(2000).

6

FLLT 2011 Proceedings

Table 2: Kendall’s Tau and Spearman’s Rho Correlations

Kendall‘s Tau and Spearman‘s Rho statistical analyses of relationships found significant

correlations among the four variables with two highest relationships between peer-rating and

final test score rating, and between self-rating and final score rating (Kendall‘s Tau=.882 and

Spearman‘s Rho=.913 for the first pair, and Kendall‘s Tau = .830 and Spearman‘s Rho=.866

for the second pair). The correlations between teacher rating and peer-rating were slightly

higher than those found between peer-rating and self-rating.

These findings showed that typical performance ratings and maximal ability tests were

significantly related. Assessment and evaluation using both methods are justified, reliable

and valid. In addition, the findings of this study did not contradict the those made by

Hamachek (1995) and House (2000).

Conclusion and Recommendation

From this simple preliminary investigation, it can be concluded that the interrelationships

were very high. This has paved the way for further investigation into the role and impact of

Correlations

1.000 .808** .764* .738* .056

. .006 .013 .013 .857

10 10 10 10 10

.808** 1.000 .745* .830** .299

.006 . .019 .007 .345

10 10 10 10 10

.764* .745* 1.000 .882** .218

.013 .019 . .006 .513

10 10 10 10 10

.738* .830** .882** 1.000 .257

.013 .007 .006 . .426

10 10 10 10 10

.056 .299 .218 .257 1.000

.857 .345 .513 .426 .

10 10 10 10 10

1.000 .868** .828** .807** .060

. .001 .003 .005 .869

10 10 10 10 10

.868** 1.000 .784** .866** .315

.001 . .007 .001 .375

10 10 10 10 10

.828** .784** 1.000 .913** .218

.003 .007 . .000 .545

10 10 10 10 10

.807** .866** .913** 1.000 .266

.005 .001 .000 . .458

10 10 10 10 10

.060 .315 .218 .266 1.000

.869 .375 .545 .458 .

10 10 10 10 10

Correlation Coefficient

Sig. (2-tailed)

N

Correlation Coefficient

Sig. (2-tailed)

N

Correlation Coefficient

Sig. (2-tailed)

N

Correlation Coefficient

Sig. (2-tailed)

N

Correlation Coefficient

Sig. (2-tailed)

N

Correlation Coefficient

Sig. (2-tailed)

N

Correlation Coefficient

Sig. (2-tailed)

N

Correlation Coefficient

Sig. (2-tailed)

N

Correlation Coefficient

Sig. (2-tailed)

N

Correlation Coefficient

Sig. (2-tailed)

N

TEACHER

SELFRATI

PEERRATE

FINAL

RELATION

TEACHER

SELFRATI

PEERRATE

FINAL

RELATION

Kendall's tau_b

Spearman's rho

TEACHER SELFRATI PEERRATE FINAL RELATION

Correlation is significant at the 0.01 level (2-tailed).**.

Correlation is significant at the 0.05 level (2-tailed).*.

7

FLLT 2011 Proceedings

self-assessment, peer-assessment and teacher ratings which are typical performance

assessment with the final test scores which are maximal ability assessment. This

recommendation also reflects the recommendation given by the present researcher in her

paper presented at CULI‘s National Conference in 2007 that ―The teacher and peers‘ ratings

have very frequent significant relationships implying that peers are reliable raters. Peers

should be involved in assessing one another‘s language use‖.

To implement the products of CCR for language learning, whatever action and activities to

be taken by the teacher and the learner as deemed suitable should be varied and planned

rendering reliability and face as well as content and construct validity to the tasks assigned for

formative evaluation such as field work, portfolios, self-assessment, peer assessment, and

team work, using the typical performance and maximal ability tools, and last but not least to

the summative assessment which may be mainly evaluated by maximal ability assessment

tools such as psychometrically sound objective tests and production tests for writing and oral

assessment including conversation, negotiation, stories, and genre variation. Below is a

diagram presenting the goal-oriented applications of CCR outcomes.

Diagram 3: Goal-oriented Evaluative Mechanisms Interfacing with Language Learning and

Teaching

A further study is needed to research using triangulated qualitative-quantitative instruments

(Lynch 1996:10) to find out the interface between classroom assessment research and learning

achievement through the mixed-method research model.

References

Allwright, R. L. (1984). The importance of interaction in Classroom Language

Learning. Applied Linguistics, 5/2, 156-171

Self-Realization, Self-Confidence, and Achievement

Maximal Ability Evaluative Mechanisms

Typical Performance Evaluative Mechanisms

Materials, Methods, Demands of Learners and

Relevant Stakeholders including Institution Demand

8

FLLT 2011 Proceedings

Brown, F.D. (1970). Principles of Educational and Psychological Testing. Hinsdale, IL:

Dryden Press.

Candlin, C. and N. Mercer. (Eds.) ( 2001). English Language Teaching in its Social

Context: A Reader. London and New York: Routeledge in Association with

Macquarie University and the Open University.

Dianne Larsen-Freeman (2003). Teaching Language: From Grammar to Grammaring.

Boston, MA.: Heinle/Cengage

Ellis, R. (1977) Second language acquisition research and language pedagogy‘ in S L A

Research and Language Teaching. London: Oxford University Press.

Hamachek, D. (1995). Self-concept and school achievement: Interaction dynamics and a tool

for assessing the self-concept component. Journal of Counseling & Development,

73(4), 419-425.

Harri-Augstein, S. & Thomas, L. (1991). Learning Conversations: The Self-Organised

Learning Way to Personal and Organisational Growth. London: Routledge. 1991)

Hopper, P. J. (1992). Grammaticalization. In Bright, W. (1992: 79–81). International

encyclopedia of linguistics. Oxford: Oxford University.

House, J.D. (2000). The Effect of Student Involvement on the Development of Academic

Self-Concept. Journal of Social Psychology, Vol. 140, No. 2/April 2000.

Kendall, M. (1938). "A New Measure of Rank correlation". Biometrika 30 (1-2): 81–

89. doi:10.1093/biomet/30.1-2.81. JSTOR 2332226

Kohonen, V. (1999). Authentic assessment in affective foreign language education. In J.

Arnold (Ed.). Affect in Language Learning. Cambridge: Cambridge University Press.

279-294.

Lightbown, P. M. & Spada, N. (2006). How Languages Are Learned. Oxford Handbooks

for Language Teachers (3rd

. ed.). Oxford: OUP.

Lynch , B.K. (1996).. Language Program Evaluation: Theory and Practice. Cambridge:

Cambridge University Press.

Loeb, R. C., & Magee, P. M. (1992). Changes in attitudes and self-perceptions during the

first two years of college. Journal of College Student Development, 33, 348-355.

Nicholas, H; Lightbown, P.M.; & Spada, N. (2001). Forecasts as feedback to language

learners. Language Learning. Volume 51, Issue 4, pages 719–758, December 2001.

Pajares, F. (1996). Self-efficacy beliefs in academic settings. Review of Educational

Research, 66(4), 543-578.

9

FLLT 2011 Proceedings

Rolheiser, C. & Ross, J.A. Center for Development and Learning, from website: STUDENT

SELF-EVALUATION WHAT RESEARCH SAYS AND WHAT PRACTICE

SHOWS.htm Retrieved on 27 March 2011.

Ross, J. A., Rolheiser, C., & Hogaboam-Gray. (1998a). ―Skills training versus action

research inservice: Impact on student attitudes on self-evaluation‖. Teaching and

Teacher Education, 14(5), 463-477.

Ross, J.A., Rolheiser, C., & Hogaboam-Gray. (1998b, April). Effects of self-evaluation and

training on narrative writing. Paper presented at the Annual Meeting of CSSE,

Ottawa.

Spearman, C. The proof and measurement of association between two things. Amer. J.

Psychol. , 15 (1904) pp. 72–101. In L. E. Moses, Non-parametric statistics for

psychological research. Psychological Bulletin Volume 49, Issue 2, March 1952,

Pages 122-143

van Lier, L. (1988). The Classroom and the Language Learner. Ethnography and Second-

Language Classroom Research. Harlow: Longman.

van Lier, L. (1996). Interaction in the Language Curriculum: Awareness, Autonomy, and

Authenticity. London: Longman.

Williams, M. & Burden, R.L. (1997). Psychology for Language Teachers: A Social

Constructivist Approach. Cambridge: Cambridge University Press.

http://pioneer.netserv.chula.ac.th/~wachara1/

Wongsothorn, A. (2003a). Development of Amplified-Objective Tests: Measuring Maximal

Ability and Typical Performance. Bangkok: Chulalongkorn University Press.

Wongsothorn, A. (2003b). A Survey of Needs for Language Testing: From National to

Regional and International Perspectives-Towards the New Millennium: Trends and

Techniques. In Language Education in East Asia Today: Policies, Developments and

Practices, A Report from the Symposium held as part of the AILA 2002. Singapore:

Singapore Association for Applied Linguistics: 105-122.

Wongsothorn, A. (2007). Peer Assessment and Teacher Assessment of Academic Oral

Presentations. Paper presented at CULI‘s National Seminar 2007: Diversity in the

EFL Classroom, on 26 November 2007, Sasa Patasala, Bangkok.

About the Author

Achara Wongsothorn is a professor of English language, specializing in testing, measurement,

and evaluation. Her research covers assessment of writing, levels of Thai students‘ English

proficiency, and learner variables affecting English learning. She served as Director of

Chulalongkorn University Language Institute and the English Language Development Centre

of the Ministry of Education. Now she is academic board member of Chulabhorn Graduate

Institute and Dhonburi Rachabhat University and is on the editorial board of journals

published by graduate schools of several governmental universities.

10

FLLT 2011 Proceedings

A Study of Thai Students’ Motivation to Study English

Chutigarn Raktham

Lampang Rajabhat University

[email protected]

Abstract

With respect to students‘ motivation, it is clear that the social milieu of the classroom is

central to the issue of students‘ motivation. Motivation to learn is thus not only viewed as a

characteristic of the individual, but also of the individual-in-action within a specific context

which mediates individuals‘ full participation in class practices which they encounter. The

purpose of this research is thus to identify factors that affect student‘s motivation to study

English in terms of individual and social motivation. The research utilized observation to

describe and characterize the learning context that students were exposed to and then to

structure interviews with the informants, who were all English majors in a provincial Thai

university. The research results emphasize the dynamics of motivation in which students‘

personal and social motivation fluctuated in line with the social context and social interactions

they encountered.

1. Introduction

Corder‘s (1967) phrase ‗Given motivation, anyone can learn a language‘ shows the

importance of motivation and its potential to overcome unfavourable circumstances and

unexpected obstacles. In general terms, motivation refers to the effort which learners put into

learning a second language as a result of their need or desire to learn it. The purpose of this

study is thus - within Dörnyei‘s framework - to identify factors that affect student‘s individual

and social motivation to study English. The study aims to highlight a dynamic view of

motivation since students‘ motivation fluctuates during their course of study. This is caused

by different factors at different levels of L2 motivation. The educational implications of this

study are to encourage teachers‘ responsiveness and understanding of students‘ motivation

and to help teachers enhance students‘ motivation, to help students with motivational

difficulties and to prevent students from being demotivated in the classroom.

2. Literature review

Overview of L2 motivation research

L2 motivation was initiated in Canada where the coexistence of English and French led to the

emergence of the social psychological approach in motivation studies so it is not surprising

that a research on L2 motivation in the 1960s was influenced by social psychological

approaches, notably from Gardner‘s motivation theory and the concept of integrativeness.

This theory stated that there are two main determinants of motivation: integrative and

instrumental orientations. The former refers to learners‘ positive interpersonal and affective

disposition toward the target language community and the desire to interact with members of

that community. The latter refers to the advantages of learning a new language such as

passing exams or financial rewards. Learners can have both integrative and instrumental

orientations, but it was originally found that an integrative orientation was a more powerful

predictor of achievement in formal learning situations. (Gardner & Lambert, 1972) However,

many interpreted Gardner and Lambert‘s work as confined to the unique context of Canada.

11

FLLT 2011 Proceedings

It may be that while the integrative orientation is perhaps more important learning French in

Canada, the instrumental orientation is more important in a foreign context, such as Thailand.

Dörnyei (1990) claims that foreign language learners rarely have sufficient experience with

the target language community to have clearly articulated attitudes towards that community,

and they are therefore uncommitted to integrating with that group. He concludes that

instrumental goals thus contribute significantly to motivation.

Following the work in Canada, more motivation research was conducted under the influence

of cognitive psychological approaches, which focus on how the individual‘s conscious

attitudes, thoughts, beliefs, and interpretation of events influence behaviour. According to

Dörnyei (2001a), ―the individual is a purposeful, goal-directed actor, who is in constantly

balancing mental acts to co-ordinate a range of desires and goals in the light of possibilities,

that is perceived competence and environmental support‖ (p. 8). Thus, from a cognitive

perspective, motivation is concerned with such ideas as why people decide to act in certain

ways; what factors influence the choices they make, how much effort they are prepared to

expend in achieving their goals and so on.

The influence of this cognitive approach led to the development of several cognitive

motivation theories including self-determination theory, attribution theory and goal theories.

As a result of the impact of social psychological and cognitive approaches, there is a

considerable body of literature on motivation in language learning. However, most research

on language learning motivation tends to emphasise the individual psychological level using

integrative and instrumental aspects to explain learners‘ attitudes. Although a learner‘s

conception is individualistic, it is heavily influenced by social and contextual influences since

humans are social beings and human action is always embedded in sociocultural

environments. These will include the whole culture and context and the social situation, as

well as significant other people and the individual‘s interaction with these people. (Williams

& Burden, 1997) As a result, some researchers have proposed several extended new L2

motivation constructs.

Dörnyei’s framework of motivation

As a response to a shift in motivation research in the 1990s, Dörnyei (1994) developed a

framework for L2 motivation which incorporated three levels: language, learner and the

learning situation level.

The merit of Dörnyei‘s framework is that it encompassed the social dimensions, the personal

dimension and the educational subject matter dimension. (Dörnyei 1994). At the most general

level (language level), the researcher can gain insights into students‘ general motives, which

determine their basic learning goals. While the language level acts as an ice-breaking process

where the teacher/researcher can get to know the students, the learner level allows the

teachers to understand the personality traits that underline students‘ motivational processes.

The learning situation level offers a complete picture of how students interact with their

learning environment and whether the social interactions within the learning-specific

motivational components have altered their L2 motivation. Dörnyei‘s attempt to bridge the

gap between the traditional motivational research resulted in a framework that is more

pragmatic, educational-centred and process-oriented.

12

FLLT 2011 Proceedings

3. Research methodology

The researcher decided to use a qualitative approach to focus on students‘ opinions and

interpretations of their L2 studies through classroom observations and in-depth interviews.

The aim was to find the internal and external factors, linkages and causal relationship of

different factors within a particular context and whether these findings could be explained or

relevant to any preconceived research hypotheses. Hence, Dörnyei‘s motivation model was

used as a framework.

The classroom observation was conducted over one month in order to see what students did in

class and identify patterns of behaviors that emerged from classroom interactions. These data

were then used to form interview questions. The interviews were semi-structured; a list of

questions and topics was prepared but students were allowed to stray onto related areas.

The interview questions consisted of seven questions concerning (1) students‘ reasons for

choosing English as their major; (2) their expectations of their four-year education at the

University; (3) the differences between studying at high-school and at university; (4) their

views on the characteristics of good/bad students, (5) the characteristics of good/ bad teachers,

(6) their views on class size and physical management and (7) their explanations of classroom

behaviour.

Informants

The informants for this study were a class of 40 (34 female and 6 male) second year English

majors at Lampang Rajabhat University. All students were asked to volunteer for the

interview process; 14 did, (11 female and 3 male). The students chose with whom to be

interviewed.

Data analysis

To allow the data to generate its own theses, a textual database (transcripts of interviews or

field notes of observations) was created and interrogated constantly until the data were

extensively coded. To code all the interview scripts, two techniques were employed. The first

involved manually cutting, pasting and re-arranging the data to develop the categories, the

second involved the use of NVivo 7 software to refine the coding processes. By looking at the

data from the interview as a whole, the researcher was able to compare responses, referring

separate sections back to refine the categories. Once the categories were thoroughly checked,

NVivo was used to code the word-processed documents according to the manually formed

categories. Within NVivo, tree nodes and sub-nodes were created to reflect the coding

categories created earlier. (NVivo allows categories and coded texts to be held in a treelike

structure, reflecting the hierarchical structure of the categories; NVivo‘s tree nodes and sub-

nodes are a way of formalising this.) This procedure resulted in a complete set of categories

4. Research findings

Dörnyei (2001b) reason for separating the L2 framework into three levels is that each of the

three levels seems to exert its influence differently and any changes in the parameters at one

level might affect overall motivation. Within the scope of this paper, the research findings

will be presented at different levels following Dörnyei‘s framework.

13

FLLT 2011 Proceedings

Language level

More than half of the students reported choosing English because they liked it or were

interested in the subject. However, their preference for English was not only the result of an

intrinsic interest. In fact, students‘ past learning experience, the influence of their families and

friends and their potential future careers were significant factors. Most students had

favourable beliefs about their English ability as opposed to their ability in other subjects.

Seven students whose major was English in high schools said that they chose English as their

major because they got better grades in. Another important factor was the influence of

families and peers. While family influence manifested itself as comparisons with other

relatives and comparing the cost and the location of the university, friends‘ influences came in

the form of desire to be with people from the same group or familiar faces. Future job

prospects were another factor that was evident in almost all students‘ answers. All students

said that English was necessary for employment after graduation and that a sufficiently good

standard of English was their main expectation of their studies. Belief in the importance of

English came from the status of English as an international language, the number of foreign

tourists in Thailand and the invasion of their everyday life by English.

Students‘ responses revealed that their interest in English as a means to achieve their future

career goals was stronger than their desire to learn English to experience pleasure or

satisfaction; none of them mentioned any desire or wish to visit or to live in an English-

speaking country or to have friends from other countries. At the language level, aspects of L2

such as culture and the community did not exert an influence on students‘ decision to learn a

second language. In fact, significant others and instrumental benefits accounted entirely for

students‘ study decisions.

Learner level

Students‘ evaluations of their ability can indicate the level of motivation they will invest in

their learning and the research subjects had evaluated their own ability prior to their

commencement at university and had certain beliefs about their academic ability as well as

expectations about their study before they began at the tertiary level. The fact that most

students decided to choose English because they were not good at, for example, Mathematics

or because they got a good grade in English in high school, showed that students initially

judged their abilities by reference to their previous performance and predicted their tendency

to achieve success. Relevant to these perceptions is attribution theory and self-efficacy theory,

commonly referred to in the field of motivational psychology. (Bandura 1977, Dörnyei 1994,

Weiner 1994, and Wentzel & Wigfield, 1998). Bandura (1986) proposed that students‘

efficacy (expectations that they can accomplish a given task) is a major determinant of effort

and persistence. After eighteen months of study, all the students reported that their belief in

their ability had lowered as a result of encountering negative learning experiences, such as the

degree of difficulty of the subject, lack of achievement, and language problems to name just a

few.

Learning situation level

In terms of course-specific motivational components, students‘ perceptions of each subject

could either be an inhibiting or a contributing factor to their determination to learn. The

determination or motivation felt toward each subject depended very much on its relevance to

future career prospects, the perceived difficulty of the subject, the balance between theory and

practice, the teaching materials and the novelty of the subject. The value attainment that

students had toward each subject can be used as an indicator of their willingness and

14

FLLT 2011 Proceedings

determination to learn. Because students‘ main aim was to get a job that allows them to use

English after they graduate, students valued the subject extrinsically so students had a

tendency to invest their time and effort in subjects or topics that they found relevant to their

future career. As a result, the skill subjects, such as Listening and Speaking III and Writing I

were reported as useful, interesting and relevant. In contrast, students expressed doubts about

or boredom with content subjects (Introduction to Linguistics and English Literature), which

did not allow them to practice their desired skills. This career-orientation led to an

engagement with study in order to pass exams rather than to explore English. Following on

from this highly instrumental involvement, it is reasonable to assume that motivation is likely

to be short-lived and will be exhausted once extrinsic goals have been met.

How students interacted with teachers was a consequence of their evaluation of two factors:

the teacher‘s teaching ability and the teacher‘s personal relationship with students. With

reference to the former, students expected teachers to know what to teach and how to teach.

Teachers should be knowledgeable, well-prepared, give clear instructions and/or objectives of

the study so that students understand or can anticipate what they are going to learn. Good

teachers should know the students‘ abilities and give lessons that are suitable for the students‘

level.

In terms of the teacher‘s personal relationship with students, teachers were described

variously as ‗boring‘, ‗kind‘, ‗strict‘, or ‗cruel‘. Students expressed their fear of teachers who

were ‗serious‘, ‗strict‘, ‗unfriendly‘ and ‗authoritative‘ and would be reserved and well-

behaved in front of these teachers. Students reported that teachers‘ facial expressions affected

their motivation to learn. If teachers had a serious, solemn expression, students were likely to

feel anxious, which negatively affected their class participation. In contrast, if the teacher has

a pleasant personality, students felt relaxed and comfortable, which helped students to be

more involved in the classroom. Some students said that they act in class to please their

teachers and students‘ accounts showed that the intimacy between teachers and students can

have a considerable effect on student motivation.

The importance of friendship was also apparent in students‘ accounts. In this class, students

divided themselves into different groups, each with its own norms and values. Because of

students‘ concerns over the status of friendships, students‘ behaviour developed out of a fear

of peer rejection and the desire for peer acceptance. Students showed their allegiance to the

group through physical proximity, social contact, and the quantity and quality of interaction

with one another. Students were well aware what kind of behaviour would be accepted or

rejected within their own group and as a result, students would avoid any behaviour that did

not conform to the group norm. When the group norm was inclined towards studying, this

helped with students‘ motivation to study and the reverse was also true.

While students felt that the cohesiveness of their own group was high, the cohesiveness of the

class as a whole was relatively low. Students felt that because of the lack of intimacy between

the groups, students were very conscious of their self-image when dealing with members of

other groups and reported a reluctance to ask questions or assert ideas in class discussion as

they feared that they might be ridiculed or laughed at. Students, however, did not feel that

they had to work so hard to maintain their self-image within their group, although one cannot

be certain that having a positive relationship with friends would lead to academic success. In

fact, the level of peer acceptance and group norms are significant determinants in students‘

behaviour. While approval from the peer group is related to students‘ sense of self-esteem and

15

FLLT 2011 Proceedings

self-image, group norms for conduct are related to pro- or anti-social behaviours in class.

Furthermore, the lack of cohesiveness between the whole class and the lack of peer sanction

and intervention could lead to misbehaviour.

5. Conclusion

According to Oldfather (1994.), gaining some access to students‘ subjective perspectives is an

essential aspect of efforts to understand the cognitive mediation involved in students‘

motivational process. The research findings reflected the centrality of the individual‘s

perceptions in motivational constructs and so students‘ judgements of their own abilities and

their past learning experience could be related to self-efficacy beliefs and attribution theory;

students‘ ambitions to have careers in the tourism industry or to achieve good grades revealed

their extrinsic motivation; students‘ willingness to please the teachers or to follow the group

norm showed the importance of significant others and social context. Students‘ accounts also

showed the ongoing changes in motivation over time as students moved from the first year to

second year and experienced more learning obstacles, as well as other distracting influences,

such as peer pressure and conflict with teachers. These insights into different motivation

perspectives might allow teachers and researchers to understand different motivational

factors, both internal and external, which could be extremely useful for both teachers and

researchers in improving their teaching or studying L2 motivation. References

Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change.

Psychological Review, 84, 191–215.

Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory.

Englewood Cliffs, NJ: Prentice-Hall.

Corder, S. P. (1967). The significance of learners' errors. International Review of Applied

Linguistics, 5, 160-170.

Dörnyei, Z. (1990). Conceptualizing motivation in foreign language learning. Language

Learning, 40, 46-78.

Dörnyei, Z. (1994). Motivation and motivating in the foreign language classroom. Modern

Language Journal, 78, 273-284.

Dörnyei, Z. (2001a). Motivational strategies in the language classroom. Cambridge:

Cambridge University Press.

Dörnyei, Z. (2001b). Teaching and researching motivation. Harlow: Longman.

Gardner, R.C., & Lambert,W.E. (1972). Attitudes and motivation in second language

learning. Rowley: Newbury House.

Oldfather, P. (1994). When students do not feel motivated for literacy learning: How a

responsive classroom culture helps. Retrieved from

http://curry.edschool.virginia.edu/go/clic/nrrc/rspon_r8.html

16

FLLT 2011 Proceedings

Weiner, B. (1994). Integrating social and personal theories of achievement motivation.

Review of Educational Research, 64, 557-573.

Wentzel, K.R., & Wigfield, A. (1998). Academic and social motivational influences on

students‘ academic performance. Educational Psychology Review, 10, 155-175.

William, M., & Burden, R. (1997). Psychology for language teachers. Cambridge: Cambridge

University Press.

About the Author

After graduating with a BA in English Language from Thammasat University, I completed

my Masters and EdD (both in ELT and Applied Linguistics) at Warwick University and have

taught English for twelve years at Lampang Rajabhat University. Being at a university where

students‘ use of language is limited to the classroom, my main interest is in the area of learner

motivation in order to find ways to stimulate students and to encourage them in their studies.

My research has mainly been conducted using students at the university as research subjects

because I believe that my time is best spent improving my classroom practice and our

institutional knowledge of the effectiveness of our teaching, rather than engaging in research

aimed principally at publication.

17

FLLT 2011 Proceedings

Applying Consciousness-Raising Method to a Writing Class

Patrisius Istiarto Djiwandono

Universitas Ma Chung, Malang, Indonesia

[email protected]

Abstract

Consciousness-Raising (C-R) has been around for some years, and while studies on the

effectiveness of C-R has mainly focused on the learning of grammatical features, more attention

needs to be paid to the mastery of other language areas. The present study is a small-scale

research that explores the impact of Consciousness-Raising (C-R) technique on the learning of

some elements of written business communication. Several intermediate EFL learners were

exposed to models of good business letters and instructed to notice three elements, namely the

rhetorical moves, the grammatical patterns, and the expressions. Afterwards, they were assigned

to write letters on their own. Their mistakes were counted and analyzed for the kinds of mistakes

in each of the elements above. The result shows that they did very well in arranging the ideas in

correct rhetorical moves but made much more mistakes on grammatical features and

appropriateness of expressions. The explanation offered to account for this finding concerns the

learners‘ allocation of cognitive capacity to different demands of task complexity. The more

complex the task, such as writing in correct grammar or writing appropriate expressions, the less

they devote their attention and effort to language formal features. A suggestion concerning

focus-on-form activities is then offered to teachers.

Background

Consciousness raising has been proposed as a method that aims to improve learners‘ language

proficiency by making them aware of the important features of an authentic discourse.

Rutherford (1987:19) maintains that consciousness-raising provides ―data that are crucial to the

learners‘ testing of hypothesis, and for forming generalizations‖. The method draws their

attention to the language features, make them notice the features, use them to restructure their

interlanguage system, and subsequently use these attended features to produce a stretch of

discourse on their own.

Rutherford (1987) also proposes the notion of grammaticization, a process by which a learner‘s

interlanguage is becoming a closer approximation of the grammatical system of the target

language. Grammaticization is manifest in the learner‘s increasing ability to (1) grammaticize

topic-comment into subject-predicate, (2) to utilize grammatical devices to express relations

between form and meaning, (3) produce more verbs with more arguments and produce verbal

noun, and (4) to produce more subordination than coordination. Implied here is that

consciousness-raising is mainly concerned with the syntactic aspects of the target language.

A question that the writer has been pondering upon is whether the same principle of

consciousness-raising is also applicable to other linguistic areas. A special area that is the focus

of this paper is the mastery of rhetorical moves and expressions that are typical of a particular

context, namely, business correspondence.

18

FLLT 2011 Proceedings

A substantive amount of literature has supported this notion, all converging on the idea that

consciousness-raising is an effective method for language teaching. However, whether the

method works effectively as it is often claimed has yet to be seen in a context of teaching

writing. The paper draws on a small-scale exploratory research on the effect of consciousness-

raising on the writing ability of some Indonesian EFL learners at Ma Chung University. A group

of 18 juniors were exposed to models of business letters, and were instructed to notice the

linguistic features that included the rhetorical moves, the tenses, and the formal expressions of

the letters. The tasks that followed mainly served to intensify their attention on those features.

Then, they were instructed to draft letters of the same topics. The drafts were analyzed for its

rhetorical organization, tenses and sentence patterns, and the appropriateness of the expressions

used. The mistakes were classified into local mistakes that did not severely affect comprehension

and global mistakes that impaired comprehension.

Language Teaching Methods

Language teaching methodology is rich with a variety of techniques for making the learners learn

linguistic elements. What is traditionally called PPP (Present – Practice – Produce) has been

refined, modified and even replaced with newer techniques along with the greater awareness of

the learning mechanism inside the learners‘ mind. Mc Carthy and Carter (1995) proposes III

(Illustration – Interaction – Induction). The technique starts with Illustration which provides the

learners with real actual instances of language use in certain contexts, followed by Interaction

which engages the learners in consciousness-raising activity where they notice how language is

used for interpersonal purposes and for meaning negotiation, and finally concludes with

Induction where the learners are prompted to notice how lexico-grammatical features fulfill

various functions.

Sa-ngiamwibool (2007) conducted a study on the impact of Consciousness-Raising (C-R)

activity on the accuracy of structure and written expression of TOEFL, and came to the

conclusion that C-R activity positively influenced the subjects‘ accuracy of the patterns and

expressions.

The Treatment

The small-scale exploratory research involved 11 students of English Department at Ma Chung

University who were taking Business Correspondence course from the writer and estimated to be

at the intermediate level of English proficiency. At the outset of the course, they were instructed

to read models of enquiry letters, and to notice the following elements in the models: the (1)

rhetorical moves, or parts of the letter; (2) the grammatical patterns used; (3) the expressions for

instructing the addressee; (4) the expressions used to close the letter. They were instructed to put

the results of their observation into a table. After 10 to 15 minutes of observation and noticing,

the students filled in the tables and matched their results with the lecturer‘s version, which is as

follows:

19

FLLT 2011 Proceedings

Table 1. Features of the Letters to be Noticed

Move/parts of the letter Tenses used Expressions

for

instructing

addressee

Expressions

for closing

the letter

Enquiry (1) Informing how they obtained

the addressee‘s

name/company

(2) Expressing interests in buying

or doing business

(3) Instructing the addressee to

send a sample/specimen/

brochures

(4) Closing the letter

Past simple

Present

simple

Modal

auxiliaries +

infinitive

Present

simple/present

progressive

Would you

please +

[infinitive];

We would

appreciate it if

you could +

[infinitive]

We are

looking

forward to

hearing from

you;

We look

forward to

hearing from

you

After a discussion on the table contents, the students were then assigned to close their textbooks

and start writing enquiries on their own based on a problem from the lecturer. They were

specifically told to recall the models of the letters they had just observed and noticed to

accomplish this task. They spent around 35 minutes to finish writing the letters.

The Finding

The results are displayed on the following table that contains the tabulation of mistakes and

accuracy they made.

20

FLLT 2011 Proceedings

Grammar Grammar Expression

Rhetorical Moves:

Enquiry Global Local

Students Omission Addition Wrong form Omission Wrong form Punctuation

Fitri 0

0

1 2

Mega 0

0

2 2

Dian 0

0

1

Grace 0

0

1 1 2

Nadia 0

0

1 1 1

Bio 0

0

4 1 1

Nadariansyah 0

0

1 1

Shavitri 0

0

1

Sano 0

0

1 1

Andre 0

0

2 1

Vania 0

0

3

TOTAL 0 0 1 1 0 12 8 3

0

0 9

FLLT 2011 Proceedings

20

21

FLLT 2011 Proceedings

The results indicate that all of the students were successful in composing letters of enquiry

with the right rhetorical moves. Their letters start with opening, informing the addressees

where they obtained their names, expressing interest in doing business, instructing the

addressees to send a sample, and the closing. Apparently, the rhetorical moves are the easiest

element that these students notice from the models in the textbooks. Quite possibly, this

might be due to the absence of complex details that are involved in remembering such order

of moves. All that is required from the learners are noticing the moves, storing them in their

short-term memory, and retrieving them when composing letters on their own. Remembering

the order of moves demands little from their cognitive capacity.

The results also shows that the learners‘ performance in producing correct expressions for the

moves is somewhat poorer than their abilities to produce the correct order of moves. Again,

this may have been attributable to the presence of linguistic details and the concomitant

language rules that are required in producing the expressions. Many of the business

expressions are less straightforward and less frequent than those of daily colloquial language

that speakers use in casual conversations. The word ―would like to‖ is more preferable than a

simple, more frequent ‖want‖; the phrase ―we appreciate it if you could . . .‖ is obviously

longer, more complex and less frequent than the common ―we are very happy if you . . .‖ or

even ―please . . .‖. The longer the expressions to use, the more elements they contain, which

in turn requires certain syntactic rules to be applied. The result is a complexity that tax the

learners‘ cognitive capacity. In other words, the task of producing correct expressions is a

cognitively demanding activity for the students.

Discussion

Van Patten (cited in Robinson, 2001:189) has shown that when learners pay more attention to

language forms, their attention to language content declines. But, when they are given

freedom to decide which one to focus on, they will likely attend to content rather than to

forms. From this perspective, it is obvious why the learners fare better in producing the

correct order of the moves than in producing appropriate individual expressions. The former

requires them to attend to simple content, while the latter requires them to attend not only

content but also the accurate language forms.

This explanation of the possible cause finds support in Robinson (2001:195), who maintains

that ―task which require more advanced structures, or which require the use of wider

repertoires of structures, or greater densities of advanced structures, such as complex tenses

or subordination or embeddings, are more likely to be more complex‖. Following this, he also

contends that besides the language (code) complexity above, the cognitive familiarity with

the genre of a discourse also determines how complex a learner perceives a task. This kind of

familiarity can be very well enhanced by careful reading and understanding of the genre,

which does not require careful attention to linguistic rules. If the learners perceive the code

complexity to be more demanding than cognitive familiarity, it is only logical that they will

allocate more effort and attention to the latter when producing a text themselves, resulting in

a text that is organized according to the genre they have noticed but which contains

significant linguistic mistakes. This is in line with Skehan‘s argument that (1998) poor

attention to forms are reflected in inaccurate or simple language, a phenomenon that is

evident in the letters written by the subjects of this current study.

22

FLLT 2011 Proceedings

It is interesting to note that when confronted with a demanding task, learners simply resort to

these strategies (Robinson, 2001:197): (1) slow down, (2) forget accuracy, (3) be simple. This

seems to the most plausible explanation for the results of the study described above.

The Follow-Up

The result described above hints at the necessity of repeating the same procedure with an

additional effort to focus the learners‘ attention to the forms and expressions that they still

often mistake. Thus, another C-R session was done with the focus on letters of complaints.

Again, the learners were instructed to read the model letters and notice the moves of

complaining, the grammatical patterns, and the expressions. The lecturer informed them that

their grammatical accuracy and formality of expressions were still poor in the previous

assignment, and stressed the need to notice these elements more. Then, they were told to

close the models and started writing a letter of complaints on their own. A brief reminder

was given concerning the need to focus more on their accuracy and appropriateness of

expressions. The following table shows the mistakes they made in their letters:

23

FLLT 2011 Proceedings

Grammar

Rhetorical Moves:

Complaint Global Local

Incorrect

exp.

Student Addition

Wrong

form Omission Wrong form Punctuation

Fitri 0 2 2

Mega 1 2

Dian 0 2 1

Grace 0 2 2

Nadia 0

Bio 0 1 1 1 1

Shavitri 0

Andre 0 1 2

Vania 0 1 3

TOTAL 1 0 2 4 10 1 0 0 7

It is apparent that there is a slight improvement from the previous results. The accuracy of the moves remains the same, while the number of

mistakes of global, local grammatical errors and expressions drops slightly. Admittedly, a fair comparison cannot be drawn here since the tasks

involved two different letter functions and the treatment was not rigorously arranged to allow for internal validity. However, from the

perspective of a small-scale classroom research, the results have probably suggested a few points worth considering. First, the effectiveness of

C-R technique may have been evident in a limited area. Those skill areas which are not internally complex may be much more amenable to C-R

than those areas which demand attention to detailed restrictions and rules. Second, given the notion of selective attention discussed above, it is

necessary that a C-R approach be complemented with a focus on form techniques that make the learner work more intensively on more complex

language elements like grammatical patterns and formality of expressions.

FLLT 2011 Proceedings

23

24

FLLT 2011 Proceedings

Conclusion

The paper is based on a small-scale study on the effect of consciousness-raising on the

abilities to produce business letters with the right rhetorical organization, accurate grammar,

and appropriate expressions. A group of learners were instructed to notice those three features

on good models of letters of enquiry and complaints, and to produce letters of the same

functions afterwards. The results showed that consciousness-raising may have assisted the

learners in learning some of the linguistic features of the models yet came short of making

them learn a few other grammatical points. The explanation that is offered for the result is

that the C-R technique has a positive effect on the mastery of global, less complex feature of

the discourse but is not effective enough to promote mastery of more complex language

features, such as grammar and accurate expressions. What seems reasonable for teachers is to

combine consciousness-raising method with a form-focused instruction that discretely teaches

learners the important grammatical elements and the appropriateness of expressions.

References

McCarthy and Carter. (1995). Spoken grammar: what is it and how can we teach it? ELT

Journal 49 (3), 207-218.

Robinson, P. (Ed.). (2001). Cognition and Second Language Instruction, pp. 33-68.

Cambridge: Cambridge University Press.

Rutherford, W. E. (1987). Second Language Grammar: Learning and Teaching. London:

Longman.

Sa-ngiamwibool, A. (2007). Enhancing structure and written expression among EFL Thai

students through consciousness-raising instructions. NELTA Journal, 12, 1 & 2.

Skehan, P. (1998). Task-based language instruction. In Grabe, W (ed.). Annual Review of

Applied Linguistics. Oxford: Oxford University Press.

About the Author

Patrisius Istiarto Djiwandono was born in Malang, 16 March 1967. He earned his Bachelor‘s,

Master‘s and Doctorate degree in Language Education from Institute of Teacher Training and

Education in Malang, and obtained Diploma TESL qualification from Victoria University of

Wellington, New Zealand in 1992. He has published 5 books in language testing and language

learning strategies, and his dissertation on language learning strategies and degree of

extroversion was recently published internationally by Lambert Academic Publishers. He

specializes in language testing, language acquisition, discourse analysis, writing, teaching

methodology, and has recently been interested in the application of Critical Thinking to

language students. He is currently a Professor at the English Letters Study Program of Ma

Chung University, Malang, Indonesia, where he is also Director of Quality Assurance

Department and Head of Language Teacher Training.

25

FLLT 2011 Proceedings

Applying Reflective Teaching Theory to ESL Teaching

Chen Meihua & Zhu Shanhua

Southeast University

[email protected] & [email protected]

Abstract

The argument in this paper is that reflective teaching activities can contribute a great deal to

ESL teaching and teachers‘ self-development, that is to say, the cultivation of ―ESL teachers

as researchers‖. Firstly the paper deals with concepts and characteristics of reflective teaching

related with ESL teacher education program, the innovation of ESL teacher education in

China, and the significance of the cultivation of ―ESL teachers as researchers‖. Then the

author describes the design of the program, the instruction of reflective teaching theory and

methods, and the practicum during which various reflective teaching activities provide

opportunities for the student teachers‘ change of teaching behavior. The purpose of the

research is to depict how the reflective teaching activities provide opportunities for teachers to

change their teaching behaviors, thus the cultivation of teachers‘ creativity and research

potentials outweighs the training of pedagogical theories and skills.

1. Introduction

China has made it clear that quality-oriented education should be promoted in all types of

schools at all levels. Since teachers play a crucial role in enhancing the quality of education,

teachers in the contemporary age of China are expected to play new roles and functions. And

due to internationalization of English language, ESL teacher training programs are being

implemented all over the world. Considerable attention has been given to the training ESL

teachers. Topics such as the nature of teacher training courses and different approaches to

language teacher training have been discussed throughout the world. The quality of teacher

development practice has become a major concern in recent educational discourse, with a

growing emphasis on a reflective approach suggesting that the quality of teachers‘ lifelong

development should be assessed with reference to teacher empowerment through reflection.

Teachers‘ professional lives are riddled with many hazards: they are expected to accept

challenges, take on roles for which their initial training and experience might not have

equipped them. As Wallace (1991:25) suggests, ―If (as might seem desirable) the trainees are

to be encouraged to develop their professional expertise in an autonomous and self-directed

way, then somehow autonomy and self-direction should be woven into the fabric of their

course‖. To be able to respond to challenges teachers must engage in continual self-

development. This process of development can best be initiated through reflective teaching

activities. Reflection and the development of reflective practice may assist teachers in the

integration of their learning experiences and in the analysis of their actions in their endeavors

to become more effective teachers as researchers.

2. Concepts and Characteristics of Reflective Teaching

Reflective teaching, which rose in the early 1980s and developed quickly in the 1990s, is now

very popular in the Western countries. Reflective practice is an evolving concept. The concept

―reflective thought‖ was introduced by John Dewey in his ―How We Think‖ (Dewey 1933:

26

FLLT 2011 Proceedings

32). Dewey‘s definition of reflective thinking repeated over the years was, ―Active, persistent,

and careful consideration of any belief or supposed form of knowledge in the light of the

grounds that support it and the further conclusion to which it tends‖. (Dewey 1933:10)

Another definition comes from Richards & Lockhart (1996:1). They state that a reflective

approach to teaching is ―one in which teachers and student teachers collect data about

teaching, examine their attitudes, beliefs, assumptions and teaching practices, and use the

information obtained as a basis for critical reflection about teaching.‖ Because such reflection

involves a critical component, reflective teaching can serve as a means of contributing to

one‘s professional development.

Reflective teaching can be conceived as a dialogue between thinking and acting, dominated

by the idea of consciousness and reflection that enables teachers to analyze the theories that

guide their practices as well as these practices along with the contexts in which they originate.

Teaching would be then conceived as an exploratory and research activity that requires

competencies for diagnosing problems, thinking about them and investigating, constructing

adequate practical theories that guide the decision making process, before, during and after

action is taken.

Reflective practice can be a crucial element of pre-service programs because reflective

thinking helps teachers in practice teaching to act in deliberate and intentional ways, to devise

new ways of teaching rather than being a slave to tradition, and to interpret new experiences

from a fresh perspective. In addition, helping teachers to develop reflective thinking will help

them integrate the various types of knowledge they receive during the program to achieve a

coherent and cohesive philosophical approach to teaching.

3. Design of the Program

A program designed by the author aims at observing how reflective teaching activities

provide opportunities for teachers‘ change of teaching behavior during their practicum. This

program lays an emphasis on collaborative, self-directed, inquiry-based, and life-long

teaching so as to assist teachers to become future ―teachers as researchers‖.

3.1 The Program Participants

The program participants include seven student teachers in their second year of ESL

postgraduate study at School of Foreign Languages, Nanjing Normal University. They have

each completed an undergraduate degree of ESL Teacher Education in the same university

and got no teaching experience before. They are offered in the first semester a course called

Theory & Practice of Modern Foreign Language & Teaching in which three months of

instruction on reflective teaching theories and skills are included, and in the second semester a

practicum during which they are provided with an opportunity to apply reflective teaching

theories and skills to practice.

3.2 The Program Outline

The program can be divided into two parts: the one that raises reflective teaching awareness,

i.e., the instruction of reflective teaching; the one that is experiential, i.e., the practicum.

27

FLLT 2011 Proceedings

3.2.1 The Instruction of Reflective Teaching:

1) Course Description. The student teachers receive 48 hours of instruction that consists of a

series of sessions with each one devoted to one topic that serves as the focus of reflection

on practice.

2) Course Content. The course content involves action research and the process of reflective

teaching; the different approaches to reflective teaching; and the dimensions of reflective

teaching.

3) Course Goals. Through the instruction, the student teachers will be able to

Critically understand major process, approaches, and dimensions used in ESL

reflective teaching

Get accustomed to reflective thinking about the attitudes, opinions, and beliefs

concerning both ESL teaching and learning

Learn how to effectively observe ESL language classrooms

Learn to design and conduct small action research projects in their own classroom

4) Course Activities and Tasks:

A) Ways of providing teaching materials: samples of teachers‘ teaching journals, reports,

lesson plans and students‘ written work; video and audio recordings of actual lessons;

case studies; textbook materials; and sample forms of questionnaire, interview and

classroom observation

B) Different learning activities and tasks: lectures; individual, pair or group work;

classroom observation and microteaching or peer teaching

3.2.2 The Practicum:

1) Course Description. The student teachers complete 48 hours of teaching practice during

which pairs of them collaborate to design and conduct an action research project under the

supervision of their tutors and submit a research report for discussion and evaluation on

their reflective teaching practice.

2) Course Content. The student teachers are assigned to teach the Intensive Reading for non-

English majors of grade one in Nanjing Normal University.

3) Course Goals. From the practicum, we intend to

Find out changes in the teaching behavior of student teachers while they are

participating in the practicum.

Explore the opportunities made available through reflective teaching that account for

these changes.

4) Course Activities and Tasks: weekly two-hour seminar or discussion; monthly contact

session; action research projects; reflective teaching plans, journals and reports;

interviews and questionnaires; and classroom observation

3.3 The Process of Reflective Teaching

Action research is quite useful in ELT in China in that it does not demand much time and its

process is easy to follow. The action research process is generally initiated by the

identification by the teachers of something that they find puzzling or problematic. This

puzzlement may, in fact, have emerged from a period of observation and reflection. The

second step is the collection of data through a preliminary investigation that is designed to

identify what is currently happening in the classroom. Based on a review of the data yielded

by the preliminary investigation, a hypothesis is formed. The next step is the development of

28

FLLT 2011 Proceedings

some form of intervention or change to existing practice, along with a way of evaluating the

effects of this change. The final step is reporting on the outcomes of the interaction, and, if

necessary, planning further interventions.

3.4 The Approaches to Reflective Teaching

Many events occur every day in our classroom, and can serve as the valuable experiences for

critical reflection. It is necessary for teachers to find ways to collect full information about

and gain deeper insight into these events themselves. So some feasible approaches are

introduced:

3.4.1 Journal writing

Writing teaching journals is a useful way of developing a deeper understanding of problems

raised in the teaching practice and exploring information and thoughts. Collaborative journal

writing can be especially beneficial and help stimulate motivation when two or more teachers

share their journals and meet regularly to discuss them. Brock, Yu and Wong (1992:134)

claim that ― One of the most important of these (benefits) is that this approach can provide

access to the hidden affective variables that greatly influence the way teachers teach and

students learn.‖

3.4.2 Classroom observation

Being observed in the classroom may rattle any teacher‘s nerves. But the classroom

observation that serves as a means for professional growth rather than performance evaluation

has multiple benefits for teachers. It can yield its greatest benefits when used as a means of

sharing instructional techniques and ideologies among teachers and enables a culture that

nurtures an exchange of ideas and promotes a certain level of trust among faculty.

3.4.3 Questionnaires

Using questionnaires is classified as an ―introspective‖ device since it involves respondents

reflecting on themselves, their knowledge, opinions, beliefs, experiences, etc. They can be

used to elicit many kinds of data as sources of analysis on both teaching and learning

perceptions of teachers and learners. Questionnaires have to be carefully written to obtain

comparatively reliable and valid information.

3.4.4 Interviews

Interviews are by definition oral, more like conversations. It is a useful way of gathering

information about affective dimensions of teaching and learning when the talk is under a

relaxed and friendly atmosphere. During the interview, it is necessary for the interviewer to

take notes for the follow-up recall and data collection. The interview focus can be used as the

stimulus to elicit responses from the interviewee.

3.4.5 Audio or video recording of lessons

This alternative approach can give the full account of a lesson, i.e. the recording of a lesson

by audio recorders or video cameras. The recording or tape can be replayed and examined

29

FLLT 2011 Proceedings

many times and capture many details of a lesson that cannot easily be observed by other

approaches. Audio-visual recordings can confront teachers with a mirror-like objective view

of what goes on in class. Moreover, they can be kept for later use and give a valuable insight

into an individual teacher‘s growth in experience over years.

4. Findings and discussion

Findings

The strong evidence shows that seven student teachers changed aspects of their teaching

behavior while participating in the twelve-week practicum. Besides the action research

projects conducted during the practicum, the changes in six areas of teaching behavior in

Table 1 are common to some of them.

Table1. Changes in Teaching Behavior of the Student Teachers Teaching

area Behavior at the beginning

of practicum Behavior at the end of practicum

Classroom

interaction Usually teacher-fronted

lectures with less

students‘ involvement

Mostly student-centered and teacher-

directed interactive activities such as

group work, pair work, whole-class

discussion, individual presentation, etc.

Teaching

Materials Mainly a focus on

textbooks More extracurricular materials included

Teaching

realia Mainly blackboard and

chalk More use of audio, video, and

multimedia facilities

Error

Correction Either almost no

correction or limited

repertoire of correction

strategies

Various efficient error correction

strategies adopted

Teachers‘

confidence Talk in low voice, with

stiff facial expressions or

gestures

Speak more fluently with mild facial

expressions and rich body languages

Students‘

feedback Without much interest

and enthusiasm in

learning content, tasks,

and communication with

teachers and classmates

With more initiative to participate in

class activities, more motivation to

improve one‘s English level, and

rapport with teachers and classmates

When the student teachers teach a class they are confronted with putting their knowledge into

practice. If an activity is available that allows them to further consider their teaching

experience, they may have the chance to process their experience one step further, possibly

even to the point of making decisions about how they would teach the same lesson differently

next time. The more activities that are made available to the student teachers, the more steps

they can take toward an understanding of themselves as teachers and their teaching behavior.

Discussion

1) The purpose of our experiment is to describe how the reflective teaching activities provide

opportunities for the student teachers to change their teaching behavior so as to explore the

30

FLLT 2011 Proceedings

actual processes going on in a teaching practicum. Reflective teaching activities provide the

student teachers with opportunities to gain the investigative and decision-making skills they

need to function as responsible and autonomous teachers.

2) Reflection is a very complex cognitive and affective process. It usually takes a long time

and practice for teachers to develop a purposeful reflective teaching practice which integrates

their emotions and thinking, and takes into account the abstract concept of purposeful

reflection as well as the reality of their personal and professional lives. Some of reflective

approaches such as journal writing, and audio-video recording of lessons are time-consuming,

which requires that teachers be perseverant and persistent enough to keep on doing them.

3) Reflective teaching as part craft and part art, different from traditional operative teaching,

is extremely complex and difficult to assess accurately. The evaluation of reflective teaching

is based not only on teachers‘ external teaching behavior but also their internal reflective

thinking process.

It is more appropriate to adopt a qualitative rather than quantitative approach in the evaluation

of reflective teaching because the latter emphasizes the commonness and uniformity while it

neglects individuality and flexibility. The goal of reflective teaching is to diagnose teaching

problems so as to enhance teachers‘ self-development and its evaluation should accordingly

be carried out by qualitative approach to achieve its goal. We should carry out observations,

take notes, make analyses and then draw conclusions based on the actual classroom activities

and case studies. Portfolios of teachers‘ syllabuses, exams, assignments, and statements of

teaching philosophy can be evaluated holistically, should the purpose of the evaluation be to

improve teaching. Schools should devote their efforts to producing holistic information for

administrative purposes, and detailed analyses of their performance for the teachers‘ own use.

If that happened, we might actually see systematic improvement of teaching--which is

supposed to be the goal of the entire operation.

4) In reflective teaching the employment of action research and the spirit of collaboration are

two important facilitating factors and there are readily identifiable factors which promote or

inhibit reflective practice. Reflective teaching requires a commitment to continuous self-

development and time to achieve it. Reflective teaching may prove emotionally challenging.

5. Conclusion

The teacher education program as a whole looks like a learning system with an emphasis on

continual study and incremental improvement. It can guide student teachers engaged in

learning how to study their own teaching to value improvement. It can also enlighten teacher

educators in China engaged in learning how to study their teaching of the student teachers.

The author believes that the program is promising because research, teaching, and learning are

tightly intertwined and are actively engaged, also because it outlines a system designed to

achieve particular learning goals, for teachers and teacher educators, using a process of

continuing improvement through learning from planned instructional experiences. The

program is intended to guide a long-term growth of knowledge in a gradual, incremental yet

steady and lasting way. The goal can be achieved but achievement depends on building local

cultures that value gradual and continuing progress.

31

FLLT 2011 Proceedings

In conclusion, it is appropriate for teachers to explore issues in the classroom and to decide

what should be investigated. Through reflective teaching teachers can acquire tried and tested

ideas, develop successful strategies and techniques, and experiment with them as well as

adjust them according to their learners. What teachers in China need most is training in

reflective teaching skills so that most of their planning, the decision-making as well as the

behavior in the classroom are based on sound pedagogic principles and any investigation that

they undertake is based on the principles of action research accompanied by exploration and

reflection. Although it takes a substantial amount of time and practice to learn how to

integrate all aspects of a reflective process, it is a form of personalized and professional

development that can last a lifetime. Learning how to think, feel and teach reflectively gives

teachers direct access to the integration of theory and practice in their everyday working lives.

References

Brock, M.N., Yu, B. and Wong, M. 1992. ‗Journaling‘ together: collaborative diary-keeping

and teacher development, In J. Flower-dew, M. Brock and S. Hsia (eds.) Perspectives on

Second Language Teacher Education. Hong Kong: Polytechnic of Hong Kong.

Dewey, J. 1933. How we think: A restatement of the relation of reflective thinking to the

educative process, Boston: Heath.

Ellis, R. 1994. The Study of Second Language Acquisition. Oxford: Oxford University Press.

Gage, N., & Berliner, D. 1991. Educational psychology,Boston: Houghton, Mifflin.

Nunan, D. 1991. Language Teaching Methodology. Hertfordshire: Phoenix ELT.

Posner, G. J. 1996. Field experience: A guide to reflective teaching (4th ed.), White Plains,

NY: Longman.

Richards, J. C. & Lockhart, C. 1996. Reflective teaching in second language classrooms, New

York: Cambridge University Press.

Wallace, M.J. 1991. Training foreign language teachers: A reflective approach, New York:

Cambridge University Press.

About the Authors

CHEN MEIHUA, female, professor of applied linguistics, MA supervisor, doctorate

candidate in education management, has been teaching English as a foreign language in

Southeast University since 1985. She obtained the Master of Education from the University of

Sydney in 2006. She has published over 10 research papers and compiled over 20 English

course-books.

ZHU SHANHUA, female, associate professor of applied linguistics, MA supervisor,doctorate candidate in arts, graduating from Nanjing Normal University with a Master‘s

degree in 1998, has been engaged in English teaching, researching and management in

Southeast University since then. Research Interests: applied linguistics, Second Language

Learning and Teaching, anthropological linguistics and Cross-cultural Communication.

32

FLLT 2011 Proceedings

Challenges That Thai Teachers and Learners Face

When Moving from L1 to L2 and How to Handle Them

Sukina Ar-lae & Cecilia M. Valdez

Yala Rajabhat University

[email protected]

Abstract

Based on their written and oral output, university students in South Thailand, particularly

at Yala Rajabhat university, were observed to commit some common mistakes which

persistently appear in their oral and written production of the English language. This

observation necessitated this study of why these mistakes happen and the consequent need to

know how to handle them. From the error analysis of hundreds of student papers as well as

hours of teacher-student conversations in English, the researchers selected the common

mistakes that the Thai learners commit. In general, the mistakes seem to happen due to the

interference of the learners‘ native language, either Thai or Malayu or both, as they learn

English. Malayu is the native tongue of most of the students. There is also the double impact

of both Thai and Malayu on the learners‘ ability to learn English well. As a result of the

observations and error analysis, the researchers are putting forward several suggestions on

how to handle the challenges both for the teachers and the learners. Suggestions include some

techniques and strategies in TESL, such as the use of realia, games, chants, and others for use

inside the ESL classroom. In addition to the suggested techniques, it appears necessary to

lengthen the time of exposure of the students to an English environment and or add more

hours of guided instruction in the target language. Furthermore, a graduated or step-wise

approach to English teaching in terms of time percentages in language use is recommended as

students move from their first to their last year of university education.

Background

Inside a Thai or Malay classroom, when a student answers the teacher with a ―Nakrian pay

rongrian‖ or ―Pelajar pergi sekolah‖, it would be perfectly acceptable. It is quite a different

story however, when that same student goes to a class in English and says, ―student go

school‖. What is correct in one classroom becomes a mistake in another, and this is more

than just a case of one class‘ treasure being another class‘ rubbish. If neither the teacher nor

the student understands where each is coming from, the challenge to learning arises and faces

both the teacher and the learner. If the teacher does not understand where the learner is

coming from, he might just assume that the student is not smart enough and will just continue

on with whatever lesson he has prepared. On the other hand, if the student does not realize

the basic differences between the languages he is supposed to learn, he will most probably get

confused and remain such unless his mind is opened to understand where he is coming from

and where he is going in terms of his learning a second or even a third language.

This is a fundamental issue that this paper hopes to clarify, and then suggest some activities,

techniques and approaches to help the teacher understand and handle the challenges that both

teachers and learners face when moving from L1 (Thai or Malayu) to L2 (English). It is also

hoped that the learners themselves will find the suggested activities helpful to their learning

English as their second/third or foreign language.

33

FLLT 2011 Proceedings

Challenge of the contrasting features of Thai/Malayu and English

Basic Differences

In comparison to the English language, Thai or Malay grammar offers very little. To begin

with, these two latter languages do not use definite or indefinite articles or noun declensions,

and pronouns and adjectives follow the nouns they describe. If words are not needed to make

sense in the sentence, they are omitted. This may make it seem quite simple, but the lack of

structure can end up making sentences more difficult than others with stricter grammar rules

like English (from www.into-asia.com/thai. 2008). Thai learners most often translate Thai

phrases word for word into English, compounding the problem of making correct sentences in

English. With the definite or indefinite articles missing in their first language, it is

understandable that learners have difficulty using such in another language which necessitates

their use, as in the example given above.

In both Thai and Malayu, plurals are indicated in an entirely different way from English.

While Thai uses specific words to indicate plurality, Malayu most often simply duplicates the

word. In moving to English therefore, it is common to hear or read learners say or write,

―many book‖ or ―ten student‖. Adjectives, demonstrative and possessive pronouns follow the

noun they describe while adverbs come after the adjectives being modified, in both Thai and

Malayu (Transparent Language, 2008).

According to Lekawatana‘s Contrastive Study of English and Thai (1969), grammar

differences between these languages occur in almost every aspect of what the English

language calls parts of speech. For simple sentences, in Thai, the subject is optional while in

English, it is obligatory with its accompanying verb to be. This leads to two major mistakes

that Thai learners tend to make in the formation of simple sentences in English. First is the

deletion of the subject of the sentence and secondly, the deletion of the linking verb to be.

There are then two probable mistakes that can occur in the production of the sentence, He is

very tall: a) deletion of the subject: Is very tall; b) deletion of the verb to be: He very tall.

In addition, English has several types of adjectival constructions but only one of these is

roughly equivalent to that found in Thai. Perhaps the greatest difficulty Thai students face in

learning adjectival constructions in English is differentiating between the –ing and –ed forms

of adjectives derived from verbs. Examples: He was interested in the movie; The movie was

interesting. Thai learners continually confuse these two forms since the difference in Thai

between the two derived forms is not in their suffixation but in their prefixation. He was

interested in…. khaw soncay… translated as, he interest…. He was interesting (khaw

naasoncay, or, he interest or literally, interestable). Thus, Thai learners have a tendency to

say, he was interesting in sports instead of saying, he was interested in sports.

With regards to verbs and their tenses, the fact that the English tense system has many more

distinctions than the Thai verb system leads to various errors which Thai learners make. The

most important error which probably accounts for a majority of all errors Thai students make

in using verbs is the use of the present tense when the past form is required. Also, although

there is a continuous tense in Thai, learners still have difficulty with the continuous verb

forms in English because the respective structures of the English and Thai verb forms are

different. When using English verbs then, Thai learners have to make a whole new set of

differentiations which they have never made in their own language (Lekawatana, et al. 1969).

34

FLLT 2011 Proceedings

They have to learn to distinguish between the tenses, regular and irregular verbs and person

and number. In Malayu, the tense of a verb can be indicated by adding affixes to the root

word either verb or noun, while in Thai, the past tense is similar to the other tenses in that it is

expressed in context using specific words to mark the time of the action or event. Malay

verbs do not change form to indicate tense or person – such nuances are expressed using

separate words such as adverbs or indicators of time.

Modals are another area of difference between the languages. While English has at least 27

modal forms, there are only 18 equivalent Thai expressions which express the same ideas.

Thai learners often make mistakes with English modals due to the lack of distinction in Thai

between modals which are distinct in English. For example, there is no distinction in Thai

between may, might, and be likely to. The most common errors made by Thai learners

however is either the overuse or the omission of the particle to after modals, the reason being

that there are many two-word pairs of English modals, one of which is followed by to and one

of which is not.

The use and position of adverbs in a sentence pose another challenge to Thai learners of

English. Thai/Malay and English differ in their use of adverbs depending upon the type. The

English adverb of manner is formed by 1) the addition of –ly to the adjective, 2) an

unchanged adjective (hard-hard), or 3) an irregular change from the adjective form. On the

other hand, the Thai adverb of manner is formed by 1) the use of the adjective form

unchanged, or 2) the addition of the adverbial prefix yaang placed before the adjectival form.

In English, adverbs can be used comparatively in several ways: as + adverb + as - as quickly

as; less/more than - less/more quickly. In Thai, such comparison is expressed by the

adjective (which is not differentiated from the adverb) followed by kwaa (than) or muean

(same). The less + adverb + than construction is never used in Thai. Instead, it is

paraphrased into a more + adverb + than equivalent resulting into a production like, he sings

good more than I.

There are many instances where the prepositions used in English do not coincide with Thai or

Malay prepositions. There are two prepositions in English which are used with the time of

day: in the morning/afternoon/evening, and, at noon/night, both of which are expressed in

Thai by the same preposition, ton.

Perhaps one of the biggest hurdles Thai and Malay learners of English stumble on when

producing sentences is the use, misuse or non-use of possessive adjectives, possessive,

indefinite, objective and reflexive pronouns. This is simply because these do not have the

exact equivalent in either Thai or Malay (Transparent Language, 2008). Khoong (roughly, of)

is used in place of the possessive adjectives and pronouns, khon (people) is used in place of

indefinite pronouns, there is no equivalent for objective pronouns, and eeng (self) is used in

place of reflexive pronouns. In addition, because Thai has many different pronominal forms

to indicate various relationships between speaker and listener (e.g. instead of I, young girls

use nuu, literally, mouse, when talking to superiors), it is sometimes difficult for a Thai

learner to know which pronominal form to use. At times however, names or titles are used

instead of pronouns. For example, father to child - Father will help you, instead of, I will

help you; teacher to students - teacher will assign a lesson, instead of, I will assign a lesson.

35

FLLT 2011 Proceedings

Method

Data Collection

The researchers collected papers in the form of reports, essays and classroom exercises from

students of Yala Rajabhat University, from all four year levels majoring in English. These

papers were gathered in the course of the researchers‘ teaching over a one-year period. Data

were collected as the researchers pored over 200 – 300 student papers as well as from hours

of conversations in English with the students. The information was then arranged and

analyzed accordingly.

Results

Error Correction

Type : Article use/non-use

1. Her father is businessman. 1. Her father is a businessman.

2. I go to university every day. 2. I go to the university everyday.

3. We stayed in small hotel. 3. We stayed in a small hotel.

4. Head of state is woman. 4. The head of state is a woman.

Pronouns

1. She name‘s Minah. 1. Her name‘s Minah.

2. He saw they in school. 2. He saw them in school.

3. Her is a pretty girl. 3. She is a pretty girl.

4. My parents love I. 4. My parents love me.

Prepositions

1. I visit my parents at Narathiwat. 1. I visit my parents in Narathiwat.

2. They go to school at morning. 2. They go to school in the morning.

3. The food is in the table. 3. The food is on the table.

4. My family went to Phuket in the last

summer.

4. My family went to Phuket last summer.

Adverbs/Adjectives

1. I cook very delicious. 1. I cook very delicious food/ I cook very

deliciously.

2. He sings beautiful more than her. 2. He sings more beautifully than her.

3. The food is delicious very much. 3. The food is very delicious.

4. My mother is woman beautiful. 4. My mother is a beautiful woman.

Verb tenses

1. Last summer, I‘m very happy. 1. Last summer, I was very happy.

2. We cook special food last Rayo day. 2. We cooked special food last Rayo day.

3. She study in Bangkok. 3. She studies in Bangkok.

4. He seen his friend in the house. 4. He saw his friend in the house.

Verb to be

1. Today I happy. 1. Today, I‘m happy.

2. I‘m listen to my friend. 2. I listen to my friend.

3. She going to buy fruits. 3. She is going to buy fruits.

4. Her mother angry. 4. Her mother is angry.

36

FLLT 2011 Proceedings

Discussion

The most common mistakes Thai learners make in both their written and oral production of

English involve the omission of the inflectional affixes in English, -s or –es for the singular to

plural nouns, or present tense, 3rd

person, singular; -d or –ed for the past tense and past

participle; -er and –est for the comparative and superlative degrees, ‗s and other pronouns for

possessives. A comparison of English and Thai morphology will show that with these affixes,

English has many morphological patterns while Thai has none at all. According to

Lekawatana in her Contrastive Study of Thai and English (1969), the initial problem with the

correct recognition and production of these affixes is a phonological not a morphological one.

Thai and Malayu do not have the /z/ sound and the /s/ sound never occurs in the final position

of words. Thus Thai learners miss it altogether when writing sentences in English, and they

have great difficulty in pronouncing the /z/ or /s/ sounds when speaking in English, resulting

in errors like, many book, two person, she study here last year, he is tall more than me, he buy

food, mother of friend.

Thai verbs are never inflected. In Thai and Malayu, the past is signalled by aspect markers

and not in the verb itself, thus Thai learners tend to leave off the inflection in English.

Basically, Thai and Malayu grammar do not distinguish between present and past tense. Thai

learners‘ using the present tense when the past tense is required, is another error of omission

which also has a phonological cause. Thai has only one final stop, the voiceless, unreleased

/t/ in contrast to the English opposition between the final voiced /d/ and the voiceless /t/

(Lekawatana, et al 1969; Imsri & Idsardi, 2002), while Malayu has other glottal stops in

addition to what Thai has. Thus we see and hear students making sentences like, she study

here last year, we cook rice last Rayo day.

While English uses the inflectional affixes –er and –est to mark the comparative and

superlative forms of adverbs and adjectives, Thai uses the words khwaa (more) and thiisut (to

the nth degree). Thus Thai learners make sentences like, she is beautiful more than me, he is

good more than you. Phonologically, both –er and –est are impermissible finals in Thai and

Malayu, adding to the Thai learners‘ difficulty with these markers. In addition, because there

are no articles in Thai, learners tend to delete the the from the superlative forms in English

committing errors as, she is most diligent in class.

Have vs. There is/are

1. In the village, have a mountain. 1. In the village, there is a mountain.

2. On the beach have many boats. 2. There are many boats on the beach.

3. In my home have orderly. 3. My home is orderly/ There is order in my

home.

4. At Big C have more new fashion clothes. 4. Big C has more new, fashionable clothes

Modals

1. She must to speak. 1. She must speak.

2. I can to swimming. 2. I can swim.

3. She should to forgive him. 3. She should forgive him.

4. You must be study hard. 4. You must study hard.

37

FLLT 2011 Proceedings

Suggestions

Thai learners of English in South Thailand have to hurdle through the double interference of

Thai and Malayu on their way to learning this foreign language. In terms of language,

specifically grammar instruction inside the classroom, a variety of activities can be done in

addition to simple lectures. Grammar instruction integrated in a communicative approach

seems to be best where the learners are encouraged to participate in group and class

discussions in the target language. To handle the particular difficulties, the use of chants and

rhymes which make use of the specific grammar subject can be really useful. Games can also

be developed focusing on the particular grammar to be learned. The use of realia or real

objects inside the classroom or pictures can also be helpful. Sentence construction exercises

in a game format always adds fun to learning. The ESL teacher however, can only do so

much, even with a variety of activities and approaches available and practiced. The English

learning environment in South Thailand requires more than just classroom activities, if the

learners are expected to be able to at least communicate in simple English after four years of

university education. This research definitely does not advocate English-only teaching inside

the classroom. Beginners, i.e. first year students, in particular would be helped more

effectively in a bilingual setting, where students are taught using a combination of first and

second languages (Grant, Meeler & Misak, 2010). Rather, this paper suggests a gradual

immersion model of instruction in English, a model which is half-way between total

immersion and bilingual approach, particularly in terms of time allotted in teaching using the

native and target languages. For beginners, a 70% to 30% native to target language ratio is

recommended whereby instruction in the native language could be no more than 70% of the

time, and at least 30% of the time in the target language. For the second year students or

perhaps low intermediate learners, a 50 – 50% ratio or at least 50% of the time using the

target language could be beneficial; high intermediate or third year students could be

challenged with no more than 30% instruction in the native language and at least 70% in the

target language. And those advanced learners, or the students who are in their fourth year of

English education should be taught English at least 90% of the time in the target language and

no more than 10% in the native language.

In addition to the activities and time allotment, an audio laboratory is a necessity for any

university which wants to produce graduates majoring in English who will be employable

because of their proficiency in English.

About the Authors

Asst. Prof. Dr. Sukina Ar-lae: I have been teaching English at Yala Rajabhat University for

13 years. My current position is an English lecturer and Malay language counsellor. I got my

Bachelor of Arts (English) from Prince of Songkhla University, Pattani campus in 1983 and

went on the Master of Western Literature at Srinakarintrwirote University, Prasarnmitr

campus in 1987. I got a Doctorate degree in TESL at the National University of Malaysia in

2006. My specialized fields are teaching of English as a foreign language, teaching English

literature and teaching Malay language (Bahasa Melayu). I am interested in conducting

research relevant to teaching especially in my southern region (5 southernmost provinces)

either in Thai, English or Malay language.

In terms of research, my colleagues and I recently conducted the research of English

teaching entitled ―Challenges Thai Teachers and Learners Face when Moving from Thai (L1)

38

FLLT 2011 Proceedings

to English (L‖) and how to Handle Them‖ which is one of the research papers to be presented

in this conference.

For the publications, my research study is usually published in the Journal of Yala

Rajabhat University. The latest one was published in Vol. 4, No. 1, January-June 2009 and I

also serve as an editor of this journal.

Cecilia M. Valdez: My training and background is in the field of biology. I got my B. S. in

Biology from the University of the Philippines in 1977, and received my certificate in TESL

from the University of California in Berkeley in 2003. Because I worked as a research

scientist in the area of cancer and other diseases at Bayer Corporation in California, my

previous research was focused on that subject.

As a result of that work, publications to which I have contributed include the

following:

Scuderi, P., Valdez, C., Duerr, M., & Thompson, T. (1991). Cathepsin-G and Leukocyte

Elastase Inactivate Human TNF and Lymphotoxin. Cellular Immunology, 135, 2, 299-313.

Lindsey, DC., Newgren, J., Thompson, T. & Valdez, CM. (1991). Characterization of an

Endotoxemic Baboon Model of Metabolic and Organ Dysfunction. Circulatory Shock, 34, 3,

298-321.

Mooradian, AD., Scuderi, P., Duerr, M., & Valdez, C. (1992). The Effect of Age and

Diabetes Mellitus on Serum Levels of Lymphotoxin. AGE, 15, 3 (July), 95-99.

With regards to research in language learning, I am interested in following up on this

gradual immersion model for Thai learners of English.

39

FLLT 2011 Proceedings

Content-Task Based Teaching in an English Science Course

Hamid Marashi

Islamic Azad University at Central Tehran

[email protected]

Ghazal Hatam

Islamic Azad University at Central Tehran

[email protected]

Abstract

This study was an attempt to explore the impact of content-task based instruction, i.e.

designing and using certain tasks to teach the content of a science book in English, on Iranian

junior high school students‘ vocabulary achievement. To this end, 60 female students of

SAMA School in Mashad, Iran, were selected and thus randomly put into two experimental

and control groups prior to the study. Both classes lasting 12 sessions received the same

content: a science book in English as part of their school curriculum comprising six lessons.

While a purely content based approach was adopted in the control group and the vocabulary

was taught through providing definitions, synonyms, and pictures, one or several tasks with

the four main phases of warm-up (pre-task), main task, follow-up (post-task), and homework

were used in the experimental group for teaching the vocabulary. On the posttest designed

within the content area, the results clearly showed that content-task based instruction was

significantly more effective on students‘ vocabulary achievement compared to the content

based approach.

1. Introduction

One of the most important features in defining language knowledge is the knowledge of

words. Vocabulary learning is a central issue in learning a new language which hand-in-hand

with other skills and subskills can help a person to use a language. To this end, numerous

studies have been conducted comparing the retention effects of different vocabulary

presentation strategies throughout the last half-century or so (e.g. Andrade & Makaafi, 2001;

Lado, Baldwin, & Lobo, 1967; Arnaud & Savignon, 1997; Atkinson, 1972; Channell, 1998;

Sansome, 2000).

Accordingly, different methods have been designed for teaching a language as well as its

vocabulary; one such way is content-based language teaching (CBLT) which has been

reported to be helpful in teaching the vocabulary of other subject matters to students (Brinton,

Snow, & Wesche, 1989; Crandall, 1987; Krashen, 1982; Mohan, 1986; Mohan, Leung, &

Davison, 2001; Snow, 2005; Stoller, 2004).

Another relatively modern approach that is recently being integrated with other approaches

and endeavors to maximize the language intake of learners (their vocabulary included of

course) is task-based language teaching (TBLT). Richards, Platt, and Webber (1985) define

TBLT as a teaching approach based on the use of communicative interactive tasks as the

central units of planning and delivery of instruction.

40

FLLT 2011 Proceedings

Nunan (2004) argues about the disparateness of the outcomes of pure CBLT and CBLT

integrated with TBLT and summarizes the benefits of CBLT as including an ―organic,

analytical approach to language development‖ and ―a framework within which learners can

have sustained engagement on both content mastery and second language acquisition‖ (p.

132).

Recently, some schools in Iran have begun exploring teaching methods using English to teach

subjects like math, science, and computer for students of the 11-14 age group (junior high

school). In this system, students learn English through other subjects. It should be added here

that in the books being taught in this system, the main focus is on vocabulary, and other

language subskills are not highlighted. Accordingly, the researchers in this study became

interested to find out whether the pure CBLT approach to teaching the vocabulary content of

science subject matters or an integrated CBLT and TBLT approach, namely, task/content-

based instruction, would generate more promising results in terms of the learners‘ vocabulary

achievement. Hence, the following research question was raised in line with the objective of

this study:

Does content-task based instruction have any significant effect on EFL learners’

vocabulary achievement?

2. Method

2.1. Participants

A total of 60 female students aged 11-12 studying at the first grade of junior high in a school

in Mashad, Iran, were chosen among 90 through a piloted language proficiency test.

2.2. Instrumentation

A Cambridge Flyers Test of English for homogenizing the students‘ general English at

the outset.

A posttest consisting of 30 multiple-choice items comparing the vocabulary

achievements of the two groups.

Both tests were piloted before actual administration.

2.3. Materials

A series of tasks including individual and group work type were used as a part of the

treatment in the experimental group (described in the next section).

The SAMA English Science Book for the first grade of junior high was used as the

course book which is designed and published by SAMA schools and includes science

subject matters in English. Its main focus is on language teaching through science

content.

The Oxford Picture Dictionary was used in the experimental group for doing certain

tasks. Only those contents in this dictionary consistent with the content of the course

book were used during the treatment. This dictionary – thanks to its colorful pictures –

was very appropriate to the students‘ language proficiency and age level.

41

FLLT 2011 Proceedings

2.4. Procedure

Following the process of selecting the control and experimental groups, the actual treatment

commenced. In the control group, the students were taught vocabulary through definitions,

synonyms, and pictures. The students were not required to do any kind of tasks with the

vocabulary they were learning; they only answered the questions presented in their course

book.

In the experimental group, however, a task/content-based framework was employed. The

content was taught through a content-based approach and the treatment was integrated with

tasks, hence a task/content-based approach.

The lessons taught in both groups were under these headings: Animals, Plants, Objects and

Matters, Five Senses, Teeth, and the Periodic Table. While in the control group, these lessons

were taught in a usual content-based fashion and only the exercises in the books were

employed, in the experimental group each of these lessons were taught through one or several

tasks and vocabulary was taught through them. Each task had four main phases: warm-up

(pre-task), main task, follow-up (post-task), and homework.

For teaching the chapter of Animals, the students were taken to the zoo where they were

taught the vocabulary content of their books regarding different animals. On their way to the

zoo, the teacher showed them pictures of some animals and asked them to make the sound of

those animals and this was regarded as the warm-up for this lesson. The whole trip to the zoo

was in English and students were aware that this was a field trip with educational purposes for

them. The next session, they worked on the reading passage of their books regarding animals

and for homework, they were asked to draw their favorite animals and write at least three

sentences for it. They read it for their classmates and showed their pictures.

For the Plants chapter, the teacher entered the class with a flower and the students were asked

to touch and smell it; this act was regarded as the warm-up for this activity. The students were

given planting tools and were taken to a garden. Different plant parts were introduced to them

and subsequently, they planted some bean seeds themselves. For 10 days, they took care of

their beans and as they started to grow, they were asked to introduce the different plant parts

to their classmates. The session after the planting activity, they worked on the reading passage

in class and for homework, they were asked to look at their picture dictionaries and find some

new plant parts, draw at least one of them, and bring it to the class the following week.

The lesson on Objects and Matters focused on magnets and thus the teacher took a box of

magnets to the class and introduced the vocabulary content to the students by using magnets

and showing their attraction power on different objects. Then the students were divided into

groups of three and were given a magnet. Next, each two groups merged and they experienced

the power of the magnet poles on each other with the teacher introducing the new vocabulary

to them. As homework, they were asked to find some magnets around and write their names

(the students had already learned about this naming in their textbooks) and draw a picture of

one of them. The session after this, they showed their homework to their classmates and

worked on the related reading passage in their book.

42

FLLT 2011 Proceedings

Next came the chapter of the Five Senses; a song was used for this lesson in the class. While

the song introduced each body part, the teacher showed that part to them. Then they were

asked to point to those body parts with the teacher and subsequently, the vocabulary was

presented using a doll. Then again they started to sing the song with the tape. For homework,

they were asked to draw one body part on a big sheet of paper and bring it to the class and

talk about it in at least two sentences. The reading was done during the next session with the

song activity and clapping and showing body parts.

The chapter on Teeth required the students to bring a toothbrush with them to the class. The

teacher entered the class with a toothbrush in hand and started showing how teeth are

brushed; this served as the warm-up for this activity. The vocabulary content was presented to

them by showing the toothbrush. Additionally, they practiced correct tooth brushing with their

toothbrushes while working in pairs using the vocabulary. For the next session, they were

asked to look at their picture dictionaries and find at least three other words related to oral

health and draw one of them to be presented in the class in the second session after working

on reading passage.

For the last chapter, that is the Periodic Table, a periodic table in English was taken to the

class. They were given different substances such as salt, sugar, and water. The teacher

explained to them that matters and substances are like a box and things inside them are

different from how they are seen on the outside (this explanation was mostly done in their L1

of course since at this stage of language proficiency, the learners would fail to understand

such explanations in English). For this purpose, they were divided into groups of five and

were given a box with some small balls which represented atoms. They repeated the word

atom and started to work in groups and showed each other the atoms. This was followed by

some questions and answers. Some common atom names were presented to them, and then

they looked in their boxes to find those atoms. For the next session as homework, they chose

one atom and drew a picture of it on a big sheet of paper and presented its characteristics; they

used the single first person pronoun as they were supposed to be the atom themselves.

The whole treatment lasted for 12 sessions with the administration of the posttest to both

groups ending the treatment.

3. Results

To make sure that the two groups bore no significant difference at the outset, an independent

samples t-test was run between the mean scores of both groups on the proficiency test (which

enjoyed a reliability of 0.88 in the piloting). The distribution scores of both groups were

checked for normality beforehand to legitimize the t-test.

Table 1. Independent Samples t-Test of the Two Groups’ Mean Scores on the

Proficiency Test

Levene's Test t-test for Equality of Means

F Sig. T df Sig. 2-

tailed

Mean

Diff

Std. Error

Diff

95% Confidence Interval of the

Difference

Lower Upper

2.724 .104 -.292 58 .771 -.300 1.0258 -2.3533 1.7533

-.292 55.51 .771 -.300 1.0258 -2.3553 1.7553

43

FLLT 2011 Proceedings

As Table 1 indicates, examining the mean difference of -0.30 with t(58) = -0.29, p = 0.77

(two-tailed) revealed that the difference between the two groups was not significant at the

outset. Hence, the researchers could rest assured that any probable difference between the two

groups at the end of the instruction period could be attributed to the difference in the

programs.

Once the treatment was completed, the posttest designed by the researchers was administered

to both groups once it was piloted. The reliability of this test in the piloting stood at 0.70

which is satisfactory. The posttest was given to the two groups. With the scores manifesting

normality of distribution, an independent samples t-test was run to compare the means of the

two groups.

Table 2. Independent Samples t-Test for the Means of the Two Groups at the Posttest

As is evident in the above table, t(58) = -5.83, p = 0.00 (two-tailed) lead to the conclusion that

there was a significant difference between the mean scores of the two groups at the posttest. It

can thus be concluded that task/content-based instruction does have a significant impact on

EFL learners’ vocabulary achievement.

Following the rejection of the null hypothesis, the researchers were interested to determine the

strength of the findings of the research, that is, to evaluate the stability of the research

findings across samples; hence, the effect size was estimated. While Cohen‘s d stood at 2.42,

the effect size was 0.78. According to Mackey and Gass (2005), this is considered a large

effect size. Therefore, the findings of the study could be considered strong enough for the

purpose of generalization.

4. Conclusion

The findings of this study indicate that English teachers can benefit more effectively from a

task/content-based approach in order to teach vocabulary. In addition, this modality of

learning was most probably a major factor at work in the significant achievement of the

learners undergoing the task/content-based program. Rather than the usual modality of

teaching/learning in which students are mainly engaged in mere abstraction in the class, these

young learners experienced, for the first time, a far more concrete presentation of new

materials and were thus involved much more actively in a dynamic learning.

Alongside providing teachers with plausible guidelines to employ in their classrooms, the

findings of this research can help syllabus designers and textbook writers to design more

effective textbooks for young learners; this is specifically true in the context of Iran where it

can be really helpful to revise the materials presented to adolescent students at school.

Levene's Test t-test for Equality of Means

F Sig. t df Sig. 2-

tailed

Mean

Diff

Std. Error

Diff

95% Confidence Interval of the

Difference

Lower Upper

6.946 .011 -5.839 58 .000 -8.233 1.410 -11.056 -5.411

-5.839 46 .000 -8.233 1.410 -11.072 -5.395

44

FLLT 2011 Proceedings

Furthermore, it is recommended to design a teacher‘s guide with the focus on task/content-

based instruction for content-based books being used in different systems clearly because not

having a guide can lead to controversial issues faced by different teachers.

Task/content-based language teaching may also be considered as an economical initiative in

enhancing EFL learners‘ vocabulary intake and use. Without having to undertake the

abominably high expenses of textbook production, both public and private sector schools can

incorporate and mainstream this procedure of language teaching in order to achieve more

promising results.

References

Andrade, M. S., & Makaafi, J. H. (2001). Guidelines for establishing adjunct courses at the

university level. TESOL, 10(2/3), 33-39.

Arnaud, P. J. L., & Savignon, S. J. (1997). Rare words, complex lexical units and the

advanced learner. In J. Coady & T. Huckin (Eds.), Second language vocabulary acquisition

(pp. 157-173). Cambridge: Cambridge University Press.

Atkinson, R. C. (1972). Optimizing the learning of a second-language vocabulary. Journal of

Experimental Psychology, 96, 124-129.

Brinton, D., Snow, M., & Wesche, M. (1989). Content-based second

language instruction. NY: Newbury House.

Channell, J. (1988). Psycholinguistic considerations in the study of L2 vocabulary acquisition.

In R. Carter & M. McCarthy (Eds.), Vocabulary and language teaching (pp. 83-96).

London: Longman.

Crandall, J. A. (1987). ESL through content-area instruction: Mathematics, science, and

social studies. Englewood Cliffs, NJ, & Washington DC: Prentice Hall and Center for

Applied Linguistics.

Krashen, S. D. (1982). Principles and practices of second language acquisition. Oxford:

Pergamon Press.

Lado, R., Baldwin, B., & Lobo, F. (1967). Massive vocabulary expansion in a foreign

language beyond the basic course: The effects of stimuli, timing and order of presentation.

Washington DC: US Department of Health, Education, and Welfare, Project No. 5-1095.

Mackey, A., & Gass, S. (2005). Second language research: Methodology and design. NJ:

LEA.

Mohan, B. (1986). Language and content. Reading, MA: Addison-Wesley.

Mohan, B., Leung, C., & Davison, C. (2001). English as a second language in the

mainstream: Teaching learning and identity. NY: Longman.

45

FLLT 2011 Proceedings

Nunan. D. (2004). Task-based language teaching. Cambridge: Cambridge University Press.

Richards, J., Platt, J., Weber, H. (1985). Longman dictionary of applied linguistics. London:

Longman.

Sansome, R. (2000). Applying lexical research to the teaching of phrasal verbs. IRAL, 38, 59-

69.

Snow, M. A. (2005). A model of academic literacy for integrated language and content

instruction. In E. Hinkel (Ed.), Handbook of research in second language learning (pp. 693-

712). Mahwah, NJ: Erlbaum.

Stoller, F. L. (2004). Content-based instruction: Perspectives on curriculum planning. Annual

Review of Applied Linguistics, 24, 261-283.

About the Authors

Hamid Marashi is Assistant Professor of Applied Linguistics and Executive Manager of the

Journal of English Language Studies (JELS). He teaches the graduate courses of seminar in

TEFL, discourse analysis, and teaching language skills and his areas of research interest

include cooperative learning, critical thinking, and TBLT. He has published in academic

journals and presented in international conferences.

Ghazal Hatam holds an MA degree in TEFL from Islamic Azad University at Central

Tehran. She has been teaching English since 2003 in several different language schools in

Iran and is currently teaching pre-advanced courses for adults. Her main areas of research

interest include TBLT and language testing.

46

FLLT 2011 Proceedings

Cultivating Learner-centered Autonomy

Zhu Shanhua & Chen Meihua

Southeast University

[email protected] & [email protected]

Abstract

With China‘s economic development and the adoption of open up policy, more emphasis is

put on students‘ integral language ability. Promoting learner autonomy is a trend in current

language teaching. In view of the defects brought about by the teacher-centered method and in

an effort to promote learner autonomy, this paper proposes the ‗learner-centered‘ teaching

method, which encourages students to independently think and develop their ability in

analyzing, reasoning and generalizing. Through various communicative classroom activities

like oral presentation, self-reports, diaries, and peer study, students gradually get used to

thinking, analyzing and learning on their own and to a large extent, their initiative and

creativity is encouraged. Judging from the experiment results and students‘ positive feedback,

it is clearly seen that the learner-centered method helps foster learner autonomy and proves to

be rewarding and contribute to more effective language teaching in China.

1. A Brief History of Language Teaching

Language teaching has changed over centuries, affected by many theories about the learning

and teaching of languages. The approach to foreign language teaching originated from the

teaching of Latin later became known as the Grammar-Translation Method, which dominated

European and foreign language teaching from the 1840s to the 1940s, and in modified form it

continues to be widely used in some parts of the world today. The period from the 1950s to

the 1980s has often been referred to as ‗The Age of Methods,‘ during which a number of

detailed prescriptions for language teaching were proposed.

The development of methodology has impacted greatly on foreign language teaching in

China. The Grammar-translation method has the longest history in China‘s foreign language

teaching. However, with China‘s economic development and the adoption of open up policy,

more emphasis is put on students‘ integral language ability rather than their reading ability.

Therefore, the communicative method gradually gained much attention in foreign language

teaching. In view of the advantages and disadvantages of the two methods and given the

special situation of Chinese language teaching, many teachers combine their strong points,

together with other methods, including the audio-lingual method, and use an integrative

method called the eclectic method, which is a result of seeking compromise solutions to meet

the needs of Chinese students, supposed to be flexible and capable of fitting for various

teaching situations, in the hope of bringing the advantages of many methods into full play.

Although the eclectic method does have some positive effects on Chinese language teaching

and learning, whether the actual application of this method has really demonstrated the

advantages still leaves room for discussion. As for one of the teaching objectives, i.e. to

encourage students‘ creativity and cultivate their learning autonomy, the present eclectic

teaching method is not fully satisfactory.

47

FLLT 2011 Proceedings

2. Current ‘Teacher-centered’ Mode in Chinese Language Classes

A survey was carried out among fifty college English teachers and a hundred and fifty college

students. Among the fifty teachers, twenty were from Southeast University, twenty from

Nanjing Normal University, ten from other universities in Nanjing. Among the students

investigated, fifty were from Southeast University, fifty from Nanjing Normal University,

fifty from other universities.

The same question was designed for both students and teachers:

What’s the percentage of the teacher’s prelection in class?

Table 1 shows the result with the university teachers.

Item Number of teachers Total number Percentage

21-40% 2 50 4%

41-60% 10 50 20%

61-80% 26 50 52%

Over80% 12 50 24%

In this table, ‗Item‘ lists the percentage of teacher‘s prelection during a comprehensive lesson period. ‗Number of teachers‘ refers to the

respective number of the teachers who chose the percentage in the same row. ‗Total number‘ is the total number of teachers investigated. ‗Percentage‘ lists the respective statistical percentage of the teachers who chose the corresponding prelection percentage.

Table 2 shows the result with the university students.

Item Number of the

students

Total

number Percentage

21-40% 8 150 5.3%

41-60% 30 150 20%

61-80% 68 150 45.3%

Over80% 44 150 29.4%

In this table, ‗Item‘ lists the percentage of teacher‘s prelection during a comprehensive lesson period. ‗Number of students‘ refers to the respective number of the students who chose the percentage in the same row. ‗Total number‘ is the total number of students

investigated. ‗Percentage‘ lists the respective statistical percentage of the students who chose the corresponding prelection percentage.

According to the survey conducted among local universities and the author‘s observation in

class, it can be easily seen that the current English teaching in Chinese universities is mostly

‗teacher-centered‘. The teachers explain the text for most of the time, supplemented with a

certain number of communicative language activities, while the students‘ main task is to listen

to the teacher and take notes. Both teachers and students admit that although there are some

language activities in class, the teacher‘s prelection takes up most of the time.

48

FLLT 2011 Proceedings

Understandably, this ‗teacher-centered‘ teaching method results from many reasons. As most

college language tests, like CET 4 and CET 6, take the form of reading comprehension and

writing, the teachers, therefore, have to lay more emphasis on grammar and word studying.

Additionally, the comparatively big size of Chinese university classes makes it difficult to

carry out many activities.

Whereas, the teacher-centered mode poses problems to students, especially to their learning

autonomy. The students may see knowledge as something to be transmitted by the teacher

rather than discovered by themselves. They tend to rely on their teacher solely, and therefore,

are less autonomous, more dependent on authority figures and more obedient and conforming

to rules. As for the teaching process, it is rather mechanical, and the classroom atmosphere

dull and tense. As a result, students‘ oral proficiency is rather weak and they lack the

motivation, or autonomy in learning.

In short, the teacher-centered method cannot serve as a satisfactory way to achieve our

teaching goal. Rather than facilitate student‘s learning, it reduces the student from an

autonomous leaner, and creative and critical thinker to a mechanical recipient of knowledge.

Not only is this result at odds with our country‘s educational goal, but it will hamper students‘

improvement in the long run.

3. Learner Autonomy and Learner-centered Teaching Method

Leni Dam (1990), drawing upon Holec(1981), defines autonomy in terms of the learner‘s

willingness and capacity to control or oversee his own learning. Learner autonomy has many

synonyms, such as ‗independence‘, ‗language awareness‘, ‗self-direction‘, etc. An

autonomous learner takes an active role in the learning process, generating ideas and availing

himself of learning opportunities, rather than simply reacting to various stimuli of the teacher.

He is a self-activated maker of meaning, an active agent in his own learning process. Learning

is seen as the result of his own self-initiated interaction with the world.

Promoting learner autonomy is a trend in current language teaching. Many scholars believe

that firstly, learning by its very nature is autonomous. Nobody can make a person learn and

indeed no one can memorize facts, understand ideas or practice skills for him. Secondly,

interest and commitment are self-generated and any attempts to impose or negate them

interfere with learning.

In view of the defects brought about by the teacher-centered method and in an effort to

promote learner autonomy, this paper proposes a teaching method that focuses on the learner:

the ‗learner-centered‘ teaching method.

The learner-centered method is based on certain theories of teaching methodology, especially

the theories of the eclectic method, but aiming at better bringing these theories into effect,

with an eye to Chinese students‘ actual situation. This method encourages students to

independently think, analyze and induce the rules of a language, in order to develop their

ability in analyzing, reasoning and generalizing. The method also aims at improving the

learners‘ listening and speaking competence. The most noticeable difference is that the

learning process is left to the learners themselves and the spoon-feeding teaching mode is

replaced by a format of students‘ autonomous study or collaboration between themselves.

Through various classroom activities, students gradually get used to thinking, analyzing and

49

FLLT 2011 Proceedings

learning on their own and to a large extent, their initiative and creativity is encouraged. The

learner-centered method is to involve the learners into as many kinds of learning activities as

possible and ultimately activate their autonomous learning.

In a student-centered classroom, the teacher‘s role has changed. He is supposed to be an

investigator and analyst, inquiring into and analyzing his students‘ needs. He is to organize

various kinds of classroom activities and facilitate these activities to be carried out. Therefore,

he is an organizer and facilitator. The studying process is left with the students and the teacher

just stands by and listens, observing students‘ behavior in class, giving help and instruction

when necessary. The teacher can also be an independent participant within the learning-

teaching group, encouraging the interaction of the students with the teacher. Moreover, other

roles assumed for teachers are researcher, monitor, counselor, inspirator, and group process

manager.

As for the role of students in a student-centered class, their role is changed from a passive one

into an active one. In order to cultivate their autonomous learning, they are assigned various

tasks to fulfill. In a sense, the students are more like the teacher than the teacher himself. In

communicative activities like pair or group discussion, the role of the learner is a negotiator.

Peer study is encouraged and the students are supposed to be responsible for not only their

own study, but each other‘s.

The following is the experiment the author carried out to foster learner autonomy. From

March to July in 2010, the author taught reading comprehension course to two similar classes

of second-year non-English majors in Southeast University. In the tentative program to

promote learner autonomy among the students, various activities were tried in the experiment

class, called Class A, with students as the focus of each activity. In the controlled class, Class

B, the traditional teacher-centered method was used to give the lesson. The purpose of the

experiments was, through comparison between the classes, to prove the learner-centered

method had an effect on fostering students‘ learner autonomy and to find out how effective

the method was. Some of the actual activities used to foster learner autonomy included:

Peer teaching and correction: The class was divided into groups of four to five

students and each student had a chance to teach the class. Each time before learning a

new lesson, the text was divided up by the teacher into several parts and each group of

students were told in advance to be responsible for one particular part. The task of a

group can be getting background information of the text, studying several paragraphs

of the text, including new words, grammatical rules, or explaining the organization of

the text or the author‘s writing style. Preparation work was done before class through

teamwork.

Students were also made to correct each other‘s work and through finding and

correcting others‘ mistakes, they would learn from their fellow students and be

expected to cultivate an awareness of the language rules, forms, style, etc., and in turn,

become autonomous and sensible in the language learning process.

50

FLLT 2011 Proceedings

Oral presentation: Oral presentation, an effective communicative activity, can be used

to promote oral proficiency in a student-centered class. Students were asked to be

responsible for their own behavior and learning., Students felt a drastic change when a

teacher atced as facilitator of learning: preparing detailed guidelines, organizing

groups, helping students to select topics, guiding their research and helping them learn

the use of various visual aids. Also the teacher was supposed to provide feedback on

the students‘ performance and sequent evaluation.

The oral presentation was met with warm enthusiasm from students and helped

improve students‘ oral ability. Although it takes some time in class and may have

certain constraints, with structured planning and organization, oral presentation can be

a beneficial and enjoyable activity with learners. If properly guided and organized, it

provides a learning experience and teaches life long skills that will be beneficial to

learners in all school subjects as well as later in their careers. The advantages of oral

presentations for the students are: bridging the gap between language study and

language use; using the four language skills in a naturally integrated way; helping

students to collect, inquire, organize and construct information; enhancing team work;

and helping students become active and autonomous learners.

Self-reports: According to Wenden (1998:79-95), a good way of collecting

information on how students go about a learning task and helping them become aware

of their own strategies is to have them report what they are thinking while performing

it. This self-report is called introspective, as learners are asked to introspect on their

learning. In this case, ‗the self-report is a verbalization of one‘s stream of

consciousness‘ (Wenden, 1998:81). Another type is called retrospective self-report,

since learners are asked to think back or retrospect on their learning. Retrospective

self-reports are quite open ended, in that there is no limit put on what students say in

response to a question or statement.

Directly after oral presentation, students were required to write self-reports, which

provided an ideal way for them to reflect on their task-fulfilling procedure. Many

students wrote about the hard work and much time devoted to the oral presentations,

as well as the techniques involved. This post-presentation activity, therefore, can be

used to raise awareness of learners‘ strategies and learner autonomy. As Wenden

(1998: 90) observes, ‗without awareness learners will remain trapped in their old

patterns of beliefs and behaviors and never be fully autonomous‘.\

Diaries: Diaries help learners in that they offer them the possibility to plan, monitor,

and evaluate their learning. Keeping a diary can help learners identify any problems

they run into and suggest solutions. If self-report is about certain strategies adopted

and reflection on specific activities, the topics of diaries are open-ended.

Diaries help raise the students‘ awareness of their learning and more happily, diaries

facilitate students‘ learning by extending the learning process to after-class period and

therefore benefit the students in the long run. Some students may develop the habit of

keeping a diary or something similar to record their learning, their thoughts, and their

life.

51

FLLT 2011 Proceedings

4. Evaluation and conclusion

The evaluation took the form of two tests, one pre-experimental test at the beginning of

experiment, and one post-experimental test at the end.

Table 3 Data of the pre-experimental test

Item

Number

of

students

Average

score

Number

of

passing

Rate of

passing

Number

of

excellence

Rate of

excellence

Controlled group

(Class B) 41 64.6 35 85.4% 1 2.4%

Experimental group

(Class A) 44 63.8 37 84.1% 0 0

Table 4 Data of the post-experimental test

Item

Number

of

students

Avera

ge

score

Number

of

passing

Rate of

passing

Number

of

excellence

Rate of

excellence

Controlled group

(Class B) 41 72.9 38 92.7% 9 21.9%

Experimental group

(Class A) 44 78.3 43 97.7% 19 43.2%

The two test papers were both chosen randomly from the papers of simulated College English

Test, Band Three. So accordingly, the levels of the two test papers were almost the same.

Since the levels of the two tests and of the students were very similar, it can be concluded that

the reason for the difference of the two groups‘ results in the post-experiment test most

probably lies in the adoption of the new teaching method: the learner-centered method.

The learner-centered teaching method can create a more comfortable classroom atmosphere

and a closer relationship between the teacher and students. In a learner-centered class, the

teacher‘s role is not that of an authority, but a facilitator, a counselor, or a friend of the

students, and more interaction between the teacher and students is encouraged. Gradually,

students are used to exchanging their ideas and thoughts with the teacher from time to time

and it is easy for the teacher and students to establish a kind of rapport.

Results of the experiment show that this teaching method does help foster learner autonomy

to a considerable extent. However, concerning the experiment, the whole process lasted only

five months (from March 2010 to July 2002), five months‘ of learner-centered teaching seems

not long enough to change their learning habits completely. Moreover, learner autonomy, in a

sense, is the language awareness, a psychological matter, of the language learner. It is more

difficult to measure and record in exact figures than other skills such as a learner‘s vocabulary

and his grammatical knowledge. However, learner autonomy is embodied in and can be

perceived through the students‘ learning process and the rise of the students‘ marks in the

exams serves the most tangible and direct evidence to indicate an improvement of learner

autonomy.

52

FLLT 2011 Proceedings

To promote learner autonomy is to be aware of, and identify, one‘s strategies, needs, and

goals as a learner, and to reconsider and refashion approaches and procedures for optimal

learning. By adopting the learner-centered teaching method, it is hoped that the effectiveness

of students‘ learning may be enhanced. To be actively involved in the process of learning, the

student may set his own objectives, and by working independently of the teacher, he may

realize a sense of autonomy and select the strategies best suited to the occasion. This will be

worthwhile and very valuable for the learner. As Holyoake (1892: 4) succinctly put it,

‗knowledge lies everywhere to hand for those who observe and think‘.

References

Benson, P. & Voller, P. 1997. Autonomy and Independence in Language Learning. London:

Longman.

Dam, L. 1990. Learner Autonomy in Practice. In Gathercole, I. (ed.). 1990, p. 16. CILT.

Great Britain: Bourne Press.

Holec, H. 1981. Autonomy in Foreign Language Learning. Oxford: OUP.

Holyoake, J. 1892. Sixty Years of An Agitator's Life. (2 vols.). London: Unwin.

Hunston, S. & Oakey, D. 2010. Introducing Applied Linguistics:Concepts and Skills. New

York: Routledge.

Pemberton, R., Toogood, S. & Barfield, A. 2009. Maintaining Control: Autonomy and

Language Learning. Hong Kong: Hong Kong University Press.

Rodgers, T. S. 2001. Language Teaching Methodology. Hawaii:University of Hawaii.

Wenden, A. 1998. Learner Strategies for Learner Autonomy. Great Britain: Prentice Hall.

About the Authors

ZHU SHANHUA, female, associate professor of applied linguistics, MA supervisor,doctorate candidate in arts, graduating from Nanjing Normal University with a Master‘s

degree in 1998, has been engaged in English teaching, researching and management in

Southeast University since then. Research Interests: applied linguistics, Second Language

Learning and Teaching, anthropological linguistics and Cross-cultural Communication.

CHEN MEIHUA, female, professor of applied linguistics, MA supervisor, doctorate

candidate in education management, has been teaching English as a foreign language in

Southeast University since 1985. She obtained the Master of Education from the University of

Sydney in 2006. She has published over 10 research papers and compiled over 20 English

course-books.

53

FLLT 2011 Proceedings

Dyadic Interaction in Writing: On-line or Off-line Feedback?

Mehran Davaribina & Biook Behnam

Islamic Azad University, Tabriz Branch, Iran

[email protected] & [email protected]

Abstract

Recent theoretical as well as pedagogical developments such as Interaction Hypothesis and

Social Constructivism have led to the introduction of pair work into language classes.

Nevertheless, few studies, with conflicting findings, have examined how fruitful the

introduction of peer feedback to the writing practice can be. This study was an attempt to

make a comparison between the qualities of student texts under two different types of

feedback: on-line feedback, in which peers swap feedback orally while jointly developing a

paragraph and off-line feedback, in which the peers provide feedback on each others‘ writing

once they have developed a paragraph individually. Forty-four sophomores in two intact

classes participated in this study, each class practicing one feedback type. A split-plot

ANOVA was conducted to assess impact of two different interventions (on-line vs. off-line

feedback) on participants‘ writing quality, across two time periods (pretest and posttest).

There was no significant interaction between feedback type and time. However, there was a

substantial main effect for time with both groups showing an improvement in writing test

scores across the two time periods. The main effect comparing the two types of intervention

was not significant suggesting no difference in the effectiveness of the feedback type.

Introduction

The importance of giving feedback to student writing is now an issue which is accepted

extensively throughout the writing literature. There are, however, a variety of factors that can

guarantee the success of this feedback or make it a failure. One factor is who is going to

provide the feedback. Traditionally the teacher has been regarded as the only figure justified

to provide feedback on student texts.

It is now commonly accepted that teacher response is an essential step in the writing process.

Numerous studies have demonstrated the efficacy of various kinds of teacher feedback in

improving the accuracy and fluency of L2 students‘ writings (Ashwell, 2000; Ferris, 1997;

Ferris & Roberts, 2001). On the other hand, for many years, the unique benefits that language

learners could provide each other were ignored in L2 writing classrooms. This idea has given

rise to peer response as part of the process approach to teaching L2 writing. It involves

students reading, critiquing and providing feedback on each others‘ writing (Hu, 2005). Peer

feedback, according to Bartels (2003), is ―a key component in the process approach to

composition. It is also known as peer review, peer response, peer editing, and peer evaluation,

in which students read each other‘s papers and provide feedback to the writer, usually

answering specific questions the teacher has provided‖ (p. 34).

The idea of incorporating peer response in writing instruction is manily motivated by two

theoretical movements, namely, Long‘s interaction Hypothesis and Vygotsky‘s Social

Constructivist perspective on learning.

54

FLLT 2011 Proceedings

The Interaction Hypothesis

It follows from the Interaction Hypothesis, whether in its early or late form, that what is

important for acquisition is the opportunity for learners to engage in meaning negotiation.

Researchers such as Doughty and Williams (1998), Lighbown and Spada (1990, as cited in

Lantolf, 2000), Lyster and Ranta (1997) and others have explored how interaction provides

opportunities for learners not only to negotiate the message of the input, but to focus on its

form as well. Other researchers, for example, Aljaafreh and Lantolf (1994) and Nassaji and

Swain (2000) have explored the nature and type of feedback that will be most helpful to

learners during interaction at different stages of their acquisition of a language form.

Collaboration and the Building of Knowledge: Insights from Sociocultural Theory

According to sociocultural theory, human cognitive development is a social activity mediated

by language (Vygotsky, 1978, as cited in Garcia Mayo, 2007), that is, knowledge is socially

constructed by interaction and is then internalized. Individuals learn how to carry out a new

function with the help of an expert and then they can perform it individually. Through

interaction, learners regulate or restructure their knowledge; therefore, learning, cognition and

interaction are closely connected.

The beneficial effects of peer comments have been outlined by a number of researchers in L1

writing (e.g., Gere & Abbot, 1985; Kroll & Vann, 1981, as cited in Tsui & Ng, 2000) and L2

writing (e.g., Chaudron, 1984; Keh, 1990; Tsui & Ng, 2000).

Despite a number of benefits, however, it has received some criticism, which casts doubt on

the benefits of this instructional procedure in teaching writing. One drawback is that in peer

review the focus is mainly on the product of writing (hence termed off-line feedback in this

study) and the process of writing remains to be a private activity (Storch, 2005). In L2

contexts in particular, a number of studies (e.g., Lockhart & Ng, 1995; Wigglesworth &

Storch, 2009) have shown that when students are asked to peer review, they tend to focus on

errors at the sentence and word level. Collaborative writing was suggested to alleviate the

problem. In collaborative writing all group members co-author the written work together. In

fact, they collaborate throughout the writing process and have joint responsibility over

different aspects of the text produced. Research findings concerning the benefits of

collaborative writing have been positive (e.g., Kim & Mc Donough, 2008; Storch, 2002;

Swain & Lapkin, 1998).

Despite all the benefits elaborated on in the literature for peer feedback as well as the

feedback learners receive in collaborative writing (on-line feedback; henceforth), when it

comes to practice, teachers often notice that some students resent pair work in any form and

refrain from joint work on tasks which require written output. In cases like this the question

that arises is to what extent, if any, teachers should incorporate off-line or on-line feedback

into their instructional practice. Put more specifically, can providing a fair mixture of both

teacher- and on-line feedback on the one hand and teacher and off-line feedback on the other

improve writing ability? One major concern of the present study was to make a comparison

among these two types of feedback, namely off-line plus teacher feedback (FTF) and on-line

plus teacher feedback (NTF) and explore how these feedback types can affect the quality of

student texts. More specifically, the following research questions were posed:

55

FLLT 2011 Proceedings

1. Does peer feedback (irrespective of its type) improve writing quality significantly?

2. Does type of feedback (FTF or NTF) have a differential impact on the quality of

writing?

3. Does the interaction between time and feedback type affect the quality of writing

significantly?

Method

Participants

Forty four sophomores (two classes) majoring in English language and literature served as the

participants of the study. They were predominantly girls and ranged between 19 to 25 years of

age. The study was performed with intact groups because students are assigned to classes on a

self-selection basis. There were about 30 students in each class. However, matching limited

the number of subjects to 22. Put another way, only 22 students in each class had a chance to

be included in the study.

Moreover, a colleague experienced in teaching and assessing writing scored 50 percent of the

pretest papers. This was done to ensure that scores assigned enjoyed a reasonable amount of

reliability.

Procedure

Common Steps Taken in Both Classes

Michigan Test was administered to all participants in two classes to determine their

proficiency level. The learners in two classes were then matched based on their proficiency

scores. This was to make sure that the groups were comparable enough to begin with. As

mentioned above this confined the number of participants in each class to 22.

Second, the students received some instructions concerning the structure and organization of a

well developed descriptive paragraph and points to consider in writing such paragraphs. After

this stage, the learners wrote a paragraph of 150 words in 40 minutes on a descriptive topic to

serve as the pretest of the study.

Third, prior to participating in peer feedback activities, the students were trained on the

guidelines for preparing EFL students for such activities, which was suggested by Berg

(1999). This was conducted to make sure that learners would adopt the best possible patterns

of collaboration.

A researcher-made peer response sheet with nine questions was also provided for each

participant. Since the posttest paragraphs were going to be corrected analytically using

Jacob‘s (1981, as cited in Weigle, 2002) rating scale, care was taken to establish a reasonable

relationship between the band scores in the scale and the researcher-developed peer response

sheet. The learners were informed that these questions would serve as the basis of their

feedback to their peers‘ text.

56

FLLT 2011 Proceedings

Group-specific Steps

1. FTF group: Following the training session, two student papers from previous terms

were considered and the peer response sheet was completed by the teacher to show the

process in practice. Next, the learners in this group were asked to develop a paragraph

of 150 words in 40 minutes individually. All students handed in their essays to their

peers who were expected to provide written corrective feedback through completing

the peer response sheet. Next, peers swapped the completed sheets as well as the

commented on papers and discussed their comments, a process called oral peer-

response session. Here, they discussed their comments and the feedback they had

provided on each other‘s paragraphs. After this stage, the teacher collected the papers

to provide further comments at home. The next session the teacher returned the papers

and asked the learners to incorporate their peers‘ as well as the teacher‘s comments

and write the final draft of their paragraph. This multi-draft writing cycle was

practiced for 5 sessions with five different writing topics.

2. NTF groups: Once the training was offered, learners in this class were paired similar

to FTF group (self-selection basis), but here members in each pair co-authored a single

paragraph, i.e. they wrote collaboratively and any feedback was presented orally

during the writing process. It should be noted that the learners in this group also

received the peer response sheet but they were strongly advised not to answer the

questions, rather they were expected to use these questions as a basis to provide on-

line feedback. To make time-on-task equal across the groups, pairs in this group were

assigned more time – 70 minutes – compared to FTF group to write the paragraph, at

the end of which period the papers were collected to receive teacher feedback at home.

The next session the teacher returned the corrected papers and asked the learners to

revise their paragraphs incorporating the teacher‘s feedbacks. This cyclical process

went on for 5 sessions.

Once the treatment sessions were over, all the participants sat the posttest in which they

developed a descriptive paragraph of 150 words under time constraint (40 minutes) on the

same topic as the pretest. The results were analyzed for possible differences in the writing

quality among the groups.

Data Analysis and Results

Depending on the data type collected, a number of statistical analyses and measures were

employed. First, as it was mentioned earlier learners in two groups were matched based on

their proficiency level. Table 1 shows the descriptive statistics for the scores on Michigan test

after the subjects were matched.

Table 1. Descriptive Statistics for Scores on Michigan Test

Type of Feedback N Mean Std. Deviation Std. Error Mean

Michigan Test NTF group 22 41.7727 10.09447 2.15215

FTF group 22 42.7727 11.89210 2.53540

57

FLLT 2011 Proceedings

A t-test was run, as a double-check, to make sure there was no significant difference between

the groups to begin with. As Table 2 shows there was no statistically significant difference

between the groups (t=-.301, p=.77).

Table 2. T-Test on Michigan Performance Levene's Test

for Equality of

Variances

t-test for Equality of Means

F Sig. t df Sig. (2-tailed)

Michigan

Test

Equal

variances

assumed

.938 .338 -.301 42 .765

As mentioned earlier to make sure the score assigned to the texts in pretest and posttest were

reliable enough 50 percent of the pretest papers were corrected by a second writing expert.

The inter-rater reliability was investigated using Pearson product-moment correlation. There

was a strong positive relationship between two set of scores (r=.78, p<.05).

Finally, in order to answer the research questions and assess the impact of two types of

feedback—on-line versus off-line—on the participants‘ writing quality across two time

periods (pretest and posttest), a split-plot ANOVA was run. Table 3 indicates the descriptive

statistics for the students‘ scores on pretest and posttest.

Table 3. Descriptive Statistics for Scores on Pretest and Posttest Type of feedback Mean Std. Deviation N

Pretest

On-line feedback 14.8182 2.59370 22

Off-line feedback 15.0909 2.63509 22

Total 14.9545 2.58758 44

Posttest

On-line feedback 15.5909 2.19651 22

Off-line feedback 15.6364 1.94068 22

Total 15.6136 2.04844 44

And Table 4 below shows the influence of within-group (time) as well as between-group

(feedback type) variables of the study.

Table 4. Split-plot ANOVA for the Main Effects and Their Interaction

Source df Mean Square Wilks‘

Lambda F

Partial Eta

Squared

Time * Feedback type 1 .284 .995 .227 .005

Feedback type 1 .557 - .056 .001

Time 1 9.557 .846 7.622** .154 **p< 0.01

It is evident from Table 4 that there was no significant interaction effect between feedback

type and time (Wilks Lambda = 1, F (1, 42) = .23, partial eta squared = .005). Figure 1 is the

line graph depicting mean pretest and posttest scores. The lines do not cross suggesting lack

of interaction effect. So the answer to the third question of the study is negative. Examining

the between-subject variable, feedback type, indicates that the answer to the second research

question is also negative meaning that type of feedback, NTF or FTF, do not improve the

writing quality significantly differently (F (1, 42) = .557, partial eta squared = .001).

58

FLLT 2011 Proceedings

Figure 1. Line graph for scores on pretest and posttest

Also, Table 4 indicates that there was a substantial main effect for time, (Wilks Lambda = .85,

F (1, 42) = 7.62, p = .009). This means that receiving feedback, irrespective of its form,

influences the quality of student-written texts over time.

Discussion

This study was an attempt to investigate the efficacy of two types of feedback, on-line versus

off-line, on the improvement of students‘ writing quality. The findings indicated that both

types of feedback can contribute to the writing improvement in a significant way. Put another

way, they can improve the quality of writing over time. However, the amount of variation that

these feedbacks created was not statistically significant though on-line feedback was rather

more beneficial in this regard.

Very similar findings have been reported regarding the benefits of dyadic interaction and

peer-peer collaboration for L2 learning (e.g., de Guerrero & Villamil, 2000; Kim &

McDonough, 2008; Leeser, 2004; Storch, 1999, 2001, 2002; Watanabe & Swain, 2007).

One explanation for why there were increases in the writing ability of the participants who

performed dyadic interaction is that they had ―opportunities for learning‖ (Lantolf, 2000) or

―affordances‖ (van Lier, 2000). This is in line with what researchers have already found

regarding the benefits of pair work (e.g., Kowal & Swain 1994; Swain & Lapkin, 1998;

Villamil & de Guerrero, 1998).

It must be noted that the present study involved a small sample size and was conducted in a

controlled classroom setting. Before extrapolating from the results of the study to other

settings and situations, more research is required with other types of learners and in other

learning contexts. It is hoped that this study sheds some light on the complex nature of peer-

peer interaction and its importance to L2 learning.

References

Aljaafreh, A. & Lantolf, J.P. (1994). Negative feedback as regulation and second language

learning in the zone of proximal development. The Modern Language Journal, 78, 465-483.

59

FLLT 2011 Proceedings

Ashwell, T. (2000). Patterns of teacher response to student writing in a multipledraft

composition classroom: Is content feedback followed by form feedback the best method?

Journal of Second Language Writing, 9, 227-258.

Bartels, N. (2003). Written peer response in L2 writing. English Teaching Forum, 41(1), 34-

36.

Berg, E. C. (1999). The effects of trained peer response on ESL students' revision types and

writing quality. Journal of Second Language Writing, 8, 215-241.

Chaudron, C. (1984). The effects of feedback on students‘ composition revisions. RELC

Journal, 15(2), 1-14.

de Guerrero, M. C., & Villamil, O. S. (2000). Activating the ZPD: Mutual scaffolding in L2

peer revision. The Modern Language Journal, 84, 51-68.

Doughty, C., & Williams, J. (Eds.). (1998). Focus on form in classroom second language

acquisition. New York: Cambridge University Press.

Ferris, D. R. (1997). The influence of teacher commentary on student revision. TESOL

Quarterly, 31, 315-339

Ferris, D. R., & Roberts, B. (2001). Error feedback in L2 writing classes: How explicit does it

need to be? Journal of Second Language Writing, 10, 161-184.

Garcia Mayo, M.P. (2007). Investigating tasks in formal language learning. Cromwell Press

Ltd.

Hu, G. (2005). Using peer review with Chinese ESL student writers. Language Teaching

Research, 9(3), 321-342.

Keh, C. L. (1990). Feedback in the writing process: a model and methods for implementation.

ELT Journal 44(4), 294-304.

Kim, Y., & McDonough, K. (2008). The effect of interlocutor proficiency on the

collaborative dialog between Korean as a second language learners. Language Teaching

Research, 12(2), 211-234.

Kowal, M., & Swain, M. (1994). Using collaborative language production tasks to promote

students. Language Awareness, 3(2), 73-93.

Lantolf, J. (2000). Introducing sociocultural theory. In J. P. Lantolf (Ed.). Sociocultural

theory and second language learning (pp. 1-26). Oxford: OUP.

Leeser, M.J. (2004) Leamer proficiency and focus on form during collaborative dialog.

Language Teaching Research, 8, 55-82.

Lockhart, C., & Ng, P. (1995). Analyzing talk in ESL peer response groups: Stances,

functions and content. Language learning, 45(4), 605-655.

60

FLLT 2011 Proceedings

Lyster, R., & Ranta, L. (1997). Corrective feedback and learner uptake: Negotiation of form

in communicative classrooms. Studies in Second Language Acquisition, 19, 37-66.

Nassaji, H., & Swain, M. (2000). A Vygotskian perspective on corrective feedback in L2: The

effect of random versus negotiated help on the learning of English articles. Language

Awareness, 9(1), 34-51.

Storch, N. (1999). Are two heads better than one? Pair work and grammatical accuracy.

System, 2, 363-74.

Storch, N. (2001). How collaborative is pair work? ESL tertiary students composing in pairs.

Language Teaching Research, 5, 29-53.

Storch, N. (2002). Patterns of interaction in ESL pair work. Language Learning, 52, 119-158.

Storch, N. (2005). Collaborative writing: Product, process, and students‘ reflections. Journal

of Second Language Writing, 14, 153-73.

TOEFL writing (TWE) topics and model essays. (2002).

Tsui, A. B. M., & Ng, M. (2000). Do secondary L2 writers benefit from peer comments?

Journal of Second Language Writing, 9, 147-170.

Van Lier, L. (2000). From input to affordance: Socio-interactive learning from an ecological

perspective. In J. P. Lantolf (Ed.), Sociocultural theory and second language learning

(pp. 245-59). Oxford: Oxford University Press.

Villamil, O.S., & de Guerrero, M.C.M. (1998). Assessing the impact of peer revision on L2

writing. Applied Linguistics, 19, 491-514.

Watanabe, Y., & Swain, M. (2007). Effects of proficiency differences and patterns of pair

interaction on second language learning: Collaborative dialog between adult ESL

learners. Language Teaching Research, 11, 1- 22.

Weigle, S. C. (2002). Assessing Writing. Cambridge: Cambridge University Press.

Wigglesworth, G., & Storch, N. (2009). Pair versus individual writing: Effects on fluency,

complexity and accuracy. Language Testing, 26(3), 445-466.

About the Authors

Mehran Davaribina received his MA in TEFL from Iran University of Science and

Technology and is currently a PhD student in TEFL. He has been teaching undergraduate and

graduate levels in the areas of teaching methodology, testing, and research. He has published

several research projects and articles nationally and internationally. His major area of research

concerns Language Skills in general and Writing in particular.

Biook Behnam is Associate Professor of Applied Linguistics in Islamic Azad University,

Tabriz Branch. His current research interests cover Discourse Analysis and Translation

Studies. He is currently on the Editorial Board of the Journal of Asia TEFL and the Journal of

Humanities, University of Tabriz, and has widely presented papers to international

conferences in North America, Australia, Europe, China, India and South East Asia.

61

FLLT 2011 Proceedings

Effective Approach to Macro Skills at the English Department

Max Renyaan & Ifan Iskandar

State University of Jakarta

[email protected] & [email protected]

Abstract

This paper reports on findings of two related classroom researches conducted at the

English Department of State University of Jakarta. The aims of the first study (2006)

were to find out (1) to what extent the integrated-skill approach in use enabled lecturers

to effectively build the four English skills of their students, (2) what communicative

task types were employed to develop the students‘ oral communicative competence.

The study findings then called for a revision of the program resulting in the

implementation of a more discrete-skill approach focusing on each skill and at the same

time integrating the other three skills in the teaching practices. As a follow up, the

second study was conducted (2008) to check (1) whether the mixed-focus approach

enabled lecturers and their students to focus on each discrete skill being taught while

integrating the other macro skills proportionally in their teaching-learning activities, (2)

to what extent communicative tasks were used to develop the student macro skills. To

address the issue, a multi-methodology case study approach (Denscombe, 1998;

Creswell, 1998 & 2008) involving the gathering of both qualitative and quantitative data

was used in both studies. Due to the weaknesses of both approaches, the findings of the

studies favor a blend of the two approaches into a mixed-focus (eclectic) approach

deemed more appropriate to build dependable English proficiency of students at the

English Department.

Nowadays communicative language teaching (CLT) has been widely used at

practically all levels of education. However, in teaching theories and practices the notion

communicative language teaching has been viewed, interpreted and implemented in various

ways according to teachers‘ belief systems of what works well in facilitating language

learning and acquisition in the classroom (Nunan, 2004; Harmer, 2007; Smith & Lovat, 1995;

Richards et al., 1996). In actual teaching practices, especially in building students‘

communicative competence comprising the four macro skills as a tapestry, instructions can be

categorized into two major approaches: integrated-skill approach also known as process-based

approach and discrete-skill or product-based approach (Oxford, 2001; Richards, 2005).

Integrated-skill approach, which includes content-based language instruction and task-

based language instruction, focuses on creating classroom processes believed to effectively

facilitate language learning and acquisition. Specifically, language learning is seen as

resulting from processes such as creating meaningful and purposeful interaction, negotiating

meaning between the learners, paying attention to input and incorporating the new forms into

the learner‘s developing communicative competence, and experimenting with different ways

of saying things In this approach the teacher is expected to integrate language skills

whenever possible, and to be the facilitator of learning as well as the responder to learner

needs (Oxford, 2001; Richards, 2005; Kumaravadivelu, 2006).

On the other hand, discrete-skill approach, which is also known as language-based

approach, considers second language learning as a process of mechanical habit formation

through repetition with an emphasis on language accuracy. Language skills are believed to be

effectively learned when items learned in the target language are presented in spoken form

before being displayed in their written form. Thus, aural-oral training constitutes the

62

FLLT 2011 Proceedings

foundation for the development of other language skills. Consequently, language skills are

presented and practiced in isolation and in rigid sequence: listening, speaking, reading, and

writing. Language learning is seen as a systematic accumulation of pieces of knowledge

obtained through repeated exposure, practice and production, and the focus is more on the

learning outcomes or products to be mastered as the starting point in a course design

(Kumaravadivelu, 2006; Richards & Rodgers, 2001; Richards, 2005). .

In reality, both approaches have weaknesses. Nunan (2004) points out that discrete-

skill approach fails to enable students to communicate effectively in the relatively

unpredictable world although they have a basic foundation of language knowledge and in the

classroom they are able to produce responses in predictable situations of use. Besides that,

language learning is viewed as a linear, incremental, and additive process, and not as a

random, convoluted process (Harmer, 2007; Long & Crookes, 1992). As for integrated-skill

approach, communicative language teaching (CLT) including both task-based instruction and

content-based instruction is quite ineffective in building the learners‘ grammatical accuracy

since their main concerns are language fluency and the content of the subject matter

(Richards, 2005; Harmer, 2007).

Due to the disadvantages, well-informed teachers normally tend to blend the insights

of the two approaches in their professional practices to build their students‘ communicative

competence including their language fluency as well as their grammatical accuracy. Oxford

(2001) maintains that in many ESL or EFL courses labeled by a single skill, the segregation

of language skills tends to be partial or even illusory since a course with a discrete-skill title

may actually involve multiple, integrated skills. Besides that, the discrete-skill approach is

contrary to the fact that in real life people normally use integrated skills in daily

communication. Further, Nunan (1999) also admits that in many contexts, the needs of the

learners determine a primary focus on a particular skill instead of the other three. This does

not mean that those three skills are not practiced by the learners. Consequently, a more

realistic approach to macro skill development would be a mixed-focus or eclectic approach

(i.e, blending both approaches in teaching practices) (Finney, 2002; Brown, 2000; Clark,

1987).

Approaches to Macro Skills at the English Department, SUJ

From 2002 to 2006 the English Department of State University of Jakarta

implemented the integrated-skill approach to the teaching of the four skills (Nunan, 1989,

1999) in accordance with the government policy. Consequently, the complex macro skills

were integrated into particular integrated-skill subjects, namely English for Social Interaction

1 & 2 (ESI) and English for Business Interaction 1 & 2 (EBI) each of which was allocated

three credits per semester. The names of the subjects and the contents were then slightly

changed into English for Social and Interpersonal Interaction (ESII) and English for Business

and Office (EBO) in 2006 (Sulistyawati & Iskandar, 20011); however, the teaching approach

was basically the same. This then resulted in an on-going debate among lecturers given their

dissatisfaction with the effectiveness of the integrated-skill approach.

The main problem here was how to develop the students‘ macro skills up to a high

level of proficiency in a particular integrated-skill subject in a short time. In the English

Department context where each skill should be highly developed, an integrated-skill approach

might not be the right option. The reason is that in actual practice as experienced before, it

was difficult to focus primarily on a specific skill without neglecting the other three skills

given the time constraint. When a certain skill was prioritized, the other three skills tended to

be neglected. What is more, students taking these subjects were generally first year students

63

FLLT 2011 Proceedings

with low English proficiency. Actually as high school leavers with inadequate competence,

the students needed more time and opportunity to develop their respective four skills. Thus,

learning English for one or two semesters (especially for ESII) with an integrated-skills

approach was simply not enough for the students to build a high level of proficiency in each

of the four macro skills.

Therefore, in 2006 the first research project was conducted (Renyaan & Hasra, 2007)

to find out to what extent the integrated approach in use enabled lecturers to effectively build

the four English skills of their students, and what effective communicative task types were

employed to develop the students‘ oral communicative competence. The study findings then

called for a revision of the program resulting in the implementation of a more discrete-skill

approach focusing on each language skill while integrating the other three skills whenever

possible in the teaching practice. In other words, the English skill curriculum was revised to

be a mixed-focus curriculum (Finney, 2002) also known as eclectic curriculum (Brown, 2000)

The following year the second project (Renyaan & Hasra, 2009) was done to check whether

the mixed-focus approach enabled lecturers and their students to focus on each discrete skill

being taught while integrating the other macro skills proportionally in their teaching-learning

activities, and to what extent communicative tasks were used to develop the student macro

skills.

RESEARCH METHOD

The research method used in these two studies was a multi-methodology case study

approach (mixed method) involving the gathering of both qualitative and quantitative data

(Creswell, 1998, 2008; Denscombe, 1998). The data collection methods used were:

observation, interview (teacher & student), document analysis, and survey. However, in the

second study only three methods of data collection were employed: interview (teacher &

student), document analysis, and survey. The data from these multiple approaches were

combined to provide multiple perspectives for each of the research questions. The mixed

method (Creswell (2008) allows findings to be corroborated or questioned by comparing the

data gleaned by different methods (Denscombe, 1998). The opportunity to corroborate the

findings can ultimately enhance the reliability and validity of the data. . Quantitative analyses

corroborated and validated the qualitative analyses through triangulation (Gall et al, 1996;

Huberman & Miles, 1998; Marshall & Rossman, 1999).

Participants of the first study were six lecturers consisting of three males and three

females and their students (N = 98 students) of six classes. Three lecturers taught ESII and

the other three taught EBO. The students were in their first year, and their level of English

proficiency was approximately pre-intermediate level. In the second study the same lecturers

and their first year students (N = 124) were involved. Two lecturers taught Speaking 1, two

taught Listening 1, and the other two taught Reading 1. Writing 1 was not included in this

study since it was not offered in the first semester when the project was conducted.

RESEARCH FINDINGS

Research question 1 (Study1): To what extent do lecturers effectively develop their students’

four skills in an integrated-skills subject such as ESII and EBO?

64

FLLT 2011 Proceedings

Table 1: Low Inference Observational Data – Focusing on Language Skills

(Mean scores shown)

Language skills

Lect. A Lect. B Lect. C Lect. D Lect. E Lect. F

Listening Low inference

High inference

6.33

2.33

6.5

3.75

6.5

3

8

3

8

3.66

6

3

Speaking Low inference

High inference

6

2.33

3.25

2.5

3.5

1.75

7

2.66

8

3

6

2.33

Reading Low inference

High inference

0

1

5

3

5

3

0.5

1.33

0.66

1.66

5

2.33

Writing Low inference

High inference

3.66

2

0

1

0

1

1.75

1.33

4

2

0

1

Scoring: Low inference: 0= extremely low, 1= low, 2-3= fairly often, 4-7= high, 8-12= extremely high -

High inference: 0= extremely low, 1= low, 2= fairly often, 3= high, 4= extremely high

The low inference data in Table 1 show that four lecturers (E, D, F and A) very

frequently helped their students to build their speaking and listening skills to develop their

oral communicative competences. However, they neglected reading skill and/or writing skill.

Lecturers B and C very frequently emphasized the student listening and reading skills and

quite often taught speaking skill, but they neglected the student writing skill. These were

supported by the lecturers‘ interview data and students‘ interview data as well as student

survey data. For example, Lecturer E who taught EBO subject claimed in her interview that

she had integrated all the four skills in her teaching practices. She most frequently focused on

speaking ( X = 8/3) and listening skills ( X = 8/3.66) compared to her other colleagues. The

claim was supported by her four interviewed students, but one of them (Student B) added that

he believed every skill should be given more or less the same portion of emphasis, and that

needed the segregation of the four skills into different discrete-skill subjects.

Similar to Lecturer E, Lecturer A also argued that ESII should be changed into

discrete-skills subject to ensure the student high proficiency. His students supported his view

in their oral interviews and classroom survey. .Lecturer D was of the opinion that teaching

ESII and EBO simultaneously in the first semester was an ineffective strategy. She

commented, ―.… Because this is the English Department, the students should have

dependable English proficiency. Therefore, I suggest that the fist and second years should be

for developing the students‘ grammatical competence and the four macro skills. - minimally

one year or three semesters.‖ Two of her students also supported the change from the

integrated-skill approach to a discrete-skill subject system in order to develop their English

proficiency. Besides, the student survey called for the change to a discrete-skill subject

system ( X = 2.14).

Lecturers B and C argued that they focused more on reading and listening skills.

Lecturer B who highly emphasized listening skill ( X = 6.5/3.75) in his interview said, ―My

students did not have enough opportunities to speak in the classroom since I focused more on

reading skill which I believe very important and essential… .‖ Likewise, Lecturer C argued

that he focused more on listening and reading skills because he did not have enough time. As

he pointed out, ―Three credits are just not enough. ….. Writing, reading, speaking, and

listening should be segregated. There must be a specification.‖

65

FLLT 2011 Proceedings

In conclusion, four out of the six lecturers highly emphasized their students‘ oral

communicative competence and neglected the development of their reading and writing skills,

while the other two stressed reading and listening skills, and they also neglected the other oral

skills. The reasons for neglecting those skills were the lack of time, different individual

belief systems, as well as the complexities of the four macro skills to be treated

comprehensively in a simple integrated-skill subject such ESII. Hence, in general they

suggested a change from ESII to more discrete-skill subjects: listening, speaking, reading, and

writing to ensure the focusing as well as in-depth coverage of each skill, including its skill-

linked learning strategies, with an integrated-skill teaching approach in the teaching practices.

In other words, they called for a mixed-focus curriculum in Finney‘s term (2002). The

lecturers also believed that EBO did not need to be changed since the integrated-skill

approach employed for the subject was appropriate in accordance with the nature of the

subject.

On the other hand, students who were also aware of the weakness in the integrated-

skill approach used in ESII expressed their concerns, criticisms, and suggestions for the

betterment of the teaching-learning activities to improve their English proficiency. Five of the

six classes participating in this study called for the change into discrete-skill subjects:

listening, speaking, reading, and writing. As for EBO students also argued that the subject

did not have to be changed due to the fact that it already covered the four skills presented

systematically in the learning materials. They just pointed out the need to strike a proper

balance among the four skills in the teaching practices.

As a logical consequence of this study, the curriculum reform at the English

Department was implemented. In the teaching of macro skills, ESII subject with its

integrated-skill approach was replaced by discrete-skill subjects combined with an integrated

approach in the teaching practice. In this case, it would be more appropriate to refer to this

blend as a mixed-focus approach or an eclectic approach. Consequently, the second study

was carried out to check the appropriate focusing on each discrete skill being taught while

balancing it with the other macro skills in an integrated teaching strategy in practice. In

addition, the use of communicative tasks in teaching practices was checked as well to see if

the mixed-focus approach could provide more communicative tasks and activities to ensure

the facilitation of the target language learning and acquisition.

Research question 1(Study 2): Does the mixed-focus approach enable lecturers and their

students to focus on each discrete skill while integrating the other macro skills

proportionally in their teaching-learning activities?

In her interview on her teaching of Listening 1, Lecturer One said that she integrated

all skills in her teaching by allocating 25 % for each skill. This was confirmed by a student

interviewee, while the other one gave 70% for listening and 30 % for other skills. However,

student survey data supported the lecturer‘s account ( X = 2). In contrast, Lecturer Two

mentioned that he also incorporated speaking in his teaching, but a student interviewee

maintained that he focused more on listening skill than others, and this was supported by the

survey data.

With regard to Speaking 1, Lecturer Tree claimed in her interview that she integrated

all skills in her teaching of speaking. She commented: ―Yes, certainly. I do incorporate

listening and writing in my teaching. Thus, I start with listening or reading ing material, then I

ask the students to write dialogs. After that, I go on with speaking.‖ As for the proportion

she stated that 70% was for speaking and for the other skills each was allotted 10 %. In

contrast, a student interviewee believed that the proportion should be 60% and 40%. Student

66

FLLT 2011 Proceedings

survey, however, supported the lecturer‘s statement ( X = 1.6). Similarly, Lecturer Four

claimed that he also integrated all skills in his teaching. One of his students confirmed the

lecturer‘s statement by giving the following: speaking 60%, listening 10%, reading 15%, and

writing 15%. The student survey data supported the lecturer‘s claim: ( X = 2).

Finally, concerning the teaching of Reading 1, both Lecturers Five and Six

acknowledged in their interviews that they combined all skills in their teachings. Lecturer

Five allocated 60% for reading, 15% for speaking, 15% for writing and 10% for listening.

The claim was confirmed by students in their interviews as well as survey data ( X = 1.5).

Lecturer Six allotted 70% to reading and 30 % to others. This was confirmed by the two

student interviewees and survey data ( X = 1.4).

In summary, in this mixed-focus approach all lecturers integrated all or at least two

macro skills in their teaching practices, but they could focus on their respective discrete skills

proportionally. Despite the fact, Lecturer Two was quite extreme in overemphasizing his

listening subject. He integrated some amount of speaking skill but quite neglected the other

skills.

It is assumed that in this kind of mixed-focus approach lecturers can cover all

necessary skill-related learning strategies and other micro skills such as pronunciation and

grammar, provide students with a lot of language input and output involving students in

interactions and negotiations of meaning as well as experimentations with different ways of

saying things. Thereby, they can internalize the language items noticed, develop their fluency

as well as a higher level of English proficiency as the ultimate goal.

Research question 2 (Study1): To what extent do lecturers make use of effective task types

to build their students’ oral communicative competence?

Table 2: Low Inference Observational Data - Tasks Provided by Lecturers in their Teaching (Mean

scores shown)

Category Communicative Tasks Lect.

A

Lect.

B

Lect.C Lect.

D

Lect.

E

Lect.F

Most effective

tasks

jigsaw 0 0 0 0 0 0

information gap 0 0 0 0 0 2

Less effective

tasks

problem solving 0 0.2* 0 0 0.66* 0

decision making 0 1.7* 0 0 0 0

opinion exchange 0 0.2* 0 0 3.66 0,88*

communic. game 0 0 0 0 0 0

oral presentation 2.66 2 0 3.5 0 0.33

free communication 0 1.2* 1.25* 1* 0.66* 0

question-answer 0 5.5* 1.5* 1.25* 0.66* 3.33*

sharing personal experience 0 0 0 0 0 0.33*

processing info. & using it 0 0 7 0 0 0

selective listening 0 0 2.75 0 83 0.66

taking note 0 0 0 0.31 0.33 0.42

67

FLLT 2011 Proceedings

picture story 0 0 0 0 0 0

listing 0 0 0 0.5* 0.66* 0.42

comparing 0 0 0 0 0 0

diagramming 0 0 0 0 0 0

matching activity 0 0 0 0 0 0.66*

summarizing 0 0 0 0 0 0

ordering & sorting 0 0 0 0 0 0

brainstorming 1* 0.25* 0.25* 0.5* 0.66* 1*

creative task 0.66* 0 0 0 0 0

song 0 0 0 0 0 0

poem 0 0 0 0 0 0

drama 0 0 0 0 0 0

film 0.66 0 0 0 0 0

self-evaluation 0 0 0 0.5* 0.66* 0.66*

Practice com-

munication task

role-play 0 0 0 0 2.33 0

Total 28 4 7 5 7 10 11

Scoring: 0= extremely low, 1= low, 2-3= fairly often, 4-7= high, 8-12= extremely high

* = teacher-fronted strategy

Data in Table 2 show that in terms of the most effective tasks (Pica, Kanagy & Falodun (1993) only Lecturer F quite often made use of information gap ( X = 2), while no

one used jigsaw. This is similar to the findings related to the use of tasks in teaching practices

in junior and senior high schools where teachers hardly used both tasks in their teaching

practices (Renyaan, at al., 2002). In their interviews most lecturers argued that they lacked

time to prepare and use such tasks, and/or they had not paid special attention to those tasks.

Instead, Lecturers A, B, D and F argued that in their views oral presentation was the most

effective tasks because it comprised many learning aspects and strategies such as individual

role, team work, cooperative learning, information gap and role play. Therefore, they tended

to use the task frequently in their teaching practices. They, however, seemed to be unaware

that in oral presentation task the frequency of two-way communication is low.

With regard to less effective tasks, Table 2 data indicate that the lecturers tended to

more frequently use less effective tasks such as brainstorming, oral presentation, question-

answer, opinion exchange and problem solving with open tasks and teacher-centered teaching

strategy where they controlled most of speaking turns and leaning activities of the students.

This certainly reduced the frequency of the negotiation of meaning among the students.

Besides, open tasks such as brain storming and opinion exchange made students discuss the

topics given briefly and drop them when serious problems arise (Long, 1989).

The data in Table 2 above also reveal that Lecturer F used most task (10 tasks) with

teacher-fronted question-answer task with high frequency ( X = 3.33). Lecturer E used 9

tasks where opinion exchange and group work were most frequently used ( X = 3.66),

whereas Lecturer C used only four tasks, the fewest of all, with the task of processing

information and using it extremely frequently ( X = 7); he was very teacher-centered as well

in his teaching strategy. These were all confirmed by lecturer interview data, student

interview data, document analysis data, and survey data.

In practice communication task, where dialog and role-play constitute specific

characteristics, learners are involved in using language actively and meaningfully, but activity

68

FLLT 2011 Proceedings

site, roles, participants, or purpose of activities are normally simulated. As shown in Table 2,

only Lecturer E used dialogs and role-plays quite frequently ( X = 2.33) In her interview the

lecturer acknowledged it, and this was supported by student interview data as well as

document analysis data. As for the other lecturers, they claimed in their interviews that they

also used role-plays in their teaching. This was confirmed by the student interviewees and

student survey data.

In brief, to answer the question above, lecturers were generally unaware of the

classification of task types: most effective tasks, less effective tasks and practice

communication tasks (Pica, Kanagy & Falodun 1993; Renyaan, 2002). As a result,

only one made use of information gap task quite frequently, but others tended to use less

effective tasks such as brainstorming, question-answer, opinion exchange, and problem

solving with open task type and teacher-fronted strategy to build their students‘ oral

communicative competence. Data analysis also revealed, four lecturers also used group work

quite frequently, but two others never use cooperative learning strategy through group work.

This certainly reflects a variation of teaching practices of lecturers because of variation in

their belief systems.

Research question 2 (study 2): To what extent do lecturers employ communicative tasks

through task-based learning materials to build the students’ macro skills in order to develop

their communicative competence?

First of all, data analysis of the second study revealed that practically all lecturers of

respective discrete-skill subjects made use of three types of learning materials as

communication data (Nunan, 1989): text-based, task-based, authentic (realia) learning

materials (Richards, & Rogers, 1986; 2001) to build their students‘ communicative

competence in their respective macro skills. However, in this report only communicative tasks

based on task-based learning materials are highlighted.

The results of data analysis show that all lecturers gave their students communicative

tasks through task-based learning materials with varied frequency. Lecturer One who taught

Listening1 claimed that besides intensive listening activities in the course book (Harmer,

2002), which were related to global or gist listening, listening for specific information, and

inference or listening between the lines (Nunan, 2003), she also gave extensive listening

tasks by assigning students to listen to the radio, watch television (film) and video, and then

report to the class and discuss it further. Unlike Lecturer One, Lecturer Two only provided his

students with listening activities within the classroom. These were confirmed by students in

their interviews. Referring to Lecturer One‘s claim, student survey data confirmed their tasks

of watching videos and films ( X = 2), but did not strongly support the task of listening to the

radio ( X = 3).

As for Speaking1 Lecturer Three claimed in her interview that she used role-play,

information gap, problem solving, opinion gap, and game, but she did not use jigsaw. She

commented, ―Oh, yes, I use all: game, role-play, pair-communication materials. Concerning

information gap, I certainly use it. I often use opinion gap and problem solving as

well, ….but I don‘t use jigsaw.‖ The claim was supported by student interview data and

survey data. Moreover, Lecturer Four said in his interview that he employed role-play, pair

communication materials, oral presentation, and observation and interview that must be

carried out by the students. Besides that, information gap, problem solving, and opinion

exchange were usually used by the lecturer in his teaching activities. As he claimed, ―I often

use presentation, observation and interview. Jigsaw … I don‘t use it because I‘m not very

good in that method.‖ This was supported by students in their interviews and survey data.

69

FLLT 2011 Proceedings

With regard to Reading1, Lecturer Five and Lecturer Six employed intensive reading

within the classroom dealing with comprehension tasks in the course books. They also

assigned students to do extensive reading outside the classroom. Lecturer Five claimed in

his interview that he told his students to read newspapers, magazines, and internet materials

and report them to the class. Similarly, Lecturer Six also had her students read newspapers,

magazines and novels and then report to their peers in groups. The extensive reading

activities above were normally done with low frequency. Both claims were confirmed by

the students in their interviews and survey data.

Clearly, except Lecturer Two, all other lecturers gave various kinds of communicative

activities according to the nature of their respective subjects to develop the students‘

communicative competence. Both lecturers of Speaking1 used information gap and interview

as the most effective task and neglected jigsaw. For less effective tasks they employed

opinion exchange, problem solving, oral presentation, and game, as well as role-play for

practice communication task. All these activities were employed at various levels of

frequency, from low to quite high frequency. Besides, in Listening1 and Reading1 the

lecturers used various kinds of tasks related to both intensive and extensive listening and

reading activities with various levels of frequency as well. In short, activities used here

seemed to be fairly richer and more varied because the discrete skill approach used enabled

lecturers to focus more on activities related to their respective discrete-skill subjects. Thus,

with numerous communicative tasks and activities provided for students by lecturers of

respective discrete skill subjects, students would have much richer language input and output

in the classroom as a learning community, and the impact on their language learning and

acquisition would be much more powerful.

CONCLUSION

The first study revealed that in using the integrated-skill approach to macro skill

lecturers lacked teaching focus, and they tended to fail in building their students‘ dependable

English proficiency in the four skills. In their teaching practices they only emphasized one or

two skills and neglected the other skills because of time constraint, the complexity of the

four macro skills, as well as individual belief systems. They also neglected the most effective

communicative tasks in their teaching practices. Due to the lack of language input and output

in the classroom that resulted in dissatisfactory teaching and learning outcome, both lecturers

and students called for a change from the integrated approach to a mixed-focus approach. In

contrast, the second study, after the change of the curriculum, showed that all lecturers deeply

focused on their respective discrete-skill subjects which they taught and concurrently

developed the other macro skills proportionally using a wider range of communicative tasks.

In brief, a mixed-focus (eclectic) approach, that lumps the discrete-skill approach and the

integrated-skill approach, seemed to be more effective in building the English Department

students‘ macro skills than either of the two approaches by providing students with richer

language input and output to facilitate their language learning and acquisition.

Specifically, results of the second study indicated that in Speaking1 the lecturers could

make use of more speaking tasks including more communicative tasks such as, information

gap, interview, problem solving, opinion exchange, oral presentation, game, and role-play,

except jigsaw, with higher frequency. In both Listening1and Reading1, intensive and

extensive listening and reading tasks and activities were employed by lecturers. This means

that the mixed-focus approach provided more time and opportunities for lecturers and their

students to focus on a certain skill in depth including its micro skills. Thus, this approach

enabled students to be more intensively involved in meaningful interaction, negotiation of

meaning, more attention to input, and experimentation with various ways of expressing ideas.

Thereby, they would be able to build a higher level of proficiency in their macro skills.

70

FLLT 2011 Proceedings

REFERENCES Brown, H.D. (2000). Principles of language Learning and Teaching (4

th ed.). New York: Longman.

Clark, J.L. (1987). Curriculum Renewal in School Foreign Language Learning. Oxford: Oxford

University Press.

Creswell, J. W. (1998). Qualitative Inquiry and Research Design: Choosing Among Five Traditions.

Thousand Oaks, CA: Sage Publications.

Denscombe, M. (1998). The Good Research Guide. Buckingham: Open University Press.

Denzin, N.K., & Lincoln, Y.S. (1998). Introduction: Entering the Field of Qualitative Research. In

N.K. Denzin & Y.S. Lincoln (Eds.), Collecting and Interpreting Qualitative Materials. (pp.1-

17), London: Sage Publications

Finney, D. (2002). The ELT Curriculum: A Flexible Model for a Changing World. In J.C. Richards

& W.A. Renandya (Eds.). Methodology in Language Teaching: An Anthology of Current

Practice. Cambridge: Cambridge University Press.

Gall, M.D., Borg, W.R., & Gall, J.P. (1996). Educational Research: An Introduction (6th ed.). New

York: Longman.

Harmer, J. (2001). The Practice of English Language Teaching. (3rd

ed.).Essex:Pearson Education Ltd.

Harmer, J. (2007). The Practice of English Language Teaching. (4th ed.).Essex:Pearson Education Ltd.

Huberman, M., & Miles, B. (1998). Data Management and Analysis Methods. In N.K. Denzin &

Y.S. Lincoln (Eds.), Collecting and Interpreting Qualitative Materials. (pp.179-210),

London: Sage Publications.

Kumaravadivelu, B. (2006). Understanding Language Teaching. New Jersey: Laurence Earlbaum

Associates. Inc.

Long, M.H. (1989). Task, Group, and Task-Group Interactions. University of Hawaii Working

Papers in English as a Second Language, 8 (2), 1-26.

Long, M.H., & Crookes, G. (1992). Three Approaches to Task-Based Syllabus Design. TESOL

Quarterly, 28 (1), 27-46.

Lovat, T.J., & Smith, D.L. (1995). Curriculum: Action on Reflection Revisited. (3rd

ed.). NSW:

Social Science Press.

Marshall, C., & Rossman, G. B. (1999). Designing Qualitative Research (3rd

ed.). London: Sage

Publications.

Nunan, D. (1989). Designing Tasks for the Communicative Classroom. Melbourne: Cambridge

University Press.

Nunan, D. (1999). Second Language Teaching and Learning. Massachusetts: Heinle & Heinle

Publishers.

Nunan, D. (2003). Practical English Language Teaching. New York: Mc Graw Hill.

Nunan, D. (2004). Task-Based Language Teaching. Cambridge: Cambridge University Press.

71

FLLT 2011 Proceedings

Oxford, R. (2002). Integrated Skills in the ESL/EFL Classroom. ESLO Magazine, Vol. 6. No1,

January/February 2001. (www.esl.mag.com).

Pica, T., Kanagy, R., & Falodun, J. (1993). Choosing and Using Communication Tasks for Second

Language Instruction. In G. Crookes & S. M. Gass (Eds.), Task and Language Learning:

Integrating Theory and Practice (pp.9-34). Clevendon: Multilingual Matters.

Renyaan, M., Hasra, H. (2007). Implementasi Pengajaran Berbasis Tugas untuk Pengembangan

Kompetensi Komunikatif Lisan Mahasiswa Jurusan Bahasa Inggris, Universitas Negeri

Jakarta. Laporan Penelitian. UNJ

Renyaan, M., Hasra, H. (2009). Penggunaan Sumber dan Materi Pembelajaran untuk

Pengembangan Keterampilan Makro Mahasiswa Jurusan Bahasa Inggris, UNJ.

Laporan Penelitian. UNJ

Richards, J.C., Ho, B., & Giblin, K. (1996). Learning how to teach in the RSA Cert. In D. Freeman

& J.C. Richards (Eds.), Teacher Learning in Language Teaching (pp. 242-259). Cambridge:

Cambridge University Press.

Richards, J.C. & Rodgers, T.S. (2001) Approaches and Methods in Language Teaching. Cambridge:

Cambridge University Press.

Richards, J.C. (2005) Communicative Language Teaching Today. Singapore: SEAMEO Regional

Language Centre.

Sulistyawati, E. & Iskandar, I. (20011). ELT and Skill Courses in ELESP UNJ‘s

Curriculum in the Last Ten Years. Research Report. UNJ.

About the Authors

Maximus Renyaan is a lecturer of English and Linguistics at the Department of English

Language and Literature, State University of Jakarta, Indonesia. He received his Doctorate in

Education from Tasmania University, Australia.

Ifan Iskandar is Head of the Department of English Language and Literature, State

University of Jakarta, Indonesia. He is currently a doctoral student of Education at Jakarta

State University.

72

FLLT 2011 Proceedings

Effects of Peer-Tutoring on Students’ Foreign Language Classroom

Fasawang Pattanapichet, Ph.D.

Language Institute, Bangkok University

[email protected]

Abstract

This paper examines the effects of peer-tutoring on the students‘ foreign language classroom

anxiety. The experiment using pretest and posttest design was conducted with 152 students

who joined the Buddy Training Program at Bangkok University and completed 20 hours of

training in the first semester of academic year 2010. The instruments used for collecting the

data consisted of a set of the Foreign Language Classroom Anxiety Scale (FLCAS)

questionnaire, a set of a program evaluation questionnaire in the form of a five-rating scale

and a semi-structured interview with 25 participants. Quantitative data was analyzed using

frequency, percentage, mean, standard deviation, t-test and the Hedges‘ effect size (g) to

examine the effects of the program while qualitative data was analyzed using content analysis.

The findings of the study reveal that peer-tutoring had positive effects on reducing the

students‘ anxiety. They also show a high rating evaluation of the students‘ satisfaction toward

the program. Finally, the study supports the use of the peer-tutoring with some

recommendations for further research.

1. Introduction

Many studies have consistently reported that anxiety could inhibit language learning (Atay &

Kurt, 2006; Cheng, 2001; Horwitz, 2001 ; Kurt& Atay, 2007). Oxford (1999) supported that

language anxiety ranks high among factors influencing language learning, whatever the

learning setting is. Therefore, it has become a focus of any investigation of variables

contributing to the learning process and language learning success (Horwitz, 1990; Dornyei,

2005; Hurd, 2007).

Foreign Language Anxiety is the feeling of uneasiness, worry, nervousness and apprehension

experienced by non-native speakers when learning or using a second or foreign language.

These feelings may stem from any second language context whether associated with the

productive skills of speaking and writing, or the receptive skills of reading and listening (Lin,

2009). Consequently much emphasis has been placed on how to reduce foreign language

anxiety. A variety of methods, approaches, techniques and strategies have been explored and

suggested to create a low anxiety learning environment (Young , 1991 & Nishimata , 2008).

Most of the suggested practices obviously share the same objective--- to promote non-

threatening learning experience to lower their students‘ anxiety. This is because the students

would be more willing to take risks with their learning and actively take part in their learning

process in a relaxing learning atmosphere.

Peer-teaching is one of many powerful tools aiming to create a stress-free learning

environment allowing students to get actively involved in the learning process. Extensive

evidence suggests that the strategy is effective for students with or without disabilities

(Houghton, S. & Bain A., 1992). It has also been used in education internationally in a

number of subject areas for many years (Mackinnon et al., 2009).

73

FLLT 2011 Proceedings

Many definitions have been offered for the term ‗peer-teaching or peer-tutoring‘ depending

on each context in which the approach was applied and referred to. For example, according to

Thomas (1993), peer teaching or tutoring is the process by which a competent pupil, with

minimal training and with a teacher's guidance, helps one or more students at the same grade

level learn a skill or concept. Boud, Cohen & Sampson's (2001) provide another interesting

definition: ―Peer- teaching involves students learning from and with each other in ways which

are mutually beneficial and involve sharing knowledge, ideas and experience between

participants. The emphasis is on the learning process, including the emotional support that

learners offer each other, as much as the learning itself.‖

2. Background of the study

Inspired by the above concepts, Language Institute (LI), Bangkok University (BU) has

originated an idea to provide an extra-curricular activity called ‗Buddy Training Program‘ for

BU students. The key idea is to provide an opportunity for Thai students to practice their

English speaking skills with foreigners in a relaxing atmosphere. By attending the program,

BU Thai students (In this program, they are called ‗trainees‘) are able to practice speaking

English in small groups with native or non-native English speaking (with a good command of

English) trainers recruited from Bangkok University International College (BUIC). They meet

once a week for one hour to participate in various speaking activities. The Buddy Training

Program is a part of the students‘ degree requirement. The trainees are required to complete

20 hours of training within an academic year in order to meet the requirement. The trainees

get to practice communicating casually with their foreign trainers in English through general

talking and various learning activities such as conducting discussion, playing games,

organizing events. They also occasionally received some formal language lessons. Before the

program starts, all of the trainers are required to attend two orientation sessions. They are

provided with a guideline on how to conduct the training sessions. During their first four

weeks of the working sessions, they will be under observation and supervision of an

experienced full-time English teacher.

3. Research objectives:

The research objectives are as follows:

1. To compare foreign language classroom anxiety level of the trainees before and after they

attended the program

2. To examine the participants‘ evaluation of the overall program.

4. Significance of the study:

1. The study will provide insights on the use of peer-tutoring.

2. The study will provide an evaluation for the Buddy Training Program.

5. Methodology

5.1. Participants

The subjects in this study were 152 fourth-year students from School of Science and

Technology. These students participated as trainees in the Buddy Training Program as a

requirement of their degree in the first semester of the 2010 academic year.

74

FLLT 2011 Proceedings

5.2. Research instruments

Three research instruments were employed as listed below:

a. The Foreign Language Classroom Anxiety Scale (FLCAS) questionnaire

Part One: Personal data

Part Two: English Oral Communication Anxiety Scale measurement

The first part asked about personal data .The second part of the questionnaire was the Foreign

Language Classroom Anxiety Scale (FLCAS) questionnaire created by Horwitz, Horwitz &

Cope (1986). It was in a five-point Likert scale, ranging from the most, a lot, moderately,

little and the least. The questionnaire consisted of 33 items. A draft of the questionnaire was

examined by three experts specialized in TEFL. They were asked to check translation from

English to Thai. After that the questionnaire was piloted with 30 students and calculated for

proper reliability value by Cronbach‘s alpha coefficient. The reliability value of the overall

questionnaire was 0.88. The reliability value of the questionnaire from the main study was

also estimated by Cronbach‘s alpha coefficient at a set point of 0.90 implying that the

questionnaire was reliable.

b. The evaluation form to evaluate the Buddy Training Program

The evaluation form used five Likert‘s scales asking the students to indicate their opinions

toward the overall program and the degree to which the program helped them reduce their

anxiety level. The form was validated by experts and the reliability value of the form was

also estimated by Cronbach‘s alpha coefficient at a set point of 0.90 implying that the

questionnaire was reliable.

c. A semi-structured interview

The interview was used for clarification concerning each of the items on the evaluation form.

5.3. Data collection and data analysis

Each of the trainees was required to complete the FLCAS questionnaire before and right after

completing the program. They were also asked to complete the program evaluation at the end

of the program. All of the completed questionnaires were compiled and analyzed using SPSS

program.

The FLCAS score was first analyzed quantitatively for mean. In this study, foreign language

anxiety measured by FLCAS was divided into four components: communication

apprehension (items 1, 3, 4, 9, 13, 14, 15, 18, 20, 24, 27, 29, and 33), fear of negative

evaluation (items 2, 7, 8, 10, 19, 23, and 31), general feeling of anxiety (items 16, 22, 25, 26,

28, 30, and 32), and general reaction toward a foreign language classroom (items 5, 6, 11, 12,

17, and 21). However, as the items 1, 3, 4, 6, 7, 9, 10, 12, 13, 15, 16, 17, 19, 20, 21, 23, 24,

25, 26, 27, 29, 30, 31 and 33 show high anxiety; therefore, strongly agree rates 5 points, agree

is 4 points, neither agree nor disagree is 3 points, disagree is 2 points and strongly disagree is

1 point. On the contrary, items 2, 5, 8, 11, 14, 18, 22, 28, and 32 indicate non-anxiety;

therefore, strongly agree is 1 point, agree is 2 points, neither agree nor disagree is 3 points,

disagree is 4 points and strongly agree measures 5 points. Next, paired-sample t-test was used

to analyze if there was any difference in terms of the mean scores of the students‘ anxiety

level. Then, Hedges‘g method of effect size was calculated for each of the items showing

significant difference.

75

FLLT 2011 Proceedings

As for the evaluation of the program, data was analyzed quantitatively for mean. Later, a

semi-structured interview was conducted with twenty-five trainees to obtain additional

qualitative data which later were analyzed using content analysis.

6. Research findings

This section reports the findings of the following topics:

6.1. Personal Data

Demographic characteristics of the overall participants are reported as follows. 63.8% of the

participants were male while 36.2 were female. Regarding their latest English grades, the

majority of the sample (28.9%) received the grade letter ‗C-‘ while 23 % of the participants

got the grade letter ‗C‘ for their latest English course. The highest grade the participants

received for the latest English course was ‗B‘ (7.9%). In addition, the table illustrates that

48% of the participants assessed their English proficiency as ‗so so‘(C) while 44.1% of them

rated their English proficiency as ‗poor‘ (D). Only 3.3% and 0.7 % rated that their proficiency

as ‗good‘ (B) or ‗very good‘ (A) respectively.

6.2. The effects of the program on levels of Students’ Foreign Language Classroom

Anxiety

To examine whether there is any difference and how significant the difference between the

students‘ anxiety level before and after attending the program, paired-sample t-test and

Hedges‘g effect size were used to analyze the mean scores. Table 2 reports the results of the t-

test. The results are presented according to each category of foreign language classroom

anxiety ranked from the largest to the smallest effect size.

Table 1: The results of t-test

Item

no.

Items

Before the

program

After the

program

Mean

dif

t Sig

(2-

tailed)

g

SD

SD

Communication apprehension

4. It frightens me when

I don‘t understand

what the teacher is

saying in the foreign

class.

3.79 0.79 2.69 1.05 1.09 10.41 .000*** 1.27

large

18. I feel confident

when I speak in the

foreign language

class.

2.77 0.80 3.36 0.67 0.59 6.06 .000*** 1.08

large

9. I start to panic when

I have to speak

without preparation

in the language

class.

3.88 0.84 2.98 1.03 0.14 9.13 .000*** 1.01

large

20. I can feel my heart

pounding when I‘m

going to be called

3.53 0.94 2.84 0.88 0.69 7.15 .000*** 0.83

large

76

FLLT 2011 Proceedings

on in the language

class.

33. I get nervous when

the language teacher

asks questions

which I haven‘t

prepared in advance.

3.61 0.79 3.14 0.71 0.47 5.32 .000*** 0.83

large

13. It embarrasses me to

volunteer answers in

my language class.

3.53 0.84 2.98 0.96 0.55 5.55 .000*** 0.67

medium

14. I would not be

nervous speaking

the foreign language

with native

speakers.

3.09 1.23 3.70 0.96 0.66 5.54 .000*** 0.50

medium

27. I get nervous and

confused when I am

speaking in my

language class.

3.23 0.69 2.93 0.89 0.30 3.32 .001** 0.47

small

29. I get nervous when I

don‘t understand

every word the

language teacher

says.

3.38 .89 3.05 1.18 0.33 2.75 .007** 0.30

small

Fear of negative evaluation

8. I am usually at ease

during a test in my

language class.

2.88 0.75 3.44 0.95 .55 6.09 .000*** 0.76

medium

19. I‘m afraid that my

language teacher is

ready to correct

every mistake I

make.

3.49 0.85 2.92 0.99 0.56 4.87 .000*** 0.66

medium

31. I am afraid that the

other students will

laugh at me when I

speak the foreign

language.

3.25 0.97 2.78 1.04 0.46 4.12 .000*** 0.46

small

23. I always feel that

the other students

speak the foreign

language better than

I do.

3.30 0.94 3.03 1.12 0.26 2.19 0.03* 0.25

small

General feeling of anxiety

22. I don‘t feel pressure

to prepare very well

for the language

class.

2.50 1.03 3.50 0.76 0.94 9.00 .000*** 1.22

large

16. Even if I am well

prepared for the

3.29 0.82 2.74 0.94 0.55 5.23 .000*** 0.70

medium

77

FLLT 2011 Proceedings

language class, I

feel anxious about

it.

25. The language class

moves so quickly I

worry about getting

behind.

3.49 .85 2.92 0.99 0.565 4.87 .000*** 0.70

medium

28. When I‘m on my

way to the language

class, I feel very

sure and relaxed.

2.86 0.82 3.26 1.00 0.40 3.71 .000*** 0.47

small

26. I feel more tense

and nervous in my

language class than

in my other classes.

3.28 1.02 3.03 0.93 0.25 2.20 .029* 0.26

small

32. I would probably

feel comfortable

around native

speakers of the

foreign language.

2.82 0.93 3.32 0.82 0.82 5.01 0.000** 0.65

small

General reaction

17. I often feel like not

going to my

language class.

3.21 1.01 2.68 0.86 0.52 4.73 .000*** 0.60

medium

21. The more I study for

a language test, the

more confused I get.

2.78 0.86 2.46 0.82 0.32 3.28 .001** 0.45

small

5. It wouldn‘t bother

me at all to take

more foreign

language classes.

2.61 0.91 3.01 1.06 0.40 3.51 .001** 0.40

small

12. In the language

class I can get so

nervous I forget

things I know.

3.42 0.82 3.03 1.16 0.38 3.61 .000*** 0.38

small

11. I don‘t understand

why some people

get so upset over

foreign languages.

2.94 0.81 3.21 1.02 0.26 2.40 .018* 0.31

small

p< 0.05*

p< 0.01**

p< 0.001***

Table 1 presents the difference between the students‘ anxiety level, how significant the

difference is including the effect size. It can be seen that most of the items (24 items out of 33

items) show the significant difference of the students‘ anxiety level. This means that peer-

tutoring had positive effect on the students‘ anxiety level. Moreover, it is interesting to find

the items which show the greatest significant difference with the largest effect size all concern

communication apprehension. It can be assumed that peer-tutoring could allow the students to

feel more at ease to communicate in English.

78

FLLT 2011 Proceedings

6.3. Program evaluation

The results of the program evaluation were presented in Table 3.

Table 2: Students’ evaluation of the Buddy Training Program

Items

SD Test value = 3.50

T Sig

2-tailed

Mean

dif

1. I liked the atmosphere

of learning.

3.82

High

0.83 4.80 0.00** 0.32

2. I think after joining the

program my English has

been improved.

3.60

High

1.02 1.26 0.206 0.10

3. I think the program was

useful.

3.58

High

0.95 1.03 0.304 0.03

4. Joining the program

helped reduce my foreign

language classroom

anxiety.

3.66

High

1.01 2.01 0.046* 0.16

5. Overall, I was satisfied

with the program.

3.70

High

0.85 2.85 0.005** 0.20

p< 0.05*

p< 0.01**

According to Table 3, one-sample t-test was used to analyze the data by comparing the mean

score with the test value = 3.5. It is apparent that all of the program evaluation criteria were at

the high level ( ≥ 3.5). This means that the students‘ evaluation of the program was highly

rated. Regarding anxiety reduction, the evaluation was at the high level ( = 3.66) with

significant difference (p< 0.05). As for qualitative data, the 25 trainees were interviewed for

clarification. All of the respondents agreed that joining the program lowered their foreign

language anxiety. All of the respondents had a similar opinion giving all of the credit to

‗relaxing informal learning atmosphere‘ and ‗friendly trainers‘. One of the respondents said

‗It‘s not like learning in a classroom. It was like doing activities with friends. We talked and

shared. The trainers are all our age. I don‘t think of them as teachers.‘ This implies that an age

gap plays a role in the students‘ feeling toward their tutors/teachers. Three students shared a

consistent opinion saying that they felt relaxed since they didn‘t have to worry about being

judged. One of the students also added ‗I was not afraid of making mistakes because I was

among my friends‘. It can be implied that the trainees viewed their trainers as less

authoritative and less judgmental. This encouraged them to take more risks in the classroom.

In terms of the overall satisfaction, all of the respondents also indicated that the program was

useful and they were satisfied with the program. They all agreed that this program allowed

them to get access to authentic situations where they were able to use English with foreigners.

7. Recommendation

The findings of the study support the use of peer-tutoring. It is obviously seen that peer-

tutoring had positive effects on reducing the students‘ anxiety and the overall satisfaction of

the program. Nevertheless, it would be illuminating to examine other effects of peer-tutoring

on the students‘ language performances. A comparative study is recommended to see if there

79

FLLT 2011 Proceedings

is any difference between peer-tutoring and a traditional classroom. Further in-depth

investigation on different characteristics and roles of teachers can also be a great contribution

to foreign language learning development.

Acknowledgement

This research received a financial support from Bangkok University.

References

Atay, D. & Kurt, G. (2006). Prospective Teachers and L2 Writing Anxiety. Asian EFL

Journal, 8 (4), 100-118.

Boud, D., Cohen, R., & Sampson, J. (2001) Peer learning in higher education: Learning from

and with each other, London, Kogan Press.

Cheng, Y.-S. (2001). Learners‘ beliefs and second language anxiety. Concentric: Linguistics,

27 (2), 209-223.

Dornyei, Z. (2005). The Psychology of the language learner: Individual differences in second

language acquisition. New York: Lawrence Erlbaum Associates.

Horwitz, E., Horwitz, M., & Cope, J. (1986). Foreign language classroom anxiety. The

Modern Language Journal, 70 (2), 125-132.

Horwitz, E.K. (1990).Attending to the affective domain in the foreign language classroom. In

S.S. Magnam (Ed.). Shifting the Instructional Focus to the Learner. Middlebury, VT:

Northeast Conference on the Teaching of Foreign Languages, 15-33.

Horwitz, E.K. (2001). Language Anxiety and Achievement, Annual Review of Applied

Linguistics, 21, 112-126.

Houghton, S. & Bain, A.(1992). Peer-tutoring with ESL and below-average readers. Journal

of Behavioral Education, 3:2 , 125-142.

Hurd, S. (2007). Anxiety and non-anxiety in a distance language learning environment: the

distance factor as a modifying influence. System 35 (4): 487-508.

Kurt, G. & Atay, D. (2007).The Effects of Peer Feedback on the Writing Anxiety of

Prospective Turkish Teachers of EFL. Journal of Theory and Practice in Education, 3

(1):12-23

Lin, G. H. C. (2009). An exploration into foreign language writing anxiety from Taiwanese

university students‘ perspectives. 2009 NCUE Fourth Annual Conference on

Language Teaching, Literature, Linguistics, Translation, and Interpretation (pp.307-

318). National Changhua University of Education, Department of English, Taiwan,

ROC.

80

FLLT 2011 Proceedings

Oxford, R.(1999). Anxiety and the Language Learners: New Insights. In A. Jane (ed.), Affect

in Language Learning (pp.58-67). Cambridge: Cambridge University Press.

Mackinnon, R., Haque, A., & Stark, P.(2009). Peer-teaching: By students for students: a

student-led initiative. A Clinical Teacher, 6, 245-248.

Nishimata, T. (2008). Going green- Can it help foreign language learning too? (Doctoral

dissertation, Florida State university). Retrieved from

http://etd.lib.fsu.edu/theses/available/etd-04142008-

170238/unrestricted/NishimataTDissertation.pdf

Thomas, R. (1991). Cross-Age and Peer Tutoring. ERIC Digest. Bloomington, In ERIC

Clearinghouse on Reading and Communication Skills. ED 350598- Microfiche, 4p.

Washington, D.C.

Young, D. (1991). Creating a Low Anxiety Classroom Environment: What does language

anxiety research suggest? The Modern Language Journal, 75, 4, 426-439.

About the Author

Fasawang Pattanapichet (PhD) teaches at Bangkok University. She received BA (Hons.) in

English Language and Literature from Thammasat University. She obtained MA in TESOL

from Eastern Michigan University. In 2009, she was awarded a Ph D in English as an

International Language (EIL) from Chulalongkorn University (Bangkok University

scholarship). Her research interests include course development, ELT methodology and ESP.

81

FLLT 2011 Proceedings

Enhancing EFL Students’ Intercultural and Critical Awareness

Amporn Sa-ngiamwibool

Krirk Univerisity

[email protected], [email protected]

Abstract

Preparing EFL students for the global market needs to raise both intercultural and critical

awareness. Consciousness-raising (C-R) incorporating with computer-assisted language

learning (CALL) plays a vital role in enhancing the students‘ intercultural and critical

awareness. This study primarily examined the effects of C-R + CALL instructions on EFL

Thai students‘ intercultural and critical awareness. The study revealed these findings. First, on

intercultural awareness, the posttests scores of the group with the noticing clues were

significantly greater than those of the group without the noting clues. Similarly, on critical

awareness, the posttests scores of the group with the clues were slightly greater than those of

the group without the clues. In addition, the attitudes of the group with the clues were highly

positive. Lastly, the instructions with the clues could enhance intercultural and critical

awareness more effectively than those without the clues. Future inquiry should replicate the

study in similar contexts to this study and/or in naturally occurring situations.

Introduction

Intercultural awareness has become increasingly necessary for international communication.

Thus, raising intercultural awareness is necessary for preparing EFL students for the global

market. Theorists and researchers (Block, D. and Cameron, D. 2002; Pennycook, A. 1994,

2001; Hinkel, E. 1999; Byram, M. 1997; Byram, M., Morgan, C. et al. 1994; Kramsch, C.

1993) agree that raising intercultural awareness is needed for intercultural communication.

Intercultural awareness is a highly sensitive issue since it deals with inter/cultural differences

of communicators. Thus, in engaging in meaningful inter/cultural contexts successfully,

communicators need to be critical of inter/cultural differences. Critical awareness in this study

is the ability to analyze issues of intercultural business contexts in which communicators are

engaged with and the ability to construct the gist of the intercultural communication text in

order to achieve the goal of the communication. Thus, in preparing EFL students for

successful intercultural communication, instructors need to raise both intercultural and critical

awareness.

To raise EFL students‘ intercultural and critical awareness, consciousness-raising (C-R) is

needed for raising awareness. C-R in this study is an attempt to draw the students‘ attention

specifically to perceive the target intercultural issue consciously, notice it, and turn it into

learning. C-R is a cognitive learning process, consisting of four components: perceiving,

noticing, discovering, and understanding. Prior research on SLA reveals that C-R can raise

linguistic awareness effectively (Izumi, 2000; Izumi, Bigelow, Fujiwara, & Fearnow, 1999;

Jourdenais, 1998; White, 1998; Alanen, 1995; Jourdenais, Ota. Stauffer, Boyson, & Doughtly,

1995; Leow, 1993, 1995, 1997) especially in EFL contexts.

In Thai contexts, Sa-ngiamwibool studied the effects of C-R on linguistic awareness in

various skills and aspects: reading (Sa-ngiamwibool, 2009a), critical reading (Sa-

ngiamwibool, 2009c), analytical reading (Sa-ngiamwibool, 2007a), structure and written

expression (Sa-ngiamwibool, 2007b), listening skill (Sa-ngiamwibool, 2008b, 2008c),

82

FLLT 2011 Proceedings

business English (Sa-ngiamwibool, 2009d), writing (Sa-ngiamwibool, 2010c), media

translation (Sa-ngiamwibool, 2010d), and English in media (Sa-ngiamwibool, 2008a). She

also examined the effects of C-R on learning: communicative language leaning (Sa-

ngiamwibool, 2009f, 2010b), autonomous learning (Sa-ngiamwibool, 2009e, 2010e) and

independence learning (Sa-ngiamwibool, 2009f). Moreover, she investigated the effects of

computer on enhancing C-R (Sa-ngiamwibool, 2008b, 2008c, 2010a, 2010d,). Most

importantly, she studied the effects of C-R on inter/cultural issues: cultural schemata (Sa-

ngiamwibool, 2009b) and intercultural awareness (Sa-ngiamwibool, 2010b, 2010f, 2010g).

All these studies reveal that C-R has effects on EFL Thai students.

However, this present investigation had a few specific features. It included critical awareness

as a necessary factor for increasing intercultural awareness. Also, it focused on a comparison

of perceiving and noticing, either with C-R + CALL or with CALL-only. This study was

drawn upon on prior study and the specific features with the following purposes of study.

Purposes of the Study

This study primarily investigated the effects of C-R + CALL instructions either with or

without noticing clues to the gist of the text, with four specific purposes of study:

1. To empirically examine the effects of the instructions on EFL students‘

intercultural awareness

2. To empirically examine the effects of the instructions on their critical

awareness

3. To explore their attitudes towards the instructions

4. To determine the instructions to enhance their intercultural and critical

awareness

Methods

Population and subjects

The population was third-year students at Krirk University who studied business courses in

the first semester of the academic year 2009. The students who studied abroad or took GMAT

Test (Graduate Management Admission Test) were excluded. The subjects were 160 students

randomly assigned into five different groups, each of which consisted of 30-33 students.

Design of the study

This study used a pretests-posttests, experimental design with five experimental groups, each

of which were assigned these treatments:

Group 1: C-R + CALL at the level of perceiving

This group received both C-R + CALL instructions at the level of perceiving.

Group 2: C-R + CALL at the level of noticing

This group received both C-R + CALL instructions at the level of noticing.

Group 3: CALL-only instructions at the level of perceiving

This group received only CALL instructions at the level of perceiving. No C-R

instructions were given to this group.

83

FLLT 2011 Proceedings

Group 4: CALL-only instructions at the level of noticing

This group received only CALL instructions at the level of noticing. No C-R

instructions were given to this group.

Group 5: Grammar instructions for control group

This was a control group, receiving neither C-R nor CALL instructions. Grammar

instructions were assigned to this group.

Instruments

This study used these instruments to elicit information: two C-R instructions, two CALL-only

instructions, grammar instructions, questionnaire, and journal log.

C-R instructions

The two C-R instructions were constructed to raise the students‘ intercultural and critical

awareness. These instructions at the level of perceiving gave no directions to search for and

focus on the given intercultural, critical clues in various linguistic contexts. These instructions

were constructed for two purposes: 1) to raise students‘ intercultural awareness with

comparison of appropriate and inappropriate expressions for intercultural communication in

45 business contexts, and 2) to raise students‘ critical awareness, asking the students to

analyze 45 issues which were drawn from the writing part of GMAT test, Analysis of Issue

which asked the students to write an essay on given issues, each of which required higher-

order thinking skills and critical awareness in order to respond to the issues. The contents of

the two C-R instructions required necessary higher order thinking skills. The two C-R

instructions, therefore, consisted of two parts as presented below:

C-R instructions at the level of perceiving

The C-R instructions at the level of perceiving gave no clues to raise intercultural and critical

awareness of the text. Below were samples.

A. Intercultural awareness instructions Directions: Using the following expressions to talk about problems with products will leave

a more professional impression. Situation 1: Talking about problems with products Inappropriate: I have too many problems with your products. Appropriate: We‘ve got a bit of a problem with the shelf life of your product. Inappropriate: The work of the last order was very bad. Appropriate: The stitching of the last order was of quite poor quality. Inappropriate: Your machines are too slow. Appropriate: The equipment is quite slow. B. Critical awareness instructions Directions: In group of 3-5, discuss whether you agree or disagree with the issue given

below and support your position with evidence. “All groups and organizations should function as teams in which everyone makes decisions

and shares responsibilities and duties. Giving one person central authority and

responsibility for a project or task is not an effective way to get work done”. To what extent do you agree or disagree with this definition of success? Support

your views with reasons and/or specific examples drawn from your own work or school

experiences, your observations, or your reading.

84

FLLT 2011 Proceedings

C-R instructions at the level of noticing

C-R instructions at the level of noticing would specifically draw the students‘ attention to

search for and consciously focus on the clues in red. Below were samples.

A. Intercultural awareness instructions

Directions: Using the following expressions to talk about problems with products

will leave a more professional impression. Notice the clues in red and share with the

others why the former set is not appropriate for intercultural communication.

Situation 1: Talking about problems with products

Inappropriate: I have too many problems with your products.

Appropriate: We‘ve got a bit of a problem with the shelf life of your product.

Inappropriate: The work of the last order was very bad.

Appropriate: The stitching of the last order was of quite poor quality.

Inappropriate: Your machines are too slow.

Appropriate: The equipment is quite slow.

B. Critical awareness instructions

Directions: In group of 3-5, notice the clues in red and use them to identify the pros

or cons of the issue below and brainstorm evidence to support your position.

“All groups and organizations should function as teams in which everyone makes

decisions and shares responsibilities and duties. Giving one person central authority

and responsibility for a project or task is not an effective way to get work done”.

To what extent do you agree or disagree with this definition of success?

Support your views with reasons and/or specific examples drawn from your own work

or school experiences, your observations, or your reading.

CALL-only instructions

The two CALL instructions drawn from English Discoveries Program, a computer-assisted

program for self-access learning, were constructed to increase the students‘ ability to

construct the gist of the text.

CALL-only instructions at the level of perceiving

These CALL instructions at the level of perceiving gave no clues to the gist of the text at all.

Below was a sample.

85

FLLT 2011 Proceedings

CALL-only instructions at the level of noticing

These CALL instructions at the level of noticing provided the clues in red, which specifically

draw the students‘ attention to the gist of the text in red. Below were samples.

86

FLLT 2011 Proceedings

Grammar instructions

These grammar instructions were assigned to the control group, receiving neither C-R nor

CALL. The group was required to solve 100 sentence correction problems. Below was a

sample.

Directions: In group of 5, share with others to choose the best choice.

The Wallerstein study indicates that even after a decade young men and

women still experience some of the effects of a divorce occurring when a child.

(A) occurring when a child

(B) occurring when children

(C) that occurred when a child

(D) that occurred when they were children

(E) that has occurred as each was a child

87

FLLT 2011 Proceedings

Pretests and posttests on intercultural awareness

These tests were constructed to assess the students‘ intercultural awareness. There were two

sets, each of which consisted of 30 questions: item-by-item and overall.

Item-by-item pretests and posttests

These tests were assigned to each group before and after each instruction. The posttests were

constructed in parallel with the pretests.

Directions: Which of the following is more suitable for talking about problems?

Pretests

A. I was wondering if we could make a few concessions on taste.

B. Thai people don‘t like your product.

Posttests A. The material of the last load was bad quality.

B. The fabric of the last consignment was of inferior quality.

Overall pretests and posttests

These overall pretests and posttests assigned to each group before and after the experiment

were drawn from the item-by-items pretests and posttests, each of which consisted of 30

questions.

Pretests and posttests on critical awareness

These tests were constructed to assess students‘ critical awareness. These tests were drawn

from the critical reading part of GMAT. Each of the two sets, item-by-item and overall,

consisted of 30 questions.

Item-by-item pretests and posttests

These tests were assigned to each group before and after the instructions each week. Below

were samples.

Pretests and posttests are based on the following.

The fewer restrictions there are on the advertising of legal services, the more

lawyers there are who advertise their services, and the lawyers who advertise a

specific service usually charge less for that service than lawyers who do not advertise.

Therefore, if the state removes any of its current restrictions, such as the one against

advertisements that do not specify fee arrangements, overall consumer legal costs will

be lower than if the state retains its current restrictions.

Pretests If the statements above are true, which of the following must be true?

a. Some lawyers who now advertise will charge more for specific services if

they do not have to specify fee arrangements in the advertisements.

b. More consumers will use legal services if there are fewer restrictions on

the advertising of legal services.

c. If the restriction against advertisements that do not specify fee

arrangements is removed, more lawyers will advertise their services.

d. If more lawyers advertise lower prices for specific services, some lawyers

88

FLLT 2011 Proceedings

who do not advertise will also charge less than services.

e. If the only restrictions on the advertising of legal services were those that

apply to every type of advertising, most lawyers would advertise their

services.

Posttests Which of the following, if true, would most seriously weaken the argument

concerning overall consumer legal costs?

a. The state has recently removed some other restrictions that had limited the

advertising of legal services.

b. The state is unlikely to remove all of the restrictions that apply solely to

the advertising of legal services.

c. Lawyers who do not advertise generally provide legal services of the same

quality as those provided by lawyers who do advertise.

d. Most lawyers who now specify fee arrangements in their advertisements

would continue to do so even if the specification were not required.

e. Most lawyers who advertise specific services do not lower their fees for

these services when they begin to advertise.

Overall pretests and posttests

These overall pretests and posttests assigned to each group before and after the experiment

were drawn from the item-by-items pretests and posttests, each of which consisted of 30

questions.

Questionnaire

This questionnaire elicited the students‘ attitudes toward the effects of the different types of

instructions on their intercultural awareness.

How much can the assigned instructions raise your intercultural awareness?

___ Very much ___ Much ___ A little ___Very little ___Not at all

Journal log

The students were required to report the critical awareness strategies they used

while analyzing each of the issues given.

Data collection and analysis

The data collection followed these procedures: pretests, instruction, and posttests. All groups

were assigned overall pretests and posttests before and after the experiment. During the

experiment, they were assigned item-by-item pretests and posttests before and after each

instruction. Each instruction was completed in thirty minutes. After the experiment, all groups

completed the overall posttests, a questionnaire, and a journal log. The data collection lasted

sixteen weeks.

For the intercultural awareness test, the reliability and validity check followed these steps.

First, the instruments constructed on the purposes of study were sent to five judges for content

validity check. The contents were then adjusted to their advice, tried out, and tested by Alpha

Cronbach Coefficient. The result of reliability check was 0.780, indicating moderate

89

FLLT 2011 Proceedings

reliability. For the critical awareness test drawn from GMAT test, there was no validity check

of the test. The result of reliability check was 0.915.

For scoring procedure and statistical analysis, counts of pretests and posttests scores were

compared and then, an ANCOVA analysis was chosen for data analysis in order to control

extraneous factors (e.g. prior knowledge) and compare the differences among the groups.

Results of the study

An ANCOVA analysis was performed on the data and the results of the data analysis were

shown based on the research questions.

Research question 1: Are there increases in posttests scores on intercultural awareness

among the different types of instructions? The results were presented below.

Table 1 Adjusted means (and standard deviations) for intercultural awareness

_______________________________________________________________

Instructions Item-by-item Overall

___________________ __________________

Pretests Posttests Pretests Posttests

_______________________________________________________________

C-R + CALL 2.7576 19.1515 2.5758 21.9697

perceiving (1.60137) (2.36010) (1.11888) (2.01260)

C-R+ CALL 2.5152 22.1818 2.6061 23.5152

noticing (1.58353) (2.27011) (1.47774) (1.97043)

CALL-only 2.5161 14.9677 2.7742 17.3871

perceiving (1.56782) (3.85991) (1.30919) (2.26094)

CALL-only 2.8667 17.1333 2.7667 13.9333

noticing (1.73669) (1.97804) (1.54659) (2.01603)

Grammar 2.6061 3.9091 2.7576 3.9697

Instructions (1.41287) (1.25906) (1.58174) (1.21153)

_______________________________________________________________

Table 1 reveals that the C-R + CALL noticing performed on item-by-item tests significantly

better than the C-R + CALL perceiving, the CALL-only noticing, the CALL-only perceiving,

and the grammar instructions. The ANCOVA analysis on the total score on posttests yielded a

significant main effect for the C-R + CALL noticing, F (5, 33) = .472, p < .05, for the C-R +

CALL perceiving, F (5, 33) = 4.677, p < .05, for the CALL-only noticing, F (5, 30) = .317, p

< .05, for the CALL-only perceiving, F (5, 31) = .049, p < .05, and for the grammar

instructions, F (5, 33) = 1.941, p < .05. Interestingly, the results of overall tests were almost

completely consistent with those of item-by-item tests, the C-R + CALL noticing performed

on item-by-item tests significantly better than the C-R + CALL perceiving, the CALL-only

perceiving, the CALL-only noticing, and the grammar instructions. The ANCOVA analysis

on the total score on posttests yielded a significant main effect for the C-R + CALL noticing,

F (5, 33) = .272, p < .05, for the C-R + CALL perceiving, F (5, 33) = .890, p < .05, for the

CALL-only perceiving, F (5, 31) = .197, p < .05, for the CALL-only noticing, F (5, 30) =

.548, p < .05, and for the grammar instructions, F (5, 33) = 5.200, p < .05. This indicated that

90

FLLT 2011 Proceedings

C-R+CALL at the level of noticing had the strongest effects on students‘ intercultural

awareness.

Research question 2: Are there increases in posttests scores on critical awareness? The

results were presented below.

Table 2 Adjusted means (and standard deviations) for critical awareness _______________________________________________________________

Instructions Item-by-item Overall

_____________________ ___________________

Pretests Posttests Pretests Posttests

_______________________________________________________________

C-R + CALL 1.7576 12.1818 1.7273 12.3636

perceiving (.96922) (3.53071) (.67420) (2.51021)

C-R + CALL 1.7879 21.5758 1.7879 16.5758

noticing (.96039) (2.87261) (.54530) (2.51021)

CALL-only 1.8710 6.8387 1.8065 6.7419

perceiving (.99136) (1.77194) (.65418) (1.87914)

CALL-only 2.0333 7.5000 1.8333 7.2667

noticing (.99943) (2.06364) (.59209) (2.66437)

Grammar 1.9394 3.5455 1.6970 3.5152

Instructions (1.11634) (1.30122) (.52944) (.79535)

______________________________________________________________

Table 2 reveals that the C-R + CALL noticing performed on item-by-item tests significantly

better than the C-R + CALL perceiving, the CALL-only noticing, the CALL-only perceiving,

and the grammar instructions. The ANCOVA analysis on the total score on posttests yielded a

significant main effect for the C-R + CALL noticing, F (5, 33) = 3.741, p < .05, for the C-R

+ CALL perceiving, F (5, 33) = .557, p < .05, for the CALL-only noticing, F (5, 30) = .890, p

< .05, for the CALL-only perceiving, F (5, 31) = 1.772, p < .05, and for the grammar

instructions, F (5, 33) = .242, p < .05. Interestingly, the results of overall tests were

completely consistent with those of item-by-item tests, the C-R + CALL noticing performed

on item-by-item tests significantly better than the C-R + CALL perceiving, the CALL-only

noticing, the CALL-only perceiving, and the grammar instructions. The ANCOVA analysis

on the total score on posttests yielded a significant main effect for the C-R + CALL noticing,

F (5, 33) = .010, p < .05, for the C-R + CALL perceiving, F (5, 33) = .055, p < .05, for the

CALL-only noticing, F (5, 30) = .253, p < .05, for the CALL-only perceiving, F (5, 31) =

.916, p < .05, and for the grammar instructions, F (5, 33) = 1.450, p < .05. This indicated that

C-R+CALL at the level of noticing had the strongest effects on students‘ intercultural

awareness.

91

FLLT 2011 Proceedings

Research question 3: What are the students‘ attitudes toward their increase in intercultural

awareness? The results of their attitudes were grouped as shown in the following table.

Table 3 Percentages (and raw scores) of attitudes toward increase in intercultural

awareness

_______________________________________________________________

Very Much Little Very Not

much little at all

_______________________________________________________________

C-R + CALL perceiving 7.5 25 35 15 0

(3) (10) (14) (6) (0)

C-R + CALL noticing 22.5 50 10 0 0

(9) (20) (4) (0) (0)

CALL perceiving 2.5 5.0 42.5 25 2.5

(1) (2) (17) (10) (1)

CALL noticing 7.5 5 35 22.5 5

(3) (2) (14) (9) (2)

Grammar instructions 2.5 2.5 22.5 40 15

(1) (1) (9) (16) (6)

_______________________________________________________________

Table 3 shows the students‘ positive responses to the instructions as follows: the C-R + CALL

noticing (72.5%), the C-R + CALL perceiving (32.5%), the CALL-only noticing (12.5%), the

CALL-only perceiving (7.5%), and the grammar instructions (5%) respectively. This

indicated that the majority of the students had positive attitudes towards C-R and CALL.

Research question 4: How do the instructions enhance your critical awareness? The students

receiving the C-R + CALL at the level of perceiving and noticing were assigned to write a

journal log on how their instructions enhanced their critical awareness while they were

working on 45 analyses of issue? A qualitative analysis of the students‘ journal log revealed

that, while analyzing issues, the students of the two instructions practiced higher –order

thinking skills, concept-analysis, problem-solving, reasoning, inquiry skills and others. These

skills are the basis of critical awareness. This indicated that the two instructions enhanced the

students‘ critical awareness. This may result from the effects of the instructions as well as the

analysis itself. Here are some samples of the students‘ responses.

―I have learnt to identify issues, weighting them, compare and

contrast them, weighting them, making sense of the value of the issues,

make decision impartially, think about reasons to support evidence,

organize the reasons coherently, and draw a conclusion.‖

[Student A, C-R + CALL at the level of perceiving]

―We have learnt to understand the two sides of an issue, tell the

differences between one side and the other, see what is not superficially

apparent, choose a side, tell the views to support the decision-making,

evaluate the views, tell the differences between fact, opinion, and reason

judgments, and drawing a conclusion.‖

[Student B, C-R + CALL at the level of noticing]

92

FLLT 2011 Proceedings

Research question 5: What instructions are effective for enhancing the EFL

students‘ intercultural and critical awareness?

Based on the research questions mentioned above, it is obvious that the two C-R + CALL,

either at the level of perceiving or noticing, can help increase the students‘ intercultural and

critical awareness more effectively than other instructions. In addition, the students of the

instructions show more positive attitudes than the others. Moreover, the C-R+CALL at the

level of noticing can promote the students‘ critical awareness more successfully than the other

instructions. Drawing upon the results of all research questions revealing that 1) the two C-R

+ CALL instructions are more effective for enhancing intercultural and critical awareness

than the CALL-only instructions, 2) the C-R + CALL instruction at the level of noticing is the

more effective of the two C-R + CALL instructions, and 3) the CALL-only at the level of

noticing is the more effective of the two CALL-only instructions, it can be concluded that the

two C-R + CALL instructions are effective tools and the C-R+CALL at the level of noticing

is the most effective instruction for enhancing the EFL students‘ intercultural and critical

awareness.

Conclusion

The results revealed several major findings based on the purposes of the study and the

research questions.

First, on the effects of the different instructions on intercultural awareness, the C-R + CALL

instructions, either with or without noticing clues to the gist of the text, yielded higher effects

on Thai students‘ awareness than the CALL-only, either with or without noticing clues to the

gist of the text, and the grammar instructions. As shown by the results of research question 1,

posttests scores on the item-by-item and overall test of the C-R+CALL and CALL-only

instructions either with perceiving or noticing yielded significantly greater effects than those

of the control group. Moreover, the C-R+CALL either with perceiving or noticing yielded

greater effects than the CALL-only either with perceiving or noticing. In details, the C-

R+CALL or CALL-only instructions with noticing yielded greater effects than the ones with

perceiving. It can be concluded that of all instructions, the C-R+CALL with noticing yielded

the greatest effects on Thai students‘ intercultural awareness. This indicated that noticing is

more effective for intercultural awareness-raising than perceiving.

Second, on critical awareness, as shown in the results of research question 2, the effects on

critical awareness shared almost all similarities as those on intercultural awareness, except

that there were differences between the effects of CALL-only either with perceiving or

noticing on intercultural awareness and those of the instructions on critical awareness on both

tests. This may result from the effects of cognitive load which may interfere the students‘

decision-making process on both tests.

Third, on attitudes towards the instructions on intercultural awareness, as shown in the results

of research question 3, the instructions have different effects on the students‘ attitudes. The C-

R + CALL instructions with noticing yielded the most positive attitudes of all. This indicated

that the C-R + CALL instructions with noticing were the instructions that Thai students

preferred most.

93

FLLT 2011 Proceedings

Fourth, on critical awareness, as shown in the results of research question 4, the two C-R

instructions either with perceiving or noticing could enhance Thai students‘ important higher-

order thinking skills which are the basis of critical awareness.

Lastly, on effective instructions for enhancing the students‘ intercultural and critical

awareness, a collective pool of information drawn upon the results of research questions 1-4

showed that the C-R + CALL with noticing is the most effective instruction since it yielded

the highest performances in all tests.

Discussion

The results of this study supported those of the prior study (e.g. Alanen, 1995; Izumi,

Bigelow, Fujiwara, & Fearnow, 1999; White, 1998; Jourdenais, Ota. Stauffer, Boyson, &

Doughtly, 1995; Izumi, 2000; Jourdenais, 1998; Leow, 1993, 1995, 1997) that C-R either at

the level of perceiving or noticing can enhance EFL students‘ awareness effectively.

In EFL contexts, the results of this present study were consistent with the studies in Thai

contexts by Sa-ngiamwibool (2007a, 2007b, 2008a, 2008b, 2009a, 2009b, 2009c, 2009d,

2009e, 2009f, 2010a, 2010b, 2010c, 2010d, 2010e, 2010f, 2010g) that the groups with C-R

only or C-R either with CAI or learning strategies outperformed the groups without C-R.

Specifically, on the effects of intercultural awareness, the results of this study,

together with those of Sa-ngiamwibool (2010b, 2010f, 2010g), revealed that C-R instructions

either with perceiving or noticing are very useful for enhancing intercultural awareness. In the

study (2010g), for example, C-R at the level of perceiving and noticing, especially with the

aid of CALL, helps raise Thai students‘ intercultural awareness and international

communication effectively. In this present study, C-R + CALL with perceiving and noticing

can enhance Thai students‘ intercultural and critical awareness successfully.

Similarly, this study shared findings with that of Sa-ngiamwibool (2010f). In the study, the

intercultural awareness-raising instructions either as an integral part of the international

business instructions or as an addition to the instructions had significant effects on students‘

intercultural knowledge of international business communication. In this present study, the C-

R + CALL and CALL-only instructions, either with or without noticing clues to the gist of the

text, yielded higher effects on Thai students‘ intercultural and critical awareness than the

control group.

In addition, this study supported Sa-ngiamwibool‘s study (2010b). In the study, the two CLL

instructions, either with intercultural awareness-raising as integral part of input or with

intercultural awareness-raising as addition to input, had effects on EFL learners‘ intercultural

awareness and communicative competence at different degrees. The CLL instruction with

intercultural awareness as integral part to the input performed over the than CLL only. This

present study found similar findings. The C-R+CALL and CALL-only instructions either with

perceiving or noticing yielded significantly greater effects than those of the group without C-

R or control group.

Lastly, like the study by Sa-ngiamwibool (2009c) revealing that C-R is needed for enhancing

the students‘ critical reading by specifically drawing the students‘ attention to the most

influential factor on critical reading (i.e. argument identification), this present study

confirmed that the C-R+CALL and CALL-only instructions either with perceiving or noticing

94

FLLT 2011 Proceedings

could enhance the students‘ intercultural and critical awareness successfully by specifically

drawing the students‘ attention to the gist of the text.

The findings of all these studies lend support to those of prior studies that C-R is a necessary

factor for enhancing intercultural and critical awareness in EFL contexts. This may result

from the effects of C-R with an aid of CALL. Of the two C-R+CALL instructions, the one

with noticing clues is more effective than the other with perceiving. This may result from the

fact that the noticing clues can help draw the students to the intercultural and critical

awareness target and, therefore, turns the noticed target into learning or understanding.

Theoretical and pedagogical implications

This study indicates these theoretical and pedagogical implications. For theoretical

implications, this present study lends support to prior study on C-R in EFL contexts. It reveals

that C-R both at the level of perceiving and at the level of noticing can enhance EFL students‘

awareness effectively. For pedagogical implications, C-R at the level of noticing helps

enhance EFL students‘ intercultural and critical awareness more effectively than C-R at the

level of perceiving. In addition, with the aid of CALL which helps accelerate C-R, awareness-

raising becomes more effectively for EFL students.

Suggestion for further inquiry

Future inquiry should replicate this study with EFL students of higher or lower age groups to

compare the effects on intercultural and critical awareness since age, maturity, level of

education might have effects on intercultural and critical awareness.

References

Alanen, R. (1995). Input enhancement and rule presentation in second language acquisition.

In R. Schmidt (Ed.). Attentional awareness in foreign language learning (pp. 259-

302).Honolulu: University of Hawai‘i.

Block, D. and Cameron, D. (2002). Globalization and Language Teaching. London:

Routledge.

Byram, M., Morgan, C. et al. (1994). Teaching-and-Learning-Language-and- Culture.

Clevedon: Multilingual Matters.

Byram, M. (1997). Teaching and Assessing Intercultural Communicative Competence.

Clevedon: Multilingual Matters.

Hinkel, E. (1999). Culture in Second Language Teaching and Learning . Cambridge:

Cambridge University Press.

Izumi, S. (2000). Promoting noticing and SLA: An empirical study of the effects of output and

input enhancement on ESL relativization. Unpublished doctoral dissertation.

Georgetown University, Washington, DC.

95

FLLT 2011 Proceedings

Izumi, S., Bigelow, M., Fujiwara, M., & Fearnow, S. (1999). ―Testing the output hypothesis:

Effects of output on noticing and second language acquisition.‖ Studies in Second

Language Acquisition, 21, 421-452.

Jourdenais, R. (1998). Attending to enhanced input. Paper presented at the American

Association for Applied Linguistics conference, Seattle, WA.

Jourdenais, R., Ota, M., Stauffer, S., Boyson, B., & Doughty, C. (1995). Does textual

enhancement promote noticing? A think-aloud protocol analysis. In Schmidt (Ed.),

Attention and awareness in foreign language learning. Honolulu: University of

Hawai‘i.

Kramsch, C. (1993). Context and Culture in Language Teaching. Oxford: Oxford

University Press.

Leow, R. (1993). To simplify or not to simplify: A look at intake. Studies in Second Language

Acquisition, 15, 333-355.

Leow, R. (1995). Modality and intake in second language acquisition. Studies in Second

Language Acquisition, 17, 79-89.

Leow, R. (1997). Attention, awareness, and foreign language behavior. Language Learning,

47, 467-505.

Long, M., Inagaki, S., & Ortega, L. (1998). The role of negative feedback in SLA: Models

and recasts in Japanese and Spanish. Modern Language Journal , 82,

557-587.

Pennycook, A. (1994). The Cultural Politics of English as an International Language .

Harlow: Longman.

Pennycook, A. (2001). Critical Applied Linguistics: A Critical Introduction . Mahwah,

New Jersey: Lawrence Erlbaum.

Sa-ngiamwibool, A. (2007a). A classroom investigation: A comparison of the

“ m ea n i n g - g i ve n ” m e t h o d a n d t h e “ m ea n i n g - i n f e r r ed ” m e t h o d o n

analyt ical reading achievement . Available at ht tp: / /www.kku.ac. th .

Sa-ngiamwibool, A. (2007b). Enhancing structure and written expression among EFL

Thai students through consciousness-raising instructions. Journal of NELTA,

12 (1&2), 113-128.

Sa-ngiamwibool, A. (2008a). English in mass media: Enhancing C-R content- based

instruction through a functional focus on language in media. Phenomena, Journal of

Language and Literature, 11 (3), 115-127.

Sa-ngiamwibool, A. (2008b). The effects of consciousness-raising instruction on EFL

students on listening achievement through computer-assisted instruction. NIDA

Development Journal, 48 (2), 65-99.

96

FLLT 2011 Proceedings

Sa-ngiamwibool, A. (2008c). The Effects of Consciousness-Raising Instruction on

EFL Students on Lis tening Achievement through Computer -Assis ted

Instruction. Paper presented at the 17th

MELTA International Conference,

Penang, Malaysia.

Sa-ngiamwibool, A. (2009a). Enhancing reading for international communication

and professions through consciousness-raising instructions and computer-

assisted instruction among EFL Thai students . Paper presented at the 1s t

annual international graduate research conference on social s ciences and

humanities, Mahidol University, Thailand.

Sa-ngiamwibool, A. (2009b). The Influence of Cultural Schemata on Critical

Reading Proficiency. Paper presented at the 1st

international conference on

teaching English as a foreign language, Muhammadiyah University of

Purwokerto, Indonesia.

Sa-ngiamwibool, A. (2009c). Enhancing Critical Reading for Higher Education .

Paper presented at the 1s t

international conference on looking beyond

globalization higher education, research and development (IHERD), Dhurakij

Pundit University, Thailand.

Sa -ngiamwiboo l , A. (2009d) . Enhanc ing Bus iness Engl i sh for Rea l -L i f e

Communication in a Thai Context. Paper presented at the 7th

international

conference on developing real -life learning experiences: education reform

through teaching s t rategies , King Mongkut‘s Inst i tute of Technology

Ladkrabang, Thailand.

Sa-ngiamwibool, A. (2009e). Enhancing Autonomous Learning for International

Communication in a Thai Context. Paper presented at the international

conference on global and local changes and challenges for sustainable

development in education, Assumption University, Thailand.

Sa-ngiamwibool, A. (2009f). Facilitating independence Learning through Communicative

Learning Tasks in EFL Classroom. Paper at the international conference on

e d u c a t i o n , P u s a t B a h a s a U n i v e r s i t a s N e g e r i , I n d o n e s i a .

Sa-ngiamwibool, A. (2010a). Enhancing English for International Communication in an EFL

Context through CRI and CAI. Paper at the 2nd

international conference on Teaching

English as a foreign language (COTEFL), Muhammadiyah Univeristy of Purwokerto,

Indonesia.

Sa-ngiamwibool, A. (2010b) Raising Intercultural Awareness in Business English

Communication Through CLL. Paper at the international conference on language in

the realm of social dynamics, University of Thai Chamber of Commerce, Thailand.

Sa-ngiamwibool, A. (2010c) The Education of Virtues in English Essay Writing through

Consciousness-Raising Model. Paper at the national conference on weaving morality

and ethics into higher education teaching, Bangkok University, Thailand.

97

FLLT 2011 Proceedings

Sa-ngiamwibool, A. (2010d). Improving Thai Students‘ Errors in English News

Headline Translation Through Noticing and CALL. Leksika , Journal of

Language, Literature and Language Teaching. 4(1).

Sa-ngiamwibool, A. (2010e). Enhancing Autonomous Learning for International

Communication in a Thai Context. Scholar. 1(1): 61-65.

Sa-ngiamwibool , A. (2010f) Empowering EFL Students wi th Intercul tural

Awareness for International Business Communication . Paper at the

international conference on the dynamics in second/foreign language teaching in the

2 1s t

c e n t u r y , P i b u l s o n g k r a m R a j a b h a t U n i v e r s i t y , T h a i l a n d .

Sa-ngiamwibool, A. (2010g). Raising EFL Students’ Intercultural Awareness for

International Communication through C-R and CALL. Paper at CULI‘s 7th

international conference on pathways in EIL: explorations and innovations in teaching

and research, Chulalongkorn University Language Institute, Thailand.

About the Author

Asst. Prof. Amporn Sa-ngiamwibool, B.A. (English), M.A. (Comparative Liturature), M.A.

(Communication Research), Ph.D. (English Language Study), is currently the head of

Department of English for Communication, Faculty of Liberal Arts, Krirk Univerisity,

Thailand. Her research interests are C-R, CALL, CLL, EIL, and English in media. E-mail:

[email protected], [email protected]

98

FLLT 2011 Proceedings

Foreign Teachers’ Foreigner Talk

Burcu Simsek Benderli

Anglia Ruskin University, Cambridge

[email protected]

Abstract

Foreigner talk (FT), helping students to achieve a better understanding in language

classrooms, is the focus of this paper and the questions addressed are: 1.Does FT provided by

native teachers (NTs) differ from FT by non-native teachers (NNTs)? 2. How does it differ in

phonological and syntactic features? 3. Are there any clear similarities in each group itself?

The data, collected from 2 NTs and 3 NNTs, is analysed with reference to the teachers' speech

rate; pronunciation of function words, fragmented sentences and how it reflects in their

speech rate; and tense choices. Results reveal that there is a considerable difference between

NTs and NNTs' rate of speech depending on their weak and strong pronunciation of function

words, use of connected speech and frequency of fragmented sentences. The speech rate stays

very close among group members in each group. The tense choices also show differences as

NNTs make use of more varied tenses whereas the use is consistent between NTs.

1. INTRODUCTION

Today, in every aspect of everyday life, foreigner talk (FT) is available to all non-native

speakers of English by native speakers in order to be able to achieve a better comprehension

and dialogue with non-proficient speakers. Taking this situation to educational setting, FT

employed by language teachers by simplifying the foreign language they use when

instructing/interacting with learners aims to help them achieve a better understanding.

The data presented in this paper addresses questions about the modifications made by native

(NT) and non-native teachers (NNT) and their comparison. Such a comparison is of vital

importance as foreign language classrooms in which both teachers and students are non-native

is a very common setting all around the world and explaining the differences could give

insights to the language classrooms not just in English-speaking countries but also in other

countries. This comparison of simplifications is narrowed down to two levels of language

which are phonology and syntax. The purpose of this paper is to compare the modifications in

phonology and syntax in the foreigner talk produced by two NTs and three NNTs and to look

for the answers of these three questions:

1. Does FT provided by NTs differ from the FT by NNTs?

2. How does it differ in terms of phonology and syntax?

Taking this comparison one step further, the input provided by NNTs will be observed

to find out:

3. Whether there are any similarities in the modifications made by NNTs.

2. PARTICIPANTS AND PROCEDURE

Three NNTs (T1, T2, T3), two NTs (T4, T5) and three beginner classes each with 15 students

at an International Language School in Cambridge are selected as the participants. Native

participants (T4, T5) are males with five years' of experience in the field. Their qualifications

99

FLLT 2011 Proceedings

for teaching are Cambridge CELTA, and Cambridge TKT. Non-native teachers' language

proficiency in this paper is assessed by their qualifications and length of their residence in the

country. It is partly due to the fact that it is an English-speaking environment; Cambridge

qualifications provide the standard around the world; and the school they are working for is a

British Council accredited school so the teachers are to meet the native-like level of language

to be able to work. (T1) is from Turkey; has been living in the UK and teaching English for

four years; her teaching qualifications are Cambridge CELTA, TKT and DELTA Module1.

(T2) is from Russia; has been living in the UK for 5 years and teaching English for 4 years,

qualified with Cambridge CELTA and TKT. T3, qualified with Cambridge CELTA and TKT,

is from Portugal; has been living in the UK for 5 years and teaching English for 4,5 years.

Even though the students' output and their process of the simplified input is not analysed in

this research, it is important to note that their level of English are the same: they all score 5 to

7 out of 100 in the school's placement test. It is important to know that the students are the

same level as it means that the teachers' – either NT or NNT – need to modify their language

is at the same level.

The main topic discussed in the classrooms is the seasons starting with a revision of

vocabulary from previous lesson followed by a listening and a writing activity with classroom

discussion before and after each activity. Five beginner classes with 15 students each are

observed and recorded for this research. All teachers are observed from the beginning of their

class times for 20 minutes. In all classes, teacher – class interaction time is paused by a

listening text lasting for 4 minutes and a writing task for 5 minutes, which leaves 11 minutes

of teacher interaction time.

3. DATA ANALYSIS

The recordings are transcribed and analysed with reference to the following categories:

3.1. Speech Rate

Speech rate is the number of words produced by a speaker per minute (wpm). Chaudron

(Chaudron, 1995) suggests that average teachers' speech to beginner learners is around 100

wpm. Similarly, Griffiths (Griffiths, 1990) defines slow rate of speech as 100 wpm. And this

average is measured excluding pauses longer than two seconds. The speech rates in this study

are as follows:

Table 1

SPEECH RATE Words per minute (wpm)

T1 (non-native) 90

T2 (non-native) 89

T3 (non-native) 90

T4 (native) 104

T5 (native) 105

100

FLLT 2011 Proceedings

As it can also be seen from Table1, NNTs‘ rate of speech (wpm: 90, 89, 90) is lower than NTs

(wpm: 104, 105). This difference can be analysed and explained under these 2 titles: sentence

fragments and function words.

3.1.1. Sentence Fragments

The term fragmented sentence is used to describe the utterances that are pieces of sentences

and/or incomplete sentences but still have a meaning. Henzl, in her research about FT in the

class (Henzl, 1979), observes that teachers speak to learners in short and well-formed

sentences. By well-formed, he means simple structures with basic grammatical utterances;

that is, not sentence fragments. On the other hand, Chaudron (Chaudron, 1995) suggests that

teachers can make frequent use of sentence fragments together with well-formed (subject-

verb-object) sentences. These fragments can be grammatical as well as ungrammatical. Unlike

Henzl (1979), Chaudron (1995) emphasizes that these ungrammatical structures are also

frequently reported in teacher talk and one of the features they involve is the omission of

functions words. By sentence fragments, the utterances without subject-verb-object order are

meant: and the utterances used as ―repetitions and elicitation devices‖ (Chaudron, 1995, p.82)

are not included in this group. Repetitions and elicitations are not considered to be part of

teacher talk as they are not originally from the teacher but from students. Examples that are

not counted as sentence fragments are as follows (in italics) (Table2):

Table 2

T2 T4

―T2: What do people wear in winter?

S: coat

T2: coat yeah

Ss: hat ….. gloves

T2: hat... gloves”

― T3: What thing is quick?

S: Quick car

T3: OK. Quick, a quick car.”

What is accepted as fragmented sentences are the utterances that might have been put into

subject-verb-object structures by the teachers and made well-formed sentences but were not

completed as a sentence. They were left as phrases that carried a sentence meaning. In the

examples below, the fragmented sentences are in italics:

Table 3

T1 T2

S: I watch match team Saudi

T1: Saudi. Versus?

S: Saudi

T1: Two Saudi teams?

Ss: Two Saudi yes.‖

―T2: We talked about seasons. We have four

seasons in Europe. Saudi Arabia, Libya two

seasons?‖

S: No no four Libya four seasons

T2: Saudi Arabia two seasons. OK

101

FLLT 2011 Proceedings

The sentence fragment values in the data are as follow:

Table 4

Teachers Fragmented sentences / words (per minute) (fs/w)

T1(non-native) 0.21

T2 (non-native) 0.17

T3 (non-native) 0.20

T4 (native) 0.05

T5 (native) 0.06

NNTs prefer to use fragmented utterances instead of short but well-formed sentences whereas

NTs use short and well-formed sentences. This difference in their choices of utterances can be

one of the reasons why the rate of speech for NNTs is slower than that is for NTs. Because the

sentences used are fragmented, the words used by NNTs are fewer than the words used by

NTs who structure their sentences with proper function words.

The sentences in both examples are grammatical but the sentences that belong to NTs make

more proper use of grammatical structures compared to the sentences produced by NNTs and

thus T4 and T5 use more words than NNTs do in the same amount of time.

So one might conclude from this comparison that:

a. NNTs use more fragmented sentences in the classroom compared to NTs' use of

fragmented sentences.

b. One of the reasons for the difference in speech rate might be due to the fact that

NTs use less sentence fragments and thus more words while NNTs use more sentence

fragments thus less words in their instruction in the class.

3.1.2. Function words

As stated earlier, one of the features of ungrammatical sentence fragments is omitting the

function words of the sentences. These words can be defined as the words which have

grammatical functions in the sentence or between sentences. (Richards&Platt&Platt, 1993). In

the teachers' speeches analysed here, it is emphasized earlier that all the utterances by the

teachers are grammatical. That is, while they simplify their language in the class, they do not

omit all functions words. Even though T4 and T5 do not frequently use sentence fragments,

they include function words when they do.

So how might it affect the speech of rate when the teachers do not omit the functions words in

their simplifications? It is the difference in pronunciation. All function words have two

different forms of pronunciation: weak and strong/full form. If not for particular reasons,

functions words are used in weak forms in sentences and the emphasis in on content words,

which are the words that have meanings when they are used alone (Richards & Platt & Platt,

1993) and carry all information load of the sentence (Thornbury, 2006) and give the most

important ideas in the sentence. Function words, on the other hand, are needed ―to hold the

language together‖ (Kelly 2003 p.72) and that is the reason why function words are not

stressed in the sentences whereas content words are emphasized in pronunciation. The only

time when the functions words are emphasized in the sentence is for particular reasons (Kelly

2003, p.73):

―no, I was coming FROM the station, not going TO it.‖

102

FLLT 2011 Proceedings

However, the data from T1, T2 and T3 does not demonstrate a trend in this direction. What is

observed in their classroom language is that they put equal emphasis on both content words

and function words, which means they use the strong/full forms of function words in their

speech. This difference in using ―connected speech‖ (defined as the speech sounds that are

produced as continuous (Thornbury 2006, p.46) ) between NNTs and NTs might be the

second reason why the rate of speech is slower for NNTs. . Because they put equal emphasis

for every word in the sentence, it takes longer time to utter the sentences, thus longer rate of

speech.

Here is an example for their use of connected speech (Table5). In the first quotation below,

there are sentences T1 uses followed by the same sentences in phonemic symbols. The strong

forms of functions words have asterisks, which means that T1 could have used the weak form

as T3 does in connected speech.

Table 5

T1: ―so now I will give you 20 minutes.

Is it short?

And you write the answers to the questions.

I want you to write it.‖

T1: ―/səʊ naʊ aɪ wɪl gɪv *ju: twentɪ mɪnɪts/.

/*ɪz ɪt ʃɔ:t/?

/*ænd *ju: raɪt *ði: ɑ:ntsəz *tu: ðə kwestʃənz/.

/aɪ wɒnt *ju: *tu: raɪt ɪt/.

These are the pronunciations of the same words in the connected speech when the speaker

does not have a particular reason to put emphasis on them:

You: */ju:/ = /jə/

Is: */ɪz/ = /əz/

And: */ænd/ = ―and‖ has a particular reason here explaining students they have 20 minutes

TO write the answers to the questions. It is used to give extra information and explain he

following step so the use of strong form instead of the weak form /ən-ənd/ is acceptable.

The: */ði:/ = /ðə/ To :*/tu:/ = /tə/

Below is a similar example from T2:

Table 6

T2: ―If you are ready, can I have your

writing?

So what do you think we are going to do

now?

Do you remember what?‖

T2: ― /ɪf *ju: *ɑ: redɪ *kæn aɪ hæv *jɔ: raɪtɪŋ/?

/səʊ wɒt *du: *ju: θɪŋk wi: *ɑ: gəʊɪŋ *tu:

*du: naʊ/?

/*du: *ju: rɪmemb wɒt/?‖

Connected speech pronunciations:

You: */ju:/ = /jə/

Are: */ɑ:/ = /ə/

Can: */kæn/ = /kən/

Your: */jɔ:/ = /jə/

Do: */du:/ = /də/

To: */tu:/ = /tə/

103

FLLT 2011 Proceedings

T4's speech sample where he uses connected speech is as follows. The words underlined are

function words in weak forms:

Table 7

T4: ―Do you have this?

That's the one, isn't it?

This is something Louisa gave you.

She gave it to you‖

T3: ―/də jə hæv θɪs/?

/ðæts ðə wʌn, ɪzənt ɪt/?

/ðɪsz sʌmθɪŋ/ Louisa /geɪv jʊ ɒn / Monday.

/ʃi: geɪvɪt tə jə/‖

As it can be seen from the speech samples, T4 uses the weak forms of function words such as

―you‖, ―to‖, ―is‖, ―the‖ whereas T1 and T2 use strong forms of these words by putting equal

emphasis for every word in the sentence. The similar examples are valid for T3 and T5 in the

data. This difference of using strong and weak forms of words might result in an increase in

the time the utterance is said and it might take longer to utter a sentence when the same

emphasis is put on each word. So this can be counted as the second reason why the rate of

speech is slower for T1, T2 and T3 than it is for T4 and T5.

3.2. Verbs and Tenses

The analysis of the verbs indicated that a high number of verbs are in present simple tense in

all five teachers' speech (Table8). What differentiates one from another is the diversity in the

other tenses they include in their speech. The tenses used in the teacher utterances are

reported in Table8:

Table 8

TENSES

TEACHERS

Future

Tense -

will

Future Tense

– going to

Present

Continuous

Tense

Simple Past

Tense

T1 (non-native) %63 %0 %6 %31

T2 (non-native) %14 %29 %7 %57

T3 (non-native) %23 %19 %11 %47

T4 (native) %0 %0 %20 %80

T5 (native) %0 %0 %10 %90

The table clearly shows that T4 and T5 use fewer non-present simple forms compared to

different forms in T1, T2 and T3‘s speech. NTs use the language in a more controlled way

with the predominance of simple present structures and thus basic grammar. Even though

their rate of speech is faster (wpm: 104, 105), the language they use is not as varied as NNTs‘

language. NTs prefer to use basic subject-verb-object sentences in structures that are very

common to beginner students whereas the language NNTs use is more varied in terms of

tense selection. NNTs‘ speech is simpler in sentence structures as they make more use of

sentence fragments but when they make full sentences; their preference of tense is not mostly

based on present simple.

104

FLLT 2011 Proceedings

4. AN OVERVIEW OF ANALYSIS AND RESULTS

4.1 Speech Rate

a. The differences obtained between two groups is significant as NTs use considerably more

words per minute as it shows that native speakers speech rate is faster than non-native

speakers regardless of the fact that they are as qualified as native speakers and have native-

like competence in the language.

b. The similarities of wpm rates among NNTs are also significant. And the numbers being this

close to each other (90, 89, 90), it can be an indication of a different average speech rate for

non-natives.

4.2 Fragmented Sentences

a. The analysis of the sentences indicates that the utterances used by NSs are basic but well-

formed sentences that include function words whereas the speech produced by NNTs includes

more sentence fragments. It shows that their style of simplifying the register is different.

While NTs simplify the structures, they keep the basic components such as pronouns and

verbs whereas NNTs simplify the sentences by splitting them into fragments.

b. NNTs have similar features for their utterances among themselves. The way they simplify

their language in terms of sentence fragments and ratio (0.21, 0.17, 0.20 fs/w) they do it in the

classroom are close to each other.

4.3 Function Words – Pronunciation

a. NTs use weak forms of function words whereas NNTs put equal emphasis on each word.

This difference in pronunciation might be one of the reasons why NT speech rate (wpm: 104‘

105) is higher than NNT rate (wpm: 90, 89, 90) in classroom language.

b. NNTs in this study all use strong forms of function words. Whether it is related to their first

language phonological features is a question for further studies.

4.4 Verbs and Tenses

a. NNTs use more varied tenses compared to NTs.

b. NNTs show differences among each other in terms of tense choices. Although they have

close results in their uses of tenses different from simple present (T1:%69, T2:%43, T3:%53),

T1 avoids using future tense-going to while T2 and T3 use future tense-will significantly less

than T1 does. One reason behind this might be related to the interference of their first

languages, which can be studied further.

5. LIMITATIONS AND FURTHER STUDIES

As this paper only examines the teacher talk in low-level classes, the modifications in high-

level classes may not carry the same characteristics. It would make the assumptions in this

paper stronger if the researchers come across the same types of simplifications both in low-

level and high-level classes.

Another limitation is the classroom procedures. A pre-determined topic / material would

enable the researcher to compare the modifications of lexis, high and low frequency words

and word choices as well.

105

FLLT 2011 Proceedings

The questions for further studies are:

Is there an average of speech rate for non-native teachers?

Is the varied choice of tenses by NNTs typical in the simplification process?

How does NNTs' L1 interfere with their L2 modifications in the classroom?

Is the simplification of utterances into sentence fragments typical for NNTs and is it

the same in low-level and high-level classes?

References

Chaudron, C. (1995). Second Language Classrooms, Cambridge University Press

Griffiths, R. (1990). ―Speech Rate and NNS Comprehension: A Preliminary Study in Time-

Benefit Analysis,‖ Language Learning, Vol. 40, No. 3, 1990, pp. 311-336

Henzl, V. M. (1979). `Foreign Talk in the Classroom`, International Review of Applied

Linguistics in Language Teaching, 17:159-167

Kelly, G. (2003). How to Teach Pronunciation, Longman: Malaysia

Richards, J.C. & Platt, J. & Platt, H. (1993). Longman Dictionary of Language Teaching &

Applied Linguistics, Longman: Singapore

Thornbury, S. (2006). An A-Z of ELT, Macmillan Publishers Ltd

About the Author

Having worked as an English language instructor at Anadolu University Turkey for two years,

I moved to Cambridge UK and started teaching English at EF International Language

Schools. Apart from my work life in EF for over three years, I have recently completed my

Master's degree on Applied Linguistics and TESOL at Anglia Ruskin University, Cambridge

and currently am preparing for my PhD studies.

106

FLLT 2011 Proceedings

From an EFL Milieu to Write in an ESL Context

Parviz Ahmadi & Roselan bin Baki

University Putra Malaysia [email protected] & [email protected]

Abstract

Based on context-oriented theories and socio-cultural perspectives of writing, academic

activities and educational settings are shaped by their surrounding social and cultural

environments. A newcomer, as stated by the concept of legitimate peripheral participation

proposed by Lave & Wenger (1991), is integrated into a community through active

participation based on underlying dynamics and sociopolitical structure of a social setting.

The graduate students who have been brought up in an EFL academic environment with its

own ecological attributes face difficulties trying to be responsive to new challenging demands

in an ESL educational context. A limited number of qualitative case studies have been done

focusing on the initial participation of novice graduate learners in academic settings. This

study investigates the perceptions of some graduate students raised in an EFL environment

towards their initial participation in their communities of practice while dealing with

difficulties of writing a research paper in an ESL educational context .In-person interviews

were carried out with a number of first year doctoral humanities students from various

disciplines at a university in Malaysia. The results showed novice students failed to perform

effectively when writing their research papers due to initial disorientation. The need for more

scaffolding for first-year post-graduate students through specifically-focused writing

workshops and self-access writing centers is keenly felt so as to minimize their period of

disorientation.

Introduction

There has been a growing tendency towards academic literacy and writing of graduate

students since early 1990s (e.g. Belcher & Braine, 1995; Casanave, 2002; Li, 2007; Prior,

1998; Riazi, 1997). Particularly, some studies have focused on the importance of engagement

with disciplinary community , participating actively and socialization of graduate learners

(e.g. Belcher, 1994; Dong, 1996; Flowerdew, 2000; Li, 2005, 2006, 2007).

The notion of socialization is embedded in the concept of situated learning proposed by

Brown, Collins & Duguid (1989) focusing on the importance of involvement in the process of

learning and acquisition of knowledge through social activities. Lave & Wenger (1991)

advanced the notion by assuming a process of ― legitimate peripheral participation‖

explaining how new comers to a community move from peripheral layers towards inner ones

through participating in its activities .This notion of participation and becoming a member of

a community can justify how a novice writer is transformed to a disciplinary writer . As a

significant study of graduate students‘ participation in his community of practice, Li (2007)

explores how a novice scholar is involved in writing processes of a research article. The study

explores how a novice scholar consults various resources: ―the laboratory data, his own

experience and practice of writing RAs, the local research community, and the more global

specialist research community (p.71)‖.

The importance of initial integration of graduate students into their communities have been

focused by some studies (Hasrati, 2005; Hasrati,2005; Li, 2007).However, there is a need for

107

FLLT 2011 Proceedings

more research on how humanities graduate learners embark on writing an academic paper

,especially when there are epistemological differences between the students of humanities and

engineering as indicated by Hasrati (2005) concerning how they employ initiation strategies

in the process of induction into peripheral participation. With a view to these differences, this

study tries to explore the perceptions of these students towards their initial participation in

their communities of practice when writing a research paper and strategies they formulate to

deal with difficulties of writing a research paper for the first time.

Methodology of research

Participants

A purposive sampling was conducted for the study. Ten international doctoral ESL learners

coming from EFL settings, majoring in various fields of humanities at a University in

Malaysia with a wide range of cultural, linguistic and academic backgrounds participated in

this study.

Research design

Emergence of socio-cognitive and socio-cultural perspectives has recently brought about a

shift in data collection procedures. Qualitative research studies in natural settings present a

more comprehensive picture suitable for a better understanding of academic literacy and its

nature (Braine, 2002). Therefore, a qualitative case study research was selected to obtain a

deeper understanding. Based on the research design selected for the study, a semi-structured

interview was the best option to collect data.

Data Analysis

The interviews were transcribed and then examined .The interview transcripts were analyzed

through analytic induction. The major recurring patterns indicating students‘ perceptions

towards initial participation in their communities and the strategies they used to deal with

difficulties when writing a research paper were selected.

Findings and discussion

Most of the students reported a state of disorientation. They said they had to review the

literature to find a research niche for their research papers .However, they said they didn‘t

know how to inlay various ideas to form the whole picture. They found it difficult to relate

their topic of interest to its related theories. As Niloofar (all of the names are pseudonyms)

said, ―It is as if you have lost your way and even worse, you don‘t know your destination.

You look for someone to suggest a destination and you will follow out of choice‖. This state

of disorientation before embarking on ―peripheral participation‖ may result in unfocused

organization of ideas which, according to Dovey (2010), causes patchwriting and

inappropriate writing -from-sources strategies. This state of disorientation and uncertainty

with respect to their unsupported circumstances can lead to inappropriate strategies students

may employ to meet the deadlines.

The disorientation mentioned by the majority of students in this study lasted through the first

and second semester of their programs with some slight variation of certainty. This feeling of

uncertainty had changed to an unhealthy obsession affecting their other academic activities

108

FLLT 2011 Proceedings

and even their daily lives as one of the students majoring in counseling chuckled and said, ―I

can‘t even counsel myself. This confusion of finding a research niche has haunted me through

these two semesters .I think I must see a counselor‖. Mohammad said, ―I have been searching

and reading the recent articles for more than a semester focusing on their future

recommendation part. I have even read some of their references, but then new theories emerge

.I wish I could anchor and start writing‖. Although there are traces of procrastination in his

words, his delay in writing could have resulted from his feeling of confusion.

Being in search of further social assistance is one of the recurring themes when it comes to

making a contribution to their research community. Bahram said, ―I wish my thesis was part

of a big local project under the supervision of some experts. I don‘t know how I can make

some contribution .I don‘t want to repeat what other people have already done. I want to be

more creative‖. This statement is in line with the process of peripheral participation where

new-comers receive assistance from the experts of a community in such a way that their

induction process and initial participation is facilitated. Interestingly, none of the students

sought any help outside their local communities concerning dominant theoretical perspectives

in their disciplines. This lack of interest in seeking help from expert opinions beyond their

local disciplines might have also originated from the wrong beliefs towards experts as

―inaccessible authorities‖ persisted in their minds resulting from ecological attributes of their

own milieus.

Another important point mentioned by the students was that they couldn‘t develop an

argument or become critical throughout their review of literature. This can be caused by

background epistemology on disciplinary participation as stated by Bitchener & Basturkman

(2006) on how L2 students in their study approached writing the discussion part of a thesis or

it might have also resulted from incoherency in their line of thoughts, which doesn‘t let them

focus on specific areas in order to be critical. Development of such a critical stance scan shape

their whole research papers as fragmented pieces of arguments can be avoided and their

thoughts can harmoniously form a uniform line of thoughts. This can lead to a better

understanding of the epistemology of the target community to assimilate into its activities as it

is emphasized by Tardy (2005).

What student mentioned indicated signs of knowledge display instead of knowledge

construction as mentioned by Delaney (2008) as a sign of lack of independence. This might

have been caused by their previous educational background in which students were not

trained to develop any critical assessment of academic texts and students didn‘t dare to cast

any doubt upon ideas expressed by ―authorities‖ in their local or global disciplinary

communities. To overcome this weakness, they reported using strategies such as using critical

viewpoints of others in their own names just by paraphrasing the whole line of argument

.Karim said, ―I just look for critical points in articles .Then; I paraphrase them in my own

words. I think this is the only way to be critical at this level. How can I criticize someone‘s

work who is an expert disciplinary writer?‖ Such an epistemology was dominant in the words

of other participants. The logic behind this conclusion lies in the fact that they were not

actively participated in their communities of practice, otherwise they would have noticed the

areas where there was a lack of research or there was a need for more research. The

sociopolitical and socio-cultural attributes of an EFL context can shape the knowledge

construction and consequently the circumstances of participation in a community of

discipline. Change of one‘s educational ecology can leave its traces in the manner and extent

of engagement in disciplinary activities on the margin of a community.

109

FLLT 2011 Proceedings

Conclusion

The state of disorientation in humanities students in this study suggested that the

epistemological difference may not justify the disorientation of humanities students on the

grounds that they embark on initial participation in their disciplinary communities after they

have found a research space or niche in the bewilderment of theories .This can call for a

disciplinary counseling support system to facilitate students‘ search for a research niche,

which can finally help students avoid patchwriting and becoming an active member of their

communities. Disorientation is likely to persist if it isn‘t minimized through the help of local

disciplinary academics or any other support source.

Moreover, students who have not been trained to develop critical thinking towards published

disciplinary materials can not deal with various arguments in their research proposals,

qualifying reports or their theses. Establishing on-line discussion forums or specialized

centers focusing on a nexus of research and writing can facilitate the initial participation of

novice graduate students in their communities of practice and minimize their period of

disorientation.

References

Belcher, D. (1994). The apprenticeship approach to advanced academic literacy: Research

students and their mentors. Journal of English for Specific Purposes, 13, 23–24.

Belcher, D., & Braine, G. (Eds.). (1995). Academic writing in a second language: Essays on

research and pedagogy. Norwood, NJ: Ablex.

Bitchener, J., & Basturkmen, H. (2006). Perceptions of the difficulties of postgraduate L2

thesis students writing the discussion section. Journal of English for Academic Purposes, 4–

18.

Braine, G. (2002). Academic literacy and the non-native speaker graduate student. Journal of

English for Academic Purposes, 1 (1): 59-68.

Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning.

Educational Researcher, 18, 32–42.

Casanave, C. P. (2002). Writing games: Multicultural case studies of academic literacy

practices in higher education. Mahwah, NJ: Lawrence Erlbaum.

Delaney, Y. A. (2008). Investigating the reading-to-write construct. Journal of English for

Academic Purposes, 7, 140-150.

Dong, Y. R. (1996). Learning how to use citations for knowledge transformation: Non-native

doctoral students‘ dissertation writing in science. Research in the Teaching of English, 30,

428–457.

Dong, Y. R. (1998). Non-native graduate students-thesis/dissertation writing in science: self

reports by students and their advisors from two US institutions. English for Specific Purposes,

17(4): 369–390.

110

FLLT 2011 Proceedings

Dovey,T.(2010).Facilitating writing from sources: a focus on both process and product

.Journal of English for Academic Purposes,9,45-60.

Flowerdew, J. (2000). Discourse community, legitimate peripheral participation, and the

nonnative-English-speaking scholars. TESOL Quarterly, 34, 127–150.

Hasrati,M.(2005).Legitimate peripheral participation and supervising PhD students. Studies in

Higher Education, 30(5), 555-570.

Jenkins, S., Jordan, M., &Weiland, P. (1993). The role of writing in graduate engineering

education: A survey of faculty beliefs and practices. Journal of English for Specific Purposes,

12: 51–67.

Lave, J., & Wenger, E. (1991). Situated learning: Legitimate peripheral participation.

Cambridge: Cambridge University Press.

Li, Y.-Y. (2005). Multidimensional enculturation: The case of an EFL Chinese doctoral

student. Journal of Asian Pacific Communication, 15, 153–170.

Li, Y.-Y. (2006).Negotiating knowledge contribution to multiple discourse communities: A

doctoral student of computer science writing for publication. Journal of Second Language

Writing, 15, 159–178.

Li, Y.-Y. (2007). Apprentice scholarly writing in a community of practice: An ―intraview‖ of

an ESL graduate student writing a research article. TESOL Quarterly, 41, 55–79.

Prior, P. (1998). Writing/disciplinarity: A sociohistoric account of literate activity in the

academy. Mahwah, NJ: Lawrence Erlbaum.

Riazi, A. (1997). Acquiring disciplinary literacy: A social-cognitive analysis of text

production and learning among Iranian graduate students of education. Journal of Second

Language Writing, 6 (2): 105-137.

Tardy, C. M. (2005). ‗‗It‘s like a story‘‘: rhetorical knowledge development in advanced

academic literacy. Journal of English for Academic Purposes, 4, 325-338.

About the Authors

Parviz Ahmadi is a PhD student in TESL at University Putra Malaysia (UPM). His research

interest is in the area of ESL graduate literacy.

Roselan Baki is Head, Department of Language and Humanities Education, Faculty of

Educational Studies at University Putra Malaysia (UPM). He holds B.Ed. (UPM), MA

(Michigan State), PhD (National University of Malaysia). He has also contributed to

conferences in the area of literacy, language instruction and qualitative research in Malaysia

and Asia. His research interest is in the area of alternative pedagogy, quality teaching, and

teacher education.

111

FLLT 2011 Proceedings

Indirect Speech Act Comprehension in English as a Foreign Language

Boonjeera Chiravate Department of English, Faculty of Arts, Silpakorn University, Thailand

[email protected]

Abstract

One of the fundamental features of pragmatic competence is recognizing in an utterance the

specific speech act that a speaker is performing. Previous research in interlanguage

pragmatics has demonstrated that compared to native speakers, L2 learners have significant

difficulty in understanding indirect speech acts. This study examined Thai EFL learners‘

ability to comprehend indirect speech acts and investigated whether different types of

indirectness and L2 proficiency affected their comprehension. A multiple-choice test was

developed to measure the learners‘ ability to comprehend conventional indirectness and non-

conventional indirectness in requests, refusals and expressions of opinion. The multiple-

choice test was completed by 60 Thai university students at two proficiency levels. Results

showed that comprehension accuracy was affected significantly by different types of

indirectness and L2 proficiency. The analysis shed light on the nature of comprehension

difficulty experienced by EFL learners.

1. Introduction

Pragmatic competence involves ability to comprehend and produce meaning in

communicative contexts. Interlanguage pragmatic studies have tended to focus on pragmatic

production, while leaving pragmatic comprehension a relatively underrepresented area of

investigation (Kasper & Rose, 2002; Taguchi, 2005; Taguchi, 2008). The present study,

however, is intended to contribute to the body of research on pragmatic comprehension by

examining EFL learners‘ ability to comprehend indirect utterances in communicative

contexts.

The remaining portions of this article are organized into 5 sections. In section 2, I provide

some background regarding speech acts and speech act comprehension in L2. Then in section

3, I report on the present study. Results of the study are presented in section 4 and discussed

further in section 5. Finally in section 6, I conclude the article by noting the limitations of the

study, and discussing some of the implications of the results.

2. Background

Studies examining pragmatic comprehension in L2 have largely been conducted within the

framework of speech acts (Gass & Selinker, 2000, p. 243). In this section, I will first

introduce some basic concepts of speech act theory. Then, I will summarize previous studies

on speech act comprehension in L2.

2.1 Speech act theory

Speech act theory was developed by Austin (1962) based on the idea that ―By saying or in

saying something, we are doing something.‖ (Austin 1962, p. 62). Austin defined speech acts

as ―the actions performed in saying something‖ and proposed that the action performed by

producing an utterance consists of three related acts: locutionary, illocutionary, and

112

FLLT 2011 Proceedings

perlocutionary. To illustrate, when for example Mary says to John ―It‘s hot in here‖ (Thomas,

1995, p.49), Mary forms the words to create a meaningful utterance in a language. In so

doing, Mary is said to perform a locutionary act. By forming the utterance, however, Mary

may have a specific purpose in mind, for instance a request for some fresh air. Producing the

utterance with some specific purpose in mind, Mary also performs an illocutionary act and

the utterance is said to have illocutionary force. An utterance such as this may also have an

effect on the hearer. In this case, Mary‘s utterance may result in someone opening the

window. If so, Mary is said to have performed a perlocutionary act. Producing an utterance,

therefore, may involve the simultaneous performance of three related acts.

Although producing an utterance involves the simultaneous performance of three related acts,

the illocutionary act is considered to be the essence of speech act theory, and therefore the

most discussed. According to Holtgraves (2007) ―an illocutionary act, illocutionary force and

speech act are typically used interchangeably and generally refer to the primary act the

speaker intends to perform with an utterance‖ (Holtgraves, 2007, p.597).

Producing an utterance, a speaker may express his/her intention directly or indirectly. To

illustrate this consider (a), (b) and (c).

(a) I compliment you on your nice hairdo.

(b) Your hair‘s nice.

(c) Your stylist must be the best in town.

(Intachakra, 2007, p. 26)

Utterances (a), (b) and (c) are meant as a compliment. However, when uttering (a) the

speaker directly expresses his/her intention, whereas in uttering (b) and (c), the speaker

indirectly expresses his/her intention. An utterance by which the speaker‘s intention is

expressed straightforwardly is considered to be a direct speech act; an utterance in which the

speaker‘s intention is implied is considered to be an indirect speech act.

With regard to indirect speech acts, Searle (1975) proposed that a distinction has to be made

between a routinized utterance, in which the speaker‘s intention is embedded within

predictable fixed pattern of discourse, as in (b), and as in (c) an idiosyncratic utterance whose

meaning is not simply attached to specific linguistic expressions. For the first type of indirect

utterance, indirectness is referred to as conventional indirectness, whereas the second type of

indirect utterance is referred to as non-conventional indirectness.

The notion of conventionality was also discussed earlier by Grice (1975). Grice drew a

distinction between conventional implicatures and conversational implicatures (as cited in

Taguchi, 2005, p.545). For a conventional implicature as in (a), the meaning is encoded in

the lexical items and context-dependent. For an exchange as in (b), however, decoding the

meaning relies on specific contextual assumptions and the implicature is considered to be a

conversational implicature.

(a) She has two daughters.

(b) A: Has John left for work?

B: It‘s after nine.

(Taguchi 2005, p.545)

113

FLLT 2011 Proceedings

In conclusion, speech act theory recognizes a three-stage dimension when someone produces

an utterance. When producing an utterance, the speaker may express his/her intention directly

or indirectly. For indirect utterances, different degrees of conventionality exist in different

types of indirectness1.

2.2 Speech act comprehension in L2

Pragmatic comprehension involves ―the ability to understand implied speaker intention by

using linguistic knowledge, contextual clues, and the assumption of relevance‖ (Grice, 1975;

Levinson, 1983; Sperber & Wilson, 1995; Thomas, 1995 as cited in Taguchi, 2005, p.544).

Previous studies examining pragmatic comprehension in L2, however, employed a variety of

labels including speech acts, conversational implicatures, routines, indirect utterances, and

implied speaker‘s intentions (Taguchi, 2008, p.558). In this section, I will summarize some

of the previous studies related to the present study, in particular Carrell (1981), Cook &

Liddicoat, (2002), Koike (1996), and Taguchi (2005).

Carrell (1981) conducted a study examining whether certain English indirect requests were

more difficult than others for L2 learners of English. In Carrell‘s study, a request to paint a

circle blue was stated in different forms. L2 learners of English at four proficiency levels

were asked to interpret the different request forms. The results showed that the requests which

were syntactically simple were interpreted correctly regardless of proficiency level. The

interpretation of syntactically complex requests, however, varied across proficiency levels.

Compared to higher-proficiency learners, lower-proficiency learners had more difficulty

interpreting requests stated as questions or involving some form of negation.

Cook and Liddicoat (2002) also investigated L2 comprehension of requests. In their study,

L2 learners of English at two proficiency levels responded to a written questionnaire which

consisted of 15 brief scenarios containing request-making expressions. The request

expressions displayed three levels of directness: direct (e.g., ―Please pass me the salt‖),

conventional indirect (e.g., ―Can you pass me the salt?‖) and non-conventional indirect (e.g.,

―Are you putting salt on my meat?‖). Results showed that high-proficiency learners had

difficulty in understanding non-conventional indirect forms. Low-proficiency learners,

however, exhibited difficulty in comprehending both conventional and non-conventional

indirect forms. The results suggested that different levels of directness corresponded to

different degrees of comprehension difficulty, which also interacted with L2 proficiency.

Changing the target language from English to Spanish, Koike (1996) examined how

university students in their first, second, and third year of Spanish understood Spanish

suggestions. In Koike‘s study, the participants watched video-taped monologues produced by

Spanish native speakers. In each monologue, the last sentence represented the speech act

under study. The participants were then asked to identify the illocutionary act of the last

sentence, and to transcribe the last sentence. Results showed that third-year students

outperformed those in the first two years in identifying the speech act in question.

Taguchi (2005), on the other hand, analyzed L2 learners‘ ability to comprehend indirectness

by focusing on the effect of conventionality in comprehension. In her study, L2 learners of

English at different proficiency levels took a computerized listing task measuring their ability

to comprehend two types of implicatures: more conventional implicatures and less

conventional implicatures. More conventional implicatures included refusals and requests;

whereas less conventional implicatures consisted of indirect opinions that did not have

114

FLLT 2011 Proceedings

specific linguistic expressions or language use patterns. Comprehension was analyzed for

both accuracy and speed. Results showed shorter response times for the more conventional

implicatures and a positive correlation between proficiency and comprehension accuracy.

To summarize, previous research has demonstrated that the levels of directness or degrees of

conventionality are related to learners‘ comprehension difficulty, which also interacts with

learners‘ proficiency.

3. The study

Based on Taguchi‘s (2005) study of comprehension of implied meaning in English as a

foreign language, this study investigates the effects of types of indirectness and proficiency

levels on Thai EFL learners‘ comprehension of implied speaker intention. Two questions

addressed in this study are: (i) Do different types of indirectness affect learners‘

comprehension of implied speaker intention? (ii) Does the learners‘ L2 proficiency affect

their comprehension of implied speaker intention?

3.1 Participants

Participants in this study were undergraduate students recruited from Silpakorn University,

Thailand. Based on their scores from an English proficiency assessment by Silpakorn

University, 60 students were selected and divided into 2 groups: high-proficiency learners

(30) and low-proficiency learners (30)2. High-proficiency learners may be classified as high-

intermediate and low-proficiency learners as low-intermediate. None of the learners had been

in an English-speaking environment for a significant period of time prior to taking part in the

present study. Their mean age was 19.6 years.

3.2 Instruments

To test the learners‘ comprehension of a speaker‘s intention behind utterances, a multiple-

choice test based on Taguchi‘s (2005) pragmatic listening task was developed. The test was

designed to test learners‘ comprehension of conventional and non-conventional indirectness.

Taguchi‘s (2005) study employed a listening task; however, in the present study for

administrative and technical reasons, the test was presented in a written format.

The test consisted of 40 conversations illustrating conventional indirectness (16 items) and

non-conventional indirectness (16 items), with 2 practice items and 6 filler items3.

Conventional indirectness was represented in indirect requests (8 items) and refusals (8

items). The indirect requests included specific language use patterns such as I was wondering

if you could + verb phrase, Do you mind if I + verb phrase, and Do you think you could +

verb phrase (Blum-Kulka et al 1989, as cited in Taguchi, 2005, p. 549), as illustrated in

example 1. The indirect refusals took the form of providing a reason for avoiding explicit

linguistic markers of refusals such as No, I can’t or No, I don’t want to (Beebe, et al, 1990, as

cited in Taguchi, 2005, p. 549), as illustrated in example 2. Non-conventional indirectness,

on the other hand, was represented by expressions of negative opinion (8 items) and

nonnegative opinion (8 items). These expressions have no fixed pattern of language use, as

illustrated in examples (3) and (4), respectively.

115

FLLT 2011 Proceedings

The items were arranged in 2 groups of 19 (conventional indirectness items and non-

conventional indirectness items), with 16 test items and 3 filler items in each group. The

items within each group were arranged randomly.

Example 1:

Kate: I have read this book. It really helped me to understand Thai culture better.

Sara: Do you mind if I borrow this book for the weekend, if you don‘t need it?

Which of the following is correct?

(a) Sara doesn‘t understand Thai culture

(b) Sara is asking Kate for the book.

(c) Kate doesn‘t need the book during the weekend.

(d) Kate wants Sara to read the book.

Example 2:

Kate: Would you like to go to the cinema tonight?

Sara: I have a lot of homework to do tonight.

Which of the following is correct?

(a) Kate doesn‘t want Sara to do her homework.

(b) Kate wants Sara to do her homework.

(c) Sara can‘t go to the cinema tonight.

(d) Sara is going to the cinema tonight.

Example 3:

Bill: Did you enjoy this novel?

John: I almost felt asleep reading this novel.

What does John think about the novel?

(a) John wants Bill to read it.

(b) John doesn‘t want Bill to read it.

(c) The novel is interesting.

(d) The novel is not interesting.

Example 4:

Bill: Last summer break you took a trip to Phuket, didn‘t you? How was it?

John: I would love to go back again.

What does John think about the trip?

(a) He likes it very much.

(b) He doesn‘t like it very much.

(c) He wants Bill to take a trip to Phuket.

(d) He doesn‘t want Bill to take a trip to Phuket.

In preparing the multiple-choice test, the researcher consulted native speakers of English who

had experience with EFL learners. Then a pilot study was carried out with 60 undergraduate

students at Silpakorn University whose English language proficiency was approximately the

same as that of the learner group to be tested in the final stage. Based on the results of the

pilot study, several items were revised. Using Cronbach‘s alpha, the internal consistency

reliability of the test was .77, indicating that the test assessed the respondents‘ comprehension

in a reliable manner.

116

FLLT 2011 Proceedings

3.3 Analysis

In examining the effects of different types of indirectness and L2 proficiency on learners‘

comprehension of implied speaker intention, the learners‘ L2 proficiency levels were treated

as a group variable. Comprehension accuracy was measured by the multiple-choice test and

had an interval scale ranging from 0 to 17 for each type of indirectness. Differences in

comprehension accuracy between the two types of indirectness were analyzed using Paired

Samples T Test. Differences in comprehension accuracy between the two learner groups were

analyzed using Independent Samples T Test. In each phase of analysis, the two practice items

and six filler items were excluded.

4. Results

4.1 Do different types of indirectness affect learners’ comprehension of implied speaker

intention?

A comparison within a proficiency group showed that high-proficiency learners scored an

average of 11.833 for the conventional indirectness items and 8.566 for the non-conventional

indirectness items. The observed difference was statistically significant with t=11.062, p <

.01. The same tendency held for low-proficiency learners, as they also scored significantly

higher on conventional indirectness items than non-conventional indirectness items (10.333

versus 7.866, t = 7.018, p < .01). The results, therefore, suggest that comprehension of non-

conventional indirectness is significantly more difficult than conventional indirectness.

Table 1. Effects of types of indirectness on learners’ comprehension scores

Con indirectness Non-con indirectness t-value

M SD M SD High-proficiency 11.833 1.085 8.566 2.112 11.062 p < .01 Low-proficiency 10.333 1.268 7.866 0.973 7.018 p < .01

4.2 Does the learners’ L2 proficiency affect their comprehension of implied speaker

intention?

In a comparison between proficiency groups, I found that high-proficiency learners and low-

proficiency learners did not differ significantly in their comprehension accuracy of non-

conventional indirectness items – 8.566 versus 7.866, t=1.649. However, for conventional

indirectness items, high-proficiency learners‘ scores were significantly higher than low-

proficiency learners‘ scores (11.833 versus 10.333, t=4.921, p < .01). The results, therefore,

suggest that compared to low-proficiency learners, high-proficiency learners were able to

handle more implied meaning types.

Table 2. Effects of L2 proficiency on learners’ comprehension scores

High-Proficiency Low-Proficiency t-value

M SD M SD Con indirectness 11.833 1.085 10.333 1.268 4.921 p < .01 Non-con indirectness 8.566 2.112 7.866 0.973 1.649 n.s.

117

FLLT 2011 Proceedings

5. Discussion

5.1 The effect of types of indirectness on learners’ comprehension accuracy

Examining the effect of different types of indirectness on learners‘ comprehension of implied

meaning, we found that both high-proficiency and low-proficiency learners scored

significantly higher on conventional indirectness items than non-conventional indirectness

items, suggesting that conventional indirectness was easier to comprehend than non-

conventional indirectness. The facilitative effect of conventionality in comprehension was

documented earlier in several studies, including Cook and Liddicoat (2002) and Taguchi

(2005). As previously discussed, examining ESL learners‘ comprehension of request speech

acts at different levels of directness, Cook and Liddicoat found that conventional forms were

significantly easier to comprehend than non-conventional expressions. Similarly, in Taguchi‘s

study, which measured EFL learners‘ ability to comprehend more and less conventional

implicatures in terms of comprehension accuracy and comprehension speed, it was found that

more conventional implicatures were significantly easier and took a shorter time for the

learners to comprehend than less conventional implicatures. The findings of the present

study, therefore, corroborate earlier findings about the facilitative effect of conventionality on

L2 learners‘ pragmatic comprehension.

5.2 The effect of L2 proficiency on learners’ comprehension accuracy

An examination of the effect of L2 proficiency on learners‘ comprehension of implied

meaning revealed that although high-proficiency learners and low-proficiency learners did not

differ significantly in their comprehension of non-conventional indirectness, high-proficiency

learners out-performed low-proficiency learners in comprehending conventional indirectness,

suggesting that L2 proficiency played a role in pragmatic comprehension. The relationship

between general L2 proficiency and comprehension of pragmatic functions was addressed

earlier in several studies including Koike (1996), Cook and Liddicoat (2002) and Taguchi

(2005). As previously discussed, Koike examined how university students in their first,

second, and third year of Spanish understood Spanish indirect suggestions. Koike found that

third-year students displayed superior pragmatic performance compared to those in the first

two years. Similarly Cook and Liddicoat, examining ESL learners‘ comprehension of request

speech acts at different levels of directness, found that more proficient learners were able to

understand direct and conventional direct request better than less proficient learners.

Furthermore, Taguchi, investigating EFL learners‘ pragmatic comprehension in terms of

accuracy and speed, also reported that higher L2 proficiency leads to better pragmatic

performance. The findings of the present study, therefore, are congruent with earlier findings

about the effect of proficiency on pragmatic comprehension.

6. Conclusion

Revealing significant effects of different types of indirectness and L2 proficiency on learners‘

comprehension of implied speaker intention, this study not only contributes to the body of

research on pragmatic comprehension but also provides some ideas for developing EFL

learners‘ pragmatic skills. The present study shows that comprehension of non-conventional

indirectness, which requires drawing inference from contextual cues, was relatively

118

FLLT 2011 Proceedings

problematic for the learners. When teaching non-conventional indirectness, classroom

activities that enhance learners‘ inferential skills should be introduced.

The focus of this study is on the effects of types of indirectness and L2 proficiency on

learners‘ comprehension of implied speaker intentions. However, further research

investigating other factors such as learning contexts (e.g., SL setting versus FL setting) and

individual learners‘ characteristics (e.g., motivation, social and psychological distance, social

identity) is recommended. Since this study is a cross-sectional investigation of a small group

of learners, future research focusing on larger groups of learners may yield a better

understanding of pragmatic comprehension in L2.

Notes 1 It is important, however, to note that there remain further complications with regard to indirect speech

acts. A full discussion of the issue is beyond the scope of the present study. 2 English proficiency was determined by the scores from the courses entitled ―English I‖ and ―English II‖

which the students had taken in their first year at the university. The scores from the two courses were

determined as follows: A = 4, B+ =3.5, B=3, C+=2.5, C=2, D+=1.5, D=1. The mean scores and their

interpretation were in a range from: high, 6.5-8; moderate, 4.5-6; low, 2-4. To increase the reliability of the

separation procedure, students ranked in the middle section of the proficiency scale were excluded. Only

students belonging to the bottom and top sections were selected. 3

The filler items testing literal comprehension were included as distracters to draw the participants‘

attention away from the actual purpose of the test.

References

Austin, J. L. (1962). How to do things with words. Cambridge, MA: Harvard University

Press.

Carrell, P. L. (1981). Relative difficulty of request forms in L1/L2 comprehension. In M.

Hines & W. Rutherford (Eds.), On TESOL ’81 (pp.141-152). Washington, DC: TESOL.

Cook, M., & Liddicoat, A.J. (2002). The development of comprehension in interlanguage

pragmatic: The case of request strategies in English. Australian Review of Applied

Linguistics, 25, 19-39.

Gass, M. S., & Selinker, L. (2000). Second language acquisition: An introductory course.

New Jersey: Lawrence Erlbaum Associates, Inc.

Holtgraves, T. (2007). Second Language Learners and Speech Act Comprehension. Language

Learning, 57:4, 595-610.

Intachakra, S. (2007). Fundamental Concepts of Pragmatics, Bangkok: Thammasat

University Press.

Kasper, G., & Rose, K.R. (2002). Pragmatic development in a second language. Language

Learning, 52, viii-x, 1-339.

Koike, D.A. (1996). Transfer of pragmatic competence and suggestions in Spanish foreign

language learning. In S.M. Gass and J. Neu (Eds.), Speech acts across cultures:

Challenges to communication in a second language (pp.257-281). Berlin: Mouton de

Gruyter.

119

FLLT 2011 Proceedings

Searle, J. (1975). Indirect speech acts. In:Cole, P. and Morgan, J. (eds.) Syntax and Semantics

3: Speech Acts. New York, NY: Academic Press, pp.59-82.

Taguchi, N. (2005). Comprehending implied meaning in English as a second language.

Modern Language Journal, 89, 543-562.

Taguchi, N. (2008). Pragmatic Comprehension in Japanese as a second language. Modern

Language Journal, 89, 543-562.

Thomas, J. (1995). Meaning in interaction: An introduction to pragmatics. London:

Longman.

About the Author

Boonjeera Chiravate is an assistant professor at Department of English, Faculty of Arts,

Silpakorn University, Thailand. She completed her M.A. and Ph.D. in Linguistics at

Michigan State University, USA. Her current research interests are syntax, semantics,

pragmatics and second language acquisition. Recently, she has been actively involved in

interlanguage pragmatic research.

120

FLLT 2011 Proceedings

Language Learning Autonomy and Action Research

MV. Joyce Merawati

Politeknik Negeri Bandung, Indonesia

[email protected]

Abstract

This study attempts to explore the development of learning autonomy of seventeen Civil

Engineering students at a state polytechnic in Indonesia when learning English as a foreign

language by conducting inductive action research together with the students and was

supported by the managing staff of Self-Access Language Learning (SALL). The

development was analyzed from learners‘ journals, observations, and class discussion or

small talks. The results showed that conducting action research with the students for two

semesters develops language learning autonomy in various degrees moving from physical to

cognitive behaviors.

Introduction

One of the goals of education is to build students‘ learning autonomy or individuals‘ ability to

decide what they think (Boud, 1988 in Benson and Voller, 1997). Autonomy cannot be learnt

within a short time and total autonomy is an ideal but it is rarely reached (Gardner and Miller,

1999). This study attempted to develop the students‘ autonomy in language learning by

applying inductive action research when they were studying English as a foreign language,

particularly in reading class, at Politeknik Negeri Bandung, Indonesia. This paper briefly

discusses autonomous learners‘ characteristics, promoting learning autonomy, and action

research; in addition, a program and the results are also presented.

The Characteristics of Autonomous Learners

Learning autonomy in this study is defined as the students‘ ability to make decision about

what to learn and how to manage their learning to achieve their objectives. Autonomous

learners are those who are able ‗to take charge of their own learning‘ (Holec, 1981 cited in

Gardner and Miller, 1999). Benson (2001) prefers to define it as those who have ‗the capacity

to take control of their own learning‘. In philosophy and psychology, autonomy has come to

be associated with the capacity of the individual to act as a responsible member of society

since learners cannot be independent from one another (Benson and Voller, 1997). In order to

have relatedness with their learning environment, learners have to regulate themselves in two

levels i.e. being reactive and proactive (Littlewood, 1999). They are able to orchestrate

various learning strategies.and act as the managers of their own learning (Holec, 1987) i.e.

they know what to learn, with what materials, how to learn, and reflect to assess the

outcomes.

Autonomous learners have clear learning purposes i.e. communicative competence (Holec,

1979). They have strong motivation, high level of confidence, adequate knowledge and skills

(Littlewood, 1996). They are capable of identifying their problems and learning to solve their

problems (Ridley, 1997). They establish personal agendas for learning, set up directions, set

clear standards of goals, and monitor, control, and motivate themselves to achieve their goals

(Pintrich, 2004; Little, 1999; Ridley, 1997). They are flexible and capable of managing,

regulating their learning, and using available resources (Breen and Mann, 1997). They make

121

FLLT 2011 Proceedings

use of various high level cognitive and metacognitive strategies and select suitable materials

to achieve their goals and reflect to assess their achievement. They manage learning and

feelings by applying appropriate social and affective strategies to increase their motivation,

and to control their nervousness.

However, the less autonomous learners prefer to learn the language incidentally (Smith, 1988

in Ridley, 1997). They have unclear learning purposes and low extrinsic motivation. They do

not develop their learning strategies (Porte, 1990, in Griffiths, 2003), and apply low-level

cognitive strategies (Littlejohn, 1997). They are teacher dependent and expect teachers to

assign, correct homework, and explain grammar.

Promoting Learning Autonomy

Many experts find that learning autonomy can be enhanced by means of learner-centered

approach and providing learning strategy training (Nunan, 1996; Dam, 1998; Cohen, 2003).

Learner-centered approach is different from traditional approach for it requires teachers and

learners to collaborate in the decision-making process. This approach needs several

proceedings as suggested by Nunan (1996):

1. Collecting data about the learners to diagnose their objective needs (Richterich, 1972 in

Nunan, 1996).

2. Selecting content and material by making explicit the content objectives of a course and

by training learners to set objectives. This encourages them to have a more realistic goal,

see their needs, and develop their learning skills and strategies.

3. Negotiating the methodology

4. Conducting evaluation at various times.

5. Promoting learners‘ self-evaluation. Learners may evaluate the materials, learning

activities, and their own achievement.

This approach allows teachers to teach both specific language skills and learning strategies

i.e. to encourage them to adopt realistic goals, develop skills to negotiate, provide learners

with efficient learning strategies, help them identify preferred ways of learning, and reflect to

self-evaluate their achievement (Nunan, 1996). As the course goes on, the students develop

their awareness, and the good relationship between the students and the teacher is established,

the program can be modified because the most valuable learners‘ data are obtained in an

informal way after relationships between the students and the teacher have been established

(Nunan, 1996).

Dam (1998) provides some steps; at the beginning teacher direct students to reflect by

gathering learning experiences and evaluating, then planning carrying out plans and finally

reevaluating. In each stage, learners are advised to answer reflective questions such as ‗what

did I do?‘ ‗how did I do it?‘ ‗What are the problems?‘ ‗What are the achievements?‘ ‗What

are the next steps?‘ These questions help learners diagnose their strengths and weaknesses,

become aware of what helps them learn the target language efficiently, perceive their

problems, develop a broad range of problem-solving strategies, make decisions, monitor,

evaluate and transfer the successful strategies (Cohen, 2003).

Learners are also allowed to practice and experience the advantages of systematically

applying the strategies to the learning and use of the language they are studying (Cohen,

2003). At this stage generally learners‘ journals have been promoted as vehicles for reflection

122

FLLT 2011 Proceedings

and self-evaluation (Kent, 1997 and Moon, 1999 as cited in Little, 2007). Writing journals

and self-reports are highly conscious and direct learners to think deeply, internalize and use

the language and strategy learned.

In addition, learners are advised to look for opportunities to share their preferred strategies

with others and to increase the use of their strategies (Cohen, 2003). By sharing their

strategies orally to their friends and class, learners are able to adopt other strategies learned

from their friends and use the language authentically (Little, 2007).

To promote learning autonomy, a teacher has roles to help students be active in learning.

Teacher‘s tasks are to set up dialogues, reorganize and refashion learners‘ prior knowledge

and strategies to help learners reach their potential cognitive levels (Gardner and Miller,

1999). A teacher warmly acts as a guide, facilitator of learning, a counselor, and as a resource

(Benson, 2001). She/he guides learners set objectives, plan, select materials and organize

interaction, evaluate, and acquire the skills and knowledge (Voller, 1997). However, when the

learners‘ activities are leading them into ‗blind alley‘ especially when they fail to set

themselves ‗optimal challenges‘, a teacher has the responsibility to intervene (Little, 2007).

These activities are strengthened and put into practice in the framework of inductive action

research, in which the teacher together with the learners may negotiate the various needs,

interests and goals; and then plan, carry out the plan and evaluate together.

Action Research

Action research models a process of reflective cycle on professional action (Wallace, 1998). It

focuses on problems and aims at solving problems (Carr and Kemmis, 1986; Cohen, 2007;

Stringer, 1996). The main characteristic of action research is the spiral activity consisting of

planning, acting, observing, and reflecting (Kemmis and McTaggart, 1988, as cited in

Stringer, 1996). Action research has two types of inquiries – inductive and deductive

(Wallace, 1998). Inductive action research is conducted when the inquiry is derived from data

collection; on the other hand, when the inquiry is to apply the principles of good teaching

methodology, deductive action research is carried out.

The inductive action research, to some extent, is matched well with learner-centered approach

for at least six reasons: first, the inductive action research starts with need analysis to discover

the problems conducted by the teacher together with the students and followed with actions to

solve the problems based on the students‘ needs, interests and wants. Second, it has two

approaches - individual and collaborative approach (Wallace, 1998). It allows the classroom

teacher to collaborate with the students because it can be undertaken by individual teachers as

well as a group of teachers working together within one school etc. (Cohen, et.al, 2007).

Third, it has cycles which each consists of plan, act, observe and reflect (Carr and Kemmis,

1986) and each cycle can be the modification or refinement of the previous ones (Stringer,

1996). These help the students manage and control their learning. Fourth, action research,

particularly the community-based action research, can be conducted based on everyday life

activities by a group of people in collaboration to assist others in extending their

understanding of their situation and thus resolves problems (Stringer, 1996). Fifth, it is

employed in anticipation of some changes (Stringer, 1996; Wallace, 1998) because the

changes of each cycle could be compared and the paths of development could be investigated.

This allows the students reflect and evaluate their development. Finally, it allows individual

teacher or researcher to control and select appropriate research tools for the teacher‘s

123

FLLT 2011 Proceedings

environment and uses these tools to generate the necessary feedback in a systematic way

(Cohen, 2007). These allow the teacher to use various data collecting methods and evaluation

instruments usually used in the classroom activities. Therefore, inductive action research,

which to some extent has some similarities to learner-centered approach, may enhance

language learner autonomy because learner autonomy.

Since action research allows researchers or teachers to use ordinary instruments and data

collecting methods, for students‘ reflection and evaluation in this study, students‘ journals –

learning log, reflection journals and thinking process journal were used as the main

instruments. In addition, classroom discussion, some small talks, and observation noted in

researcher‘s diaries were also used. The small talks and observations were conducted when

the students reported their strategies applied to the class or when they had learning activities

both in the class and in SALL.

The Program

One program run based on inductive action research was a class of a reading program in

Politeknik Negeri Bandung. It was conducted in three cycles and lasted in two semesters. It

started with a diagnostic phase and followed with three cycles which each consisted of plan,

act, observe and reflect. Diagnostic Phase was to analyze the objective needs, the students‘

language proficiency, and interests. The results were discussed and considered in ‗Plan‘ stage

to select the content and gradation, methodology, materials selections, and evaluation. The

‗Plan‘ stage was followed by a set of treatments or ‗Act‘ in which an ongoing monitoring was

carried out. By the end of each cycle an ‗Observe and Reflect‘ stage or assessment was

conducted. The program was then evaluated and refined at the next cycles. This program is

illustrated in diagram 1.

124

FLLT 2011 Proceedings

COLLABORATION

Students The lecturer Staff of SALL

‗Act‘ carrying out the plan

Plan‘ together with the students

and staff of SALL

‗Observe and Reflect‘

To evaluate the results

‗Act‘ carrying out the plan

Plan‘ together with the students

and staff of SALL

Observe and Reflect‘

To evaluate the results

‗Act‘ carrying out the plans

‗Plan‘ together with the students

and staff of SALL

DIAGNOSTIC PHASE

Diagram 1 The Program

Each cycle consisted of planning, exposures of some strategies, models, discussions

and practices (Cohen, 2003) and ended with evaluation as illustrated in Diagram 2.

individually

or

Practice with peers

Guided practice

Discussion

Exposures of strategies

through modelings

Introduction

Diagram 2 Treatments of Each Cycle

Before planning was carried out, feedback on strategies which were applied by the students in

the previous cycle was jointly discussed. At ‗Plan‘ stage, the lecturer and students

collaborated to develop instructional decision; the students were encouraged to provide

suggestions about the materials, the objectives of the cycles, and the learning activities. To

guide the students in deciding their learning objectives, the students were encouraged to

reflect on their problems in reading English texts or learning English. In preparation for the

‗Act‘, the lecturer collaborated with the managing staff of SALL. During ‗Act‘, exposures to

the strategies were provided by the lecturer and models were given either by the lecturer or

peers. In this occasion, the students explored various strategies and discovered suitable and

personalized strategies. Subsequently the students were instructed to practice the strategies

with peers and finally practice individually either in SALL or at home whilst doing their

Cycle 1

Cycle 2

Cycle 3

EVALUATION Observe and reflect

Act

Plan

125

FLLT 2011 Proceedings

assignments. At the end of each cycle the program were reviewed, evaluated and refined in

the next cycles.

This study was conducted in a reading program of 24 first-year civil engineering students,

among them 17 students were intensively analyzed because they attended the class, wrote,

and submit their journals regularly. When the language learning autonomy were explored

from the students‘ learning purposes, motivation and reading skills particularly their skills for

constructing meaning, the results showed that the program enhanced the students‘ language

learning autonomy.

The learners‘ learning purposes which were analyzed from the students‘ answers of ‗What do

you want?‘ triangulated with those of ‗What did you learn?‘ showed that they developed from

physical activities to learning for problem solving. In detail the development moved from

enjoyable activities, reading to obtain content information, reading for language learning,

improving language starting from easy materials, to learning based on preferences/interests,

improving language (vocabulary/grammar) using challenging materials, and finally to solving

problems. The last three stages were experienced by the students who had fairly high

proficiency only; some of them learned the language by applying top-down approach and

others preferred bottom-up approach. It was also found that learners who applied top-down

approach had limited ability to plan, monitor, and evaluate their language. The learners‘

motivation – represented by their affective response - analyzed from the students‘ reflective

journals improved for various reasons. Their motivation developed from enjoying the learning

activities, obtaining language knowledge , being able to apply learning strategies, developing

thinking, finding and solving problems, applying imagination and creativity, expressing ideas,

retaining words for longer periods, to being capable of doing challenging exercises and

learning independently. The skills for constructing meanings analyzed from the students‘

thinking process journals developed in three clusters: typography of texts, analyzing,

classifying words, and synthesizing meanings from other words, and finally relating meaning

to the wider scope of contexts.

These results showed that the development of students‘ learning autonomy were in line with

the levels of language proficiency and learning purposes. When they focused on enjoyment

activities, they did not apply their high level of cognitive strategies to learning the language.

However, when they had language learning purposes, they then thought deeply and as a result

they learned and acquired the language.

Conclusion

Autonomous learners are those who are capable of managing and responsible for their

learning. They are able to orchestrate various learning strategies, set realistic goals, select

materials and learning methods, and evaluate the outcomes. Learning autonomy can be

developed by means of learner-centered approach which requires lecturers to collaborate with

the students throughout the program. It has several steps, diagnose the students‘ needs,

interests and lacks, selecting learning content and materials, negotiating the methodology, and

conducting evaluation. This approach matches well with the inductive action research

providing that the research is conducted by the teacher or a group of teachers together with

the students. After conducting this study in two semesters in an English reading class of Civil

Engineering students at Politeknik Negeri Bandung, Indonesia, the students‘ learning

autonomy developed from physical to cognitive behaviors.

126

FLLT 2011 Proceedings

References:

Benson, P. (2001) Teaching and Researching Autonomy in Language Learning. England:

Pearson Education Limited.

Benson, P., and Voller, P. (1997) Autonomy and Independence in Language Learning, New

York: Longman

Breen, M.P. and Mann, S.J. (1997) Shooting arrows at the sun: Perspectives on a pedagogy

for autonomy, in Autonomy and Independence in Language Learning, Benson and

Voller, eds, 1997, London: Pearson Education Limited.

Carr, W and Kemmis, S. (1986) Becoming Critical: Knowing Through Action Research,

Burwood: Deakin University Press

Cohen, A. (2003) Strategy Training for Second Language Learner, Eric Digest, ED482492

Cohen, L., Manion, L., & Morrison, K. (2007) Research Methods in Education (6th Edition

ed.). London: Routledge Falmer.

Dam, L. (1998) Why Focus on Learning rather than Teaching? From Theory to Practice,

Focus on Learning rather than Teaching: Why and How? Papers from the IATEFL

conference on learner independence, Kraköw, 14 – 16 may 1998, CLCS, Trinity

College Dublin 2, Ireland.

Gardner, D and Miller, L. (1999) Establishing Self-Access: From Theory to Practice.

Cambridge: Cambridge University Press.

Holec, H. (1979) Autonomy and Foreign Language Learning, Strasbourg: Council of the

Europe

Holec, H. (1987) The Learner as Manager: Managing Learning or Managing to learn? in

Learner Strategies in Language Learning, Wenden and Rubin, eds, 1987, London:

Prentice Hall ELT

Little, D. (2007) Language Learner Autonomy: Some Fundamental Considerations Revisited,

Innovation in Language Learning and Teaching, Vol 1, No 1, 2007

Littlejohn, A. (1997) Self-Access Work and Curriculum Ideologies, in Benson, Phil and

Voller, Peter eds (1997) Autonomy and Independence in Language Learning, United

Kingdom: Pearson Education Limited. pp. 181-191

Littlewood, W. (1996) Autonomy: an Anatomy and a Framework, System, Vol. 24, pp 427-

435; Elsevier Science Ltd.

Littlewood, W. (1999) Difining and Developing Autonomy in East Asian Contexts, Applied

Linguistics, 20 (1), pp. 71-94.

Nunan, D. (1996) The Learner-Centred Curriculum, Cambridge: Cambridge University Press.

127

FLLT 2011 Proceedings

Oxford, R. (1990) Language Learning Strategies. Massachusetts: Heinle & Heinle Publishers.

Pintrich, P.R. (2004) A conceptual Framework for Assessing Motivation and Self-Regulated

Learning in College Students, Educational Psychology Review, Vol. 16, No. 4

December 2004.

Ridley, J. (1997) Reflection and Strategies In Foreign Language Learning, Frankfurt,

Germany: Peter Lang GmbH.

Stringer, E.T. (1996) Action Research: A Handbook for Practitioners, New Delhi: Sage

Publications

Victori, M. and Lockhart, W. (1995) Enhancing Metacognitive in Self-directed Language

Learning, System, Vol. 23, No. 2: pp 223-234

Voller, P. (1997) Does the Teacher have a role in Autonomous Language Learning, in

Benson, P. and Voller, P. Eds. (1997) Autonomy and Independence in Language

Learning, United Kingdom: Pearson Education Limited

Wallace, M. J. (1998) Action Research for Language Teachers, Cambridge: Cambridge

University Press

About the Author

Dr. MV. Joyce Merawati, Dipl. TESL., M.Pd. is an English lecturer at Politeknik Negeri

Bandung, Indonesia. She got her bachelor degree in Teaching English in 1981 from IKIP

Sanata Dharma, Jogyakarta, Indonesia; her Post Graduate Diploma in Teaching English as a

Second Language from Victoria University of Wellington, New Zealand in 1991. She got her

master degree in 2003 and doctoral degree in 2010, from Indonesia University of Education.

Her interests are in teaching English at non-English department and her research interest is in

learning autonomy.

128

FLLT 2011 Proceedings

Learning L2s among Southeast Asian Immigrant Women in Taiwan: The Case of Chinese L2 Classroom Practices Contested by First L2 Effect

Yu-Hsiu (Hugo) Lee

Graduate School of Language and Communication,

National Institute of Development Administration (NIDA)

[email protected]

Abstract

This study reconceptualized Chinese L2 teaching, learning and research in a way that

illuminated ―first L2 effect‖ which enormously influenced L2 practices among immigrant

women in Taiwan. This paper has argued that language preferences immigrant women in

Taiwan made on L2 acquisition in a multilingual society can be understood by pursuing a

particular first L2 rather than all other L2s. It theorized that their developed tendency to

maximize this certain L2 system can be more cognitively satisfactory than mastering other

unfamiliar L2s. Challenging common beliefs of language and power, the findings proved that

a powerful L2, such as Mandarin Chinese, plays a minimal role on the most dominant L2

acquisition in immigrant communities in a multilingual society, because vernacular Southern-

Min L2 is actively practiced as the most dominant L2 among 40 % of these immigrants

(N=60) in a predominantly Mandarin Chinese L2 environment.

Introduction

Mandarin-Chinese medium of instruction is at crisis in official Mandarin Chinese L2

programs designed particularly for Southeast Asian immigrant women in Taiwan, because, on

the one hand, data from this study indicated that there are an increasingly number of

immigrants (40%, N=60) coming to Mandarin-Chinese L2 classrooms with more fluent or

native-like vernacular Southern-Min L2 speaking ability but with very limited or no

proficiency in Mandarin Chinese L2. On the other hand, data stated in marked contrast that a

number of immigrant women (50%, N=60) rely heavily on Mandarin Chinese L2 with very

limited or no proficiency in vernacular Southern-Min L2.

Searching for root causes of these two extreme cases, data revealed that official language

policies, literacy planning efforts and formal L2 education have little or no effect on what is

the most dominant L2 over other L2s among informants. However, data showed that initial

language socialization (2-3 years) right after immigration has a long lasting influence on not

only what are the most dominant L2s but also possibilities of acquisition of other L2s in

participants.

129

FLLT 2011 Proceedings

Multilingual Developments in Contemporary Taiwan

Table 1: Societal uses of languages in modern Taiwan

Linguistic

Groups

% of

Population

in Taiwan

Reported Societal Uses of Languages

Austronesian-

Formosan

Speakers

<2%

-Can read and write Mandarin-Chinese;

-Can read and write foreign languages (i.e., English);

-Trilingual among Indigenous languages, Mandarin-

Chinese and Southern-Min;

-Bilingual between Aboriginal languages and

Mandarin-Chinese;

-Monolingual Mandarin-Chinese

Southern-Min

Speakers

73.3%

-Can read and write Mandarin-Chinese;

-Can read and write foreign languages (i.e., English);

-Bilingual between Southern-Min and Mandarin

Chinese;

-Bilingual between Southern-Min and Japanese among

elder generation;

-Monolingual Southern-Min among elder generation

Hakka

Speakers

12%

-Can read and write Mandarin-Chinese;

-Can read and write foreign languages (i.e., English);

-Trilingual among Mandarin Chinese, Southern-Min

and Hakka;

-Bilingual between Hakka and Mandarin Chinese

-Monolingual Mandarin Chinese

Mainlander:

Mandarin-

Chinese

Speakers

with

Dialectal

Variations

13% -Can read and write Mandarin-Chinese;

-Can read and write foreign languages (i.e., English);

-Bilingual between Mandarin-Chinese and Southern-

Min (some can understand Southern-Min but cannot

speak it);

-Monolingual Mandarin Chinese

Southeast

Asian

Immigrants

(Usually

Women)

2%> -Can read and write Mandarin-Chinese with varying

proficiency levels;

-Can read and write foreign languages (i.e., English);

-Trilingual between their L1s, Southern-Min and

Mandarin-Chinese;

-Trilingual among L1s, Hakka and Mandarin-Chinese;

-Bilingual between their L1s and Southern-Min;

-Bilingual between their L1s and Hakka;

-Bilingual between their L1s and Mandarin-Chinese

Sources: Huang (1993); Lee (2010, p.25); Price (2009, p. 239).

All native languages related to mother tongues spoken by immigrants in Taiwan are

recognized, but they are not yet developed into, or recognized as, official languages used in

130

FLLT 2011 Proceedings

government (Fu-Ju, 2007, online). In reviewing the history and recent language policy

developments, and literacy planning, it could be argued that recent language policy and

planning in Taiwan has not moved away from a linguistic hierarchy with only Mandarin-

Chinese as the main language and minority languages being positioned in subordinated

positions. In other words, language policy in Taiwan for immigrants has not yet moved

toward paralleled development of mainstream languages and minority languages.

Any conception of prestige related to literacy planning (Liddicoat, 2007, p1) and promoting a

particular literacy usually comes at the expense of minority languages. 100 hours of

Mandarin-Chinese literacy instruction under current language policy and literacy planning is a

response to massive number of immigrant women from Southeast Asia. In school-based

Mandarin-Chinese programs designed to enact mass literacy for immigrant women in Taiwan,

literacy development is narrowly viewed as literacy acquisition for an official language—

Mandarin-Chinese. Local vernacular languages and mother tongues of immigrant women are

viewed as means for acquiring the official language and not an end in and of itself.

Relative to language policies, literacy planning and formal Chinese L2 education, Taiwan‘s

linguistic cultures explicitly and implicitly influenced daily practices of vernacular languages

as well as official Mandarin-Chinese language occurred for immigrant women communities

where this study was conducted.

Table 2: Language hierarchy in Taiwan

English

Mandarin Chinese

Southern-Min

Hakka

Indigenous languages &

Immigrant women‘s Southeast Asian languages

Sources: Wei-Ren, (n.d.) online

Regarding linguistic cultures, most research has shown that women are more aware of

linguistic cultures than men. Some scholars agree that women tend to be more innovative

linguistically than men and utilize more advanced, newer, and prestigious forms of languages

(Gal, 1978, pp. 1-16, Smith-Hefnir, 2009, pp. 57–77, and Cavanaugh, 2006, pp. 194–210).

For instance, Gal studied 18 women and 14 men in Oberwart, a German- Hungarian bilingual

town located in the province of Burgenland in eastern Austria, and found that young women

influenced the whole community into a language shift from German- Hungarian bilingualism

toward monolingual German. Linguistic code change symbolizes social change. The speech

choices of Hungarian-German bilingual women indicate their social positions. Those

speaking the Hungarian language are considered farmers and identified with local agricultural

and negative connotations. However, those speaking the German language have a more

affluent status, and, even though they are employed in factories, represent money and prestige

(Gal, 1978, pp. 1-16).

Contrasting to Gal‘s research, Mugambi studied four women and two men in a contemporary

Kenyan urban setting and found that monolingualism among Kenyan women is tied to the

patriarchic structure in Kenyan communities. Women have customarily been kept out of

interethnic social interactions in Kenya. Thus, they rarely need to acquire, or learn, a second

language unless they marry a husband of a different ethnicity than theirs. A woman in

interracial marriage is expected to learn the first language of her husband as part of the

131

FLLT 2011 Proceedings

assimilation process. In some cases, married couples adopt English, Kiswahili (Swahili), or

both English and Kiswahili so they do not use their first languages at home. While the

language shift has occurred from indigenous languages to English and Kiswahili in the home

domain, women play the key role in maintaining indigenous languages. Mugambi‘s results

showed that Kenyan women in interracial marriages are constrained by the patriarchal family

structure and cultural expectations that requiring them to learn the first languages and cultures

of their husbands (Mugambi, 2002, pp. 12-23). Gal‘s and Mugambi‘s studies will be used to

compare with immigrant women in Taiwan.

Methods

The Immigrant Woman Communities

Kaohsiung, a harbor city in Southern Taiwan, is the second largest metropolitan area in this

beautiful tropical island. More than ninety percent of Kaohsiung City‘s population speaks

Southern-Min language. The city of Kaohsiung has long been a stronghold of traditional

Taiwanese languages, cultures and values. Kaohsiung City provides a rich site for language

research because residents here are known for their close-knit families. Local communities

where Southeast Asian immigrant women live remain relatively conservative as its core,

despite the fact that Kaoshiung is today a modern and second cosmopolitan center in Taiwan.

60 participants were selected on the basis of their accessibility to the researcher and their

willingness to collaborate in the research. All participants have fairly similar diasporic

backgrounds with other Southeast Asian immigrant women throughout Taiwan. 60

participants selected include Burmese, Cambodians, Filipinos, Indonesians, Malaysians, Thais

and Vietnamese. Participants chosen represent seven different Southeast Asian countries in

the range of potential Southeast Asian immigrant women in Kaohsiung City with ages ranging

from early twenties to late sixties. The researcher digitally recorded and observed them over

a period of three years (May 2007-December 2009). Participants were interviewed and

observed in multiple sites including two official adult literacy education programs, one private

adult literacy education classroom, one protestant church that provides shelter for immigrants,

two workplaces, two households, and one immigrant woman service center.

Data Collection and Analysis

The researcher aimed to answer this following research question in this contribution: what

affects the most dominant L2 teaching and learning over other L2 acquisitions among

Southeast Asian immigrant women in Taiwan. The research question provides an opportunity

to demonstrate the utility of language policies, literacy planning, formal L2 education,

linguistic cultures and relevance theory. Field-notes gathered from participant and non-

participant observations supply data set. Thus, data sources include digital-recorded

interview transcripts from individual interviews and transcripts of group interviews. Included

as data sources are field-notes from observing participants interacting with each other,

dialogues with L2 teachers, and spontaneous conversations in multiple sites. The impact

factors that affect the most dominant L2 over other L2s are examined by means of the

research instrument—an interview protocol—consisted of a series of close and open-ended

questions pertaining to the language background of participants as well as their current

reported impact factors of the most dominant L2s. Only one interview for each of the 60

subjects does not constitute interview data, so a number of fellow-up individual interviews

and follow-up group interviews are to ensure the methodological rigor. Each interview lasted

132

FLLT 2011 Proceedings

approximately one hour, so the digital-recordings of the interviews yielded a significant

amount of data.

Findings and Conclusion

Table 3: Responses of Southeast Asian informants when asked what affects the

way they acquired their most dominant L2 oral and written discourse

in a multilingual setting

Impact factors # of responses from 60

informants

% of responses from 60

informants

Host parents/husbands/family

members: Exposure to a local

vernacular Southern-Min L2

in a household language

domain for 2-3 years upon

their arrival

25 40%

Receiving formal Mandarin-

Chinese L2 education in an

official program for 2-3 years

soon after migration

30 50%

Friends and neighbors from

Taiwan and home countries

Media:

Newspapers, TV, radio

No opinion/unclear/

neutrality

5 8%

Comparable to Mugambi‘s (2002) study, it is evident from data indicating that immigrant

women in Taiwan are constrained by the patriarchal family structure and expectations from

strong cultural tradition that requiring them (40%, N=60) to learn vernacular Southern-Min

L2 in their home language domain in order to communicate with their Taiwanese in-laws.

Nonetheless, the patriarchal family structure and expectations from strong cultural tradition,

as suggested by Mugambi (2002), fail to explain why 50% of informants (N=60) resisted to

acquire Southern-Min L2 despite the fact that their Taiwanese in-laws can only communicate

in Southern-Min language.

Parallel with Gal‘s (1978) study, data echoed that immigrant women in Taiwan, to some

extent, are aware of linguistic cultures and language hierarchy because 50% of them (N=60)

speak predominantly Mandarin-Chinese L2 with very limited or no proficiency in Southern-

Min L2. Nevertheless, the perspective drawn from Gal (1978) regarding different linguistic

codes that symbolized different social prestige may not adequately explain why 40% of

informants (N=60) are reluctant to learn more powerful Mandarin-Chinese L2.

133

FLLT 2011 Proceedings

Combined with Mugambi (2002) and Gal‘s (1978) perspectives, this study proposed first L2

effect to explain initial language socialization in immigrant woman communities in Taiwan.

First L2 effect is a term coined by the researcher for lack of a better term. Reported from

data, first L2 usually becomes the most dominant L2 for immigrants in a multilingual host

society such as the immigrant communities in Kaohsiung. It occurs when the interview

responses speak to a tendency on the part of immigrant women to insist on utilizing a certain

L2 instead of other L2s in a multilingual setting. 90 % of participants desired a particular L2

over other L2s. The most intriguing finding from the data, however, concerns the pattern of

reported first L2 language use as correlated with initial language and literacy socialization in

Taiwan for immigrant women. Challenging current notions of language and power, the

differences in reported adopting different first L2s in Taiwan often reflect the fact concerning

what are first L2s immigrants were first exposed to in initial language socialization soon after

their transnational movement. It is interesting to note that some participants utilized

Mandarin-Chinese as their first L2, but others revealed a marked preference for the adoption

of Southern-Min as their first L2.

While similar percentages of participants reported utilizing their certain first L2 most

frequently than other L2s, a significant distinction emerged in the use of Mandarin-Chinese

L2 and Southern-Min L2 (50% and 40%, respectively). Crucially, immigrant women (50%)

who received formal Mandarin-Chinese L2 instruction first and then acquired a vernacular

Southern-Min L2 in home language domains developed their formal Mandarin-Chinese L2 in

a manner superior to that of the local vernacular Southern-Min L2. By contrast, if they (40%)

first acquired a local Southern-Min L2 language and knew it for several years (data reported

2-3 years) before receiving formal Mandarin-Chinese L2 instruction, their local Southern-Min

L2 was superior to their formal Mandarin-Chinese L2.

In a multilingual setting, the first L2 acquired by immigrants, either through formal L2

instruction that are influenced by language policies or through socialization that took place in

home language domains, becomes more influential and significant than other L2 oral and

written discourses available. Therefore, immigrants recognized with first L2 effect developed

strong tendencies to maximize this particular L2 verbal-written discourse over others,

regardless of the actual demands of other, or alternative, language competencies. Most

participants identified with first L2 effect heavily rely on their particular first L2s more

frequently than other L2s in the host society. They stated that they regularly engage in certain

L2 activities where languages, other than first L2s, become less desirable.

Relevance theory can be used in explaining first L2 effect. Relevance theory says one is

inclined to draw attentions to occurrences applicable to improving prior beliefs (Sperber &

Wilson, 1987, 1995, and 2004). The cognitive principle of relevance shows cognition has a

predisposition to be geared toward maximizing relevance, because everyone generates

expectations of relevance when observing stimuli responsive to established personal belief

systems that yield considerable cognitive rewards. When hearing or reading L2 words people

develop a tendency to construct interpretative presumptions that follow paths of least efforts,

enabling them to access desirable and satisfactory comprehensive tasks. When immigrant

women were exposed to a first L2 in a multilingual society through their initial language

socialization, they developed a tendency to maximize this particular first L2 rather than other

L2s because pursuing it was cognitively more satisfactory than acquiring other unfamiliar

L2s.

134

FLLT 2011 Proceedings

Continuing discussions of first L2 effect, an accommodation norm, explicitly or implicitly,

typically involves decisions regarding language domains and whether speaking more formal

Mandarin-Chinese language is required or the less formal Southern-Min language in Taiwan.

This study might suggest otherwise. The most surprising finding in data relates to language

and power, and shows that powerful, dominant and prestigious L2s may have weak or no

effect on first L2 acquisition by immigrant women in a multilingual setting such as immigrant

communities in Kaohsiung. The findings suggest that first exposed L2 in an immigrant‘s

initial language socialization has a long lasting effect on her overall L2 acquisitions.

Reported from data, the main contributor of certain L2 fluency for an immigrant woman in

Taiwan is initial exposure to a particular L2 for at least 2-3 years in relatively isolated

language socialization. However, language policy and planning, and linguistic cultures might

have a weaker effect on informants‘ L2 acquisitions.

In Taiwan, the traditional families in Kaohsiung are usually consistent keeper of Southern-

Min language. Even so, data in this study showed that first L2 effect prevents the non-first L2

Southern-Min language from passing to their immigrant wives of these Kaohsiung men, when

the formal Chinese L2 has become the most dominant first L2 in these immigrant women

after receiving formal Chinese L2 education outside their host family discourses.

References

Cavanaugh, J. R. (2006). Little women and vital champions: Gendered language shift

in a Northern Italian town, Journal of Linguistic Anthropology, 16(2), pp. 194–210.

Fu-Ju, Zhang. (2007). From national languages to official languages. The Liberty

Times. Retrieved on November 11 2010 from

http://www.libertytimes.com.tw/2007/new/mar/22/today-o1.htm

Gal, S. (1978). Peasant Men Can‘t GetWives: Language Change and Sex Roles in a Bilingual

Community. Language in Society (7)1, pp. 1–16.

Huang, S.F. (1993). Yuyan, shehui yu zuqun yishi: Taiwan yuyan shehuixue de yanjiu

(Language, Society and Ethnic Identity: A Sociolinguistic Study on Taiwan), Taipei:

Crane.

Lee, Hugo,Y.H. (2010). Exploring biliteracy developments among Asian women in

diasporas: The case of Taiwan. Ph.D. dissertation, Indiana University, United States --

Indiana. Dissertations & Theses @ CIC Institutions.

Liddicoat, A. J. (ed.) (2007). Language planning and policy: Issues in language planning and

literacy. Multilingual Matters Ltd.

Mugambi, H.M. (2002). Language Choice and Shift in Kenya: A Look at the

Changing Roles of English, Kiswahiliand Indigenous Languages. Language,

Literacy & Culture Review, umbc.edu.

Price. G.O. (2009). A political sociology of language in Taiwan: Local, national and global

context. Doctoral dissertation from the University of Essex, Britain.

135

FLLT 2011 Proceedings

Smith-Hefner, N. J. (2009). Language Shift, Gender, and Ideologies of Modernity in

Central Java, Indonesia. Journal of Linguistic Anthropology, (19)1, pp. 57–77.

Sperber, D., & Wilson, D. (1987). Precis of relevance: Communication and

cognition. Behavioral and brain sciences, 10 (4), pp. 697-754.

Sperber, D., & Wilson, D. (1995). Relevance: Communication and cognition (2nd

ed.). Oxford: Blackwell.

Sperber, D., & Wilson, D. (2004). "Relevance theory" in G. Ward. and L. Horn

(eds.), Handbook of pragmatics (pp. 607-632). Oxford: Blackwell.

Wei-Ren, Hong. (n.d.). Where the language policy in Taiwan should go?

Retrieved on November 11 2010 from http://mail.tku.edu.tw/cfshih/ln/paper18.htm

About the Author

Dr. Hugo received his Ph.D. and M.S. from Language Education department at Indiana

University, USA. He obtained his concurrent M.A. from Southern Baptist Theological

Seminary, Kentucky, USA. His professional development will be at Columbia University,

NYC, USA. His research interests include exploring bi/multilingual and bi/multiliteracy

among immigrants, refugees, and orphans.

136

FLLT 2011 Proceedings

On the Effect of Background Knowledge on Reading Comprehension and

Recall Process of a Group of Iranian Intermediate Students

Mahboobeh Khosrojerdi

Islamic Azad University, Sabzevar Branch, Iran

[email protected]

Abstract

The study reported here sought to find further evidence of the role of background knowledge

in EFL reading comprehension and recall. The study was conducted in two succeeding

phases. First, 90 subjects studying at the Iran Language Institute took the TOFEL test. The

results enabled the researcher to select 40 subjects in intermediate level. In the second phase,

a questionnaire and four reading comprehension texts were administered. Finally, the recall

protocols were analyzed. The result of the matched t-tests showed that background knowledge

had effects on reading comprehension and the recall of the texts. Overall, the results

supported the view that background knowledge can be considered as a factor affecting reading

comprehension and recall and therefore, as a source of differential success in EFL language

learning as well.

INTRODUCTION

By far, reading is perhaps the most important of the four skills, particularly in EFL/ESL

situation. In language classes, particularly in advanced level, reading occupies the most class

time for a variety of purposes. Thus, the ability to read well and comprehensibly has been

recognized as a prerequisite to advanced proficiency English. Quite simply, without having

reading proficiency, second language learners are not capable of performing well

communicatively. As a result, theoreticians have generally attempted to devise new plans and

approaches to meet such educational needs.

Early work in second language reading, assumed a passive, bottom-up view of second

language reading. This view holds that the reader reconstructs the intended meaning by

recognizing the printed letters and words and builds up meaning from smallest units in the

text or at ―bottom‖ to larger units at the ―top‖. In 1970, background knowledge was

recognized to have a great role in second language reading. Specially the lack of cultural

familiarity with reading texts influences negatively the total comprehension. According to

Fries (in Patricia L. Carrell, 1988), a failure to relate the linguistic meaning of reading

passages to cultural factors would result in deficiency in comprehension. This is cultural-

specific knowledge which is now known as ―schemata‖.

About a decade ago, the emergence of psycholinguistic models of reading had a strong

influence on second language learning. According to this model, the reader predicts meaning

and then confirms the predictions by relating them to his past experiences and knowledge of

the language. This is in line with what schema theory has suggested.

Different studies show the crucial role of background knowledge in comprehension and recall

of the text. In relation to comprehension and retrieval of a text, Orasana (1986) states that ―the

knowledge a reader brings to a text is a principle determiner of how that text will be

comprehended, and what may be learned and remembered‖ (P. 32). He also mentions that

―schema theory would predict that propositions which are rated as important in light of the

137

FLLT 2011 Proceedings

schema are more likely to be learned and remembered‖ (P. 41). Anderson et al. (1983)

concluded ―a schema influences learning and memory when activated before reading and

retrieval when accessed after reading‖ (P. 43). Hammadou (1991) reported ―readers with

more knowledge about the topic showed more logical (correct) inferences based on the text

and fewer illogical (incorrect) inferences‖ (P: 178).

Background knowledge as a predictor of successful comprehension and recall of the texts has

been investigated through various procedures, one most prevalent technique is recall

protocols. Recall protocol is a technique by which the amount of comprehension is measured

by analyzing the idea units retrieved from the text. Bernhardt (1983, 1991) and Swaffar et al.

(1991), among others (Carrell, 1983, 1984a, 1984b; Wells, 1986), suggest the use of recall

protocols as a measure of holistic or overall reading comprehension.

The study reported here designed to find further evidence on the effect of background

knowledge on reading comprehension and recall of the texts. Quite a number of studies have

been carried out with reference to reading and in particular to reading in a foreign language.

Moreover, many studies have been carried out regarding the processes and factors which

affect the reading comprehension among which is the role of background knowledge in

retrieval of the text. In spite of these studies the role of background knowledge in retrieving

expected information is not yet known to the best of knowledge of present researcher. So, it

can become a significant research topic to be investigated through this study. So many

students specially at university levels have comprehension problems. More studies regarding

the comprehension problems are needed to provide both the teacher and learners with a good

understanding of the nature of the problem and factors involved with it. So to serve this

purpose and also due to few studies in relation to the effect of schema theory on recall of the

text in Iran, this study has been carried out.

The positive finding related to the effect of background knowledge on reading comprehension

and retrieval of the texts led the researcher to consider one main positive directive hypothesis.

H: There is a positive relationship between background knowledge and recall of the text in

intermediate Iranian learners.

Significance of the Study

It is needless to say that the result of the research can have logical effects in educational

settings such as, universities, ESP courses and institutes. The result of this study would be of

help to teachers to provide their students with the necessary background knowledge and

information before teaching text materials. It will also be of help to ESP courses whose aim is

providing the students with subject materials within their specialization domain. Those

involved in material preparation for these courses will also take advantage out of this result.

Furthermore, teachers may find it useful to assess student‘s comprehension with such tools

such as free recall method. Each student‘s recall protocol might indicate common linguistic

and conceptual difficulties experienced through the reading.

138

FLLT 2011 Proceedings

METHOD

Participants

The subjects for this study were 90 EFL students at the Iran Language Institute (ILI). These

students have been studying English as a foreign language for at least three years. On the

basis of a sample TOFEL proficiency test 20 subjects with the score between 225 to 425 were

considered at the intermediate level. Both sexes – about 50 girls and 40 boys- took part in this

study. To have a check over probable intertwining variables, only subjects whose native

language was Persian and their age level was between 18 to 30 were selected.

Instrumentations:

In this study, the following tests have been used.

(1) TOFEL TEST:

The experimental TOFEL published by Browns was used to determine the proficiency level.

The statistical features of the test relating to reliability and validity have been reported by the

publisher and it is claimed to be highly valid and reliable. This test was administered to

decide the level of subjects for this study and on the base of this test the subjects were

considered intermediate learners. The score on this test has been calculated based on the

method available in the BROWN TOFEL book available in the market. It includes three

sections; listening comprehension (50 questions), vocabulary and structure (40 questions), and

reading comprehension and vocabulary (60 questions). The total time is 120 minutes. All

three sections of the test were administered simultaneously.

(2) FOUR READING COMPREHENSION TEXTS:

These texts were chosen from some reading comprehension books available in the market.

The length and the readability of these texts are almost the same (see table 1. below). Many

factors have been established to measure the readability but in fact their aim, construction and

validity are not very different (Alderson & Urquhart, 1987). One typical readability is the Fog

Index which is used in this study.

4.01

100

.

3.

.

.

wordsno

wordssylableno

sentencesNo

wordNo

And the result is interpreted as 12- = easy, 13-16 = undergraduate, 16+ = postgraduate.

This formula is based on the number of words in a sentence.

These texts were to be read and recalled by the students. Two of these texts –Robin Hood

(RH) and Family Size and Economic Development (FSED)- were hypothesized to be familiar

and the other two –Professional Sport (PS) and Earth Day (ED)- were hypothesized to be

unfamiliar.

139

FLLT 2011 Proceedings

Table 1. The readability and length of the texts

Texts Text length Readability

ROBBIN HOOD 330 Words 22.7

FAMILY SIZE AND

ECONOMIC

DEVELOPMENT

319 21.5

PROFESSIONAL

SPORTS

321 20.3

EARTH DAY 322 20

(3) A Questionnaire:

To determine the amount of familiarity of subjects with the texts, the researcher gave a

questionnaire with 10 questions on the reading passages –three questions on Robin Hood,

three questions on Professional Sports, two questions on Earth Day, and two questions on

Family Size And Economic Development- was used. The results were used to once again

divide them into homogeneous groups in relation to familiarity and unfamiliarity with the

texts.

Procedure:

In the first phase of the study, a TOFEL exam was given to about ninety students at the ILI.

Before the exam, the students were provided with enough information about the test. Based

on the results 20 students with the score 225 to 425 were considered intermediate learners.

In the second phase of this study which was held on a separate day, first a questionnaire was

given to each subject and they were told to answer the questions on the paper. They were also

told that they can easily leave blank any questions they did not know. The purpose of this was

to determine how familiar the subjects had been with the text. After completing this

questionnaire, they were supplied with the first reading text. An empty sheet was also given to

them to write their recalls on it. They were already informed of what they were supposed to

do. The subjects were asked to consider the following points when writing the recalls.

(1) The students should not read the text longer than ten minutes and they should not go back

to the text while they are writing the recalls.

(2) The subjects should write their recalls on a separate sheet.

(3) They should write their recalls in full sentences.

(4) They should write their recalls in English.

(5) They should write whatever they remember about the text.

(6) They have enough time to write their recalls.

(7) Grammatical and spelling mistakes are not important.

The same procedure was followed for the rest of the texts. Then, the questionnaires and the

recall protocols were collected. The questionnaires were rated. The score above 50 was

considered familiar and below that unfamiliar. The two texts –Robin Hood and Family Size

and Economic Development were proved to be familiar as it was hypothesized and the other

two texts –Earth Day and Professional Sports- were also proved to be unfamiliar.

As put forward by Alderson (1984), the idea unit is the unit of text analysis and widely used

in reading comprehension oriented research. Thus, as a test of comprehension students can be

asked to write a recall protocol of a text they have read, which in turn is scored in terms of the

140

FLLT 2011 Proceedings

number of idea unit it contains. So in order to correct the recall protocols, each text was

parsed into idea units. For the ease of scoring, an effort was made to establish a unit in which

there was only one bit of information expected to be significant for the analysis as

recommended by Alderson (1984). It was also set that every parallel or paraphrased sentences

are to be accepted. So all recall protocols were analyzed and graded based on these idea units.

In RH text which was 330 words in length, there were 36 idea units; in FSED text which was

319 words in length, there were 28 idea units; in PS text which was 321 words in length, there

were 30 idea units; in ED text which was 322 words in length, there were 28 idea units (see

Table 2). These idea units were verified by two independent judges.

Table 2. The number of Idea Units in Each Text

Texts Length Number of Idea Units

RH 330 36

FSED 319 28

PS 321 30

ED 322 28

Examples of idea units are given as follows.

Table 3. Examples of idea units

Robin Hood text (2 idea units)

Robin Hood is a legendary hero/ who lived in Sherwood Forest, in Nottingham, with his band

of followers. / (As illustrated above the sentence contains 2 idea units as separated off by

two virgules.)

Family Size and Economic Development (1 idea unit)

Poor people often have larger families than middle class and upper class people./

Based on this criterion, any sentence presented in this way was given a point. For example

one of the students recalled the first idea unit in Robin Hood this way; ―Robin Hood was a

hero and he lived in Nottingham with his friends.‖ Or for the second text one wrote; ―there are

more children in poor families than high- class families‖. Both of these students got a point

for their recall. Two scorers scored the recall protocols and using Pearson Product-Moment

Correlation, the inter-rater reliability was found to be .85.

Data Analysis

The data gathered were analyzed using the SPSS statistical software. At first, descriptive data

for recall protocols were computed. As stated already, the main aim of this study was to

confirm that the background knowledge of the subjects had a role on their reading

comprehension and recall protocols. The design of the study made the application one

matched t-test necessary. The aim was to compare the means of two familiar and unfamiliar

texts. The value of the t-observed for the comparisons of means and that of t-critical were

calculated and tested for the significance of the comparisons. The alpha for achieving

significance was set at 0.05.

141

FLLT 2011 Proceedings

Result and Discussions

To investigate the probable effect of background knowledge on reading comprehension and

recall of the Iranian EFL students, four reading texts were selected- two familiar and two

unfamiliar.

Table 4. indicates the mean score for two familiar and unfamiliar texts which turned out to be

1.979 and is greater than the t-critical. Table 5. illustrates the result of the t-test for the two

familiar texts which is 5.670 and is greater than the t-critical and table 6. depicts the result of

the t-test for the two unfamiliar texts which is 4.019 and is greater than the t-critical too.

Table 4. The result of t-tests for Familiar and Unfamiliar texts in intermediate group

Group N X SD t d.f.

Intermediate 20 12.4 4.796 1.979 19

0.05

Table 5. The result of t-test for two familiar texts

Table 6. The result of t-test for two unfamiliar texts

Texts N X SD T d.f.

PS 20 11/5 2.606 4.019 19

ED 20 8/6 1.903

0.001

Conclusions:

As it can be seen in the fourth table, the observed t is 1.979 with the d.f. of 19 is significant at

0.05 level; therefore this hypothesis is confirmed. The intermediate students did remember the

familiar texts better than the unfamiliar ones. And this finding is in line with the previous

findings regarding the role of background knowledge in reading comprehension and their

recall of the texts.

But, more interesting results are related to tables 5 and 6. As it is shown in these two tables

the t observed is greater than the t critical which indicates that some factors other than back

ground knowledge and proficiency have had effects of reading and recall process since these

two factors have already been controlled in the study.

The researcher believes that these results can be due to reading strategies and reading skills

that students have used while performing. Another reason can be the intelligence level of the

students involved in the test. Or simply it is because one of the texts has been more familiar

and one has been more unfamiliar.

Texts N X SD T d.f.

RH 20 16/7 6/666 5/670 19

FSED 20 8/1 1/252

0.001

142

FLLT 2011 Proceedings

Pedagogical Implications

The findings of this study may have some implication for teachers, syllabus designers and

evaluators.

Teachers may find it useful to assess student comprehension with free recall method. Since it

is argued that recall protocol is an attentive for testing reading and listening comprehension.

Each student‘s verbal report might tell the teacher how the individual approaches the reading

comprehension task and what aspects of the particular text seem to cause comprehension

difficulties. Similarly, each student‘s recall protocol might indicate common linguistic and

conceptual difficulties experienced through the reading or those which are specific to the

individual. Thus, teachers can gain insights in the nature of their student‘s comprehension and

therefore can meet their student‘s needs effectively.

Material designers can also take advantage of these findings too. The learner‘s background

knowledge (linguistic and non-linguistic) should be taken into consideration in material

selection. As indicated in this study, both linguistic and extra-linguistic knowledge can

influence the speed and success in EFL reading comprehension. Thus, syllabus designers and

material developers may make careful provision in moving in line with meeting the readers‘

extra-linguistic knowledge when designing some materials for them.

The results can also be useful in material designs especially for ESP courses whose aims are

to make students familiar with the texts in their specialization. The closer the material is to the

student‘s fields of specialty. The more familiar the students are with the texts and

consequently have a better understanding. Therefore, syllabus and material designers should

make the texts in compatible with the student‘s specialization as much as possible.

On the level of classroom practice, the results clearly provide support to the use of previewing

activities, indicating that if such activities are appropriately structured and sufficiently be

learner sensitive they can play a significant role in aiding learners to comprehend the

materials better.

References

Anderson, R. C. et al (1983). Effects of the Reader‘s Schema at Different Points in Time.

Journal of Educational Psychology, 75, 271-9.

Alderson & A. H. Urquhart (Eds). Reading in a Foreign Language. New York, Longman.

Bernhardt, E. B. (1991). Reading Developing in a Second Language. Norwood, NJ: Ablex

Carrell, P. L. (1987). Content and formal schemata in ESL reading. TESOL Quarterly,

21,461-481.

Carrell P. L. & Wallace, B. (1983). Background Knowledge: Context and Familiarity in

Reading Comprehension. TESOL QUARTERLY, 82, 295-308.

Hammadou, J. (1991). Interrelationships Among Prior Knowledge, Inference, and Language

Proficiency in Foreign Language Reading. THE MODERN LANGUAGE JOURANL,

75, 27-38.

143

FLLT 2011 Proceedings

Jacobson, J. L. ands. W. Jacobson (1996). Intellectual Impairment in Children Imposed to

Polychlorinated Biphenylsin Utero. NEW ENGLAND JOURNAL OF MEDICINE,

335(11), 783-789.

Orasana, J. (ED), (1986). Reading comprehension from research to practice. Hillidale:

Lawrence Erlbaum Associates Publishers.

Swaffar, J. K., Arens, K., & Byrnes, H. (1991). Reading For Meaning: An Integrated

Approach to Language Learning. Englewood Cliffs, New Jersey: Prentice-Hall.

About the Author

Mahboobeh Khosrojerdi is from Iran. She has gotten her MA degree from Ferdowsi

University of Mashad. She has been teaching English for about 15 years at different institutes

and universities and right now she is a faculty member of Islamic Azad University, Sabzevar

Branch. She has taught different courses in English specially reading courses. Her main

research interests are reading comprehension, ESP courses, and psychological issues in

reading comprehension. She has recently attended a conference in Malaysia. She has written

two books.

144

FLLT 2011 Proceedings

Oral Performance: Effect of Comprehensible Input and Output

Seyed Omid Tabatabaei

Islamic Azad University, Najafabad Branch, Iran

[email protected]

Parvin Musavian Hejazi

Islamic Azad University, Najafabad Branch, Iran

Abstract

This study aimed at investigating the impact of comprehensible input and comprehensible

output on the accuracy and complexity of Iranian EFL learners‘ oral production. The

participants were randomly divided into input, output, and control groups. The study involved

a pre-task, and a main-task phase. During the pre-task phase, the input group received

comprehensible input and the output group was pushed to be engaged in comprehensible

output production. In the main-task phase, all subjects performed monologues that were

separately recorded, and later transcribed and coded in terms of accuracy and complexity, and

finally scored. The results revealed that while both comprehensible input and output improved

speech accuracy and complexity, neither was more significant than the other one in this

regard.

1. Introduction

The assessment of L2 speaking is a relatively new field, even within the young discipline of

applied linguistics (Fulcher, 2003). Speaking is a complex construct that is mainly

operationalized through the three measures of ‗complexity‘, ‗accuracy‘, and ‗fluency‘. In

other words, the development of speaking ability is measured in terms of progresses made in

each of these aspects (Skehan, 1998). According to Finardi (2008) speaking an L2 is an

important and universal activity that one aspect of it is usually achieved at the expense of

others as learners conceptualize, formulate and articulate messages. Skehan (1998) points out

that there is a tension between ‗complexity‘, ‗accuracy‘, and ‗fluency‘; what he calls a ‗trade-

off‘ effect. Finardi (2008) investigated whether the repetition of a picture description task will

result in gains in complexity and whether these gains are paid especially by gains in accuracy.

The results of the study corroborate evidence of tradeoff effects in oral production, especially

in terms of complexity at the expense of accuracy.

Bygate (1999) defines accuracy as the extent to which a speaker‘s selection of the formal

features of the language (vocabulary, idiomatic phrases, grammatical morphemes,

pronunciation patterns) correspond to patterns that a representative section of the target

population of speakers would find normal, and avoiding what they would find abnormal, for

the meanings being conveyed. Complexity, however, reflects the quality of structures used in

the communication, in terms of the number of words clustered within structures, and the

extent to which structures are clustered together.

There exist different theories in the literature regarding what (factor/method) can help L2

learners to become more proficient speakers. Comprehensible Input Hypothesis and

Comprehensible Output Hypothesis are two theories each having their own claims regarding

the most influential variable ( comprehensible input or output) for improving oral speech and

its various dimensions and the role of speech in developing the second language.

145

FLLT 2011 Proceedings

The Input hypothesis is Krashen's attempt to explain how the learner acquires an L2.

According to this hypothesis, the learner improves and progresses along the 'natural order'

when s/he receives L2 'input' that is one step beyond his/her current stage of linguistic

competence (Schutz, 2007). In the programs supporting comprehensible input theory,

students‘ grammatical errors are ignored in favor of enhancing the students‘ fluency.

Feedback is considered necessary only when intelligibility is affected. Krashen‘s fear of

attention to accuracy comes from the idea that it may get in the way of fluency and could

make the learner self-conscious and as a result, impede second or foreign language

acquisition. Accuracy is thought in natural approach to evolve as the learner progresses,

without conscious attention to form or error correction (Harati, 2000).

Krashen (1982) claims that the function of the L2 learners‘ output (production) in SLA is only

to provide a further source of comprehensible input indirectly by inviting more input from

speech partners. Krashen (1981) suggested that real language acquisition develops slowly,

and speaking skills emerge significantly later than listening skills, even when conditions are

perfect. The best methods are, therefore, those that supply ‗comprehensible input‘ in low

anxiety situations, containing messages that students really want to hear. These methods do

not force early production in L2, but allow students to produce when they are ‗ready‘,

recognizing that improvement comes from supplying communicative and comprehensible

input, and not from forcing and correcting production. (PP.6-7)

However, research shows that predominantly meaning-focused instruction does not produce

native-like grammatical competency. Evaluation of the immersion programs have shown that

while students, who have been provided with comprehensible input, acquire considerable

fluency and possess discourse skills they do not show an equivalent control over a range of

grammatical items (Mangubhai, 2001). In fact, Contrary to Krashen‘s insistence that

acquisition is dependent entirely on comprehensible input, most researchers now

acknowledge that learner output also plays a part in SLA (Ellis, 2008). In response to the

shortcomings and criticisms leveled against comprehensible input hypothesis, Swain (1985)

put forward the Comprehensible Output Hypothesis that claims that production can aid a

more complete acquisition when the learner is pushed to produce appropriate language that is

grammatically accurate.

According to Swain (1995) comprehensible input may not be sufficient for certain aspects of

L2 acquisition and that comprehensible output may be needed. Based on this hypothesis,

learners must also be given the opportunity to produce comprehensible output. Thus, the role

of output is to provide opportunities for contextualized and meaningful use of language, to

test out hypotheses about the target language, and to move the learner from a purely semantic

analysis of the language to its syntactic analysis.

Swain (1985) believes that comprehensible output under certain conditions plays specific

functions that can draw the learners‘ attention to the form of language and help them to move

from semantic to syntactic processing. These functions involve:

Noticing: Swain & Lapkin (1995),considering the ―noticing/triggering function‖ of output

indicated that under some circumstances, the activity of producing the target language may

prompt L2 learners to recognize consciously some of their linguistic problems: it may bring

their attention to something they need to discover about their second language (possibly

directing their attention to relevant input). Hypothesis testing: Producing output is one way of

testing one's hypothesis about the target language. Learners can judge the comprehensibility

146

FLLT 2011 Proceedings

and linguistic well-formedness of their interlanguage utterances against feedback obtained

from their interlocutors. (Soleimani, Ketabi, & Talebinejad, 2008). Metalinguistic Awareness:

As Swain (2008) has stated, the claim here is that using language to reflect on language

producing by other and the self, mediates L2 learning.

However, comprehensible output has its own criticisms. As Shehade (2002) has stated, after

over a decade of research on Swain's (1985) comprehensible output (CO) hypothesis, there is

still a severe lack of data showing that learner output or output modifications have any effect

on (L2) learning.

2. Statement of the Problem

The major problem and the main concern of this study is that despite the great amount of

input Iranian EFL learners receive during six years of formal schooling in high school and

four years of academic education in university, still a great number of Iranian University EFL

learners are not able to speak English accurately and fluently. In fact, the problem arises from

the point that in Iran, as a foreign language context, both Iranian language teachers and

learners usually tend to be more interested and proficient in receptive skills (reading and

listening) than productive skills like writing and speaking. This tendency naturally seems to

result in a disconnection between comprehensible input (CI) and comprehensible output (CO)

and a comparatively low efficiency in language production.

3. Objectives of the Study

According to the stated problem, the present study mainly aims to investigate the impact of

comprehensible input and output on the accuracy and complexity of Iranian EFL learners‘

oral speech. The specific objectives of this study have been set to determine:

1- if CI and CO have any effect on the accuracy and complexity of Iranian EFL learners‘

oral speech;

2- Whether CI or CO is more rigorous and influential for developing the levels of

accuracy and complexity in L2 oral speech of Iranian EFL learners, and

3- If there exist trade-off effects between the accuracy and complexity measures of Iranian

EFL learners‘ oral speech.

4. Research Questions

The following research questions have been addressed in this study:

1- Do CI and CO affect the accuracy of EFL learners‘ speech?

2- Do CI and CO affect the complexity of EFL learners‘ speech?

3- Is CI or CO more rigorous and influential for developing the speech accuracy of

Iranian EFL learners?

4- Is CI or CO more rigorous and influential for developing the speech complexity of

Iranian EFL learners?

5- Does any trade-off effect exist between accuracy and complexity dimensions of EFL

learners‘ oral speech?

147

FLLT 2011 Proceedings

5. Research Hypotheses

Based on the questions cited above, this study aims at testing the following null hypotheses:

H01: Neither CI, nor CO affect the accuracy of EFL learners‘ oral speech.

H02: Neither CI, nor CO affect the complexity of EFL learners‘ oral speech.

H03: Neither CI, nor CO play a more significant role than the other one in the production

of more accurate oral speech.

H04: Neither CI, nor CO play a more significant role than the other one in the production

of more complex oral speech.

H05: There exists no trade-off effect between accuracy and complexity dimensions of oral

speech.

6. Methodology

6.1. Participants

This study was conducted with 60 female EFL students all majoring in English language

teaching at the MA level in Najafabad Azad University, Iran. They were between 24 and26

years old and all Persian native speakers. They were selected from a whole population pool of

80 based on the listening and speaking modules of the standard test of IELTS. Later, these

homogenized participants were randomly assigned to three experimental groups labeled as

input, output, and control groups. The participants went through a pre- task phase before

being engaged in the main task phase.

6.2. Instruments

6.2.1. IELTS Test

IELTS (a standard test for speakers of other languages) was used as a reliable and valid test

for the selection (homogenization) of 60 intermediate participants regarding their speaking

ability. Since the main concern and focus of the research was oral speech assessment, the

listening and speaking modules of the test were used to assess the speakers, and reading and

writing modules were deleted.

6.2.2. Reading Comprehension Text

In the pre-task phase, those 20 participants who had been selected as the input group were

given a reading text selected from the book‖ Intermediate Select Reading” that has specially

been written for students at the intermediate level of proficiency. To help students

successfully tackle and understand the passage, the writer had provided the following support

tools: Vocabulary glosses for challenging words and expressions, explanations for language

and cultural references that appeared in blue type in the reading, and numbered lines for easy

reference. The main objective of this text was to provide the participants with comprehensible

input about the topic (culture shock) in the pre-task phase and later investigate its effect on the

subsequent oral speech of the participants in the main-task phase.

148

FLLT 2011 Proceedings

6.2.3. Standard Coding Scheme

To score the recorded monologues of participants in the main –task phase, a standard coding

system was utilized. The coding process was done in terms of grammatical accuracy, and

syntactic complexity of structures based on Bygate‘s (2001) standard coding system in which

complexity is measured in terms of number of words per t-unit, where t-unit is defined as‖a

finite clause together with any subordinate clauses dependent on it‖ (Bygate, 2001, p. 35) and

accuracy was measured by calculating the incidence of errors per t-unit,the higher the number,

the less accurate the language (Bygate, 2001).

6.3. Procedures

To select 60 homogeneous intermediate EFL speakers for the study, 80 Persian, female EFL

learners all majoring in English language teaching at MA level participated in the listening

and speaking modules of the IELTS test and those whose scores were approximately 5 were

selected. As the next step these 60 participants were randomly divided into three groups of

20: The input experimental group, the output experimental group, and the placebo control

group. This study consisted of two phases: The pre-task phase and the main-task phase. The

members of these groups were expected to participate in activities within the pre and main-

task phase.

6.3.1. Pre-Task Phase

6.3.1.1. The Input Group in Pre-Task Phase

The participants of this group in pre-task phase were asked to read the comprehension text

carefully with the purpose of comprehending and getting information. The main objective of

this part was to provide the participants with CI and later investigate its‘ effect on the

subsequent oral speech of the participants. The topic of the reading text (culture shock) was

exactly the same as the topic of discussion selected for the output group in the same pre-task

phase in order to make sure that under identical conditions (the same age, gender, level of

speaking skill, L1, the time allowed, and topic) any difference in the future oral performance

of participants would be due to the mode and way through which the topic has been handled

(i.e., through CI or CO).

6.3.1.2. The Output Group in Pre-Task Phase

The participants produced comprehensible output through discussing and negotiating the topic

of culture shock, trying to produce the language that was both comprehensible to their

partners and at the same time well formed. In the case of output group, the participants were

divided into three groups of 5. Five minutes before starting the discussion, the participants

were given the topic and its‘ related sub-topics accompanied by the following instructions in

written form in order to emphasize how they were expected to participate in the discussion so

that the aim of this phase that was providing comprehensible output would be achieved:

1 – Look at the presented topic and sub-topics and think about them for five minutes.

2 – The participation of every individual in the discussion is important and necessary.

3 – Try to understand what others say, using any technique or strategy you have in your

disposal.

149

FLLT 2011 Proceedings

4 - Try to speak in such a way that others understand you and if any misunderstanding occurs

try to compensate it for example by rephrasing, paraphrasing, simplifying your speech,

etc,

5- Mutual understanding and peer correction is also quite welcomed.

6.3.1.3. The Control Group

In this phase the members of the control group did not engage in any particular activity and

merely attended their regular classes.

6.3.2. The Main-Task Phase

In the main-task phase, the participants from all three groups were asked to perform a

monologue within the time limit of 10 minutes about the topic that was thematically related to

the topic of the pre-task phase. The main purpose of this part was to determine whether the

group that has received comprehensible input about the topic (the input group) could produce

more accurate and complex oral speech in this phase or the group that had practically put into

practice his inter-language knowledge through discussing and negotiating the topic ( the

output group).

The oral performance of participants of each group was recorded on three separate CDs.

Later, the researcher and two other raters listened to the recordings and transcribed them

carefully. Keeping in mind the main objective of this study that was investigating the effect of

CI and CO on the grammatical accuracy and syntactic complexity of oral speech, these

transcriptions had to be coded in terms of accuracy and complexity. This was done using

Bygate‘s (2001) standard coding system, where accuracy was accounted by the number of

errors per t-unit and complexity by the number of words per t-unit. To ensure inter-coder

reliability, the coding process was done by the researcher herself and two other competent

raters. Correlation of the obtained scores was found to be 0.89. Rating the coded

transcriptions was the last step. Those who had made less grammatical errors in each t-unit,

received higher scores in accuracy and those who had made longer sentences and structures

(i.e., used more words per t-unit) received higher scores in complexity. Then, these scores

were submitted to statistical analysis.

7. Data analysis

In the present study, one-way ANOVA and Post Hoc tests were performed to examine if there

exist any significant differences among three input, output, and control groups regarding the

accuracy and complexity of speech and if it is the case, is the observed critical difference

more meaningful in the case of input or output group. In addition, correlation coefficient was

run between the accuracy and complexity scores within each group in order to investigate the

relation between these two measures of oral speech and to find the existence or non-existence

of trade-off effects.

7.1 Accuracy of Speech and the Influential Role of CI and CO

Research question one focuses on whether comprehensible input and output had any effect on

the accuracy of EFL learners‘ oral speech. The purpose of this question is to find out whether

these two variables result in more accurate speech or not. To address this question, the

number of grammatical errors per t-unit was considered, and the generated errors of

150

FLLT 2011 Proceedings

participants in three groups were compared using ANOVA. Table 1 presents the descriptive

statistics for the incidence and number of errors per t-unit by the participants of each group.

Table1. Descriptive Statistics: Speech Accuracy among Groups

As the descriptive data in table 1 show, the accuracy mean scores of participants both in the

input and output group (15.07 and 9.80) are lower than those of the control group (17.33). As

it has been mentioned earlier, in the case of accuracy measurement that is actually an

inaccuracy measurement in this study, the smaller the figure, the better the results. So, the

lower mean scores of the input and output group in comparison with the control group

indicates that the participants in these two groups have made fewer errors in their speech. To

put it differently, under the influence of comprehensible input and output, improvements have

been made in the accuracy of their speech.

According to the obtained means, the accuracy mean scores in the input and output groups are

different from and lower than the control group, indicating that CI and CO have influenced

the incidence of errors and consequently the accuracy of learners speech: the participants have

had the fewest number of errors in the output group, followed by the input group, and then the

control group. The results of ANOVA, shown in Table 2 largely reflect this trend:

Table 2.ANOVA: The Accuracy of Speech

The findings revealed a significant difference among participants‘ accuracy measures in three

groups. (F=6.578, df=2, P=.05), meaning that there were significantly different numbers of

errors in each group and that both CI and CO have affected the accuracy of EFL learners‘

speech. In other words, this significant difference implies that CI and CO have been two

influential factors affecting the number of errors as indicators of accuracy in this research.

Based on the results presented in Tables 1 and 2, the first research hypothesis denying the

effect of CI and CO on speech accuracy is rejected.

Descriptives

accuracy of speech

15 15.07 6.158 1.590 11.66 18.48 5 25

15 9.80 4.411 1.139 7.36 12.24 4 18

15 17.33 6.694 1.728 13.63 21.04 5 28

45 14.07 6.535 .974 12.10 16.03 4 28

input

output

control

Total

N Mean Std. Deviation Std. Error Lower Bound Upper Bound

95% Confidence Interval for

Mean

Minimum Maximum

ANOVA

accuracy of speech

448.133 2 224.067 6.578 .003

1430.667 42 34.063

1878.800 44

Between Groups

Within Groups

Total

Sum of Squares df Mean Square F Sig.

151

FLLT 2011 Proceedings

7.2 The Complexity of Speech and the Influential Role of CI and CO

Similarly, the second research question investigated the effect of CI and CO on the

complexity of EFL learners‘ oral speech. To address this question, the participants speech

complexity measured through the number of content words per t-unit were compared among

three groups using ANOVA and post hoc tests. Table 3 presents the descriptive statistics for

the number of words per t-unit indicating speech complexity of the participants in each group:

Table 3.Descriptive Statistics: Speech Complexity among Groups

Looking at the descriptive data in Table 3, it can be noticed that complexity mean scores of

participants in the input and output groups (496.60 and 462.53) are different from and higher

than those of the control group (389.67), indicating that CI and CO have affected speech

complexity. In fact, the existence of difference among the complexity mean scores of the

participants in three groups implies that input reception and output production tasks have led

to changes in the number of words used per t-unit and consequently the complexity of speech.

As the results show, the participants in the input group have produced more number of words

than either the participants in the output or control group. The results of ANOVA presented in

Table 4 confirm these findings. This test was run to determine if the difference among the

three involved groups regarding the complexity of speech was significant or not.

Table 4.ANOVA: Complexity of Speech

As the results of Table 4 show, there existed a significant difference among the participants‘

complexity measures in three groups. (F= 9.854, df=2, p=.05). It means that CI and CO in

comparison with the control group, have affected the participants‘ complexity measure that

the degree and significance of each of these variables on developing speech complexity will

be later compared and determined through post hoc test.

Descriptives

complexity of speech

15 496.60 67.144 17.336 459.42 533.78 392 621

15 462.53 65.157 16.823 426.45 498.62 388 578

15 389.67 69.813 18.026 351.01 428.33 311 524

45 449.60 79.816 11.898 425.62 473.58 311 621

input

output

control

Total

N Mean Std. Deviation Std. Error Lower Bound Upper Bound

95% Confidence Interval for

Mean

Minimum Maximum

ANOVA

complexity of speech

89524.133 2 44762.067 9.854 .000

190784.667 42 4542.492

280308.800 44

Between Groups

Within Groups

Total

Sum of Squares df Mean Square F Sig.

152

FLLT 2011 Proceedings

7.3. Neither CI nor CO is More Significant in Developing Speech Accuracy

In order to investigate research question three focusing on the comparison between the effects

of CI and CO on speech accuracy, the ANOVA analysis of accuracy presented in Table 2 was

followed by post hoc Scheffe test. This post hoc test was run to determine whether CI or CO

plays a more significant role in developing speech accuracy. The results of the post hoc test

have been presented in Table 5:

Table 5.Post Hoc Test: Analysis of Accuracy

As shown in Table 5, the results revealed that the difference existing between the numbers of

errors (as indicator of accuracy) in the CI and CO groups was not significant. This means that

the influence of these two variables on developing speech accuracy was not significantly

different and neither was more rigorous than the other one in decreasing the number of errors

and consequently improving the accuracy of speech. Thus, the third research hypothesis

which stated that there is no difference between the effects of CI and CO on the accuracy of

Iranian EFL learners‘ oral speech is confirmed.

7.4. Neither CI nor CO is More Significant in Developing Speech Complexity

Research question four asks whether there exist differences between the effects of CI and CO

on the speech complexity of EFL learners. To address this question, the ANOVA test that was

run for complexity measure in Table 4 was followed by the post hoc Scheffe test to determine

if CI or CO plays a more influential role in improving speech complexity. Table.6 shows the

results of this post hoc test:

Mult iple Comparisons

Dependent Variable: accuracy of speech

Scheffe

5.267 2.131 .058 -.14 10.67

-2.267 2.131 .572 -7.67 3.14

-5.267 2.131 .058 -10.67 .14

-7.533* 2.131 .004 -12.94 -2.13

2.267 2.131 .572 -3.14 7.67

7.533* 2.131 .004 2.13 12.94

(J) group

output

control

input

control

input

output

(I) group

input

output

control

Mean

Difference (I-J) Std. Error Sig. Lower Bound Upper Bound

95% Confidence Interval

The mean difference is signif icant at the .05 level.*.

153

FLLT 2011 Proceedings

Table.6. Post Hoc Test: Analysis of Complexity

As Table 6 shows, the post hoc Scheffe test was performed on the significant finding of Table

4. This current analysis directly compares speech complexity between groups two by two in

an effort to explore whether CI or CO is more influential in developing complexity. The

results revealed that the difference existing between number of words (as indicator of

complexity) in the CI and CO groups was not significant, that is neither of these variables

proved to be more rigorous and influential than the other one in developing the complexity of

Iranian EFL learners‘ oral speech. Therefore, the fourth research hypothesis that stated no

difference exists between the effects of CI and CO on the complexity of oral speech is

confirmed.

7.5 The Existence of Trade-off Effects between Accuracy and Complexity

Complexity and accuracy, as two measures of oral speech, were compared between and

among input, output, and control groups using ANOVA and post hoc Scheffe test. In order to

investigate the relation between these two measures within each group, the Pearson

correlation was run between the error scores (as indicator of accuracy) and complexity scores.

The following table shows the results of Pearson correlation run between accuracy and

complexity scores within the input group:

As the Table 7 shows, there exists a significant correlation between the set of error scores

(number of errors per t-unit) and complexity scores (number of words per t-unit) within the

input group.

Mult iple Comparisons

Dependent Variable: complexity of speech

Scheffe

34.067 24.610 .392 -28.39 96.52

106.933* 24.610 .000 44.48 169.39

-34.067 24.610 .392 -96.52 28.39

72.867* 24.610 .019 10.41 135.32

-106.933* 24.610 .000 -169.39 -44.48

-72.867* 24.610 .019 -135.32 -10.41

(J) group

output

control

input

control

input

output

(I) group

input

output

control

Mean

Difference (I-J) Std. Error Sig. Lower Bound Upper Bound

95% Confidence Interval

The mean difference is signif icant at the .05 level.*.

154

FLLT 2011 Proceedings

Table7. Correlation between Accuracy and Complexity Scores within the Input Group

In order to determine if this correlation is positive or negative, Figure 1 was drawn:

Figure 1.Correlation between Accuracy and Complexity Scores within the Input Group

As shown in Figure 1, from the upward movement of the graph it is implied that the

correlation is positive and consequently increase in the number of errors is accompanied by

increase in number of words and vice versa. However, as it has been mentioned earlier, in the

case of accuracy measurement that is actually an inaccuracy measurement in this study, the

lower the error score, the higher the accuracy and the higher the error score, the lower the

accuracy. In fact, this positive correlation exists between the two sets of scores that one

represents number of errors and the other one the number of words. But considering the

diverse relation between the actual accuracy and the error score (as indicator of accuracy), we

come to the conclusion that the positive correlation shown in the graph is between complexity

and error scores, while the correlation between actual accuracy and complexity of oral speech

is negative.

To investigate the relation between accuracy and complexity scores within the output group,

again the Pearson correlation is used. Table 8 presents the obtained results:

Correlations

1 .959**

.000

15 15

.959** 1

.000

15 15

Pearson Correlation

Sig. (2-tailed)

N

Pearson Correlation

Sig. (2-tailed)

N

accuracy of speech

complexity of speech

accuracy

of speech

complexity of

speech

Correlation is signif icant at the 0.01 level (2-tailed).**.

155

FLLT 2011 Proceedings

Table 8. Correlation between Accuracy and Complexity Scores within the Output

Group

As it can be observed in Table 8, there exists a significant correlation between number of

errors and number of words made by individuals within the output group. However, whether

this correlation is positive or negative is not apparent from the table itself and for this purpose

the obtained results need to be transferred and drawn on a Figure. Figure 2 shows such a

correlation:

Figure 2.Correlation between Accuracy and Complexity Scores within the Output

Group

The upward direction of graph indicates that the correlation between the error and complexity

scores within the output group is positive and consequently increase in the number of errors is

accompanied by the increase in complexity and vice versa. However, since in this study

accuracy is an inaccuracy measurement and the relation between the actual accuracy and error

score (as indicator of accuracy) is diverse, it can be concluded that the correlation between

complexity and actual accuracy is a negative one. Pearson Correlation is again used to

determine if there exists any significant correlation between accuracy and complexity scores

within the control group:

Correlations

1 .974**

.000

15 15

.974** 1

.000

15 15

Pearson Correlation

Sig. (2-tailed)

N

Pearson Correlation

Sig. (2-tailed)

N

accuracy of speech

complexity of speech

accuracy

of speech

complexity of

speech

Correlation is signif icant at the 0.01 level (2-tailed).**.

156

FLLT 2011 Proceedings

Table 9 shows that like the input and output group, the correlation between these two sets of

scores in the control group is also significant.

Table 9. Correlation between Accuracy and Complexity Scores within the Control

Group

Drawing Figure 3 can help to determine if such significant correlation is positive or negative.

Figure 3.Correlation between Accuracy and Complexity Scores within the Control

Group

Upward direction always signifies a positive correlation and downward direction a negative

one. Based on this Figure, in the control group, the correlation between error and complexity

scores is positive. But, as mentioned before, due to the converse relation between error score

(as indicator of accuracy) and the actual accuracy, it is concluded that there exists a negative

correlation between the actual accuracy and complexity as two measures of oral speech.

8. Discussion

The first null hypothesis of this research aimed at determining if comprehensible input and

output have any effect on the accuracy of EFL learners‘ oral speech. The findings of the

present study showed that both input reception and output production tasks caused changes in

the syntactic accuracy of EFL learners‘ speech. This finding of the study supports previous

claims made concerning the influential role of CI and CO in developing the accuracy measure

of oral performance.

As stated by Krashen (1985), speaking skills and the knowledge of grammar rules occur as

long as sufficient amount and type of input is provided. In fact, in approaches supporting CI,

Correlations

1 .882**

.000

15 15

.882** 1

.000

15 15

Pearson Correlation

Sig. (2-tailed)

N

Pearson Correlation

Sig. (2-tailed)

N

accuracy of speech

complexity of speech

accuracy

of speech

complexity of

speech

Correlation is signif icant at the 0.01 level (2-tailed).**.

complexity of speech

550500450400350300

accu

racy o

f sp

eech

30

25

20

15

10

5

157

FLLT 2011 Proceedings

speech accuracy is thought to evolve as the learner progresses and receives more and more CI,

without conscious attention to form or error correction. On the other hand, great numbers of

experiments have also proved the influential role of CO in developing speech accuracy and

review of the literature provides us with convincing theories as why comprehensible output

can improve the speech accuracy of EFL learners. Three specific functions have been

mentioned for comprehensible output that is believed to be different from and independent of

comprehensible input. ‗Noticing function‘, ‗hypothesis testing function‘ and ‗meta-cognitive

function‘ are regarded as three significant functions of CO that can help learners move from

semantic to syntactic processing and as the result develop their grammatical accuracy. Studies

done about comprehensible output and each of its specific functions positively support and

confirm the role it plays in improving speech accuracy of EFL learners. There exist great

number of studies in the literature that have provided support for the claim that pushing

learners to produce comprehensible output results in gains in speech accuracy (e.g., Swain,

1985, 1995; Nagata, 1998; Tarone & Liu, 1995; Izumi, 2002; Dekeyser & Sokalski, 1996;

Mackey, 1999; Noubishi & Ellis, 1993). Results of these studies support the link between

output production and in particular the development of grammatical accuracy. Therefore,

based on the created change and development in speech accuracy of input and output group

participants, regardless of the degree of significance of such change in each group, the first

null hypothesis stating that CI and CO have no effect on speech accuracy is rejected.

The second null hypothesis of the research similarly focuses on determining whether CI and

CO play any role in developing speech complexity. The review of the literature revealed that

the number of studies which directly investigated the effect of comprehensible input and

output on the complexity of oral speech is very limited and fewer than those investigating the

impact of these factors on speech accuracy. As the results of this study revealed

comprehensible input and output both created changes in speech complexity of participants

that determining whether CI or CO was more rigorous, influential, and significant in creating

such a change and development in speech complexity is the matter that is considered when

evaluating the fourth hypothesis of the study. However, the created change in speech

complexity of input and output group members regardless of the degree of significance of

such change in each group caused the second null hypothesis denying the effect of

comprehensible input and output on developing speech complexity to be rejected as well.

Considering the third null hypothesis of the research which states that comprehensible input

and output have the same impact on the accuracy of EFL learners‘ oral speech, the results

obtained from this study confirmed this null hypothesis. However, review of the existing

literature reveals that previous studies conducted in this regard are not in line with this result

of the study and previous experiments mainly confirm a more influential role for

comprehensible output in developing speech accuracy and formal linguistic features and a less

influential role for comprehensible input in this regard.

Beside others, Nobuyoshi and Ellis (1993), for example, claim to have provided data showing

that comprehensible output results in actual improvement in speech accuracy. They stated that

their study ― provides some support for the claim that pushing learners to improve the

accuracy of their production results in not only immediate improved performance but also in

gains in accuracy over time‖ (p. 208).

On the other hand, one of the most significant experiments that prove the lack of success of

CI in improving the accuracy of speech is the case of learners in the immersion context,

where the learners were exposed to abundant, extensive amount of comprehensible input in

158

FLLT 2011 Proceedings

both written and spoken form, but still produced oral speech that was full of grammatical

errors. Ryan (n.d.) refers to the study conducted with Canadian immersion students, in which

Swain (1995) has shown that even though students had received abundant comprehensible

input in French and were somewhat fluent in the language, they had still not acquired

grammatical competence in the language. Immersions students‘ many syntactical errors in

French confirmed that the target language grammatical system had not been fully acquired.

One underlying reason why in this research neither of these variables succeeded to be more

influential in improving speech accuracy may be the way of conducting tasks and mainly the

way comprehensible output was put into practice. There is the probability that during the

output production task, the CO in its real sense that calls for negative feedback, modification,

restatement, and correction had not been truly practiced and consequently the main function

of output that is moving learners from semantic to syntactic processing had not been applied.

In fact as Krashen (1994) has stated, output in this sense is scarce, so it is possible that in this

study, too, the real output that was expected to be produced had not been practiced.

The fourth null hypothesis of the research that states comprehensible input and output have

the same effect on the complexity of EFL learners oral performance is also confirmed based

on the results obtained from this study. As the obtained results show, complexity level was

not significantly different in the speech of input and output group learners.

As it was mentioned before, the numbers of studies that have investigated the effect of CI and

CO on the development of speech complexity are very limited and consequently there does

not exist enough experiments in this regard to be compared with the results of this study.

However, in seeking for an underlying reason, we can again mention the way through which

CO was put into practice and the probability that CO in its real sense that pushes learners

from a semantic processing to syntactic processing of language has not been achieved.

The fifth null hypothesis of this study investigated the existence of trade- off effects between

accuracy and complexity within all three groups of the study. Analyzing the scores of

individual participants revealed that those participants who performed oral speech with higher

accuracy showed less gains in complexity, and those who had higher scores in speech

complexity, were weaker in performing accurate, grammatical speech. Such results are quite

in line with previous experiments which were concerned with accuracy, complexity, and

fluency as three measures of EFL learners‘ speech production. According to Skehan and

Foster (2001), attentional resources are limited and attending to one aspect of performance

may mean that other dimensions are neglected. They propose that for language development

to proceed optimally, a balance needs to be established between these three performance

dimensions. Mentioning some of these studies at this point can be a good evidence for

proving such claim.

Foster and Skehan (1996) examined the influence of task type and degree of planning on three

different aspects of L2 performance: fluency, accuracy, and complexity. The study employed

three types of tasks (personal information exchange, narrative, and decision-making) under

three planning conditions (unplanned, planned but without detail, and planned with detail). In

their discussion, Foster and Skehan noted that a trade-off existed between the goals of

performance complexity and performance accuracy. They explained that individuals have a

159

FLLT 2011 Proceedings

limited capacity for attention, as noted earlier, so when a task is more cognitively demanding,

attention is diverted from formal linguistic features-the basis of accuracy-to dealing with these

cognitive requirements.

In Brazil, D‘Ely (2006) investigated the impact of four types of pre-task planning on the L2

oral performance of 47 learners of English. Participant‘s speaking was assessed in terms of

fluency, accuracy, complexity, and lexical density. Results of the statistical analyses

conducted showed that different planning conditions affected learners‘ performance in

different ways. D‘Ely‘s results also provided evidence for the trade-off among fluency,

accuracy, complexity, and lexical density due to limitations in attentional resources during

speaking, giving support to Foster and Skehan (1996).

9. Conclusion

Based on the findings of this study, comprehensible input and output are both influential

variables for improving the accuracy and complexity measures of L2 learners‘ speech.

Significant changes occurred in the performance of input and output group participants in

terms of accuracy and complexity after being engaged in input reception and output

production tasks, indicating that comprehensible input and output are two variables that can

improve speech accuracy and complexity.

The results of this study also revealed that there existed no significant difference between the

number of errors (as indicator of accuracy) in the speech of input and output group members,

indicating that neither CI nor CO has been more influential in developing the accuracy

dimension of Iranian EFL learners‘ oral speech. To put it differently, the decrease in the

number of errors was not so much different in the speech of input and output group

participants. Similarly, the lack of noticeable difference between input and output group

members regarding the increase in the number of words (as indicator of complexity) in their

speech was evidence indicating that neither CI nor CO has been more effective in improving

the speech complexity of Iranian EFL learners. This result of the study, however, is not in

harmony with the previous experiments as the majority of studies conducted in this regard

mainly have reported a more effective role for comprehensible output in developing accuracy

dimension of oral speech in comparison with comprehensible input.

Another obtained result of this study that can be matched up with recent theories is the trade-

off effects between accuracy and complexity measures of oral speech. Such trade-off effect

means that one of these variables progresses at the expense of the other one. In the present

study, within all three groups, when attention was devoted to speech complexity, it was

diverted from formal linguistic features (accuracy), and, on the other hand, accuracy

progressed at the expense of speech complexity.

10. Implications of the Study

One possible pedagogical implication that can be derived from the findings of this study is

that in the course of L2 speech development, teachers should design and manipulate tasks in

such a way that enough practice is allowed in various dimensions of oral speech. In other

words, since different tasks provide different opportunities for practicing specific aspects of

L2 speech production, so various tasks need to be manipulated to enable learners practice

160

FLLT 2011 Proceedings

various dimensions of speech production, focusing both on meaning and on form and in focus

on form, according to Finardi (2008, P.9), ―a balance should be made between hypothesis

testing and restructuring (complexity) and the control of stable elements in the interlanguage

system (accuracy)‖. Generally it is implied that the most effective way for improving oral

speech, based on the literature and the results obtained from this study is an eclectic approach

which confloats both CI and CO.

To use Bygate‘s (1999) words: ―Feed people with narrative tasks and they will crunch up

some aspects of speech in one way, sharpening certain linguistic teeth, i.e., cognitively

mapping certain types of language and certain types of communicative demand. Feed them

different tasks, and different linguistic teeth might be developed.‖(p. 39).

11. Limitations of the Study

The most notable limitation is related to the IELTS test used to select homogeneous

intermediate learners. This test was selected from an IELTS course book, i.e., Cambridge

IELTS 5, due to the problem of accessibility to the real IELTS test. So there is the possibility

that the obtained results have not truly reflected the proficiency level of the participants.

Moreover, based on this course book test, the score of participants was on average 5, but more

specifically 4.5 to 6. Thus, the oral performance of learners was likely to have been

influenced by this broad range of scores.

Due to the problem of accessibility, like most SLA studies, this study also involved a small

number of participants. The present research was conducted with 45 participants, 15 members

in each group. To be able to generalize these results more confidently, a larger number of

participants are required.

One aspect that must be taken into consideration when analyzing the results of this study is

the fact that since the participants who cooperated in this research came from an experimental

group, there is the probability that some of them may have perceived the speaking task as

tests and therefore behaved accordingly. As Iwashita, McNamara, and Elder (2002) suggest,

performance on tests differ from performance in class and so it has to be analyzed differently

and with caution. As stated by Finardi (2008), task implementation for research purpose must

be carried out with care and consideration of these issues.

12. Suggestions for Further Research

The current study population involved intermediate-level learners of English as a foreign

language with Persian as their L1. Conducting the study with another different population

regarding their L1, level of proficiency, educational background, learning environment, and

other variables may lead to quite different results about the influence of input and output on

accuracy and complexity of EFL learners‘ oral speech.

In the present study, the output hypothesis was put into practice through interactions between

L2 learners, rather than among L2 learners and native speakers. Thus, the results of the

current study should not be generalized to native speaker-learner interactions without

additional research.

The main focus of the present study is on the accuracy and complexity of oral speech.

However, the effect of CI and CO can also be investigated regarding the fluency of speech.

161

FLLT 2011 Proceedings

The mode of presenting CI to learners (either through listening or reading) may influence

their comprehension and consequently their following performance. So research on the role

and effect of mode of input presentation seems necessary.

References

Bygate, M. (1999). Task as context for the framing, reframing, and unframing of language.

System, 27, 33-48.

Bygate, M. (2001). Effects of task repetition on the structure and control of oral language. In

M. Bygate, P. Skehan, & M. Swain (Eds.), Researching pedagogic tasks: Second

language learning and testing (pp. 37-53). London: Longman.

Dekeyser, R, & Sokalski, K. (1996). The differential role of comprehension and production

practice. Language Learning, 46(4), 613-642.

D‘Ely, R. C. F. (2006). A focus on learners‘ meta-cognitive processes: The impact of strategic

planning, repetition, strategic planning plus repetition, and strategic planning for

repetition on L2 oral performance. Unpublished Doctoral Dissertation, University of

Santa Catarina.

Ellis, R. (2008). Principles of instructed second language acquisition. CALL(Center for

Applied Linguistics). Retrieved September 25, 2009 from

http:// www.cal.org/resources/digest/instructed2ndlang.html.

Faerch, C., & Kasper, G. (1986). The role of comprehension in second language learning.

. Applied Linguistics, 7(3), 257-274.

Finardi, R. K. (2008). Effects of task repetition on L2 oral performance. Scielo, 47(1).

Retrieved November 25, 2009 from

http:// www.scielo.br/scielo.php?script=sci-arttext&pid=5do3-

18132008000100003&hg=es&nrm=iso&tlng=en

Foster, P., & Skehan, P. (1996). The influence of planning and task type on second language

performance. Studies in Second Language Acquisition, 18, 229-323.

Fulcher, G. (2003). Testing second language speaking. TESL, 8(1). Retrieved June, 2004

from http:// tesl-ej.org/ej 29/r5.html.

Harati, N. (2000). The impact of recast versus negotiation of form on the grammatical

accuracy of the Iranian EFL students‘ speech. A Thesis Submitted in Partial Fulfillment

of the Requirements for the Degree of Master of Arts in Teaching English as a Foreign

Language. In the Foreign Languages Department of Iran, University of Science and

Technology.

Iwashita, N. & McNamara, T. & Elder, C. (2002). Can we predict task difficulty in an oral

proficiency test? Exploring the potential of an information processing approach to

task design. Language learning, 51(3), 401-436.

162

FLLT 2011 Proceedings

Izumi, S. (2002). Output, input enhancement, and the noticing hypothesis. Studies in Second

Language Acquisition, 24, 541-577.

Krashen, S. D. (1981). Principles and practice in second language acquisition: English

Language Teaching Series. London: Prentice-Hall International (UK) Ltd.

Krashen, S. D. (1982). Principles and practice in second language acquisition. Oxford:

Pergamon.

Krashen, S.D. (1985). The input hypothesis: Issues and implications. London: Longman.

Krashen, S. (1994). The input hypothesis and its rivals. In N. Ellis (Ed.), Implicit and explicit

learning of languages (pp. 45-77). London: Academic Press.

Mackey, A. (1999). Input, interaction, and second language development: An empirical study

of question formation in ESL. Studies in Second Language Acquisition, 21, 557-587.

Mangubhai, F. (2001). Book floods and comprehensible input floods: providing ideal

conditions for second language acquisition. International Journal of Educational

Research, 35,147-156.

Nagata, N. (1998). Input vs. output practice in educational software for second language

acquisition. Language Learning & Technology, 1(2), 23-40.

Nobuyoshi, J., & Ellis, R. (1993). Focused communication tasks and second language

acquisition. ELT Journal, 47, 203-210.

Ryan, J. (n.d.). A review of the role of the output in second language acquisition with

anecdotal examples from a Japanese learner‘s experience. Language Learning,

38(17), 42-54.

Schutz, R. (2007). Stephen Krashen‘s theory of second language acquisition.Retrieved

November, 2007 from

http://www.sk.com.br/sk-krash.html.

Shehadeh, A. (2002). Comprehensible output, from occurrence to acquisition: an agenda for

acquisitional research. Language Learning, 52(3), 597-647.

Skehan, P . (1998). A cognitive approach to language learning. Oxford: Oxford University

Press.

Skehan, P. & Foster, P. (1997). Task type and task processing conditions. Language Teaching

Research, 3(1), 185-211.

Skehan, P. & Foster, P. (2001). Cognition and Tasks. In Robinson, P. (Ed.), Cognition and

second language instruction (pp. 183-205). Cambridge: Cambridge University

Press.

163

FLLT 2011 Proceedings

Soleimani, H. & Ketabi, S. & Talebinejad, M. (2008). The noticing function of output in

acquisition of rhetorical structure of contrast paragraphs of Iranian EFL university

students. Linguistic Online. Retrieved April, 2008 from

http:// www. linguistic-online.de/34-08/soleimani.html

Swain, M. (1985). Communicative competence: some roles of comprehensible input and

comprehensible output in its development. In Gass,S. & Madden, C. (EDs), Input

in Second Language Acquisition (pp.235-256). Newyork. Newbury House.

Swain, M. (1995). Three functions of output in second language learning. In G. Cook & B.

Seildlhofer (Eds.), Principles and practice in applied linguistics: Studies in honor

of H.G. Widdowson (pp. 125-144). Oxford: Oxford University Press.

Swain, M. (2008). The output hypothesis: its history and its future. A keynote speech in The

5th

Annual International Conference on ELT in Beijing. Retrieved March 1, 2008

from http://www.celea.org.cn/2008/keynote/ppt/merrill%20Swain.pdf.

Swain, M. & S. Lapkin (1995). Problems in output and the cognitive processes they generate:

A step towards second language learning. Applied Linguistics, 16, 371-391.

Tarone, E., & Liu, G.Q. (1995). Situational context, variation, and second language

acquisition theory. In G. Cook & B. Seidelhofer (Eds.), Principle and practice in

applied linguistics: Studies in honor of H. G. Widdowson (pp.107-124). Oxford:

Oxford University Press.

About the Author

Seyed Omid Tabatabaei is an assistant professor of TEFL at Islamic Azad University,

Najafabad Branch, the head of English Department and the educational vice-dean of the

Humanities Faculty. He has published articles at various domestic and international Journals

and presented at different National and international conferences.

Parvin Musavian Hejazi is an MA candidate of TEFL at Islamic Azad university, Najafabad

Branch. She has taught English for a couple of years at Language Institutes.

164

FLLT 2011 Proceedings

Power Relations in Pedagogy: A Constraint on EFL Speakers’ Identity

Confidence and Identity Anxiety

Noparat Tananuraksakul

South-East Asia University

[email protected]

Abstract

This present study into power relations in pedagogy and its influence on EFL speakers‘

identity confidence and identity anxiety have been overlooked in Thailand. The power is

mainly based on Jennifer Gore‘s implications that teachers legitimately have power produced

through teaching and that they must embrace and exercise it consciously in order to enhance

their students‘ learning outcome. This kind of teacher power reflects a set of deeply-

embedded cultural practices which exist in Thai culture. Quantitative findings of 69 students

reveal that to some degree conscious use of attractive and rewarding power by the researcher

(teacher) can positively influence her students‘ identity confidence and identity anxiety in

spoken English and attitudes towards teaching and learning of English. However, it can also

negatively influence their achievement in speaking due to some factors relating to

psychomotor domain. The study offers an insightful direction for EFL teachers.

1. Introduction

Culturally speaking, teachers hold some forms of power. Over forty years ago, French and

Raven (1959) constructed five types of teacher power: attractive, expert, reward, position and

coercive. These sorts of power remain in use today as teachers need them in order to influence

their students‘ behaviours (Shindler, n.d.). This notion mirrors a fundamental set of power

relations in pedagogy consisting of a set of deeply-embedded cultural practices (Gore, 1995).

Instead of dispensing the power, Gore (2002) suggests that teachers need to embrace and

exercise it more consciously. This means they need to know that power relations produced

through pedagogy have three effects in relations (between teachers and students), habitus

(engagement in pedagogy) and discourse (knowledge). Such power is inescapably

constructed in a classroom and may have a positive and/or negative effect on learning

outcomes.

In an EFL context like Thailand, acquiring English skills (discourse) does not appear to be

simple because of not only the context itself but also the position of ―the teacher‖. Teachers

legitimately have power influenced by certain cultural patterns or values (Ziegahn, 2001). An

obvious pattern is exemplified in respect for seniority generally determined by age and job.

In any given context, a wide range of relationships among Thais is normally determined by

who is more senior and who is more junior (Redmond, 1998). In an academic context,

students are culturally deemed to be luk-sid or disciples and behave as passive learners.

These circumstances may limit Thai learners of EFL to develop their speaking skills

competently due to a need of active interactions in a classroom. The limit may further

decrease their identity confidence and concurrently increase their identity anxiety.

Research into power relations in teaching and its effect on students‘ affect in learning in

Thailand have been overlooked. For example, Srinutham (2009) studies power relations

between parents and their children through characters in one of well-known classic children‘s

books called Pla Boo Thong. Prajuckpana (2008) examines how the construction and

165

FLLT 2011 Proceedings

reproduction process of gender and the manifestation of patriarchy that occurs at the

restaurant affect gender division of labour, gender bias, and gender power relations. Peacham

(2007) investigates the power structure of the community and power relations of the

community as well as the local government in managing and utilising the resources.

2. Objectives

This paper aims to investigate the following: 1) undergraduate students‘ levels of identity

confidence and identity anxiety in spoken English; 2) their attitudes towards pedagogical

strategies; and 3) correlations between these three variables (confidence, anxiety and

attitudes) and speaking test results.

3. Procedure of the study

To illuminate the arguments previously mentioned, I firstly used a replicated 1-5 rating scale

questionnaire (Park & Lee, 2005) to examine the levels of confidence and anxiety in spoken

English in 69 students enrolled in my three different speaking classes during the first session.

The overall outcomes revealed that their confidence (x̄ = 3.28) and anxiety (x̄ = 3.02) were

moderate and that they felt shy speaking English to both Thai (x̄ = 3.12) and foreign

professors (x̄ = 3.17).

However, when considering each statement in the questionnaire, one particular statement

showed their lowest level of confidence in that they did not think they could speak English

well (2.51). This specific outcome was parallel with their high level of anxiety shown in

these four statements: ‗I worried about speaking with errors (x̄ = 3.49), taking oral tests (x̄ =

3.45), earning grades (x̄ = 3.71) and learning English (x̄ = 3.48)‘. This aspect is in accordance

with Krashen‘s (1987) Affective Filter Hypothesis.

Then from session two onwards, I particularly embraced both attractive and rewarding power

and exercised them in my class along with the lesson plans prepared according to the course

outline. By means of attractive power, I made an effort to build a rapport with my 69

students, calling them by their nickname instead of first name. For rewarding power, I

commended them every time they tried to make a range of effort (from a little to great) to

speak up. For example, ‗just need to work on it a little more‘, ‗that is good‘, ‗well-done‘ and

‗excellent‘. These were pedagogical strategies to break down the power relations.

After use of the above pedagogy for six and fifteen weeks, I gave the students mid-term and

final speaking tests and asked them to complete the same questionnaire. During these periods,

I additionally investigated their attitudes towards the teaching strategies using a questionnaire

that I constructed based on the pedagogical strategies. Five teaching experts examined it and I

revised it accordingly.

4. Hypotheses

Based on Gore‘s (2002) arguments that teachers need to use their power knowingly and that

trying to dispense classrooms of power is not futile, I hypothesise that after conscious use of

the pedagogical strategies for six weeks, the students‘ overall level of:

1. confidence in spoken English is higher than the first session;

2. anxiety in spoken English is lower than the first session;

166

FLLT 2011 Proceedings

3. attitudes towards the pedagogical strategies is high;

4. confidence correlates with their mid-term speaking test result;

5. anxiety correlates with their mid-term speaking test result; and

6. attitudes correlates with their mid-term speaking test result.

A continuity of conscious use of the pedagogical strategies until final exam or after fifteen

weeks, the students‘ overall level of:

7. confidence in spoken English is higher than six weeks earlier;

8. anxiety in spoken English is lower than six weeks earlier;

9. attitudes towards the pedagogical strategies is higher than six weeks earlier;

10. confidence correlates with their final speaking test result;

11. anxiety correlates with their final speaking test result; and

12. attitudes correlates with their final speaking test result.

5. Reliability of research tools

SPSS is used to measure questionnaire reliability. The results show that the questionnaires on

confidence, anxiety and attitudes are reliable at .689, .943 and .902, respectively.

6. Statistical treatment of data

The quantitative data garnered during sessions one, eight (mid-term exam) and sixteen (final

exam) are analysed by use of SPSS. Descriptive statistics of mean and standard deviation are

used to interpret the data answering hypotheses 1, 2, 3, 7, 8 and 9. Inferential statistics of t-

test dependence is employed to interpret correlations between two variables answering

hypotheses 4, 5, 6, 10, 11 and 12.

7. Findings and Discussion

After using the teaching strategies knowingly for six weeks, the overall findings reveal that

the levels of students‘:

1) confidence (x̄ = 3.36) and anxiety (x̄ = 2.92) in speaking are moderate. The

results remain the same as the first session, rejecting hypotheses 1 and 2.

However, when comparing all statements, there are three statements showing one

higher level of confidence in speaking. They think they can speak English well (x̄

= 2.91), speak perfect English in the future (x̄ = 4.20) and get an A in this class (x̄

= 3.51). Four statements show one lower level of anxiety. They worried about

speaking with their classmates (x̄ = 2.35), speaking better English than their

classmates (x̄ = 2.43), being corrected by their classmates (x̄ = 2.45) and learning

English (x̄ = 3.33).

The analysis suggests that conscious use of the pedagogical strategies have some positive

effects on the students‘ identity confidence and identity anxiety in speaking in English.

2) attitudes towards the teaching strategies is high (x̄ = 3.83), supporting with

hypothesis 3. They like it most when I call them by their nickname (x̄ = 4.30),

when I correct their spoken errors (x̄ = 4.25) and because they gain more

knowledge in this class (x̄ = 4.20).

167

FLLT 2011 Proceedings

The analysis suggests that conscious use of the pedagogical strategies can positively break

through the power relations between my students and myself.

3) confidence does not correlate with their speaking test result (r = .490,

p = .084), rejecting hypothesis 4.

4) anxiety does not correlate with their speaking test result (r = .059, p = .229),

which conflicts with hypothesis 5.

5) attitudes correlate with their speaking test result (r =.682*, p = - .050), supporting

hypothesis 6.

There may be other factors affecting the rejection of hypotheses 4 and 5, for example, class

absence during the first seven weeks and a lack of lesson reviews. The survey shows that 41

students missed the class between two and three times and five missed it more than three

times. Two statements addressed in the attitude survey reveal moderate levels of lesson

reviews through E-Learning that I produced for this class and of reading before coming to the

class. These aspects may impinge on their speaking achievements since 40 students receive

marks lower than 50%.

After using the teaching strategies knowingly for fifteen weeks, the overall outcomes indicate

in the following that the levels of students‘:

1) confidence in speaking is high (x̄ = 3.40) and is higher than six weeks earlier,

supporting hypothesis 7.

2) anxiety in speaking is moderate (x̄ = 3.04) and is the same as six weeks before,

rejecting hypothesis 8.

However, when comparing all statements, one statement particularly shows a higher level of

confidence in speaking from moderate to high. They particularly thought they were capable to

learn English (x̄ = 3.47). In contrast, five statements show one higher level of anxiety. They

were afraid when they had to speak in English with Thai professors (x̄ = 3.02) and with their

classmates (x̄ = 2.76). They worried about being corrected by their professor (x̄ = 2.68) and

by their classmates (x̄ = 2.80) and about learning English (x̄ = 3.44).

Of the five statements of anxiety mentioned above, the level of the first four moved up from

low to moderate whereas the fifth increased from moderate to high. These two statements: ‗I

was afraid when I had to speak in English with Thai professors‘ and ‗I worried about being

corrected by my professor‘ reflect power relations in pedagogy. Other two statements: ‗I was

afraid when I had to speak in English with my classmates‘ and ‗I worried about being

corrected by my classmates‘ reflect loss of face (Mulder, 2000), a Thai cultural pattern deeply

embedded in social interactions. It may be that these four statements specifically led the

students to have more anxiety in learning English, parallel with Nunan‘s (1999) suggestion

that the least number of students in a language classroom (not over ten) and types of speaking

activities are important factors influencing learners‘ willingness to talk.

The above analysis suggests that conscious use of the pedagogical strategies may not be key

factors influencing the students‘ higher anxiety. Perhaps, it derives from frequency of error

correction and meaning-and-form-focused instructions for the purpose of correct and

appropriate spoken productions (Long, 1996) I adopted in my class. I corrected my students‘

errors every time they spoke with incorrect forms and words. Excessive correction may build

168

FLLT 2011 Proceedings

up their anxiety when they had to interact with me in the classroom (Lightbown & Spada,

1999).

3) attitudes towards the teaching strategies is high (x̄ = 3.83) but it remains the same

as six weeks earlier, rejecting hypothesis 9. However, when comparing all

statements, one statement (I like it when the teacher corrects my errors)

specifically shows a lower level from the highest (x̄ = 4.25) to high (x̄ = 4.20).

The analysis is in agreement with the statement of anxiety that the students feel more worried

when I correct their errors. This aspect can imply that their anxiety is influenced by loss of

face, similar to Zhang‘s (2006) study in that EFL learners of Chinese prefer face keeping to

error-making because they feel anxious to make mistakes.

4) confidence does not correlate with their final speaking test result

(r = -.186, p = .134), rejecting hypothesis 10.

5) anxiety does not correlate with their final speaking test result (r = -.187, p = .134),

which conflicts with hypothesis 11.

6) attitudes do not correlate with their final speaking test result (r =.065, p = .606),

rejecting hypothesis 12.

The analysis suggests that there may be other factors affecting the rejection of hypotheses 10,

11 and 12, for example, class absence during weeks nine and fifteen as well as a lack of

lesson reviews. The survey shows that 43 students missed the class between two and three

times while 17 students missed it more than three times. From my class attendance records

during these periods, apart from their absence there were two groups of eight students each

arriving in the class at least half an hour late. Through an informal interview with them, I

found that they waited for their group members to come to the campus and have breakfast

together first and then attended the class later. This point reflects a collectivistic practice

(Hofstede, 1997). Students who missed the class more than three times had to work part-time

with dynamic shifts. Additionally, two statements addressed in the attitude survey reveal

moderate levels of lesson reviews through E-Learning produced for this class and of reading

before coming to the class. The analysis implies that frequent absence from the class,

unpunctuality and lack of lesson reviews may impinge on their final speaking achievements

as 34 students receive lower marks than their mid-term test result

8. Conclusion and Recommendation

This study examined power relations in pedagogy based on Gore‘s (2002) implications and its

effects on identity confidence and identity anxiety in Thai students of EFL. Although the

small number of participants limits the investigation, it offers an insightful direction that

teachers of EFL need to be consciously aware of power relations produced through pedagogy,

embrace and exercise it knowingly. The teachers also need to know which types of power

(attractive, expert, reward, position and coercive) they have and can use to suit their group of

students. Such conscious awareness can to some extent break through the power relations,

improve students‘ identity confidence in speaking, develop their positive attitudes towards

learning and teaching of English and at the same time decrease their identity anxiety. Yet, the

awareness cannot help students achieve in their speaking skills because of these factors,

frequent absence from the class, unpunctuality and lack of lesson reviews. To say the least,

this group of students needs not only affective but also cognitive and psychomotor domains in

169

FLLT 2011 Proceedings

order to develop their speaking skills (Bauer, 1970). It is recommended to add a control

group for further research.

9. References

Bauer, E.W. (1970). Objectives, learning tasks, and testing in foreign languages.

Paper presented at the Southeast Asian Ministers of Education Organization Regional

English Language Center Seminar on English Language Testing, Bangkok, Thailand.

French, J., & Raven, B. H. (1959). The bases of social power. In D. Cartwright (Ed.),

Studies in social power (pp. 150-167). Ann Arbor, MI: Institute for Social

Research.

Gore, J.M. (1995). On the continuity of power relations in pedagogy. International

Studies in Sociology of Education, 5(2), 165-188.

Gore, J.M. (2002). Some certainties in the uncertain world of classroom practice:

An outline of a theory of power relations in pedagogy. Conference Proceedings: the

Annual Meeting of the Australian Association for Research in Education, Brisbane,

December 2 – 5.

Hofstede, G. (1997). Cultures and Organizations: Software of the Mind. New York:

McGraw-Hill

Krashen, S. D. (1987). Principles and Practice in Second Language

Acquisition. Prentice-Hall International.

Lightbown, P., & N. Spada. (1999). How Languages are Learned. (2nd ed.). Oxford:

Oxford University Press.

Long, M. (1996). The role of the linguistic environment in second language

acquisition. In W. R. & T. J. Bhatia (Eds.), Handbook of second language acquisition (pp. 413-468). San Diego : Academic Press.

Mulder, N. (2000). Inside Thai society: Religion, everyday life, change. Chiang Mai:

Silkworm Books.

Nunan, D. (1999). Second language teaching and learning. Boston: Heinle and

Heinle

Park, Hyesook & Lee, R.A. (2005). L2 Learners’ Anxiety, Self-Confidence and Oral

Performance. The 10th

Pan-Pacific Association of Applied Linguistics

(PAAL) Japan Proceedings. Retrieved 20 August 2010 from

http://www.paaljapan.org/resources/proceedings/PAAL10/pdfs/hyesook.pdf

Peacham, C. (2007). Power Relations of Community and Local Government in

Natural Resource Management in Ban Sop Win Village, Tambon Mae Win, Amphoe

Mae Wang, Changwat Chiang Mai. Master‘s Degree Thesis, Political Sciences,

Chiang Mai University.

170

FLLT 2011 Proceedings

Prajuckpana, T. (2008). Gender and power relations through drinking and eating

culture. Master‘s Degree Thesis, Women‘s Studies, Chiang Mai University.

Redmond, M. (1998). Wondering into Thai Culture. Bangkok: Redmondian Insight

Enterprises.

Shindler, J.V. (n.d.). The five forms of teacher power. Retrieved 22 November, 2010,

from http://www.calstatela.edu/faculty/jshindl/cm/Teacherpower

Srinutham, P. (2009). A Study of the construction of parental-child power relations in

Pla Boo Thong. Master‘s Degree Thesis, English, Chiang Mai University.

Zhang, X. (2006). Speaking skills and anxiety. CELEA Journal, 29(1), 34-39.

Ziegahn, L. (2001). Considering Culture in the Selection of Teaching Approaches for

Adults. Retrieved 23 November, 2010, from

http://www.ericdigests.org/2002-3/culture.htm

About the Author

Noparat Tananuraksakul is a PhD candidate in Linguistics, Macquarie University. She is a

teaching staff member of the Department of Business English, South-East Asia University.

Her interest is in the areas of intercultural communication, human security and psychological

aspects of foreign language learning.

171

FLLT 2011 Proceedings

Questions: Interpersonal Interactive Feature in

Science Lecture Discourse in L2 Setting

Akhyar Rido

English Literature Department

Higher School of Foreign Language (STBA) Teknokrat Lampung, Indonesia

[email protected] Abstract

This paper looks into the use and function of questions as one of interpersonal interactive

features in science lecture discourse particularly in Non-Native Speaker (NNS) of English

setting in a university in Malaysia where English (L2) is used as the medium of instruction

(MOI). There are two lectures compared, analyzed, and discussed qualitatively. Meanwhile

the data are collected through non-participant observation and video-recording. The findings

show that there are a number of display and referential questions employed by the lecturer.

The use of questions will help a lecture to be more interactive and can define interpersonal

relations between a lecturer and students.

Introduction

This paper looks into the use and function of questions as one of interpersonal interactive

features in science lecture discourse particularly in Non Native Speaker (NNS) of English

setting in a university in Malaysia where English (L2) is used as the medium of instruction

(MOI). Interactive discourse structuring is used to guide listeners through on-going speech

and has been shown to have a positive effect on lecture comprehension, particularly in L2

settings. As mobility increases in the academic world, there are more possibilities for lecture

events characterized not only by linguistic/cultural diversity but also by unfamiliarity between

lecturers and audiences (Camiciottoli, 2004: 41). In this situation, interactive discourse

structuring may have an especially important role in terms of improving students‘ linguistic

and communicative competence also establishing a comfortable context that will encourage

participation (Morell, 2000; Comicciottoli, 2004). Morell (2004: 326), then, adds that

personal pronouns, discourse markers, questions, and the negotiation of meaning are

considered as interpersonal discursive features because they are concerned with the lecturer‘s

attitude towards the content being worked upon and to the students. However, this study will

focus on questions, particularly display and referential.

A question is categorized as interpersonal because they indicate the desire to share discourse

(Morell, 2004). A teacher or lecturer formulates a question mostly because he is expecting a

response. Nevertheless, not all questions require or expect response.

There are several researches which focus on the use of questions in a lecture discourse

(Brock, 1986; Olsen and Huckin, 1990; Morell, 2004, 2007). Olsen and Huckin (1990) found

that students may face such difficulties to follow a lecture. Such instances and questions can

help and influence students to comprehend a large chunk of discourse.

In one study, Brock (1986) has found that referential questions which are mostly open

questions (the lecturer does not know the answer) rather than display questions which are

mostly closed questions (the lecturer knows the answer), will get more and longer responses.

Nevertheless, the lecturers who claim that the discourse should contain closed questions were

probably referring to the type of questions that they more often use or that they have received

172

FLLT 2011 Proceedings

responses for (Morell, 2007: 229). Morell (2007: 229) adds that responding with one or two

words requires a smaller risk of losing face than responding with a longer utterance. In any

case, few lecturers are aware of the different type of questions that their either use or that can

be used, for these reason in the questionnaire responses, there is no mention of referential and

display questions or the different ways of negotiating meaning. However Brock (1986) and

Morell (2004) have different findings in such points.

So now, Morell‘s (2004) findings show that there is more display questions than referential

questions. In addition, it seems that there is a correlation between the amount of referential

questions and the amount of student interventions. She reveals that students‘ responses toward

referential questions are longer and more complex than display questions. Therefore, she

claims that referential questions can enhance the quality and quantity of students‘

contributions to the lecture. Moreover, it is also revealed that all the referential questions got

responses. In contrast there are many display questions which got no responses. Further,

Morell (2004: 335) also agrees that it is true that the content of the referential questions was

primarily of a more personal character (e.g., For what reason do you think…? How would you

say this compares with Spain?), whereas the display questions tended to be more of an

impersonal nature (e.g., Which religion is the most predominant in the US?). In her final

statement, Morell (2004: 236) says that the use of questions by the lecturer indicates that

students‘ participation is not only welcomed but requested.

In a more recent study, Morell (2007) shows that students would prefer to answer than to ask

questions. She further explains that some lecturers claim that students answer closed

questions (direct to individuals that require short responses), while other believe that open

questions (questions posed to whole class that require many possible answers) get more

responses.

QUESTION CLASSIFICATION

Athanasiadou (1991: 108-110) classifies four types of questions that vary in their degree of

textuality and that define distinct interpersonal relations. These four are display, referential,

rhetorical, and indirect questions.

a) Display—questions to check students‘ understanding toward material at hand e.g.,

What speaker’s face was threatened?

b) Referential—questions to look for unknown information e.g., Those of you who

were in the U.S., did you have any contact with religion?

c) Rhetorical—questions which do not require an answer and provide information.

Lecturers usually formulate then and respond to them e.g., What is the business of

parliament? Now the main…

d) Indirect—questions used to mark recipient act e.g., Is there anybody who doesn’t

have this handout? (Students who do not have handouts are expected to put up

their hands).

METHODOLOGY

This research uses purely qualitative method. In general, qualitative methods are subjective

and humanistic as they deal with meanings. It is different from quantitative method which is

regarded as more objective and scientific as they deal with numbers (Clarke and Dawson,

173

FLLT 2011 Proceedings

1999: 38). Further, the data are gathered through three ways namely non-participant

observation and video-recording.

The researcher conducted observations, as a non-participant observer, on 8 August and 12

September 2008 by directly observing the two lecture sessions at the Faculty of Science and

Technology in a university in Malaysia from the same lecturer. The first lecture is about

‗forces‘ while the second one is about ‗centre of mass‘. The first lecture lasts approximately

one and half hour while the second lecture lasts approximately one hour. During the

observation the researcher brings and uses recording field notes. The researcher stays in the

lecture hall and observes everything from the very beginning until the very end of the

lectures. Furthermore, in this research, the video recording process is also done in the same

days of observation to collect data. A technician helps recording the two lectures. Then, the

recordings are converted to DVD version and transcribed manually using a notebook and a

headset. In transforming the video-recording into a transcribed form, the details of gestures,

intonations, and postures during the lectures are also noted. After all, the transcriptions are

typed in a Ms. Word program.

A SERIES OF VIGGNETTS

Participants, events, and setting are called as a series of vignettes (Flowerdew, 2002). Even

though there are lecturer and students as participants, but this study only focuses on the

lecturer. The lecturer is a professor of physics in the Faculty of Science and Technology. She

has more than twenty years teaching experiences and teaches both undergraduate and

postgraduate courses. During her career, she participates in many teaching professional

development programs, seminars, and workshops. Moreover, the event of this discourse is the

two science lectures and part of physical mechanic course. The first lecture recorded discusses

‗forces‘ while the second lecture concerns on ‗centre of mass‘. Further, the setting of this

lecture event is in a large lecture theatre which can accommodate approximately 200 students.

The lecturer uses microphone during the lecture and speaks from the front of the room, about

2 or 3 meters away from the first row of students. Sometimes she walks around and

approached students. The lecture lasts approximately one to two hours.

FINDINGS AND DISCUSSION

This section will discuss the use of questions based on Athanasiadou (1991). The research

question is, what is the function of questions in a science lecture and how do they function as

an interactive feature? It is interesting that the data from the interview with specialist

informant reveal that she has a keenness towards posing questions in class as she believes she

can monitor the students‘ understanding of the lecture directly. Questions to her can also

make the lecture more interactive. Further, the students‘ responses can contribute to the

development of the lecture as well. Her insights are corroborated with the findings from the

data in the disocussion that follows.

The findings have revealed that there are various types of questions in both LE (1) and LE (2)

namely display, referential, rhetorical, and indirect questions. However, because of the

limitation of the study, this section will only discuss display and referential questions used in

LE (1) and LE (2). Athanasiadou (1991) states that display questions are posed in order to

check the students‘ understanding toward materials at hand while referential questions are

posed in order to ask for unknown information. Further, questions have been found to adhere

to not only the form, (who, what, where, how, and why) but also the function as indicated by

174

FLLT 2011 Proceedings

the raising intonation at the end of the structure. There are also polar questions, questions with

‗modals‘, and questions ended by a question tag. Now, let us turn to the Data.

Display Questions

The findings show that display questions have been used in both LE (1) and LE (2). In LE (1)

the researcher finds that the lecturer poses 155 display questions to the students while in LE

(2) she poses sixty 39 display questions. Athanasiadou (1991) in 2.3.2 states that a display

question is a test question if the students know the material at hand. In Data Sample 1 below,

there is a series of question-answer exchanges between the lecturer and the students which

contain display questions on the topic of relative speed namely a stationary. The lecturer

poses three display questions in lines 142, 147, and 152 and the students respond in lines 145,

149, and 151. The questions are formulated in two ways: ‗wh‘ (lines 142 and 152) and

‗yes/no‘ (lines 147 and 150).

Data Sample 1: LE (1)

138

139

140

141

142

143

If I were to move faster or slower (.), at the same time

(/) your personal experience, your own personal

experience. [moves back to front](..) You are driving

a car. (hh) Another car is coming to you. (…)

If that car is stationary, (..) what is the speed, of that

person coming to you?

145 S (.7) our speed.

146

147

148

L (.3) our speed. But in the (/) opposite direction.

Do you see the trees moving, when you’re in the car

? (hh)

149 S (.3) Yes::

150 L Are (/) the trees really moving?

151 S No:::

152 L who is really moving?

153 S We::

Further, interestingly in line 165 of LE (1) the lecturer poses a display question using

question a tag isn’t it. This question is actually posed in order to confirm a statement that she

just delivered (line 165). The students give their response by saying ‗Yes‘ (line 166). Please

refer to Data Sample 2 below.

Data Sample 2: LE (1)

160

161

162

163

L Hmmm.. Which is worse? (laughter) You are moving

(..) and there is this stationary car and you hit it.

Compared to:: (/) you‘re moving, this thing is moving

(..) and bam. Which is worse? (/)

164 S two thing moving will be worse

165 L When both are moving (/) (…), isn’t it? (/)

166 S Yes

174

175

L you make faster, so the impact will be (.) greater.

(/)Again, there is to be, what we mean by re:la:tive.

The lecturer‘s tendency to use questions to elicit information from the students is not only

through ‗wh‘ or ‗yes/no‘ questions but also from the raising intonation at the end of her

175

FLLT 2011 Proceedings

utterances. Here, in Data Sample 3 below the lecturer raises her intonation at the end of her

utterances to indicate or to signal the formulation of display questions to the students (lines

127 and 130). The raise of intonation at the end of her utterances with incomplete ending is

actually a signal for the students to complete the turn. The students also give their responses

in lines 129 and 132.

Data Sample 3: LE (1)

127

128

L Because (/) the escalator is going up (..) but I’m

going? (/)

129 S Down

130

131

L There:fore? (/) (.4) the speed that you see will be

now? (/) subtraction.

132 S (..) subtraction

133

134

135

L That means, [hand gestures showing speed] the speed

of the escalator (.3) and my speed.

(.3) Can you see that?

In LE (2) the lecturer also poses display questions to the students. Here, in Data Sample 4

below a question-answer process between the lecturer and the students, it is revealed that the

lecturer poses display questions in various forms. In lines 414 and 427 the lecturer poses two

display questions in ‗wh‘ form (what and where). Next, in line 425 the lecturer poses a

display question in ‗yes/no‘ form (do) while in line 429 she poses a display question with

‗modals‘ (would). In addition, it is obtained that in some parts of utterances in Data Sample 4

below the lecturer raises her intonation at the end of her utterances which indicate that those

utterances can be included as questions as well (lines 417, 419, and 436). The students give

their responses in lines 418, 420, 423, 426, 428, 434, and 438. And, the lecturer also gives her

positive feedback indicating that she agrees with the students‘ responses (lines 421, 424, and

435). Each feedback is followed by a question.

Data Sample 4: LE (2)

414

415

416

417

L principle, is still:: the same. What is it that you have

to do now (/)? (.4) Can you tell me (/)? What is it you

have to do now (/)? What is it you have to do now (/)?

You determine the (/)? 418 S (.5) position

419 L Position of (/)?

420 S (..) x:::

421

422

L x. The x position for the centre of the mass and then

you determine the (/)? 423 S Y position::

424

425

L Y position. So, how do you do that (/)? Can you all

imagine ? Do you all have your x position (/)?

426 S [nods head]

427 L Where?

428 S (..) [inaudible response]

429

430

431

432

433

L Would you consider that or here? [no response from

students]. Right, so look. Here will be the x-axis

[points and moves along the front row]. And here will

be the y-axis. [points to the stairs in the centre of the

dewan.]

176

FLLT 2011 Proceedings

434 S Y :::

435

436

437

L Y-axis:. So there you are. [points to students in front

row and assigns them with a number]. Yours is y1,

yours (/) ? 438 S 2

Interestingly in Data Sample 5 below, display questions are posed by the lecturer as she

switches from one code to another code. Bearing in mind that this is a Malaysian university

where the students had experienced a Malay medium of instruction, that is not surprising. She

code-switches English and Bahasa Melayu (lines 619, 626, and 630) while asking the students

about the meaning of conservation of momentum. First, she poses a question in English (line

618). After that she asks the same question which she code-switched.

Data Sample 5: LE (2)

618

619

620

621

622

623

624

L What is the meaning of conservation of momentum

(/)? (..) Ahh:: Apa makna conservation of

momen::tum(/) ? (..)Apa makna conservation of

momentum? (..) Are you having a problem with the

English term (/) or apa ini? (..) The idea? Apa makna

conservation of momentum? The momentum does

not? (.6)

625 S Change.::

626

627

628

L Does not change. (.5) Apa makna does not change?

Biasanya, when you talk about momentum what do

you talk about? 629 S Collision

630

631

L Collision (/). Conservation of momentum:: apa

maknanya? Before collision and ? (/)

632 S (.4) After:: collision::

Referential Questions

The findings reveal that referential question has been used in both LE (1) and LE (2). In LE

(1) the researcher finds that the lecturer poses 9 referential questions to the students while in

LE (2) she poses 6 referential questions. Athanasiadou (1991) in 2.3.2 states that referential

question is a question to look for unknown information. Data Sample 6 below (lines 223, 226,

228) shows that the lecturer poses three referential questions. First, the lecturer asks the

students when they learnt about forces for the first time. The lecturer poses ‗wh‘ question

form in her first question (line 223). The next two questions are indicated because the lecturer

raises her intonation at the end of her utterances (lines 226 and 228). It is also found that the

students give their responses toward those questions in lines 224, 226, and 229.

Data Sample 6: LE (1)

218

219

220

221

L (.5) Can I give you about a few minutes? I have to

tackle this. Few minutes to think about it. Just (/)

what:: is forces:? (..)You have learn about forces, (/)

haven‘t you?

222 S (..) yes

223

224

L when did you (/) learn about forces? [moves back to

questioning students].

177

FLLT 2011 Proceedings

225 S (.5) form four (mumble)

226 L Form (/) ?

227 S form 4

228 L look at that. Form 4. some more (/) ? (..) finish off

there?

229 S inaudible responses

230

231

232

L Form 5, Form 6. now,(.) you haven‘t to be going

deeper. Ok? Otherwise, you are going back to form 4.

right?

In Data Sample 7 below there are a question-answer process between the lecturer and some

students about Newton‘s law of inertia and the Newton‘s third law of motion. The lecturer

poses eight questions to three students (lines 323, 327-328, 335-336, 338, 341, 353, 357, and

360-361). Those students give their responses in lines 326, 330-334, 337, 339-340, 343-345,

350-352, 356, 358, 362. Interestingly, from those questions, only three of them are

categorized as referential questions (lines 324, 338, and 357). Question in line 324 ‗What do

you understand about that?‘ is identified as a referential question because the lecturer poses

the question in order to know a student‘s understanding toward inertia. Meanwhile, referential

question ‗What do you mean by not really?‘ posed in line 338 is actually a personal question

as a ‗feedback‘ of a student‘s response ‗Not really‘ (line 337) toward her question about

Newton‘s first law of motion she posed before (line 335). Finally, in line 357 the lecturer

poses one more referential question ‗What do you mean of different direction?‘ as her

‗feedback‘ toward another student‘s response (line 356) toward her question about Newton‘s

third law of motion she posed before (line 353).

Data Sample 7: LE (1)

323 S (.4) Newton‘s law? Ah, related to inertia.

324

325

L Ok, what do you understand about that? [hand

movements]

326 S (.14) No idea.

327

328

329

L Ok, can I ask you? (come out). What is Newton‘s law

of inertia? (.hh) The first law of motion. [hands

microphone to another student]

330

331

332

333

334

S (.5) ok, basically the first law of motion states that, an

object at rest will remain at rest, unless an external

force is being exerted (…) ehmm, towards that object.

(.3) So, (..) it is particularly (hh) about the inertia

also.

335

336

L Ok. (.4) First law of motion refers to just (hh) a body

at rest (/)?

337 S (.4) no, not really.

338 L what do you mean by not really?

339

340

S (laughter) the object can be (.3)moving also, can be

still in motion.

341 L But (/). Is there a but to it? (/)

342 S (.3) emm.. I‘m not sure.

343

344

345

L You are not sure. Ok. [hands microphone to another

student]Come. (.8) What is the second law of motion?

[laughs]

346 S (.7) ((laughters and mumble)).

178

FLLT 2011 Proceedings

347

348

349

L No, because you said that you have learned it, so I

better, sort of check on you, (.4) so that, when I teach

you I know what is going o:n?

350

351

352

S The next force of motion is (.) the next force of

motion is related to the mass of and the acceleration

of the object.

353

354

355

L (unclear) the third law of motion(/)? [looks for

student to answer the question, moves back to front

centre] [hands microphone to another student at front

row]

356 S (.16) ahh, different direction.

357 L what do you mean of different direction?

358 S different direction.

359

360

361

L different direction? (.5) What is the third law of

motion? Oh, sorry. What is Newton‘s third law of

motion? For every (gap)?

362 S (mumbles) single movement.

Next, in this Data Sample 8 of LE (1) below the lecturer poses referential question in ‗yes/no‘

form (line 372). The lecturer asks the students whether they have the picture of Newton in

their book or not. The students give their response in line 374.

Data Sample 8: LE (1)

372

373

L Ok. Now, do you, have his picture in your book?

[helds up a book] (Newton‘s picture)

374 S no::

375

376

377

378

379

380

right, (.3) now I get it from another book. This is just

to let you know some basic history. [refers to the slide

on screen] Now, it has always been the practise of

those in the West (/), to keep on promoting this idea

(..) that it is people (.) who discovered the laws.

Whereas, the laws:: have always been there. But,

Meanwhile, the use of referential question is also found in LE (2). In Data Sample 9 below,

the lecturer combines ‗yes/no‘ (do), ‗modals‘ (would and can), and ‗wh‘ (what) forms of

questions. First two referential questions are ‗yes/no‘ question and question with ‗modals‘. It

is when the lecturer asks all students whether they can hear their friend‘s answer (line 478)

because it seems to her that his voice sounds inaudible. This is actually a checking question.

After that the lecturer poses a question to one group of students in order to know their

perspective toward the activity they have just done (finding coordinates). She asks ‗Can you

tell me what do you do? Who wants to try? This group, can you tell me what do you do?

Would you like to try? What would you do (/)?‘ (lines 486-490, and 500). One student who

represents that group gives his response (lines 493, 495-496, 498, and 501).

Data Sample 9: LE (2)

475

476

L Now look, he is, what is the, I want both the x and y

coordinates. Give me your coordinate(/)?

477 S X9, Y3 [inaudible]

478 L X9, did you hear? Could you hear (/)?

479 S X9, Y3.

179

FLLT 2011 Proceedings

480

481

482

L X9, Y3. so, each and everyone of you has a

coordinate. Now let‘s see, what is your coordinate

now?

483 S X5, y1

484

485

486

487

489

490

L Oh, he is ready already. (.5) [laughter] X5, y: 1.

right? So each and everyone of you has your own

coordinate, so what do you do (/)? Can you tell me

what do you do (/)? Who wants to try? This group,

can you tell me what do you do (/)? Would you like

to try? What would you do(/)? 491 S (..) [inaudible response]

492 L Bangun, bangun, bangun.

493 S We consider each particle, (..) lets say x axis first

494 L Aahh

495

496

S (..) Times up the mass and the coordinate of x axis,

(..) neglecting the y axis first so we get bar x.

497 L Aahh

498 S And then we use, (..)the other way round.

499

500

L You see (/) that they are there (.hh). They are not here.

So, what do you do(/)? 501 S But the x, we already have the x coordinate.

Furthermore, in Data Sample 10 of LE (2) below it can be revealed that the lecturer poses a

referential question to the students in code-switch styles. She combines English and Bahasa

Melayu (line 643) while she asks the students about the place for the following meeting

because she has no idea about it. The students give their response by saying ‗Fssk‘ (line 644)

which stands for Fakulti Sains Sosial dan Kemanusiaan or Faculty of Social Sciences and

Humanities.

Data Sample 10: LE (2)

633

634

635

636

637

638

639

L After collision. Ok, this 2 objects are moving, collide

(.5) and what happen? Either they get stuck and stop

atau they move. Right? So,(.4) ini ada momentum,

this 1 also ada momentum. So what do you do, you

just add them up (.5). So, kalau conservation of

momentum, what does that mean? The momentums

before and after must (/)

640 S Must be the same.

641

642

643

L Be the same. So, that is the principle that you need to

use to find the speed after that (..) as well as the ( ) so,

you come back, on Monday morning, kat mana ini? 644 S Fssk [inaudible]

645

646

L fssk ye. (.10) Ok, I‘ll see you on Monday morning

and talk about it.

From the findings of the use of questions in both lectures, it can be concluded that the lecturer

uses more display than referential questions. This result is similar to Morell (2007) and

contrast with Brock (1986). It is also revealed that the lecturer poses more questions in LE (1)

than that of in (LE 2). The lecturer poses 164 questions in LE (1) and 45 questions in LE (2).

180

FLLT 2011 Proceedings

CONCLUSIONS AND SUGGESTIONS

In conclusion, from the findings, it is identified that there are a number of display and

referential questions (based on Athanasiadou, 1991) employed by the lecturer. As can be seen

from the data, the lecturer employs a highly interactive style of lecture and not the monologue

norm. She uses a lot of questions despite the students‘ relative reluctance to answer them.

This is a common scenario in Malaysian lecture as well as in Malaysian classroom where the

students prefer to be passive recipients of knowledge. Here, in this case, display and

referential questions are posed by the lecturer in order to check the students‘ knowledge and

to ask for unknown information.

In relations to types of questions, it is revealed that the lecturer uses more display than

referential questions in both LE (1) and LE (2). The finding is similar to Morell (2004) and

contrasts with Brock (1986).

There is indeed a potential in this area for further research. The same research can be repeated

with larger corpus so then there will be richer data to be analyzed further. In addition, more

interpersonal interactive features (e.g. aside and digression) can enrich the micro analysis of a

lecture. This research can also be compared to NNS of English lectures from different

disciplines (in engineering or medicine for examples) or can be contrasted to native of English

lecture (in the United States for example). Further, since this research only employs

qualitative method, collaborating quantitative and qualitative research can enrich the data and

give an added-value for the findings as well. There is always room for improvement in

expanding this research.

REFERENCES

Athanasiadou, A. 1991. The discourse function of questions. Pragmatics: Quarterly

Publication of the International Pragmatics Association 1 (Mar): 107-122.

Brock, C. 1986. The effects of referential questions on ESL classroom discourse. TESOL

Quarterly 23 (3): 421-445.

Camiciottoli, Crawford B. 2004. Interactive discourse structuring in L2 gust lectures: some

insights from a comparative corpus-based study. Journal of English for Academic

Purposes 3: 39-54.

Clarke, Alan and Dawson, Ruth. 1999. Evaluation research. London: Sage Publications.

Flowerdew, J. 2002. Ethnographically inspired approaches to the study of academic

discourse. In Flowerdew, J (Ed.). Academic discourse. London: Pearson Education

Limited. pp. 233-252

Morell, T. 2007. What enhances ELS students‘ participation in lecture discourse? Student,

lecturer and discourse perspective. Journal of English for Academic Purposes 6: 222-

237.

Morell, T. 2004. Interactive lecture discourse for university ELF students. English for

Specific Purposes 23 (3): 325-338.

181

FLLT 2011 Proceedings

Olson, L. A and Huckin, T. N. 1990. Point-driven understanding in engineering lecture

comprehension. English for Specific Purposes 9: 33-47.

About the Author

Akhyar Rido is a lecturer at STBA Teknokrat Lampung. He completes his first degree at

Padjadjaran University and his masters at the National University of Malaysia. He has

presented his research papers in local, national, and international conferences (Asia TEFL,

TEFLIN, English and Asia, etc) and published his writing in a local journal. Further, he has

ever involved in a research project lead by Prof. Saran Kaur Gill (Representative of UNESCO

Asia Pacific in Malaysia) for one and a half years. His interests include discourse analysis,

pragmatics, second language acquisition, and ELT.

182

FLLT 2011 Proceedings

Relationship between Vocabulary Size and Reading Comprehension

Preawpan Pringprom

Language Institute, Bangkok University

[email protected]

Buppha Obchuae

School of Humanities, Bangkok University

Abstract

This research aimed to study the relationships between students‘ English vocabulary size and

their reading comprehension. Subjects were 30 undergraduate students at Bangkok

University who were studying EN111. The Vocabulary Levels Test (VLT) bilingual version

(English-Thai) was employed to measure the subjects‘ receptive vocabulary size. A multiple-

choice-question-format reading test was utilized to assess the subjects‘ reading

comprehension. Pearson correlation was used to analyze the relationships between the scores

of the VLT and the score of the reading test (RCT). The finding showed that the subjects‘

English vocabulary size and their reading comprehension were positively correlated.

1. Introduction

It has been recognized that vocabulary knowledge plays an important role in reading

comprehension both in first and second language. Research on the role of decoding and

vocabulary skills, as predictors of reading comprehension in young first (L1) and second (L2)

language learners found that vocabulary is a critical predictor of the development of reading

comprehension skills in both L1 and L2 learners (Lervåg and Aukrust, 2010). There are

sufficient evidences that vocabulary is related to reading skills than all the other components

(Anderson & Freebody, 1981; Beck, Perfetti, & Mckeown, 1982; Koda, 1989; Laufer, 1991;

1997). Leading scholars in vocabulary research (Laufer 1989; 1998; Mear, 1996; Nation,

1990; Read, 1988) believe that the number of words known is one of the key factors in second

language learning.

From teaching experiences, the researchers (thereafter we) have found that vocabulary is the

big issue which concerns Thai students‘ English acquisition and development. Their

vocabularies are quite limited. Nevertheless, there aren‘t many Thai researchers carrying out

research on measuring Thai students‘ English vocabulary knowledge.

2. Literature Review

2.1 Vocabulary Knowledge

Vocabulary knowledge could be regarded as having two primary dimensions: receptive and

productive (Qian, 1999; Wesche et. al, 1996). Receptive knowledge is the language input that

learners receive from others through listening or reading and try to understand it. Productive

knowledge, on the other hand, is the language output that learners convey messages to others

through speaking or writing (Nation, 2006: 24).

183

FLLT 2011 Proceedings

2.2 Vocabulary Levels Test (VLT)

The Vocabulary Levels Test (VLT), which was originally designed by Nation (1983, 1990), is

used as a diagnostic test in New Zealand. It becomes an important tool that widely used in

the research area of second language acquisition (SLA) to test learners‘ English proficiency.

The test has five parts corresponding to five levels of word frequencies in English: 2000,

3000, 5000, academic, and 10,000. Later, there is a major improvement on the original test

made by Norbert Schmitt, Diane Schmitt and C. Clapham (Nation, 2001: 416-420).

The 2000 level represents the 1986 word families from the General Service List (GSL; West

1953). The GSL was constructed from a corpus of five million written running words, using

frequency as the predominant selector. Frequency counts were based on Thorndike and

Lorge‘s list of 30,000 words, which was compiled from 18 million running words of written

text.

The 3000, 5000, and 10,000 levels represent a sample of words from the third, fifth and 10th

1000-word frequency based on Thorndike and Lorge‘s word list.

The test-item types are used in discrete and context-independent. It tests the target words out

of context because the context might provide clues to the meanings. The VLT uses word–

definition matching format to require test-takers to match the words to the definitions. Each

level contains 30 items. There are three definitions on the right and six words on the left.

Test-takers need to choose three out of the six words to match the three on the right. In total

at each level, 30 definitions need to be matched to 30 out of 60 words. See example below.

For interpreting the test, Nation (2008) explains that:

Each word in the test represents 33 words (1000 divided by 30). A score of

20 out of 30 on a level means that a learner knows 667 words out of the 1000

at that level, and does not know 333 from that level. We would expect a

learner to know at least 90% of the words at that level (27 out of 30) before

we could feel that the level might be known. (p. 143)

2.3 Vocabulary Knowledge and Reading Comprehension

It has long been accepted that vocabulary knowledge is an instrument for reading

comprehension (Anderson & Freebody; Alderson, 2000; Mezynski, 1981; 1983; Qian, 2002;

Read, 2000). Vocabulary knowledge has played an important role not only reading in first

1 business

2 clock _ 6_

ก ำแพง

3 horse _ 3_ มำ้

4 pencil _ 4_

ดินสอ

5 shoe

6 wall

You answer it in this way.

1 business

2 clock __ _

ก ำแพง

3 horse _ __ มำ้

4 pencil __ _

ดินสอ

5 shoe

6 wall

184

FLLT 2011 Proceedings

language (L1) but also has proved to be true of reading in second language (L2) settings.

Most theorists and researchers in education have assumed that vocabulary knowledge and

reading comprehension are closely related, and numerous studies have shown the strong

correlation between the two (Baker, 1995; Laufer 1992; Nagy, 1988; Nelson-Herber, 1986;

Qian, 1999; 2002; Qian and Schedl 2004; Read 1997). For L2 learners, vocabulary

assessment can reveal the extent of the lexical gap they face in coping with authentic reading

materials (Read, 2007: 107).

Laufer (1989b) studied the percentage of running words needed to be understood to ensure

‗reasonable‘ reading comprehension of a text. She found that those who scored 95% and

above on the vocabulary measure have a higher number of successful readers than those

scoring below 95%. Furthermore, Laufer (1992b) administered the VLT and the Eurocentres

Vocabulary Test to 92 university freshmen whose native language was either Arabic or

Hebrew. She found that the scores on these tests correlated with reading comprehension

scores at .50 and .75. Findings also indicate that the minimal vocabulary level where there

were more readers than non-readers was 3000 word families.

Hirsh and Nation (1992) studied the amount of vocabulary demands of three short

unsimplified novels which were written mainly for young native speakers of English. The

findings showed a vocabulary size of 2000 word-frequency was not enough for pleasurable

reading. They stated that a number of words between 3000 to 5000 word families were

needed to provide a basis for comprehension (cited in Nation and Waring, 1997: 10).

However, Nation and Waring (1997: 11) suggest that an ESL learner needs to know the 3000

frequency words of the language or beyond. Furthermore, Hu and Nation (cited in Nation,

2006: 147) compared the effect of four text coverages on reading comprehension of a fiction

text. They found that learners needed to know around 98% of the running words in the text to

gain adequate comprehension. Hu and Nation conclude that knowing 95% of text coverage is

likely to be the possible threshold for the reasonable comprehension as the findings show in

Laufer‘s study (1989b).

Beglar and Hunt (1999) conducted an identical study with 496 Japanese high school students

using four versions of the 2000 word level from the VLT and 464 students with four versions

of the UWL from the same test. He found that scores on the reading comprehension test

correlated with scores on versions A and B of the 2000 word level at .66 and .62 and with

scores on versions A and B of the UWL section at .67 and .71.

Qian (1999) found significant correlations in his study with the roles of depth and breadth of

vocabulary knowledge in reading comprehension with 44 Korean and 33 Chinese speakers

using version A of the VLT and the reading comprehension section from the TOEFL. The

correlation between the two tests was .78. Qian (2002) further investigated the relationship

between vocabulary knowledge and academic reading performance with 217 students

attending an intensive ESL program at the University of Toronto. Findings indicated that

students‘ vocabulary knowledge was positively related to the performance on reading tasks.

He, therefore, concluded that vocabulary is a critical component in reading assessment.

Zhang and Suaini (2008) studied the role of vocabulary in reading comprehension with thirty-

seven secondary students learning English in Singapore. The VLT was used to measure

students' vocabulary knowledge. Result showed that students' vocabulary knowledge at the

2000-word and the 3000-word levels were correlated to their reading comprehension.

185

FLLT 2011 Proceedings

All studies reviewed above are the evidence of close relationship between vocabulary

knowledge and English reading comprehension.

3. Research Objectives

There are two main folds of this research objective: (1) to find out the students‘ vocabulary

sizes; (2) to study the relationship between students‘ vocabulary size and their English

reading comprehension. Thus, our research questions are:

1. What is the overall receptive vocabulary size of the students?

2. Is there a significant correlation between students‘ scores of the VLT and a

score of the Reading Comprehension Test?

4. Methodology

4.1 Subjects

One section among four of EN 111 (Fundamental English) classes was purposively selected

as the subjects of this study. The subjects were thirty first-year-students studying EN 111 in

academic year 2010 at Bangkok University.

4.2 Instruments

The 2000, 3000, and 5000 Vocabulary Levels Test (VLT) bilingual version (English-Thai)

was used to measure the subjects‘ receptive vocabulary size in this study. The bilingual

version was based on the original version B of Norbert Schmitt, Diane Schmitt and Caroline

Clapham (2001). The vocabulary definitions of the bilingual version were translated into

Thai and validated using the back translation process by three ESL teachers. As for scoring,

each correct definition was awarded one point; a total score for each level was 30 points

A multiple-choice-question-format Reading Comprehension Test (RCT) was used to

assess the subjects‘ reading comprehension. The test consists of eight short-passages,

carefully selected from a pool of short-reading texts by language Institute teachers. There are

30 questions with only one correct answer and three distracters for each question; the subjects

were supposed to select the best choice among a set of four options. As for scoring, a correct

answer to each question was given one point. The total score for the RCT is 30 points. The

test was reviewed and validated for its content, appropriateness, and practicality by three ESL

teachers.

4.3 Procedure

Before using the research instruments with the subjects, we tried out both VLT and RCT with

forty-three students who had similar profiles. In order to find out the reliability of the

instruments, we had the same section retest two weeks later.

To avoid testing exhaustion, which may affect subjects‘ proficiency, the data collection was

carried out at different times. In the first week of the course, the 2000, 3000, and 5000 VLT

186

FLLT 2011 Proceedings

were administered at the beginning of class time. Instructions and procedures were clearly

explained in Thai because the subjects seemed to be unfamiliar with the VLT format. How-

to-answer the VLT was also demonstrated on the white-board. While taking the test, the

subjects were allowed to ask questions relating to the test administration, not the test‘s

content. The subjects were told to leave the answer blank if they didn‘t know the meaning of

the word in order to prevent any chance of guessing correctly, which might affect the true

scores subject should really earn. An average time the subjects had spent on the VLT was

approximately 30 minutes.

In the second week of the course, the RCT was also administered at the beginning of class

time. Instructions were explained and the subjects were given one hour to complete the

reading test. The subjects were assured that scores from both tests would not affect their

grade, so as a result they didn‘t have to randomly guess the answer. However, they were told

to try their best to examine how well their English was. Both tests were taken in a quiet

classroom under examination conditions.

5. Results and Discussion

Table 1: Obtained scores on the VLT frequency levels (N = 30)

Levels 2000 3000 5000

Number of Items 30 30 30

Mean ( x ) 15.53 14.37 9.27

Standard deviation 6.235 5.738 5.439

Table 1 indicates the means and standard deviations for the VLT 2000, 3000, and 5000

frequency levels. As can be seen, the mean scores for the three frequency levels were rather

low. According to Nation‘s interpretation (2008: 143), these subjects knew 518 words out of

1000 at the 2000 level, 479 words out of 1000 at the 3000 level, 310 words out of 1000 at the

5000 level respectively.

Figure 1: Average percentage scores on the VLT frequency levels (N = 30)

Figure 1 shows subjects‘ average scores of the VLT in percentage. It was obvious that the

subjects‘ vocabulary knowledge were rather limited compared to their academic level,

especially, the scores of 2000-level and 3000-level which considered high frequency words.

Line graph shows the subjects‘ VLT scores, undoubtedly dropped as the word-frequency

levels decreased.

51.7847.89

30.89

0.00

10.00

20.00

30.00

40.00

50.00

60.00

%

VLT2000 VLT3000 VLT5000

51.57 51.7847.89

30.89

0

10

20

30

40

50

60

RC VLT2000 VLT3000 VLT5000

%

187

FLLT 2011 Proceedings

With this result, we could answer the research question 1 that overall receptive vocabulary

size of the students was far from the threshold for comprehending the written text. As ESL

undergraduate-learners, 2000 word families should be a minimum they have to know. The

amount of vocabulary they have obtained will impede their comprehension on any kinds of

English written text. According to the research by Liu and Nation (1985) at least 95% of text

coverage is needed for successful guessing of the meaning of the unknown words.

Table 2: Individual’s Profile of Vocabulary Knowledge (N = 30)

Table 2 illustrates receptive vocabulary knowledge of each subject. We can see that overall

vocabulary profile of each individual was considerably insufficient. There was only one

subject (#30) who scored 100% from 2000 and 3000 frequency-level, and 93% (28 out of 30)

from 5000 word-level. We later learned that subject #30 had been in the bilingual education

program for fifteen years. Plus (+) sign was put to show that subjects had obtained at least the

criterion score (27/30) at the level.

Unexpectedly, we found that there were ten subjects whose test scores didn‘t follow the VLT

pattern. However, this unusual occurrence didn‘t affect the overall findings much since the

discrepancy between two levels was small. The possibility exists that subjects guessed

correctly. Nevertheless, some subjects reported that they knew more of the words in the

3000-level, for example, angel, draft, naked, normal, apartment, champion etc. The reason

was that these words are ―loan words‖ in Thai language.

Levels of the Test

Subjects

2000

3000

5000

1 6 9 3

2 9 6 8

3 12 12 3 4 11 12 10

5 19 18 12

6 13 11 6 7 14 14 15

8 28 (+) 25 16

9 19 18 13 10 10 11 6

11 12 17 6 12 7 8 3

13 17 14 14

14 22 17 8 15 13 15 5

16 26 25 16

17 8 8 7 18 25 22 16

19 21 20 11

20 19 14 11

21 14 12 4

22 17 16 11

23 20 7 5 24 11 11 6

25 15 14 9

26 11 7 3 27 11 12 6

28 13 14 9

29 13 14 8 *30 30 (+) 30 (+) 28 (+)

188

FLLT 2011 Proceedings

Table 3: Correlation between RCT score and VLT 2000 (N = 30)

x S.D. RCT VLT2000 RCT 15.47 5.582 - 0.684** VLT2000 15.53 6.235 -

** Correlation is significant at the 0.01 level (2-tailed).

Looking at Table 3, it can be seen that the RCT score was correlated with the VLT 2000 score

at .68, which indicated the moderate level of correlation. This could be interpreted that the

subjects‘ RCT score would probably be increased if they scored higher on the 2000-level.

Table 4: Correlation between RCT score and VLT 3000 (N = 30)

x S.D. RCT VLT3000 RCT 15.47 5.582 - 0.779** VLT3000 14.37 5.738 -

** Correlation is significant at the 0.01 level (2-tailed).

Looking at Table 4, it can be seen that the RCT score was correlated to the VLT 3000 score at

.78, which indicated the high level of correlation. This could be interpreted that the subjects‘

RCT score could be increased if they scored higher on the 3000-level.

Table 5: Correlation between RCT score and VLT 5000 (N = 30)

x S.D. RCT VLT5000 RCT 15.47 5.582 - 0.571** VLT5000 9.27 5.439 -

** Correlation is significant at the 0.01 level (2-tailed).

Looking at Table 5, it can be seen that the RCT score was correlated with the VLT 5000 score

at .57, which indicated the low level of correlation. This could be interpreted that the

subjects‘ RCT score might be increased if they scored higher on the 5000-level.

Findings in Table 3, 4, and 5 answered the research question 2 that there was correlation

between students‘ scores of the VLT and a score of the RCT especially at the 3000 word-

level. The results from this study support early research (Anderson & Freebody, 1981; Beck,

Perfetti, and Mckeown, 1982; Beglar and Hunt, 1999; Hirsh and Nation, 1992; Koda, 1989;

Laufer, 1989b; 1991; 1997; Qian, 1999; 2002; Zhang and Suaini, 2008).

6. Pedagogical Implications

Numerous studies indicate that vocabulary knowledge is an important factor for

understanding when reading text. Therefore, students‘ vocabulary assessment and instruction

should be a focus of every English course especially at the beginning level in order to prevent

189

FLLT 2011 Proceedings

the Matthew Effect1 that poor readers read less and acquire fewer words, while better readers

read more and learn more words from their reading.

References

Alderson, J. C. (2000). Assessing reading. Cambridge, England: Cambridge university

Press.

Anderson, R. C., & Freebody, P. (1981). Vocabulary knowledge. In J. T. Guthrie (ed.),

Comprehension and Teaching: Research Reviews (pp. 77-117). Newark, DE:

International Reading Association.

Baker, Scott K., et al (1995). Vocabulary Acquisition: Curricular and Instructional

Implications for Diverse Learners. Technical Report No. 14.

Eugene, OR: National Center to Improve the Tools of Educators. [ED 386 861]

Beck, I. L., Perfetti, C. A., & McKeown, M. G. (1982). Effects of long-term vocabulary

instruction on lexical access and reading comprehension. Journal of Educational

Psychology, 74(4), 506-521. doi:10.1037/0022-0663.74.4.506

Beglar, D. & Hunt, A. (1999). Revising and validating the 2,000 word level and

university word level vocabulary tests. Language Testing, 16, 131-162.

Hirsh, D., & Nation, P. (1992). What Vocabulary Size is Needed to Read Unsimplified Texts

for Pleasure? Reading in foreign Language, 8(2), 689-696. doi: EJ474555

Hu, M. & Nation, I.S.P. (in press). Vocabulary density and reading comprehension.

In Nation. (2008). Learning Vocabulary in Another Language. NY: Cambridge

University press. p. 147.

Laufer, B. (1989b). What percentage of text-lexis is essential for comprehension? In

Nation. (2006). Learning Vocabulary in Another Language. (p.145). New York:

Cambridge.

Laufer, B. (1992b). How much lexis is necessary for reading comprehension? In Arnaud

and Bejoint. (eds.) 1992: Vocabulary and Applied Linguistics. London: Macmillan.

126-32.

1 Matthew effect has been adopted by Keith Stanovich from sociology field. The phenomenon in

which ―the rich get richer and the poor get poorer‖ explains that those who possess power and

economic or social capital can leverage those resources to gain more power or capital. In educational

field, the Matthew effect is expressed similarly to the economic analogy by stating that while poor

readers read less they acquire fewer words, better readers read more they acquire more words. The

term comes from a line in the biblical Gospel of Matthew.

(http://en.wikipedia.org/wiki/Matthew_effect_(sociology))

190

FLLT 2011 Proceedings

Laufer, B. (1997). The lexical plight in second language reading: Words you don‘t know,

words you think you know, and words you can‘t guess. In J. Coady & T. Huckin

(Eds.), Second language vocabulary acquisition (pp. 20-34). New York:

Lervåg, A. & Aukrust, V. G. (2010), Vocabulary knowledge is a critical determinant of

The difference in reading comprehension growth between first and second

language learners. Journal of Child Psychology and Psychiatry, vol. 51(5).

pp.612-620. Doi: 10.1111/j.1469-7610.2009.02185.x

Retrieved from Academic Search Complete database.

Liu, N., & Nation, I. S. P. (1985). Factors affecting guessing vocabulary in context. RELC

Online Journal, 16 (1), 33-42 doi: 10.1177/003368828501600103

MacDonald, M. C. (1997). Introduction. In Lexical Representations and Sentence

Processing. A special issue of Language and Cognitive Processes.

Great Britain: Psychology Press Ltd.

Matthew effect. (2010). Wikipedia, the free encyclopedia.

Mezynski, K. (1983). Issues concerning the acquisition of knowledge: Effects of vocabulary

training on reading comprehension. Review of Educational Research,

53, 253-279.

Nagy, W. E. (2009). On the role of context in first-and second-language vocabulary

learning. In Schmitt, N. & McCarthy, M. (Eds.) Vocabulary: Description,

Acquisition and Pedagogy (pp. 64-83). Cambridge: Cambridge University Press.

Nation, I.S.P & Waring, R. (2009). Vocabulary size, text coverage and word list. In

Schmitt, N. & McCarthy, M. (Eds.): Vocabulary: Description, Acquisition and

Pedagogy (pp. 6-19). Cambridge: Cambridge University Press.

Nation, I. S. P. (2006). learning Vocabulary in Another Language (8 ed.): Cambridge

University Press.

Nelson-Herber, Joan (1986). Expanding and Refining Vocabulary in Content Areas.

Journal of Reading, 29, 626-33. [EJ 331 215]

Qian, D. D. (1999). Assessing the roles of depth and breadth of vocabulary knowledge. In

reading Comprehension. Canadian Modern Language Review, 56, pp. 282-308.

Qian, D. D. (2002). Investigating the relationship between vocabulary knowledge and

academic reading performance: an assessment perspective. Language Learning

52:3 pp. 513-536. Retrieved from Academic Search Complete database.

Qian, D. D., & Schedl, M. (2004 ). Evaluation of an in-depth vocabulary knowledge measure

for assessing reading performance. Language Testing, 21(1), 28-52

doi: 10.1191/0265532204lt273oa

Retrieved from Academic Search Complete database.

191

FLLT 2011 Proceedings

Read, J. (2000). Assessing vocabulary. Cambridge, England: Cambridge university Press.

Read, J. (2007). Second language vocabulary assessment: Current practices and new

directions. IJES, vol. 7(2). pp 105-125. Retrieved from Academic Search Complete

database.

Vermeer, A. (1992). Exploring the second language learner lexicon. In L. Verhoeven and

J. H. A. L. de Jong (Eds.) The Construct of Language Proficiency. p 147-162.

Amsterdam: John Benjamins.

Wesche, M. and Paribakht, T. S. (1996). Assing second language vocabulary knowledge:

Depth versus breadth. Canadian Modern Language Review, 53, pp. 13-40.

Zhang, L. J., & Anual, S. B. (2008). The Role of Vocabulary in Reading Comprehension: The

Case of Secondary School Students Learning English in Singapore. RELC Journal,

39(1), 51-76 doi: 10.1177/0033688208091140

Acknowledgement

We are grateful to Bangkok University for funding this research. We express our debt to Mr.

Willard Van De Bogart for proofreading this paper as well as Language Institute teachers who

help validating the instruments. We appreciate the students for participating this research,

also every researcher and author whose article was used in this paper.

About the Author

Asst. Prof. Dr. Preawpan Pringprom teaches English at Language Institute, Bangkok

University. She received her Doctorate from Kasetsart University, Thailand and her Master

from Fairleigh Dickinson University, NJ., USA. Her current research interest is on

vocabulary acquisition and instruction.

Buppha Obchuae is now teaching at the English Department, School of Humanities, Bangkok

University.

192

FLLT 2011 Proceedings

Self Assessment of Essay Writing

Asghar Kargar

Islamic Azad University of Iran, Abadeh Branch

[email protected]

Mortaza Yamini

Shiraz Universit, Iran

[email protected]

Abstract

This study investigated low intermediate EFL learners‘ ability to assess their essays in a

scaffolded environment. Thirty EFL students participated in the study. During their essay

writing course they had learned how to write four paragraph essays. In the study, they were

trained to assess their writings at two levels: macro and micro levels. After training, they

assessed the overall organization of their essays including introductory, developmental and

concluding paragraphs using an analytical scoring scale. The results of the study showed high

internal consistency and moderate validity for their assessment. At micro level, the students

were asked to edit their essays based on their training. They focused on capitalization,

punctuation, conjunctions and verb forms one by one. Making use of special marks, they

indicated correct and incorrect items. To find the effectiveness of their assessment, the

proportions of correct and incorrect editing were compared. The data suggested that the

learners were mostly confused about their errors and some correct forms. It was concluded

that they seemed to be unable to edit their errors; however, they could provide the teacher

valuable information about the area of their weaknesses and where they needed help to

improve.

I. Introduction

Learning how to write at a proper academic level is an integral part of every university

education, although its mastery is typically supposed to be a long term process (Xiao and

Lucking, 2008). Many teachers and researchers have been exploring and experimenting with

diverse methods to improve students‘ academic essay writing. As an example, Nunan (1998,

cited in Oscarson, 2009) believes that essay writing is very difficult for second language

learners, since they need to overcome the difficulty of writing second language forms, find

resources to use right words and incorporate ideas and skills to produce final results. Yet, a

thornier field is how to assess the learners‘ progress and give them appropriate feedback,

since scoring procedure is both subjective and time consuming. In fact, scoring is a

complicated and cost involved process in essay writing (Attali and Powers, 2008). According

to Alderson (2007), most writing assessments are concerned with how to get learners actually

produce relevant pieces of writing, and how to get trained humans to evaluate them reliably

and validly. Learner-directed assessment or self assessment can be considered as a way to

enhance learners‘ awareness of their own strengths and weaknesses and to lighten the

teacher‘s assessment burden (Ekbatani, 2000).

Self assessment was introduced to the field of language testing as a key to promote the

fairness of assessment and a way to ―balance the power relationship in the classroom‖

(Brown, 2004, P.251). In fact, it was believed that the authority of assessing and decision

making should be divided between learners and teachers. Brown (2004, P.252) states that self

193

FLLT 2011 Proceedings

assessment has the potential to provide both learners and educators with more complete and

accurate information because:

1. It requires students to perform, create, produce or do something;

2. It allows students‘ assessment on what they normally do in the classroom every day.

3. It focuses on process as well as product.

4. It taps into higher level thinking and problem solving skills.

5. It provides information about both the students‘ weaknesses and strengths.

6. It ensures that people, not machine, do the scoring, using human judgment.

7. It calls upon teachers to take new instructional and assessment roles.

Other researchers (e.g. Allan, 1995; Blanche, 1988; Blanche and Merino, 1989; Ferguson,

1978; Fok, 1981; Heilenman, 1990; Jafarpour, 1991; Jafarpour and Yamini, 1995; LeBlanc

and Painchaud, 1985; Oscarson, 1989) have referred to the benefits of self assessment as:

1. Promotion of learning

2. Raised level of awareness

3. Improved goal orientation

4. Expansion of the range of assessment

5. Shared assessment burden

6. Beneficial post course effects

(Mousavi, 1999, P.344)

Many studies have been conducted to find out the usefulness of self assessment in different

aspects of language learning. Oscarson (2009) reviewed many studies in the field and

concluded that comprehension skills seem to be self assessed more accurately than productive

skills. She states that there are few studies on the impact of self assessment on EFL writing

skill. This study, hence, tries to cast some light on self assessment of essay writing.

II. Review of literature

Oscarson (2009) noted that empirical work up to this time has had two main aims: to explore

the reliability of the results and to investigate ways of involving the learners in the

assessment. Internal consistency of self assessment is on average high, and the evidence in

support of self assessment is positive in terms of consistency across tasks, across items, and

over short time period (Ross, 2006). However, based on principled evaluation of self

assessment, Brown (2004, P.278) found the following rates for the fulfillment of the major

assessment principles:

Principle Rate

Practicality Moderate

Reliability Low

Face Validity Moderate

Content Validity High

Wash back High

Authenticity High

He concludes that authenticity, wash back and content validity have very high potential

because students concentrate ―on their own linguistic needs and receive useful feedback‖.

White (2009, P.97) defines authenticity of self assessment as ―whether tasks included

194

FLLT 2011 Proceedings

represent or approximate real world tasks‖ and adds that generating positive washback is a

primary motive in the creation and use of self assessment. Brown (2004) concludes that self

assessment can be justified from a number of well-established principles of SLA. The most

important ones are the principle of autonomy and the principle of intrinsic motivation. The

first principle states that the responsibility and monitoring learning should mainly be given to

the learners. According to the second principle, the desire to promote and observe the

promotion can develop intrinsic motivation. Oscarson (2009) states that the fundamental

reason for self assessment is to help the learner become aware of his or her achievement at

any given time and over a longer term, and in this way, enhance learning.

Validity in self assessment typically means agreement with the teacher‘s judgment or peer

ranking. Ross (2006) states that peer ranking, using the mean of multiple judges tends to be

more accurate than the results from a single judge. Boud and Falchikov (1989) reviewed 48

studies reporting self and teacher assessment agreement; however, students‘ self assessments

are generally higher than teacher‘s ratings. They concluded that over-estimation is more likely

to be found if self assessment contributes to the students‘ grades in a course, if they do not

have the needed cognitive skills to incorporate information about their abilities, or they are at

risk of wishful thinking. As a result, the ideal way to ensure validity of self assessment is to

find the agreement between results and objective criteria.

Writing skill as well as other language skills has experienced the research on self assessment,

and it has proved to be quite fruitful. Schendel and O‘Neil (1999, cited in Oscarson, 2009),

for instance, advocate self assessment as it encourages self awareness and control of one‘s

own writing. In other words, students need to recognize their strength and weaknesses to see

what more they need to learn. However, as Taras (2003, cited in Oscarson, 2009) states, self

assessment without the teacher‘s feedback cannot help, for the students should be aware of

their own errors. To put in his words, Taras (P. 562) believes that ―students‘ self assessment

with integrated tutor feedback is one efficient means of helping them overcome unrealistic

expectations and focus on their achievement rather than on the input required to produce their

work‖. The same conclusion was drawn by Brown (2005 cited in Oscarson, 2009) when, in a

study, she asked students to assess their own writing by comparing it with an annotated text

reflecting communicatively oriented criteria (e.g. content, sociolinguistic appropriateness, text

structure, organization and coherence). She concluded that self assessment becomes a learning

tool if it helps students identify and correct their mistakes in their own writing.

Some researchers believe that learning takes place as a result of the students‘ reflection on

their own writing when they are revising them. Hedge (2000, cited in Oscarson, 2009), for

example, asked students to contemplatively revise their own writing. Students spent time

rethinking and improving their writing through some additions or deletions. It was concluded

that reflection may promote metacognitive awareness in planning and self assessment

practices when deciding whether or not the objectives are met.

Self assessment of writing is also affected by scoring criteria and training students to use them

(Attali and Powers, 2008). Some studies (e.g. Ross, 2006) have focused on the effects of

training students how to assess their work. The results confirm that systematic training of how

to apply criteria can improve self assessment. Ross, Rolheiser and Hogaboam-Gray (1999,

cited in Oscarson, 2009) investigated the effects of training self assessment on narrative

writing skills. They found that teaching self assessment skills both increased accuracy,

especially for those who tended to overestimate, and had a positive effect on achievement

among low achievers, as it helped them better understand teacher expectations.

195

FLLT 2011 Proceedings

Some researchers (e.g. Brown and Hudson, 1998 cited in Brown 2004) have maintained that

self assessment has some drawbacks. Subjectivity is assumed to be the primary disadvantage.

Students may underestimate or overestimate their performance. Another drawback is that

they may not have the essential tools to make a correct assessment. Oscarson (2009, P.66)

states that ―beginners and students with elementary skills generally seem to have a tendency

to overestimate their abilities, while students who are more proficient are liable to

underestimate themselves‖. Ross (2006) maintains that the students who conduct

retrospective assessment of their work, may not remember what they did or have no idea

about high performance. Consequently, they may not be able to assess their own production.

In addition, some students believe that self assessment is a boring job and argue that it is

unfair to ask the learners to do the teachers‘ job (Ross et al., 1998, cited in Ross, 2006). Ross

(2006) adds that self assessment will not work unless students make a commitment to the

process, although their assessment is prone to evaluative bias or their insufficient experience

of assessing (White, 2009).

III. Research questions

The purpose of the study was to investigate the possibility of essay writing self assessment in

an Iranian EFL context and with low intermediate EFL learners, so the following research

questions were formed:

1. Is self assessment a reliable assessment technique for low intermediate EFL learners?

2. Is self assessment a valid assessment technique for low intermediate EFL learners?

3. Are low intermediate learners able to edit their writing mistakes if they are trained to do

so?

IV. Method

1. Participants

Thirty low intermediate EFL learners took part in the study. Oxford Placement Test (OPT)

was used prior to the study to establish the participants‘ proficiency level. All of them were

juniors, had already learned paragraph writing and were going to learn essay writing when the

study started. Essay Writing is a two credit required course, including 16 weekly sessions, and

learners are expected to write a complete essay at the end of the course.

2. Instrumentation

Contrary to most of the self assessment studies of writing, holistic rating scale was not used in

this study for two reasons. First, according to Dlaska and Krekeler (2008, P.507), self

assessment is only useful if the learners are able to locate their specific weaknesses and ―give

an indication of learning needs‖. Consequently, as they asserted, holistic assessment ―will not

give sufficient feedback to the learner‖. Secondly, as Ross (2006) states low level learners

―may lack the deductive skills involved in applying the criteria to their work‖. Instead, an

analytic rating scale for assessing different aspect of the ability was adapted from a

questionnaire developed by Patri (2002). He used it to get students to assess their oral

presentations with respect to organization and content, use of grammar, manner, and

interaction with the audience. The rating scale of the study had 11 questions, and the average

rating on the questions was reported with 5 as the highest possible score and 1 the lowest

196

FLLT 2011 Proceedings

(Appendix 1). The possible range of the scores was between 11 and 55. The reliability and

validity of the rating scale had been calculated before the study was conducted. The reliability

coefficient was .88, and the validity index was .63.

3. Data collection procedures

The study and data collection had three steps. First, students were taught how to write essays

in English. As was already mentioned, essay writing is a required course for the Iranian

students majoring in English. In this study, students were taught to write 4 paragraph essays

including an introductory paragraph, two supporting paragraphs, and a concluding paragraph.

Needless to say, they had already learned paragraph writing. In the second step, they were

trained how to assess themselves. The assessment itself had two levels, macro and micro

levels. At macro level, the analytic scale was used to assess the overall organization of the

essay. It has two questions for the introductory paragraph of the essay, four questions for the

supporting paragraphs and four questions for the concluding paragraph. Students were trained

to use the scale and assess their essays. The questions about introductory paragraph addressed

the effectiveness of the ―thesis statement‖ of the essay. In three questions of the body,

students assessed the organization of their paragraphs regarding the relationship between the

topic sentences and the supporting sentences. Final questions addressed the effectiveness of

the concluding paragraph, and whether or not it was supported by effective concluding

reasons. At micro level self assessment, students were assisted to edit their essays using an

annotated manual. It had instructions for checking grammar, for example, pronouns, verb

forms, subject and verb agreement, etc. It also had a complete guide for English conjunctions

including correlative and coordinating conjunctions, and conjunctive adverbs. In addition,

compound and complex sentences as well as punctuation had been discussed in the manual. In

the third step which was conducted at the end of the semester, students actually assessed their

essays at both levels. First, they were asked to respond to the analytic scale, and then they

reviewed their writings and edited them. Only four points were selected for the editing stage

because if self assessment takes a long time, there will be the danger of ― lack of students‘

commitment ‖, and the task may be boring for them (Ross, 2006). They assessed their essays

in terms of capitalization, punctuation, verb forms and conjunctions. They were asked to

review their essays and to judge whether or not they were correct and to edit them if

necessary, since as Hedge (2000, P.306 cited in Oscarson, 2009) states ―during reflection that

revision entails, students have to rethink ideas and improve their writing through other

additions and deletions‖, and this can enhance metacognitive awareness needed for

acquisition. To improve their assessment, they were asked to focus only on one point at a

time.

V. Results

The results of the study belonged to two phases. The first part was taken from the students‘

answers to the analytic scale, assessing the overall organization of their essays. For reliability

estimate, the coefficient alpha was calculated. The internal consistency was rather high, .92.

Pearson correlation coefficient between the mean scores of the students‘ and teachers‘

assessments was used as the index of validity. Table 1 shows the results.

197

FLLT 2011 Proceedings

Table 1: Descriptive Statistics and Correlation Coefficient for Self and teacher

Assessments

Assessment type N Minimum Maximum Mean Std. Deviation

Pearson Correlation

Sig.

Self assessment 30 20 54 40.50 8.22842 .623 0.01

Teacher assessment 30 25 53 37.53 6.47932

According to Ross (2006), validity in self assessment can be defined as the agreement with

the teacher‘s judgment, ―considered as the gold standard‖. As is shown in the table, validity

index is .623. Other data in the table indicate students‘ overestimation. Mean, range and

standard deviation of students‘ assessment have greater values.

In the second phase, students‘ editing was compared with the teachers‘ in order to assess the

students‘ micro level self assessment. The students‘ answers were classified as: 1) the cases

which were correctly taken as correct; 2) the incorrect cases which were correctly taken as

incorrect; 3) the correct cases wrongly considered as incorrect; 4) The incorrect cases wrongly

taken as correct; 5) the correct cases which were not recognized; 6) the incorrect cases that

were not recognized.

In the beginning, students were asked to focus on capitalization. They had already been

trained to check all capital letters used in their writings and decide whether they were correct

or not. They were allowed to use the manual if they needed instruction. The following graph

shows the results.

Figure 1: Self assessment of capitalization (CC = correct items assessed correctly; WW= wrong items

correctly assessed as wrong; CN: correct items ignored; CW: correct items considered as wrong; WC: wrong items

considered as correct; WN: wrong items not observed)

As the graph shows, students were able to verify, to a large extent, their correct capital letters

(81%), and only few of the correct items were taken as wrong (3%) or ignored (1%). Only 6%

of total wrong capitalization was recognized, and the rest was either taken as correct (4%) or

ignored (5%).

CC:81%

WW:6%CN:1%

CW:3%WC:4% WN:5%

Capitalization

198

FLLT 2011 Proceedings

The participants were then asked to review their essays and check punctuation marks. They

were asked to ponder over the punctuation marks used in their writings and indicate whether

or not they were correct. They were trained to put specific marks to show this. Fig. 2 shows

the results.

Figure 2: Self assessment of punctuation (CC = correct items assessed correctly; WW= wrong items

correctly assessed as wrong; CN: correct items ignored; CW: correct items considered as wrong; WC: wrong items

considered as correct; WN: wrong items not observed)

The graph shows that the students were able to recognize 60% of the correct punctuation

marks out of a total of 75% correct items. The rest of the correct marks were either ignored

(10%) or considered as incorrect. From a total of 25% wrong punctuation marks, 6% was

recognized, 12% was wrongly taken as correct and 7% was neglected.

The third step was to check the verb forms including verb tenses and agreement between the

subjects and the verbs based on the training they had already received. The data are shown in

Fig.3:

Figure 3: Self assessment of verb forms (CC = correct items assessed correctly; WW= wrong items correctly

assessed as wrong; CN: correct items ignored; CW: correct items considered as wrong; WC: wrong items considered as

correct; WN: wrong items not observed)

The graph indicates that from the total 67% of correct verb forms, 48% was recognized

correctly, 11% was ignored, and 8% was considered as wrong. A total of 33% of verb forms

was wrong, 3% of which was recognized, 15% was considered as correct and the rest (15%)

was ignored.

CC:60%

WW:6%

CN:10%

CW:5%

WC:12%WN:7%

Punctuation

CC:48%

WW:3%CN:11%

CW:8%

WC:15%

WN:15%

Verb forms

199

FLLT 2011 Proceedings

Finally, the students were asked to focus on conjunctions used in the texts. They had the

chance to use the instructions of their manuals. During their essay writing classes they had

been trained how to use conjunctions and how to write complex and compound sentences.

They were informed that conjunctions played a crucial role in maintaining cohesion and

coherence of the text. The results of this part are depicted in Fig. 4 below.

Figure 4: Self assessment of conjunctions (CC = correct items assessed correctly; WW= wrong items

correctly assessed as wrong; CN: correct items ignored; CW: correct items considered as wrong; WC: wrong items

considered as correct; WN: wrong items not observed)

The graph shows that 87% conjunctions was correct, 81% of which was correctly recognized,

2% was considered as wrong, and 4% was ignored.

VI. Discussion

Data summarized in Table 1 suggest that students overestimated their writing ability. This is

in line with the results of many studies on self assessment that indicate that low level students

particularly tend to be more lenient when rating their performance (e.g. Alfallay, 2004;

Dlaska and Krekeler, 2008; Oscarson, 2009). One reason is that low proficient learners are

less accurate due to lack of enough cognitive and deductive skills to incorporate information

about their abilities (Ross, 2006). Another reason is that students may have felt that their

assessments would be used in their grades in the course (Boud and Flachikov, 1989 cited in

Ross, 2006).

In terms of reliability, self assessment of essay writing enjoyed a very high level of internal

consistency; coefficient alpha was .92. The internal consistency of self assessment is usually

high especially when the learners have already been trained to evaluate their work (Ross,

2006). In the present study, training was meticulously done during the course. In addition,

using an analytic scale whose items were similar to the content of the course helped students

to assess themselves more consistently. Validity of self assessment of essay writing in this

study was moderate, .62. The ideal in estimating validity of self assessment is to find the

agreement between students‘ scores with objective criteria; hence, the teacher‘s judgment was

used in this study.

The last question of the study addresses students‘ ability to edit their own writing. One

distinction between mistake and error suggests that while students may be able to find their

mistakes, they may not be able to correct their errors which are not in their competence. In

other words, by focusing on a specific point like punctuation, students may find their

mistakes; however, learning takes place if they are able to find and edit their errors. As

CC:81%

WW:2%

CN:4%

CW2%WC:9% WN:2%

Conjunctions

200

FLLT 2011 Proceedings

mentioned before, students were scaffolded to find the errors as well as mistakes by

permitting them to use the manual.

In the beginning, they started checking all capital letters of their essays, since capitalization

seems to be less complicated than other items. High proportion of correct capitalization (85%)

suggests that students at this level were able to use their own knowledge and can show this

consciously. 81% of the cases were correctly judged as correct, meaning the students and the

rater agreed on 500 cases to be correct. Only 1% (7cases) of correct ones was ignored, and 3%

(16 cases) was wrongly taken as incorrect. This may be due to their carelessness or confusion

over the starting point of a sentence especially when they used transitions. For instance, in the

sentence ―In the past people had close relationship, but today they are less friendly.‖ the word

―but‖ was wrongly edited to ―But‖. Some other cases were found where transitional words

such as ―and, so, however, although, as‖ were wrongly edited. 15% of capitalization (97

cases) was wrong that only 6% (39 cases) of it was recognized and edited. This can be

considered as an index for the effectiveness of scaffolded self assessment. The learners were

able to correct only 40% of their inaccurate capitalization and were confused over the rest

(60%) of the incorrect cases. Analysis of the wrong cases indicated that students knew that

English sentences start with capital letters, but they sometimes got confused when they

wanted to write complex or compound sentences. No wrong case was found with proper

nouns. The agreement coefficient (Brown, 2001) was computed by adding correct and

incorrect cases that were correctly assessed. It was .87 meaning the learners and the rater

agreed on 87% or 539 cases to be either right or wrong. Consequently, the main reason for

students‘ confusion over capitalization seems to be their confusion over longer structures for

which they need more help.

The second graph indicates the students‘ ability to edit punctuation marks when they are

helped. Punctuation tends to be more complicated than capitalization, and as expected, the

percentage of total correct cases is less than capitalization, 75%. Only 60% of correct

punctuation marks were considered as correct. 10% percent was ignored, and 5% was

assessed to be wrong. As with the capitalization, this may be because of their temporary

carelessness or their confusion over some punctuation marks. Analysis of the cases showed

that they had little problem with period at the end of the sentences. A few cases were

observed when students got confused over comma when used between two clauses or similar

structures with conjunctions. Some students put comma correctly and assessed it as wrong,

whereas others did not use it and ignored it. For instance, one student wrote ―They used to

have a lot of parties, so they were very happy‖. In the sentence comma was correctly used but

wrongly edited as an incorrect mark. Similar cases showed that students had some problems

with punctuation of complex and compound sentences and mixed them together. The

agreement coefficient was .66 meaning in 66% cases (586 cases) the learners and the rater had

the same idea about the correctness of punctuation. Total of wrong punctuation marks was

25% (220 cases), only 6% (52 cases) of which was recognized and edited. It means learners

were not able to find 76% (168 cases) of their incorrect punctuation marks. For example, in

the sentence ―We keep some animals at home, however they may cause disease to us‖, one

student has wrongly punctuated the sentence but considered it as correct. The percentage of

unnoticed inaccurate cases (76% of total incorrect cases) suggests that learners need help to

improve their punctuation. To conclude, self assessment of punctuation can both help learners

to be conscious about punctuation marks and provide teachers with useful information about

the learners‘ area of weaknesses. Feedback sessions can be planned to help students use the

assessment data to improve their writing.

201

FLLT 2011 Proceedings

Next editing phase was to revise verb forms, both subject-verb agreement and verb tenses.

The data in the graph suggests that 67% (607 cases) of verbs was correct, and 33% (302

cases) was incorrect. The agreement coefficient was .51, meaning the participants and the

rater agreed on 51% of cases. Of correct cases 48% (434 cases) was recognized and 19% (173

cases) was confusing, but of wrong cases only 3% (26 cases) was edited and 30% (276 cases)

was either ignored or considered as correct. From total of wrong cases, only 10% was

recognized and edited in a scofolded environment when students focused on verb forms and

were allowed to use the manual. Their ability to find and edit small number of wrong cases

suggests that self assessment of writing may not be a reliable tool to edit verb forms. One

reason is the level of the learners. Low intermediate learners need more help to master verb

tenses and structures. The possible sources of errors were not in the scope of this study;

however, the proportions of wrong cases which were edited, ignored and taken as correct

suggest that learners were actively involved in the process of learning. Grammaticality

judgment has already been considered as a reflection of learners‘ competence. In this study,

only 51% of their judgment was valid, 49% was not.

The last part of the data represented the learners‘ ability to edit conjunctions. The learners

were trained and recommended to use such words in their study; moreover, they had access to

the lists and instructions about them in the manual. The total proportion of the recognized

correct and incorrect cases (83% or 296 cases) suggests high agreement coefficient

representing high agreement between the rater and the learners‘ assessment. However, they

were only able to recognize and edit 15% of their total incorrect cases. High agreement

between the rater‘s and the learners‘ judgment may suggest that learners know how to use

transitions; however, such hurried conclusions should be avoided as learners may use only the

transitions they are certain about. Avoidance strategy may have helped them get high level of

agreement coefficient. Analysis of the transitional words used in their essays proved the idea.

Majority of correct transitions (74%) were coordinating conjunctions (e.g. and, but, so, for),

but most of the wrong transitions (89%) were correlating conjunctions and conjunctive

adverbs (e.g. either-or, neither-nor, on the other hand, in other words, although). For example,

few of the learners observed the word order of the sentence after negative transitions like nor

or not only.

In conclusion, the data from the learners‘ assessment can be put into three categories. First,

correct cases that were recognized by the learners. Second, incorrect cases that were

recognized, and the rest of the cases that were confused. The proportion of second and third

parts can show us the effect of self assessment in enhancing the learners‘ awareness about

their lapses. The following graph shows this:

Figure5: The proportions of correct and incorrect editions (1. Capitalization, 2.Punctuation,

3.Conjunctions, 4.Verb forms)

66 2 3

1334 17 49

0%

20%

40%

60%

80%

100%

1 2 3 4

202

FLLT 2011 Proceedings

The data suggest that low intermediate learners were able to find and edit low proportion of

incorrect cases (32% capitalization, 15% punctuation, 11% conjunctions, 6% verb forms).

Moreover, they show that learners were confused about higher proportion of cases. They

either ignored or failed to recognize the accuracy of the cases. The data from this part can be

considered as the area that learners can learn with the help of teachers or more proficient ones.

A simple comparison shows that low intermediate learners may not be able to edit most of

their errors; hence, their assessment could not replace the teachers‘, and such learners are not

able to alleviate the burden of scoring. However, valuable information can be obtained from

the results of their assessment about their area of weaknesses. Dlaska and Krekeler (2008,

P.515) maintain that ―errors in judgments are integral to self assessment‖, so the suitability of

self assessment may depend on other factors like, enhancing the learners‘ awareness of their

performance, increasing their motivation and informing the teacher of the learners‘ needs.

When learners confused correct and incorrect cases, it may mean they are actively

formulating and testing hypotheses about the language they are learning. Teachers‘ feedback

can help them to improve and acquire correct forms.

VII. Conclusion

The main goal of the study was to investigate low intermediate learners‘ ability to self asses

their essay writing in a scafolded environment. It was performed in two levels, macro and

micro assessment. They assessed the overall organization of their essays by using an

analytical scale. Reliability coefficient was quite high, while validity was moderate. Micro

level assessment consists of editing their essays‘ capitalization, punctuation, verbs and

transitions. Data suggest that the learners were able to detect small number of their errors and

were confused by most of others. Although causes of the errors were not investigated in this

study, it is concluded that the areas where students have difficulty can be improved if they are

helped. Teachers can use the information to find the students‘ weaknesses and provide them

with right feedback. In conclusion, based on the results of the study, teacher‘s assessment

cannot be completely replaced by low intermediate learners‘ assessment, but very useful

information about the learners‘ interlanguage can be deduced from their self assessment.

XI. References

Alderson, J. Charles (2007). The CEFR and the Need for More Research. The Modern

Language Journal, 91 (4), 659-663.

AlFallay, I., (2004). The role of some selected psychological and personality traits of the rater

in the accuracy of self- and peer assessment. System, 32, 407-25.

Allan, A. I. (1995). Beginning the questionnaire: Instrument effect on readers‘ response to a

self report checklist. Language Testing. 12 (2), 133-56.

Attali, Y. & Powers, Don. (2008). A Developmental Writing Scale. Princeton: ETS

Blanche, P. (1988). Self assessment of foreign language skills: Implications for teachers and

researchers. RELC Journal. 19: 75-96.

Blanche, P & Merino, B. J. (1989). Self assessment of foreign language skills: Implications

for teachers and researchers. Language Learning. 39 (3): 313-40.

203

FLLT 2011 Proceedings

Boud, D., & Falchikov, N. (1989). Quantitative studies of student self-assessment in higher

education: A critical analysis of findings. Higher Education, 18, 529-549.

Brown, H. D. (2004). Language assessment: principles and classroom practices. New York:

Pearson Education, Inc.

Brown, J. D. (2001). Using Surveys in Language Programs. Cambridge: Cambridge

University Press.

Dlaska, A. & Krekeler, C. (2008). Self assessment of Pronunciation. System. 36: 506-16.

Ekbatani, G & Pearson, H. (2000). Learner-directed Assessment in ESL. London: Lawrence

Erlbaum Associates, Inc.

Falchikov, N., Boud, D.(1989). Student self assessment in higher education: a meta-analysis.

Review of Educational Research. 59 (4): 395-430.

Ferguson, N. (1978). Self assessment of listening comprehension. International Review of Applied

Linguistics in Language Learning. 16: 149-56.

Fok, A. (1981). Reliability of Student Self assessment. Hong Kong: Hong Kong University

Language Center.

Heilenman, L. K. (1990). Self assessment of second language ability: the role of response effects.

Language Testing. 7: 174-201.

Jafarpur, A. (1991). Can Naïve EFL learners estimate their own Proficiency? Evaluation and

Research in education.5(3):145-57.

Jafarpur, A. & Yamini, M. (1995). Do self assessment and peer rating improve with training?

RELC Journal. 26 (1): 63-85.

Leblanc, R. & Painchaud, G. (1981). Self assessment scales: An investigation into their validity.

In B. C. Sigurd and J. Svartvik (eds.): AILA 81: Proceedings I (Abstract). Lund, Sweden:

University of Lund.

Mousavi, S. A. (1999). A Dictionary of Language Testing. Tehran: Rahnama Publications.

Oscarson, A. D. (2009). Self Assessment of Writing in Learning English as a Foreign

Language. Goteborg: Geson Hylte Tryck.

Oscarson, M. (1989). Self assessment and language proficiency: Rationale and applications.

Language Testing. 6(1): 1-13.

Patri, M. (2002). The influence of peer feedback on self- and peer-assessment of oral skills.

Language Testing 19, 109–131.

Ross, J. A. (2006). The Reliability, Validity, and Utility of Self-Assessment. Practical

Assessment Research & Evaluation, 11(10).

204

FLLT 2011 Proceedings

White, E. (2009). Assessing the Assessment: An Evaluation of a Self assessment of Class

Participation Procedure. Asian EFL Journal.11(3):75-109.

Xiao, Y. & Lucking, R. (2008). The Impact of Two Types of Peer Assessment on Students‘

Performance and Satisfaction within a Wiki Environment. The Internet and Higher Education

Retrieved June 5, 2008, from http://dx.doi.org/10.1016/j.iheduc.

About the Authors

Asghar Kargar is a PHD student in TEFL at Shiraz University, Iran. He has been a lecturer in

the in the Department of English at Islamic Azad University, Abadeh branch. He has been

teaching different courses in TEFL and English Translation for 10 years. His research interest

includes teaching and testing language skills especially reading and writing as well as

teaching methodology. He has also published a book in essay writing entitled ―easy essay‖.

Dr. Mortaza Yamini is an assistant professor who taught for 35 years at Shiraz University

before he retired a few years ago. He is still pursuing his teaching profession, offering some

graduate courses at Shiraz University and the Islamic Azad University, Shiraz Branch. He is

also an active member of the Center of Excellence in L2 Reading and Writing, Shiraz

University.

205

FLLT 2011 Proceedings

Appendix 1

Self-assessment score sheet Name: ……………………………

Essay Question:

…………………………………………………………………………………………

…………………………………………………………………………………………

…………

Part one: Review your essay carefully and use the score sheet below to evaluate it.

Introductory Paragraph

Is there an effective introductory paragraph? 1O 2O 3O 4O 5O

Introductory Paragraph

Does the introductory paragraph have an effective thesis statement? 1O 2O 3O 4O 5O

Supporting Paragraphs

Does each paragraph have a clear topic sentence? 1O 2O 3O 4O 5O

Supporting Paragraphs

Do the topic sentences support the thesis statement effectively? 1O 2O 3O 4O 5O

Supporting Paragraphs Do the ideas in the supporting sentences support the ideas of the topic

sentences?

(Are all of the supporting sentences relevant ?) 1O 2O 3O 4O 5O Supporting Paragraphs

Are all the details (examples, facts, experiences, etc.) clear? 1O 2O 3O 4O 5O

Concluding Paragraph

Is there an effective concluding paragraph? 1O 2O 3O 4O 5O

Concluding Paragraph Does the concluding paragraph give (A) an opinion, preference, prediction,

or solution and 1O 2O 3O 4O 5O

(B) reasons? 1O 2O 3O 4O 5O

Concluding Paragraph

Does the essay have an effective concluding statement? 1O 2O 3O 4O 5O

Essay

Does the essay answer all parts of the question completely? 1O 2O 3O 4O 5O

206

FLLT 2011 Proceedings

Short-Term Training Model of Academic Writing to High School Teachers

Rita Inderawati and Rita Hayati

Sriwijaya University Palembang, Indonesia

[email protected] [email protected]

Abstract

Since scientific writing becomes an important requirement of promoting teachers‘ position in

their school life, the English teachers entail such a training model of generating their

motivation to write academically. The teachers have been teaching English for years without

taking care of their writing ability. How can they arouse their students‘ motivation in writing

if they cannot write themselves. Based on a preliminary study conducted a few months ago, it

was found that most teachers could not write academically. They confirmed that they wrote

their major papers (thesis) for finishing their undergraduate program to be teachers;

nevertheless, they confessed it was difficult to write.

Those phenomena challenge the writer to conduct a research concerning an excellent strategy

to motivate the high school teachers in generating ideas for writing. By conducting a short-

term training to 33 high school teachers from distinct regencies of the province of South

Sumatra for six hours, this study was aimed at providing the teachers with a very short and

effective way of writing academically as well as scientifically and analyzing the effectiveness

of the short-term training model.

This research-based paper elaborates the short-term model of academic writing by giving

treatment to the teachers and the teachers‘ perspective towards the short-term model by

distributing a questionnaire. The findings are there is significant development of academic

writing and the teachers have positive perspective toward the training model.

Introduction

Language, the main means of communication among people has long been recognized. It is

believed that human beings and language are deeply embedded in the sense that people own a

language and use it to interact with others. It is also viewed as a vehicle of thought, a system

of expression that mediates the transfer of thought from one person to another (Finegan,

2004:8). People learn languages in order to be able to communicate in different linguistic

contexts such as getting knowledge and information. One of the most important means for

acquiring knowledge and information is English. It has largely contributed to human life in

many ways. Therefore, there has been a strong demand for English mastery due to the fact

that process of communication can be carried out in the form of spoken and written language.

Learning to communicate in foreign language entails the necessity to learn both language

skills and language aspects of the target language. Among the four skills, writing is a

determinant of one‘s success in language learning. Finegan (2004:418) argues that writing is

the single most important invention in human history. Writing is a skill which requires

organization of ideas to be communicated in a text. Indeed, writing entails many complex

components such as grammar, spelling, vocabulary, mechanics more importantly its unity,

coherence and cohesion.

207

FLLT 2011 Proceedings

Many people find it difficult to write for many reasons. Even though there are many factors to

consider, the skill of writing is a skill which can be learned. It just takes study and practice to

develop writing skills. It is well accepted both in theory and practice that the best way to learn

to write is by doing the writing as argued by Calkins (1986) in Peregoy and Boyle (1993:182)

that writing is another powerful strategy that promotes discovery, comprehension, and

retention of information. It is true that one‘s success in learning a language can be measured

through his or her writing.

It is obvious that writing includes a complex process which allows writers to explore ideas

and thoughts and make them visible and concrete to readers. Raimes (1983:10) states, ―

recently the teaching of writing has begun to move away from a concentration on the written

product to an emphasis on the process writing.‖ During the writing process writers rewrite

and revise their sentences until they are satisfied that they have expressed their meaning

(Byrne, 1998:3). It implies that the teacher trainees pass through several developmental

writing stages to produce a good final piece of writing.

Furthermore, Oshima and Hogue (1999:3) mention that there are four main stages in the

writing process: prewriting, planning, writing and revising drafts, and writing the final copy.

There are various features that a writer needs to consider in producing a piece of writing. In

writing process, time is a crucial element in which the writers should have time to make

decision, play around with ideas, time to construct sentences, and time to change their minds

(Raimes, 1983:21). It is obviously clear that writing is just like working in a project which

considers everything in detail.

Essays consist of more than one paragraph. Complete essays contain three major parts namely

an introduction, a body, and a conclusion (Leki, 1995; Oshima, 1999; Leonhard, 2002).

1. The introductory paragraph attracts the reader‘s attention and informs the reader what

the main topic of discussion will be. An introductory paragraph has two parts;

a. Several general sentences that give background information on the subject and

gradually lead the reader into a specific topic.

b. A thesis statement that states the subdivisions (topics of each paragraph). It may

also indicate the method of development.

2. The body of an essay discusses the subdivided topics one by one. It contains as many

paragraphs as necessary to explain the controlling ideas in the thesis statement.

3. The concluding paragraph reminds the reader of what you have said. Remember to use

a ―conclusion‖ transition signal. The concluding paragraph has a summary of the main

ideas of a restatement of the thesis in different words and a final comment on the

topic.

An introduction has two parts: general statements and the thesis statements. An introductory

paragraph of an essay begins with an attention to get readers‘ interests. This is called kinds of

support for writing such as a fact, quotation, definition, question, or background information.

The introductory paragraph also includes a thesis statement usually at the end. The next part is

the body of an essay which is built up in the form of a series of paragraphs which all

contribute to establishing the writer‘s purpose. The last part is a concluding paragraph. It

restates the main ideas of the essay. A good conclusion gives the reader a feeling of

completion and leads the reader away from the essay.

208

FLLT 2011 Proceedings

Writing an essay is more complex than a paragraph because writers are working with

paragraphs. Those who write an essay should pay attention to the elements of writing an

essay. Building up the overall structure through paragraphs which have clearly defined main

points is a requirement of successful essays. Furthermore, in writing an essay the writer

focuses on achieving a purpose, organizing and developing ideas logically, using details to

support or illustrate ideas, demonstrating syntactic and lexical variety, and engaging in the

process of multiple drafts to achieve a final product (Brown, 2004:220).

Since scientific writing becomes an important requirement of promoting teachers‘ position in

their school life, the English teachers entail such a training model of generating their

motivation to write academically. The teachers have been teaching English for years without

taking care of their writing ability. How can they arouse their students‘ motivation in writing

if they cannot write themselves. Based on the preliminary study conducted a few months ago,

it was found that most teachers could not write academically. They confirmed that they wrote

their major papers (thesis) for accomplishing their undergraduate program to be teachers;

nevertheless, they confessed it was difficult to write.

Indonesian government through the National Education Ministry has implemented a huge

program, Teacher Profession Training and Education (TPTE), to certificate teachers of all

education levels since 2007. Specifically, English teachers are provided with the following

subject matters: 1) teacher professionalism, 2) models of teaching, assessment, teaching

media, and lesson plan, 3) English enrichment, 4) peer teaching practice, and 5) classroom

action research and scientific writing.

TPTE is a nine day training that functions to train teachers to be professional ones. The very

short training with six hours allocated for writing session often made the trainers become

disappointed since the majority of the teacher trainees failed to write, even only a single

paragraph. This condition motivated the writer to discover a simple way to train them within

the six hours. The short-term training model is called A Funnel from Paragraph to Essay

Short-term Training Model. Consequently, this paper focuses on the scientific writing

conducted by the teacher trainees by writing academically and collaborating among them in

order to get improvement from the peer comments. Method

The sample of the study consisted of 33 teachers from 32 senior high schools from some

regencies of the province of South Sumatra Indonesia. The research instruments used were

written tests that consist of writing test, paragraph writing, and essay writing and

questionnaire. The writing tests were administered before and after treatment, while the

questionnaire was given after the whole tests. Since it was a pre-experimental research, it used

one group pretest- posttest design that was measured before and after being exposed to a

treatment of some sort. To score the teacher trainees‘ writing, a rating scale presented by Hill

(2008:292) was used.

Meanwhile, for the treatment, the steps of writing training were as follows: (1) ask the teacher

trainees to write a paragraph under different topics, (2) ask the teacher trainees to answer 10

questions dealing with their writing knowledge, (3) ask the teacher trainees to rewrite their

previous paragraph after they have understood the answers of the ten questions, (4) ask the

teacher trainees to write their paragraph based on the paragraph model given if they still found

that writing was difficult, (5) ask the teacher trainees to proofread their peers‘ paragraph

guided by the trainer, (6) ask the teacher trainees to revise their paragraphs, (7) ask the teacher

trainees to pay attention to the explanation about essay, (8) ask the teacher trainees to develop

209

FLLT 2011 Proceedings

their paragraphs into essays, (9) ask the teacher trainees to do collaborative writing, and (10)

ask the teacher trainees to revise their essays.

Findings and Discussion

The data in this study refer to development of writing from a single paragraph to an essay and

the teachers‘ perception toward the short-term training model.

A Funnel from Paragraph to Essay

This training conducted for six hours brought a satisfactory result in which the senior high

school teachers ultimately were motivated to write. At the first thirty minutes, the teachers

showed uncomfortable face due to the first assignment to do, to write a free topic in five up to

10 sentences in good paragraph writing. The result of their first writing after taking long time

avoiding writing scientifically was not so bad. The average score of paragraph writing in

pretest was 58.1. After being given a test of writing knowledge and discussing the answer of

the ten items, the teacher trainees revised their first writing. Nevertheless, the revised drafts

were still poor although there were some improvements, especially in devising some essential

transition signals such as furthermore, for example, and in conclusion. Therefore, the trainer

showed them a model writing. They just imitated the paragraph entitled Gold taken from

Oshima and Hogue (1999). While imitating, the trainer elaborated the parts of a good

paragraph, that is topic sentence, supporting sentences, and concluding sentence and also

reminded them the other two important elements of a good paragraph, coherence and unity.

At the third hour, the teachers could identify and understand how to write a good paragraph.

The average score gained by the teachers was 79 with 85 as the highest score and 73 as the

lowest score in the posttest of paragraph writing.

The histogram below shows the development even the improvement of paragraph writing.

Paragraph writing

0

10

20

30

40

50

60

70

80

90

pretest

posttest

Column1

To identify the improvement of paragraph writing, the writer exemplifies a paragraph written

by Syafaruddin, one of the teacher trainees, before and after the short-term training model.

The influence of technology has important role on children’s mindset. Why?

The one way for children learning something is by using their eyes. They can

learn easily by watching television or other technology tools. Based on this

210

FLLT 2011 Proceedings

fact many scientists do a scientific research to know how far the influence of

technology and its effect.

From the first draft, it can be seen that the topic sentence is not correct even though it consists

of the topic and controlling idea, the supporting sentences do not really support the topic

sentence, the conclusion sentence does not restate specifically the topic sentence, and the

other two important elements of a good paragraph, coherence and unity, have not been used in

it. As argued by Finegan (2004:418), many complex components such as grammar, spelling,

vocabulary are necessitated in writing, and so do its unity, coherence and cohesion.

After working on a test of writing knowledge, all the teacher trainees revised and rewrote

their previous paragraphs. The following is also Syafaruddin‘s.

Technology, a part of human life, has two kinds of influences on children’s

mindset. First, technology can be as a good media for children to develop and

increase their knowledge, because one of good ways to educate children is by

using technology. For example, internet can help and make children find out

information and knowledge in everywhere. Another influence, it is a dangerous

media for children character since it can make the children have negative

thinking and action. For example, watching violent films on television can

make the children be dangerous for other. So, to avoid the bed effects of

technology, the children must know about it. In conclusion, technology can be

good media to get knowledge and can be bad to children’s character.

This second draft paragraph seems better. It is influenced by the discussion on the test of

writing knowledge given after the teacher wrote their first draft. In the draft, it can be seen

that the topic sentence consists of the topic itself (technology) and controlling ideas (two

influences), the supporting sentences really support the topic sentence with some transition

signals, and the concluding sentence, indeed, summarizes the supporting sentences. Due to the

complete and correct format applied in it, it can be categorized as a good paragraph.

Furthermore, the trainer explained how to develop the paragraph to be an essay. The

following figure is the result of pretest and posttest of the teachers‘ essay. Similar to the

previous paragraph, there is a significant difference of essay writing between pretest (the

average score is 58.6) and posttest (the average score is 78.9). It is obvious that the

improvement of their writing from paragraph to essay is quite good by examining the score

for paragraph is 79 and essay is 78.9. It is relevant to the statement of Raimes (1983:10), ―…

to an emphasis on the process writing.‖ Similarly, Byrne (1998:3) insists that writers rewrite

and revise their sentences in the process of writing through several developmental writing

stages until they can express their ideas satisfactorily. Meanwhile, the improvement from

pretest (the blue color) to posttest (the red color) in essay writing can be obviously seen in the

following figure.

211

FLLT 2011 Proceedings

Essay Writing

0

10

20

30

40

50

60

70

80

90

Series 1

Series 2

Column1

In order to see the development from a paragraph to an essay, the following is taken from the

same teacher trainee‘s.

Technology, a part of human life, has two kinds of influences on children’s

mindset. Based on Raihan (2006:7), “Technology is a tool that can be the most

important thing for children.” This essay will elaborate two influences of

technology on children’s mindset, good and bad influences.

First of all, technology can be seen as a good media for children to develop

and increase their knowledge because of good ways to educate children is by

using technology. For example, internet can help and make children find out

information and knowledge in everywhere. Nowadays, many schools in

Indonesia use internet to increase the quality of teaching learning process

especially for student, teacher, and school quality because internet is the

easiest and fastest way to find out many information and knowledge.

Another influence is that it is a dangerous media for children’s character since

it can make the children have negative thinking and action. For example,

watching violence films too much can make the children dangerous for other.

So, to avoid the bad effect of technology, the children must know about it.

According to Arrasyid (2006:13) in his article, ”There are 29 problems faced

by children in a month because of their bad habits on watching video.” It is

the responsibility of all parents and teachers to guide the children in using

technology.

In conclusion, using the technology for its advantages only and avoid the bad

influence one by telling which one is important and which one is dangerous for

children and everyone.

This essay is not successful in closing the last paragraph. The teacher did not restate correctly

what he has discussed in it.

Teacher Trainees’ Perception toward the Short-term Training Model

In order to know the participants‘ point of view toward the short-term training model of

writing, the thirty-three teacher trainees were asked to respond to 14 questions. The following

212

FLLT 2011 Proceedings

is the result of their responses to the questionnaire distributed. First of all, the teacher trainees

stated that they never wrote scientific paper beside their undergraduate papers. They have

known kinds of text such as narrative, recount, descriptive, and procedure text, but there was

only one teacher that had an experience of writing narrative and descriptive texts. Those who

answered never wrote such texts could identify the characteristics of the texts.

Furthermore, they were asked to comment on their own paragraph writing after three hours of

training. Only 2 (6%) out of 33 said that their paragraphs were bad. Others, 15% is good

enough and 79% is good. One of those whose writing was good cited that structurally her

paragraph was good as it followed the rule or the format of writing, but the quality of diction

was still poor. The following figure shows the participants‘ comment toward their writing at

the first three hours of training.

The Result of Writing

bad= 6%

good enough=15%

good=79%

After being explained, all the participants could identify the parts of a good paragraph.

Unfortunately, there were 28 (85%) teachers who cited that they found it difficult to develop

supporting sentences since getting idea is so difficult, developing sentences is not easy, and

connecting one sentence to other sentences is hard to do. Nevertheless, 100% expressed that

the short-term training model was worthy because it was important for teachers to know how

to write. It also motivated them to write academically. And since the writing material was

understandable, it could inspire the teachers to write an essay. Furthermore, it was valuable

because some teachers did not know the system of good writing, and it opened their minds

that writing was not difficult after they had known the procedure of writing. This is supported

by Brown (2004) that successful essays depend on building up the overall structure through

paragraphs which have clearly defined main points.

After knowing how to write a paragraph well, the trainer taught them how to write an essay

by developing their previous paragraph, the teachers said that they could understand it but

they still found it difficult to write the conclusion (35%). The teachers actually had to restate

the ideas that they have discussed in the supporting paragraphs (Oshima and Hogue, 1999).

It is interesting that 100% agreed that writing an essay by developing similar paragraph was

easily understood. Consequently, they found it easy to write a piece of essay by the help of

paragraph they composed before.

Since the participants were provided with a module of language skills, they had read before

the training began. It was a pity that they could not understand the material well. Therefore,

all the teachers insisted that the instructor‘s explanation was easier to understand than the

213

FLLT 2011 Proceedings

material being read because she could explain well and their techniques of writing were

initially poor. However, there was 6% (2 teachers) who claimed that their ability in writing

was still poor after attending the short-term training. It is indicated in the following figure.

good= 80%

good enough= 10%

bad= 6%

very good= 4%

The Teachers’ Opinion to Their Essays

The last question posed in the questionnaire was to figure out their opinion to the

instructor‘s technique of training the teachers in writing scientifically. Ninety-six teachers

were interested in the way she presented the writing material since she explained in details the

parts of the essay that were difficult to understand, and guided them step by step. Besides, she

also checked and asked them to revise their essays.

Conclusion

Based on the findings above, it can be inferred that the teachers could ultimately write a good

paragraph as well as good essay even though some of them still found it difficult to develop

supporting sentences in an essay. Due to the limited time, the teachers‘ writing showed only a

little progress; however, it can be concluded that A Funnel from Paragraph to Essay Short-

term Training Model is effective to develop the teachers‘ ability in both writing paragraph and

essay. The effectiveness of the model is also strengthened by the teachers‘ perception toward

the model implemented that they have positive perception to the model of writing being

trained.

REFERENCES

Brown.H.Douglas. 2004. Language Assessment: Principles and Classroom Practices. White

Plains, NY: Pearson Education, Inc.

Budiharso, Teguh. (2006). The Rhetoric Features of English and Indonesian Essays Made by

EFL Undergraduate Students. TEFLIN: Teaching English as Aa Foreign Language in

Indonesia Journal. 17, 54-86.

Byrne, Don. 1998. Teaching Writing Skills. Essex: Addison Wesley Longman Ltd.

Finegan, Edward. 2004. Language: Its Structure and Use (4th

ed.). Boston, MA: Wadsworth

Thomson Corporation

214

FLLT 2011 Proceedings

Hill, Susan. 2008. Developing Early Literacy Assessment and Teaching. Praharan: Eleanor

Curtain Publishing.

Leki, Ilona. 1995. Academic Writing: Exploring Processes and Strategies ( 2nd

ed.) .New

York, NY: ST Martin‘s Press.

Leonhard, B.Harris. 2002. Discoveries in Academic Writing. Boston, MA: Heinle&Heinle

Thomson Learning, Inc.

Oshima, Alice & Ann Hogue. 1999. Writing Academic English (3rd

ed.). New York, NY:

Adison-Wesley Longman.

Peregoy,S.F. and O.F.Boyle. 1993. Reading, Writing & Learning in ESL. New York,

NY:Longman.

Raimes, Ann. 1983. Techniques in Teaching Writing. Oxford: Oxford University Press.

215

FLLT 2011 Proceedings

Simplified Literature in Language Teacher Education

Liesel Hermes

Karlsruhe University of Education, Germany

[email protected]

Abstract

Language teacher education comprises the fields of literature, applied linguistics and area

studies which are all related to the methodology of teaching English as a foreign language.

Literary texts are particularly suitable for language learners because they give insights into

different cultures and offer themselves for meaningful communication. However, they are

often linguistically too demanding. Publishers therefore offer adapted literary texts, which

should be introduced to future language teachers with a view to making them aware of the

challenges of using simplified literary texts in class. Students should learn to analyse literary

originals and simplified versions both from the standpoints of literary criticism and linguistics

with the aim of developing objective criteria for adaptations, to assess their literary as well as

linguistic merits and their value in class. On the basis of a set of criteria students they can

learn to simplify literary texts on their own.

1. Introduction

David Hill, the director of the Edinburgh Project on Extensive Reading, once complained:

"There is virtually no training of teachers in the rationale and implementation of extensive

reading programmes." (Hill, 2001:312) Since I felt he had a point I devised a course for

language teacher students which aimed to bridge the objectives of literary criticism with those

of applied linguistics and teaching literature. The course included the following components:

information about graded readers series,

analysis of the linguistic and content criteria of different series,

theoretical foundation of text adaptation,

discussion of the concept of authenticity in language learning,

original short stories and comparison with simplified versions,

development of a model set of criteria for the adaptation of texts,

simplification of an original short story.

2. Graded Readers

Graded readers serve a world-wide market of English-language learners. Therefore they come

with a practically infinite variety of themes, and they include titles originally written for the

series and adaptations of original novels, short stories and film scripts. The range of linguistic

levels and wide variety of themes enable teachers to include them in heterogeneous classes

over a longer period of time. A critical overview should include the following criteria:

Number of levels/stages

Linguistic level: vocabulary, grammar and style

Fiction/non-fiction

Tasks and Activities

Media (CDs or DVDs)

216

FLLT 2011 Proceedings

Simple originals and adaptations

The students familiarize themselves with different series on the market. Almost all of them

contain simple originals, i. e. novels that have been specially written for the series, and

simplified texts, i. e. adaptations of literary originals, often classical authors like Shakespeare,

Austen, Dickens, Brontës, London, Mark Twain and others. However, their quality varies

considerably, and students have to learn not to trust any adaptation, but to develop criteria to

assess the quality of the texts and the linguistic level, to analyse the tasks and activities.

Furthermore they have to listen to the CDs or look at the DVDs and judge their respective

merits. Last but not least they have to assess their suitability for use in class at different levels.

This includes the literary and linguistic quality as well as the methodological potential.

3. Text adaptation

Since there is no coherent theory of text adaptation the students should become familiar with

the most important studies published that deal with aspects of text adaptation and thus learn

about the wide variety of possibilities to simplify a text.

Adaptations come under the general heading of ―language learner literature‖ (Day &

Bamford, 1998:63ff.) that is meant to help adolescents find an approach to literary texts and

read with pleasure. Adapting a literary text means in general shortening and changing it in

order to simplify it. The process of alteration has been called ―adapt, abridge, reduce, retell,

rewrite, simplify‖ (Simensen, 1987:43) or ―modify‖ (Aebersold & Field, 1997:48), which

indicates that different operations are possible. Text adaptations can be analysed and

evaluated objectively (Hermes, 2008:277). One should differentiate control of discourse and

structure, of information and of language (Simensen, 1987:45 ff.).

Control of discourse and structure. The adaptation of novel-length texts requires major

modifications as to the linguistic level and the length, since a certain number of pages usually

goes together with a certain level in the series. Thus whole chapters may be deleted or

summarized, which means a change in structure. In most cases the chapters in the original are

summarized, and new chapters are created which overlap with the chapters of the original,

which means change in structure, sometimes significantly so (Hermes, 2009:248 ff.).

Control of information refers to descriptions or details, the number of characters or subplots,

which may be considered unessential. If on the one hand details are deleted, information may

on the other hand be added, which is called elaboration. This holds true e.g. for cultural

information. When adapters feel that some information which is essential to the text may not

be understood by foreign language learners, they may feel the need to add a detail in order to

bring an idea home to the readership. However, cultural information may also be suppressed

or changed into neutrality, e.g. when a brand of automobile is rendered as "car".

Shortening a long novel may result in very dense information, even if some minor characters

are entirely deleted, the effect being a plot with a lot of action in dense sequence which does

not necessarily make reading easier. This may hold true e.g. for Dickens' novels, which

always contain a vast number of characters. Therefore control of information may concern

plot, characters, details as well as cultural phenomena.

Control of language refers to linguistic changes of the original text (detailed list in Simensen,

1987:50-52). It affects lexis, grammar, idioms, register and style. Thus, difficult words are

217

FLLT 2011 Proceedings

deleted or exchanged for easier ones. Choice of tenses can be restricted. Hypotactical sentence

structures can be avoided by splitting the sentences up. Idiomatic expressions make literary

language very lively, but may be difficult and are often deleted or exchanged for neutral

phrases. Authors sometimes use "ungrammatical" English or ―incorrect‖ spelling with the aim

of conveying the social background of a character. Both are difficult for the language learner,

and therefore the register is often neutralized to Standard English.

Adapters often have the choice between substitution and deletion. Deletion is invariably used

in lengthy descriptive paragraphs. Substitution is used when a rare word can be exchanged for

a more frequent one.

In sum, adapting a novel always means summarizing and retelling the story. However, good

adaptations will maintain the key scenes and sometimes even the flavour of the original style.

Adapting a short story results in the more or less subtle linguistic changes which I have just

described.

4. Authenticity

A course on the analysis of simplified literature has to deal with the concept of ―authenticity‖,

which is highly controversial when one looks into the literature (Hermes, 2007). In a lot of

studies the question is raised whether simplified texts are authentic and if not, if that detracts

from their suitability for use in EFL classes. Aebersold & Field define: "Authentic materials

are taken directly from L1 sources and are not changed in any way before they are used in the

classroom." (Aebersold & Field, 1997:48, bold type in the original) This definition makes

sense if one has only the text itself in mind, and consequently simplified texts would not be

authentic. Catherine Wallace argues: ―As soon as texts, whatever their original use, are

brought into classrooms for pedagogical purposes they have, arguably, lost authenticity.‖

(Wallace, 1992:79) Strangely enough that would mean that originals like newspaper articles

or novels would lose their authenticity as soon as they are used in EFL classrooms and

become vehicles for learning the foreign language. By the same token, coursebook texts,

which were written especially for EFL learners and are consequently carefully graded, would

be originals since they are put to their original use, i. e. language learning. This does not seem

to lead us anywhere.

One should rather look at what is being done with a text in class, i. e. at the interaction

between text and learners. This aspect, authenticity of situation, may be far more important. A

text may be read for language learning purposes or for pleasure. Narratives in L2 can be read

for pleasure if they are entertaining and easy to read. The situation in the L2 context is then

similar to the L1 situation, when young people read fiction for their pastime. This notion of

authenticity in language learning needs the language teachers' attention. It is especially

simplified literature that should provide opportunities to read for pleasure and relaxation, of

course with the idea at the back of the teacher‘s mind that incidental language learning occurs.

Insofar the texts may acquire authenticity, although the originals have been modified. The

interaction between readers and text and the purpose of reading are authentic.

Learners may not be too thrilled by the mere notion of authenticity, or be highly motivated by

the prospect of being exposed to an ―authentic‖ text. Some learners‘ motivation may even

fade if an authentic text proves to be too difficult at the linguistic level, but may be kindled by

218

FLLT 2011 Proceedings

an "unauthentic" text which contains interesting topics and which they find worthwhile

reading because of the language level.

This line of argumentation is in keeping with Day and Bamford who doubt "the widely held

assumption that authentic (real-life) materials should be used in language teaching" (1998:53)

and question its validity, especially the view that difficult authentic texts are "worthwhile as

learning tools" (ibid.:54). They argue that on the contrary difficult texts can impede foreign

language learning and reading. Anyone who has experienced the extent to which the frequent

use of a dictionary slows down reading speed and impedes understanding, will look for texts

that are manageable and are read for the message without undue concern for the language (cf.

Day & Bamford, 1998:55). In other words, original literature that comes in a heavily

annotated edition, will not arouse in the students the feeling that they are reading authentic

literature, but rather the anxiety that they will have to cope with a difficult text, because the

reading process is constantly interrupted by the eyes moving to and fro between text and

annotations.

Future language teachers should learn to deal critically with the controversial concept of

authenticity, to find and to defend their own position. My students‘ outcome of the discussion

was that language teachers should worry less about real or alleged authenticity but rather

about the appropriate linguistic level, fascination of topics and the motivational potential of

texts they choose for a class.

5. Analysis of original short stories and simplified versions

There is a huge supply of adaptations of classical novels on the market, with some classics

existing in up to five different versions. However, for detailed text analysis within the time

constraints of a semester course, they are not ideal, because any analysis requires a detailed

knowledge of the original text, which would be hard to demand of students with novels by

Dickens or Austen. In the framework of a university course, short stories are better suited for

the purpose mentioned, because they are short enough to allow intensive reading of the

original and the adaptation and allow an equally intensive comparison. Thus the students,

after discussing the theoretical underpinnings of text adaptation, learn to analyse original

short stories and their simple counterparts (literary criticism), to analyse and evaluate the

changes made (linguistic, content, and cultural changes) and to assess the overall quality of

the simple version as well as its suitability for the EFL classroom. The process is one of

awareness raising as far as the literary merit as well as the ―teachability‖ of a literary text

goes, with cultural information and its treatment in the simplified version posing particularly

delicate problems. The process of analysing and comparing various short stories can lead in

an inductive process to a set of criteria for assessing the quality of the adaptation:

Control of information:

Length in comparison with original

Deletions

Substitutions

Cultural aspects

Consistency or inconsistency of alterations

Control of structure:

Differences in structure

Plot

219

FLLT 2011 Proceedings

Characters

Elaborations

Control of language:

Deletions

Substitutions

Summary of paragraph (= shortening)

Change of wording of sentence

Lexis

Idioms

Grammar

Syntax

Overall style

Neutralisation of cultural information

Neutralisation of register in direct speech

Comparison and Evaluation:

How much and what of the original text has been maintained?

Is the adapted text abridged, simplified or retold?

Effect of the adapted version on the reader

Overall quality of the adaptation (Hermes, 2008:277)

6. Experiential learning: simplifying a short story

In order to make the students aware of the difficulty of creating a good text adaptation, they

were asked to simplify a short story themselves. I chose a fairly easy story from an American

anthology for young adult readers: No easy answers: short stories about teenagers making

tough choices. ―I‘ve Got Gloria‖ is about a teenage boy who failed his math exam at school

and tries to take revenge on his math teacher by pretending to have kidnapped her dog and

phoning the teacher to demand a ransom. In the end she is willing to help the boy in a

remedial math summer course. The story deals with a common teenager topic: dislike of a

school subject and projection of the aversion on the teacher. At the same time the boy feels

that he is not understood by either teacher or parents. The plot structure is very simple. It

covers no more than one afternoon and is mainly in dialogues. This structure makes it very

vivid and – superficially - fairly easy to read.

However there are a few caveats: the dialogues are full of colloquialisms. Moreover, the

setting is American. The students agreed unanimously that the story would be appropriate for

pupils in their 4th

year of learning English in secondary school. They then worked together in

pairs and adapted the text. Pair work gives students a chance to discuss their own reading of

the story, agree on each modification they are about to make and justify it. It is thus a highly

interactive process and lends itself to reflexion on the activity they are engaging in. The

results were then discussed in a plenary and the decision making process of the respective

pairs was analysed. The following decisions were agreed on:

A text cannot be simplified without agreement on a specific language level and a

certain group of pupils in mind.

220

FLLT 2011 Proceedings

Partners have to agree on the teaching objectives they wish to achieve, whether it is

the fluent reading of an easy story or rather reading a literary text that still reflects the

original.

It seems hard to be consistent with the American setting, since pupils in Germany start

learning British English and may not have the relevant background knowledge for this

story, which means that cultural information may have to be neutralized (cf. Hermes

2010).

To maintain consistency throughout the process of simplification is a daunting task, which

concerns maintaining a word or phrase, substituting it or deleting it throughout. When

working on the text the students felt they had to go back and forth and check on previous

pages. The colloquial language level in the original sounds convincing and authentic, but may

be too difficult in places and has to be changed to more standard language, which detracts

from the authenticity of the dialogues. The students agreed on annotating ―flunk, remedial

math, Yellowstone‖, since these were essential to the story and should not be paraphrased.

The discussion of the pairs‘ respective text adaptations yielded the following results:

Simplifying a text is a time-consuming process, in which each decision has to be justified to

lead to a high-quality adaptation. The comparable brevity of the text meant that not much

shortening was necessary.

Adjectives like ―anxious, valuable, petty‖ were found to be important, but not easy to

paraphrase, and all students wished to avoid annotations to ensure a certain reading speed.

To sum up: The overall experience was a very positive one. The students had become aware

of the chances and pitfalls of simplifying a text and learnt that it is not only hard work that

presupposes a high language level and cultural knowledge, but that it also requires an

instinctive feel for language use. Consistency is an important objective that is hard to attain

even if the text is comparatively short.

7. Conclusion

A course like the one described combines elements of literary criticism, applied linguistics,

cultural studies and methods of teaching literary texts. The students become aware of the

richness of literary texts in language learning and of the didactic potential of good text

adaptations for teaching reading in a foreign language. And they learn in an experiential

process what is required to simplify a literary text without detracting too much from its

quality to make it manageable for language students.

221

FLLT 2011 Proceedings

8. References

Aebersold, Jo Ann, & Mary Lee Field (1997). From Reader to Reading Teacher. Cambridge:

Cambridge University Press.

Day, Richard R., & Julian Bamford (1998). Extensive Reading in the Second Language

Classroom. Cambridge: Cambridge University Press.

Hermes, Liesel (2008). Original und Bearbeitung: Literarische Texte in der

Fremdsprachenlehrerausbildung. Fremdsprachen Lehren und Lernen, 37, 268-282.

Hermes, Liesel (2009a). Literature and the teaching of literature in teacher education. IATEFL

Young Learners and Teenagers, I, 26-28.

Hermes, Liesel (2009b). An Analysis of a Graded Readers Adaptation of Katherine

Mansfield's 'The Doll's House'. IATEFL Literature, Media and Cultural Studies, 35,

12-14.

Hermes, Liesel (2010). Simplifying a Literary Text: A Challenging Task for Student

Teachers. IATEFL Literature, Media and Cultural Studies, 37, 9-11.

Hill, David R. (2008). Graded Readers in English. English Language Teaching Journal, 62/2,

184-204.

Kerr, E.M. (1997). I've Got Gloria. In Donald R. Gallo (Ed.), No Easy Answers: Short Stories

about Teenagers Making Tough Choices (pp.67-76). New York: Delacorte Press.

Wallace, Catherine (1992). Reading. Oxford: Oxford University Press.

About the Author

Liesel Hermes Professor of English and President of the University of Education, Karlsruhe, Germany; 40

years experience in teacher education; fields of research and publications in contemporary

English and Australian literature (mostly women writers), intercultural education, theory and

practice of teaching English as a foreign language, Action Research, learner autonomy in

tertiary education, theory and practice of group work; development of materials for learning

English and editor of literature anthologies for advanced learners of English; member of

various international associations.

222

FLLT 2011 Proceedings

Test Taker Feedback on the Appropriateness of a Reading Test*

Sutilak Meeampol

Language Institute, Bangkok University

[email protected]

Abstract

This small scale pilot study aimed at obtaining feedback from test takers during a pre-testing

of a reading test before the main study that investigates the effects of text structure

instruction. A retrospective questionnaire survey was given to sixty-one Bangkok University

EFL students in order to elicit how they perceived the appropriateness of the test features:

content, methods or tasks, scoring, and test administration. Overall positive feedback was

found with written comments that yielded lessons valuable for improvement of the test and its

administration. Despite its limitations, this study entailed reviewing theoretical concepts

necessary for a construction of test specifications and presenting a practical way to evaluate

the test‘s face validity by the test takers. *This study is part of the main study entitled "Feedback on a Reading Test: A Pilot Study"

Introduction

Language tests play an important role in second language research. They function as tools for

collecting language data in order to answer research questions or test hypotheses (Shohamy,

1994, p. 133). As such, tests involve people who take part in research, mainly the test takers

and the researcher, whose role is assumed here to also be the tester. It is the part of the test

takers that this paper focuses on, as their feedback or responses are important to the

researcher-tester in a successful use of a test meant to be used in the main study that aims to

investigate the effects of a reading instruction given to a target group of EFL students at

Bangkok University. In the main study, the text structure approach to reading is what

underlies aspects of instruction and assessment. A reading test is one of the tools used for the

investigation. This paper particularly presents a pilot of the reading test, which was field

tested before the actual test use in order to obtain an immediate, retrospective feedback from a

group of potential students taking the test. The overall feedback was hoped to reflect how

they perceived the appropriateness of the test and its features: content, methods or tasks,

scoring, and administration.

Overview of the Reading Test

1. Test Content

Test content is ―what the test is about‖ and its quality ―depends on whether the content is a

good sample of the relevant subject matter‖ (Genesee and Upshur, 1996, p. 142). What

makes up the test content are text passages and questions of the test. The characteristics of

the input or texts include texts‘ topics, patterns, and difficulty level and length. Topics are the

content of texts that should be controlled on the grounds that they are unbiased and suitable

for a test of reading. In the present study, expository text passages used as the test content are

categorized as collection or lists, causation or cause and effect, problem-solution, compare

and contrast, and description or attribution (Meyer and Poon, 2001, p. 143). Selecting

appropriate reading materials for a test basically involves examining if texts are of an

223

FLLT 2011 Proceedings

appropriate level of difficulty and length. Estimating the appropriateness of texts in terms of

difficulty level could be accomplished by employing both readability formulas and experts‘

judgments. In writing the test, attention should also be paid to minimizing factors that could

cause inappropriateness of questions/answers used to elicit answers from the test takers.

―Common problems‖ should be avoided (Henning, 1987, p. 43). Questions/answers should be

the means to assess what meant to be tested in the test.

2. Test Methods

Test method is ―the kinds of tasks that test takers are asked to perform,‖ and test methods

―give form to test content‖ (Genesee and Upshur, 1996, pp. 142-143). Test tasks can be either

―discrete-point tasks‖ that focus on ―isolated bits of information,‖ such as multiple-choice

questions, or ―integrative tasks‖ that focus on ―several features combined to convey the

meaning,‖ such as summaries (Riley and Lee, 1996, p. 173). Alderson (2005) suggested that

it is up to the tester to determine the tasks or methods of test content and that which forms or

tasks to be used depends upon ―levels of understanding of the content to be investigated‖ (p.

118).

3. Test Scoring

Test scoring is another important feature of a test. It directly relates to the test reliability, and

thus it can increase or decrease the appropriateness of tests. It is well understood that ―test

items that can be objectively scored yield more reliable scores than do items that require more

subjective judgment in their scoring‖ (Genesee and Upshur, 1996, p. 199). For summary

writing in particular, scoring is a major concern as it is an attribute for appropriateness of the

test that employs such method or task. Henning (1987) suggested ways to minimize the

subjectivity of scoring written answers, such as ―insisting on rater competence or expertise,‖

and ―employing multiple independent raters‖ (p. 34).

4. Test administration

Test administration could be considered what completes language testing. Its importance is

confirmed by Hughes (1994) who remarked that even ―the best test may yield the results that

are unreliable and invalid results if it is not well administered‖ (p. 152). Factors such as test

materials and equipment, examiners, proctors, and rooms for the tests should be carefully

prepared in advance, and the administration of the test should be well operated (pp. 152-154).

These problems must be prevented because they can affect the reliability of the test and thus

minimize its appropriateness.

Importance of the Pilot Study and Test Taker Feedback

Test taker feedback can be important information from a pilot study. It is ―reactions to and

opinions about tests,‖ and feedback obtained during the test trial is valuable in terms of ―its

use in the test revision stage‖ and ―the light it may shed on the acceptability and fairness of

the test from the test-takers‘ point of view‖ (Brown and McNamara, 1992, p. 67). Also, it is

important for a test to ―achieve widespread acceptance by potential users‖ and it ―should

therefore be investigated as part of the test development process‖ (p. 69). Despite the fact that

the feedback per se may be insufficient, ―lessons‖ learned from it can be an important source

of information for researcher-testers in improving their tests prior to the actual use.

224

FLLT 2011 Proceedings

Objectives and Research Questions

The purpose of this pilot study is, therefore, to receive the test taker feedback on the test in

terms of the appropriateness of its content, method, and scoring, as well as its administration.

In this regard, the feature of reading constructs was considered what embedded in the test

content, method, and scoring. As such, this study addresses the questions as follows:

Research Question 1: What is the test takers’ feedback on the test content?

Research Question 2: What is the test takers’ feedback on the test scoring?

Research Question 3: What is the test takers’ feedback on the test methods?

Research Question 4: What is the test takers’ feedback on the test administration?

Method

1. The Pilot Study

To find out the answers to the research questions mentioned above, survey research seemed

suitable, as surveys are ―methods of collecting information from individuals and the preferred

means to address a research question when it is most efficient to simply ask those who can

inform the question‖ (Baumann and Bason, 2004, p. 288).

2. Participants

The pilot study of the reading test took place during the 2009 summer semester with 61

second-year students randomly selected as participants (n = 61) from students taking the

Advanced English course at the time. They are of 18-19 years old, and their English

proficiency as determined by their reported grades of English are of average.

3. Instruments

There were two instruments: the Reading Test and the Student Survey. The reading test used

for pre-testing in this pilot study consists of two parts, Part A (multiple-choice) and Part B

(summary writing), and it aims to assess students‘ reading comprehension ability both before

and after the treatment of text structure instruction in the main study. A Thai-translated

version of retrospective questionnaire survey was developed to obtain test takers‘ responses or

feedback on the reading test.

4. Procedures

The test procedure started with the tester informing the test takers in advance about the

coming testing of reading which included what they had to bring to the test room such as a

dictionary. After completing the reading test, the test takers were given the student survey to

answer, and they were allowed to retain the reading test in order to ―assist their memory‖ of

the test features. The data collected from the reading test and the student survey were

undertaken and analyzed, and their results were reported. Please note, however, that the

student survey was the main source of data used to answer the four research questions as

mentioned above.

225

FLLT 2011 Proceedings

Results and Discussion of the Student Survey

Research Question 1: What is the test takers’ feedback on the test content?

Table 1: Test taker feedback on test content Disagree Agree

1 = completely disagree

6 = completely agree

1 2 3 4 5 6 Total

Percentages

(n = 61)

1. The reading content is

not too difficult or too

easy.

3

(4.9%)

11

(18.0%)

10

(16.4%)

27

(44.3%)

9

(14.8%)

1

(1.6%)

Disagreement = 39.3% Agreement = 60.7%

2. The reading content is

familiar.

4

(6.6%)

5

(8.2%)

13

(21.3%)

21

(34.4%)

16

(26.2%)

2

(3.3%)

Disagreement = 36.1%

Agreement = 63.9%

3. The length of the

reading passages is

appropriate.

3

(4.9%)

8

(13.1%)

8

(13.1%)

24

(39.4%)

16

(26.2%)

2

(3.3%)

Disagreement = 31.1%

Agreement = 68.9%

4. The reading content is

relevant to my life.

3

(4.9%)

6

(9.8%)

7

(11.5%)

20

(32.8%)

20

(32.8%)

5

(8.2%)

Disagreement = 26.2% Agreement = 73.8%

5. Each question tests my

reading comprehension.

0

(.0%)

3

(4.9%)

7

(11.5%)

14

(23.0%)

32

(52.4%)

5

(8.2%)

Disagreement = 16.4%

Agreement = 83.7%

6. Each question tests the

reading skills I‘ve learned.

0

(.0%)

0

(.0%)

10

(16.4%)

16

(26.2%)

28

(45.9%)

7

(11.5%)

Disagreement = 16.4%

Agreement = 83.6%

7. Each question is

appropriate to test my

reading skills.

0

(.0%)

3

(4.9%)

9

(14.8%)

19

(31.1%)

27

(44.3%)

3

(4.9%)

Disagreement = 29.7%

Agreement = 80.3%

8. Each question is clear. 0 (.0%)

5 (8.2%)

13 (21.3%)

16 (26.2%)

23 (37.7%)

4 (6.6%)

Disagreement = 29.5%

Agreement = 70.5%

9. Each question is challenging. 1

(1.7%)

3

(5.0%)

10

(16.7%)

12

(20.0%)

19

(31.6%)

15

(25.0%)

Disagreement = 23.4%

Agreement = 76.6%

10. The multiple choices are clear.

3 (4.9%)

4 (6.6%)

11 (18.0%)

23 (37.7%)

16 (26.2%)

4 (6.6%)

Disagreement = 29.5% Agreement = 70.5%

11. The test provides good

multiple choices.

2

(3.3%)

3

(4.9%)

12

(19.7%)

24

(39.3%)

18

(29.5%)

2

(3.3%)

Disagreement = 27.9%

Agreement = 72.1%

The results in Table 1 revealed that, overall, the test content, which consists of the

components of text passages (items 1-4) and questions/answers (items 5-11), received positive

feedback from the test takers. However, when looking closer at the items that related to each

component, it is interesting to know that characteristics (difficulty, familiarity, length, and

content relevance to life) of text passages could still be problematic for the test takers, as

indicated by the results of items 1-4. In spite of overall positive feedback, the results showed

that quite a number of test takers were not at ease with the passages used in the test, and they

disagreed that the passages were not too difficult (item 1, n=24 or 39.3%) and that the reading

content was of familiarity (item 2, n=22 or 36.1%). Also, the length of the passages (item 3)

and their relevance to life (item 4) seemed to be an issue from the point of view of a few test

takers who stated their disagreement on the length appropriateness (item 3, n=19 or 31.1%)

and the relevance of texts to their life (items 4, n=16 or 26.2%). This might be due to factors

that relate to the nature (variables) of both the text passages and the test takers. Text passages

selected as the test content were complicated and unique in nature.

The results also revealed that questions/answers seemed appropriate from the test takers‘

point of view. However, the results based on items 8-11were found to be slightly different

from those of items 5-7 mentioned above. Few test takers seemed to have some doubt about

questions/answers in terms of their quality. It could be said that the negative feedback on

questions/answers would probably be influenced by the problem about their vocabulary

knowledge (e.g. I didn’t understand the questions/answers because I didn’t know the meaning

226

FLLT 2011 Proceedings

of the words.). This assumption was very likely when considering most test takers‘ reported

vocabulary skills as being either poor or moderate and English proficiency as being either

average or below average, though no statistical correlations were attempted.

Research Question 2: What is the test takers’ feedback on the test scoring?

To answer research question 2, results from Table 2 about test taker feedback on the test

scoring were used. The discussion of the results focused on the quality of the scoring and

marking as perceived by the test takers.

Table 2: Test Taker Feedback on the test scoring Disagree Agree

1 = completely disagree

6 = completely agree

1 2 3 4 5 6 Total

Percentages

(n = 61)

12. The marking and

scoring are clear.

0

(.0%)

3

(4.9%)

10

(16.4%)

24

(39.4%)

18

(29.5%)

6

(9.8%)

Disagreement = 21.3%

Agreement = 78.7%

13. The marking and

scoring are fair and the

score results can be trusted.

2

(3.3%)

0

(.0%)

10

(16.3%)

20

(32.8%)

20

(32.8%)

9

(14.8%)

Disagreement = 19.6%

Agreement = 80.4%

Results in Table 2 revealed the positive feedback of the test takers on the marking and scoring

of the test which included both of the multiple-choice questions and written summaries.

Particular interest went to the quality of being clear, fair, and trustworthy. In detail, most test

takers agreed that the marking and scoring were clear (item 12, n=48 or 78.7%), and fair and

trustworthy (item 13, n=49 or 80.4%). For those who felt that they disagreed with the quality

of scoring also gave some interesting comments: I was worried about my scores for

summaries. I wasn’t good at writing, so I didn’t do well on summarizing. / I don’t think it is

fair for me! I always make a lot of grammar mistakes.

In discussing the results that related to the negative feedback, the writer would like to assume

that those who disagreed with the quality of test scoring, which included marking, would

probably missed the information provided by the tester-proctor in the test room about the

scoring.

Research Question 3: What is the test takers’ feedback on the test methods?

Table 3: Test Taker Feedback on the test methods Disagree Agree

1 = completely disagree

6 = completely agree

1 2 3 4 5 6 Total

Percentages

(n = 61)

14. Testing reading

comprehension needs

various forms of tests.

1

(1.6%)

1

(1.6%)

7

(11.5%)

17

(27.9%)

22

(36.1%)

13

(21.3%)

Disagreement = 14.7%

Agreement = 85.3%

15. Summarizing the

reading is appropriate to test

reading comprehension.

0

(.0%)

1

(1.6%)

7

(11.5%)

22

(36.1%)

21

(34.4%)

10

(16.4%)

Disagreement = 13.1%

Agreement = 86.9%

16. Questions with multiple

choices to choose from are

appropriate to test reading

comprehension.

0

(.0%)

4

(6.5%)

7

(11.5%)

19

(31.1%)

27

(44.3%)

4

(6.6%)

Disagreement = 18% Agreement = 82%

17. The multiple choice

format is fair to test takers.

0

(.0%)

3

(4.9%)

13

(21.3%)

14

(23.0%)

23

(37.7%)

8

(13.1%)

Disagreement = 26.2%

Agreement = 73.8%

227

FLLT 2011 Proceedings

18. The summary writing

format is fair to test takers.

1

(1.6%)

3

(4.9%)

11

(18.0%)

16

(26.3%)

25

(41.0%)

5

(8.2%)

Disagreement = 24.5%

Agreement = 75.5%

19. In Part A, the multiple

choice format is familiar to

me.

1

(1.6%)

5

(8.2%)

9

(14.8%)

14

(23.0%)

24

(39.3%)

8

(13.1%)

Disagreement = 24.6% Agreement = 75.4%

20. In Part B, the summary

writing format is familiar to

me.

1

(1.6%)

1

(1.6%)

10

(16.4%)

15

(24.6%)

26

(42.6%)

8

(13.2%)

Disagreement = 19.6%

Agreement = 80.4%

The overall results in Table 3 revealed positive feedback on the test methods or tasks:

multiple-choice questions and summarizing. Two surprises emerged from the results. One

was to know that the notion of using various methods or tasks to test reading comprehension

(item 14) was perceived as appropriate by most test takers (n=52 or 85.3%). The other was

that most agreed that summarizing the reading (item 15) and multiple-choice questions (item

16) were appropriate methods or tasks to test reading comprehension (n=53 or 86.9% and

n=50 or 82% respectively).

In terms of fairness, however, the results of items 17-18 revealed a slightly different feedback.

Albeit positive feedback from a lot of test takers, there were still a few test takers who

disagreed that the multiple-choice questions format (item 17, n=16 or 26.2%) and the

summary writing (item 18, no=15 or 24.5%) were fair to test takers in general, which

inevitably included the respondents themselves. In addition, the results of items 19 and 20

revealed that not all of the test takers were familiar with both methods, though the majority

claimed that they were.

One thing interesting about the results was that it seemed that the test takers could realize the

appropriateness of the two methods and they understood how important these two test

methods were to testing reading. However, from their first-hand experience of taking the test,

somehow they could sense some unfairness of the two methods. As the stakeholders of the

test themselves, they made some comments: Summarizing was a good method to check if

students understood the reading./ I think summarizing is a better method than multiple-choice

questions. Students may cheat on the multiple-choice question method.

Research Question 4: What is the test takers’ feedback on the test administration?

1: Did you have enough time to finish the test? Please check (√) and explain.

The answers seemed to suggest that the test takers had enough time to do both parts of the

test. In detail, from the total 61 test takers, almost all (n = 55) stated that they had enough

time to finish Part A (multiple-choice questions), while the majority (n = 49) stated that they

had enough time to finish Part B (summary writing). For those who stated the insufficiency

of time mentioned the reasons, which basically were: The test had too many passages./ The

vocabulary was too difficult./The passages were too long./I am not very good at reading./I

didn’t know the meanings of the words, even I used the dictionary. Regarding all the

responses or feedback on the time allowed for both parts of the test, it could be seen that as a

whole the allotted time (Part A was allowed 40 minutes, while Part B, 50 minutes) was

appropriate.

228

FLLT 2011 Proceedings

2. Do you think the instructions of the test are clear and satisfying? Please

check (√) and explain.

The answers seemed to suggest that the test takers had no objection against the test

instructions of both parts in terms of being clear and satisfying. In detail, almost all (n = 58)

felt that the instructions of Part A (multiple-choice questions) are clear and satisfying, and

almost all (n = 59) felt the same with Part B, the summary writing. However, some stated that:

I was late to the test, so I missed what the teacher had explained about the test./ The

instructions were very clear. The fact that I couldn’t do the test had nothing to do with the

instructions. It could be said from the comments that some test takers might have problems

with reading or coming to the test late rather than with the test instructions.

3: Do you think the test administration and environment were appropriate and satisfying?

Please explain so that your answers can be used to improve them next time.

The answers seemed to suggest that most test takers were satisfied with the test environment,

and that the test administration was perceived as appropriate. In detail, the majority of

students (n = 45) felt satisfied with the administration and thought it was appropriate.

However, for those who expressed the disapproval stated that: The chairs were making noises

/The room was too small; the bigger room would be better./The air conditioning was so cold

that I could not concentrate on the test.

The results suggested that the test room could be problematic to the test takers, and it seemed

to be the cause of negative feedback.

4: Please respond to the use of a dictionary in the test room.

The results revealed the approval of allowing a dictionary in the test room since almost all test

takers (n=59) stated that it was very appropriate. However, most comments seemed to

suggest that the test takers could feel the drawback of using the dictionary while doing the

test. Interesting statements were as follows: It helped me to alleviate the suffering of test

taking./ It was fair to me because the test did not ask anything about the meaning of words in

the passages.

Regarding the feedback on the use of a dictionary in the test room, it was quite clear that the

test takers appreciated the permission to bring a dictionary to the test. However, it seemed

that they also realized that they did not have to depend on it all the time, and that it might

unnecessarily cost them time as well.

5: Do you think you were ready for this test? Please check (√) and explain.

The answers showed that only half of the test takers felt they were ready for the test: Part A

(n=35) and Part B (n=35). Those who felt not ready gave reasons such as: I was not good at

summarizing./ I forgot to bring a dictionary./The vocabulary was too difficult for me./I was

not well prepared for the test./I did not expect to take the reading test that was this much, and

I was so shocked! /I was not informed about the test. Nobody had told me! I did not read my

emails.

229

FLLT 2011 Proceedings

It could be assumed from the results that what affected the test takers‘ readiness were factors

that ranged from their personal attitudes about English, being unprepared about the test, to

being late to the test room.

Conclusion and Lessons Learned

The feedback reflected ―face validity,‖ on a one hand, and how they perceived the

appropriateness of the test and its features: content (passages and questions/answers), scoring,

methods or tasks, and test administration, on the other. As suggested by Bachman and Palmer

(2009), the results obtained from the pre-testing of a test should be used only to improve the

test itself and the procedures for administering it and not to make any inferences about the

individual test takers. What learned from the results and discussion, then, were ―lessons‖ that

related to improvement of both the features of the test as summarized in the following.

REFERENCES

Alderson, C. (2005). Assessing Reading. Singapore: Cambridge University Press.

Bachman, L. & Palmer, A. (2009). Language Testing in Practice. China: Oxford University

Press.

Baumann, J. & Bason, J. (2004). Survey Research. In N. K. Duke & M. H. Mallette (Eds).

Literacy Research Methodologies. New York: The Guilford Press.

Brown, A. & McNamara, T. (1992). The Role of the Test-Taker Feedback in the Test

Development Process:

Test Takers‘ Reactions to a Tape-Mediated Test of Proficiency in Spoken Japanese.

Melbourne Papers in Language Testing. Retrieved from

http://www.ltrc.unimelb.edu.au/mplt/papers/01_1_4_Brown_McNamara.pdf

Genesee, F. & Upshur, J. (1996). Classroom-Based Evaluation in Second Language

Education. New York: Cambridge University Press.

Henning, G. (1987). A Guide to Language Testing. Singapore: Newbury House Publishers.

Hughes, A. (1994). Testing for Language Teachers. Great Britain: Cambridge University

Press.

Meyer, B. & Poon, L. (2001). Effects of Structure Strategy Training and Signaling on Recall

of Text. Journal of Educational Psychology, 93(1): 141-159.

Riley, G. and Lee, J. (1996). A Comparison of Recall and Summary Protocols as Measures

of Second Language Reading Comprehension. Language Testing 13, 173-189.

Retrieved from http://Ltj.sagepub.com/cgi/content/abstract/13/2/173.

Shohamy, E. (1994). The role of language tests in the construction and validation of second-

language acquisition theories. In E. Tarone, S. Gass, & A. Cohen (Eds.). Research

Methodology in Second-Language Acquisition. New Jersey: Lawrence Erlbaum

Associates, Inc.

230

FLLT 2011 Proceedings

About the Author

Asst. Prof. Dr. Sutilak Meeampol received her Ph.D. in Curriculum and Instruction from

Kasetsart University, Thailand, and her M.A. in English from the University of Louisiana at

Lafayette, USA. She is currently an English instructor at the Language Institute, Bangkok

University. Her research interest is on EFL reading and instruction.

231

FLLT 2011 Proceedings

The Effect of Text Familiarity on Summary Writing Skill

Abbas Pourhosein Gilakjani

Islamic Azad University, Lahijan, Iran

[email protected]

Seyedeh Masoumeh Ahmadi

[email protected]

Abstract

Research has been done on the effects of text familiarity on reading comprehension. It has

been shown that there is no relationship between familiarity with the content of a passage and

better comprehension of that passage through reading it. More specifically, it has been

indicated that students perform better on a passage with an unfamiliar content (Carrel, 1983).

The study reported here focuses on the effect of text familiarity on summary writing skill of

foreign language students. In order to achieve this goal, 60 male and female senior students,

aged between 22 and 26, majoring in English language translation who were studying at the

Islamic Azad University of Tonekabon participated in the present study. Four passages were

selected from among reading comprehension TOEFL texts: Two passages were familiar and

the other two were unfamiliar. They were given to students for summary writing. Through the

processes of test administration, each subject was tested on 4 passages. The subjects

performed better on the passage with unfamiliar content.

1. Introduction

Writing is a basic communication skill and a unique asset in the process of learning a second

language. Both aspects of writing are important in the typical language class, and both can

serve to reinforce the other. Writing both in the practice sense and in the communicative sense

entails unique features that result in distinct contribution to overall language learning

(Chastain, 1988, p. 244). Scholes (1985) has argued, reading and writing are ''complementary

acts'' (p.20); in the same way that writing a text necessarily involves reading it, reading a text

requires writing a response to it. Just as reading provides comprehensible input for writing,

writing can contribute input for reading. Just as students ''need to become better readers'' in

order to ''become better writers,'' as Spack (1988, p. 42) argues, they can become better

readers by becoming better writers. A commonly identified problem area in summary

writing is superordination (Anderson, & Heidi, 1988; 1989; Brown, & Day, 1983).

Superordination, or what Ausubel (1968) terms ''subsumption'' (p. 100) occurs at very

specific levels of text comprehension when the student constructs general categories to

include specific details, but it also occurs when achieving the macro-level conceptual

framework of a text. Thus, it plays a key role in achieving the purposes of writing a study

summary by providing the conceptual framework that facilitates text comprehension. In this

study, the researchers attempted to provide answer to the following question: Is there any

relationship between text familiarity and summary writing skill?

2. Literature Review

Writing will no doubt play a significant role in our academic career. It is so central to most

students because of two main reasons: a. Writing is a powerful way to learn anything. b.

232

FLLT 2011 Proceedings

Writing is crucial to becoming a significant participant in any specific discipline or career

area-to become part of a particular field or profession. It is the way to learn what information

is important in a field and how to think and use language like other scholars and/or

practitioners in a field. Researchers call this two-dimensional view of writing ''writing-to-

learn'' and ''learning- to-write.'' Writing-to-learn has emerged from the work of educators,

scholars, and researchers of all kinds who have found that writing is a powerful way to learn,

but not only to learn specific material or content in your courses. Writing helps us learn how

to think in depth, and to think critically and analytically about our own ideas and the ideas of

other people. Learning to write might refer to specific of organization, content, style, voice,

grammar, and mechanics. It also encompasses learning conventions of specific fields, such as

formats and styles unique to certain disciplines, and learning features of specific writing

communities, such as ways of prioritizing information or methods of creating knowledge

(Mulvaney & Jolliffe, 2005, p. 13).

The tendency to view writing as the least of the four language skills may lead to the

conclusion that writing is less important and that it can be sacrificed to spend more time on

the other three skills. According to Chastain (1988), such is not the case, and teachers should

carefully consider the role of writing before deciding how much emphasis to place on it in

elementary language courses. Rivers (1981) points out'' writing is an essential classroom

activity. It is of considerable importance for consolidating learning in the other skill areas; it

provides a welcome change of activity; and it will always remain useful as part of a program

of testing. Writing should be considered the handmaid of the other skills, not the major skill to

be developed.''

Chastain (1988) mentioned, ''Real language involves authentic tasks with authentic materials

for authentic purposes. An educated person should be able to write in a clear, coherent,

comprehensible manner. The point is that language students often have very poorly developed

composing skills even in their native language. Thus, the task of helping them to develop their

communication skills in writing is more difficult. Ideally, the teacher should attempt to

correlate types of writing with students' skill levels'' (pp. 249-250).

Writing and reading are very closely connected, and good writers often make extensive use of

readings before and while they write. They need to get ideas, to consider the ways other

writers have written, and to enjoy someone else's insights and language. Responding to

readings offers a number of comprehensive reading strategies and suggests ways in which you

may use reading as an important element of your writing process (Lunsford & Bridges 2008,

p. 5).

''A summary is a condensation of the main ideas in an article. The length of a summary

depends on the assignment, the length and complexity of the article and the audience'' (Reid,

1988, p. 110). To Reid (1988), summarizing is an interactive, recursive process. In

summarizing a text, we work back and forth between the text, the papers we are writing, and

the requirement of the assignment—rereading, rewriting, and continually reflecting on and

comparing aspects of these elements. Summarizing skills are essential to academic success;

they are required to produce study summaries, to complete various types of summary

assignments, and to complete tasks that call for the incorporation of source material in

academic papers and presentations (ibid).

The goal of a summary is to record the gist of the piece-its primary line of argument-without

tangential arguments, examples, and other departures from the main ideas. The acceptable

233

FLLT 2011 Proceedings

summary recasts the main idea in the student's own words and provides proper attribution to

the source itself (Hult & Huckin, 2008, p. 276).

In their studies of planning skills for summary writing, Brown, Day and Jones (1983) indicate

that'' the ability to work recursively on information to render it as succinctly as possible

requires judgment and effort, knowledge, and strategies, and is, therefore, late developing'' (p.

968). According to Reid (1988), the qualities of a summary are:

1. Objectivity: No idea that is not the author's should be included in the summary, and no

opinion of the summary writer should be in the summary. No judgments are permitted in a

summary.

2. Completeness: Depending on the assignment, the summary should contain every main idea

in the article. Stating only the first main idea, or only one main idea and details to support it,

will not give the reader a complete idea of what the article was about.

3. Balance: Giving equal attention to each main idea, and stressing ideas that the author

stressed, will result in an accurate summary (p. 110).

According to Mulvaney and Jolliffe (2005), the characteristics of a good summary are as

follows:

1. It shrinks the length of the original text.

2. It retains the main content points, clearly reflecting the stance of the original author and

includes a limited amount of detail or examples.

3. It strives for objectivity.

4. It does not offer opinion, evaluation, or any additional information not contained in the

original piece; rather, it simply ''re-presents'' the original in reduced format (p. 328).

To Widdowson (1984), the term text refers to the recorded or transcribed linguistic rules used

to mediate that meaning. In other words, a text is the cover trace of an interaction which can

be used as a set of clues for reproducing the discourse. Halliday and Hasan (1976) defined the

word text as ''referring to any passage, spoken or written, of whatever length that forms an

integrated whole. It may be anything from a single proverb to a whole play, from a

momentary cry for help to an all-day discussion in a committee'' (p. i). Therefore, a text is

best defined as a unit of language in use. It is not a grammatical unit like a clause or a

sentence and does not consist of sentences, but it is realized by, or encoded in, sentences.

To Anderson (1988), the term familiarity refers to the degree to which the information or

genre is related to individual schemata. According to Scholes (1985), familiarity is a measure

of how frequently a linguistic item is thought to be used, or the degree to which it is known.

This may be measured by asking people to show on a rating scale whether they think they use

a given word or structure never, sometimes, or often.

3. Methodology

3.1 Subjects

The participants in this study were 60 students of English majoring in translation. The 60

students were randomly selected among 150 senior students studying at the Islamic Azad

234

FLLT 2011 Proceedings

University of Tonekabon. In order to select the 60 students for the main experiment, the

researchers administered a pretest, consisting of two passages to test students' summary

writing. Those who scored between16 to 20 on the TOEFL texts were included in this study.

The participants of the main study were distinguished in only one group, and each participant

in the group had to perform on 4 passages.

3.2 Design and Instrumentation

The certain design applied to handle this study was ''one group pre – test + post - test: 01 x

02.'' The researchers administered the summary writing of the TOEFL texts which consisted

of 4 passages. The subjects were given 80 minutes to summarize the passages. Four

passages were presented in the form of four texts: a) two familiar texts and b) two

unfamiliar ones. The presentation of the texts was in the form of written material.

3.3 Procedure

3.3.1 Pilot Study: To test the EFL students' writing skill, two passages were selected for a

small number of students. The passages were distributed among the students. The students

summarized the two passages. After performing the pilot study, it was indicated that students

performed on the unfamiliar passage better than the familiar one.

3.3.2 Experiment: After administering the pre-test and selecting one group of 60 students,

the passages were distributed among the subjects. Two passages were unfamiliar and the

other two were familiar. Time allotted for each text was the same. The instrument used to

gather information and data for this study was: Four passages (familiar and unfamiliar) for

summary writing. Two students were assigned to two experimental conditions. In the first

condition, the students were asked to write the summary of the passages (familiar and

unfamiliar) in the written form. Passages consisted of some idea units. These ideas were

expected to be written by the students. In the second condition, the experimenters repeated

the same procedure with another passages and gathered the protocols. The instructions for

writing on protocols were explained by the experimenters; he emphasized that the subjects

should pay attention to the passages carefully and to focus on understanding them; moreover,

he encouraged the students to write the ideas by using the key words.

4. Data Analysis

In order to answer the research question, several statistical analyses were carried out. They

were as follows:

Analysis 1- In order to test the research hypothesis, the X and SD of the texts were compared.

Then, two separate t-tests between pairs of the means were computed for passages to examine

whether there were significant differences between pairs of familiar and unfamiliar passages

(tables 1 and 2).

Analysis 2- The reliabilities of the raters for each text were reported (tables 3, 4).

235

FLLT 2011 Proceedings

Table1. Students' Scores on Their Protocols

Condition 1

(U) Condition 1 (F)

X = 4.11 X = 3.55

∑X = 247 ∑X = 213

SU = 1.94 SF = 1.47

Tobs =1.86 U = Unfamiliar F = Familiar

Table 2: Students' Scores on Their Protocols

Condition 2 (U) Condition 2 (F)

X = 4.15 X = 3.85

∑X = 268 ∑X = 261

SU = 1.15 SF = 1.05

Tobs = 1.76 U = Unfamiliar F = Familiar

Table 3: The Pearson Product-Moment Correlation

(Raters' Reliability)

Unfamiliar Familiar

∑X = 341 ∑X = 168

∑Y = 267 ∑Y = 210

∑ = 1578 ∑ = 564

∑ = 1001 ∑ = 845

∑X.Y = 1288 ∑X.Y = 671

R = 0.88 R = 0.81

236

FLLT 2011 Proceedings

Table 4: The Pearson Product-Moment Correlation

(Raters' Reliability)

5. Results

The statistical computations of the study showed the outcomes regarding the null hypothesis.

With the degree of freedom of 118 (60-1) + (60-1), and the level of 0.05, the t-critical is 1.98.

The t-observed of the study is 1.86 for the participants' protocols in the first condition, and

1.76 for the participants' protocols in the second condition. Both figures were lower than the t-

critical. This means that the null hypothesis of the study has been supported, which means

that the familiarity or unfamiliarity of a passage does not necessarily enhance better writing of

passages. Although the t-critical was higher than the t-observed, the difference was not

statistically significant. The obtained figures from the Pearson Product-Moment Correlation

(0.88, 0.92 for the unfamiliar passages, and 0.81, 0.82 for familiar passages) indicated that the

scorers' scores are correlated. So they are reliable enough to be able to show the results of the

study.

6. Conclusion

The results of this study showed no relationship between ''text familiarity'' and ''writing skill''.

The statistical analysis of the data supported this. Both in the pilot study and in the main study

the participants performed on the unfamiliar passage better than the familiar one. This meant

that participants had used linguistic clues for understanding and summarizing of the

unfamiliar passages through paying attention to them. The new topic (unfamiliar passage) has

been the reason for better performance. It has made the students pay more attention or be

more careful about the unfamiliar one and when there is more attention to the unfamiliar

passage, there is better performance.

7. Implication for Teaching

The results of this study indicate a number of steps which teachers may take to improve the

summarizing skills of EFL students of various proficiencies. First of all there is a need to

provide continued paraphrasing practice the sentence level. It may be wise to encourage this

Unfamiliar Familiar

∑X = 341 ∑X = 168

∑Y = 267 ∑Y = 210

∑ = 1578 ∑ = 564

∑ = 1001 ∑ = 845

∑X.Y = 1288 ∑X.Y = 671

R = 0.92 R = 0.82

237

FLLT 2011 Proceedings

practice in a discourse domain well known to the students, since decisions must be about what

terms can be paraphrased and which are central to the disciplines and therefore must be

retained in a summary. Secondly, most EFL students appear to need further practice in

combining sentences within as well as across paragraphs, while retaining the rhetorical

relationships established in the original. Finally, students at all levels can benefit from further

practice in applying Van Dijik's rules of generalization. They should be asked to create these

generalizations for paragraphs and longer expository texts, in order to understand the

commonly accepted deductive structure of written English discourse.

Acknowledgements

The authors wish to thank Ahmadi, Alizadeh, Babaei, and Khazaei, for their extensive and

insightful discussions and comments on the paper.

References

Anderson, V., & Heidi, S. (1989). Teaching students summarize. Educational Leadership, 46,

26-28.

Ausubel, D. (1968). Educational Psychology: A cognitive review. New York: Holt, Rinehart,

& Winston.

Brown, A. L., Day, J. D., & Jones, R. S. (1983). The development of plans for summarizing

texts. Child development, 54, 968-970.

Carrel, P. L. (1983). Three components of background knowledge in reading comprehension.

Language Learning. 33, 183-205.

Chastain, K. (1988). Developing second- language skill. 3rd

. U. S. A: Harcourt Brace,

Jovanovich, Inc.

Halliday, M. A. K., & Hassan, R. (1992). Cohesion in English. London: Longman.

Hult, C. A., & Huckin, T. N. ( 2008). The New Century Handbook. Pearson Longman.

Lunsford, R. F., & Bridges, B. (2008). The Longwood Guide to Writing.4th

ed. 5, Pearson

Longman.

Mulvaney, M. K., & Jolliffe, D. A. (2005). Academic Writing. Genres, Samples, and

Resources. 13, 328, Pearson Longman.

Reid, J. M. (1988). The Process of Composition. Colorado State University: Prentice-Hall

Regents.

.

Scholes, R. (1985). Textual Power. New Haven, CT: Yale University Press.

Spack, R. (1988). Initiating ESL students into the academic discourse community: How far

should we go? TESOL Quarterly, 22 (1), 29-51.

238

FLLT 2011 Proceedings

Van Dijik, T. A. (1982). Text and Context: Explorations in the Semantics and Pragmatics of

Discourse, London: Longman.

Widdowson, H. B. (1984). Explorations in Applied Linguistics: Oxford University Press.

APPENDICES

Appendix 1: Familiar passage used in the main study

Until recently, the growth hormone could only be obtained from the pituitary glands of dead

people. The substance was used to treat children who did not produce enough of their own

growth hormone and who would grow up as dwarfs. The natural product was taken off the

market after it was linked to a brain disease which attacked some of the children undergoing

treatment with it. But now, a new synthetic growth hormone has been developed which has no

dangerous side effects. The new drug is called "Somatrem" and can be produced in unlimited

quantities. For children who are deficient in their own growth hormone, Somatrem is an

important medical advance. The problem is that the drug may be abused by people who are

not medically in the need of its benefits. For example, athletes may take the drug in the belief

that it will improve their physique and physical performance. Parents may want to obtain the

drug for their children who are marginally under average height. For such reasons, experts are

recommending that registers be kept of Somatrem recipients. The implications of the use of

Somatrem must be understood before the distribution of drug is undertaken.

Appendix 2: Unfamiliar passage used in the main study

One of the main hazards for deep-sea divers is the bends. This condition is caused by gas

bubbles forming in the bloodstream if the diver ascends too rapidly. The reason for this

condition has to do with the saturation and de-saturation of body tissues with various gases.

At greater depths, the diver breathes air at higher pressures. This results in an increased

quantity of air being dissolved in the bloodstream. Different body tissues are saturated with

different gases from the air at different rates. When the diver ascends, oxygen is used by the

body tissues, carbon dioxide is released quickly, and nitrogen needs to be released gradually

from the bloodstream and body tissues. If nitrogen is subjected to a too rapid condition, it

forms gas bubbles in the blood vessels. The bubbles become trapped in the capillaries. This

prevents blood and oxygen from supplying necessary nutrients to body tissues, which

consequently begin to die. Saturation and de-saturation are affected by various factors such as

the depth, length of time, and amount of exertion under water. There are other factors that a

diver must take into account when determining a safe ascent rate. These include the the diver's

sex and body build, the number of dives undertaken within the previous12 hours, the time

spent at the dive location before the dive, and the composition of the respiration gas.

Appendix 3: Familiar passage used in the main study

Many folk cures which have been around for centuries may be more therapeutic than

previously suspected. A case in point is that of penicillin. Alexander Fleming did not just

randomly choose cheese molds to study when he discovered this very important bacteria-

killing substance. Moldy cheese was given to patients as a remedy for illness at one time.

Fleming just isolated what it was about the cheese which cured the patients. In parts of South

America, a powder obtained from grinding sugar cane is used for healing infections in

239

FLLT 2011 Proceedings

wounds and ulcers. This usage may take back to pre-Colombian times. Experiments carried

out on several hundred patients indicate that ordinary sugar in high concentrations is lethal to

bacteria. Its suction effect eliminates dead cells, and it generates a glasslike layer which

protects the wound and ensures healing. Another example of folk medicine which scientists

are investigating is that of Arab fishermen who rub their wounds with a venomous catfish to

quicken healing. This catfish excretes a gel-like slime which scientists have found to obtain

antibiotics, a coagulant that helps close injured blood vessels, anti-inflammatory agents, and a

chemical that directs production of a glue-like material that aids healing. It is hoped that by

documenting these folk remedies and experimenting to see if results are beneficial, an

analysis of the substances can be made, and synthetic substances can be developed for human

consumption.

Appendix 4: Unfamiliar passage used in the main study

In some rural agricultural societies, the collection of available fuel such as firewood, dung

cake, and agricultural waste can take 200 to 300 person-days per year. As well ws being time

consuming, the typical patterns of collection lead to deforestation, soil erosion, and ecological

imbalances. In the future, experts predict that even if food supplies are adequate for rural

populations, fuel supplies for domestic use may not be sufficient. In the light of such

considerations, a team in India has developed a solar oven for home use. The oven is cheaply

constructed, easily operated and extremely energy efficient. The device consists of an inner

and outer metal box, a top cover, and two panes of plain glass. The inner box is painted black

to absorb maximum solar radiation. The space between the two boxes is filled with an

insulating material, such as rice husks, which are easily available and which neither attract

insects nor rot easily. Other easily available materials for insulation are ground nutshells or

coconut shells. An adjustable mirror mounted on one side of the oven box reflects the sunlight

into the interior, boosting the temperatures by 15-30 degrees Celsius. This is most useful

during the winter when the sun is lower. Inside the oven, a temperature between 80 and 120

degrees Celsius above ambient temperature can be maintained. This is sufficient to cook food

gradually but surely. Trials have shown that all typical food dishes can be prepared in this

solar device without loss of taste or nutrition.

240

FLLT 2011 Proceedings

The Efficacy of Immediate and Delayed Corrective Feedback in the Correct

Use of English Definite and Indefinite Articles

Afshin Soori

Islamic Azad University, Larestan Branch, Iran

[email protected]

Arshad Abd. Samad

University Putra Malaysia

[email protected]

Abstract

The process of giving effective feedback is a central concern for teachers and researchers in

both first language and second language writing. Many teachers correct students‘ written

errors in the hope that this will help them improve the students‘ mastery over the correct use

of targeted linguistic forms, while Truscott (1996) considered this approach as a misguided

endeavour due to his claim that feedback on grammar errors had no place in writing

classrooms and it should be abandoned. Regarding this issue, the current study investigated

the results of nine weeks treatment on the efficacy of immediate and delayed corrective

feedback in the correct use of definite and indefinite articles. Data were collected from a

sample of 51 (34 males and 17 females) first year Iranian EFL medical students. The students

were administered three rational cloze tests (pre-test, immediate post-test, and delayed post-

test). The finding of the study revealed that immediate corrective feedback had a significant

effect on the correct use of English articles and the students received corrective feedback

significantly improved their ability in using English article system correctly and that they

retained this ability when they were given a new test four weeks after the treatment session.

This study also indicated that there was a change in article scores across the three different

time periods. Thus, the main effect for time was significant.

1. Introduction

The term corrective feedback (CF) is an umbrella term that covers both explicit and implicit

types of feedback in natural and instructional settings. CF is an important task and both teachers

and students may benefit it in the writing instruction. CF bridges the concerns of EFL teachers,

researchers, and instructional designers.

From the last decade onwards, the interest in CF in SLA on both theoretical and pedagogical

aspects has been established. There has been a debate on the theoretical side of CF that whether

CF is effective and beneficial for language acquisition. Pedagogically, CF has been

concentrated in many second and foreign language studies. One of the common findings of

these studies is that CF is occurred frequently in the classroom, regardless of pedagogical focus

and classroom setting (Fanselow, 1997; Hendrickson 1978), and it is generally agreed that L2

learners expect their teacher to provide them with feedback on their written errors (Enginarlar,

1993; Hedgcock & Lefkowitz, 1994; Lee, 1997;Schulz, 1996). Therefore, the main concern of

teachers ‗‗is not so much to correct or not to correct‖ (Lee, 1997, p. 466), but rather when and

how to provide feedback on the students‘ errors (Lee, 2003; Yates & Kenkel, 2002).

Regarding conflicting and different views on effectiveness of error correction practice

researchers confront the challenge of whether or not they should abandon all forms of

241

FLLT 2011 Proceedings

corrective feedback because some very well known studies and experts have provided

evidence that corrections do not work (e.g. Truscott, 1996,1999, 2007, 2008; Sheppard, 1992)

while other studies and experts (e.g. Ferris, 1999, 2001, 2004; Lee, 1997, 2004; Hedgcock

and Lefkowitz, 1996) have demonstrated that under certain conditions, with certain student

populations, and in some contexts, error correction is effective. Investigating this issue has

been the main focus of many recent studies.

2. Literature review

Corrective feedback has been regarded as a controversial topic among researchers and

composition theorists for the last three decades (Carrol and Swain, 1993; Dekeyser, 1993;

Lyster, 2001; Lyster and Ranta, 1997). It is also assumed as an essential key for the learners

in successful language learning. The shift from grammar translation and audiolingualism to

communicative language teaching led to conducting research that both support and

undervalue the effectiveness of corrective feedback.

One trend in discussion on error correction is on whether or not corrective feedback is

effective and whether teacher correction can help reduce linguistic errors. Regarding the

literature review on corrective feedback, there are studies that indicate the usefulness and

efficacy of error feedback (Ashwell, 2000; Fathman and Whalley, 1990; Ferris1999,

2003,2006; Ferris and Roberts 2001). Dana Ferris, was the most proponent of corrective

feedback that has argued corrective feedback more extensively. Her main objective seems to

provide good evidence for short term learning that results from error correction. To this end,

Ferris (1999) referred to Fathman and Whalley‘s (1990) findings in grammar correction.

Ferris (2003) claimed that Fathman and Whalley‘s (1990) finding was the best evidence

available source for the effectiveness of corrective feedback. Ferris (2006) revealed the type

of error corrected apparently influence language learning. Other researchers that found

immediate CF was effective in improving the accuracy were Bitchener, 2008; Bitchener and

Knoch 2008; Ellis et al. 2008; Ferris and Roberts, 2001; and Sheen, 2006. Russell and Spada

(2006) investigated the impacts of corrective feedback on second language grammar learning.

The outcome of this study revealed that corrective feedback was helpful for L2 learning.

However, there is also research that casts doubt on the benefits of CF (Truscott, 1996, 1999,

2004, 2007). Truscott (2007) claims that research evidence strongly indicates the

ineffectiveness of correction. Truscott (2007) believes that error correction has a small effect

on learners‘ ability to write accurately, and he is 95% confident that error correction has very

little positive effect, and its effects are very small and uninteresting. Truscott‘s view on error

correction is shared by other researchers in the literature review. Xu (2009) was in agreement

with Truscott who was the most potent critic of error correction. Xu (2009) claimed that

correction does not contribute the development of accuracy, may even harm the learning

process. Repeatedly, Truscott (2008) argueed that all the previous works on error correction

revealed the short-term effects of treatment. Moreover, some studies do not find error

feedback by the teacher to be significantly more effective for developing accuracy in L2

student writing (e.g., Polio, Fleck, and Leder, 1998; Sheppard, 1992).

Since EFL students have great diversities of error correction and feedback strategies, a fit for all

approach cannot be prescribed for any student. Hence, as Hyland and Hyland address a more

constructive approach and a more interactive environment are required for the students.

Moreover, ―to be effective, feedback should be conveyed in a number of modes and should

allow for response and interaction ( Hyland and Hyland, 2006, p. 5) .

242

FLLT 2011 Proceedings

3. Research questions

This study was designed to investigate the following research questions:

Q1. Is immediate corrective feedback effective in increasing the correct use of definite and

indefinite articles?

Q2. Is the effect of the corrective feedback on increasing the correct use of definite and

indefinite articles observable after a period of time?

4. Design

4.1 Method

The study used a quasi-experimental design involving two intact classes serving as

experimental group (N = 28), and a control group ( N = 23). Prior to the experiment, a pre-test

was administered to two groups to catch the initial difference between experimental and

control groups. The results of the pretest revealed that the experimental and control groups

were not significantly different in pre-test. Then, two groups completed, an immediate post-

test and a delayed post-test, where all the tests involved a rational cloze test with forty

deletions. In addition, two groups wrote three picture stories and completed three error

correction tasks during the treatment. The experimental group received corrective feedback on

article errors and the control group did not receive direct corrective feedback. Instead, the

location of errors made by participants were indicated and underlined and they were asked to

do self-correction.

5. Population of the Study

In this study, there was a sample of 51 (34 males and 17 females) medical students in two

General English I classes. All students were studying medicine in Shiraz University of

Medical Sciences and were enrolled in general English classes. The students were all in the

first year of study and were taking their second English class at university at the time of this

study.

6. Treatment

There were six treatment sessions in the current study. The students in experimental and

control groups took the same three rational cloze tests (Pre-test, post-test, and delayed post-

test). Each of these three cloze tests required students to fill in the blanks with ―a‖, ―an‖, ―the‖

and zero article. The students also did six tasks (three picture stories and three error correction

tasks) all in medical contexts, and received feedback on each piece of writing from the

researcher as the teacher of the course. Each of the picture stories required the students to

describe what was happening in the set of pictures given to the students. Each picture

included a setting where different people were doing various activities.

Picture one was ―Get blood taken‖, picture two was ―Visiting a doctor‖ and picture three was

―Mr. Thin at a dentist‘s‖. Moreover, the students in both experimental and control groups

completed three error correction tasks that contained sentences with twenty underlined

articles. The students were asked to read the whole passages and correct the article errors or

tick the correct articles in the parentheses were provided for each article. The researcher made

clear for the students that the tasks would not be assessed and they would not be considered in

determining their grades for the course.

243

FLLT 2011 Proceedings

The students in experimental group received immediate, explicit corrections above the article

errors committed by the students, and the students in control group did not receive corrective

feedback. The post-test was administered four weeks after pre test. Four weeks after

administering post-test, the delayed post-test was given to the students to assess the retention

of corrective feedback over time.

7. Schedule

The schedule for the study is shown briefly in Table.1. The entire study was continued for a

period of 9 weeks. There was a gap of 4 weeks between post-test and delayed post-test when

the students in both groups followed their regular classes and the researcher continued

teaching the text book for both groups. During these 4 weeks the students did not receive any

corrective feedback.

Table1. Schedule for the study

Week Activity

1 Pre-test: 1st Rational Cloze Test

2 Task 1 (A & B)

3 Feedback on Task 1: Task 2 (A & B)

4 Feedback on Task 2: Task 3 (A & B)

5 Feedback on Task 3: Post-test (2nd

Rational Cloze Test)

9 Delayed post-test: 3rd

Rational Cloze Test

8. Scoring and analysis

To calculate the performance of the students on three rational cloze tests, the students asked to

fill in the blanks with appropriate articles. Each blank that was answered correctly was given

a credit. Therefore the maximum score was 40 for forty items.

The scores for the three rational cloze tests were analyzed by means of repeated measures

ANOVA to measure the same subjects under different conditions (or measured at different

points in time) (pallant, 2007). To this end, the interaction effect between two variables (time

and group), the main effect for each of the independent variable (e.g. time), and the main

effect of between-subjects variable were assessed.

9. Results

9.1 Descriptive Statistics Results

To answer the Research Questions the mean scores and standard deviations of both

experimental and control groups in three rational cloze tests were calculated.

The descriptive statistics for both experimental and control groups in pre-test, post-test, and

delayed post-test are shown in Table 2, 3, and 4. Table 2 displays the means, standard

deviations, minimum and maximum scores.

244

FLLT 2011 Proceedings

Table 2. Descriptive statistics for experimental and control groups in pre-test

Groups N Mean SD Min. Max.

Experimental 28 16.60 2.55 12 21

Control 23 16.26 3.79 9 23

As depicted in Table 2, the means and standard deviations of different groups were very close

together. The comparison between the mean scores among different groups showed that there

were no considerable differences among mean scores. The minimum and maximum scores

obtained in the pre-test were9 and 23 that were belong to control.

Table 3. Descriptive statistics for experimental and control groups in post-test

Groups N Mean SD Min. Max.

Experimental 28 18.03 2.92 12 23

Control 23 17.26 4.94 8 26

As shown in Table 3 the means and standard deviations represented difference between

experimental and control groups. The comparison between the mean scores between these

two groups revealed that there was considerable difference between the mean scores. This

table also indicated the experimental group had the higher mean score (mean = 18.03) than

the control group (mean = 17.26). The minimum and the maximum scores obtained in the

post-test were 8 and 26 in control group.

Table 4. Descriptive statistics for experimental and control groups in delayed post-test

Groups N Mean SD Min. Max.

Experimental 28 18 3.43 10 24

Control 23 17.95 3.30 10 25

As illustrated in Table 4 the comparison between the mean scores between the experimental

and control group revealed that there were no considerable differences between mean scores.

This table indicated the mean score for experimental group was (mean = 18) and (mean =

17.95) for control group. The minimum score obtained in the delayed post-test revealed that

the minimum score was 10 in two groups while the maximum score was 25 in control group

9.2 Repeated Measures ANOVA Results

To assess the efficacy of corrective feedback, on the correct use of definite and indefinite

articles across three time periods (pre-test, post-test, and delayed post-test) repeated measures

ANOVA was run. The results are shown in Table 5.

Table 5. Test of within-subjects contrasts

Effect Value F Hypothesis

df

Error df Sig. Partial Eta

squared

Time Wilk‘s

Lambda

.833 4.81 2 48 .012 .167

Time*Group

Wilk‘s

Lambda

.989 .260 2 48 .772 .011

245

FLLT 2011 Proceedings

As depicted in Table 5 the time-group interaction was not statistically significant, Wilk‘s

Lambda = .99, F (2,48) = .26, p = .77 partial eta squared = .011. There was a considerable

main effect for time, Wilk‘s Lambda = .83, F (2,48) = 4.81, P = .012, partial eta squared=

.167 with both groups showing increase in their scores from pre-test to post-test.

Table 6. Tests of between-subjects effects

Source Type III Sum of

Squares

Df Mean Square F Sig. Partial Eta

Squared

Intercept 456.32 1 45632.271 1.94 .000 .975

Group 5.709 1 5.709 .244 .624 .005

Error 1148.723 49 23.443

As shown in Table 6 the main effect comparing the two types of intervention was not

significant, F (1, 49) = .24, P = .62, partial eta squared = .005, suggesting no significant

difference in the effectiveness of corrective feedback.

10. Discussion

Despite Truscott‘s (1996, 1999, 2004) claims on the ineffectiveness of corrective feedback, it is

suggested that researchers and teachers consider corrective feedback as a facilitative factor for

improving the students‘ mastery over linguistic errors and worthwhile spending time and

energy. Having said this, it is timely to remind that the finding of this study is not the result of

unfocused and random treatment of diverse linguistic errors because different linguistic

categories represent separate domains of knowledge and that they are acquired through

different stages and processes (Ferris, 1999, 2002; Truscott, 1996). However, it is the result of

targeted focus on functional uses of one problematic linguistic error for EFL students. The

finding of the study showed that corrective feedback provided had significant effects on the

correct use of articles. Hence, it can be concluded that Truscott (1996) was not right when he

claimed that giving corrective feedback on linguistic errors is ineffective. However, the findings

in this study were the results of focusing on different functions of definite and indefinite articles

that were problematic issues for Iranian EFL students. It should also be admitted that the

participants of the study are Iranian medical students that learn English in a place where English

is a foreign language and with a few exceptions, the common characteristics of Iranian students

is their ability to learn grammar well in formal instructional settings where the focus is usually

on form and structure. However, Iranian students also have some problems when they want to

use articles correctly. Therefore, further research should be conducted to determine how

corrective feedback will be effective in developing the students‘ mastery over some linguistic

structures and how they help them to use them correctly in sentences.

The findings of the present study reinforced those of earlier studies (Ashwell, 2000;

Bitchener, 2008; Bitchener et al., 2005; Ellis et al, 2008; Fathman & Whalley, 1990; Ferris &

Roberts, 2001; Sheen, 2006) of the effectiveness of corrective feedback. Like this study, the

findings of earlier studies revealed that corrective feedback provided had a significant effect

on the correct use of articles and the students who received corrective feedback outperformed

those who did not receive CF and the students significantly improved their ability in using the

targeted functions of the English article system accurately.

The second Research Question investigated the effects of corrective feedback on increasing the

correct use of articles after a period of time. To this end, ANOVA revealed that the time was an

246

FLLT 2011 Proceedings

effective factor and the participants had different performance in different time from pre-test to

post-test and delayed post-test. In fact, this study revealed that the students‘ ability varied

significantly across the three times (pre-test, post-test, and delayed post-test). However, it was a

linear and upward pattern of improvement from one time to another. While the experimental

group faded away on the delayed post-test, it was not significant and the students maintained the

same level of ability in the correct use of articles. However, the control group‘s ability

continued to improve from pre-test to post-test, and from post-test to delayed post-test. Even

though the performance of the control group improved in the delayed post-test, it was

significantly different from that of experimental group. One explanation for this improvement

might be that some members of the group received additional input on the targeted feature

during the weeks between the post-test and delayed post-test. It is always possible that students

in experimental group may have passed on information about what they were receiving

feedback on or those students in the control group sought instruction from out of class sources.

In this case, the findings of this study not only indicated the immediate effect of different types

of corrective feedback but also the extent to which the ability for the correct use of articles was

retained after a four-week period without additional corrective feedback and classroom

instruction.

References

Ashwell, T. (2000). Patterns of teacher response to student writing in a multiple-draft

composition classroom: Is content feedback followed by form feedback the best method?

Journal of Second Language Writing, 9 (3): 227- 257.

Bitchener, J. (2008). Evidence in support of written corrective feedback. Journal of Second

Language Writing. 17: 102–118.

Bitchener, J., and Knoch, U. (2008). The value of written corrective feedback for migrant and

international students. Language teaching Research. 12(3): 409-431.

Carroll, S. and Swain, M. (1993). Explicit and implicit negative feedback: An empirical study

of the learning of linguistic generalizations. Studies in Second Language Acquisition. 15:

357–386.

Dekeyser, R.M.(1993). The effect of error correction on L2 grammar Knowledge and oral

proficiency. The Modern language Journal. 77(4): 501-514.

Ellis, R. Sheen, Y. Murakami, M. and Takashima, H. (2008). The effects of focused and

unfocused written corrective feedback in an English as foreign language context. System.

36: 353–371.

Enginarlar, H. (1993). Students response to teacher feedback in EFL writing. System. 21(2):

193-204.

Fathman, A. K., and Whalley, E. (1990). Teacher response to student writing: Focus on form

versus content. In B. Kroll (ed.), Second Language Writing. p.178-190

CambridgeUniversity Press.

247

FLLT 2011 Proceedings

Ferris, D.R. (1999). The case for grammar correction in L2 writing classes: A response to

Truscott (1996). Journal of Second Language Writing. 8(1): 1-10.

Ferris, D.R. (2003). Response to student writing: Implications for second language students.

Mahwah, NJ: Lawrence Erlbaum Associates.

Ferris, D.R. (2004). The ‗‗grammar correction‘‘ debate in L2 writing: Where are we, and

where do we go from here? Journal of Second Language Writing. 13: 49–62.

Ferris, D.R. (2006). Does error feedback help student writers? New evidence on the short- and

long-term effects of written error correction. In K. Hyland & F. Hyland (Eds.), Feedback

in second language writing: Contexts and issues (pp. 81– 104). Cambridge: Cambridge

University Press.

Ferris, D.R. and Roberts, B. (2001). Error feedback in L2 writing classes How explicit does it

need to be? Journal of Second Language Writing. 10: 161– 184.

Hedgcock, J., and Lefkowitz, N. (1994). Feedback on feedback: Assessing learner receptivity

to teacher response in L2 composing. Journal of Second Language Writing. 3(2): 141-163.

Hedgcock, J. and Lefkowitz, N. (1996). Some input on input: Two analyses of student

response to expert feedback in L2 writing. The modern language Journal. 80(3): 278-308.

Hendrickson, J. (1978). Error correction in foreign language teaching: Recent theory research,

and practice. Modern Language Journal. 62: 387-398.

Lee, I. (1997). ESL learners‘ performance in error correction in writing. System 25(4): 465-

477.

Lee, I. (2003). L2 writing teachers‘ perspectives, practices and problems regarding error

feedback. Assessing Writing. 8: 216–237.

Lee, I. (2004). Error correction in L2 secondary writing classrooms: The case of Hong Kong.

Journal of Second Language Writing. 13: 285-312.

Lyster, R. (2001). Negotiation on form, recasts, and explicit correction in relation to error

types and learner repair in immersion classrooms. Language Learning. 5: 265-301.

Lyster, R. and Ranta, L. (1997). Corrective feedback and learner uptake: Negotiation of form

in communicative classrooms. Studies in Second Language Acquisition. 19(1): 37-66.

Pallant, J. (2007). SPSS Survival Manual. Open University Press.

Polio, C., C. Fleck and N. Leder (1998). ‗If I only had more time‘: ESL learners‘ changes in

linguistic accuracy on essay revisions. Journal of Second Language Writing. 7(1): 43-68.

Schulz, R. (1996) Focus on form in the foreign language classroom: Students‘ and teachers‘

views on error correction and the role of grammar. Foreign Language Annuals, 29(3),

343-364.

248

FLLT 2011 Proceedings

Sheen, Y. (2006). Corrective feedback, individual differences, and the acquisition of English

articles by second language learners. Unpublished doctoral thesis, University of

Nottingham.

Sheppard, K. (1992). Two feedback types: Do they make a difference? RELC Journal,

23.1,103–110.

Truscott, J. (1996). The case against grammar correction in L2 writing classes. Language

Learning. 46(2): 327-369.

Truscott, J. (1999). The case for grammar correction in L2 writing classes‖: A response to

Ferris. Journal of Second Language Writing. 8: 111-122.

Truscott, J. (2007). The effect of error correction on learners‘ ability to write accurately.

Journal of Second Language Writing. 16: 255–272.

Truscott, J., and Hsu, A.Y. (2008).error correction, revision, and learning. Journal of second

language Writing. 17: 292-305.

Yates, R., Kenkel, J. (2002). Responding to sentence-level errors in writing. Journal of

Second Language Writing, 11(1), 29-47.

Xu, C. (2009). Overgeneralization from a narrow focus: A response to Ellis et al. (2008) and

Bitchener (2008). Journal of Second Language Writing, 18, 270-275.

About the Authors

Afshin Soori holds a BA in English literature and MA in English teaching from Shiraz

University, Iran. He is currently pursuing his ph.D in TESL in University Putra Malaysia. He

was appointed as a faculty member with Islamic Azad University, Larestan branch, Iran in

2003. He has been teaching English for the past ten years. His research interest is feedback in

writing, textbook evaluation, CALL, grammar instruction, and translation. Among his

publications is Special English for Computer Students. He has been a presenter in several

international conferences in Teaching and Learning English.

Assoc. Prof. Dr. Arshad Abd. Samad holds a doctoral degree from Northern Arizona

University, Flagstaff, Arizona, USA which he received in 1999 and Master and Bachelor

degrees from Indiana University, Bloomington, Indiana, USA. He was appointed as a lecturer

with University Putra Malaysia in 1990. Currently he is a senior lecturer in Faculty of

Educational Studies, Universiti Putra Malaysia. He is involved in research and publication in

the field of Teaching English as a Second Language (TESL), especially in grammar

instruction, language acquisition and testing. Among his publications are Essentials of

Language Testing for Malaysian Teachers (2002) and Perspectives of Grammar in Education

(2003).

 

 

 

 

 

 

 

 

 

 

 

 

Language Institute Thammasat University Rangsit Campus 

99 M. 18 Phaholyothin Road Klongnung, Kongluang 

Pathum Thani 12120 THAILAND http://litu.tu.ac.th or http://www.tu.ac.th/org/litu 

LITU QR Code