PLEASE SCROLL DOWN FOR ARTICLE Journal of Travel & Tourism Marketing Usability of Chinese...

18
PLEASE SCROLL DOWN FOR ARTICLE This article was downloaded by: [Hong Kong Polytechnic University] On: 30 December 2009 Access details: Access Details: [subscription number 909944559] Publisher Routledge Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered office: Mortimer House, 37- 41 Mortimer Street, London W1T 3JH, UK Journal of Travel & Tourism Marketing Publication details, including instructions for authors and subscription information: http://www.informaworld.com/smpp/title~content=t792306980 Usability of Chinese Destination Management Organization Websites Shanshan Qi a ; Rob Law a ; Dimitrios Buhalis b a School of Hotel & Tourism Management, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong b School of Service Management, Bournemouth University, Poole, Dorset BH12 5BB, UK To cite this Article Qi, Shanshan, Law, Rob and Buhalis, Dimitrios(2008) 'Usability of Chinese Destination Management Organization Websites', Journal of Travel & Tourism Marketing, 25: 2, 182 — 198 To link to this Article: DOI: 10.1080/10548400802402933 URL: http://dx.doi.org/10.1080/10548400802402933 Full terms and conditions of use: http://www.informaworld.com/terms-and-conditions-of-access.pdf This article may be used for research, teaching and private study purposes. Any substantial or systematic reproduction, re-distribution, re-selling, loan or sub-licensing, systematic supply or distribution in any form to anyone is expressly forbidden. The publisher does not give any warranty express or implied or make any representation that the contents will be complete or accurate or up to date. The accuracy of any instructions, formulae and drug doses should be independently verified with primary sources. The publisher shall not be liable for any loss, actions, claims, proceedings, demand or costs or damages whatsoever or howsoever caused arising directly or indirectly in connection with or arising out of the use of this material.

Transcript of PLEASE SCROLL DOWN FOR ARTICLE Journal of Travel & Tourism Marketing Usability of Chinese...

PLEASE SCROLL DOWN FOR ARTICLE

This article was downloaded by: [Hong Kong Polytechnic University]On: 30 December 2009Access details: Access Details: [subscription number 909944559]Publisher RoutledgeInforma Ltd Registered in England and Wales Registered Number: 1072954 Registered office: Mortimer House, 37-41 Mortimer Street, London W1T 3JH, UK

Journal of Travel & Tourism MarketingPublication details, including instructions for authors and subscription information:http://www.informaworld.com/smpp/title~content=t792306980

Usability of Chinese Destination Management Organization WebsitesShanshan Qi a; Rob Law a; Dimitrios Buhalis b

a School of Hotel & Tourism Management, The Hong Kong Polytechnic University, Hung Hom,Kowloon, Hong Kong b School of Service Management, Bournemouth University, Poole, Dorset BH125BB, UK

To cite this Article Qi, Shanshan, Law, Rob and Buhalis, Dimitrios(2008) 'Usability of Chinese Destination ManagementOrganization Websites', Journal of Travel & Tourism Marketing, 25: 2, 182 — 198To link to this Article: DOI: 10.1080/10548400802402933URL: http://dx.doi.org/10.1080/10548400802402933

Full terms and conditions of use: http://www.informaworld.com/terms-and-conditions-of-access.pdf

This article may be used for research, teaching and private study purposes. Any substantial orsystematic reproduction, re-distribution, re-selling, loan or sub-licensing, systematic supply ordistribution in any form to anyone is expressly forbidden.

The publisher does not give any warranty express or implied or make any representation that the contentswill be complete or accurate or up to date. The accuracy of any instructions, formulae and drug dosesshould be independently verified with primary sources. The publisher shall not be liable for any loss,actions, claims, proceedings, demand or costs or damages whatsoever or howsoever caused arising directlyor indirectly in connection with or arising out of the use of this material.

USABILITY OF CHINESE DESTINATIONMANAGEMENT ORGANIZATION WEBSITES

Shanshan QiRob Law

Dimitrios Buhalis

ABSTRACT. Information Communication Technology (ICT) has had a large impact ontourism industry. In Mainland China (hereafter known as China), the increasing popularity ofInternet applications to its tourism industry is evident by the rapid growth of Chinese tourismwebsites. In 2005, e-tourism in China has reached an income of RMB12.5 billion orUS$1.63 billion, showing that although a small percentage of Chinese use the Internet, theironline consumption is still considerable. While the e-tourism market seems promising, thereexist a limited number of prior studies on website evaluations in the context of China. Thisresearch explores usability, a contemporary issue of website design, and focuses on theprovincial Destination Management Organization (DMO) websites in China. Research findingsinclude a checklist of criteria for assessing DMO website usability. Findings showed thatChina’s DMO websites had medium problems, and the best and worst performing destinationswere Beijing and Ningxia. In addition, the usability indices had no significant relationship withwebsite performance and level of tourism regional development which was represented by totaltourism income in the destination. Findings of this study would be of interest to readers forbetter understanding the current development of DMO websites in China. Industrialpractitioners may consider adopting a similar approach to evaluate their websites.

KEYWORDS. DMO, China, usability, website, tourism

The growth of Information Communica-tion Technology (ICT), especially the Internet,has had a great impact on the tourismindustry. In order to obtain market advan-tages and to better reach its responsibilities,governments together with stakeholders haveestablished Destination Management Organi-zation (DMO) websites to promote their

service/products globally (Buhalis, 2003,2005; Hanna & Millar, 1997; Tunnard &Haines, 1999; World Tourism OrganizationBusiness Council [WTOBC], 2001, 2005).Since the primary responsibility of DMOs isto introduce, promote, market, and branddestinations around the world; websites canhelp destinations achieve DMOs’ marketing

Journal of Travel & Tourism Marketing, Vol. 25(2) 2008Available online at http://www.haworthpress.com# 2008 by The Haworth Press. All rights reserved.

182 doi: 10.1080/10548400802402933

The authors are grateful to the constructive comments offered by the three anonymous reviewersabout an earlier version of this article.

This project was partly supported by a research grant funded by the Hong Kong PolytechnicUniversity (A-PG87).

Shanshan Qi (E-mail: [email protected]) is Research Assistant, and Rob Law (E-mail:[email protected]) is Associate Professor, both at the School of Hotel & TourismManagement, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong.Dimitrios Buhalis is Professor, School of Service Management, Bournemouth University, Poole,Dorset BH12 5BB, UK (E-mail: [email protected]).

Downloaded By: [Hong Kong Polytechnic University] At: 13:27 30 December 2009

objectives, which include increasing visitors’satisfaction and strengthening their experi-ence, maintaining and improving the prosper-ity of a local community on a long-term basis,developing partnership between public andprivate sectors, and bringing benefits to boththe supply and demand sides (Buhalis, 2000,2003; Pike, 2005; Ritchie & Crouch, 2003).

The tourism industry in China has grownrapidly in recent years. According to theUnited Nations World Tourism Organiza-tion (UNWTO), China will become theworld’s most popular destination by 2020(‘‘China A Top Tourist Destination by2020,’’ 2004; Qi, Buhalis, & Law, 2007;Wang, Yu, & Avgoustis, 2005). In addition,China has become the second largest countryin terms of Internet users. According to thestatistical results of China Internet NetworkInformation Center [CNNIC] (2007), therewould be 162 million Internet users in Chinaat the end of June 2007, and this included3.9% online users who made travel reserva-tions. Additionally, the number of newInternet users has increased 25 million ascompared to the same period in the previousyear. Therefore, the huge potential inChina’s e-tourism industry, together withthe growing popularity of the Internet,necessitate the emerging need for furtherdevelopment of China’s online travel mar-ket. Cui (2002) indicated that e-tourism is amajor means for China’s tourism industry toparticipate in market competition. Tourismadministrative departments and tourismenterprises should thus pay close attentionto the developmental trends of China’s e-business. They should also urge the con-struction of China’s e-tourism fundamental

frames and application environments inorder to sustain healthy development (Cui;Ma, Buhalis, & Song, 2003).

E-TOURISM IN CHINA

At present, China has more than 5,000travel and tourism websites that provideusers the necessary information on food,accommodation, tours, transportation,shopping, and entertainment for specificdestinations (Cui, 2002; Hu, Zeng, & He,2006; Zhou & Shi, 2005). In general, thereare four types of tourism informationwebsites in China, and Table 1 details thesetypes.

Websites of the first type have a govern-ment background and are monitored bylocal tourism administrations such as localprovincial DMOs in Guangdong, Beijing,and Yunnan. These websites can provide ane-business platform for both tourists andtourism enterprises. In contrast, travel infor-mation websites are monitored by InternetContent Providers (ICPs), and these websitespresent commercial tourism information. Anexample of this kind of websites is Ctrip(Xiecheng), which is the largest online travelagent in China. The third type includes travelpackage selling websites, which are managedby tourism operators and facilitate sellingtheir products. Examples of these websitesinclude Qinglv Online and Kunlun Online.The last category comprises gateway net-work station websites that are developed bynetwork companies. These websites arededicated to provide brief introduction totourists on popular tourism spots, tour

TABLE 1. Types of China’s Tourism Websites

Categories Scope and Mode of Operation Examples

Government background Managed by the local government, and to promote

and introduce destinations.

Shandong Tourism Website Guilin

Tourism Website

Travel information website Held by Internet Content Providers (ICPs), present

commercial tourism information.

Xiecheng Tourism Website, Chinese

Tourism Business Hotline

Travel package selling Managed by tourism operators to sell their products Qinglv Online, Kunlun Online

Gateway network stations Network companies provide tourism information on

their websites.

Sina, 163, Sohu, and Yahoo websites

Qi, Law, and Buhalis 183

Downloaded By: [Hong Kong Polytechnic University] At: 13:27 30 December 2009

routes, transportation information, hotelbookings, comprehensive knowledge ontourism, and travel diaries. Examples ofthese websites include Sina, 163.net, Sohu,and Yahoo.cn (Liu, 2004; Wang, 2000; Wei,2006; Yang, 2001; Zhou & Shi, 2005).Compared with other commercial travelwebsites, destination marketing websites areusually managed by the government sector(Buhalis, 2003; Kotler, Bowen, & Makens,2003), the duty of a DMO website is not onbusiness benefits, it is focused on increasinga destination’s visitation and sales of itsdestination products (So & Morrison, 2004;WTOBC, 2001). Therefore, in order to betterdevelop and promote tourism destinations,most DMOs have established their ownwebsites for marketing and bookings(WTOBC, 2001, 2005). This way of websitedevelopment efforts directly applies toDMOs in China (Wei, 2006; Wu, 2006;Zhou & Shi, 2005). Hence, a DMO websitecan reflect the real situation in a destinationwithout any commercial descriptions. In thisresearch, the DMO websites of 31 Chinesekey provinces and independent cities wereselected for analysis. Research findings areexpected to contribute to reflect the generalperformance and problems of e-tourism ineach destination. Additionally, findingswould be beneficial for DMOs from usingInformation and Communication Techno-logies (ICTs) for promotion, as well asenabling China’s DMOs to better under-stand the performance of their websites.This, in turn, can assist China to cope withthe emerging e-tourism market.

RESEARCH OBJECTIVES

Although there are many prior studies ontourism website analysis, only a few of themfocused on website usability evaluation orDestination Marketing Systems. In addition,prior studies on China’s tourism websiteswere only attempted by a few researchers. Inorder to fill this research gap, this researchmakes an attempt to establish a checklist ofcriteria for assessing DMO website usability.

Utilizing the checklist, website developershave a set of preset standards to benchmarkwhen they try to improve destination web-sites. This study is to apply this benchmark ofwebsite evaluation to investigate the usabilityperformance of DMO websites in China.

LITERATURE REVIEW

It is commonly known that the goal of aDMO website is to integrate its onlineactivities with its marketing and visitorservicing strategies. In order to establish asuccessful DMO website, designers shouldabide to the criteria for successful websites(Benckendorff & Black, 2000; Kaplanidou &Vogt, 2004; Morrison, Taylor, Morrison, &Morrison, 1999; WTOBC, 2005). Manyprior studies thus indicated that the design,especially its ease of use, is of paramountimportance for a successful website (AuYeung & Law, 2003, 2006; Douglas &Mills, 2004; Elges, 2004; Nielsen, 2003;Nielsen & Norman, 2000; Olive, 2002).Nielsen (2003) defined usability as thequality attribute that evaluates how easy auser interface is to use. The word usabilityalso refers to the methods for improving awebsite’s ease of use at the design stage. Thisimplies that website usability deals with notonly how to make sure everything on the siteworks but also how quickly and easilyvisitors are able to use the site. Nielsen(1993) also pointed out that usability hasmultiple components which are usuallyassociated with five usability attributesincluding ease to learn, ease to use, memor-ability, low error rates, and customer satis-faction. Hence, in order to improve theefficiency and visitation of a DMO website,usability should be recognized as a criticalsuccess factor in DMO website evaluation.According to Mills and Morrison (2000), thecritical success factors of a DMO websitecould be categorized into four groups—namely technical quality, customer perspec-tive, website attractiveness, and marketingeffectiveness. These four categories are sum-marized in Table 2.

184 JOURNAL OF TRAVEL & TOURISM MARKETING

Downloaded By: [Hong Kong Polytechnic University] At: 13:27 30 December 2009

Some prior studies have been performedthat focused on measuring the usabilityperformance of a website by different usabil-ity evaluation methods (UEMs). TheseUEMs underpin the two characteristics ofusability evaluation. First, usability is mani-fold and thus the measurements should bevariegated. Secondly, usability is a subjectiveassessment which is based on users’ personaljudgment (Agarwal & Venkatesh, 2002;Mack & Nielsen, 1994). Morrison, Taylor,and Douglas (2004) further suggested thatthe ultimate measure of the success oftourism and hospitality websites is theirreturn on investment (ROI). They concluded

that private sector websites’ effectiveness canbe measured against the transactions andrevenue they have generated. However as anonprofit and government sector, DMOwebsites rarely have direct online sales.This, in turn, renders the ongoing difficultyin accurately measuring ROIs of the web-sites. As such, a better way to evaluate thesewebsites would be through benchmarking,which will enable them to compare theirperformance against their peers.

In order to achieve the objectives of thisresearch, the researchers chose to use aheuristic evaluation method. The importanceof a heuristic evaluation is that it can help

TABLE 2. Critical Success Factors for DMO Websites

Dimension Successful Criteria

Technical Qualification N Loading time

N Link popularity

N Webpage spelling

N Browser compatibility

N Effective application of HTML

N Website accessibility

Factor: Provide service to disabled people

Consumer Perspective N Easy to use

Factors: Easy-to-remember URL links; Limited vertical and horizontal scrolling; Internal

search engine facility

N Easy to navigate through

Factors: A home button on all pages; Navigation menu/index; Site map; Availability of FAQ;

Friendly user interface

N Easy to obtain contact info

Factors: Mailing address; E-mail address; Telephone numbers; Fax numbers

Website Attractiveness N Clear website structure

Factor: Standard forms; Uncluttered pages

N Interface, visual appeal

Factors: Text readability; Multimedia images; Fantastic graphic layout;

Comfortable website colors

N Destination Information Perspective

Factors: Destination attractions; Accommodation information; Local news; Destination

activities; Pricing; Meeting planning; Information for trip planners; General travel links

Marketing Effectiveness N Market segmentation/ target marketing

Factor: Different groups of tourists

N Marketing research and database

Factors: Hyperlinks to partner organizations

N Marketing information

Factors: Timely information; Multiple foreign languages and special interest for international

travelers; Contact information gathered from visitors; On-line reservation; On-line

transaction information

N Marketing strategies

Factors: Travel stories and reviews; Bulletin board and chat rooms

Summarized from: Benckendorff & Black (2000); Douglas & Mills (2004); Feng et al. (2003); Ham (2004); Ismail et al. (2002); Kaplanidou &Vogt, (2004); Kim & Lee (2004); Morrison et al. (2004) ; Oertel, Thio, & Feil (2001); So & Morrison (2004); WTOBC, (2001, 2005).

Qi, Law, and Buhalis 185

Downloaded By: [Hong Kong Polytechnic University] At: 13:27 30 December 2009

researchers find usability problems in a userinterface design and the revealed problemscan then be addressed in the subsequentimprovement processes (Nielsen 1994;Nielsen & Molich, 1990). In addition, themethod was originated from the mostpopular method used to examine websitepertinent problems (Nielsen, 1993). Moreimportantly, there are only a limited numberof prior studies in the existing tourism andhospitality literature which used a modifiedheuristic evaluation method to evaluatewebsite usability in the hospitality industry.Au Yeung and Law (2003, 2006) adopted amodified heuristic evaluation method toevaluate the usability of Hong Kong hotelwebsites. This research adopted Au Yeungand Law’s (2003, 2006) modified heuristicmethod to evaluate the China’s DMOwebsites. Generally speaking, this evaluationmethod requires a small group of evaluators,with each evaluator working individuallyand the researcher is in-charge of collectingand analyzing data. Moreover, evaluatorsshould be familiar with the products andagree with a set of usability principles beforethe evaluation begins (Nielsen, 1992; Nielsen& Landauer, 1993; Nielsen & Molich, 1990).

The recent tourism literature comprisesmany studies on China’s emerging eTourism(Li & Lu, 2006; Wei, Li, Wang, & Guo, 2006;Wen & Zhang, 2006; Yang, 2001; Zhang,2005). These prior studies had indicated thatChina’s e-tourism market generally has threemain problems, including:

1. level of tourism network’s informationis low, ununiformly developed, and haslarge discrepancy in different regions;

2. tourism websites’ construction level islow and these websites often imitateforeign ones; and

3. organizations lack the experts who hadthe right knowledge in e-business(Wang, 2000; Yang, 2001; Zhou &Shi, 2005

In spite of the growing popularity ofDMO websites in China, the existing litera-ture has only a couple of published articles

that are related to China’s DMO websites. Intheir study, Feng, Morrison, and Ismail(2003) compared marketing strategies, webpage design, marketing information, andtechnical qualities of DMO websites inChina and the United States from a quali-tative point of view instead using of ascientific approach. In addition, Qi et al.(2007) initially examined the design ofChina’s DMO websites but their findingswere limited to a general description. Thisresearch extends Qi et al.’s (2007) work bymodifying Au Yeung and Law’s (2003, 2006)usability evaluation model to Chinese DMOwebsites. Different from the previous study,findings of this research should enable read-ers to determinate what the tourists, ITprofessionals, and tourism employees arelooking for from DMO websites. It can alsohelp website developers sense how to satisfyand better serve different types of users.More importantly, this research attempts toinvestigate the relationship of usability per-formance and provincial tourism income. Inorder to explore the correlation betweenwebsite performance and regional tourismdevelopment, the 31 key Chinese provincesand autonomous municipalities were classi-fied into two groups of destinations withhigh and low tourism incomes based on TheYear Book of China Tourism Statistics(China National Tourism Administration[CNTA], 2006). Naturally, one might expectthat higher tourism revenues in a regionshould be related to better website usabilityperformance.

METHODOLOGY

This exploratory research endeavors toachieve a better understanding of China’sDMO websites and to produce useful eva-luation results for improvement. In thisstudy, a modified heuristic evaluationmethod was adopted. The examinationapproach was divided into four stages of:(a) finding out the key criteria for DMOwebsites’ usability, (b) identifying andevaluating the 31 Chinese provincial and

186 JOURNAL OF TRAVEL & TOURISM MARKETING

Downloaded By: [Hong Kong Polytechnic University] At: 13:27 30 December 2009

autonomous municipal DMO websites, (c)calculating hazard indices of China’s DMOwebsite usability, and (d) analyzing China’sDMO website performance and offeringsuggestions for further development.

Questionnaires and Respondents

To develop a comprehensive instrument,new usability criteria were established toevaluate Chinese DMO websites’ usability.These criteria included 30 attributes thatcombine DMO websites’ success factors withwebsite usability hazard criteria. The websiteusability hazard criteria were selected fromthe study of Nielsen (2000, 2003) andAbeleto (Sprengers, 2004). In addition, thesuccess factors for DMO websites wereselected from published articles (Douglas &Mills, 2004; Ismail, Labropoulos, Mills, &Morrison 2002; Kaplanidou & Vogt, 2004;So & Morrison, 2004; WTOBC, 2001, 2005).All of these criteria were based on theirapplicability to the travel destination indus-try. For instance, the criteria of ‘‘No relevantlinks (airport, travel agencies)’’ and ‘‘poordestination information presentation’’ wererelated to the examination of the perfor-mance of destination websites.

These criteria were divided into fivedimensions as proposed by Abeleto(Sprengers, 2004). These dimensionsincluded: (a) Language, which refers to thechoice of words used to present informationon the web, (b) Layout that relates to howelements are visually rendered on the webpage, (c) Information Architecture that isrelated to how the content and features of awebsite are arranged, (d) User Interface andNavigation, which determine the ease ofnavigating through content, and (e) Generalthat refers to download speed, generalpractice of design, and maintenance.

Two questionnaires were developed in thisresearch in mid-2006. The first questionnaireaimed at working out the usability criteriafor DMO websites according to respondents’perceptions and ratings of the usabilityhazard criteria of DMO websites. Using aconvenient sample, the first questionnaire

was sent by e-mail to three groups ofconsumers, travel industry professionals,and IT professionals, who had prior experi-ence of using DMO websites. Thirty peoplewere included in each of these groups, whorepresented the users and designers of DMOwebsites. The second questionnaire was toevaluate the 31 Chinese provincial andautonomous municipal DMO websites. Inthis research, 12 users of Chinese DMOwebsites participated in the evaluation. Ineach group there were two evaluators whowere responsible for evaluating five or sixwebsites. Although Nielsen (2003) had pro-posed used five users to evaluate a website,such an attempt was for evaluating iterativedesign, and is thus considered unnecessary inthis study for evaluating developed websiteswith an established instrument. According toWan (2002), using two assessors to evaluate awebsite can solve the problem of personalbias. Cappel and Huang (2007) echoed such aclaim, and evaluated 500 company websitesby two evaluators. During the website evalua-tion, two evaluators shared their experienceand discussed their point of view and one ofthe authors was present during the evaluationto answer queries. The evaluation results werethen used to calculate usability hazard indicesfor all DMO websites. Each DMO websitehad its own score that reflects the usabilityperformance in each dimension.

The Modeling Process

As previously stated, this research adoptsAu Yeung and Law’s (2003, 2006) modifiedheuristic evaluation model on the selectedDMO websites. In the first questionnaire,respondents were required to rate eachusability criterion according to their percep-tions on the negative impact to a DMOwebsite. The criteria were ranked from themost offensive to the least offensive withineach dimension. The respondents were alsorequested to weigh the relative importance oftheir responses so that an Importance Indexfor each usability criterion within a dimen-sion can be calculated according toEquation (1) as listed below. In addition,

Qi, Law, and Buhalis 187

Downloaded By: [Hong Kong Polytechnic University] At: 13:27 30 December 2009

the percentage of relative importance indexof the each criterion is from a specificdimension. Therefore, the sum of relativeImportance Indices within a dimensionequals 100%.

Importance Indexr~ T :Pð Þz E:Qð Þ

z IT :Rð Þð1Þ

T~Tr

.Xn

r~1Tr~The percentage of stan-

dard r in its category from the perception ofconsumers.P~

Pmi~1 Pi=m~weighted percentage of

consumers’ opinions.T?P 5 weighted percentage of criterion r inconsumers’ opinion.E~Er

�Pnr~1 Er~percentage of standard r

in its category from the perspective of travelindustry professionals.Q~

Pmi~1 Qi=m~weighted percentage of

travel industry professionals’ opinion.E?Q 5 weight of criterion r in travel industryprofessionals’ opinion.IT~ITr

�Pnr~1 Tr~percentage of standard r

in its category from the perspective of ITprofessionals.R~

Pmi~1 Ri=m~weighted percentage of IT

professionals’ opinion.IT?R 5 weighted percentage of criterion r inIT professionals’ opinion.x 5number of respondents in the consumersgroup.y 5number of respondents in the travelindustry professionals group.z 5number of respondents in the IT profes-sional group.m 5total number of respondents; where m 5

x + y + z.n 5number of criteria within a dimension.T 5 mean score for the rth criteriongenerated from customers; r 5 1, 2, …, n.Er~mean score for the rth criterion gener-ated from travel industry professionals; r 5

1, 2, …, n.ITr~mean score for the rth criterion gener-ated from IT professionals; r 5 1, 2, …, n.Pi 5 relative importance of responses fromthe tourist group generated from the ith

respondent; i 5 1, 2, …,m; where P + Q +R5 100%.

Qi 5 relative importance of responses fromthe tourism employee group generated fromthe ith respondent; i 5 1, 2, …,m; where P +Q + R5 100%.Ri 5 relative importance of responses fromthe IT professional group generated from theith respondent; i 5 1, 2, …m; where P + Q +R5 100%.Ir 5importance index of criterion r; r 5 1, 2,…, n.

Based on these importance indices a newchecklist of criteria for DMO website usabil-ity was established. Naturally, the higher acriterion’s score is, the more important it isfor a DMO website from the respondents’perspective.

The Website Sampling and EvaluationProcess

Thirty-one DMO websites were selectedfor all provinces and autonomous municipa-lities in China. As previously discussed, amodified evaluation method was adopted inthis research. The evaluators were requestedto evaluate DMO websites based on a 5-pointrating scale (Sekaran, 2003). The scale used inthis research included ‘‘no problem on thiscriterion,’’ ‘‘minor problems,’’ ‘‘medium pro-blems,’’ ‘‘major problems,’’ and ‘‘destructiveproblems.’’ In order to reduce the chance ofvariability, the evaluation was conducted inthe same location. For each DMO websiteand in each criterion, a mean rating score wascalculated based on the result of groupevaluation. Usability Hazards Indices werecalculated by Equations 2 to 4.

Usability Hazard Index of criterionr

~ Sr{1� ��

I�5ð2Þ

Index of dimesion~C1zC2zC3

z � � �zCn

ð3Þ

Usability Hazard Index of a

Chinese DMO website~Xn

i~1Ui

ð4Þ

n 5number of criteria within a dimension i, i5 1, 2, …, 5.

188 JOURNAL OF TRAVEL & TOURISM MARKETING

Downloaded By: [Hong Kong Polytechnic University] At: 13:27 30 December 2009

Sr~mean rating score for the rth criterion; r5 1, 2, …, n.Ir 5importance index of criterion r; r 5 1, 2,…,n.Cr 5usability hazard index of criterion r; r 5

1, 2, …, n.Ui 5usability hazard index of dimension i, i5 1, 2, …, 5.D5usability hazard index of a DMO website.

Equation parses. Parameter Sr refers to themean rating score of each criterion. The scaleranged from 1 to 5. Therefore, equation(Sr21)*Ir*5 undergoes the following computa-tion process.

Firstly, if the rating score is 1, it implies thereis ‘‘no problem’’ in the criterion. So Sr-1 wasused to verify values ranging from 0 to 4.Secondly, (Sr21)*Ir*5 was used to get Crwhich has a value of 0 to 20. In this way, everydimension’s minimum value is 0 and maximumvalue is 20. The five dimensions’ total valuethus ranges from 0 to 100. In total, the usabilityhazard index of a DMO website was generatedwith minimum score ‘‘0’’ to maximum score‘‘100.’’ Lower scores mean fewer problemswere found on the website, and higher scoresimply more problems. In order to presentbetter evaluation results for different destina-tion categories, the results of usability hazardindex can be divided into four levels using anequal percentile approach. Usability hazardindices with scores in the range of 0 to 25belong to level 1 that means minor problemswere found on this website. Usability hazardindices with a score ranging from 25.01 to 50belong to level 2, which means mediumproblems were found on the website. A scoreof 50.01 to 75 is at level 3 that shows majorproblems were found on a website. Lastly, anindex of 75.01 to 100 is at level 4 that impliesdestructive problems were found on a website.

FINDINGS AND ANALYSIS

Different Opinions from Different Groups

The findings of importance indices ofusability criteria were collected from three

different groups of respondents includingconsumers, IT professionals, and travelindustry professionals. Table 3 shows theopinions of different groups of respondentsfor each dimension and criterion. Accordingto Table 3, the criteria that are related towebsite service and pertinent standards onwebsite operation were scored higher thanothers. This means that the respondents paidmore attention to these website usabilitycriteria. Nonetheless, the perspectives ofusability criteria are still different amongthe three groups. The consumer group hadhigher scores for criteria on website’s ‘‘easeof use’’ and ‘‘service functions.’’ Forinstance, the criteria of ‘‘without an internalsearch engine’’ and ‘‘doesn’t have a ‘go back’button’’ received the highest scores ascompared to the other groups. This, in turn,leads to the connotation that these criteriaare more important to this group of respon-dents and they will affect their impression onwebsite usability performance. In addition,respondents in the IT professional groupseemed to care more about the performanceof websites’ technological functions. Toillustrate, the criteria of ‘‘dead links’’ and‘‘program not accurate’’ received the highestscores as compared to other groups. Such afinding could be due to the influence of thesecriteria to respondents’ impression. Lastly,the travel industry professional group paidmore attention to websites’ general perfor-mance, service functions, and targetingmarket. Criteria such as ‘‘poor presentationof destination information,’’ ‘‘no separateinformation for business partners,’’ and‘‘lacking of international service’’ all gotthe highest scores as compared to othergroups.

Results of Importance Indices

On the basis of the successfully completedquestionnaires from consumers, travel indus-try professionals, and IT professionals, theimportance indices of the five dimensions arepresented in Tables 4 to 8.

The following analysis is based on therespondents’ general perceptions about

Qi, Law, and Buhalis 189

Downloaded By: [Hong Kong Polytechnic University] At: 13:27 30 December 2009

importance indices of the usability criteria ineach dimension. If a criterion received ahigher score, it means that it has a higherlevel of hazards.

TABLE 3. Respondents’ Perception of Usability Criteria

Dimension 1. Language Mean Scorefrom the

Tourist Group

Mean Scorefrom the IT

Professional Group

Mean Scorefrom the Travel

Employee Group

1. Spelling and grammar mistakes 1.93 2.03 2.20

2. Use lots of Internet jargon buzzwords 1.47 1.43 1.50

3. Text is not readable and understandable (including headlines) 2.60 2.53 2.30

Dimension 2. Website Layout

1. Using graphical bullet/divider bars in a wrong way 4.50 5.33 5.17

2. Webpage is too long 3.93 3.80 3.90

3. Horizontal scrolling under the common screen’s resolution 4.47 3.93 3.87

4. No separate print document 2.70 2.13 2.40

5. Non-standard text colors 3.67 3.80 3.93

6. Disordered website structure 5.23 5.77 5.70

7. Not using multimedia images 3.50 3.33 2.87

Dimension 3. Information Architecture

1. Doesn’t mark changed URL on the old website 3.47 4.43 3.60

2. Poor information on data’s source 3.73 3.93 3.50

3. Improper use of systematic navigation labelling 4.80 4.43 4.87

4. Poor presentation of destination’s information 6.13 6.20 6.50

5. No relevant links (airport, travel agencies) 3.87 3.50 3.97

6. No separate information for business partners 1.90 2.13 2.23

7. No comment mechanism and tourism destination forum 4.00 3.37 3.23

Dimension 4. User Interface and Navigation

1. Link opens in a new browser window 3.77 4.27 4.13

2. Imperfect basic webpage elements 4.17 4.07 4.60

3. Dead links 7.07 7.20 6.30

4. Lack of navigation support 4.77 5.47 6.17

5. The colour of visited hyperlinks is not significant 2.97 2.73 2.33

6. Lack of international service 3.03 2.70 3.63

7. Doesn’t have a ‘‘go back’’ button 4.63 4.37 4.27

8. Without an internal search engine 5.60 5.20 4.57

Dimension 5. General

1. Long sever response time 3.67 3.63 4.27

2. Download time is too long 2.77 2.97 2.80

3. Bad browser compatibility 3.47 3.20 3.07

4. Program is not accurate 3.30 3.43 3.17

5. No accessible pages for disabled people 1.80 1.77 1.87

TABLE 4. Importance Indices of UsabilityCriteria in Dimension 1

Dimension 1. Language Importance

1. Spelling and grammar mistakes 0.339

2. Use lots of Internet jargon buzzwords 0.245

3. Texts are not readable and

understandable (including the headlines)

0.416

TABLE 5. Importance Indices of UsabilityCriteria in Dimension 2

Dimension 2. Website Layout ImportanceIndex

1. Using graphical bullet/divider bars in a

wrong way

0.175

2. Webpage is too long 0.139

3. Horizontal scrolling under the common

screen’s resolution

0.149

4. No print-out options 0.189

5. Nonstandard text colors 0.135

6. Disordered website structure 0.196

7. Not using multimedia images 0.117

190 JOURNAL OF TRAVEL & TOURISM MARKETING

Downloaded By: [Hong Kong Polytechnic University] At: 13:27 30 December 2009

Dimension 1—Language. This dimensionpresents the usage of language on a website.As indicated in Table 4, the importanceindex of ‘‘texts are not readable and under-standable’’ has the highest score among allcriteria in this dimension. This implies that‘‘texts are not readable and understandable’’is a major hazardous criterion for websiteusability. On the other hand, the criterion of

‘‘Internet jargons’’ is less hazardous ascompared to other criteria.

Dimension 2—Website Layout. Thisdimension refers to the layout and graphicsused on a website and how the elements arevisually displayed. As indicated in Table 5,the importance index of ‘‘disordered websitestructure’’ has the highest index score, butthe ‘‘not using multimedia images’’ criterionscored the lowest in this dimension. Thisshows that the respondents expect a clearwebsite layout that can offer an explicit andclear web context. On the other hand, therespondents were less concerned whether theinformation on the web was presentedtogether with pictures, videos, and othermultimedia.

Dimension 3—Information Architecture.This category refers to how a websitearranges its content and features. It isobvious in Table 6 that the importance indexof ‘‘poor presentation of destination’s infor-mation’’ scored the highest among all criteriain this dimension. In addition, the importantindex of ‘‘no separate information for busi-ness partners’’ was scored the lowest. Thisindicates that the respondents would like tohave rich and colorful information about adestination that includes information onshopping areas, attractions, transportation,pricing, general travel information, andrestaurants. Failed destination informationpresentation may generate a very poor imageto the usability performance of a destinationwebsite. In contrast, respondents were lessconcerned with whether the website con-tained information for business partners.

Dimension 4—User Interface and Naviga-tion. This dimension is to show how easyit is for a user to navigate through adestination website. As shown in Table 7,the importance indices of ‘‘dead links’’ and‘‘the color of visited hyperlinks is notsignificant’’ were scored the highest andlowest, respectively. This means dead websiteinternal links will disappoint respondentsand negatively affect their opinions on the

TABLE 6. Importance Indices of UsabilityCriteria in Dimension 3

Dimension 3. Information Architecture ImportanceIndex

1. Doesn’t mark changed URLs on the old

website

0.134

2. Poor information on data’s source 0.133

3. Improper use of systematic navigation

labeling

0.169

4. Poor presentation of destination’s

information

0.225

5. No relevant links (airports, travel agencies) 0.136

6. No separate information for business

partners

0.073

7. No comment mechanism and tourism

destination forum

0.130

TABLE 7. Importance Indices of UsabilityCriteria in Dimension 4

Dimension 4. User Interface and Navigation ImportanceIndex

1. Links open in a new browser window 0.111

2. Imperfect basic webpage elements 0.118

3. Dead links 0.191

4. Lacking of navigation support 0.148

5. The color of visited hyperlinks is not

significant

0.076

6. Lacking of international service 0.087

7. Doesn’t have a ‘‘Go Back’’ button 0.124

8. Without an internal search engine 0.145

TABLE 8. Importance Indices of UsabilityCriteria in Dimension 5

Dimension 5. General ImportanceIndex

1. Long sever responding time 0.255

2. Download time is too long 0.185

3. Bad browser compatibility 0.219

4. Program is not accurate 0.220

5. No accessible pages for disabled people 0.121

Qi, Law, and Buhalis 191

Downloaded By: [Hong Kong Polytechnic University] At: 13:27 30 December 2009

website. However, the respondents thoughtthat the color of visited hyperlinks wasrelatively unimportant.

Dimensions 5—General Criteria. Thisdimension determines the general perceptionof a website including server’s respondingtime, download time, browser compatibility,program accuracy, and website accessibilityfor disable people. As reflected in Table 8,the importance index of ‘‘long sever respond-ing time’’ was scored the highest in thisdimension. This indicates that the respon-dents would not wait too long when they aretrying to open a webpage. Still, the accessi-bility for disabled users did not seem to be amajor concern.

Overall Usability Hazard Indices ofChina’s DMO Websites

The results in general usability hazardindices are shown in Tables 9 to 14. Asindicated in Table 9, the language dimensionwas scored 3.681. This value shows that

TABLE 9. Usability Hazard Indices of ChineseDMO Websites in Dimension 1

Dimension 1. Language UsabilityHazard

1. Spelling and grammar mistakes 1.695

2. Use lots of Internet jargon buzzwords 0.040

3. Texts are not readable and understandable

(include the headlines)

1.946

Dimension total 3.681

TABLE 10. Usability Hazard Indices of ChineseDMO Websites in Dimension 2

Dimension 2. Website Layout UsabilityHazards Index

1. Using graphical bullet/divider bars in

a wrong way

0.395

2. Webpage is too long 1.076

3. Horizontal scrolling under the common

screen’s resolution

0.096

4. No print-out options 1.120

5. Nonstandard text colors 0.697

6. Disordered website structure 1.201

7. Not using multimedia images 0.642

Dimension total 5.227

TABLE 11. Usability Hazard Indices of ChineseDMO Websites in Dimension 3

Dimension 3. Information Architecture UsabilityHazards

Index

1. Doesn’t mark changed URLs on the old

website

1.340

2. Poor information on data’s source 1.030

3. Improper use of Systematic navigation

labeling

0.273

4. Poor presentation of destination’s information 0.980

5. No relevant links (airports, travel agencies) 0.680

6. No separate information for Business partners 0.365

7. No comment mechanism and tourism

destination forum

0.671

Dimension total 5.339

TABLE 12. Usability Hazard Indices of ChineseDMO Websites in Dimension 4

Dimension 4. User Interface and Navigation UsabilityHazards Index

1. Links open in a new browser window 0.895

2. Imperfect basic webpage elements 0.571

3. Dead links 1.140

4. Lacking of navigation support 0.477

5. The color of visited hyperlinks is not

significant

0.785

6. Lacking of international service 1.235

7. Doesn’t have a ‘‘Go Back’’ button 0.920

8. Doesn’t have an internal search engine 1.169

Dimension total 7.192

TABLE 13. Usability Hazard Indices of ChineseDMO Websites in Dimension 5

Dimension 5. General UsabilityHazards Index

1. Long sever responding time 1.357

2. Download time is too long 1.208

3. Bad browser compatibility 0.071

4. Program not accurate 0.958

5. No accessible pages for disabled people 2.098

Dimension total 5.692

TABLE 14. Usability Hazard Indices of ChineseDMO Websites

Dimensions UsabilityHazards Index

Dimension 1. Language 3.681

Dimension 2. Website Layout 5.227

Dimension 3. Information Architecture 5.339

Dimension 4. User Interface and Navigation 7.192

Dimension 5. General 5.692

Industry performance 27.131

192 JOURNAL OF TRAVEL & TOURISM MARKETING

Downloaded By: [Hong Kong Polytechnic University] At: 13:27 30 December 2009

minor problems were found in this dimen-sion. China’s DMO websites should usemore simple words to make their texts morereadable.

Table 10 shows that the usability hazardindex in Dimension 2 ‘‘website layout’’ is5.227, which is much lower than the maximalscore of 20. This finding demonstrates thatthe DMO websites have medium problems inthis dimension. As revealed by the data, theusability criterion of ‘‘disordered websitestructure’’ was scored 1.201 and is thehighest in this dimension. China’s DMOwebsite developers should; therefore, paymore attention to websites’ structures.

Table 11 shows that the usability hazardindex in Dimension 3 of ‘‘informationarchitecture’’ was scored 5.339, implyingthat China’s provincial DMO websites havemedium problems in this dimension. Inaddition, the attribute of ‘‘doesn’t markchanged URLs on the old website’’ wasscored the highest in this dimension. TheDMO website developers in China shouldpresent a new link on the old website when aweb address has been changed.

Table 12 presents the usability hazardindex of Dimension 4. In the research, ‘‘userinterface and navigation’’ has an index of7.192, which is the highest among alldimensions. In other words, this dimensionhas the worst performance on China’s DMOwebsites as compared to other dimensions.In addition, the criterion of ‘‘lacking ofinternational service’’ was scored the highest.China’s DMO websites should provide moreinternational services such as to improve thequality of the websites’ English version andto present their content in other languages.

In Table 13, the usability hazard index forDimension 5, ‘‘general,’’ was scored 5.692.This indicates that medium problems werefound on the websites. The attribute that hasthe worst performance was ‘‘no accessiblepages for disabled people’’ which was scored2.098. In other words, the websites did notprovide the necessary service to physicallychallenged users.

The DMO website usability hazard indicesin each dimension are shown in Table 14.

The sum of the five dimensions’ usabilityhazard indices, which is the industrialperformance, was scored 27.131. As pre-viously indicated, this finding belongs tolevel 2, which implies medium problems werefound on China’s DMO websites. Abeleto(Sprengers, 2004) stated that mediumhazards can cause the loss of visitors if thesefactors cannot be improved. It is unlikemajor hazards that can lead to criticaldamage on a website.

Results of Different Categories ofDestinations in China

All usability hazard indices were listed inTable 15 and Table 16. In order to explorethe correlation between website performanceand regional tourism development, the 31key Chinese provinces and autonomousmunicipalities were classified into twogroups according to their total tourismincome in 2005 (CNTA, 2006). Sixteenregions were classified as high tourismincome which means the total tourismincome in each of these regions was morethan RMB6 billion, the median value of allregions. The remaining 15 regions were thenclassified as low tourism income group.

According to Table 15, the overall hazardindex for the high tourism income regionswas 26.822, indicating medium problemswere found on these websites. The regionthat had the best usability performance isBeijing that had an overall score of 15.740;whereas the regions that had the worstusability performance are Sichuan andHebei provinces—both received the samescore of 33.160. Guangdong province hadthe highest tourism income, but its usabilityhazard index was 32.460. For the websites ofhigh tourism income, Dimensions 1 and 5had the least and the worst problems,respectively.

There were 15 regions in the low tourismincome group (Table 16). The average usabil-ity hazard index was 27.712, which meansthat these tourism websites had mediumproblems. The website of Anhui provincehad the least problem (scored at 21.488), and

Qi, Law, and Buhalis 193

Downloaded By: [Hong Kong Polytechnic University] At: 13:27 30 December 2009

TABLE 15. Usability Hazard Indices of Destinations High Tourism Income More Than 6 BillionRMB

Dimension 1. Language 2. WebsiteLayout

3. InformationArchitecture

4. UserInterface and

Navigation

5. General UsabilityHazard Index ofDMO Websites

Total TourismIncome Billion

RMBProvince

Hena 3.775 7.425 6.415 7.990 6.813 32.018 6,131,777,100

Hunan 3.775 6.738 5.125 6.160 11.220 33.018 6,134,438,100

Guangxi 3.775 5.390 2.670 5.435 6.280 23.550 6,380,689,800

Hubei 3.775 4.660 4.460 7.830 7.013 27.738 6,726,849,100

Fujian 3.775 6.375 8.675 6.755 7.013 32.593 6,767,746,600

Hebei 3.775 5.930 7.680 7.855 7.920 33.160 6,958,152,900

Guizhou 3.775 2.510 0.670 3.965 7.470 18.390 7,026,761,700

Yunnan 5.000 5.925 7.575 4.730 4.620 27.850 8,122,685,700

Liaoning 3.775 6.730 2.640 5.350 9.020 27.515 9,519,912,100

Sichuan 3.775 5.930 7.680 7.855 7.920 33.160 12,049,831,600

Shandong 3.775 5.545 3.690 7.545 3.520 24.075 12,519,310,200

Zhejiang 3.775 3.685 4.050 4.505 2.438 18.453 20,370,141,100

Jiangsu 3.775 6.235 4.715 3.080 3.713 21.518 22,392,006,100

Shanghai 3.775 4.575 4.915 7.425 7.140 27.830 31,453,633,300

Beijing 3.775 3.290 2.685 3.075 2.915 15.740 40,115,447,400

Guangdong 3.775 9.885 3.400 7.480 7.920 32.460 72,054,044,100

Average 3.851 5.677 4.815 6.047 6.432 26.822

Note. The overall usability hazard index: 0.00–25.00 5 level 1, which means minor problems were found on this website; 25.01–50.00 5 level2, which means medium problems were found on this website; 50.01–75.00 5 level 3, which means major problems were found on thiswebsite; 75.01–100.00 5 level 4, which means destructive problems were found on this website.

TABLE 16. Usability Hazard Indices of Destinations with Tourism Income Lower Than 6 BillionRMB

Dimensions 1. Language 2. WebsiteLayout

3. InformationArchitecture

4. UserInterface and

Navigation

5. General Usability HazardIndex of DMO

Websites

TotalTourism Income

Billion RMBProvince

Tibet 3.775 4.950 4.425 3.865 4.620 21.635 381,225,500

Qinghai 3.775 5.550 6.915 8.300 3.345 27.885 404,049,300

Ningxia 3.775 6.425 7.295 13.615 7.920 39.030 815,818,000

Nei Menggu 1.695 2.290 9.450 8.415 2.420 24.270 1,648,154,400

Gansu 3.775 7.115 8.785 6.420 4.620 30.715 1,798,769,200

Jilin 1.695 4.325 8.505 9.935 2.420 26.880 2,324,890,600

Heilongjiang 3.775 3.310 3.595 7.290 5.720 23.690 3,238,843,000

Tianjin 3.775 4.035 4.640 7.225 6.040 25.715 3,463,862,700

Jiangxi 3.775 5.925 8.015 11.445 5.720 34.880 3,653,787,600

Hainan 3.775 5.540 2.670 6.540 3.713 22.238 3,851,726,200

Xinjiang 3.775 7.878 6.455 10.515 4.445 33.068 4,431,841,300

Shaanxi 3.775 3.665 4.430 9.535 10.120 31.525 4,439,593,700

Anhui 3.775 5.360 3.795 5.945 2.613 21.488 4,489,361,200

Chongqing 3.775 3.985 4.000 5.915 5.720 23.395 4,967,020,800

Shanxi 3.775 3.200 9.455 9.145 3.695 29.270 5,004,382,900

Average 3.498 4.903 6.162 8.273 4.876 27.712

Note. The overall usability hazard index: 0.00–25.00 5 level 1, which means minor problems were found on this website; 25.01–50.00 5 level2, which means medium problems were found on this website; 50.01–75.00 5 level 3, which means major problems were found on thiswebsite; 75.01–100.00 5 level 4, which means destructive problems were found on this website.The foreign exchange rate was from Bank of China (2007).

194 JOURNAL OF TRAVEL & TOURISM MARKETING

Downloaded By: [Hong Kong Polytechnic University] At: 13:27 30 December 2009

the website that had the worst performanceis Ningxia province (scored at 39.030).Moreover, Dimensions 1 and 4 on DMOwebsites for low tourism income regions hadthe least and the worst problems, respec-tively.

In addition, the research findings alsoindicate the worst and the best performingdestinations. The best one is Beijing and theworst one is Ningxia. On Beijing’s website,the lowest score was 15.74, and the averagedimension score was around 3. The bestperforming dimension was InformationArchitecture. Additionally, the worst per-forming dimension on Beijing’s website wasLanguage. The Beijing DMO website devel-oper should improve the choice of words topresent information. On Ningxia’s DMOwebsite, the overall score was 39.03, andmost dimensions on the website scored morethan 6. Naturally, website developers ofNingxia should seriously consider makingimprovement in these dimensions. The mostcrucial improvement is, perhaps, to makebetter the dimension of User Interface andNavigation. Otherwise, users will simplyleave this website due to its poor structure.Also, it is important to arrange the websitecontent and features, and to make allelements aligned properly in an easy tounderstand way. Lastly, the DMO ofNingxia has been improved on its Generalperformance that related to the downloadspeed, general practice of design, and main-tenance.

Moreover, an attempt to find the correla-tion between tourism income and websiteusability performance was made. Thisresearch used Mann-Whitney U test, anindependent sample nonparametric test, toexamine the existence of significant differ-ence between the two groups of regions withdifferent levels of tourism income and their

websites’ usability performance (Table 17).Empirical findings showed that there is nosignificant difference between the high andlow tourism income groups and the websiteusability performance. In other words, thelevel of tourism development, which ismeasured by total tourism income, did notseem to significantly influence the websiteusability performance.

IMPLICATIONS ANDCONCLUSIONS

This study has adopted a modified heur-istic usability evaluation method to examinethe usability performance of 31 Chineseprovincial and autonomous municipalDMO websites. Research findings indicatethat the overall usability performance ofChina’s DMO websites was 27.131, indicat-ing these websites had medium problems.Although different regions have developedtheir DMO websites, usability does not seemto be incorporated into the website develop-ment process. This is evident by the fact thatthe overall usability performance of theanalyzed websites exhibited medium pro-blems.

According to the research findings, DMOwebsite designers should not only focus onthe problems of website usability but alsopay attention to what users are looking for.Based on the research findings, ChineseDMO users demand high quality websiteswhich are user-friendly. Tourism practi-tioners can determine, on the basis of theevaluated importance criteria, which attri-butes and criteria require more efforts onongoing improvement. In order to enhanceusers’ satisfaction of DMO websites, tourismpractitioners should improve their websitenavigation systems. In this way, users’ self

TABLE 17. Mann-Whitney U Test Results

High Tourism IncomeDestinations (n 5 16)

Low Tourism IncomeDestination (n 5 15)

Z Sig

Usability Hazard Index 26.822 27.712 20.158 0.892

Qi, Law, and Buhalis 195

Downloaded By: [Hong Kong Polytechnic University] At: 13:27 30 December 2009

searching will become more efficient.Moreover, providing clear website structureand more readable text on web pages cansurely help improve Chinese DMO usabilityperformance. As well, when a website haschanged its URL, clear information aboutthe new address should be presented.

An expected outcome for the relationshipbetween usability performance and regionaltourism revenues could be the existence of anegative relationship. That is, lower revenuecould render less satisfactory website perfor-mance. However, findings of this researchdid not show such a relationship. Still, allregions should continuously devote theirresources on ongoing website improvement.

Since a consensus has not been reached onwhat the best criteria and practices are,Morrison et al. (2004, p. 246) stated that ‘‘itis impossible at this point to pinpoint thestate of the art in Website evaluation fortourism and hospitality.’’ Still, findings ofthis study can offer some useful implicationsto tourism managers. First, tourism man-agers can apply, and possibly further modify,the approach to measure their websites’performance. The numeric scores would bevital for practitioners to understand howappealing their websites are to users, todetermine within-sector performance, and tojudge a website’s performance versus itspeer. Additionally, the approach presentedin this study appears repeatable, measurable,and has the potential to form a long-termmetric that would assist refinement of an e-tourism program. Also, research outcomeswill offer further insights on setting new e-metric standards and creating new e-metricsto measure a tourism business’s achievement.

A successful DMO website should notonly serve as a data repository of destinationinformation. It should also serve as an easy-to-use platform. This research; therefore, canbe regarded as a benchmark for furtheranalysis of the usability of DMO websitesusing quantitative modeling techniques.Findings of this research can also help travelwebsite developers in general and DMOwebsite developers in particular on designand the subsequent promotion.

The usability evaluation model, after all, isperception based, which renders its difficultyto generalize the findings. Longitudinal andrepeated studies can, and should, be able toeliminate any potential bias. Also, althoughthis research had evaluated 31 DMO web-sites in China, the country’s fast develop-ment certainly deserves ongoing researchendeavors on evaluating its tourism websiteson a regular basis. In addition to conductinga longitudinal study of the DMO websites,other destination websites can be evaluatedin future studies. Another future researchpossibility is to compare and contrastdifferent groups of DMO websites in differ-ent countries and using other separationmethods such as per capita income andnumber of tourist attractions.

REFERENCES

Agarwal, R., & Venkatesh, V. (2002). Assessing a

firm’s web presence: A heuristic evaluation proce-

dure for the measurement of usability. Information

Systems Research, 13(2), 168-186.

Au Yeung, T., & Law, R. (2003). Usability evaluation

of Hong Kong hotel websites. In A. J. Frew, M.

Hitz, & P. O’Connor (Eds.), Information and

communication technologies in tourism 2003 (pp.

261-269). Wien: Springer.

Au Yeung, T., & Law, R. (2006). Evaluation of usability:

A study of hotel web sites in Hong Kong. Journal of

Hospitality & Tourism Research, 30(4), 1-22.

Bank of China. (2007). Foreign exchange rate.

Retrieved February 2, 2007, from http://www.boc.

cn/cn/common/whpj.html

Benckendorff, P. J., & Black, M. L. (2000).

Destination marketing on the Internet: A case

study of Australian regional tourism authorities.

Journal of Tourism Studies, 10(1), 11-21.

Buhalis, D. (2000). Marketing the competitive destina-

tion of the future. Tourism Management, 21(1), 97-

116.

Buhalis, D. (2003). E-tourism: Information technology

for strategic tourism management. Englewood Cliff,

NJ: Prentice Hall.

Buhalis, D. (2005). Information technology in tourism.

In C. Cooper, J. Fletcher, D. Gilbert, A. Fyall, & S.

Wanhill (Eds.), Tourism: Principles and practice

(pp. 702-730). London: Pearson.

Cappel, J. J., & Huang, Z. (2007). A usability analysis

of company websites. Journal of Computer

Information Systems, 48(1), 117-123.

196 JOURNAL OF TRAVEL & TOURISM MARKETING

Downloaded By: [Hong Kong Polytechnic University] At: 13:27 30 December 2009

China a top tourist destination by 2020. (2004, May

13). China Daily News. Retrieved July 15, 2006,

from http://www.chinadaily.com.cn/english/doc/

2004-05/13/content_330514.htm

China Internet Network Information Center. (2007).

Statistical report on the Internet development in

China. China: Author.

China National Tourism Administration. (2006). The

year book of China tourism statistics. Beijing: China

Tourism Press.

Cui, F. J. (2002). The innovation and development of

Chinese tourism destination. China: China Tourism

Publishing Company.

Douglas, A., & Mills, J. E. (2004). Staying afloat in the

tropics: Allying a structural equation model

approach to evaluating national tourism organiza-

tion website in the Caribbean. In R. Law & J. Mills

(Eds.), Handbook of consumer behaviour, tourism,

and the Internet (pp. 269-293). New York: Haworth.

Elges, M. (2004). Why worry about web site usability?

Credit Union Executive Newsletter, 30(19), 8.

Feng, R., Morrison, A. M., & Ismail, A. J. (2003). East

versus West: A comparison of online destination

marketing in China and the USA. Journal of

Vacation Marketing, 10(1), 43-56.

Ham, S. (2004). Developing a content analysis evalua-

tion approach for the examination of limited-

service lodging properties. Journal of Travel &

Tourism Marketing, 17(2/3), 295-308.

Hanna, J. R. P., & Millar, R. J. (1997). Promoting

tourism on the Internet. Tourism Management,

18(7), 469-470.

Hu, X. Q., Zeng, H., & He, Y. M. (2006). Impact of e-

tourism on Chinese tourism industry and future

developing suggestion. Market Modernization, 478,

94-95.

Ismail, J. A., Labropoulos, T., Mills, J. E., &

Morrison, A. (2002). A snapshot in time: The

marketing of culture in European Union NTO web

sites. Tourism Culture & Communication, 3(3), 165-

179.

Kaplanidou, K., & Vogt, C. (2004). Destination

marketing organization websites (DMOs) evaluation

and design: What you need to know? Retrieved

February 18, 2007, from Michigan State University

Web site: http://www.travelmichigannews.org/

Research.htm

Kim, W. G., & Lee, H. Y. (2004). Comparison of web

service quality between online travel agencies and

online travel suppliers. Journal of Travel & Tourism

Marketing, 17(2/3), 105-116.

Kotler, P., Bowen, J., & Makens, J. (2003). Marketing

for hospitality and tourism. Upper Saddle River, NJ:

Prentice Hall.

Li, Y. L., & Lu, Z. (2006). Comparative analysis of

Chinese and American tourism websites and the

prediction model of virtual distance attenuation.

Human Geography, 21(6), 115-118.

Liu, B. Y. (2004). Development, integration and

utilization of tourist information resources.

Library Tribune, 24(23), 145-147.

Ma, J., Buhalis, D., & Song, H. (2003). The adoption

of ICTs & Internet in China and impact to tourism

industry structure. International Journal of

Information Management, 23(6), 451-467.

Mack, R. L., & Nielsen, J. (1994). Executive summary.

In J. Neielsen & R. L Mack (Eds.), Usability

inspection methods (pp. 1-22). New York: John

Wiley & Sons.

Mills, J. E., & Morrison, A. M. (2000). Updated

Balanced Score Card Instrument. Retrieved January

15, 2007, from http://www.htmresearch.atfreeweb.

com/BSC

Morrison, A. M., Taylor, S., & Douglas, A. (2004).

Website evaluation in tourism and hospitality: The

art is not yet stared. Journal of Travel & Tourism

Marketing, 17(2/3), 233-251.

Morrison, A. M., Taylor, S., Morrison, A. J., &

Morrison, A. D. (1999). Marketing small hotels on

the World Wide Web. Information Technology &

Tourism, 2(2), 97-113.

Nielsen, J. (1992, May 3–7). Finding usability pro-

blems through heuristic evaluation. Proceedings

ACM CHI’92 Conference, Monterey, CA (pp. 373-

380). New York: ACM. Retrieved February 26,

2007, from http://portal.acm.org/citation.cfm?id5

142834&dl5GUIDE&coll5GUIDE&CFID5

77231111&CFTOKEN521603516

Nielsen, J. (1993). Usability engineering. London:

Academic Press.

Nielsen, J. (1994). Heuristic evaluation. In J. Nielsen &

R. L. Mack (Eds.), Usability inspection methods

(pp. 25-62). New York: John Wiley & Sons.

Nielsen, J. (2000). Designing web usability: The practice

of simplicity. New York: New Riders.

Nielsen, J. (2003). Usability 101: Introduction to

usability. Retrieved October 6, 2007, from http://

www.useit.com/alertbox/20030825.html

Nielsen, J., & Landauer, T. K. (1993, April 24–29). A

mathematical model of the finding of usability

problems. Proceedings of ACM INTERCHI’93

Conference, Amsterdam, The Netherlands (pp. 206-

213). New York: ACM. Retrieved February 26,

2007, from http://portal.acm.org/citation.cfm?id5

169059.169166

Nielsen, J., & Molich, R. (1990, April 1–5). Heuristic

evaluation of user interfaces. Proceedings of ACM

CHI’90 Conference, Seattle, WA (pp. 249-256). New

York: ACM. Retrieved February 26, 2007, from

http://portal.acm.org/citation.cfm?id597281&

dl5GUIDE&coll5GUIDE&CFID577231111&

CFTOKEN521603516

Qi, Law, and Buhalis 197

Downloaded By: [Hong Kong Polytechnic University] At: 13:27 30 December 2009

Nielsen, J., & Norman, D. A. (2000, February 14).

Usability on the Web isn’t a luxury. Information

Week, 773, 65-69.

Oertel, B., Thio, S. L., & Feil, T. (2001).

Benchmarking tourism destination in the

European Union. In P. J. Sheldon, K. W. Wooer,

& D. R. Fesenmaier (Eds.), Information and

communication technology in tourism 2001 (pp.

234-243). New York: Spring-Verlag Wien.

Olive, E. G. (2002). Usability: Marking the web work.

Intercom, 49(9), 8-10.

Pike, S. (2005). Destination marketing organisations.

Oxford: Elsevier.

Qi, S. S., Buhalis, D., & Law, R. (2007). Evaluation of

the usability of Chinese provincial DMO websites.

In M. Sigala, L. Mich, & J. Murphy (Eds.),

Information and communication technologies in

tourism 2007 (pp. 267-278). Vienna: Springer.

Ritchie, J. R. B., & Crouch, G. I. (2003). The

competitive destination. Oxford: CABI Publishing.

Sekaran, U. (2003). Research methods for business: A

skill building approach (4th ed.). New York: John

Wiley & Sons.

So, S. I., & Morrison, A. M. (2004). Internet market-

ing in tourism in Asia: An evaluation of the

performance of East Asian National Tourism

Organization Web Sites. Journal of Hospitality &

Leisure Marketing, 11(4), 93-118.

Sprengers, J. (2004). Objective evaluation of likely

usability hazards—Preliminaries for user testing.

Retrieved July 15, 2006, from http://www.abeleto.

nl/resources/articles/objective1.html

Tunnard, C. R., & Haines, P. (1999). Destination

marketing systems—A new role for tourist board

marketing in the information age. Journal of

Vacation Marketing, 1(4), 43-56.

Wan, C.-S. (2002). The web sites of international

tourist hotels and tour wholesalers in Taiwan.

Tourism Management, 23(2), 155-160.

Wang, S., Yu, T., & Avgoustis, S. (2005). The ‘‘The

Top City’’ Rating System: A case study of China’s

NTO functions. China Tourism Research, 1(2), 374-

384.

Wang, X. (2000). The status of Chinese e-tourism

developing in future. Social Scientist, 15(3), 50-54.

Wei, F. Y., Li, W. X., Wang, J., & Guo, J. F. (2006).

Research and development of tourism information

system based on web service and Microsoft NET

framework. Geomatics & Spatial Information

Technology, 29(4), 57-58.

Wei, M. (2006). Analysis on the usage of electronic

information technology in China’s tourism. Journal

of Kaifeng University, 20(4), 9-12.

Wen, Z. B., & Zhang, W. (2006). A study of China’s e-

tourism. Commercial Economics Review, 2, 13-15.

World Tourism Organization Business Council.

(2001). E-business for tourism, practical guidelines

for destinations and businesses. Madrid, Spain:

Author.

World Tourism Organization Business Council.

(2005). Evaluating and improving websites, the

destination web watch. Madrid, Spain: Author.

Wu, J. (2006). Chinese tourism: A case study of

Dunhuang—The Chinese travel destination of e-

Tourism development and analysis. Study of the

Productive Force, 1, 152-154.

Yang, L. (2001). A study on the problems and counter-

measures in development of China’s tourism

electronic business. Tourism Tribute, 16(6), 40-42.

Zhang, J. (2005). A case study of Shanghai Spring &

Autumn National Tourism administration—

Analysis of the successful case on large travel

agencies’ development of e-Tourism. Technoe-

conomics & Management Research, 6, 60-61.

Zhou, Y., & Shi, Y. (2005). The current situation of

Chinese e-tourism development and marketing

strategy and advises. Economics, 7, 117-118.

SUBMITTED: July 9, 2007FINAL REVISION SUBMITTED:

October 10, 2007ACCEPTED: October 22, 2007

REFEREED ANONYMOUSLY

198 JOURNAL OF TRAVEL & TOURISM MARKETING

Downloaded By: [Hong Kong Polytechnic University] At: 13:27 30 December 2009