Delphi Forecasting for Shipping Industry and Technology: Performance and Validity
Transcript of Delphi Forecasting for Shipping Industry and Technology: Performance and Validity
Electronic copy available at: http://ssrn.com/abstract=2239723
Delphi forecasting for shipping industry and technology: Performance and validity
1
Delphi forecasting for shipping industry and technology: Performance and validity
Okan Duru, Emrah Bulut, Shigeru Yoshida
Department of Maritime Transportation and Management Engineering,
Istanbul Technical University, Tuzla 34940, Istanbul, Turkey.
&
Department of Maritime Transportation Systems,
Kobe University, Higashinada 658-0022, Kobe, Japan.
Electronic copy available at: http://ssrn.com/abstract=2239723
Delphi forecasting for shipping industry and technology: Performance and validity
2
Delphi forecasting for shipping industry and technology: Performance and validity†
Okan Durua,*
, Emrah Bulutb, Shigeru Yoshida
b
aDepartment of Maritime Transportation and Management Engineering,
Istanbul Technical University, Tuzla 34940, Istanbul, Turkey.
bDepartment of Maritime Transportation Systems,
Kobe University, Higashinada 658-0022, Kobe, Japan.
Abstract
The aim of this paper is to investigate the performance of the Delphi group consensus
forecasting for the ship industry and technology. Delphi method is the most popular technique
for technology and long term forecasting and it is an aid in decision-making based on the
opinions of experts, which has been in existence for over half a century. The present research
considers its performance and validity particularly in the area of shipping industry. Three
existing applications in this field are reviewed which have some improvements and
drawbacks due to their objectives, the nature of subjects and properness according to the
recent developments of Delphi. These applications highlight how this technique may be
adapted to increase validity in the future studies. Finally, there is a statement of a number of
lessons learnt from the empirical studies, which may contribute to the successful outcome of a
Delphi practise in shipping industry.
Keywords: Technology forecasting; Delphi group decision; Shipping industry.
†An earlier version of this paper is presented at the First Global Conference on Innovation in
Maritime Technology and the Future of Maritime Transportation in Istanbul, Turkey,
November 24-26, 2010.
*Corresponding author. Tel: +81 90 9867 8949; fax: +81 78 431 6259. E-mail address:
Delphi forecasting for shipping industry and technology: Performance and validity
3
I. Introduction
Long term forecasting is a specific field of future sciences. It is used for various
purposes and applied by statistical and judgmental methods. Long term forecasting is mainly
implemented for technology forecasting task, but it is also frequently used for prediction of
the economic trends. In shipping business, long term forecasting applied by a limited research
and these studies have some typical structures such as the conventional literature. On the other
hand, these studies have some critical outcomes according to their methodology and
predictive accuracy.
The last century demonstrated the importance of technology forecasting in shipping
industry with developments that are thought as imaginary previously, but a new era is faced in
the course of time due to intelligent improvements of shipping industry. The shipping
technologies enhanced performance and effectiveness of seaborne transportation e.g.
invention of containers, combined carriers, increasing cargo handling speed, high
performance propulsion systems. Technologies affected operational and financial aspects of
shipping industry. Shipping markets are also orientated by technology in terms of pricing
services and ships. Forecasting ship technology has a crucial field of research because of such
impacts on shipping business.
Economic forecasting is also one of the important application areas of long term
prediction. Shipping investments and investments which are connected to the industry of
maritime affairs are mostly financed by commercial banks, and these investment projects are
required to be consistent for future fluctuations of the shipping market. Most of the shipping
projects are based on a long term schedule. For example, a merchant ship project is beginning
with acquisition of a second hand ship or signing a new building project, and it concludes by
completion of financial agreement or sale of investment. This schedule is distributed on 5 to
25 years in general according to conditions of the shipping markets. Such a long duration
Delphi forecasting for shipping industry and technology: Performance and validity
4
brings various operational and financial risks which are including risk of income and
unexpected upswings of several costs. In the banker’s perspective, it is defined as credit risk.
How to establish a long term prediction of economic aspects of shipping business is one of the
critical accounts of investors and lenders for clearing credit risk issue [1].
The recent work suggested some proper methods for econometric analysis and prediction
of the shipping markets [2]. Likewise, the judgmental forecasting is also providing some long
term forecasting methods, and it is applied by many scholars for various prediction purposes.
For long term judgmental forecasting, the Delphi methodology is the most popular approach
in the current literature, and it can be implemented for both technological and economic
visions. As a short term forecasting tool, it can be designed for the adjustment of statistical
extrapolation. For example, Duru et al [3] proposed a fuzzy-Delphi model for judgmental
calibration of the short term forecast in dry bulk freight market and introduced its superiority
by comparing with the statistical benchmark.
Delphi method is particularly accurate when the historical data is limited or the objectives
are completely judgmental. For instance, a technological development is a judgmental
statement and it must be treated by judgmental methods. We may measure technological
improvements by some variables such as average speed of ships, but it is not an explanation
of timing and content of developments. Kahn and Wiener [4] use different types of
forecasting techniques in their studies. Trend line fitting, Scenario planning and Delphi
technique are some of the methods in this seminal study. This research illustrates the Delphi
technique which provides successful forecasts at many of the scientific innovations.
Green, Armstrong and Graefe [5] pointed out some considerable application fields of
Delphi method in a review paper and listed the dry bulk shipping study among the other
globally important items. As our surveys, there are three considerable Delphi studies for
shipping industry in the existent literature. Frankel [6] investigates technology planning
Delphi forecasting for shipping industry and technology: Performance and validity
5
objective in shipping industry and expresses a Delphi forecasting experiment by Japan
Transport Economics Research Centre (JTERC) (1970). At the same time, Moore and
Pomrehn [7] investigated a technology focused forecasting study by Delphi methodology in
University of California. Furthermore, Ariel [8] tries to perform a long-term forecasting study
by Delphi methodology for mainly economic prediction of shipping business.
The main objective of the present paper is to compare initial expectations and results of
the Delphi applications in shipping business and the research attempts to conceive prominent
points and weaknesses according to the published papers about the methodology and
implementation of Delphi like procedures [9, 10]. Although the number of Delphi studies is
limited in shipping business, the current literature maintains several critical points about the
success of a Delphi study among the all other experiences in different application fields. In
the reference of these major evidences, the Delphi practice in shipping business is reviewed
and discussed.
The structure of this paper is as follows. Section 2 presents the Delphi technique among the
advantages and disadvantages of method. Section 3 presents the empirical studies of JTERC
(1970), Moore and Pomrehn (1971) and Ariel (1989). It also compares some of the forecasted
and actual items as an example. Section 4 discusses performance and validity of the Delphi
technique in shipping industry. Finally, Section 5 concludes the present study and recommends
some research extensions.
II. The Delphi method
Delphi method is used by many empirical studies and frequently suggested by many of the
researchers. The main reasons of popularity of Delphi method are existed by more structured
technique and consensus making approach in particular. Delphi technique is a method
developed at the RAND Corporation in the middle of the last century [10]. It is a qualitative
approach that seeks to use the judgement of experts systematically in arriving at a forecast of
Delphi forecasting for shipping industry and technology: Performance and validity
6
what future events will be or when they may occur. The approach uses a series of
questionnaires to elicit responses from a panel of experts [11].
Delphi was developed during the 1950s while involved on the US Air Force-sponsored
Project Delphi. The aim of the project was the application of expert opinion to the selection of
an optimal US industrial target system, with a corresponding estimation of the number of
atomic bombs required to reduce munitions output by a prescribed amount. More generally,
the technique is seen as a procedure to "obtain the most reliable consensus of opinion of a
group of experts by a series of intensive questionnaires interspersed with controlled opinion
feedback" [12].
The Delphi method is an approach used in forecasting the likelihood and timing of
future events. The Delphi is one of the limited number of methods in the situations, which
have few historical data or a huge number of factors. The most important pre-requisite for
using the method is that all subjects should be experts in a given aspect of the proposed
objective.
In particular, the structure of the technique is intended to allow access to the positive
attributes of interacting groups (knowledge from a variety of sources, creative synthesis, etc.),
while pre-empting their negative aspects (attributable to social, personal and political
conflicts, etc.). From a practical perspective, the method allows input from a larger number of
participants than could feasibly be included in a group or committee meeting, and from
members who are geographically dispersed.
Delphi is not a procedure intended to challenge statistical or model-based procedures,
against which human judgment is generally shown to be inferior: it is intended for use in
judgment and forecasting situations in which pure model-based statistical methods are not
practical or possible because of the lack of appropriate historical/ economic/ technical data,
and thus where some form of human judgmental input is necessary [13]. Such input needs
Delphi forecasting for shipping industry and technology: Performance and validity
7
to be used as efficiently as possible, and for this purpose the Delphi technique might
serve a role.
Mainly four key attributes are defined to describe a Delphi procedure [14-16]:
• “Anonymity” which is provided by questionnaires, allows that the group
members can express and revise their judgments without drawbacks of meetings.
The members’ identity is kept privately and social pressures are eliminated.
• “Iteration” improves to revise and consider their judgments according to the
judgments of other group members. The number of iteration is subject to
statistical aggregation and the guidance of Delphi panel moderator.
• “Feedback” is another attribute of Delphi method that provides to evaluate
individual judgments in all iterations. The moderator controls the feedback
procedure and content to obtain higher performance of group consensus.
• The last specification of Delphi is “statistical aggregation”. The statistical
aggregation is averaging of group judgments by simple average or median
methods. In the final iteration, judgments of every participant have an equal
weight and affect outcome of the Delphi session.
Given the problems that traditional groups have with making judgmental predictions,
one would expect that Delphi, with its structured approach, would improve accuracy. Rowe
and Wright [17] found that Delphi improved accuracy over traditional groups. Over all of
the 24 comparisons, Delphi improved accuracy in 71% and harmed it in 12%.
One of the aims of using Delphi is to achieve greater consensus amongst experts.
Empirically, consensus has been determined by measuring the variance in responses of
Delphi participants over rounds, with a reduction in variance being taken to indicate that
greater consensus has been achieved. Results from empirical studies seem to suggest that
Delphi forecasting for shipping industry and technology: Performance and validity
8
variance reduction is typical, although claims tend to be simply reported unanalyzed [18],
rather than supported by analysis. Indeed, the trend of reduced variance is so typical that
the phenomenon of increased 'consensus', per se, no longer appears to be an issue of
experimental interest. In practice, the coefficient of variation, which is a value of standard
deviation divided to mean of the data, is frequently used for checking variance improvement.
III. The empirical studies for shipping industry forecasting
Forecasting methods are widely used in maritime literature and the majority of them
commonly implement statistical approaches. Nevertheless qualitative processes broaden
the perspectives of forecasting recipe with a judgmentally adjusted strategy. The Delphi
methodology is widespread use in qualitative direction of scientific process to elicit
subjective attributes of research object.
The empirical studies of Delphi for shipping industry forecasting have considerable
outcomes to establish better solutions for the next exercises. The first experimental works
are performed in 1970s by JTERC and University of California. These studies have an
emphatical meaning for understanding technology focused performance of the Delphi in
maritime literature. Subsection 3.1 and 3.2 review these two technology focused study in
terms of technique implementation and accuracy of predictions.
Unlike the technology focused experiments, point specific economic forecasting is a
different scope of futures studies. Strategic foresight ordinarily utilizes point specific
forecasts, variable interval forecast, or timing of an innovation. While the studies of JTERC
and University of California use an innovation timing prediction model, Ariel [19] tries a
point specific forecast of some variables in shipping industry by the Delphi. Depending on
objectives of the present paper, prediction type of experiment denotes one of the differences
as a diagnostic factor. Subsection 3.3 reviews a point specific Delphi forecasting for shipping
industry.
Delphi forecasting for shipping industry and technology: Performance and validity
9
3.1 The study of Japan Transport Economics Research Centre-1970
Frankel [20] investigates the technological planning and forecasting problem for
maritime transportation which is principally focusing on the studies about technology
forecasting of the shipping and shipbuilding industry. One of the emphasized studies is
performed by Shipbuilders Association of Japan (SAJ) in 1960 and 1965. According to cited
review, this forecasting study performed fairly due to comparisons of actual and predictions.
A structured experiment is also reported which is the study of the Japan Transport Economics
Research Centre (JTERC) in 1970 by the Delphi technique. The objective of the mentioned
Delphi practise was also forecasting of shipping and shipbuilding technology. Most of the
prediction items are found substantially inaccurate by their objective-result comparisons.
Table 1 lists some of the particular technology forecasts of the study.
Table 1. Delphi forecasts in JTERC study.
Objectives Forecast Actual
Completion of the first submersible rescue ship 1979 2006
Completion of technology to prevent disasters due to a large
quantity of flooded oil 1979 NA
Completion of the first lifesaving bridge of automatically
detachable type 1979 NA
Completion of the first ocean-going trimaran ship 1979 NA
Completion of the first oil tankers of one million tons
deadweight 1980 NA
Completion of the first merchant ship with prime mover of
fuel cell type 1983 exp. 2010
Completion of the first ship with batteries for propulsion 1985 exp. 2010
Completion of the first submarine merchant ship 1985 NA
Completion of the first ship built with man-hours of less than
one-third of the one in 1969 1985 NA
Completion of the first ocean-going unmanned merchant ship 1987 Eng.
Notes: NA: Not applicable, because this item is not practically used yet.
Eng.: Unmanned engine rooms are presently in operation. However, a fully unmanned ship is not in
operation yet.
Exp.: Expected to be according to the recent developments.
Source: [7], [21].
Delphi forecasting for shipping industry and technology: Performance and validity
10
In order to the review of listed predictions, most of the Delphi forecasts do not respond
actual developments. Although a few of them is developed, practically not used, or postponed
for an economically and technically proper time. The performing environment and timing are
also major influences on the Delphi practises. One unique example is prediction of tankership
size trend. Building of one million dwt of oil tanker is inferred in the time of oil shocks of the
20th century. After the 1967 Six Day War, the Suez Canal was closed by Egypt until 5th June
1975. An increasing ship size trend was triggered by the canal closure which induced historic
developments on building of large-scale merchant ships. The local trend of ship size was
interpreted as a long lasting impact. At that time, economic and political psychology and
cyclical influences embodied predictor’s reasoning.
A number of predictions pointed out lagged forecasts which are recently in developing
progress of ship technology. Battery for propulsion and ships with prime mover of fuel cell
are issues of the European Union (EU) nowadays. The critics of environmentalists that
emissions of sulphur dioxide and nitrous oxide from ships are expected to be more than land
based emissions in the European Union by 2020, motivated EU funded projects Zemships
(Zero Emission Ships) and NEW H SHIP (New Hydrogen Ship) to establish technical
circumferences of hydrogen cells and develop the first models of fuel cell ships [22, 23].
The submarine merchant ship is still a dream of technology and it has various difficulties
according to economic operation and the recent submarine technology. However, submarine
rescue ships are used after 2006 which is developed for submarine vessel rescue operations
[24].
The study also consists of predictions for manpower capacity on board. The working
hours of ship’s crew is expected to be one third of 1969 levels. However, when the
technology ensure less working hours for crew, shipping companies look for a manning
reduction and it is also supported by safe manning requirements. As compared to 30 years ago,
Delphi forecasting for shipping industry and technology: Performance and validity
11
working duration is partly decreased and unmanned engine room is unique development of
new built vessels today. On the other hand, dual purpose accreditation of seafarers is recently
a next step to reduce crewing requirements which is initiated by major liner shipping
companies. Although, the overall working hours and physical load of crew are substantially
declined by the current ship building technology, the decline of individual working time is not
clear and at least it is not one third of 1969 level. The ship’s crew is still working about 12-16
hours a day in an average merchant ship condition.
3.2 The study of Moore and Pomrehn-1971
Moore and Pomrehn [25] investigate the U.S. maritime transportation industry and use
some alternative methods to forecast developments of the industry. The most important
part of this study uses the Delphi forecasting method among wide range future predictions.
The study is carried out with college students who attended Ocean Transport and Logistics
course in University of California.
The items of prediction task include different parts of expertise such as vessel
design, performance, ports and terminals etc. Because of lack of statistics and available
database, a complete inspection of forecast performance is very difficult in most of these
titles. However, some of them are possible to compare with actual developments and to
criticise prediction competency on an objective base. Table 2 shows some of the forecasted
titles and actual situation of them.
Delphi forecasting for shipping industry and technology: Performance and validity
12
Table 2. Delphi forecasts in Moore & Pomrehn’s study.
Objectives Forecast Actual
500 000 DWT tanker or dry cargo vessel in operation 1986 1976a
1 million DWT cargo ship in operation 2000 NA
LASH (Lighter Aboard Ship) ships in widespread use 1980 NAb
Roll on-Roll off (RO-RO) ships in use 1980 before 1980c
Catamaran cargo liner operational 1985 NA
Economical 50 to 100 knots cargo liners in use 1990 NA
Majority of new cargo liners have nuclear power plants 1985 NA
30 knots average cargo liner speed 1990 NAd
Towed underwater bulk carrier in operation 1985 NA
Satellite navigation and communication in widespread
use 1980 1985-1990
Crew size reduced of 1/3 of present (1970) 1988 NAe
Fully automated engine room developed 1978 1985-1990
All weather operations at sea and in port 1985 NA
Container design standardized 1978 1979f
Notes: a “M/T Jahre Viking” is a 564 763 dwt tanker which is built in 1976.
b Container transportation have been developed rapidly and LASH-Carriers could not success to be
widely operated. c Several records prove that RO-RO ships were operative before 1980.
d Average speed of cargo liners is still lower than 30 knots. Although the container fleet has a higher
speed average about 20-25 knots, for other fleet average speed is less than this level. e Cargo ships have half the crew size of 1970 levels. However, there is no any specific ship size
definition for this item. Today’s an average cargo ship has 30 000 – 50 000 dwt size according to share
of world total dwt capacity and such a tonnage employs about 20 crews on board. On the other hand,
container ships partly reduced crew size about 10 to15 [26, 27]. f ISO 668:1979 [28].
NA; Not applicable, because this item is not existed or practically used yet.
Source: [8], [28], [29].
The study of Moore and Pomrehn [30] was performed with a college student group.
Notwithstanding the Delphi technique particularly requires expert driven predictions;
overall expertise was contradictorily weak in this study. The results of the predictions are
Delphi forecasting for shipping industry and technology: Performance and validity
13
indicated to fail existence and not operative in most, even in the current ship technology.
Some of the predictions have a timing difference.
A 500 000 dwt tanker or dry cargo ship is expected to be in service about 1986, but
bigger size of vessels are demanded before 1980s. 564 763 dwt tankership, M/T Jahre
Viking, was built in 1976 by Sumitomo Heavy Industries Shipyard of Japan. JTERC expert
group attempts to predict timing of a one million dwt oil tanker in service and prescience of
this Delphi study expected to be actualize in 1980 (median forecast of group). In the
increasing tonnage trend, Japanese expert group who was mainly originated from shipbuilding
industry expected continuity of the trend. In 1975, Suez Canal was opened for maritime
transits and tonnage trends are substantially changed because of oversupply tonnage
(decreasing transport distance induced recession by lesser demand). Simultaneously a deep
recession was recorded in freight markets as well.
LASH (Lighter Aboard Ship)-Carrier System vessels would be expected to be in
widespread use by the transport experts in 1950s. Although standardisation of containers
was in progress, it took a long time to orientate ports and ships for container technology.
The Delphi study is also affected by these developments and LASH-Carrier system is one
of the expected futures of part cargo shipment. In the second half of 20th century,
Container transportation envelops part cargo traffic including LASH type shipments in
mobilisation trend. LASH-Carrier system never had a chance to be used widely.
In technology forecasting, estimating speed or power of equipment is a conventional
prediction strategy which most of the futurists think them designates overall technology
development level. From this point of view, ship speed might be assumed as a leading
indicator of shipping industry development. Unlike the Delphi study of JTERC and Ariel,
Moore and Pomrehn tend to predict speed of ship and timing of probable improvement
levels of it. First attempt is to determine timing of primary high speed cargo liners of 50-
Delphi forecasting for shipping industry and technology: Performance and validity
14
100 knots level. The second attempt is to define average speed of fleet whether it reaches
to 30 knots level. Nowadays, the economical speed of merchant ship fleet is in the 12-20
knots range. According to diesel engine capacity, ship size, bunker consumption and
bunker prices, higher speed vessels are not inferred feasible yet. Container ship fleet partly
has about 20-25 knots performance.
An interesting expectation is underwater cargo carriers. Whether in JTERC study or
in Moore and Pomrehn’s study, service timing of underwater cargo carrier is similarly
forecasted in about 1985. Submarine vehicles are still not in use for cargo carrying
purposes. The size of submarine vehicles is still limited for a huge size of seaborne trade.
Crew size expectation predicts one third of 1970’s level which signifies
approximately 10-15 crews on board. Crew reduction is mostly successed by fully
automatic engine room implementation. However, the share of tonnage over 25 000 dwt is
83.2% and crew size of such a tonnage is mostly over fifteen [26, 27]. Same study also
concentrates engine room automation objective and predicts that the timing of practical
usage would be at the end of 1970s. Actually fully automated engine rooms are initiated by
around 1985-1990. At that time, crew reduction trend widely affected shipping industry by
the ship technology improvements. In the late 1990s, new generation containerships have
been put in service with extremely crew reductions. These ships are operated with around
12-15 crews. So, the objective of one third of 1970’s crew size is partly accomplished.
Container standardization is completed in 1979 by the reference publication ISO
668 of International Standardization Organisation. The study predicted to be actualizing in
1978 that is very close to original timing.
Catamaran structure and nuclear power are used for different purposes, but it is not
implemented for cargo ships, or it is not found to be feasible. Catamaran hull design is
Delphi forecasting for shipping industry and technology: Performance and validity
15
frequently used for passenger ships and sportive boats. Nuclear power is first applied for
navy ships and later it is used for some ice breaker ships as well.
3.3 The study of Ariel-1989
Ariel [31] attempts a Delphi application in dry bulk shipping and mainly indicates
economic trends of the dry bulk shipping industry by an expert group. The Delphi exercise
of the study includes three iterations and a consensus scenario of the industry is presented
by value, date and characteristic dimensions. This study uses quantitative variables as
forecasting items for the most part rather than a descriptive expression. Green, Armstrong
and Graefe [32] listed this study in considerable applications of the Delphi method among
the other globally experiments.
Ariel’s study is carried out especially for understanding future directions of shipping fleet
after the deepest slump of 1980s. A reference year is determined as 2000 and future events are
asked to expert group particularly for economic forecasting. Table 3 gives some of the Delphi
forecasts from the study with forecast and actual results. Some of the forecasting items are not
included in this paper because of the time of forecast actualization or lack of proper data for
assessment. The second column of table demonstrates forecasted value as median forecast of
the expert group. The actual values of items are provided from various shipping periodicals
and reports [33, 34].
Delphi forecasting for shipping industry and technology: Performance and validity
16
Table 3. Delphi forecasts in Ariel’s study.
Objectives Forecast Actual
World economic recovery 1992 1990-92
Revival of dry bulk shipping to 1973 levels 1990 1990a
Total deadweight capacity of the dry bulk fleet in 1990 200 mills. 208.8 mills.
Total deadweight capacity of the dry bulk fleet in 1995 205 mills. 232.3 mills.
Total deadweight capacity of the dry bulk fleet in 2000 215 mills. 255.5 mills.
The proportion of the dry bulk fleet completely laid-up
in 1990 3.5% 2.2%
The proportion of the dry bulk fleet completely laid-up
in 1995 3% 2.1%
The proportion of the dry bulk fleet completely laid-up
in 2000 2.7% 1.6%
Supply-demand gap ratio of the dry bulk fleet in 1990 15% 15.4%
Supply-demand gap ratio of the dry bulk fleet in 1995 10% 10.6%
Supply-demand gap ratio of the dry bulk fleet in 2000 10% 11%
Annual scrapping of 5% 1990 1998
50% of merchant ships above 5 000 dwt equipped with
electronic mail 1995 1995-2000
Note: a Although, the levels of 1990’s decline did not exactly reach to the levels of 1973’s recovery, recession
affected dry bulk freight markets and time charter base prices decreased to about 1973’s boosting prices
[35].
Source: [9], [33], [34].
Two significant differences are recognised in this application:
• The study is performed with an expert group who is originated from a wide range
society of the industry that including different branches of expertise. Most of the
experts are constituted by on the job professionals.
Delphi forecasting for shipping industry and technology: Performance and validity
17
• Predictions of experts are mostly established on the forecasting of the value of a
data according to predetermined timing. The prediction horizon is defined by
facilitator and subjects are asked to estimate value of a quantitative variable.
Rather than a descriptive expression of an innovation, the volume of a variable is
selected to be predicted in a specific time span [36].
World economic recovery, laid-up ratio of dry bulk fleet, supply-demand gap ratio and
some other objectives are forecasted with higher accuracy. Scrapping of dry bulk carriers is
expected to be 5% of the fleet in 1990 that is shortly after the recession of 1987-88. At that
time, experts were in a slump market which may have been affected their expectations.
Scrapping of 5% of fleet is actually recorded in 1998 when a recession period existed before
the recovery of 2001 in dry bulk freight market. Fig. 1 shows the development of dry bulk
fleet and laid-up tonnage in period of 1980-2007.
Dry Bulk Fleet Capacity in kdwt
1990; 208,8001995; 232,300
2000; 255,542
2005; 308,848
0
50,000
100,000
150,000
200,000
250,000
300,000
350,000
400,000
1980 1985 1990 1995 2000 2005
Year
Dry Bulk Fleet / kdwt
0
5,000
10,000
15,000
20,000
25,000
Dry Bulk Fleet Laid-Up Tonnage in kdwt
Laid-Up Tonnage / kdwt
Fig. 1. The dry bulk shipping fleet capacity and laid-up tonnage [33, 34].
Moreover, the forecasts of supply-demand gap ratio provided very high accuracy and it could
be analysed to predict freight market in econometric studies.
Delphi forecasting for shipping industry and technology: Performance and validity
18
IV. Performance and validity of Delphi forecast in shipping
JTERC [37], Moore and Pomrehn [38] and Ariel [39]’s studies investigated Delphi
forecasting for marine technology and shipping economics. Three works have some
similarities even same forecasting items. JTERC and Moore & Pomrehn’s studies mostly
concentrated to technological forecasting and ship design aspects. On the other hand, Ariel’s
Delphi study focused on shipping economic which mainly consists of items that are fleet
capacity, utilization and demand aspects of world seaborne trade.
In this circumstances, the Delphi studies in this paper, separated to two conceptual
types. Objective of Delphi study can be focused on technological innovations or economical
developments. By this classification, the studies of JTERC, and Moore and Pomrehn are
based on ship and port technology developments. On the other hand, the study of Ariel is
based on developments in shipping economics.
Moreover, these studies are subdivided into objective strategy. Objectives can be
introduced by a single innovative idea and the timing of actualization will be asked to subjects.
Another option is that objective is based on a significant time and value of a specific variable
is asked to be predicted. By this classification, both technology focused studies are
constructed on timing prediction. The study of Ariel is based on a point specific forecasting of
a variable. Fig. 2 depicts this classification.
Delphi forecasting for shipping industry and technology: Performance and validity
19
The studies of
JTERC (1970)
Moore & Pomrehn (1970)
The study of
Ariel (1989)
Not existed
in the current literature
Not existed
in the current literature
Technology focused Economy focused
Timing of objective
Value in spesific time
Fig. 2. The structure of Delphi study strategies.
As it is indicated in Fig. 2, economical long term forecasting is not proposed by
objective timing method in general, or technological long term forecasting is not based on
values of variables in a specific time. Ariel [39] partly applied objective timing method for
economical variables such as economic recovery, 5% scrapping level. For example, the
average speed of dry bulk fleet can be asked for a specific time, or the time of turning points
in freight markets can be predicted. Both strategies have limited examples.
The inspection of Delphi performances clearly exhibits higher capabilities of statistical
point forecasts rather than a technology estimation study. Technology forecasting task
requires more engineering skills and wide range understanding of shipping industry. In
practical usage of Delphi, expertise of panellists is one of the unique specifications for higher
performance. Rowe and Wright [40] investigate many different Delphi applications and
particularly suggest high expertise groups. Moore and Pomrehn [38] distinctly used college
Delphi forecasting for shipping industry and technology: Performance and validity
20
students as predictor of shipping industry. Accordingly the prediction performance is
suspicious and including various incompetencies. Several predictions are still not applied or
practically used in general.
Ariel [39] uses highly expert group to forecast over twenty items and most of the
participants are defined from practical labour area. Forecasting accuracy of quantitative
results in this study is measured by the conventional Root Mean Square Error (RMSE) metric.
The RMSE metric gives an average deviation interval, and increases effects of larger errors
by squares of them. Eq. (1) indicates the RMSE formulation. Xi is the prediction and Yi is
actual result. The number of prediction is indicated as n.
( )2
1
n
i iiX Y
RMSEn
=−
=∑
(i=1,…, n) (eq. 1)
The RMSE results of dry bulk fleet capacity indicated 28 Million dwt error rate and it means
about 12% of actual statistics. On the other hand, the results of laid-up tonnage ratio and
supply-demand gap ratio predictions provide 1% deviation on percentage expectations.
V. Conclusions and outlines for future research
The Delphi method is one of the alternatives for judgmental forecasting. Many applications
try to improve higher accuracy among the expert groups by the Delphi panel forecasts.
However, recent studies indicate performance differences into different execution strategies.
This paper investigated performance and validity of Delphi in maritime transportation and
finds some significant particulars to be able to adjust in the next practises.
Expertise of panellist is observed one of the most effective attribute for forecasting
success. Moore & Pomrehn [38] tried to perform a Delphi round with college students and
results have various incompleteness of technological development. Nevertheless Ariel [39]
improved higher forecasting performance by on the job, practicing expert group. However,
perspective of these two studies is different.
Delphi forecasting for shipping industry and technology: Performance and validity
21
The objectives of the task are other drivers of Delphi panel as a performance provider.
Fully technology focused tasks are found less performance and invalid for practically usage.
Results are usually out of real development pattern of the industry and can not be interpret as
valid predictions. Quantitative variable or point specific forecasts are found more capable to
catch actual fulfilment. Quantitative data is able to be compiled by historical pattern and
recent trends. Technological items are rarely predicted on time and as rational. Prediction of a
variable in a specific time ensures higher capability.
Ono and Wedermeyer [40] reported that a Delphi panel produced forecasts that were
over 50% accurate, and used this as 'evidence' that the technique is somehow a valid
predictor of the future. However, the validity of the technique, in this sense, will depend as
much on the nature of the panelists and the task as on the technique itself.
Judgmental forecasting is a new research area in shipping industry except a number
of former studies and gaps still exist how to improve valid predictions [41]. As a judgmental
forecasting tool, the Delphi provides a consensus building methodology for shipping industry
practise. Although recent theoretical and empirical developments have improved our
understanding of the role of quantitative methods in shipping market forecast, subjective
factors of the industry is an existent field of future research [42]. The Delphi method can be
extended among the shipping market forecasts in short term as well. The results of long term
forecasting by Delphi indicated several errors, and it can be proper for short term experiences.
Recent maritime research has limited research that criticises accuracy of judgmental forecasts
and it is one of the extending fields to develop a judgment sensitive forecasting for shipping
industry.
Delphi forecasting for shipping industry and technology: Performance and validity
22
References and notes
1. Harwood, S., Shipping Finance, Euromoney Institutional Investor Plc, London, pp. 70-
92 (2006).
2. Batchelor, R., Alizadeh, A. and Visvikis, I., 2007, “Forecasting spot and forward prices
in the international freight market”, International Journal of Forecasting, Vol. 23, No.1,
pp. 101-114 (2007).
3. Duru, O., Bulut, E. and Yoshida, S., “A fuzzy extended DELPHI method for adjustment
of statistical time series prediction: An empirical study on dry bulk freight market case”,
Expert Systems with Applications, doi:10.1016/j.eswa.2011.07.082 (2011).
4. Kahn, H. and Wiener, A.J., The year 2000-A framework for speculation on the next
thirty-three years, McMillan, New York, (1967).
5. Green, K., Armstrong, J.S. and Graefe, A., “Methods to elicit forecasts from groups:
Delphi and prediction markets compared”, Foresight: International Journal of Applied
Forecasting, Vol. 8, pp. 17-20 (2007).
6. Frankel, E.G., Ocean Transportation, MIT Press, Cambridge (1973).
7. Moore, C.G. and Pomrehn, H.P., “The Technological forecast of marine transportation
systems 1970 to 2000”, Technological Forecasting and Social Change, Vol. 3, pp. 99-
135 (1971).
8. Ariel, A., “Delphi forecast of the dry bulk shipping industry in the year 2000”, Maritime
Policy and Management, Vol. 16, No.4, pp. 305-336 (1989).
9. Rowe, G. and Wright, G., “The Delphi technique as a forecasting tool: issues and
analysis”, International Journal of Forecasting, Vol. 15, pp. 353-375 (1999).
10. Dalkey, N. and Helmer, O., “An experimental application of the Delphi method to the
use of experts”, Management Science, Vol. 9, pp. 458-474 (1963).
Delphi forecasting for shipping industry and technology: Performance and validity
23
11. Makridakis, S., Wheelwright, S.C. and Hyndman, R.J., Forecasting Methods and
Applications, John Wiley and Sons, New York, pp. 482-511 (1998).
12. Dalkey, N. and Helmer, O. (1963), supra, note 10.
13. Wright, G., Lawrence, M.J. and Collopy, F., “The role and validity of judgment in
forecasting”, International Journal of Forecasting, Vol. 12, pp. 1-8 (1996).
14. Rowe, G. and Wright, G., (1999), supra, note 9.
15. Stewart, T.R., “The Delphi technique and judgmental forecasting”, Climatic Change,
Vol. 11, pp. 97-113 (1987).
16. Linstone, H.A. and Turoff, M., The Delphi method: techniques and applications,
Addison-Wesley, London (1975).
17. Rowe, G. and Wright, G., “Expert opinions in forecasting: the role of the Delphi
technique”, In: Principles of Forecasting, edited by J.S. Armstrong, Kluwer Academic
Publishers, Boston, pp. 125-144 (2001).
18. Dalkey, N. and Helmer, O. (1963), supra, note 10.
19. Ariel, A., (1989), supra, note 8.
20. Frankel, E.G., (1973), supra, note 6.
21. Actual results of forecast objectives were compiled from various maritime sources and
personal communication with several experts.
22. http://www.zemships.eu/
23. https://www.hfpeurope.org/
24. http://www.naval-technology.com/projects/lr5/
25. Moore, C.G. and Pomrehn, H.P., (1971), supra, note 7.
26. Committee on the effect of smaller crews on Maritime Safety Marine Board
Commission on Engineering and Technical Systems National Research Council, 1990,
Crew Size and Maritime Safety (Washington, D.C.: National Academy Press).
Delphi forecasting for shipping industry and technology: Performance and validity
24
27. Institute of Shipping Economics and Logistics, Shipping Statistics Yearbook, 2007
(Bremen: Institute of Shipping Economics and Logistics).
28. http//www.iso.org, ISO Reference publication ISO 668: Series 1 freight containers-
Classification, external dimensions and ratings, 1979.
29. Actual results of forecast objectives were compiled from various maritime sources and
personal communication with several experts.
30. Moore, C.G. and Pomrehn, H.P., (1971), supra, note 7.
31. Ariel, A., (1989), supra, note 8.
32. Green, K., Armstrong, J.S. and Graefe, A., (2007), supra, note 5.
33. Fearnleys Monthly and quarterly dry bulk reports (various issue).
34. Lloyd’s Shipping Economists, various issues of magazine.
35. Institute of Shipping Economics and Logistics, Shipping Statistics Yearbook, 1991
(Bremen: Institute of Shipping Economics and Logistics).
36. The strategy difference can be easily recognized by the comparison of tables.
37. Frankel, E.G., (1973), supra, note 6.
38. Moore, C.G. and Pomrehn, H.P., (1971), supra, note 7.
39. Ariel, A., (1989), supra, note 8.
40. Ono, R. and Wedermeyer, D.J., “Assessing the validity of the Delphi technique”,
Futures, Vol. 26, pp. 289-304 (1994).
41. Duru, O. and Yoshida, S., “Composite forecast: a new approach for forecasting shipping
markets”, Proceedings of the International Association of Maritime Economists
Conference 2008, Dalian, China (2008).
42. Duru, O. and Yoshida, S., “Market Psychology”, Lloyd’s Shipping Economists, August
Issue, pp. 30-31 (2008).