FUNCTIONAL REQUIREMENT-BASED FORECASTING - Ghent ...

73
FUNCTIONAL REQUIREMENT-BASED FORECASTING ESTIMATING THE COST AND DURATION OF EARLY-STAGE PROJECTS Word count: 20,029 Arne Van Belleghem Student number : 000130582309 Supervisor: Prof. Dr. Mario Vanhoucke Commissioner: Jeroen Burgelman Master’s Dissertation submitted to obtain the degree of: Master in Business Engineering: Operations Management Academic year: 2018-2019

Transcript of FUNCTIONAL REQUIREMENT-BASED FORECASTING - Ghent ...

FUNCTIONAL REQUIREMENT-BASED

FORECASTING ESTIMATING THE COST AND DURATION OF EARLY-STAGE

PROJECTS

Word count: 20,029

Arne Van Belleghem Student number : 000130582309

Supervisor: Prof. Dr. Mario Vanhoucke

Commissioner: Jeroen Burgelman

Master’s Dissertation submitted to obtain the degree of:

Master in Business Engineering: Operations Management

Academic year: 2018-2019

ii

Declaration

I declare that the content of this Master’s Dissertation may be consulted and/or reproduced, provided that the

source is referenced.

Arne Van Belleghem

iii

Acknowledgements

Almost 6 years have passed since I attended my first lecture at the University of Ghent and now my life as a

student has come to an end. Writing this dissertation was a challenge. I faced a lot of obstacles and difficulties

and I could not have overcome them all on my own. Therefore, I want to thank the people who inspired, guided

and supported me along the way.

First of all, I want to thank my supervisor Prof. Dr. Mario Vanhoucke, who inspired me to perform this research

with his enthusiasm for project management. During my school career, only 2 people were able to really

influence my educational choices and he is without a doubt the one who persuaded me to study Operations

Management.

Second, I want to acknowledge the guidance of commissioner Jeroen Burgelman through this research. His

knowledge, insights and feedback were invaluable in discussing and defining the path of this dissertation.

Furthermore, he was always available for me when I needed help, and for that I am very grateful.

Finally, I want to thank my family and friends who encouraged and supported me during the progress of this

research. I’m deeply indebted to my parents, who gave me the opportunity and resources to study Business

Engineering at the University of Ghent. Special thanks goes to my brother and friends, who were always there

to lift my spirit during the sometimes hard period writing this dissertation.

iv

Abstract

Cost and duration forecasts are often inaccurate due to the overoptimistic behaviour of project managers.

Functional Requirement-based Forecasting (FRF) is a forecasting technique, which is solely based on the

execution of projects in the past. Consequently, FRF avoids the biases of human judgement. The proposed

technique in this dissertation is applied to 41 real-life projects for which data was retrieved from the database

available at the Operations Research and Scheduling (OR&S) group of Ghent University. These projects can be

divided in 8 groups of similar projects and for each group the results are analysed. Furthermore, the effect of

different factors on the forecast accuracy of FRF is tested and a general evaluation of FRF is made. This

dissertation aims to introduce the use of a new technique to estimate the cost and duration of a project and test

its potential regarding forecast accuracy.

v

Contents

List of acronyms ..................................................................................................................................................... vi

List of tables ......................................................................................................................................................... viii

List of figures .......................................................................................................................................................... ix

I Introduction .......................................................................................................................................................... 1

II Literature ............................................................................................................................................................. 4

III Research Hypothesis ........................................................................................................................................ 13

IV Methodology .................................................................................................................................................... 15

IV.I Project Data................................................................................................................................................. 15

IV.II Determining Functional Requirements ...................................................................................................... 17

IV.III Project Size ................................................................................................................................................ 20

IV.IV Calculations ............................................................................................................................................... 24

V Results ................................................................................................................................................................ 26

V.I Results per project group ............................................................................................................................. 27

V.II General Results ........................................................................................................................................... 38

V.III Regression Analysis .................................................................................................................................... 39

V.IV Sensitivity Analysis size-factor ................................................................................................................... 41

VI Conclusion ........................................................................................................................................................ 43

References ............................................................................................................................................................ 45

Appendix ............................................................................................................................................................... 47

vi

List of acronyms

AB = Apartment Building

ABFW = Apartment Building Finishing Works

ABSW = Apartment Building Structural Work

ADT = Axiomatic Design Theory

AoN = Activity-on-the-Node

APE = Absolute Percentage Error

BBRI = Belgian Building Research Institute

CN = Customer need

DP = Design Parameter

DSM = Design Structure Matrix

EVM = Earned Value Management

ES = Earned Schedule

FE = Absolute Forecast Error

FP = Function Point

FR = Functional Requirement

FRF = Functional Requirement-based Forecasting

LOC = Lines Of Code

MAPE = Mean Absolute Percentage Error

OFW = Office Finishing Works

OR&S = Operations Research and Scheduling

PLC = Project Life Cycle

vii

PM = Project Management

PMI = Project Management Institute

PV = Process Variable

RB = Railway Bridge

RH = Residential House

RHFW = Residential House Finishing Works

RCF = Reference Class Forecasting

ROT = Rule of Thumb

RQ = Research Question

RQa,b,c = Research sub-Questions

SAY = Social Apartments Ypres

SME = Small and Medium-sized Enterprise

WBDG = Whole Building Design Guide

WBS = Work Breakdown Structure

WTCB = Wetenschappelijk en Technisch Centrum voor het Bouwbedrijf

XSM = eXponential Smoothing-based Method

viii

List of tables

Chapter II

Table 2. 1 The DSM of the network ......................................................................................................................... 8

Chapter IV

Table 4. 1 Overview Project Groups ...................................................................................................................... 16

Table 4. 2 Examples of Activities and their Functional Requirements .................................................................. 19

Table 4. 3 Project sizing matrix. Source: Burgan & Burgan (2014) ........................................................................ 20

Chapter V

Table 5. 1 Residential House Finishing Works: Cost forecast ................................................................................ 27

Table 5. 2 Residential House Finishing Works: Duration forecast ........................................................................ 28

Table 5. 3 Residential House: Cost forecast .......................................................................................................... 29

Table 5. 4 Residential House: Duration forecast ................................................................................................... 29

Table 5. 5 Apartment Building Finishing Works: Cost forecast ............................................................................. 30

Table 5. 6 Apartment Building Finishing Works: Duration forecast ...................................................................... 30

Table 5. 7 Apartment Building Structural Work (1): cost & duration MAPE ......................................................... 31

Table 5. 8 Apartment Building Structural Work (2) & (3): Cost forecast ............................................................... 32

Table 5. 9 Apartment Building Structural Work (2) & (3): Duration forecast........................................................ 32

Table 5. 10 Railway Bridge: cost & duration MAPE ............................................................................................... 33

Table 5. 11 Apartment Building: cost & duration MAPE ....................................................................................... 34

Table 5. 12 Apartment Building: Absolute cost FE ................................................................................................ 34

Table 5. 13 Office Finishing Works: cost & duration MAPE .................................................................................. 35

Table 5. 14 Office Finishing Works: Absolute cost FE............................................................................................ 35

Table 5. 15 Social Apartments Ypres: cost & duration MAPE ............................................................................... 36

Table 5. 16 Social Apartments Ypres (b): cost & duration MAPE .......................................................................... 36

Appendix

Table A. 1 Cost forecast accuracy .......................................................................................................................... 52

Table A. 2 Duration forecast accuracy ................................................................................................................... 54

Table A. 3 Effect different values of a on the cost forecast accuracy ................................................................... 59

Table A. 4 Effect different values of a on duration forecast accuracy .................................................................. 61

Table A. 5 Forecast results with size factor = 1 ..................................................................................................... 63

ix

List of figures

Chapter II

Figure 2. 1 Literature overview ............................................................................................................................... 4

Figure 2. 2 Dynamic Project Scheduling. Source: Vanhoucke (2012) ...................................................................... 5

Figure 2. 3 Project Life Cycle (PLC). Source: Vanhoucke (2012) .............................................................................. 6

Figure 2. 4 Four levels of a WBS. Source: Vanhoucke (2012) .................................................................................. 7

Figure 2. 5 An example of a network ...................................................................................................................... 8

Figure 2. 6 Zigzagging. Source: Rebaiaia and Viera (2013) ...................................................................................... 9

Figure 2. 7 The design process. Source: Rebaiaia and Viera (2013) ...................................................................... 10

Figure 2. 8 Reverse Zigzagging (visualization) ....................................................................................................... 11

Chapter III

Figure 3. 1 Roadmap FRF ....................................................................................................................................... 13

Chapter IV

Figure 4. 1 Overview Methodology ....................................................................................................................... 15

Figure 4. 2 Methodology information searching process ..................................................................................... 17

Figure 4. 3 Correlation Actual Cost Actual Duration ............................................................................................ 22

Chapter V

Figure 5. 1 Overview Result Analysis ..................................................................................................................... 26

Figure 5. 2 Sensitivity analysis a: cost MAPE ......................................................................................................... 41

Figure 5. 3 Sensitivity analysis a: duration MAPE .................................................................................................. 42

Appendix

Figure A. 1 Effect average number of observations on cost MAPE ....................................................................... 55

Figure A. 2 Effect average number of observations on duration MAPE ............................................................... 55

Figure A. 3 Effect difference in size factor on cost MAPE ..................................................................................... 56

Figure A. 4 Effect difference in size factor on duration MAPE .............................................................................. 56

Figure A. 5 Effect difference in FRs on cost MAPE ................................................................................................ 57

Figure A. 6 Effect difference in FRs on duration MAPE ......................................................................................... 57

1

Chapter I

Introduction

How often does a project-manager exactly know how long the execution of a project will take before it has

started? And how often does a project-manager sit down with investors and tells them the exact budget he

or she will need to perform a project? The estimated cost and duration of a project are vital pieces of

information for an organisation, because it could determine whether a project is dropped or continued.

Despite the importance of a good cost forecast, Flyvbjerg (2014) states that cost overruns are a problem in

both private and public sector projects and that things are not improving. “Overruns have stayed high and

constant for the 70-year period for which comparable data exist.” As a matter of fact rail and road projects

have average cost overruns of 44.7% and 20.4% respectively. A well-known example is the railway tunnel

that connects England and France or the Channel tunnel that had a construction cost overrun of 80%

(estimated £2600, actual cost £4650 million). Further there are numerous other examples like the cost

overrun of the new US international airport in Denver that was close to 200%, the Humber bridge in the UK

that had a 175% overrun and the Paris Nord TGV in France that had a 25% overrun (Flyvbjerg et al., 2003).

Another study of 52 civilian projects ranging in cost from $500 million to over $10 billion (in 1984) concludes

that the average cost overrun was 84%. The total cost overrun was over $30 billion and only 4 projects were

estimated on budget (Merrow et al., 1988). Other past cost overruns were even more extreme: Boston’s

Big Dig had an overrun of 220%, The UK National Health Service IT system between 400% and 700%, and

The Sydney Opera House even had an overrun of 1400% (Flyvbjerg, 2014). This phenomena does not only

hold for big projects, Aljohani et al. (2017) state that nine out of ten construction projects normally

experience cost overrun.

Moreover, estimating the duration of a project accurately is a worldwide problem as well. A field survey in

Saudi Arabia concluded that 70% of construction projects experienced time overrun, with an average

slipping period between 10% and 30% of the original duration (Assaf & Al-HHejji, 2006). Abdallah &

Battaineh (2002) evaluated progress reports of 164 building and 28 highway projects constructed during

the period 1996-1999 in Jordan. They also noticed extensive project delays: the average ratio of actual

completion time to the planned contract duration equals 120.3% for building projects and for road projects

even 160.5%. Additionally, in Europe a lot of projects faced severe delays as well. A famous example is the

Wembley Stadium project in the UK which started in 2002 and was expected to be finished in 2006, but had

a delay of 1 year (or a delay of 25%) and furthermore a cost overrun of 32%. Another example is the

Olkiluoto 3 Nuclear Power Plant in Finland. This project had a planned duration of 5 years, but the actual

2

duration took 13 years! This came down to a delay of 160%, not to mention the cost overrun of 166% (Wilks,

2015).

Cost and duration overruns are not solely problems for construction projects, a study published in the

Harvard Business Review (Flyvbjerg & Budzier, 2011), which analysed 1,471 IT projects, found that all but

one in six projects had a cost overrun of 200% on average and a schedule overrun of almost 70%.

An explanation for these inaccuracies is given by Flyvbjerg (2006), who states that psychological and

political biases are the causes instead of imperfect data or bad forecast models. These biases induce project

managers to be overoptimistic about the cost and duration of a project, without reviewing similar projects

in the past. During the execution of most projects, there are simply too many factors that can affect both

cost and duration. In the field of project management a lot of research has already been done and there

are already a range of techniques who try to deal with these unpredictable factors during the execution of

the project. For example, Earned Value Management (EVM) originated in the 1960s, when the US

Department of Defense proposed a standard method to measure a project’s performance (Vanhoucke,

2012). Later, Earned Schedule (ES) was proposed as an alternative technique to measure a project’s time

performance by Lipke (2003). A more recent study proposes a technique called XSM (Batselier &

Vanhoucke, 2017), which is an acronym for eXponential Smoothing-based Method, integrates the EVM

technique with Holt's double exponential smoothing method (Holt, 1957, 2004) and Reference Class

Forecasting (RCF) (Flyvbjerg, 2006).

The proposed technique in this dissertation, Functional Requirement-based Forecasting (FRF), tries to limit

the overoptimistic behaviour of project managers by estimating the cost and duration of a project based

on the actual cost and duration of similar projects in the past. In contrast to the techniques described above,

which aim to forecast an ongoing project's actual duration and cost, FRF tries to predict the duration and

cost of the activities in an early stage of the project. In this dissertation this early stage can be defined as

the time period when the duration and cost of the activities are estimated before the execution of the

project has started.

In order to apply this technique, the functional requirements (FRs) of the project’s activities need to be

determined. Based on the past results of activities with the same FRs in similar projects, a prediction of

their cost and duration can be made. Before reading any further, it is important to understand what a FR

really is. A functional requirement emphasizes that what the system must do (Farid & Suh, 2016), or in other

words it defines the function that a system must fulfill. Based on their function, the duration and cost of

activities are estimated.

The proposed technique in this dissertation was applied to 41 real life projects retrieved from the dataset

available at the Operations Research and Scheduling (OR&S) group of Ghent University (Batselier &

3

Vanhoucke, 2015). These projects can be divided in 8 groups of similar projects, with differences in project

group size and differences in similarity between projects of the same group.

This brings us to the main goal of this dissertation: testing the potential of Functional Requirement-based

Forecasting in terms of forecast accuracy for cost and duration. Consequently the research question (RQ)

of this dissertation is:

RQ: What is the potential of Functional Requirement-based Forecasting regarding forecast accuracy of

early-stage cost and duration estimates of a project?

Furthermore, it is important to know in which situations it is useful to apply this technique. In other words,

it is key to figure out which the drivers of a good estimation in FRF are. In order to find an answer to this

question, 3 sub-questions (RQa, RQb and RQc) are defined:

𝐑𝐐𝐚: What is the relation between the forecast accuracy and the number of observations on which

a forecast is based on?

𝐑𝐐𝐛: What is the relation between the forecast accuracy and the difference in project size between

similar projects in a project group?

𝐑𝐐𝐜: What is the relation between the forecast accuracy and the differences in the functional

requirements of activities in similar projects?

In order to find an answer to these questions, this dissertation has the following structure. Chapter II

contains a literature review in order to give some context about the subject. In Chapter III the research

questions are put forward and transformed into research hypothesises. The used methodology of applying

this technique is described in Chapter IV. In Chapter V the obtained results are analysed and thoroughly

discussed. Finally, the conclusions and limitations of this dissertation are described in Chapter VI.

4

Chapter II

Literature

This dissertation aims to introduce the use of a new technique to estimate the cost and duration of a

project. To the best of our knowledge only related research can be found on the subject. The goal of the

first part of this literature review is to provide the reader with a clear view on the context of the subject.

Subsequently, the theory from which the idea of Functional Requirement-based Forecasting is inspired from

and their link will be explained. Finally, the motivation why the proposed technique could be useful for

project managers is presented.

Figure 2.1 provides a scheme of the literature review.

The proposed technique Functional Requirement-based Forecasting is located in the field of project

management. Therefore to understand the concept of this dissertation, it is key to understand what project

management really is.

Project management (PM) can be defined as the discipline of planning, organizing and managing resources

to bring about the successful completion of specific project goals and objectives (Vanhoucke, 2012).

Figure 2. 1 Literature overview

5

According to PMBOK (2013), PM is the application of knowledge, skills, tools, and techniques to project

activities to meet the project requirements. PMI (Project Management Institute) states that every project

is unique and temporary. It is not a routine operation, but a specific set of operations designed to

accomplish a singular goal. Besides, every project has a defined beginning and end in time, and therefore

defined scope and resources. A good project manager needs to be comfortable with change and complexity

in dynamic environments, because projects can be very complex and executed in unpredictable

circumstances. That is why scheduling a project is a dynamic process. During the life time of the project,

changes to the schedule happen all the time, therefore decisions have to be made until the end of the

project. To deal with this, dynamic project scheduling has three closely connected components: Baseline

Scheduling, Risk Analysis and Project Control (Vanhoucke, 2012).

Figure 2. 2 Dynamic Project Scheduling. Source: Vanhoucke (2012)

Baseline Scheduling: In this phase a timetable is constructed to provide a start and end date for

each project activity. It is key to take the activity relations, resource constraints and other project

characteristics into account while trying to reach a schedule objective.

Risk Analysis: What are the effects on our schedule objective when certain activities are delayed

or certain resources are unavailable? When dealing with uncertainty, the weaknesses of the

schedule need to be determined. In that way the schedule can be adapted or buffered to be more

robust to changes.

Project Control: The progress of the project is measured and evaluated using the information

obtained during the scheduling and risk analysis steps. In this way corrective actions can be taken

in case of problems to reach the objective.

FRF provides a technique to predict the cost and duration of a project and can be used during the baseline

scheduling phase. In dynamic project scheduling a project’s baseline schedule serves as a point of reference

in the project life cycle and is therefore only a prediction of the execution of the project. However, this

point-of-reference becomes very important when it is embedded in a wider dynamic scheduling

perspective. It acts as a tool for resource efficiency calculations, time and cost risk analyses, project control,

6

performance measurements and much more and is therefore the starting point in any dynamic scheduling

analysis. That is why it is very important to have a good estimation of the costs and duration of the activities

in order to reach the predetermined objective (Vanhoucke, 2013).

Before and after a project is scheduled, it has to go through different phases. Together these phases form

the project life cycle (PLC). PMBOK (2013) defines the project life cycle as the series of phases that a

project passes through from its initiation to its closure. Although PMBOK represents the PLC slightly

different, the one described below is proposed by Vanhoucke (2012) and gives a clear overview of the

different phases.

Figure 2. 3 Project Life Cycle (PLC). Source: Vanhoucke (2012)

Conceptual phase: First, the need for a project is identified. Usually an organisation receives a

request from a customer or a recent market research indicates an opportunity.

Definition phase: In this phase the projects objectives, specifications and requirements are

defined. Furthermore, the organisation that will be involved is assigned to the project. It is key that

the project objectives are translated into a list of activities, a set of technological precedence

relations and the resource requirements, taking into account their availabilities.

Scheduling phase: Next, a timetable is constructed where each activity is assigned to a start and

finish time. The schedule takes into account the information received by the previous step, in order

to be precedence and/or resource feasible.

Execution and control phases: During the execution, the progress of the project is tracked to check

if it deviates from the schedule constructed in the previous phase. When needed, corrective actions

can be taken.

Termination phase: During this last phase the project is completed and evaluated. This evaluation

can be very important, because the obtained data can be used during the project life cycle of future,

similar projects. The proposed forecasting technique in this dissertation is based on this

information.

The idea behind FRF is inspired by the Axiomatic Design Theory (ADT) developed by Dr. Suh (1990). ADT is

a technique to generate a project network and can be situated in the definition phase.

7

During this definition phase the activities are identified that are essential to reach the project goal. A well-

known concept to do this is the Work Breakdown Structure (WBS). WBS is the process of subdividing project

deliverables and project work into smaller, more manageable components (PMBOK, 2013). Starting from

the project objective, the project is decomposed until the project activities can be defined.

The WBS has multiple levels of detail and is visualised below.

Figure 2. 4 Four levels of a WBS. Source: Vanhoucke (2012)

This obtained information needs to be transformed into a network diagram that represents the project

activities and their technological links. These technological links define the logical sequence in which the

activities are executed. For example, when you are building a house, you cannot start with the brickwork if

the foundations are not yet finished. More detailed information about the different precedence

relationships can be found at Vanhoucke (2012).

Constructing a project network is not always an easy task. Projects can involve the completion of hundreds

or even thousands of parts or activities. Such projects are not simply coordinated or structurally well-linked,

they can be very complex and especially dynamic. In the project scheduling literature 2 methodologies have

been developed to generate activity-on-the-node (AoN) networks for such projects: the Design Structure

Matrix (Steward, 1981) and Axiomatic Design Theory (Suh, 1990).

Design Structure Matrix

The design structure matrix (DSM) or the dependency structure matrix and its manipulating algorithms was

originally developed by Steward (1981). DSM is a general method for representing and analysing system

models to better plan complex projects involving interdependencies, facilitating modularity, sequencing to

minimize costs and schedule risk in a variety of application areas (Rebaiaia and Viera, 2013). This method

uses the information obtained of the WBS and constructs a binary matrix that indicates the precedence

relationships between the activities.

8

According to Rebaiaia and Viera (2013), a DSM associated with a graph is a binary square matrix with m

rows and m columns, with m equal to the number of activities, and the number of marked cells corresponds

to the links between nodes which are admitted equal to n. The rows of the activities represent their inputs,

their columns represent their outputs. The DSM can be defined as follows:

The DSM is a (m x m) Boolean matrix 𝐴 = [𝑎𝑖𝑗] composed of elements such as each element is defined

according to:

1 if (𝑎𝑗 → 𝑎𝑖)

𝑎𝑖𝑗 = ∀ 𝑖, 𝑗 𝜖 {1, … , 𝑚}

0 otherwise

where link (𝑎𝑗 → 𝑎𝑖) between 𝑎𝑗 and 𝑎𝑖 denotes that component 𝑎𝑗 transfers information to component

𝑎𝑖 so that the execution of 𝑎𝑖 cannot be proceeded if 𝑎𝑗 did not complete its execution. When 𝑎𝑖𝑗 equals 0,

the cells are empty and the diagonal cells are blackened. An empty row represents a source node and an

empty column represents a terminal node.

For example, for a given network:

Figure 2. 5 An example of a network

Table 2. 1 The DSM of the network

This matrix serves as the starting point of 2 algorithms: partitioning and tearing. Partitioning means

changing the order of the activities and is useful to show which activities or group of activities can be

A B C D E F G H I

A 1

B 1 1

C 1 1

D

E 1 1

F 1 1 1

G 1

H 1 1 1

I 1

9

performed serial or simultaneously and which activities are coupled. Tearing is performed when so called

activity-blocks or coupled activities are identified and these activities have to be sequenced within the

blocks. The sequence of these activities depend on the judgement of the manager and will be different from

one person to another. For the specific algorithms and illustrative examples of the technique I refer to

Rebaiaia and Viera (2013).

DSM is a useful tool to decompose a system into subsystems and schedule tasks in an optimal sequence for

a complex project and is most useful when activities are listed in the order of their execution in the project.

DSM provides a simple way to visualise the structure of an activity network. It is a great technique to

capture, understand and manage the interactions occurring in a project. However this technique is limited

in predicting system interactions before detailed designing is carried out. In other words, the project must

be well defined in terms of activities and their precedence relationships before DSM can be applied.

Axiomatic Design Theory

The axiomatic design theory (ADT) (Suh, 1990) is a useful technique when the project design is still in an

early phase. When you design a new product or service you look for something customers want. By giving

form to your product or service you translate these customer needs (CNs) into functional requirements

(FRs). This technique looks to satisfy these functional requirements by adjusting their correlating design

parameters (DPs). The design parameters are determined through a process called zigzagging (Rebaiaia and

Viera, 2013). Zigzagging is an iterative process that decomposes the overall functional requirement and

determines its corresponding DP at the same hierarchical level. This process is visualised underneath.

Figure 2. 6 Zigzagging. Source: Rebaiaia and Viera (2013)

These design parameters are used to design the process and are being transformed into process variables

(PVs). This results in the whole design process and its 4 domains:

10

Figure 2. 7 The design process. Source: Rebaiaia and Viera (2013)

Similar to the WBS method, zigzagging applies multiple hierarchical levels to decompose a project into

smaller, more manageable components. Although instead of focussing on the project objective and the

work that needs to be done to satisfy this goal, ADT focusses on the customer needs and translates the

functional requirements of a project into activities. This point of view that activities should satisfy the

functional requirements of a project is the basic idea behind Functional Requirement-based Forecasting!

For the specific method and the application of ADT to real projects we refer to Rebaiaia & Viera (2013) and

Farid & Suh (2016).

ADT can be used early in the design process and while DSM captures the As-Is model, ADT captures the

underlying structure of the design problem because the design model is driven by the functional

requirements. ADT provides insight on which Design Parameters the Functional Requirements depend.

Relying on the ADT, the design parameters can be manipulated in order to satisfy the functional

requirements. The biggest disadvantage is that, in contrast to DSM, ADT does not capture the system

interactions. Another disadvantage is that although on product or process level the uncoupled design is

always better than the coupled one, on business level this is not the case. An uncoupled design is easier to

use, control and service, but at the same time easier to imitate (Nakao, 2016).

It is clear that both techniques can be very useful in different situations and they both have their advantages

and disadvantages. Dong and Whitney (2001) believe these techniques can be very complementary to each

other and proposed a technique to combine those methods. Since we do not seek to research the AoN

network generation and do not want to lose ourselves into details, this falls out of the scope of this

dissertation.

Link Design Structure Matrix and Functional Requirement-based Forecasting

DSM is very useful to schedule the activities of a project in an optimal sequence. At an early stage, the

optimal sequence is based on the estimation of the cost and/or duration of an activity, depending on the

project objective(s). For example, if the goal is to minimize the total duration of a project, it is important to

have an accurate forecast of the duration of the activities. Consequently, FRF and DSM can be

complementary techniques to generate these optimal sequences.

11

Furthermore, the data used in this dissertation from the database of Batselier and Vanhoucke (2015) is

generated in a software tool called Protrack. The scheduling process in Protrack is based on the traditional

critical path based forward (to create an earliest start schedule) and/or backward (to create a latest start

schedule) project scheduling calculations aiming to construct a project schedule with a minimal project lead

time, taking the predefined precedence relations and the various predefined activity constraints in account

(Vanhoucke, 2009).

Link Axiomatic Design Theory and Functional Requirement-based Forecasting

The technique proposed in this dissertation starts from the activities obtained in the WBS and determines

the functional requirement(s) each activity tries to satisfy. This is the exact opposite of the zigzagging

technique in ADT, which starts from the functional requirements of a project and determines its activities

based on them. Furthermore, ADT uses a top-down technique to determine its activities. Whereas FRF is

using a bottom-up approach: it starts from its activities to estimate the cost and duration of a project.

Consequently, the determination of the FRs in FRF can be seen as some sort of “reverse zigzagging” because

it does the exact opposite of what ADT does.

Figure 2. 8 Reverse Zigzagging (visualization)

Note that this “reverse zigzagging” is only necessary to determine the FRs for the activities that are already

determined. If FRF would be considered when the project activities are not determined yet, the project

manager could also start from the FRs and use the initial zigzagging technique to determine the activities.

Either way it could be interesting for a project manager to think about the function of an activity before

adding it to a project.

When all the FRs are determined, the duration and cost of each activity can be estimated by the actual

values of activities of similar past projects with the same FR(s). This will be discussed thoroughly in the next

chapters.

Why FRF?

Next, it is important to understand why the proposed technique in this dissertation can be useful. FRF aims

to provide accurate cost and duration estimates in an early-stage of a project. In the introduction it was

12

already mentioned that this can be of vital importance to a company, because these estimates could

determine whether a project is dropped or continued. Pasco & Aibinu (2008) state that an accurate estimate

is an important piece of information needed for decision-making at the pre-tender stage. Nevertheless,

there is still a lot of room for improvement in terms of early stage forecast accuracies.

An explanation for these poor estimates is given by Flyvbjerg (2006), who states that psychological and

political biases are the cause instead of imperfect data or bad forecast models. He argues that substantial

resources have been spent to improve data and forecasting over the last decades and that this has had no

effect on the accuracy. Instead, he puts the optimism bias forward as the psychological explanation: “Most

people judge future events in a more positive light than is warranted by actual experience”. Likewise a

political bias in the form of strategic misinterpretation has its effect on the inaccuracy. In order to gain

approval or funding for a project, forecasters and managers tend to overestimate benefits and

underestimate costs. This is explained very well by De Smyter and Vandoorne (2018), who indicate that

most project managers particularly focus on the specifics of the project and its objective, without reviewing

similar completed actions. This “inside view” causes inaccurate forecasts as explained above.

Instead Functional Requirement-based Forecasting is based solely on similar projects executed in the past.

In this way this technique avoids these optimism and political biases and aims to be a useful tool in the

decision process in an early stage of a new project.

13

Chapter III

Research Hypothesis

It is already mentioned above that FRF is based on the cost and duration of similar projects. Applying this

technique is done in 4 steps. First, data of similar projects, which were executed in the past, is collected.

Together with the forecasted project, these similar projects form a project group. Second, the FR(s) of each

activity in the project group are determined. Subsequently, the size of the project is determined and

compared with the similar projects in its project group. This is of vital importance for the calculations,

because the actual values need to be compensated for the difference in size between projects. The last step

is to calculate the forecasted cost and duration of each activity of the project based on the actual cost and

duration of the activities in similar projects with the same FR.

In Figure 3.1 the roadmap of FRF is visualised.

Figure 3. 1 Roadmap FRF

To the best of our knowledge no results are available for a similar technique, consequently it will be

interesting to see if FRF can be useful for project managers in the early stage of a project. In order to provide

the reader a clear view on the topic of this dissertation, we repeat the research question and sub-questions

below:

RQ: What is the potential of Functional Requirement-based Forecasting regarding forecast accuracy of

early-stage cost and duration estimates of a project?

𝐑𝐐𝐚: What is the relation between the forecast accuracy and the number of observations on which

a forecast is based on?

𝐑𝐐𝐛: What is the relation between the forecast accuracy and the difference in project size between

similar projects in a project group?

𝐑𝐐𝐜: What is the relation between the forecast accuracy and the differences in the functional

requirements of activities in similar projects?

These questions will be researched in the next chapters, but first the expectations of the relations, which

are to be investigated are discussed. In order to test these predictions, they are transformed into 3

hypothesises below.

14

Regarding the first sub-question, the expectation is that a forecast based on more observations will be

more accurate. The more similar projects a forecast is based on, the less sensitive it will be to an extreme

value in one of the projects. The goal is to search for an indication of how many similar projects we need

to obtain a relative good estimation using FRF. Note that some activities in similar projects can be

different. This can result in different FRs and consequently less observations on which the cost and

duration of an activity is based.

Second, it could be interesting to look if the difference in project sizes between similar projects in a project

group affects the forecast accuracy. Since the forecasted values are dependent on the differences in size

between the projects, the activities for which the cost and duration are independent of this size difference

will have a lower forecast accuracy. Consequently, we expect that the bigger the difference in size between

the similar projects in a project group is, the lower the forecast accuracy will be.

The goal of the last sub-question is to determine the effect of differences in the FRs of activities between

similar projects on the forecast accuracy. The expectation is that the more differences in terms of FRs

between similar projects exist, the lower the forecast accuracy will be. Similar to the difference in project

size, this can be an important factor to decide whether or not to add a similar project to the project group

on which a forecast is based. Maybe a trade-off has to be made between the raise in accuracy of an extra

observation and the loss in accuracy due to the differences between projects.

This results in the following research hypothesises:

Hypothesis 1: a forecast based on more observations will be more accurate.

Hypothesis 2: the bigger the difference in size between the similar projects in a project group, the

lower the forecast accuracy will be.

Hypothesis 3: the more differences in the functional requirements of activities between the similar

projects in a project group, the lower the forecast accuracy will be.

In the following chapters these hypothesises are investigated, taking into account the limitations of this

research.

15

Chapter IV

Methodology

The methodology used to apply FRF in this dissertation includes 4 steps. First, real-life project data was

collected to conduct the forecasting. Second, the FRs needed to be determined for each activity. Next, the

size of each project in the project groups were determined. Finally, the cost and duration forecasts were

calculated and compared with the actual cost and duration.

Figure 4. 1 Overview Methodology

IV.I Project Data

In order to test the proposed method in this dissertation, 41 real-life projects from the data available at the

OR&S group of Ghent University were used. These projects can be divided in 8 groups of similar projects. A

project belongs to a project group if it has the same subject and consequently the same project name in

the database. An overview of the project groups and the number of projects per group is given below (Table

4.1).

16

Project Group # Projects

Apartment Building (AB) 6

Apartment Building Finishing Works (ABFW) 4

Apartment Building Structural Work (ABSW) 3

Office Finishing Works (OFW) 5

Railway Bridge (RB) 5

Residential House (RH) 4

Residential House Finishing Works (RHFW) 11

Social Apartments Ypres (SAY) 3

Table 4. 1 Overview Project Groups

These projects are all located in the construction sector and have actual durations between 79 and 611 days

and their actual costs vary between €53,000 and €3,600,000. In 53.66% of the projects the actual duration

was longer than the planned duration and 70.73% of the projects had a budget overrun. Here must be noted

that the 11 ‘Residential House Finishing Works’ projects performed perfectly as planned in terms of

duration. It is highly unlikely that this has happened for 11 similar real-life projects, so one must be careful

by drawing conclusions based on these observations.

If the data of the Railway Bridge projects is compared with the statement of Flyvbjerg (2014) that rail

projects have an average cost overrun of 44.7%, one sees that only 2 of the 5 projects are performing worse

than the planned cost with respectively a 1.06% and a 4.81% cost overrun. This can be an indication that

the data used represents rather good projects in terms of cost and duration performance. This is confirmed

by the fact that the maximum time overrun is only 34.32% and that the maximum cost overrun is even

lower: 19.48%. On the other hand, 35 projects or 85.37% experience a cost or duration overrun, which

seems like a realistic figure. Still, since FRF is only applied to 41 projects, the results must be evaluated with

caution and further research will certainly be necessary to validate this technique.

The projects used are all construction projects and their number is limited to 41. The reason behind this

decision is that the other projects in the database do not have (sufficient) similar projects to be compared

with. Consequently, without enough similar projects to compare with, it is difficult to apply the FRF

technique on these other projects. The database can be consulted at the site of the OR&S group of the

University of Ghent. More information about the database can be found in Batselier & Vanhoucke (2015)

and Vanhoucke et al. (2016).

17

IV.II Determining Functional Requirements

Provided with the project data, the next step was to determine the functional requirement(s) of each

activity. As stated in the introduction, a functional requirement emphasizes that what the system must do

(Farid & Suh, 2016). When assigning a FR to an activity in a project, it is key to understand which function

an activity fulfils in the project. Often this was not an easy task, because on some subjects a lot of

information can be found and for other activities websites of small and medium-sized enterprises (SMEs)

needed to be consulted to figure out which function a material or activity had. In order to be consistent we

worked with the same methodology to find information about every activity. Figure 4.1 gives an sequential

overview of the consulted sources. Since the functional requirements of 1193 activities needed to be

determined, we decided that when useful information is found at source 1 (the Belgian Building Research

Institute), it was unnecessary to consult the other sources. If not, source 2 is consulted for which the same

rule applies. Only when extra information was found during the Google Search that could help in the

searching process, the searching process started again at source 1.

Figure 4. 2 Methodology information searching process

Since all projects are construction projects, the website of WTCB (Het Wetenschappelijk en Technisch

Centrum voor het Bouwbedrijf) or BBRI (Belgian Building Research Institute) was my most valuable source

of information. The BBRI is a private research institute and has 3 main tasks: perform scientific and technical

research for the benefit of its members, supply technical information and assistance to its members and

contribute to the general innovation and development in the construction sector. Via this website it is easy

to consult magazines, reports, files and technical information about a lot of construction related subjects.

Most functional requirements are determined based on the information found at WTCB.

The next source of information was the website of the WBDG (the Whole Building Design Guide). The WBDG

presents itself as “the only web-based portal providing government and industry practitioners with one-

18

stop access to up-to-date information on a wide range of building-related guidance, criteria and technology

from a 'whole buildings' perspective”.

When no useful information about an activity could be found at the previous scientific sources, the next

step was to search Google for some information. Most of the times it were the SME websites that provided

the best information, but also Wikipedia was useful to learn more about activities or materials. Occasionally,

a different name for an activity or material was found during this stage and then WTCB and WDBG were

consulted again to see if more information could be found about the subject under this different name.

The last source of information were experts in the construction industry. However, nowadays most

information is available online and except for some clarification about the use of some materials, this source

was not used. The links to the websites of the different sources of information can be consulted in Appendix

A.I.

Understanding what an activity does is one thing, but then it was key to give an accurate and good

description of its functional requirement. Sometimes two or even more different tasks were combined in

one activity, which made its FR description rather long. Furthermore, the level of detail in the description

of the activity differs a lot from project to project. In a lot of activity descriptions there is a lack of

information to give a detailed description of its FR, for example in a lot of activities the materials used are

not mentioned. This resulted in rather general descriptions of the FRs.

During the process of defining the FRs, some Rules of Thumb (ROT) were used to be consistent in their

description:

ROT 1: In the description of its FR, the emphasis lies on the main function of the activity and an

abstraction was made of its secondary functions.

ROT 2: The information obtained from the scientific sources WTCB and WDBG we considered as

reliable. If relevant information was obtained via SME-websites, Wikipedia or other sources during

the Google search, at least one other source had to confirm this information to be considered

reliable. In the situation where 2 sources do not agree about the function, extensive research was

done and multiple sources were consulted in order to be able to decide which information is

reliable.

ROT 3: If no or only little information could be found about an activity or material, related search

terms were searched and used to obtain the information needed. In the rare situation that we

could not determine what an activity does, because its description was unclear, we did not define

a FR.

19

Table 4.2 shows some examples of activities and their defined FR.

Activity Functional Requirement

Electricity Enable the use of electrical devices and providing light

Ventilation Ensure air quality

Kitchen Hygienic and safe cooking possibility

Pile Foundation Stability: transfer tensile and compressive forces to the underlying layers

Concrete Reinforcement Strength: resistance against tensile forces

Office Automation Efficient and qualitative automating the information processing and communication tasks

Solar Panels Efficient solar energy conversion to electricity

Gutter Rainwater drain

Roof Insulation Limit heat loss through the roof

Plastering the walls Flat finishing of the walls

Table 4. 2 Examples of Activities and their Functional Requirements

As stated before, the descriptions of the FRs are sometimes limited due to a lack of information in the

activity description. In the future this lack of information can be dealt with when the functional

requirements are added to the project information. This can have the advantage that project managers will

think more about the function and the importance of an activity in a project.

The method is called Functional Requirement-based Forecasting, so the importance of the functional

requirements must not be underestimated. By working with the methodology above I tried to be consistent

and made sure that the same activities have the same FR(s) across the different projects.

20

IV.III Project Size

The determination of the size of the projects was the next important step. The project size is a key factor in

the calculations of the estimated cost and duration of a project. Since these forecasts are based on the

actual cost and duration of past similar projects, the difference in project size between the projects needs

to be taken into account. For example, it would not be logical to estimate the cost and duration of

constructing an apartment building with 2 floors based on the actual values of an apartment building with

5 floors.

In the IT sector the project size can be determined by lines of code (LOC) and function point (FP), but how

could one determine the project size of a construction project to estimate the cost and duration? Can they

be based solely on the dimensions of the building? No, the project size includes factors as cost, duration,

staffing requirements, degree of complexity, level of risk and the strategic value to the organisation. This

size is used to quantify the importance and consequently the management effort an organisation will put

in a project. A tool that allows an organisation to compare their projects in terms of their relative magnitude

is the project sizing matrix. The factors included in this tool are dependent on the relevant project attributes

and an example of such a project sizing matrix is given below (Figure 4.2). In many cases projects are

categorised in small, medium and large projects. The purpose of this project categorisation is that small,

simple and low-risk projects need a different approach then large, complex and high-risk projects (Burgan

& Burgan, 2014).

Small Project Medium Project Large Project

• Project duration less than six

months

• Project duration between six

months and 12 months

• Project duration greater

than 12 months

• Project budget less than

$100,000

• Project budget between

$100,000 and $500,000

• Project budget greater than

$500,000

• Project team fewer than five

people

• Project team between five

and 20 people

• Project team greater than 20

people

• Minimal integration with

other business units

• Moderate integration with

other business units

• Significant integration with

other business units

• Impacts fewer than 25 end

users

• Impacts 25 to 250 end users • Impacts more than 250 end

users

Table 4. 3 Project sizing matrix. Source: Burgan & Burgan (2014)

Looking at the project data, one can see that there is again a lack of information regarding the project team,

degree of complexity, dimensions of the building, etc. The only relevant project attributes we have are the

cost and the duration of the projects. The big advantage here is that the actual cost and duration of the

21

projects are available, which would not be the case for an early stage project. Since the estimates in FRF

are based on similar projects, it is possible to make some assumptions.

Assumption 1: The complexity of the projects in a project group is similar and does not imply a

difference in size.

Assumption 2: The number of people working on the project is equal for similar projects. If this is

not the case and one project has a higher number of staff working on the project this will result in

higher costs and a lower duration of the activities.

Assumption 3: The dimensions of the construction project reflect in the cost and duration of the

project. The bigger the project in terms of height, width and length, the higher the cost and the

longer the duration of the project. Consequently, the project size based on these higher values will

be bigger.

Assumption 4: The importance and impact of the similar projects in a project group are assumed

equal.

These assumptions limit the comparison of the project sizes to similar projects, because they can only be

made for projects who are in the same project group. Consequently, the inputs of the forecasts are limited

to the data of similar projects. In contrast to the project sizing matrix, we did not divide the projects into

different categories (small, medium and large), but instead evaluated them separately based on their actual

cost and duration.

Visualisation of the project groups

If the project sizes in a group are equal to each other there must be a correlation between the cost and

duration of the projects. Assuming equal project sizes, the projects with a higher cost should have a shorter

project duration (and vice versa) and form an efficiency frontier. When we look at Figure 4.3 we see that

there is no clear correlation between cost and duration in any project group, so we assume that the project

sizes are different for each project. Note that some projects groups have more observations then their

number of projects. This is because some projects are divided in subprojects in Chapter V.

22

Figure 4. 3 Correlation Actual Cost Actual Duration

Quantifying the project size

The literature describes the division between small, medium and large projects, but does not include an

unambiguous formula to quantify these project sizes. Taking into account the assumptions and since we

have the actual cost and duration of all projects, the project sizes can be determined based on these data.

The cost of the projects is measured in Euro and their duration is measured in time-units, so they cannot

be added up to quantify the size of a project. Instead, what we can do is comparing the sizes of two different

projects within a project group by dividing the actual cost of the first project by the actual cost of the second

project and do the same for their actual durations. If we add these two values together, we get a

dimensionless value for their difference in project size. This dimensionless value will be referred to as the

‘size-factor’ in the following parts of this dissertation and is calculated by using the following formula:

23

𝑆𝑖𝑧𝑒𝑖,𝑥 = 𝑎 ∗𝐴𝑐𝑡𝑢𝑎𝑙 𝐶𝑜𝑠𝑡𝑥

𝐴𝑐𝑡𝑢𝑎𝑙 𝐶𝑜𝑠𝑡𝑖+ (1 − 𝑎) ∗

𝐴𝑐𝑡𝑢𝑎𝑙 𝐷𝑢𝑟𝑎𝑡𝑖𝑜𝑛𝑥

𝐴𝑐𝑡𝑢𝑎𝑙 𝐷𝑢𝑟𝑎𝑡𝑖𝑜𝑛𝑖 (1)

𝑆𝑖𝑧𝑒𝑖,𝑥 is the relative size of project 𝑥 compared to project 𝑖. As mentioned above, this is a key factor in the

calculations of the forecasted cost and duration of activities in project 𝑥. Because these forecasts are based

on actual values of project 𝑖, these actual values need to be adjusted to the size of project 𝑥 with this size-

factor.

Coefficient 𝑎 ∈ [0,1] indicates the relative importance of the actual cost in the determination of the relative

project size. Consequently, (1 − 𝑎) indicates the relative importance of the actual duration in the

determination of the size-factor. So, in order to determine the size-factors, a last assumption is needed.

Assumption 5: Cost and duration are equally important factors in the calculation of the project

size-factors.

Assuming that cost and duration are equally important factors in determining the project size, coefficient

𝑎 in Equation (1) is initially set equal to 0.50. In Chapter V a sensitivity analysis is performed on this

assumption.

24

IV.IV Calculations

The last step in the methodology is to calculate the cost and duration forecasts and compare them with the

actual values of the project. The forecast formula is applied for every activity in a project that has at least

one similar project in its project group with an activity that has the same functional requirement(s). The

same formula (Equation (2)) is used to determine both the forecasted cost and duration. The forecasted

values represent the average actual values of activities with the same FR in similar projects, taking into

account the difference in project sizes. The forecast value of the activity with functional requirement 𝑦 in

project 𝑥 is denoted as 𝐹𝑜𝑟𝑒𝑐𝑎𝑠𝑡𝑥,𝑦.

𝐹𝑜𝑟𝑒𝑐𝑎𝑠𝑡𝑥,𝑦 =

∑ 𝑆𝑖𝑧𝑒𝑖,𝑥 ∗ 𝐴𝑐𝑡𝑢𝑎𝑙𝑉𝑎𝑙𝑢𝑒𝑖,𝑦𝑛𝑖=1

𝑛 (2)

𝐴𝑐𝑡𝑢𝑎𝑙𝑉𝑎𝑙𝑢𝑒𝑖,𝑦 denotes the actual cost or actual duration of the activity with functional requirement 𝑦 in

project 𝑖 dependent on whether the cost or duration is forecasted. As already explained in the previous

part, 𝑆𝑖𝑧𝑒𝑖,𝑥 is the relative size of project 𝑥 compared to (similar) project 𝑖. The number of similar projects

that have an activity with the same functional requirement 𝑦 is denoted by 𝑛.

After the forecasted values for the activities are computed, they are compared to their actual costs or

durations. To avoid biased results caused by extreme forecast errors, the forecast error of an activity is

limited to 100%. The forecast accuracy is measured for every activity with functional requirement 𝑦 of

project 𝑥 using formulas (3) and (4).

𝐹𝑜𝑟𝑒𝑐𝑎𝑠𝑡 𝐸𝑟𝑟𝑜𝑟𝑥,𝑦 = max

𝑥,𝑦(1,

|𝐴𝑐𝑡𝑢𝑎𝑙𝑥,𝑦 − 𝐹𝑜𝑟𝑒𝑐𝑎𝑠𝑡𝑥,𝑦|

𝐴𝑐𝑡𝑢𝑎𝑙𝑥,𝑦 ) (3)

𝐹𝑜𝑟𝑒𝑐𝑎𝑠𝑡 𝐴𝑐𝑐𝑢𝑟𝑎𝑐𝑦𝑥,𝑦 = 1 − 𝐹𝑜𝑟𝑒𝑐𝑎𝑠𝑡 𝐸𝑟𝑟𝑜𝑟𝑥,𝑦 (4)

Now the forecasts for the individual activities are obtained, the forecast accuracy of a project can be

evaluated in two ways. The first way is to use these forecasts as input to calculate the total forecasted cost

and duration of a project. The forecasted cost of an activity can be easily obtained by taking the sum of the

forecasted costs of its activities. However, the forecasted duration of a project depends on its critical path.

Because the critical path of a project can change when the durations of the activities change, the forecasted

duration cannot be obtained by taking the sum of the forecasted duration of the critical activities in the

existing baseline schedule. Fortunately, the dataset of Batselier & Vanhoucke (2015) available at the OR&S

group of Ghent University contains a Protrack file of each project. By changing the initial planned duration

of the activities to the forecasted duration of the activities in Protrack, the program automatically

25

recalculates the critical path and the total forecasted duration of the project. For practical purposes the

forecasted duration is rounded to the hour in Protrack, given that there are 8 (working) hours in a day.

To evaluate these total project cost and duration forecasts, the Absolute Percentage Error (APE) is used and

we will call this the ‘Absolute Forecast Error’ (FE) of a project for the remaining of this dissertation. Likewise,

the forecast accuracy of these forecasts will be referred to as the ‘Absolute Forecast Accuracy’ of project 𝑥.

𝐴𝑏𝑠𝑜𝑙𝑢𝑡𝑒 𝐹𝑜𝑟𝑒𝑐𝑎𝑠𝑡 𝐸𝑟𝑟𝑜𝑟𝑥 =

|𝐴𝑐𝑡𝑢𝑎𝑙𝑥 − 𝐹𝑜𝑟𝑒𝑐𝑎𝑠𝑡𝑥|

𝐴𝑐𝑡𝑢𝑎𝑙𝑥 (5)

𝐴𝑏𝑠𝑜𝑙𝑢𝑡𝑒 𝐹𝑜𝑟𝑒𝑐𝑎𝑠𝑡 𝐴𝑐𝑐𝑢𝑟𝑎𝑐𝑦𝑥 = 1 − 𝐴𝑏𝑠𝑜𝑙𝑢𝑡𝑒 𝐹𝑜𝑟𝑒𝑐𝑎𝑠𝑡 𝐸𝑟𝑟𝑜𝑟𝑥 (6)

Despite the fact that this is a realistic first assessment of Functional Requirement-based Forecasting, the

Absolute Forecast Accuracy cannot be calculated for every project. When only 1 activity in a project doesn’t

have a similar activity with the same functional requirement in its project group, the cost and duration of

that activity cannot be forecasted with FRF. Furthermore, by taking the sum of the activity forecasts,

forecast errors may cancel each other out. To avoid these two problems the Mean Absolute Percentage

Error (MAPE) of the activities is used to evaluate a project. In this way the activities without forecast can be

left out and every forecast error will be included in the assessment of the project forecast.

The formulas for the MAPE and the Forecast Accuracy of project 𝑥 are given below.

𝑀𝐴𝑃𝐸𝑥 =

1

𝑁∗ ∑ 𝐹𝑜𝑟𝑒𝑐𝑎𝑠𝑡 𝐸𝑟𝑟𝑜𝑟𝑥,𝑦

𝑁

𝑦=1

(7)

𝐹𝑜𝑟𝑒𝑐𝑎𝑠𝑡 𝐴𝑐𝑐𝑢𝑟𝑎𝑐𝑦𝑥 = 1 − 𝑀𝐴𝑃𝐸𝑥 (8)

𝐹𝑜𝑟𝑒𝑐𝑎𝑠𝑡 𝐸𝑟𝑟𝑜𝑟𝑥,𝑦 refers to Equation (3). It was already mentioned that the forecast error of an activity is

limited to 100% to avoid biased results caused by extreme forecast errors. 𝑁 denotes the number of

activities that can be forecasted with FRF in project 𝑥.

Next, the results of this methodology will be presented and analysed. The goal is to find the strengths and

weaknesses of Functional Requirement-based Forecasting and to find an answer on the research questions

of this dissertation.

26

Chapter V

Results

In this chapter the results of the FRF technique are analysed and thoroughly discussed. First, the forecasts

for the different project groups are evaluated. For every group some project specific information is given

and the forecast accuracy of each group is examined. The second part of this chapter consists of a general

assessment of the forecast accuracy of FRF for the data used in this dissertation. Subsequently, we test the

hypothesises made in this dissertation by performing a regression analysis of the different factors on both

the cost and duration MAPE. Finally, a sensitivity analysis is performed on the assumption that cost and

duration are equally important factors in the calculation of the project size-factors.

In figure 5.1 the structure of this chapter is visualised.

Figure 5. 1 Overview Result Analysis

27

V.I Results per project group

Residential House Finishing Works (RHFW)

This project group consists of 11 Residential House Finishing Works (RHFW) projects and is the group with

the largest number of projects. Looking at the activities, one sees that all projects are divided into 4 similar

phases. Moreover, except for RHFW (3), (4) and (5), who have the extra activity “floor heating”, the activities

of the projects are exactly the same! Consequently, the FRs of these activities are the same and their

forecasted cost and duration are based on the highest possible number of (actual) observations in this

project group.

Regarding the original planned costs, one sees that all projects are executed over budget, with an average

cost overrun of 6.90% and a maximum cost overrun of 19% in RHFW (3). The results of applying FRF to

forecast the costs of these projects are presented in Table 5.1. The average Absolute Forecast Error is

decreased to 5.35% and in only 4 projects the forecasted costs are lower than the average cost. Also the

MAPE of the cost of the activities are relatively low and the average MAPE of the projects is 13.73% and

consequently an average cost forecast accuracy of 86.27%.

Project Cost Forecast Actual Cost Absolute FE

MAPE

Residential House Finishing Works (1) 58,729.27 € 64,526.76 € 8.98% 11.79% Residential House Finishing Works (2) 57,419.47 € 64,580.17 € 11.09% 14.09% Residential House Finishing Works (3) 59,495.33 € 60,829.52 € 2.19% 12.59% Residential House Finishing Works (4) 56,058.21 € 53,351.38 € 5.07% 16.88% Residential House Finishing Works (5) 57,955.79 € 53,783.28 € 7.76% 17.20% Residential House Finishing Works (6) 58,154.16 € 54,996.22 € 5.74% 11.89% Residential House Finishing Works (7) 59,412.22 € 57,822.40 € 2.75% 10.60% Residential House Finishing Works (8) 58,888.42 € 56,645.71 € 3.96% 11.01% Residential House Finishing Works (9) 57,344.27 € 53,176.83 € 7.84% 13.33%

Residential House Finishing Works (10) 55,600.15 € 56,748.33 € 2.02% 16.84% Residential House Finishing Works (11) 54,073.71 € 53,319.24 € 1.42% 14.80%

Table 5. 1 Residential House Finishing Works: Cost forecast

In the previous chapter it was already mentioned that the actual duration and the initial planned duration

for all the projects in the RHFW-group are the same. As a result it is impossible to improve the duration

forecast accuracy with the proposed technique. Nevertheless, the Absolute Forecast Error is very low with

an average of 6.36% and 6 projects have an actual duration that is longer than the duration forecast.

Besides, the average MAPE of the activities regarding duration is 14.22%, which is similar to MAPE of the

cost forecasts. Furthermore, Table 5.2 indicates no extreme forecast errors.

28

Project Duration Forecast

Actual Duration Absolute FE

MAPE

Residential House Finishing Works (1) 97d 3h 90d 8.19% 20.90% Residential House Finishing Works (2) 95d 5h 86d 11.19% 17.09% Residential House Finishing Works (3) 100d 7h 91d 10.85% 15.28% Residential House Finishing Works (4) 93d 4h 91d 2.75% 14.49% Residential House Finishing Works (5) 98d 4h 91d 8.24% 18.03% Residential House Finishing Works (6) 94d 101d 6.93% 11.24% Residential House Finishing Works (7) 96d 3h 101d 4.58% 12.62% Residential House Finishing Works (8) 96d 1h 101d 4.83% 12.04% Residential House Finishing Works (9) 92d 101d 8.91% 10.35%

Residential House Finishing Works (10) 90d 6h 91d 0.27% 11.54% Residential House Finishing Works (11) 88d 1h 91d 3.16% 12.86%

Table 5. 2 Residential House Finishing Works: Duration forecast

This is without a doubt the project group with the most accurate forecasts. Furthermore, the fact that there

are only relatively small differences in actual cost and duration between the projects, results in size-factors

close to 1. Still, one must be careful on drawing conclusions about FRF based on the results of this project

group. Since these 11 projects are all performed exactly on their time schedule, the results may be biased.

Looking at Table 5.2 it is highly unlikely that these actual durations are the real actual durations of these

projects. The actual durations are very similar and this affects the size factor which is closer to 1 and as a

consequence less influential in the calculations of the forecasts.

Residential House (RH)

The project group Residential House (RH) consists of 4 projects with more or less the same structure. The

activities are subdivided into similar categories across the projects, but within these categories the activities

differ across the projects. Before looking at the result, it must be mentioned that for each project in this

group at least 1 activity cannot be forecasted, due to the lack of a similar functional requirement in the

other projects. Since these activities account only for a small amount of the total cost and duration, we

decided to take over their initial planned values in the calculations of the absolute FE for both cost and

duration. Note that the calculations of the MAPE are solely based on the estimates of the FRF technique.

The cost forecasts in Table 5.3 show that project RH (3) has the worst forecast with an absolute forecast

error of 22.11% and a MAPE of 53.52%. Furthermore, this is the only project that underestimates the actual

costs. The values of the MAPE of these projects lie very close to each other with an average of 51.96%. This

bad result is particularity caused by high forecast errors in low cost activities, which is reflected in the much

lower absolute forecast error values.

29

Project Cost Forecast Actual Cost Absolute FE

MAPE

Residential House (1) 191,352.33 € 163,189.00 € 17.26% 52.30% Residential House (2) 253,948.00 € 226,285.00 € 12.22% 50.05% Residential House (3) 295,435.92 € 379,300.00 € 22.11% 53.52% Residential House (4) 238,494.76 € 222,021.78 € 7.42% 51.97%

Table 5. 3 Residential House: Cost forecast

For the duration forecasts similar results can be noticed (Table 5.4). RH (3) performs even worse in terms

of its absolute duration forecast accuracy with an absolute duration forecast error of 39.92%. The other

projects have a more accurate absolute forecast with absolute forecast errors around 10%. Furthermore,

the duration MAPE values lie very close to each other as well, but it is remarkable that the average duration

MAPE for the RH project group is about 5 % lower than for its costs.

Project Duration Forecast

Actual Duration Absolute FE

MAPE

Residential House (1) 225d 3h 254d 11.27% 43.69% Residential House (2) 317d 7h 291d 9.24% 43.61% Residential House (3) 461d 6h 330d 39.92% 48.75% Residential House (4) 279d 7h 320d 12.54% 48.88%

Table 5. 4 Residential House: Duration forecast

Despite that the MAPE for both cost and duration are very high, the total forecasted values for RH (1), (2)

and (4) are acceptable, given the low number of projects in this project group. The fact that the forecasts

for RH (3) underestimate the cost and overestimate the duration of the execution, can be due to a

difference in project team size between these projects. More resources cost more money, but can shorten

the duration of the project significantly. Since these projects lack this information, it is impossible to know

what the cause of this bad forecast is. Still we must treat these absolute project results with caution due to

the fact that for some small activities the initial planned values are used. Looking at the MAPE results, we

can conclude that for the individual activities in this project group the forecasts of the FRF technique are

inadequate.

Apartment Building Finishing Works (ABFW)

The Apartment Building Finishing Works (ABFW) group is composed of 4 projects. ABFW (1) and (2) execute

the finishing works of apartment block A and ABFW (3) and (4) those of block B. Each project includes the

finishing works of 2 floors. Since most activities emerge in the execution of each floor, we chose to handle

the data as if it were 8 different projects. Note that one activity could not be forecasted using FRF: the (last)

activity “cleaning up” with an actual cost of € 901 and 5 days duration in project (4). Since this is only a small

part of the total cost and duration, we decided to use the initial planned cost (€ 920) and duration (5 days)

in the calculations of the absolute forecast error here as well. The MAPE is based on the FRF forecasts only.

30

The cost forecasts of each project in Table 5.5 equal the sum of the costs of its 2 floors. When taking the

sum of the actual costs and cost forecasts of each project, we notice that the total absolute forecast error

of the project group (or the 2 apartment blocks) is only 1.10%. This figure is the result of the fact that the

underestimating of the costs of project (2) and the overestimating of the costs of project (3) cancel each

other out. It is clear that the MAPE of the individual activities is higher, with an average of 16.19%. Since

the execution of each floor consists of only a dozen activities, the MAPE is sensitive to a bad forecast in one

activity. Still, the forecasts for most subprojects are relatively accurate.

Project Cost Forecast Actual Cost Absolute FE

MAPE

Apartment Building Finishing Works (1) 502,435.59 € 498,473.00 € 0.79% 16.88% Block A ground floor 264,031.24 € 267,887.00 € 1.44% 19.43%

Block A first floor 238,404.35 € 230,586.00 € 3.39% 14.09% Apartment Building Finishing Works (2) 443,640.83 € 496,991.00 € 10.73% 13.59%

Block A second floor 240,497.03 € 245,743.00 € 2.13% 8.99% Block A third floor 203,143.80 € 251,248.00 € 19.15% 18.20%

Apartment Building Finishing Works (3) 455,987.63 € 394,829.00 € 15.49% 19.74% Block B ground floor 245,590.94 € 204,250.00 € 20.24% 24.17%

Block B first floor 210,396.69 € 190,579.00 € 10.40% 14.91% Apartment Building Finishing Works (4) 391,626.31 € 383,871.00 € 2.02% 14.53%

Block B second floor 209,001.47 € 187,211.00 € 11.64% 16.38% Block B third floor 182,624.84 € 196,660.00 € 7.14% 12.67%

Table 5. 5 Apartment Building Finishing Works: Cost forecast

The results of the duration forecast are comparable with the results of the cost forecast. The same

reasoning can be applied here: the absolute forecast errors are relatively low, but the average MAPE is

18.17% due to its sensitivity to a bad forecast value of one activity. Nevertheless, Table 5.6 shows no

extremely high duration MAPE values.

Project Duration Forecast

Actual Duration Absolute FE

MAPE

Apartment Building Finishing Works (1) 107d 6h 117d 7.91% 17.61% Block A ground floor 94d 6h 92d 2.99% 16.28%

Block A first floor 91d 2h 100d 8.75% 19.07% Apartment Building Finishing Works (2) 112d 4h 97d 15.98% 19.87%

Block A second floor 92d 7h 97d 4.25% 12.38% Block A third floor 85d 4h 70d 22.14% 27.36%

Apartment Building Finishing Works (3) 121d 2h 129d 6.01% 12.42% Block B ground floor 96d 6h 97d 0.26% 14.24%

Block B first floor 82d 4h 92d 10.33% 10.44% Apartment Building Finishing Works (4) 92d 2h 92d 0.27% 22.76%

Block B second floor 82d 2h 92d 10.60% 10.65% Block B third floor 83d 7h 70d 19.82% 34.87%

Table 5. 6 Apartment Building Finishing Works: Duration forecast

31

The forecast accuracy of the activities in this project group is on average above 80% for both cost and

duration. The fact that the ‘Finishing Works’ activities per floor are almost equal and that most forecasts

are based on 7 actual observations indicates why FRF is relatively accurate for this group. But since there

are not a lot activities per floor, the results are sensitive to a bad result of one activity. Still, FRF is a decent

forecast technique for the ABFW group.

Apartment Building Structural Work (ABSW)

The next group, Apartment Building Structural Work (ABSW), consists of only 3 projects. The first thing to

notice when looking at these projects is that ABSW (1) is very different from ABSW (2) and (3). ABSW (1)

executes the construction of the foundations, the sewerage and the cellar floor. ABSW (2) and (3) construct

the structure of respectively block A and block B of the apartment building with each 4 floors. Similar to the

previous project group, ABFW, we chose to handle the execution of every floor of ABSW (2) and (3) as if

they were 8 different projects. Since the FRs of the activities in ABSW (1) are different, FRF could not be

used to forecast the cost and duration based on the actual values of the other projects. Instead the

execution of most of the activities in this project is done in 2 phases, between marks Aa-Ab and Ab-Hb.

Before discussing the results of ABSW (1), it must be noted that the calculations of the size-factor of

subprojects Aa-Ab and Ab-Hb are done slightly different. Since the activities of the different subprojects are

not divided into different phases, in contrast to the other projects which are divided into subprojects, they

can be executed at the same time. Instead of taking the sum of the duration of the activities in the critical

path, the actual duration of these subproject are determined by the sum of the actual durations of all their

activities.

Table 5.7 depicts the MAPE results for both cost and duration. In contrast to previous projects, the MAPEs

of the duration forecasts are a lot bigger than those of the cost forecast. This is due to the fact that the

difference in actual duration between these subprojects are a lot bigger than their difference in actual cost.

Since these forecasted values are based on only one actual observation, FRF is very sensitive to these

differences for this project. Note that no total cost or duration is calculated because each subproject had

one activity with a different FR.

Project MAPE Cost MAPE Duration

Apartment Building Structural Work (1) 7.21% 35.80% Aa-Ab 7.24% 27.94% Ab-Hb 7.18% 43.66%

Table 5. 7 Apartment Building Structural Work (1): cost & duration MAPE

Looking at the cost forecasts of ABSW (2) and (3), we see that the absolute forecast errors of the different

subprojects cancel each other out and result in a high absolute forecast accuracy (Table 5.8). Although the

subprojects only consists of maximum 6 activities, the higher MAPE is not due to one bad forecast, but the

32

forecast errors are relatively consistent throughout the activities. The explicit difference in forecast

accuracy between both projects is due to the fact that three subprojects of ABSW (3) have one extra activity

with a big forecast error. This is reflected in higher absolute forecast errors and higher MAPEs for these

subprojects.

Project Cost Forecast Actual Cost Absolute FE

MAPE

Apartment Building Structural Work (2) 1,888,527.96 € 1,860,330.62 € 1.52% 14.48% Block A ground floor 399,834.08 € 465,147.27 € 14.04% 15.11%

Block A first floor 443,019.01 € 380,451.99 € 16.45% 17.69% Block A second floor 473,670.85 € 407,093.49 € 16.35% 15.94%

Block A third floor 572,004.01 € 607,637.86 € 5.86% 9.30% Apartment Building Structural Work (3) 1,534,206.75 € 1,353,361.29 € 13.36% 33.41%

Block B ground floor 419,210.89 € 348,020.95 € 20.46% 22.10% Block B first floor 421,123.50 € 308,583.20 € 36.47% 41.91%

Block B second floor 430,008.29 € 328,262.20 € 31.00% 38.06% Block B third floor 263,864.07 € 368,494.94 € 28.39% 29.69%

Table 5. 8 Apartment Building Structural Work (2) & (3): Cost forecast

While the subprojects of ABSW (2) have a better cost forecast, their duration forecasts are (a lot) worse

than those of ABSW (3). The eye-catcher in Table 5.9 is the execution of the third floor of ABSW (2) with a

MAPE of no less than 71.82%. Despite a MAPE of 40.49%, the absolute forecast error is only 6.08% for ABSW

(2). Again, one can see that the absolute forecast errors in the different subprojects cancel each other out.

Project Duration Forecast

Actual Duration Absolute FE

MAPE

Apartment Building Structural Work (2) 139d 148d 6.08% 40.49% Block A ground floor 21d 3h 46d 53.53% 40.39%

Block A first floor 30d 29d 3.45% 32.89% Block A second floor 32d 4h 31d 4.84% 16.85%

Block A third floor 45d 1h 32d 41.02% 71.82% Apartment Building Structural Work (3) 100d 6h 96d 4.95% 18.16%

Block B ground floor 29d 1h 28d 4.02% 17.04% Block B first floor 27d 5h 29d 4.74% 13.71%

Block B second floor 28d 5h 29d 1.29% 14.12% Block B third floor 15d 3h 10d 53.75% 27.60% Table 5. 9 Apartment Building Structural Work (2) & (3): Duration forecast

When focussing on the absolute forecast errors of the projects, FRF seems like a good technique to estimate

the cost and duration of these projects. Although when looking at the MAPE of the activities, the results of

FRF are contradictory. The fact that the subprojects were very small in terms of number of activities, could

be the reason of the varying forecast accuracies. On the other hand, the forecast of a project with many

activities based on only 1 observation is also very sensitive to variations.

33

Railway Bridge (RB)

This project group concerns 5 Railway Bridge (RB) projects. The execution of these projects is divided into

different phases, but in contrast to previous projects, these phases differ across the different projects. For

example, the construction of the bridge in RB (3) is done in two phases, while in RB (1), (2) and (4) this is

done in three phases. In order to apply FRF to all the projects, we decided to reform the projects by

collecting the activities with the same or similar FRs and categorize them under one activity. So instead of

forecasting the cost and duration of, for example, the activity ‘concrete’ for the different phases, we

preferred to forecast the total cost and duration of concrete for the different railway bridges.

Note that we have no absolute forecasts, because in every project at least one activity could not be

forecasted using FRF. Furthermore, we cannot know which part of the forecasted duration of the newly

compound activities belongs to which initial activity. In this way it is impossible to forecast the total duration

of the project without extra assumptions, because the duration of a project depends on the duration of the

activities on the critical path. Table 5.10 depicts big differences in the MAPE results for both cost and

duration. Especially the cost MAPE of 54.71% in RB (3) and the duration MAPE of 48.55% in RB (5)

demonstrate that FRF falls short to give a reliable estimate for this project group.

Project MAPE Cost MAPE Duration

Railway Bridge (1) 34.65% 26.01% Railway Bridge (2) 34.08% 41.22% Railway Bridge (3) 54.71% 35.69% Railway Bridge (4) 22.42% 38.82% Railway Bridge (5) 26.81% 48.55%

Table 5. 10 Railway Bridge: cost & duration MAPE

Looking at the individual activity forecasts it is remarkable that, although there are 5 projects in this group,

a lot of forecasts are only based on 1 or 2 observations. With an average cost MAPE of 34.53% and an even

higher average duration MAPE of 38.06% FRF proves to be unreliable in obtaining accurate forecasts for the

activities in the RB projects.

Apartment Building (AB)

The ‘Apartment Building’ project group is composed of 6 projects, but the structure of their activities differs

a lot. AB (1), (2) and (3) are not divided into different phases and can be considered pretty similar. Instead

the activities in AB (4) are divided in 3 groups: general activities, the activities done in the different floors

and the activities involving the construction of the ground floor. AB (5) and (6) are not explicitly divided into

phases, but consist of a lot of recurring activities. These recurring activities all have a general activity

description like “electricity”, so it is difficult to determine what the activity entails exactly. Moreover, every

activity in AB (5) and (6) has an initial planned duration of 1 week or 5 (working) days or a multiple of this

value. Similar to the previous project group RB, we decided to reform the 6 projects by grouping the

activities with the same or similar FRs under one activity.

34

Table 5.11 depicts the MAPE of the cost and duration forecast of every AB project. It is clear that for the

individual activities in this project group both the cost and duration forecasts of the FRF technique are

inadequate. The MAPE results of the cost forecasts are more or less similar across the different projects

with an average of no less than 61.36%. The results of the duration forecasts vary, but still have an average

of 61.35%.

Project MAPE Cost MAPE Duration

Apartment Building (1) 66.72% 46.03% Apartment Building (2) 68.83% 81.24% Apartment Building (3) 63.41% 40.79% Apartment Building (4) 58.61% 78.80% Apartment Building (5) 57.43% 57.61% Apartment Building (6) 54.64% 62.73%

Table 5. 11 Apartment Building: cost & duration MAPE

As already explained in the previous project we cannot forecast the total duration of the reformed projects

without extra assumptions. The total costs, on the other hand, can be forecasted if every activity has at

least one activity with the same FR in another project. For AB (3), (5) and (6) the total costs can be calculated

and its absolute forecast errors confirm that FRF falls short in the estimation of the costs for this project

group (Table 5.12).

Project Cost Forecast Actual Cost Absolute FE

Apartment Building (1) - - - Apartment Building (2) - - - Apartment Building (3) 2,514,661.91 € 1,289,696.78 € 94.98% Apartment Building (4) - - - Apartment Building (5) 1,881,783.00 € 2,590,796.73 € 27.37% Apartment Building (6) 862,110.84 € 2,563,675.86 € 66.37%

Table 5. 12 Apartment Building: Absolute cost FE

The big differences in the calculated project sizes of the AB projects might be the reason of these inaccurate

forecasts. Since the cost and/or duration of some activities totally depend on the size of the project and

other activities depend less on the size of the project, the forecast accuracies of these last category

decreases when the differences in project sizes are bigger.

Office Finishing Works (OFW)

The Next project group is Office Finishing Works (OFW). This project group consists of 5 projects and similar

to AB (5) and (6), the OFW projects are not explicitly divided into phases, but have some recurring activities.

Since their activity description is also very general and the number of times a recurring activity returns

differs from project to project, we decided to reform the projects in the same way we did in the two

previous project groups RB and AB. Furthermore it is remarkable that the projects differ a lot in number of

35

activities, and by reforming the projects, we only make this worse. For example, while OFW (4) only consists

of 4 activities, OFW (5) has 20 activities.

Looking at the results of the forecasts of the individual activities in Table 5.13, one can only conclude that

they are disastrous! With an average MAPE of 73.62% for the cost forecasts and an average MAPE of 77.51%

for the duration forecasts, the most striking result is the relative good cost MAPE of OFW (4). In OFW (2)

the MAPE results of the FRF technique reach an absolute low point with an cost MAPE of 89.71% and an

even higher duration MAPE of no less than 94.38%.

Project MAPE Cost MAPE Duration

Office Finishing Works (1) 78.32% 72.02% Office Finishing Works (2) 89.71% 94.38% Office Finishing Works (3) 76.46% 72.82% Office Finishing Works (4) 37.28% 77.80% Office Finishing Works (5) 86.32% 70.51%

Table 5. 13 Office Finishing Works: cost & duration MAPE

Similar to the previous project group AB, we could determine some total cost forecast for some OFW

projects (Table 5.14). When comparing the absolute forecast errors of the projects with the cost MAPE of

the individual activities, we see that the absolute FE is much lower. OFW (3) even has an absolute forecast

accuracy of 86.89%. Still the absolute forecast error of 41.53% in OFW (2) proves that this might be a lucky

result due to the fact that the forecast errors of the activities cancelled each other out.

Project Cost Forecast Actual Cost Absolute FE

Office Finishing Works (1) - - - Office Finishing Works (2) 106,808.80 € 75,468.30 € 41.53% Office Finishing Works (3) 348,759.86 € 308,343.78 € 13.11% Office Finishing Works (4) 151,279.69 € 198,567.00 € 23.81% Office Finishing Works (5) - - -

Table 5. 14 Office Finishing Works: Absolute cost FE

Using FRF for this project group definitely results in the worst MAPE values in the used data. Furthermore,

it is remarkable that there is a big difference in project size between the projects in this project group. This

difference is mainly caused by the biggest project, OFW (1), who’s actual cost is higher than 3 times the

actual cost of the second biggest (OFW (3)). Furthermore the actual duration of OFW (1) is almost twice the

actual duration of OFW (3). Second, the execution of the projects differ too much. Looking at, for example

the grouped activities “moveable walls” or “Office Automation”, it is strange how different their importance

is in terms of actual cost and duration compared with the total actual cost and duration of the project.

36

Social Apartments Ypres (SAY)

The last project group Social Apartments Ypres (SAY) concerns 3 projects. When looking at the execution of

these projects, their difference in terms of activities is the first thing to notice. Furthermore, there is a

difference in level of detail in the activity descriptions between these projects. In order to be able to use

FRF for these activities, we reformed the projects in a similar way as the previous projects by grouping the

activities with similar functional requirements into one activity. Still a lot of activities cannot be forecasted

with the proposed technique due to the lack of activities with the same FRs in the other projects.

In contrast to the previous 2 project groups, no absolute cost forecast accuracies could be calculated for

the projects in this group. Moreover, in SAY (1) and (3) more than half of the activities in the project do not

have an activity in a similar project with the same FR! Since the FRF forecasts are determined by the size

factor of the full project, the results in table 5.15 indicate that this might be the reason why the MAPEs are

very high.

Project MAPE Cost MAPE Duration

Social Apartments Ypres (1) 72.15% 41.67% Social Apartments Ypres (2) 47.42% 38.68% Social Apartments Ypres (3) 56.65% 73.55%

Table 5. 15 Social Apartments Ypres: cost & duration MAPE

In order to check if the forecasts of the SAY projects are biased by their size-factor, we decided to

experiment and forecast the cost and duration of their sub-projects. These sub-projects consists only of

activities which could be forecasted using FRF. Their size factor is determined by the actual cost, which is

equal to the sum of the cost the activities in the subproject, and the actual duration, which is equal to the

sum of the duration of the activities in the subproject instead of the duration of the critical path.

When looking at the results in Table 5.16 we see that the MAPE of the different projects is more aligned,

but the FRF forecast accuracy is not increasing dramatically. While the average cost MAPE is slightly

decreasing from 58.74% to 57.24%, the average cost MAPE even increases from 51.30% to 54.82%.

Project MAPE Cost MAPE Duration

Social Apartments Ypres (1) (b) 59.36% 45.58% Social Apartments Ypres (2) (b) 53.91% 58.03% Social Apartments Ypres (3) (b) 58.44% 60.83%

Table 5. 16 Social Apartments Ypres (b): cost & duration MAPE

Neither the cost, nor the duration forecast accuracies of the projects are reliable. So we can conclude that

FRF fails in estimating these values accurately for this project group. Even when we pull the activities

without a forecast out of the project and determine a new size factor, we do not get better results. The

difference in execution between the execution of the social apartments can be the reason of these poor

forecasts. Furthermore this project group only consists of 2 projects, so the observations on which a

37

forecast is made are scarce. Also the grouping of activities can be another reason of the inaccuracy, but

similar as in other projects we had to do this in order to get comparable results and be able to use FRF.

38

V.II General Results

Now that we discussed the peculiarities and results of the different project groups, we can make a general

evaluation FRF for the data used in this research. Appendix A.2 includes an overview of the MAPE and

absolute FE of all projects for both cost (Table A.1) and duration forecasts (Table A.2). Note that we consider

the subprojects as full-fledged projects. So when appropriate, the average forecast accuracy is calculated

using the results of the subprojects. Looking at the results of the different project groups, some remarkable

patterns can be noticed.

First, we see that for almost every project group the absolute forecast values of the FRF technique are

better than the average MAPE of its activities. Note that the comparison between the total average MAPE

of the projects and their total average absolute FE does not make much sense, because we could not obtain

an absolute FE for every project. Consequently, the average absolute FE is based on fewer projects and

should not be compared with the average MAPE. Nevertheless, it is clear that the absolute FE is much lower

than the MAPE for most projects. This is due to the fact that the absolute forecast errors in the different

activities are sometimes able to cancel each other out and give a more accurate forecast for the total project

cost and duration. Therefore, while assessing the forecast accuracy of FRF, we will focus on the MAPE

results.

Second, the FRF forecast accuracy of the project groups that consist of projects with a similar structure is

remarkably lower than those of the projects we needed to reform to obtain a forecast. When we divided

the project groups in these 2 categories, we see that the mean MAPE of the similar structured projects is

20.97% for cost and 24.02% for duration forecasts. However the average MAPE of the reformed projects is

more than 30% higher for both cost (57.11%) and duration (57.79%). This indicates that the structure of the

project and specific description of the activities are important when using FRF. When projects are executed

in a different way, the results indicate that FRF falls short in predicting an accurate (summed) forecast for

a group of activities with a similar main FR.

Finally, we can conclude that an average cost forecast accuracy of 65.83% and an average duration forecast

accuracy of 63.64% is not the result we are trying to achieve. The large differences in forecast accuracy

between the different project groups indicate that FRF should not be applied in all situations. In the next

part we will test the Hypothesises made in this dissertation and try to determine which factors have an

important effect on the forecast accuracy of FRF.

39

V.III Regression Analysis

In the following paragraphs, we analyse the hypothesises made in this dissertation in order to find the

answer to our sub-questions and determine the drivers of an accurate forecast using the FRF technique. In

order to do this we used the well-known statistical tool SPSS to perform a regression analysis on the cost

and duration forecasts. The results of the analysis are discussed for every hypothesis below. The output of

the regression analysis can be consulted in the Appendix (A.III).

Hypothesis 1: a forecast based on more observations will be more accurate.

Regarding the first hypothesis, we performed a simple linear regression of the effect of the average number

of observations on which the activity forecasts of a project are based on the cost and duration MAPE.

Looking at the results of the F-test, we see that the average number of observations is a statistical significant

predictor of both cost and duration MAPE (p<0.001, for both cost and duration). Furthermore, the average

number of observations explains a significant part of the variance in cost (𝑅2 = 0.492) and duration MAPE

(𝑅2 = 0.497). The predicted decrease in MAPE for cost and duration is respectively 5.2% and 5.1% per extra

observation. This means that if the average number of observations of the activities in a project are equal

to 10, the cost forecast accuracy is estimated to be 91%. In order to get a cost forecast accuracy above 80%

the average number of observations for the activities must be at least 7.88. For the duration forecast

accuracy the average number of observations must be at least 8.39 to get this forecast accuracy. So we can

conclude that the expected accuracy will be higher when it is based on more observations.

Hypothesis 2: the bigger the difference in size between the similar projects in a project group, the lower

the forecast accuracy will be.

In order to determine this difference for every project, we calculated the average difference between the

project sizes of the projects in a project group using Equation (9):

∆𝑆𝑖𝑧𝑒𝑦 = ∑ ∑|𝑆𝑖𝑧𝑒𝑖,𝑥 − 1|

𝑛 ∗ (𝑛 − 1)

𝑛

𝑥=1

𝑛

𝑖=1

∀ 𝑖 ≠ 𝑥 𝜖 𝑦 (9)

In this formula 𝑦 denotes the project group with size 𝑛 and 𝑖 and 𝑥 are projects that are part of this project

group. 𝑆𝑖𝑧𝑒𝑖,𝑥 is the relative size of project 𝑥 compared to (similar) project 𝑖 and is calculated using Equation

(1). The absolute value of the difference between the size factor and 1 reflects the difference in project size.

Note that every project in a project group gets the same value.

40

When we test the effect of this factor on the MAPE results of every project, we see that this is again a

significant predictor of both the cost and duration MAPE. Moreover, the difference in size between the

projects explains an even bigger part of the variance in cost (𝑅2 = 0.689) and duration MAPE (𝑅2 = 0.644)

than the average number of observations. Looking at the 𝛽-values of this simple linear regression, we see

that the expected duration forecast accuracy decreases from 83% to 27.4% when the difference in project

size increases from 0 to 1. The expected cost forecast accuracy decreases even more dramatically from

86.1% to 27.6%. Again we can statistically confirm our hypothesis based on the data used.

Hypothesis 3: the more differences in the functional requirements of activities between the similar projects

in a project group, the lower the forecast accuracy will be.

The difference in the FRs of the activities of a project and the similar projects in its project group is

calculated by the average number of observations on which the forecast of the activities in a project is

based on divided by the maximum number of observations a forecast can be based on. When this factor is

equal to 1 the FRs of the activities between the different projects of a project group are the same. The more

this factor decreases, the more differences in terms of FRs.

Also this last independent variable is a statistical significant predictor of both the cost and duration MAPE.

In contrast to the last two factors, there is a clear difference in 𝑅2 values between cost (𝑅2 = 0.644) and

duration (𝑅2 = 0.475). This difference is also noticeable in the 𝛽-values, when the difference in FRs increases

and consequently the independent variable in this simple linear regression decreases, it reflects more in

the expected cost forecast accuracy than in the expected duration forecast accuracy. For example when

this factor decreases from 1 to 0.50, the expected cost forecast decreases with 44.35%, while the expected

duration forecast accuracy decreases with (only) 29.9%. Nevertheless, based on this regression analysis, we

can conclude that all three hypothesises can be statistically proven for the data we used in this dissertation.

41

V.IV Sensitivity Analysis size-factor

As already mentioned in chapter IV, coefficient a ∈ [0,1] in Equation (1) indicates the relative importance

of the actual cost in the determination of the relative project sizes. Consequently, (1-a) indicates the relative

importance of the actual duration in the determination of the size-factors. Until now we made the

assumption that the project’s actual cost and duration are equally important factors in the calculation of

the project size-factors (assumption 5). This means that until now we have calculated the size-factors of the

projects with a = 0.5. In the last part of this chapter we perform a sensitivity analysis on this assumption.

An overview of the MAPE results for the different values of a is presented in Appendix A.IV.

Figure 5.2 visualizes the effect of changing the relative importance of the project’s actual cost in the

determination of the size-factors on the total average cost MAPE of the projects. It is clear that when a

increases, the cost MAPE decreases. Furthermore, we can see an almost perfect linear correlation between

the values of a and the average cost MAPE. Looking at the exact values in Table A.3, we see that this effect

is returning in almost every project group. The total average cost forecast accuracy even increases above

70% for a = 1. When we determine the relative project sizes solely based on their actual duration and

therefore set a = 0, we see that the mean total cost MAPE increases to 40.85%.

Figure 5. 2 Sensitivity analysis a: cost MAPE

In contrast to the cost MAPE, Figure 5.3 depicts much smaller differences in the total average duration

MAPE for the different values of a. Furthermore, in Table A.4 we see that when a = 0 and the size-factor is

solely determined by the actual duration ((1-a) = 1), the mean duration MAPE is even a little higher (36.74%)

0.00%

5.00%

10.00%

15.00%

20.00%

25.00%

30.00%

35.00%

40.00%

45.00%

0 0.25 0.33 0.4 0.5 0.6 0.67 0.75 1

Cost MAPE

42

than for its initial value (36.36%). We can conclude that the average duration MAPE is relative insensitive

to changes in coefficient a, except for a clear increase to 39.51% when we set a = 1.

Figure 5. 3 Sensitivity analysis a: duration MAPE

In the last part of this sensitivity analysis, we analyse the effect of changing our methodology and set the

size factors equal to 1. In this way the forecasts are based solely on the actual values of the other activities

with the same FR. Consequently, the activities that do not depend on the project size will be estimated

more accurately.

Looking at the results in Table A.5, we see that the total average cost MAPE increases to 36.03%, which is

still a lot better than the 39.51% for a = 1. Instead, the total average duration MAPE decreases to its lowest

level (35.18%). This decrease is not that big, but it indicates that estimating the duration is not dependent

on the size of the project for all activities.

34.00%

35.00%

36.00%

37.00%

38.00%

39.00%

40.00%

0 0.25 0.33 0.4 0.5 0.6 0.67 0.75 1

Duration MAPE

43

Chapter VI

Conclusion

The goal of this dissertation is to introduce the use of a new technique to estimate the cost and duration of

a project. However, the average forecast accuracy results of the 41 projects used in this research are not

the results we are trying to achieve. Nevertheless, the large differences in forecast accuracy between the

different project groups indicate that FRF has the potential to be provide accurate forecasts, but should not

be applied in all situations.

In order to determine in which situations FRF could be useful, we performed a regression analysis. In this

regression analysis, we tried to find an answer to our research question by testing the hypothesises made

in Chapter III. The results of the regression analysis statistically confirmed the hypothesises made. In other

words, the 3 factors which were tested are statistical significant predictors of both the cost and duration

forecast accuracy. Moreover, this analysis indicated that when the values of these variables change this has

a serious impact on the expected forecast accuracy, which confirmed that FRF should only be applied when

certain conditions are met. These conditions include that the forecasts should be based on sufficient

observations, the differences in project sizes in a project group are low and the FRs of the activities in the

projects of a project group are to a great extent the same.

Furthermore, we performed a sensitivity analysis on the assumption that the project’s actual cost and

duration are equally important factors in the calculation of the project size-factors. Looking at the results

we see that we obtain a lot better predictions for costs when the project size is determined solely by the

actual cost of the projects. Regarding the duration forecasts, we see that the best results are obtained when

we change our methodology and set the project size-factors equal to 1. This indicates that the cost and

duration forecasts should not be calculated by using the same methodology.

When assessing the potential of the proposed technique, we need to acknowledge the limitations of this

research. First of all, FRF is only applied to 41 projects, which are all located in the construction sector. In

order to validate this technique, it should be tested on more projects and for projects which are located in

different industries.

Second, the lack of information in the activity descriptions made it difficult to determine an accurate FR and

base the forecast on the activities with the exact same FR. Instead, in this dissertation more general FRs

were defined and this sometimes resulted in poor forecasts based on activities that are not that comparable

with the activity that needs to be forecasted.

44

The next limitation is the restriction that the duration and cost of the project activities can only be

forecasted based on the actual values of similar projects. Due to a lack of information in the project data,

we needed to make assumptions to determine the relative project sizes. These assumptions made it

possible to determine the relative project sizes of similar projects, but not between the projects of different

project groups. Furthermore, the size-factors are solely determined by the actual cost and actual durations

of the projects, while a lot of other factors play an important role in the project size as well.

Finally, not for every project an absolute forecast error could be calculated, since this requires that every

activity in a project has at least one activity with same FR in a similar project. Furthermore, the reforming

of some projects based on a (limited) activity description, might bias the results of these projects.

Consequently, a lot of future research could still be performed. Not only could this method be applied to

more projects in different sectors and with more information. It would also be interesting to see what the

result of FRF could be on a new project. Until now the technique is only applied to forecast projects that

have already been executed.

The sensitivity analysis of the size-factor has shown that the current size-factor is far from optimal in terms

of forecast accuracy. Moreover, considering using a different methodology to forecast the cost and another

one to forecast the duration, could be the starting point to redesign FRF. The final limitation is that FRF

lacks a method to compare the sizes of projects from different project groups. Therefore, the activities

cannot be based on the values of projects from a different group. Consequently, developing a method to

quantify the project size of projects could be a real future breakthrough for FRF.

45

References

Aljohani, A., Ahiaga-Dagbui, D., & Moore, D. (2017). Construction Projects Cost Overrun: What Does the Literature Tell Us? International Journal of Innovation, Management and Technology, 8(2), 137-143.

Assaf, S. A. & Al-Hejji, S. (2006). Causes of delay in large construction projects. International Journal of Project Management, 24(4), 349–357.

Batselier, J. & Vanhoucke, M. (2015). Construction and evaluation framework for a real-life project database. International Journal of Project Management, 33(3), 697–710.

Batselier, J. & Vanhoucke, M. (2017). Improving project forecast accuracy by integrating earned value management with exponential smoothing and reference class forecasting. International Journal of Project Management, 35(1), 28-43.

Burgan, S. C. & Burgan, D. S. (2014). One size does not fit all: Choosing the right project approach. Paper presented at PMI® Global Congress 2014—North America, Phoenix, AZ. Newtown Square, PA: Project Management Institute.

De Smyter, M. & Vandoorne, W. (2018). Practical application of Reference Class Forecasting, Identifying the drivers of similarity between projects (Master’s dissertation, Ghent University, Ghent, Belgium).

Dong, Q. & Whitney, D. (2001). Designing a requirement driven product development process. Pittsburgh: PA.

Farid, A. M. & Suh, N. P. (2016). Axiomatic Design in Large Systems: Complex Products, Buildings, Manufacturing Systems (1st ed.). Switzerland: Springer.

Flyvbjerg, B., Bruzelius, N., & Rothengatter W. (2003). Megaprojects and Risk: An Anatomy of Ambition. Cambridge: Cambridge University Press.

Flyvbjerg, B. (2006). From Nobel prize to project management: Getting risks right. Project Management Journal, 37(3), 5–15.

Flyvbjerg, B. & Budzier, A. (2011). Why your IT project may be riskier than you think. Harvard Business Review. Retrieved from https://hbr.org/2011/09/why-your-it-project-may-be-riskier-than-you-think

Flyvbjerg, B. (2014). What You Should Know about Megaprojects and Why: An Overview. Project Management Journal, 45(2), 6-19.

Holt, C. (1957). Forecasting Trends and Seasonals by Exponentially Weighted Averages. Carnegie Institute of Technology. Pittsburgh Office of Naval Research memorandum no. 52.

Holt, C. (2004). Forecasting seasonals and trends by exponentially weighted moving averages. International Journal of Forecasting, 20(1), 5–10.

Lipke, W. (2003, March). Schedule is different. The Measurable News, 31–34.

Merrow, E.W., McDonnell, L., & Argüden, R.Y. (1988). Understanding the Outcomes of Megaprojects: A Quantitative Analysis of Very Large Civilian Projects. Santa Monica: The Rand Corporation.

Nakao, M. (2016). Surprising disadvantage of uncoupled design in staying competitive in the global market, Procedia CIRP, 53, 136-141.

Odeh, A. M. & Battaineh, H. T. (2002). Causes of construction delay: traditional contracts. International Journal of Project Management, 20(1), 67-73.

46

Operations Research & Scheduling Research Group (2014). Real Data. Retrieved from http://www.projectmanagement.ugent.be/research/data/realdata

Pasco, T. & Aibinu, A. A. (2008). Project Factors Influencing the Accuracy of Early Stage Estimates. Proceedings from International Conference on Building Education and Research (BEAR), (February 11-15), 102-112.

PMBOK. (2013). A guide to the project management body of knowledge (5th ed). Pennsylvania: Project Management Institute.

PMI. (1969). What is project management? Retrieved from https://www.pmi.org/about/learn-about-pmi/what-is-project-management

Rebaiaia, M. & Viera, D. R. (2013). The concept of DSM and ADT integration in the Product Design Process, The journal of modern project management, 1(1), 6-17.

Steward, D.V. (1981). The design structure system: a method for managing the design of complex systems. IEEE Transactions on Engineering Management, 28(3), 71–74.

Suh, N.P. (1990). The Principles of Design. New York: Oxford University Press.

Vanhoucke, M. (2009). Measuring Time: Improving Project Performance Using Earned Value Management. New York: Springer.

Vanhoucke, M. (2012). Project management with dynamic scheduling: Baseline scheduling, risk analysis and project control(2nd ed.). Berlin: Springer.

Vanhoucke, M. (2013). Project baseline scheduling: an overview of past experiences. The journal of modern project management, 1(2), 18-27.

Vanhoucke, M., Coelho, J., & Batselier, J. (2016). An overview of project data for integrated project management and control. Journal of Modern Project Management, 3(2), 6–21.

WBDG (1997). About The WBDG: A robust gateway to up-to-date information on integrated 'whole building' design techniques and technologies. Retrieved from https://www.wbdg.org/about-wbdg-whole-building-design-guide

Wilks, S. (2015). The century’s most troublesome construction projects. Global Construction Review. Retrieved from http://www.globalconstructionreview.com/perspectives/centurys-most-troublesome-construction-pr8oje8ct8s/

WTCB (1959). Het WTCB. Retrieved from https://www.wtcb.be/homepage/index.cfm?cat=bbri

47

Appendix

A.I List of consulted websites to determine the Functional Requirements

Source 1: BBRI (=WTCB)

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=TVN%20188.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=wtcb_artonline_2010_3_nr9.

pdf

https://www.wtcb.be/homepage/index.cfm?cat=publications&sub=bbri-

contact&pag=Contact30&art=458&lang=nl

https://www.wtcb.be/homepage/index.cfm?cat=publications&sub=bbri-

contact&pag=Contact49&art=735

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=wtcb_artonline_2016_3_nr6.

pdf

https://www.wtcb.be/homepage/index.cfm?cat=publications&sub=bbri-

contact&pag=Contact28&art=425

https://www.wtcb.be/homepage/index.cfm?cat=publications&sub=bbri-

contact&pag=Contact23&art=340&lang=nl

https://www.wtcb.be/homepage/index.cfm?cat=publications&sub=infofiches&pag=20&lang=nl

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=TVN%20208.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=TVN%20227.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=WTCB_Rapport_10.pdf

https://www.wtcb.be/homepage/index.cfm?cat=publications&sub=bbri-

contact&pag=Contact39&art=598

https://www.wtcb.be/homepage/index.cfm?cat=publications&sub=bbri-

contact&pag=Contact43&art=650

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=wtcb_artonline_2013_4_nr1

2.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=TVN%20220.pdf

https://www.wtcb.be/homepage/index.cfm?cat=publications&sub=bbri-

contact&pag=Contact35&art=544

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=Meetstaat%202_3.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=WTCB_Tijdschrift_1990_4.6.

pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=WTCB_Tijdschrift_1994_3_p

17.pdf

48

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=wtcb_artonline_2018_3_nr1

2_scheidingswanden_uit_akoestisch_verbeterde_gipsplaten_en_profielen.pdf

http://www.confederatiebouw.be/portals/38/CDSchrijnwerk/data_tech_doc_schrijnwerk/docs/Houtcons

tructies/Dimensionering%20van%20houtconstructies.%20Deel%202.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=wtcb_artonline_2015_2_nr3

3.pdf

https://www.wtcb.be/homepage/download.cfm?dtype=publ&doc=WTCB_Rapport_19.pdf&lang=nl

https://www.wtcb.be/homepage/index.cfm?cat=publications&sub=bbri-

contact&pag=Contact22&art=332&lang=nl

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=TVN_265.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=wtcb_artonline_2015_2_nr2

5.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=TVN%20188.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=TVN%20209.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=wtcb_artonline_2018_3_nr1

2_scheidingswanden_uit_akoestisch_verbeterde_gipsplaten_en_profielen.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=TVN%20237.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=Meetstaat%202_27_1.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=TVN%20232.pdf

https://www.wtcb.be/homepage/index.cfm?cat=publications&sub=bbri-

contact&pag=Contact40&art=616

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=Meetstaat%202_27_3.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=WTCB_Digest_nr_14.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=TVN%20233.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=TVN%20214.pdf

https://www.wtcb.be/homepage/download.cfm?dtype=publ&doc=WTCB_Rapport_19.pdf&lang=nl

https://www.wtcb.be/homepage/index.cfm?cat=publications&sub=bbri-

contact&pag=Contact4&art=54&lang=nl

https://www.wtcb.be/homepage/index.cfm?cat=publications&sub=bbri-

contact&pag=Contact35&art=548

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=WTCB_Tijdschrift_1993_2_p

47.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=TVN%20144.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=TVN%20129.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=TVN%20247.pdf

https://www.wtcb.be/homepage/index.cfm?cat=publications&sub=infofiches&pag=13&lang=nl

49

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=TVN%20147.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=wtcb_artonline_2006_3_nr1.

pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=wtcb_artonline_2018_1_nr9_ventilatie_van_woningen_hybride_systemen_en_toekomstige_tendensen.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=wtcb_artonline_2018_1_nr5_een_nieuwe_kijk_op_sanitaire_verdeelinstallaties.pdf

https://www.wtcb.be/homepage/index.cfm?cat=publications&sub=infofiches&pag=48&art=2&lang=nl

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=Meetstaat%202_20_21.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=TVN%20251.pdf

https://www.wtcb.be/homepage/index.cfm?cat=publications&sub=bbri-contact&pag=Contact56&art=848

https://www.wtcb.be/homepage/index.cfm?cat=publications&sub=infofiches&pag=69&art=4&lang=nl

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=WTCB_Digest_nr_2.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=TVN%20198.pdf

https://www.wtcb.be/homepage/download.cfm?lang=nl&dtype=publ&doc=wtcb_artonline_2015_2_nr28.pdf

Source 2: WBDG

http://www.wbdg.org/FFC/ARMYCOE/TECHNOTE/technote16.pdf

http://www.wbdg.org/FFC/DOD/UFGS/UFGS%2012%2035%2039.pdf

http://www.wbdg.org/FFC/DOL/OSHA/OSHA3755.pdf

http://www.wbdg.org/guides-specifications/building-envelope-design-guide/below-grade-systems/floor-slabs

Source 3: Google Search

https://www.amsadvocaten.nl/woordenboek/bouwrecht/regiebasis/

https://www.astrimex.be/index/metalen-plafonds

http://betonwerkenguessoum.be/werken/

http://www.expertisebetonenstaal.be/sites/default/files/atoms/files/H%202.6%20%20uitzetvoegen%20v

an%20bruggen_0.pdf

https://www.gidsduurzamegebouwen.brussels/nl/akoestiek-van-een-verplaatsbare-

wand.html?IDC=10164#

http://www.joostdevree.nl/bouwkunde2/jpgb/baksteen_16_technische%20eigenschappen_www_bakste

en_be.pdf

http://www.joostdevree.nl/shtmls/meerwerk.shtml

50

https://www.knauf.be/nl/node/8313

http://www.leendertjanse.nl/plafonds/vaste-plafonds/

https://resiplast.be/waterdichte-rok-op-bruggen/

https://www.techopedia.com/definition/4319/office-automation-oa

https://www.vdbbeton.be/nl/pages/grachtelement.html

https://nl.wikipedia.org/wiki/Schanskorf

https://nl.wikipedia.org/wiki/Boogbrug

https://nl.wikipedia.org/wiki/Paalfundering

https://nl.wikipedia.org/wiki/Pleister_(bouw)

https://www.youtube.com/watch?v=aVO7hVUzfBY

51

A.II Overview of the results

Cost forecast

Project MAPE Absolute FE

Residential House Finishing Works (1) 11.79% 8.98%

Residential House Finishing Works (2) 14.09% 11.09%

Residential House Finishing Works (3) 12.59% 2.19%

Residential House Finishing Works (4) 16.88% 5.07%

Residential House Finishing Works (5) 17.20% 7.76%

Residential House Finishing Works (6) 11.89% 5.74%

Residential House Finishing Works (7) 10.60% 2.75%

Residential House Finishing Works (8) 11.01% 3.96%

Residential House Finishing Works (9) 13.33% 7.84%

Residential House Finishing Works (10) 16.84% 2.02%

Residential House Finishing Works (11) 14.80% 1.42%

Residential House Finishing Works 13.73% 5.35%

Residential House (1) 52.30% 17.26%

Residential House (2) 50.05% 12.22%

Residential House (3) 53.52% 22.11%

Residential House (4) 51.97% 7.42%

Residential House 51.96% 14.75%

Apartment Building Finishing Works (1) 0A 19.43% 2.99%

Apartment Building Finishing Works (1) 1A 14.09% 8.75%

Apartment Building Finishing Works (2) 2A 8.99% 4.25%

Apartment Building Finishing Works (2) 3A 18.20% 22.14%

Apartment Building Finishing Works (3) 0B 24.17% 0.26%

Apartment Building Finishing Works (3) 1B 14.91% 10.33%

Apartment Building Finishing Works (4) 2B 16.38% 10.60%

Apartment Building Finishing Works (4) 3B 12.67% 19.82%

Apartment Building Finishing Works 16.11% 9.89%

Apartment Building Structural Work (1) Aa-Ab 7.24% -

Apartment Building Structural Work (1) Ab-Hb 7.18% -

Apartment Building Structural Work (1) 7.21% -

Apartment Building Structural Work (2) 0A 15.11% 14.04%

Apartment Building Structural Work (2) 1A 17.69% 16.45%

Apartment Building Structural Work (2) 2A 15.94% 16.35%

Apartment Building Structural Work (2) 3A 9.30% 5.86%

Apartment Building Structural Work (3) 0B 22.10% 20.46%

Apartment Building Structural Work (3) 1B 41.91% 36.47%

Apartment Building Structural Work (3) 2B 38.06% 31.00%

Apartment Building Structural Work (3) 3B 29.69% 28.39%

Apartment Building Structural Work (2) & (3) 23.72% 21.13%

Railway Bridge (1) 34.65% -

Railway Bridge (2) 34.08% -

Railway Bridge (3) 54.71% -

Railway Bridge (4) 22.42% -

Railway Bridge (5) 26.81% -

Railway Bridge 34.53% -

52

Apartment Building (1) 66.72% -

Apartment Building (2) 67.34% -

Apartment Building (3) 63.41% 94.98%

Apartment Building (4) 58.61% -

Apartment Building (5) 57.43% 27.37%

Apartment Building (6) 54.64% 66.37%

Apartment Building 61.36% 62.91%

Office Finishing Works (1) 78.32% -

Office Finishing Works (2) 89.71% 41.53%

Office Finishing Works (3) 76.46% 13.11%

Office Finishing Works (4) 37.28% 23.81%

Office Finishing Works (5) 86.32% -

Office Finishing Works 73.62% 26.15%

Social Apartments Ypres (1) 72.15% -

Social Apartments Ypres (2) 47.42% -

Social Apartments Ypres (3) 56.65% -

Social Apartments Ypres 58.74% -

Total AVG 34.17% 17.11% Table A. 1 Cost forecast accuracy

53

Duration forecast

Project MAPE Absolute FE

Residential House Finishing Works (1) 20.90% 8.19%

Residential House Finishing Works (2) 17.09% 11.19%

Residential House Finishing Works (3) 15.28% 10.85%

Residential House Finishing Works (4) 14.49% 2.75%

Residential House Finishing Works (5) 18.03% 8.24%

Residential House Finishing Works (6) 11.24% 6.93%

Residential House Finishing Works (7) 12.62% 4.58%

Residential House Finishing Works (8) 12.04% 4.83%

Residential House Finishing Works (9) 10.35% 8.91%

Residential House Finishing Works (10) 11.54% 0.27%

Residential House Finishing Works (11) 12.86% 3.16%

Residential House Finishing Works 14.22% 6.36%

Residential House (1) 43.69% 11.27%

Residential House (2) 43.61% 9.24%

Residential House (3) 48.75% 39.92%

Residential House (4) 48.88% 12.54%

Residential House 46.23% 18.24%

Apartment Building Finishing Works (1) 0A 16.28% 2.99%

Apartment Building Finishing Works (1) 1A 19.07% 8.75%

Apartment Building Finishing Works (2) 2A 12.38% 4.25%

Apartment Building Finishing Works (2) 3A 27.36% 22.14%

Apartment Building Finishing Works (3) 0B 14.24% 0.26%

Apartment Building Finishing Works (3) 1B 10.44% 10.33%

Apartment Building Finishing Works (4) 2B 10.65% 10.60%

Apartment Building Finishing Works (4) 3B 34.87% 19.82%

Apartment Building Finishing Works 18.16% 9.89%

Apartment Building Structural Work (1) Aa-Ab 27.94% -

Apartment Building Structural Work (1) Ab-Hb 43.66% -

Apartment Building Structural Work (1) 35.80% -

Apartment Building Structural Work (2) 0A 40.39% 53.53%

Apartment Building Structural Work (2) 1A 32.89% 3.45%

Apartment Building Structural Work (2) 2A 16.85% 4.84%

Apartment Building Structural Work (2) 3A 71.82% 41.02%

Apartment Building Structural Work (3) 0B 17.04% 4.02%

Apartment Building Structural Work (3) 1B 13.71% 4.74%

Apartment Building Structural Work (3) 2B 14.12% 1.29%

Apartment Building Structural Work (3) 3B 27.60% 53.75%

Apartment Building Structural Work (2) & (3) 29.30% 20.83%

Railway Bridge (1) 26.01% -

Railway Bridge (2) 41.22% -

Railway Bridge (3) 35.69% -

Railway Bridge (4) 38.82% -

Railway Bridge (5) 48.55% -

Railway Bridge 38.06% -

Apartment Building (1) 46.03% -

Apartment Building (2) 80.35% -

54

Apartment Building (3) 40.79% -

Apartment Building (4) 78.80% -

Apartment Building (5) 57.61% -

Apartment Building (6) 62.73% -

Apartment Building 61.05% -

Office Finishing Works (1) 72.02% -

Office Finishing Works (2) 94.38% -

Office Finishing Works (3) 72.82% -

Office Finishing Works (4) 77.80% -

Office Finishing Works (5) 70.51% -

Office Finishing Works 77.51% -

Social Apartments Ypres (1) 41.67% -

Social Apartments Ypres (2) 38.68% -

Social Apartments Ypres (3) 73.55% -

Social Apartments Ypres 51.30% -

Total AVG 36.36% 12.54% Table A. 2 Duration forecast accuracy

55

A.III Output regression analysis SPSS

Hypothesis 1

Figure A. 1 Effect average number of observations on cost MAPE

Figure A. 2 Effect average number of observations on duration MAPE

56

Hypothesis 2

Figure A. 3 Effect difference in size factor on cost MAPE

Figure A. 4 Effect difference in size factor on duration MAPE

57

Hypothesis 3

Figure A. 5 Effect difference in FRs on cost MAPE

Figure A. 6 Effect difference in FRs on duration MAPE

58

A.IV Sensitivity Analysis size-factor

Cost forecast

Project a=0 a=0.25 a=0.33 a=0.4 a=0.5 a=0.6 a=0.67 a=0.75 a=1

RHFW (1) 16.74% 13.27% 12.75% 12.30% 11.79% 11.45% 11.31% 11.36% 12.56%

RHFW (2) 21.77% 17.29% 15.86% 14.89% 14.09% 13.45% 13.16% 12.83% 13.76%

RHFW (3) 13.96% 13.01% 12.77% 12.68% 12.59% 12.63% 12.66% 12.80% 13.33%

RHFW (4) 17.80% 17.34% 17.19% 17.06% 16.88% 16.69% 16.56% 16.42% 16.04%

RHFW (5) 18.14% 17.66% 17.51% 17.38% 17.20% 17.06% 16.96% 16.87% 16.67%

RHFW (6) 17.29% 14.51% 13.66% 12.92% 11.89% 10.93% 10.27% 9.69% 8.69%

RHFW (7) 13.12% 11.84% 11.44% 11.08% 10.60% 10.14% 9.83% 9.47% 8.34%

RHFW (8) 14.21% 12.61% 12.09% 11.65% 11.01% 10.37% 9.92% 9.58% 8.77%

RHFW (9) 21.48% 17.41% 16.10% 14.96% 13.33% 11.95% 11.09% 10.35% 9.50%

RHFW (10) 16.98% 16.91% 16.89% 16.87% 16.84% 16.82% 16.80% 16.78% 16.71%

RHFW (11) 14.98% 14.81% 14.75% 14.70% 14.80% 14.93% 15.03% 15.13% 15.47%

RHFW 16.95% 15.15% 14.64% 14.23% 13.73% 13.31% 13.05% 12.84% 12.71%

RH (1) 55.16% 53.81% 53.34% 52.91% 52.30% 51.82% 51.53% 51.42% 51.19%

RH (2) 51.59% 50.88% 50.64% 50.40% 50.05% 49.70% 49.46% 49.19% 48.37%

RH (3) 48.71% 51.13% 51.88% 52.50% 53.52% 54.86% 55.58% 56.26% 59.60%

RH (4) 55.35% 53.79% 53.30% 52.80% 51.97% 51.11% 50.50% 49.79% 47.61%

RH 52.70% 52.40% 52.29% 52.16% 51.96% 51.87% 51.77% 51.66% 51.69%

ABFW (1) 0A 26.76% 23.01% 21.81% 20.76% 19.43% 18.25% 17.71% 17.26% 16.28%

ABFW (1) 1A 16.15% 15.06% 14.71% 14.41% 14.09% 13.86% 13.79% 13.76% 13.83%

ABFW (2) 2A 9.04% 9.01% 9.00% 9.00% 8.99% 8.98% 8.97% 8.96% 8.94%

ABFW (2) 3A 34.57% 26.38% 23.76% 21.47% 18.20% 15.51% 13.71% 12.80% 11.73%

ABFW (3) 0B 34.80% 29.48% 27.78% 26.30% 24.17% 22.15% 20.91% 19.50% 16.34%

ABFW (3) 1A 27.60% 20.97% 18.85% 17.12% 14.91% 13.02% 12.00% 11.12% 8.97%

ABFW (4) 2B 28.59% 22.48% 20.53% 18.82% 16.38% 13.94% 12.54% 11.30% 8.71%

ABFW (4) 3B 14.34% 13.06% 12.92% 12.82% 12.67% 12.52% 12.52% 12.57% 12.71%

ABFW 23.98% 19.93% 18.67% 17.59% 16.11% 14.78% 14.02% 13.41% 12.19%

ABSW (1) Aa-Ab

14.18% 9.62% 8.58% 7.81% 7.24% 6.91% 7.05% 7.24% 12.68%

ABSW (1) Ab-Hb

11.91% 8.20% 7.50% 7.36% 7.18% 7.71% 8.11% 9.33% 15.29%

ABSW (1) 13.04% 8.91% 8.04% 7.59% 7.21% 7.31% 7.58% 8.28% 13.99%

ABSW (2) 0A 5.88% 6.17% 8.03% 10.94% 15.11% 19.27% 22.18% 25.52% 35.92%

ABSW (2) 1A 29.43% 23.56% 21.68% 20.03% 17.69% 15.34% 13.69% 11.81% 6.05%

ABSW (2) 2A 27.47% 21.71% 19.86% 18.25% 15.94% 13.63% 12.02% 10.17% 5.83%

ABSW (2) 3A 14.46% 9.96% 9.56% 9.45% 9.30% 9.14% 9.03% 8.90% 10.86%

ABSW (3) 0B 37.92% 30.01% 27.48% 25.26% 22.10% 18.93% 16.72% 14.19% 7.36%

ABSW (3) 1B 72.55% 59.42% 53.82% 48.91% 41.91% 34.90% 30.00% 24.39% 7.52%

ABSW (3) 2B 63.49% 52.87% 48.13% 43.98% 38.06% 32.13% 27.98% 23.24% 8.88%

ABSW (3) 3B 64.39% 47.04% 41.49% 36.63% 29.69% 22.74% 17.88% 12.33% 6.50%

ABSW (2) & (3)

32.25% 25.22% 23.11% 21.48% 19.22% 17.09% 15.66% 14.13% 11.90%

RB (1) 42.73% 37.29% 35.84% 34.83% 34.65% 34.80% 35.16% 35.58% 38.22%

RB (2) 33.84% 33.31% 33.55% 33.77% 34.08% 34.39% 34.60% 34.85% 35.90%

RB (3) 53.97% 54.34% 54.46% 54.56% 54.71% 54.86% 54.96% 55.08% 55.51%

59

RB (4) 23.82% 23.08% 22.86% 22.68% 22.42% 22.15% 21.97% 21.75% 21.09%

RB (5) 30.89% 27.52% 27.11% 26.99% 26.81% 26.64% 26.56% 26.62% 27.78%

RB 37.05% 35.11% 34.76% 34.57% 34.53% 34.57% 34.65% 34.78% 35.70%

AB (1) 82.20% 75.92% 73.27% 70.96% 66.72% 62.29% 58.73% 55.49% 52.07%

AB (2) 69.26% 67.84% 67.29% 67.39% 67.34% 65.91% 64.68% 63.62% 62.37%

AB (3) 67.31% 65.89% 65.14% 64.48% 63.41% 62.04% 60.74% 58.70% 49.26%

AB (4) 66.61% 62.61% 61.33% 60.21% 58.61% 57.01% 56.22% 55.78% 57.19%

AB (5) 56.56% 57.00% 57.13% 57.26% 57.43% 57.60% 57.63% 57.34% 56.41%

AB (6) 73.15% 63.89% 60.93% 58.34% 54.64% 50.94% 49.04% 47.56% 42.95%

AB 69.18% 65.52% 64.18% 63.11% 61.36% 59.30% 57.84% 56.41% 53.37%

OFW (1) 74.59% 73.81% 75.25% 76.52% 78.32% 80.13% 81.40% 82.84% 82.92%

OFW (2) 96.52% 97.15% 97.36% 95.54% 89.71% 82.23% 77.00% 68.27% 52.05%

OFW (3) 78.10% 77.65% 77.50% 77.38% 76.46% 75.49% 74.80% 74.03% 74.88%

OFW (4) 36.25% 36.77% 36.93% 37.08% 37.28% 37.49% 37.63% 37.80% 38.32%

OFW (5) 88.17% 87.75% 87.61% 87.14% 86.32% 85.50% 84.93% 84.28% 80.27%

OFW 74.73% 74.62% 74.93% 74.73% 73.62% 72.17% 71.15% 69.44% 65.69%

SAY (1) 89.02% 82.96% 79.33% 76.34% 72.15% 67.20% 63.06% 57.30% 39.29%

SAY (2) 61.23% 53.67% 51.21% 49.65% 47.42% 45.19% 43.63% 42.38% 42.27%

SAY (3) 69.27% 58.06% 55.93% 55.25% 56.65% 58.19% 58.97% 59.05% 59.98%

SAY 73.17% 64.90% 62.16% 60.41% 58.74% 56.86% 55.22% 52.91% 47.18%

Total AVG 40.85% 37.32% 36.26% 35.40% 34.17% 32.94% 32.10% 31.17% 29.42% Table A. 3 Effect different values of a on the cost forecast accuracy

60

Duration forecast

Project a=0 a=0.25 a=0.33 a=0.4 a=0.5 a=0.6 a=0.67 a=0.75 a=1

RHFW (1) 17.00% 15.99% 17.56% 18.93% 20.90% 22.71% 23.97% 25.41% 29.92%

RHFW (2) 16.47% 14.93% 14.44% 14.53% 17.09% 19.63% 21.29% 23.18% 29.09%

RHFW (3) 13.62% 13.11% 13.29% 14.11% 15.28% 16.44% 17.26% 18.20% 21.12%

RHFW (4) 13.62% 14.05% 14.19% 14.31% 14.49% 14.66% 14.79% 14.93% 15.36%

RHFW (5) 17.62% 17.82% 17.89% 17.94% 18.03% 18.11% 18.16% 18.23% 18.43%

RHFW (6) 14.74% 12.99% 12.43% 11.94% 11.24% 10.54% 10.05% 10.49% 12.83%

RHFW (7) 14.74% 13.68% 13.34% 13.04% 12.62% 12.19% 11.90% 11.56% 10.49%

RHFW (8) 14.74% 13.39% 12.96% 12.58% 12.04% 11.50% 11.13% 10.70% 10.19%

RHFW (9) 14.74% 12.55% 11.85% 11.23% 10.35% 10.83% 11.69% 12.67% 15.74%

RHFW (10) 11.88% 11.71% 11.65% 11.61% 11.54% 11.47% 11.42% 11.36% 11.19%

RHFW (11) 11.88% 12.37% 12.53% 12.67% 12.86% 13.06% 13.19% 13.35% 13.84%

RHFW 14.64% 13.87% 13.83% 13.90% 14.22% 14.65% 14.99% 15.46% 17.11%

RH (1) 44.99% 44.10% 43.97% 43.86% 43.69% 43.69% 43.74% 43.74% 43.69%

RH (2) 44.60% 44.13% 43.96% 43.81% 43.61% 43.40% 43.26% 43.11% 42.62%

RH (3) 41.84% 44.46% 45.78% 47.11% 48.75% 50.77% 52.56% 54.48% 60.49%

RH (4) 52.13% 50.46% 49.93% 49.48% 48.88% 48.35% 48.10% 47.80% 47.00%

RH 45.89% 45.79% 45.91% 46.07% 46.23% 46.55% 46.92% 47.28% 48.45%

ABFW (1) 0A 11.47% 12.76% 13.89% 14.87% 16.28% 17.78% 19.12% 20.80% 26.06%

ABFW (1) 1A 22.12% 20.59% 20.10% 19.68% 19.07% 18.46% 18.03% 17.54% 16.34%

ABFW (2) 2A 12.68% 12.53% 12.48% 12.44% 12.38% 12.32% 12.28% 12.23% 12.08%

ABFW (2) 3A 31.55% 29.66% 28.55% 28.06% 27.36% 27.88% 29.39% 31.12% 38.04%

ABFW (3) 0B 17.86% 15.34% 14.99% 14.68% 14.24% 13.79% 13.97% 14.96% 18.05%

ABFW (3) 1A 10.64% 8.57% 8.36% 9.10% 10.44% 11.92% 12.96% 14.14% 18.71%

ABFW (4) 2B 10.13% 7.93% 8.20% 9.02% 10.65% 12.27% 13.40% 14.83% 19.98%

ABFW (4) 3B 32.49% 33.68% 34.06% 34.39% 34.87% 35.21% 35.38% 35.57% 36.18%

ABFW 18.62% 17.63% 17.58% 17.78% 18.16% 18.70% 19.32% 20.15% 23.18%

ABSW (1) Aa-Ab

25.97% 26.95% 27.27% 27.54% 27.94% 28.33% 28.60% 28.92% 29.90%

ABSW (1) Ab-Hb

33.15% 38.93% 40.78% 42.13% 43.66% 45.19% 45.81% 46.45% 48.44%

ABSW (1) 29.56% 32.94% 34.02% 34.83% 35.80% 36.76% 37.21% 37.68% 39.17%

ABSW (2) 0A 28.51% 34.45% 36.35% 38.01% 40.39% 42.77% 44.43% 46.33% 52.27%

ABSW (2) 1A 33.09% 32.99% 32.96% 32.93% 32.89% 32.85% 32.83% 32.79% 32.70%

ABSW (2) 2A 19.46% 17.81% 17.50% 17.23% 16.85% 16.47% 16.20% 15.89% 14.94%

ABSW (2) 3A 56.86% 64.34% 66.74% 68.83% 71.82% 74.81% 76.91% 79.30% 86.78%

ABSW (3) 0B 23.01% 19.37% 18.56% 17.88% 17.04% 16.83% 16.68% 16.52% 16.00%

ABSW (3) 1B 28.07% 18.65% 16.57% 15.02% 13.71% 13.26% 13.22% 13.67% 20.20%

ABSW (3) 2B 28.07% 19.86% 17.51% 15.96% 14.12% 12.90% 12.38% 12.23% 16.22%

ABSW (3) 3B 43.49% 31.70% 30.92% 28.31% 27.60% 33.09% 37.40% 43.56% 65.91%

ABSW (2) & (3)

31.75% 30.73% 30.83% 30.79% 31.07% 32.11% 32.88% 33.94% 38.41%

RB (1) 39.28% 31.24% 28.83% 27.23% 26.01% 25.70% 25.83% 26.05% 28.56%

RB (2) 37.50% 38.71% 39.51% 40.22% 41.22% 42.22% 42.93% 43.73% 46.24%

RB (3) 34.58% 35.06% 35.26% 35.44% 35.69% 36.16% 36.61% 37.13% 39.14%

RB (4) 39.80% 39.09% 38.88% 38.86% 38.82% 38.78% 38.76% 38.73% 38.64%

RB (5) 50.41% 49.30% 48.84% 48.70% 48.55% 48.39% 48.28% 48.16% 47.44%

61

RB 40.31% 38.68% 38.26% 38.09% 38.06% 38.25% 38.48% 38.76% 40.00%

AB (1) 52.33% 48.03% 47.24% 46.52% 46.03% 44.87% 44.84% 43.90% 46.94%

AB (2) 79.06% 80.43% 80.58% 80.48% 80.35% 80.21% 79.97% 79.26% 74.30%

AB (3) 52.25% 48.75% 46.21% 43.98% 40.79% 37.61% 35.65% 33.56% 36.10%

AB (4) 75.27% 78.37% 78.75% 78.78% 78.80% 78.81% 78.68% 78.70% 77.83%

AB (5) 61.20% 58.34% 57.61% 57.14% 57.61% 58.93% 60.49% 62.26% 67.80%

AB (6) 78.88% 66.47% 65.17% 64.17% 62.73% 61.30% 60.30% 59.15% 52.40%

AB 66.50% 63.40% 62.59% 61.85% 61.05% 60.29% 59.99% 59.47% 59.23%

OFW (1) 64.42% 74.04% 75.51% 74.31% 72.02% 69.74% 68.14% 66.31% 60.69%

OFW (2) 91.77% 93.30% 93.79% 94.21% 94.38% 90.24% 85.26% 79.57% 63.80%

OFW (3) 69.28% 72.37% 72.51% 72.64% 72.82% 73.00% 73.13% 73.27% 72.61%

OFW (4) 75.23% 76.52% 76.93% 77.29% 77.80% 78.32% 78.68% 79.09% 79.42%

OFW (5) 70.92% 70.71% 70.65% 70.59% 70.51% 70.42% 71.13% 72.16% 75.17%

OFW 74.33% 77.39% 77.88% 77.81% 77.51% 76.34% 75.27% 74.08% 70.34%

SAY (1) 43.56% 41.18% 41.03% 41.77% 41.67% 41.06% 41.51% 42.38% 54.88%

SAY (2) 35.15% 35.52% 36.53% 37.41% 38.68% 40.26% 41.41% 42.97% 50.73%

SAY (3) 46.60% 58.50% 64.21% 67.71% 73.55% 79.96% 82.84% 84.83% 91.06%

SAY 41.77% 45.07% 47.25% 48.97% 51.30% 53.76% 55.25% 56.73% 65.56%

Total AVG 36.74% 36.11% 36.15% 36.17% 36.36% 36.72% 37.04% 37.45% 39.51% Table A. 4 Effect different values of a on duration forecast accuracy

62

Size factor = 1

Project MAPE Cost MAPE dur

RHFW (1) 13.40% 16.04%

RHFW (2) 14.94% 14.38%

RHFW (3) 12.94% 13.20%

RHFW (4) 19.32% 13.20%

RHFW (5) 19.86% 17.20%

RHFW (6) 10.45% 10.00%

RHFW (7) 8.32% 10.00%

RHFW (8) 9.31% 10.00%

RHFW (9) 12.97% 10.00%

RHFW (10) 17.06% 11.04%

RHFW (11) 15.24% 11.04%

RHFW 13.98% 12.37%

RH (1) 62.90% 53.15%

RH (2) 53.12% 46.84%

RH (3) 49.34% 42.36%

RH (4) 53.34% 49.59%

RH 54.68% 47.99%

ABFW (1) 0A 29.79% 8.73%

ABFW (1) 1A 15.25% 13.25%

ABFW (2) 2A 14.19% 8.27%

ABFW (2) 3A 16.01% 27.53%

ABFW (3) 0B 24.85% 12.16%

ABFW (3) 1A 20.03% 7.47%

ABFW (4) 2B 22.44% 6.97%

ABFW (4) 3B 22.87% 36.84%

ABFW 20.68% 15.15%

ABSW (1) Aa-Ab 7.24% 27.94%

ABSW (1) Ab-Hb 7.18% 43.66%

ABSW (1) 7.21% 35.80%

ABSW (2) 0A 45.97% 61.66%

ABSW (2) 1A 13.34% 35.84%

ABSW (2) 2A 6.01% 13.57%

ABSW (2) 3A 33.92% 41.63%

ABSW (3) 0B 25.70% 22.05%

ABSW (3) 1B 40.77% 16.33%

ABSW (3) 2B 32.71% 16.33%

ABSW (3) 3B 18.37% 68.21%

ABSW (2) & (3) 21.67% 34.82%

RB (1) 34.80% 23.93%

RB (2) 33.76% 35.88%

RB (3) 54.14% 33.15%

RB (4) 22.06% 38.11%

RB (5) 24.88% 47.76%

RB 33.93% 35.76%

AB (1) 94.35% 67.08%

AB (2) 58.27% 53.32%

AB (3) 65.15% 37.38%

63

AB (4) 58.59% 72.80%

AB (5) 50.60% 56.81%

AB (6) 45.98% 57.69%

AB 62.16% 57.51%

OFW (1) 68.04% 60.06%

OFW (2) 93.92% 84.55%

OFW (3) 74.73% 70.63%

OFW (4) 49.05% 75.18%

OFW (5) 85.84% 75.14%

OFW 74.31% 73.11%

SAY (1) 95.52% 57.52%

SAY (2) 57.37% 38.81%

SAY (3) 66.40% 46.49%

SAY 73.10% 47.61%

Total AVG 36.03% 35.18%

Table A. 5 Forecast results with size factor = 1