Handbook for Economic analysis of on-farm trials
Transcript of Handbook for Economic analysis of on-farm trials
1 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
Handbook for Economic Analysis of on-farm Trials
By: Leykun Birhanu
15.1 Introduction
Evaluation of on-farm trials is done to determine the impact of the technology/intervention. It
may be ex-ante, on-going as well as ex-post. Traditionally experimental results are assessed
using statistical techniques only. Over the years it has been demonstrated that the criteria used
by farmers to evaluate and adopt technologies may be totally different to that of researchers.
Very often socio-economic considerations play a major role in accepting or rejecting a
technology. Assessment of trials is, therefore, one of the important stages of an on-farm
research programme. The main elements of such an assessment are farmer assessment,
agronomic evaluation, statistical analysis and economic analysis.
In this module various socio-economic criteria and simple techniques used to assess economic
performance of a technology are discussed. The economic analysis helps researchers:
to look at the results from the farmers’ view point;
to decide which treatments merit further investigation, and
to decide on the recommendations to make to farmers.
On-farm data upon which the recommendations are based must be relevant to the farmers’ own
agro-ecological conditions, and the evaluation of those data must be consistent with the
farmers’ goals and socio-economic circumstances.
15.2 The need for socio-economic evaluation
Traditionally, agronomic trials are evaluated by biological scientists using statistical techniques
and the dominant evaluation criteria used is yield per unit area. The primary objective here is
the maximum exploitation of the biological potential and the test used often is statistical
significance. Normally the experiments/treatments are tested at 0.01, 0.05, 0.10 percent level.
If they do not pass this test they are not considered any further. This approach has many
limitations in deriving recommendations in a systems context:
(a) Evaluation criteria that a farmer may use are varied, location specific and depend
greatly on the degree of market orientation. The appropriateness of any technology
should always be evaluated in relation to their priority objectives and resource use
pattern. The relevant criteria for the target group should be identified and used in the
design and interpretation of the experiment. A number of physical, biological and
socio-economic variables influence the farmers' choice of a technology. Very often the
socio-economic factors such as lack of marketing, shortage of labour, clash with food
priority etc., determine these choices.
(b) Agronomic data only establishes the technical relationships that can be used to
determine the technical optimum. It should be complemented with market information
in order to establish the economic optimum. The 'economic optimum' for any input is
always lower than the 'technical optimum'. If the treatment means are not significantly
different but an economic analysis shows that one treatment is a better recommendation
than the others then we need to have a more careful analysis. Examples of situations
2 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
where farmers choose technologies even without significant differences in yield may
be:
varietal means may not be different but one could observe differences in
palatability (preference), prices, storability, early maturing etc;
technology may not increase the yield/profit, but may reduce the labour
requirement at the critical period;
A new technology may provide possibility of introducing a second crop i.e.
increasing the total production of the systems;
The intervention may reduce malnutrition in the target group.
It should be remembered that these variable attributes are also valid even in situations where
there is significant difference in yield between treatments. It is important to remember that a
farmer is managing a system and he/she is interested in improving the total production of the
system without creating serious contradictions to his/her priority objectives and resource use
patterns.
c) Farm level decisions are made and actions are taken in an attempt to reach goals in a
world of uncertainty and scarcity of resources. These two elements are therefore crucial
in assessing the impact of any technology. Thus it is necessary for the biological
scientist to conduct economic analysis in a similar manner, as they are responsible for
the statistical analysis of their trials. The usefulness of the result of many bio-physical
research experiments can be greatly enhanced if relevant economic analysis can be
applied to the results. In this regard, therefore it makes sense for biological scientists
and agricultural economists to jointly evaluate experiments to establish both biological
and economic viability.
The majority of economic analysis with reference to on-farm trial work is in three categories:
1. Average Returns Analysis. This analysis consists of a listing of the average costs of
producing a particular product and the average value of the product for each technology
being compared. The cost-and-returns analysis requires information on both variable
and fixed inputs. A more limited average variable cost-and-returns analysis is often
used to compare different technologies that used the same fixed inputs. This
information can be used to compare the average returns above variable costs (RAVC)
(i.e., sometimes called gross margin analysis) for different technologies and the returns
to other production factors such as total labour or labour for a single operation e.g.
weeding. The process of valuing inputs and commodities is of particular importance in
making realistic cost-and-return analyses.
The average returns (gross margin) analysis allows a comparison between various
technologies being tested based on the inputs the farmer must provide. The procedure is as
follows:
Calculate an average yield or an average amount of product for each separate
technology.
Calculate average inputs -- often with particular emphasis on labour inputs -- for
each technology separately.
Calculate the gross return (i.e., gross total value product), which is the adjusted
yield times the appropriate field price for the product, or products, if there are
more than one.
Calculate the variable costs associated with each technology. The variable costs
for a crop trial usually include labour, seed, draught hire (i.e., if hired draught is
used), and a charge for equipment depreciation.
The average return above variable cost (RAVC) -- also called gross margin -- is
then calculated by subtracting the variable costs from the gross total value product.
3 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
These average net returns can then be compared between technologies. According
to Norman, et. al. (1994) some scientists believe that the return for a new
technology must be at least 30 percent higher than that for the traditional
technology before farmers will be willing to consider adopting the new
technology.
This analysis is generally on a per hectare basis, and the return calculated is a return to
management, assuming that land is fixed and that labour has been valued at the price of its best
alternative use (i.e., opportunity cost). In order to maximise profits, it is necessary to maximise
returns to the most limiting resource. For example, the most limiting resource may labour for
weeding. When the most limiting resource is known, it is possible to calculate an average net
return to that resource for the different technologies being compared and choose the most
favourable technology.
Measures of return are calculated as follows:
(a) Return above variable cost (RAV) i.e. Gross Margin (GM)
= Gross Return - Total Variable Costs
(GR) (TVC
(b) Returns to Factor A.
The general equation for the rate of return to Factor A is:
Rate of Return to A
= GR - all costs other than Costs of A
Costs of A
Therefore:
(i) Return to TVC = GR
TVC
(ii) Return to labour and power Cost = GR - Material Cost
Labour and power cost
(iii) Return to material Cost = GR - Labour and power cost
Material Cost
2. Budget Analysis. There are several types of budget analysis. The enterprise budget is
statement of costs-and-returns (i.e., both variable and fixed) for a particular enterprise
or technology. This type of budget can be used as a building block in making whole
farm budgets. The partial budget, on the other hand, is a direct comparison of the
elements within enterprise budgets that change between technologies. This type of
budget requires fewer data than the enterprise budget and offers the advantage of direct
comparison. Finally, whole farm budgets can be used to look at allocation of resources
between enterprises and at the impact of a new technology on the allocation of
resources to other enterprises on a farm. The partial budget technique is used most
frequently in FSR.
3. Risk Analysis. When a farmer undertakes a crop or livestock enterprise she/he always
faces the risk of failure and loss of their time, cash or other inputs invested in the
enterprise. When farmers consider a new technology, they are concerned about the risk
4 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
involved in the new technology compared to the risk of their present technology.
Measuring risk is difficult and is of somewhat limited value because different farmers
look at risk differently. Risk analysis needs to be kept as simple as possible. Some
indications of risk can be obtained from doing sensitivity analysis with partial budgets.
5 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
15.3 The partial budget
The first step in doing an economic analysis of on-farm experiments is to calculate the costs
that vary for each treatment. In developing a partial budget all outputs and inputs are measured
in currency units, as a common denominator. This is necessary because otherwise it would be
impossible, for example, to add hours of labour to litres of herbicide and compare these with
kilograms of grain. The use of currency units does not, however, necessarily imply that farmers
spend money on inputs or receive money for the outputs. Neither does it imply that farmers are
concerned only with money. It is simply a device to represent the process that farmers go
through when comparing the value of the things gained and the value of the things given up.
In a partial budget not all costs (e.g. family labour) necessarily represent the exchange of cash.
An important concept used in the calculation of such cost items is that of opportunity cost. This
cost is defined as the value of any resource in its best alternative use. In partial budgeting one
has to be concerned with the differences in costs and benefits between experimental treatments.
Preparation of a good partial budget requires:
1. A detailed understanding of farmers objectives, practices, resource use pattern,
constraints etc.
2. Some understanding of the fundamental concepts and principles of economic theory
e.g. profitability, risk, opportunity cost, scarcity of resources, marginal concepts etc.
3. Good judgement and common sense. Educated guesses are always better than ignoring
a cost or a benefit. It should be remembered that:
a. all source of benefits and costs to farmers are included in the analysis.
b. the realism of the costs and yield assumptions are as important as the type of
analysis chosen.
c. a partial budget does not give the net effect of a technology/production process. It
only gives the change in NET BENEFITS. It does not show the profitability of the
enterprise or the farm. In order to get this one has to do an enterprise/whole farm
budget.
In order to construct a Partial Budget one should calculate:
A. benefits of different treatments
B. costs that vary across treatments
A. Estimation of benefits
1. Identify the sources of benefits
(a) Direct Benefits - main products
- by products
(b) Indirect benefits - often difficult to identify and quantify if the
systems interaction is not known.
2. Quantify the benefits derived from the technology or treatment
(a) Estimate the yield
(b) Estimate the yield adjustment coefficient
(c) Calculate the adjusted yield
(d) Determine the field price of the product (and by-products).
3. Calculate the Gross Field Benefit (GFB)
GFB = Adjusted Yield X Field Price
B. Estimation of Costs
6 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
Here the total costs that vary across treatments are estimated:
1. Identify and list the input items that vary across treatments.
2. Quantify the level of input in each treatment.
3. Estimate the unit value of the input. Once again we use the field price for input.
4. Estimate the Field Costs of the inputs
Field Cost = Field Price X Quantity of the Input
5. Calculate the total costs that vary for each treatment.
C. Calculation of NET BENEFIT (NB)
NET BENEFIT = Gross Field Benefit = Total Cost(s) that vary across treatments.
Definitions
The adjusted yield for a treatment is the average yield adjusted downward by a certain
percentage to reflect the difference between the experimental yield and the yield
farmers could expect from the same treatment.
The field price (of an input) - is the value which must be given up to bring an extra unit
of input into the field.
The field price of an output is the value of one unit of output to the farmer, less harvest
costs that are proportional to yield.
Costs that vary are the costs (per hectare) of purchased inputs, labour, and machinery
that vary between experimental treatments.
Field cost is the field price multiplied by the quantity of the input needed for a given
area.
The total costs that vary is the sum of all the costs that vary for a particular treatment.
Yield estimation
Farmers often do not receive the same yield as researchers even when they apply the same
treatment. Yields obtained by researchers are generally high due to various reasons:
1. The management standard of the experimentation is very high.
Small plots - easier to manage and the quality of work is good.
Adlib resource input - often researchers have less resource restrictions than the
farmers.
Timely operation - e.g. planting, plant spacing, fertiliser application, weed control,
pest and disease control and harvesting.
High level of non-experimental variables. These are strictly controlled.
Control of experimental errors.
On a management scale the (experimental station) researchers are likely to be at the top end but
in a farming population both yield and management level are more likely to be normally
distributed. The recommendations generated should address the major proportion of the
farmers and not the good managers. Depending on the location of the trials and who manages
the trial one could observe 3 major differences.
a) Differences in natural factors - soil fertility, pest and disease incidence etc.
b) Differences in management factors - this in fact is a random variable in
farm level situation.
c) Differences in resource base - small farmers have much less resources than
the researchers.
Therefore there is a need to adjust the yields obtained by the farmers.
7 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
2. Use of Different Techniques
Researchers often use different harvesting and drying techniques which minimises
the field loses.
3. Storage losses
Some of the local varieties store better than the improve varieties. If farmers store
improved varieties for late sale or house hold consumption then they incur heavy
storage losses. Therefore the effective production for the farmer is less than the actual
harvest.
4. Abandoning of treatments
Very often researchers abandon some sites or some treatments due to drought, floods,
insect attack etc. This may inflate the yield of the experiment, but the farmers will have
to face these situations. Therefore it is important to include them in analysing the
experiments.
Example of a partial budget:
Table 15.1 shows a partial budget for a weed control trial. There are two columns, representing
two treatments (hand weeding and herbicide). The first line of the budget presents the average
yield from all locations in the recommendation domain for each of the two treatments. The
second line is the adjusted yield and the third one shows the gross field benefits. The last two
lines of the table represent the total costs that vary and the net benefits.
Table 15.1 Example of a partial budget
Hand weeding Herbicide
Average yield (kg/ha) 2,000 2,400
Adjusted yield (kg/ha) 1,800 2,160
Gross field benefits (Tsh/ha) 153,000 183,600
Cost of herbicide (Tsh/ha) 0 5,600
Cost of labour to apply herbicide (Tsh/ha) 0 2,000
Cost of labour for hand weeding (Tsh/ha) 25,000 0
Total costs that vary (Tsh/ha) 25,000 7,600
Net benefits (Tsh/ha) 128,000 176,000
8 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
15.4 Marginal analysis
15.4.1 Introduction
In the previous section a partial budget was developed to calculate the total costs that vary and
the net benefits for each treatment of an experiment. In this section a method for comparing the
costs that vary with the net benefits is described. This comparison is important to farmers
because they are interested in seeing the increase in costs required to obtain a given increase in
net benefits. Calculation of net benefits for each treatment is only an intermediate step in the
economic analysis of on-farm data. The treatment with the highest net benefit does not always
make the best recommendation. The net benefit calculations also do not explicitly treat some
crucial aspects of small farmers’ conditions, namely scarcity of resources and risk. In order to
include these two critical aspects which are crucial in decision-making one has to perform a
‘marginal analysis’. This marginal analysis can be made more efficient by an intermediate step
known as Dominance Analysis. This intermediate step enables one to discard the clearly
unprofitable treatments.
15.4.2 Dominance analysis
Dominance analysis in fact divides the treatment set into 2 categories, namely “dominated” and
“un-dominated” treatments. A dominated treatment has net benefits that are less than or equal
to those of a treatment with lower costs that vary. Dominated treatments need not be considered
further in the analysis. One could perform dominance analysis using one of the two
approaches.
A. Net Benefit Curve
B. Tabular Method
A. Net Benefit Curve
A net benefit curve could be drawn for any factor
A net benefit curve shows the relationship between the level of input and the
corresponding net benefit from the alternatives.
To construct a net benefit curve each treatment is plotted on a graph, the vertical axis
representing the net benefits and the horizontal axis representing the cash outlay/labour
input.
Beginning with the point that corresponds to the least expensive treatment. Aa line is
drawn to a point that represents the next most expensive treatment - but only an upward
slopping line is allowed. The un-dominated treatments will be on the net benefit curve
but dominated treatments will be below the net benefit curve. In other words, the
treatments or choices which are not dominated when connected together form the ‘NET
BENEFIT CURVE’. The alternatives or treatments which are falling below the Net
Benefit Curve are known as dominated alternatives; because for each of these there is
another alternative with a higher net benefit and lower variable cost. Under normal
circumstances a farmer will never choose one of these dominated alternatives.
The dominated alternatives are eliminated from further analysis and un-dominated
alternatives are used to compute Marginal Rates of Returns (MRR).
9 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
C. Tabular method
List all the alternative treatments from highest to the lowest net benefit i.e. rank the net
benefits.
Starting from the top identify and eliminate dominated treatments i.e. eliminate any
treatment which has a TCV equal to or higher than the treatments above.
Use the un-dominated (dominating) treatments for Marginal Analysis.
In computing MRR always start from the bottom of the table.
Example:
Based on an N by Density experiments, all from one recommendation domain, the following
data were obtained. Perform a dominance analysis using both methods, i.e. Net Benefit Curve
and Tabular Method.
Table 15.2 Data from the NXD experiment
Treatment Net Benefit Total costs that vary
Tshs/ha Tshs/ha
NoDo 36700 6700
NoD1 49630 8300
N0D2 58700 9900
N1D0 39840 13730
N1D1 48770 15330
N1D2 47170 16930
N2D0 31740 20740
N2D1 47580 22340
N2D2 40750 24440
a) Dominance analysis using tabular method
Step 1: Rank Net Benefits
Treatment NB Tshs/ha TCV Tshs/ha
N0D2 58700 9900
N0D1 49630 8300
N1D1 48770 15330
N2D1 47580 22340
N1D2 47170 16930
N2D2 40750 24440
N1D0 39840 13730
N0D0 36700 6700
N2D0 31740 20740
Step 2: Identify and eliminate treatments – i.e. TCV equal to or higher than the previous
dominating treatment
Treatment NB Tshs/ha TCV Tshs/ha
N0D2 58700 9900
N0D1 49630 8300
N0D0 36700 6700
The dominating treatments are N0D2, NoD1 and No Do
b) Dominance Analysis – Using Net Benefit Curve
10 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
In a net benefit curve the vertical axis represents the net benefit of various treatments and the
horizontal axis represents the corresponding total costs that vary or cash outlay for the
corresponding treatment. First plot all points in the space. Remember the rule, start from the
least cost treatment and only positive steps are accepted. The least cost treatment is N0D0, the
next expensive treatment is N0D1, the slope is positive so connect N0D0 to N0D1. The next
expensive treatment is N0D2 and N1D0, the slope is positive, so connect N0D1 to N0D2. The next
expensive treatment is N1D0 but when we connect N0D2 and N1D0, the slope will be negative.
This is the same for all other treatments in relation to N0D2. When you connect N0D0, N0D1 and
NOD2 you will get the Net Benefit Curve. All three treatments, which lie on the Net Benefit
Curve, are dominating treatments. This is the same result we obtained with the Tabular Method.
These treatments which lie below the NB curve are dominated treatments.
NB
(Tshs)/ha
60,000
*
50,000
* *
*
40,000 * *
*
*
30,000
20,000
10,000
0 5,000 10,000 15,000 20,000 25,000 (Tshs)/ha
Costs that vary across Treatments
Figure 15.1 Net Benefit Curve
Convex and non-convex Net Benefit Curves
In a convex curve the MRR will continuously decline as we move along the response surface or
the net benefit curve. Here the decision making process is less complicated. But if the net
benefit curve is not convex as shown in the Figure 15.2 then extra care is required for
interpretation. If, as one moves along the curve in the direction of increasing net benefits, the
MRR falls below the minimum rate of return, but a subsequent MRR is above the minimum
rate, then an extra step must be taken.
11 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
Figure 15.2 Convex net benefit curves
120
* 80N
83%
* 40
200%
0N
CASH OUTLAY
15.4.3 Marginal Rate of Return (MRR)
The purpose of marginal analysis is to reveal how the net benefits from an investment increase
as the amount invested increases. MRR is defined as the change in net benefits (marginal net
benefit) divided by the change in costs that vary (marginal cost), expressed as a percentage. The
marginal rate of return indicates what farmers can expect to gain, on average, in return for their
investment when they decide to change from one practice (or set of practices) to another.
Minimum (Acceptable) Rate of Return
In order to make farmer recommendations from marginal analysis, it is necessary to estimate
the minimum rate of return acceptable to farmers in the recommendation domain. If farmers are
asked to make an additional investment in their farming operations, they are going to consider
the cost of the money invested. The cost of working capital is the benefit given up by the farmer
by tying up the working capital in the enterprise for a period of time.
Note: (1) The working capital is the value of inputs (purchased or owned) allocated
to an enterprise with the expectation of a return at a later point in time.
(2) The cost of capital may be a direct cost or it may be an opportunity cost,
the earnings of which are given up by not putting money, or an input already
owned, to its best alternative use.
Apart from the need to know the cost of capital, it is necessary to estimate the level of
additional returns (above the cost of capital) that will satisfy farmers that their investment is
worthwhile. In estimating a minimum acceptable rate of return, something must, therefore, be
added to the cost of capital to repay the farmers for the time and effort spent in learning to
manage a new technology. In most cases it will not, however, be possible to provide an exact
figure, but the figure will rarely be expected to be below 50%, even for technologies that
represent only simple adjustments in farmer practice, and is often around 100%, especially
when the proposed practice is new to farmers. If the cropping cycle is longer than four to five
months, these minimum rates will be correspondingly higher. Where farmers have access to
credit, either through informal or formal capital markets, it is possible to estimate a cost of
capital (or an opportunity cost of capital) and use it to estimate a minimum rate of return. But
12 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
even in such cases, it must be remembered that the figure will be approximate. In summary, if
the estimated MRR for cash is less than the Minimum Acceptable Rate for Return (MARR)
then reject the technology.
This minimum rate of return should cover:
Direct cost of cash;
Risk premium, and;
Provide some incentive (management) for the producer/farmer.
The maximum economic limit on input use is more meaningful to a farmer with abundant
capital or credit. At this level the farmer makes more net income even though the efficiency
with which (s) he is using his/her capital and inputs is less than the maximum possible.
To be acceptable, a new technology needs to be:
At a cost which the target group of farmers can handle
Competitive with the present options that the farmers have for spending their cash
Low risk of losing the cash investment
Using Marginal Analysis to make recommendations
The procedure involves comparing the marginal rates of return (MRR) between treatments with
the minimum rate of return acceptable to farmers. It should be noted that this type of analysis is
useful both for making recommendation to farmers, where there is sufficient experimental
evidence, and for helping select treatments for further experimentation. Farmers should be
willing to change from one treatment to another if the MRR of that change is greater than the
minimum rate of return.
Example:
Table 15.3 shows the marginal analysis for the results of a nitrogen experiment in maize in a
certain recommendation domain. The minimum acceptable rate of return to farmers is 100%.
Table 15.3 Marginal analysis, nitrogen experiment
Treatment Total costs that vary (‘000
Tshs/ha)
Net benefits
(‘000 Tshs/ha)
MRR
1. 0 kg N/ha 0 400
2. 40 kg N/ha 30 486 287%
3. 80 kg N/ha 60 526 133%
4. 120 kg N/ha 85 535 36%
5. 160 kg N/ha 110 528 D a -
a Treatment 5 is dominated.
In the given experiment, the MRR of change from 0 kg N/ha to 40 kg N/ha is 287%, which is
well above the 100% minimum rate of return. The MRR from 40 kg N/ha to 80 kg N/ha is
133%, also above 100%. But the MRR between 80 kg N/ha and 120 kg N/ha is only 36%. The
conclusion is that, of the treatments in the experiment, 80 kg/ha would be the best
recommendation for farmers. Important things to note from this conclusion are:
1. The recommendation is not (necessarily) based on the highest MRR. Although the MRR for
farmers investing in 40 kg N/ha is very high, if farmers stopped there, they would miss the
opportunity for further earnings, at an attractive rate of return, by investing in an additional
40 kg N/ha. Farmers will continue to invest as long as the returns to each extra unit invested
(measured by MRR) are higher than the cost of the extra unit invested (measured by the
minimum acceptable rate of return).
13 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
2. The recommendation is not (necessarily) the treatment with the highest net benefits (in this
case 120 kg N/ha). If instead of a step-by-step marginal analysis, an average analysis is
carried out, the rate of return looks attractive (i.e. (535-400)/(85-0) = 159%), but this is
misleading because the average rate of return of 159% hides the fact that most of the
benefits were already earned from lower levels of investment.
In conclusion, therefore, it should be noted that the recommendation is not necessarily the
treatment with the highest MRR compared to that of next lowest cost, nor the treatment with
the highest net benefit. The identification of a recommendation requires careful marginal
analysis using an appropriate minimum rate of return.
14 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
15.5 Dealing with risk in on-farm research
15.5.1 Need for risk analysis
Whenever a specific action may give different outcomes when repeated at a different time,
there is said to be risk attached to that action. In other words where the outcome of an action
cannot be predicted with complete certainty, there is risk. Farming is a particularly risky
activity. For example, climate, diseases and prices are all unpredictable and affect the outcome
of any farming activity. When farmers evaluate one action (practice) against another they will
take account of the outcome variability (risk) attached to each action.
Risk is present when the outcome of the intervention (result) is not known with certainty. For
example, experimental results indicate a range (distribution) of yield obtained from various
sites (locations) at different time periods (year to year variation). Not all farmers obtain the
same yield in all sites at all times. There is not one yield level (single value) to realise but
rather a range of yields, but we do not know for sure which will be realised at the farmer level
of output. The marginal analysis discussed in the previous section uses an average of those
yields to calculate the Net Benefits.
From experience we know that some treatments lead to larger yields on average but are highly
variable (more risky and less stable). Other treatments may result in lower yields on average
but with smaller range of variation (less risky or more stable). If farmers do not care about risk
(risk neutral) then variability in yields does not matter. However, small holder farmers
generally care about stability and level of returns. They are risk averse and they prefer less risk
as well as higher returns. Therefore, in the minds of the farmers, a treatment that combines
both desirable properties (less risky or stable as well as higher returns) dominates. Most of the
times there is a trade off between higher returns and risk. The choice then depends on the
degree of risk aversion of the farmers. The basic questions are:
How much risk can a farmer accept in exchange for larger benefits on average?
Or
How much gain in average benefits is he/she is willing to give up for more stable or assured
returns?
It is difficult to measure (remember that there are techniques) the degree of risk aversion or
farmers' attitude towards the risk, but we need to provide for variability (risk) in our analysis as
risk matters to the farmers.
15.5.2 Risk decision theory
There are two major elements to decision theory under risk. The first deals with the
PROBABILITIES of outcome from a specific action. That is the extent of outcome variability.
This is a function of a particular technology in a given environment. The other element deals
with farmer response to variability of outcomes, often referred to as risk aversion. This is a
personal characteristic of the farmer, or group of farmers and has to do with RISK
PREFERENCES and CERTAINTY EQUIVALENTS.
A. Subjective probabilities
For any action that gives variable outcomes, it will be possible for farmers to attach
probabilities of obtaining different outcomes. For example a farmer’s current technology set
for growing maize (A) may give Tsh. 100,000 net value of output per hectare 50% of the time
15 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
and Tshs. 200,000 the other 50% of the time. In this case we can say that the farmers expected
outcome would be:
Tshs (100,000 x .5) + (200,000 x .5) = 150,000
more generally we can say that:
E = (a1 .p1 ) + a2 .p2)
Where: E = the expected outcome
a1 = outcome possibility 1
p1 = probability of achieving outcome possibility 1
a2 = outcome possibility 2
p2 = probability of achieving outcome possibility 2
Farmers will base decisions about practices on their own estimates of expected outcome.
Farmers’ own estimates of expected outcome are based on their own experience of the
variability of outcomes and this is termed SUBJECTIVE PROBABILITY. A farmer’s
subjective probability estimates may differ from his neighbour’s and may differ from the actual
or objective probabilities of any action. This gives rise to the possibilities of improving farmer
decision making by providing information on risky outcomes that allows farmer subjective
probabilities to more nearly equate with the actual or objective probabilities of outcomes of a
particular action.
B. Risk preferences
Suppose we introduced an alternative set of practices (B) for growing maize which gave higher
outcomes (Tshs 400,00) 50% of times, but gave a loss (Tshs 100,000) the other 50% of times.
We can calculate the expected outcomes of alternatives (A) and (B) as in the table below.
Possibilities (States) Probabilities Alternative
(A)
Practices
(B)
1
.5
200,000
400,000
2 .5 100,000 -100,000
Expected outcome
150,000
150,000
Expected outcomes are the same for each alternative practice. But it is clear that they are not
equally attractive. Whether (A) or (B) is more attractive depends on the RISK AVERSITY of
the individual decision taker. Only if the individual is risk neutral would he be indifferent to
choosing between (A) or (B). If he were risk averse he would select (A). If he were a risk taker
he would choose (B).
C. Certainty equivalents
To establish whether an individual is risk averse or risk neutral we ask “what is the certain
income which would make you indifferent between a risky outcome and the current income?”.
For example in relation to practices (A), we could ask what certain income would you just
accept rather than take the risk involved with (A)?. If the answer is less than Tshs 150,000,
then the individual is risk averse, since he thinks he will get less than the expected income on
the risky gamble. If the answer is more then Tshs 150,000, this means that the individual hopes
to get more than the expected income with the risky gamble and he is a risk taker. In effect we
see that risk averse individuals discount expected outcomes, while risk takers inflate expected
incomes.
16 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
D. Farmers’ decision criteria under risk
It can be safely assumed that resource poor farmers are risk averse. On this assumption,
decision theory tells us that farmers base risky decisions on two elements:
1. Subjective probability judgements on outcomes of actions, providing estimates of
expected outcome.
2. Discount levels applied to expected outcomes to equate with certainty equivalents.
To estimate expected outcomes we need probability distribution information, subjective
preferably or objective otherwise. Estimation of risk aversity discounts is more difficult.
However, in choosing between two alternatives it is the relative discounts that will be important
and we can make some statements about situations in which risk discounts will be higher than
in others. For example discounts will tend to be higher for:
1. Poorer than richer farmers
2. Technologies with higher levels of variability of outcomes
3. Less familiar technologies with which farmers have had little experience
4. Technologies requiring higher levels of management.
On the basis of 2 and 3 above, small farmers would select technology (A) over technology (B),
despite them both having the same level of expected outcome.
15.5.3 Risk implications for an on-farm research programme
The objective of an on-farm research program is to improve the productivity of farmers’
resources. Besides improving the production of target crops or animals, this may also include
lowering the costs of production or increasing the stability of production. The latter is an
important factor for many farmers, whose practices often reflect attempts to reduce the risks of
failure. Risk/uncertainty confronting farmers can originate from various sources. Two of the
most common risks confronted by farmers are:
Uncertain yields - largely due to natural factors such as rainfall, drought, frost, pest,
diseases etc. These conditions are unpredictable and beyond the farmers' control.
Remember farmers can develop strategies to handle these variations. For example
regular irrigation, variation in sowing date, short maturing and tolerant varieties, use of
pesticides and insecticides etc.
Market risks - variability in input and output prices
- unreliable supplies of inputs
Other examples of farmer risk management strategies are given in Table 15.4 and 15.5 below.
17 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
Table 15.4 Farmer risk management strategies: pre-emptive measures
Action Purpose in managing risk Other possible reasons 1. Diversification Low co-variation in profits for different
enterprises. Crop, livestock, off-farm
enterprises.
1) Variety in food for family
2) Beneficial interaction
between enterprises:
Resource allocation, by
products, etc.
2. Mixed cropping More dependable returns to land and
peak season labour
1) Increased use of
environmental factors:
moisture, light, etc.
2) Reduced soil erosion
3) Reduction of adverse
condition:
weeds, diseased, etc.
4) Higher returns to land and
labour.
Allow continuous flow of
fresh food
3. Staggered planting Lessen risk of losing entire crop to a
periodic hazard: drought, pests, disease,
etc.
Means of easing peak season
labour concentration. May be
preferred foods, higher
returns than other crops
4. Insurance crops Drought resistant: Sorghum and millet,
cassava, sweet potato.
Long-period storage capacity: cassava.
Beneficial interaction with
other enterprises.
5. Low level of
purchased inputs
Low possibility of losing scarce cash
resources in agricultural undertakings
Inavailability, lack of
information, lack of market
for increased output, credit
constraint.
6. Traditional forms of
co-operation
Switching private cost of sustenance in
time of famine to a wider group (family,
village, etc.).
Social functions
7. On-farm storage Minimise reliance on market for
consumption
More cost effective than
selling after harvest and
purchasing later on.
8. Produce food for
family
Avoid price risk and in-availability of
foodstuffs
More cost-effective
9. Avoid risky enterprises
and crop varieties.
Emphasise non-risky
enterprises and crop
varieties.
Lessen risk of low returns in any given
year
10. Plant at low density Lessen risk of complete crop failure
18 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
Table 15.5 Farmer risk management strategies: reactive measures
A. PRODUCTION
1. Resowing
2. Reduced dependence or cutback on hired or purchased resources (hired labour, top
dressing, etc.). Substitute labour for capital.
3. Changes in techniques to minimise waste (more careful harvesting)
4. Contract/Expand particular operations (increased thinning, rogueing, pesticides,
weeding).
5. Recover by-products when main products are unavailable
6. Pursue what are usually low value
a) operations (more careful harvesting, weeding).
b) enterprises.
7. Sowing of short season crop when rains are delayed.
B. CONSUMPTION/LOSS MANAGEMENT DEVICES
1. Borrowing
2. Asset depletion, (sales of tools, consumption items)
3. Supplementary earning (Working as a labourer, out-migration, handicrafts).
4. Dependence through charity.
5. Reduction, postponement, cancellation of current consumption commitments.
6. Substitution of food items (cassava for maize, wild greens for beans etc.).
7. Substitution of favoured foods.
8. Diversion of crops from use in brewing to use as food.
Risk has three important implications for an on-farm research programme:
1. New technologies that are proposed for testing should be compatible with farmers’
practices to reduce risk. Technologies that do not take account of farmers’ attempts to
reduce risk have little chance of being adopted.
2. Risks faced by farmers may suggest opportunities for developing recommendations to
help stabilise farm production. For example, drought risk may be reduced with
moisture conservation techniques, and losses from strong winds may be reduced with
shorter varieties. Thus in setting priorities for an experimental programme, researchers
should include the possibility of testing alternatives that may not necessarily increase
average benefits, but instead help to reduce their year-to-year variability.
3. Researchers need to be careful in evaluating how new recommendations modify the
risks currently borne by the farmers in a recommendation domain. The amount that
farmers are willing to give up (in terms of average net benefits) to reduce the effects of
an uncertain environment is a measure of their degree of risk aversion. It is not easy to
specify the degree of risk aversion, but it is something that should be considered when
proposing new recommendations.
19 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
15.5.4 Techniques used in handling risk
If the probability of occurrence of each state of nature or incidence of changing factors is
known, then the risk factor can be incorporated in the quantitative analysis. Unfortunately in
most cases this information is not available. One can use subjective probabilities for some
events. Once again we are looking for some simple techniques. In performing economic
analysis of technologies very often one of the following approaches can be used to handle risk.
Minimum returns analysis
Sensitivity analysis
Risk discounting
These simple techniques are discussed in the following sections.
A. Minimum Returns Analysis
A minimum returns analysis (MRA) is a way of screening data from on-farm experiments in
order to give farmers (and researchers) additional information about the variability in returns
implicit in a proposed recommendation in comparison with the farmers’ practice. A minimum
returns analysis compares the average of the lowest net benefits for each non-dominated
treatment. The MRA presented below is not strictly speaking, a method of risk analysis, but
rather a way of assessing the variability due to unpredictable and at times unexplained causes.
The MRA is done to look at variability the way that farmers do. Looking at across-location and
across-year variability is one way of estimating the risks for farmers associated with the
proposed recommendation. The careful definition of recommendation domains attempts to
eliminate across-location variability as much as possible. Across-year variability, on the other
hand, is estimated based on the results of several years. A careful minimum returns analysis is
therefore a useful way of examining the variability associated with different technological
alternatives.
It should be noted that farmers are more interested in variability in benefits than variability in
yields. A minimum returns analysis looks at variability in net benefits. If the results of a set of
on-farm experiments show that two treatments have the same average net benefits, but one
treatment’s results are more variable than the other’s, it is likely that farmers will prefer the
treatment that is more consistent, rather than the one that sometimes gives very high net
benefits but at other times gives very low net benefits.
Pre-requisites for a Minimum Returns Analysis
For the MRA to be relevant, several prerequisites must be met:
1. The marginal analysis must have been done on all locations for a given experiment and for
all years.
2. A minimum returns analysis should be done only on experimental treatments that are being
considered for recommendation. That may include not only the farmers’ practice and the
treatment that has been judged acceptable on the average by marginal analysis, but also
other non-dominated treatments that may provide alternatives if the tentative
recommendation proves unsatisfactory.
3. Minimum returns analysis presumes that researchers have tried to explain the reasons for
the variability they observe. The more precise an idea of the sources of observed
variability, the more useful the information from the minimum returns analysis will be for
farmers.
4. Minimum returns analysis is relevant when done on the results of several locations and
years. The results should be from enough locations and years to fairly represent the
variability that farmers in the recommendation domain are likely to face.
20 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
Minimum Returns Analysis: procedure
The steps involved in the minimum returns analysis are:
1. To calculate the net benefits at each one of the locations for each one of the treatments.
2. To select the (approximately) 25% lowest benefits for one treatment and compare their
average with that of the 25% lowest benefits for the alternative.
3. If the average of the lowest net benefits for the tentative recommendation is higher than the
average of the lowest net benefits for the farmers’ practice, then the recommendation
should be made, because even in the worst cases the recommendation does better than the
farmers’ practice.
4. If the average for the tentative recommendation is lower than that for the farmers’ practice,
then one should be more careful in making the recommendation. The absolute value of the
net benefits has little meaning but the difference between the two should be examined. If
the difference is small, then farmers will probably be willing to accept this risk, knowing
that over the long run they will benefit. If, on the other hand, the difference is large, then it
would be best to reconsider the recommendation by taking an alternative less risky
recommendation. If this is not available, then the farmers’ practice is to be preferred.
It is important to note that:
MRA assumes that all locations are representative of a single recommendation domain,
and that there is nothing special about any individual location.
MRA is done with actual location by location data.
The key to MRA is a common sense examination of the data from the farmers’ point of
view.
B. Sensitivity analysis
Experimental yields are not the only element of the partial budget that is likely to change. Input
and product prices are also subject to change. The best way to test a recommendation for its
ability to withstand price changes is through sensitivity analysis. This simply implies redoing a
marginal analysis with alternative prices. If, for instance, a fertiliser recommendation is made
using current fertiliser prices, but there are indications that those prices may increase a
reasonable estimate of the new prices may be substituted in the analysis. Table 3 illustrates
such a situation. In the original analysis (case A), a field price for nitrogen of Tsh 770/kg was
used. The recommendation of 50 kg N was made, assuming a minimum rate of return of 100%.
If the field price of nitrogen increases to Tshs. 900/kg would the same recommendation hold?
Redoing the partial budget (case B) with the higher price of nitrogen shows that the
recommendation of 50 kg N is now inappropriate because the marginal rate of return from
application of 50 kg N is less than the minimum rate of return (100%). Any higher nitrogen
prices would necessitate lowering the fertiliser recommendation.
21 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
Table 15.6 Sensitivity analysis for nitrogen experiment
Case A
(Current field price
of N = Tshs 770/kg)
Case B
(Future field price
of N = Tshs 900/kg)
0 kg N
50 kg N
100 kg N
0 kg N
50 kg N
100 kg N
Adjusted yield (ton/ha) 1.99 2.83 3.52 1.99 2.83 3.52
Gross field benefits (‘000 Tshs) 199 283 352 199 283 352
Cost of fertiliser (‘000 Tshs) 0 39 77 0 45 90
Cost of labour (‘000 Tshs) 0 2 4 0 2 4
Total cost that vary (‘000 Tshs) 0 41 81 0 47 94
Benefits (‘000 Tshs/ha) 199 242 271 199 236 258
Marginal rates of return
0 kg N to 50 kg N = 105% 0 kg N to 50 kg N = 79%
50 kg N to 100 kg N = 72% 50 kg N to 100 kg N = 47%
In case A if the minimum rate of return does not change, and the price of labour and the field
price of maize remain constant, how high can the field price of nitrogen go before even 50 kg N
ceases to be a viable recommendation? This question can be answered by the formula below.
The change in the total costs that vary will depend on the field price of N (n) and the labour
costs of applying 50 kg N/ha (Tshs 2,000). The calculation shows that the nitrogen field price
can rise Tshs 800/kg before 50 kg N ceases to be a profitable practice for farmers.
Calculation of maximum acceptable field price of nitrogen:
Y = change in adjusted yield
TCV = change in total costs that vary
M = minimum rate of return (expressed as a decimal fraction)
P = field price of product
Y = TCV (1 + M)
P
or
TCV = P x Y
1 + M
Example:
Increase in adjusted yield between 0 kg N and 50 kg N = 840 kg/ha
Cost of labour to apply fertiliser = Tshs 2,000/ha
Minimum rate of return = 100%
Field price of maize = Tshs 100/kg
To calculate the maximum acceptable field price of nitrogen (n) in order for the application of
50 kg nitrogen to be economic:
50 n + 2,000 = 100 x 840
1+1 = 2
n = 800 Tshs/kg
C. Risk discounting
22 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
This is simply a matter of discounting the rate of return for risk. This is done by adding a risk
premium to the cost of capital in estimating the minimum acceptable rate of returns (MARR)
for the farmer. The risk premium depends on the nature of the technology, which depends on
the subjective judgement of the research team. If the anticipated risk is high, then the benefits
are highly discounted by adding a much higher risk premium in MARR. As a rule of thumb, the
average acceptable rate of return should be at least 20 percent above the direct cost of capital.
Remember, the cost of capital may vary from farmer to farmer and may also depend on the
source of capital.
1. Cost of Capital
One of the key aspects in the risk discounting procedure is the estimation of the direct cost of
capital. The cost of capital depends on the source of capital as well as the attractiveness of the
alternative investment as shown in Box 15.1. The direct cost of capital is the earnings given up
by not using the money or the return generated from the best alternative case where the capital
is already being employed. It is important to remember that the actual cost of capital to a
farmer is not the same as the market interest rate.
Example 1:
A farmer borrowed Tshs 300,000 for eight months at an annual interest rate of 20%. Besides
interest the farmer paid a service charge of Tshs 10,000 and he had Tshs 14,000 of personal
expenses relating to the loan. What is the percentage cost of borrowed capital?
Box 15.1 Source and Cost of Capital
Source
Alternative
Use/Investment
Own
Borrowed
- Institutional
- Non
Institutional
Use in Agriculture
Others
Annual interest cost = 300,000 x 20 = Tshs 60,000
100
The interest cost for eight months = 60,000 x 8 = Tshs 40,000
12
Service charge on loan = Tshs 10,000
Personal expenses = Tshs 14,000
Therefore the total cost = Tshs 40,000 + 10,000 + 14,000
= Tshs 64,000
Cost of borrowed capital = 64,000 x 100 = 21.3%
300,000
23 | P a g e
Economic analysis of on-farm trials By: Leykun Birhanu
2. Minimum Acceptable Rate of Returns (MARR)
MARR is only an estimate and it must be inferred from an estimate of the cost of borrowed
capital. We need to be very realistic in making such estimation. The MARR should include the
direct cost of capital, plus some allowance for risk (not to mention management). The MARR is
influenced by three factors:
1. The type of technology under consideration
Whether it involves a major/minor change from the current practice
Likelihood of failure (e.g. loosing a crop) and frequency
Amount of cash involved
2. The cost of borrowed capital. This again depends on the source and alternative use as
discussed earlier.
3. The length of the enterprise cycle.
These factors should be carefully considered in estimating the MARR.
References
Amir, P. and H. C. Knipscheer (1989). Conducting on-farm animal research: Procedures and
economic analysis. Winrock International Arkansas, USA.
Anderson, J. R. and J. L. Dillon (1992). Risk analysis in dryland farming systems. FAO, Rome.
Anandajayasekeram, P. (n.d.). Teaching Notes: Experimental Evaluation. CIMMYT, Eastern
African Economics Programme, Nairobi, Kenya.
CIMMYT (1988A). From Agronomic Data to Farmer Recommendations: An Economics
Training Manual. Completely revised edition. Mexico, D.F.
CIMMYT (1988B). From Agronomic Data to Farmer Recommendations: An Economics
Workbook. Mexico, D.F.
Low, A. (1989). Application of Risk Decision Theory to Net Benefit and MRR Analysis.
Teaching Notes for the Experimental and Other Data Analysis Workshop for Social Scientists,
October 15-27, 1989, Njoro, Kenya.
Norman, D.W., J.D. Siebert, E. Modiakgotla and F.D. Worman (1994). Farming Systems
Research Approach: A Primer for Eastern and Southern Africa. Regional Farming Systems
Programme.
Perrin, R. K., D. L. Winkelmann, E. R. Moscardi and J. R. Anderson (1976). From agronomic
data to farmer recommendations: An economics training manual. Information Training Bulletin
21. CIMMYT, Mexico.
Worman, F., D. Norman and J. Ware-Snyder (Eds) (1990). Farming Systems Research
Handbook for Botswana. ATIP RP 3. Agricultural Technology Improvement Project.
Department of Agricultural Research Ministry of Agriculture, Botswana.