I. Basic project data

22
1 Project Completion Report Validation Community-Based Natural Resource Management Programme -Niger Delta Region (CBNRMP-ND) Federal Republic of Nigeria Date of validation by IOE: May 2017 I. Basic project data Approval (US$ m) Actual (US$ m) Region West and Central Africa Total project costs 84,800 52,710 Country Federal Republic of Nigeria IFAD loan and percentage of total 15,000 b 18% 16,793 30.4% Loan number LI-598-NG Federal Govt. of Nigeria 10,200 12% 8,442 15% Type of project (subsector) Rural Development NDDC 15,000 18% 15,000 28% Financing type Loan States Govt. 8,200 9.6% 7,736 14% Lending terms a HC Local Govt. Councils 32,000 37.7% 4,250 7.6% Date of approval 11/12/2002 Beneficiaries c 4,400 5% 2,494 4.5% Date of loan signature 09/07/2003 Co-Financer (World Bank) d (3,800) Date of effectiveness 06/07/2005 Loan amendments 1 Number of beneficiaries (direct) 2,800,000 people 400,000 HHs 2,783,399 people 291,435 HHs Loan closure extensions 1 Country programme managers A. BARRY (Jul-10 to May-12) A. TODA (May-12 to Dec-16) B. ODOEMENA (from Dec-16) Loan closing date 31/03/2016 19/08/2016 Regional director(s) M. BEAVOGUI I. DE WILLEBOIS Mid-term review 27/05/2010 Project completion report reviewer Manuela Bucciarelli IFAD loan disbursement at project completion (%) 100% e Project completion report quality control panel Date of the project completion report 31/12/2016 Source: Project Completion Report 2016; Mid-term Review 2010; President Report 2001. a ) There are four types of lending terms. This was a special loan on highly concessional terms, free of interest but bearing a service charge of three fourths of one per cent (0.75 per cent) per annum and having a maturity period of 40 years, including a grace period of ten years. b ) Equivalent to SDR 11.35 million. c ) It was estimated that beneficiaries will contribute the equivalent of US$4.4 million (5.4 per cent of total programme costs) in the form of labour and materials for the construction and rehabilitation of village infrastructure under the CDF. d ) This amount was included in the Formulation and Appraisal Report and it was proposed for funding under the World Bank Niger Delta Institutional Strengthening Project. It never materialized and removed from the actual financing of CBNRMP-ND. e ) This 100 per cent of the amount expressed in Special Drawing Rights (SDR). IFAD financing in US$ was 112 per cent of the appraisal estimate due to foreign exchange differences over the programme life.

Transcript of I. Basic project data

1

Project Completion Report Validation

Community-Based Natural Resource Management Programme -Niger Delta

Region (CBNRMP-ND)

Federal Republic of Nigeria

Date of validation by IOE: May 2017

I. Basic project data

Approval (US$ m) Actual (US$ m)

Region West and Central

Africa Total project costs 84,800 52,710

Country Federal Republic of

Nigeria IFAD loan and percentage of total 15,000

b 18% 16,793 30.4%

Loan number LI-598-NG Federal Govt. of Nigeria 10,200 12% 8,442 15%

Type of project (subsector) Rural Development NDDC

15,000 18% 15,000 28%

Financing type Loan States Govt. 8,200 9.6% 7,736 14%

Lending termsa HC Local Govt. Councils 32,000 37.7% 4,250 7.6%

Date of approval 11/12/2002 Beneficiariesc 4,400 5% 2,494 4.5%

Date of loan signature 09/07/2003

Co-Financer (World Bank)

d

(3,800)

Date of effectiveness 06/07/2005

Loan amendments 1

Number of beneficiaries (direct)

2,800,000 people

400,000 HHs

2,783,399 people

291,435 HHs

Loan closure extensions 1

Country programme managers

A. BARRY

(Jul-10 to May-12)

A. TODA

(May-12 to Dec-16)

B. ODOEMENA

(from Dec-16) Loan closing date 31/03/2016 19/08/2016

Regional director(s)

M. BEAVOGUI

I. DE WILLEBOIS Mid-term review 27/05/2010

Project completion report reviewer Manuela Bucciarelli

IFAD loan disbursement at project completion (%) 100%

e

Project completion report quality control panel

Date of the project completion report 31/12/2016

Source: Project Completion Report 2016; Mid-term Review 2010; President Report 2001. a) There are four types of lending terms. This was a special loan on highly concessional terms, free of interest but bearing a

service charge of three fourths of one per cent (0.75 per cent) per annum and having a maturity period of 40 years, including a grace period of ten years.

b) Equivalent to SDR 11.35 million.

c) It was estimated that beneficiaries will contribute the equivalent of US$4.4 million (5.4 per cent of total programme costs) in

the form of labour and materials for the construction and rehabilitation of village infrastructure under the CDF. d) This amount was included in the Formulation and Appraisal Report and it was proposed for funding under the World Bank

Niger Delta Institutional Strengthening Project. It never materialized and removed from the actual financing of CBNRMP-ND. e) This 100 per cent of the amount expressed in Special Drawing Rights (SDR). IFAD financing in US$ was 112 per cent of the

appraisal estimate due to foreign exchange differences over the programme life.

2

II. Project outline 1. Introduction. The Community-Based Natural Resource Management Programme,

Niger Delta (CBNRMP-ND)1 was a ten-year programme implemented by the Federal

Government of Nigeria, Niger Delta Development Commission (NDDC), the State

governments of the nine Niger Delta states and IFAD2. The programme was

approved for a loan of US$15 million on 23 June 2003, became effective in July

2005, and disbursement went into effect on 06 July 2006. The initial completion

date was 30 September 2013 but, at the Federal Government of Nigeria’s request,

IFAD granted a 2-year extension in 2012. The modified completion date was set as

30 September 2015 and the programme officially closed on 30 March 2016. There

was also a joint Federal Government of Nigeria/IFAD Mid-term Review (MTR) held

in May 2010.

2. Project area. The CBNRMP was implemented in each of the nine states of the

Niger Delta3. A total of eighty Local Government Areas were targeted within the

nine participating states for a total of 243 communities covered. The programme

aimed to reach roughly 2.8 million beneficiaries in the entire Niger Delta region.

Despite significant economic growth over the last 30 years due to oil export

revenues, 50 per cent of the rural population in the Niger Delta region was still

classified as poor and 20 per cent as food insecure.4 The exploitation of the Niger

Delta’s vast natural resources5 had not resulted in significant social or economic

benefits for the population. Environmental degradation, deteriorating economic

conditions, community conflicts and violence prevailed in the late 1990s and

2000s. This led to the erosion of traditional social structures, lack of confidence in

development processes, and institutions without strong political influence or

community coordination mechanisms. In particular, the younger parts of the

population became involved in the resulting social unrest such as armed robbery,

militancy, kidnapping and homicide. Moreover, due to poor extension support and

environmental challenges, major crops did not reach their full production potential,

access to drinking water was limited,6 and infrastructure were under-developed.

3. Project goal, objectives and components. The CBNRMP intended to improve

the standard of living and quality of life of at least 400,000 poor rural households

of the Niger Delta region, with an emphasis on women and youth. The

programme’s purposes7 were: i) to strengthen the community development

capacity of rural communities and service providers; and (ii) to establish a

community development fund with effective disbursal. The programme’s objectives

were to be achieved via three components: a) Institutional strengthening/capacity

building; b) Community development fund creation; and c) Management and

Coordination. The first component: Institutional Strengthening (46 per cent

of total allocations, at appraisal) provided community-level awareness and

capacity building while also providing institutional capacity building and monitoring

and evaluation (M&E) support to the implementing agencies using a Community

Driven Development (CDD) approach. The second component: Community

Development Fund establishment (54 per cent of total allocations, at

1 Referred as CBNRMP through this report.

2 The programme responds to a request of the Federal Government of Nigeria for assistance to alleviate rural poverty in

the Niger Delta region, at the time when IFAD and Federal Government of Nigeria completed the framework for partnership and the Country Strategic Opportunity Paper (COSOP) for Nigeria had been approved in 2001. 3 These are: Abia, Akwa Ibom, Bayelsa, Cross Rivers, Delta, Edo, Imo, Ondo and Rivers States.

4 National Bureau of Statistics. Revised Poverty Statistics, Abuja 2013.

5 The Niger Delta region is one of the world’s largest wetlands comprising a vast floodplain built over many years by the

accumulation of sedimentary deposits washed down the Niger and Benue rivers. In addition, over 60 per cent of Nigeria mangrove forests are found in the Delta Region (Formulation Report, 2002). 6 In 2001 only 24 per cent of the rural population had access to drinking water (Formulation Report, 2002)

7 Programme implementation was structured along a theory of change of establishing rural institutions to effect a

change in mind-set of the people and drive infrastructure development, which would induce beneficiaries to pursue agriculture as a business. IFAD disbursement was planned for the first eight years during which period, the LGCs and NDDC were expected to learn and integrate the CDD framework in their business development models (President Report and Project Completion Report - PCR).

3

appraisal) supported initiatives identified by the rural poor that would develop

community and Local Government Council (LGC) capacity to secure additional

funding for community development projects from the government, other local

agencies, without IFAD support. This component originally had three sub-

components (described below), but was modified after the MTR and subsequent

supervision missions recommended the programme re-focus on agriculture and

agriculture-related infrastructure. Component 3: Management and

Coordination8 supported the efficient management of the two above components

in order to increase the capacity of the institutions at the federal, regional, state

and LGC levels. The programme was implemented by the Project Coordination Unit

under the leadership of the Lead Programme Agency, the Federal Ministry of

Agriculture and Rural Development (FMARD) and the line Federal Ministry of

Finance (FMF). Implementation was supervised by the NDDC which financed

programme activities to the tune of US$15 million.

4. Target group. IFAD-supported activities targeted the poorest of the poor.9 The

poor were classified into different strata during programme formulation in order to

allow for the design of tailor-made activities for the different strata.10 The poorest

of the poor represented 29 per cent of the rural population in the Delta Region and

are characterized by food insecurity, limited labour and resources, and small farm

size (less than 2ha). The majority of this group are female-headed households,

young families with small children, or women in polygynous families with sole

responsibility for their children and unemployed youth. A three-state (Abia, Rivers

and Ondo) pilot of the CDD approach in the first 15-18 months of the programme

focusing on one LGC per state helped develop the overall geographical targeting

strategy. Geographic locations selected had to fulfill three criteria, based on

geographical representation, wealth and community participation11. Each state

started with nine participating LGCs, with the exception of Bayelsa State; 57 LGCs

participated in the programme at completion date.12

5. Financing. At design the estimated total programme cost was US$84.8 million,

out of which 18 per cent (US$15 million) was to be financed through an IFAD loan,

and the rest by co-financers (the Federal Government of Nigeria, NDDC, the nine

participating states and the LGCs), according to the percentages and amounts

reported in Table 1, Annex I. The intervention design assumed that government

counterparts were deeply committed to agriculture in the Delta region. This

commitment was to be translated into financial contributions to the programme.

The IFAD loan and the NDCC grant met the initial targets and the Federal

Government of Nigeria and the States Counterparts were just below the targets, at

83 and 94 per cent respectively. The LGC disbursement was very low (only 13 per

cent of the planned contribution). At completion, the actual expenditures of the

programme were US$55.23 million, representing 65 per cent of the revised total

cost (Table 1, Annex I).

6. Changes and developments during implementation. The programme

implementation effectively had three phases, instead of the two initially designed:

the first phase (July 2006 to May 2010) focused heavily on CDD sensitization and

awareness raising, establishment of social infrastructure, and capacity building.

8 This component includes M&E, partnerships, linkages and knowledge management.

9 Past interventions rarely reached the extremely poor, so this programme was supposed to raise the poor’s awareness

of the opportunities available to them. 10

The population in the programme area was divided into four groups: poorest; poor; less poor and well-off, and their specific features are described. 11

The criteria were:(i) the main agro-ecological zones in each state had to be represented; (ii) wealth ranking tools had to be used to identify LGCs with higher proportions of poor communities that had a demonstrated commitment to a CDD approach; and (iii) a community participation approach had to be used within the LGCs to identify the communities to be included. The targeting approach, as described extensively in the formulation report, was supposed to be integral part of the planning process, with the assumption that all segments of the population would participate in the dialogue to set the community priorities. 12

80 LGCs were selected to participate in the programme. Some LGCs were unable to contribute their counterpart funding, so the total number of participating LGCs was reduced to 57.

4

After the MTR, the programme (2010 to 2013) shifted its focus from social

infrastructure to agriculture and agricultural infrastructure needs. Lastly, Phase 3

(2014-2015), the extension period, focused on the consolidation of activities (such

as categorization of agro-enterprises) for exit and sustainability.

7. Intervention logic. The CBNRMP-ND’s central goal was to bring about a change

in the mindset of people who would pursue agriculture as an employment

generation activity. The programme was designed to promote innovation and a

community-driven development approach with LGCs and NDDC expected to learn

from, integrate, and scale up the CDD framework in their own business

development models. Component 1 would promote pro-poor legislation at both the

local and state government levels as well as pro-poor regulations at community

level, beneficiary capacity strengthening, and more effective service delivery to the

poor. Component 2 was meant to promote an increase in crops, livestock,

aquaculture and fish catch productivity, an increase in beneficiary net income from

agro-enterprises, an increase in jobs, and improved household drinking water. All

programme activities would have a focus on youth and women. The aim of the

programme was also to reduce current tensions and conflicts among the youth in

the region by improving productive opportunities and channeling their energies into

natural resources management and sustainable livelihoods.

8. Delivery of outputs. A detailed analysis of the actual project progress is

presented in Annex 8 of the Project Completion Report (PCR). The programme

reached 76.3 per cent of the appraisal target for activities under the livelihood

improvement component, 75.8 per cent of the appraisal target for the Community

Development Fund (CDF) component, 62.2 per cent of the appraisal target for the

rural infrastructure sub-component, and 53.1 per cent of the target for the Natural

Resources Management sub-component. The quality of both the outputs and data

analysis is discussed in the Effectiveness and PCR quality sections, respectively.

III. Review of findings

A. Core criteria

Relevance

9. Relevance of objectives. The objectives of CBNRMP were well aligned with the

government’s Economic Empowerment Strategy of 1999-2003, Vision 20:2020,13

7-Point Agenda, and the Strategic Development Framework of the NDCC (2005),

all of which advocate for the participation of rural communities in development

processes and for youth empowerment. The programme was a response to the

Federal Government of Nigeria's request for assistance and was designed against

the backdrop of the 2001 Nigeria Rural Development Strategy. The programme

objectives also reflected the strategic direction of the IFAD 2001 Country Strategic

Opportunities Paper (COSOP) for Nigeria14. CBNRMP interfaced closely with two

World Bank projects.15 CBNRMP also built on and adapted the community-driven

development approach of the IFAD Community Based Agricultural and Rural

Development Programme in northern Nigeria.

10. Relevance to the needs of beneficiaries is rated high. The programme

addressed the needs of the rural poor and of women in the target areas: it adopted

the principles of CDD to improve smallholder farmers’ participation in development.

In particular, beneficiaries appreciated the CDF component, which supported

initiatives identified directly by the rural poor. The introduction of Commodity Apex

Development Associations (CADAs) to support the community-based enterprises

13

Vision 20:2020 lays the overarching policy framework for Nigeria to become one of the top 20 economies in the world by year 2020. 14

IFAD 2001 COSOP for Nigeria emphasized empowerment of the rural poor, female empowerment, and access to and management of resources, infrastructures and services. 15

The Niger Delta Institutional Strengthening project and the Nigeria Local Empowerment and Environmental Management Programme.

5

increased the relevance to the needs of beneficiaries. CADAs consisted of

enterprises specialized in certain commodities, representatives of farmer groups,

agro-entrepreneurs and agro-allied entrepreneurs, mostly youth and women. The

MTR also reports that interventions were largely relevant to the needs of the very

poor communities.

11. Targeting. The Appraisal report includes a very detailed Annex on “Targeting

Considerations”,16 but the Country Programme Evaluation (CPE) in 2016 reported

that the actual process was somewhat opaque because of the absence of reliable

sub-state poverty data.17

12. Relevance of project design. The design of the CBNRMP was based on

participatory community-led initiatives. The project had a long time span (more

than ten years including the extension). The country’s policy direction shifted over

the course of this period and a stronger emphasis was placed on agriculture, as

evidenced by the Agricultural Transformation Agenda in 2011. IFAD priorities

significantly evolved during this time as well, as described in the COSOP (2010-

2015), towards market-led and commodity based approaches. The paradigm shift

to agriculture, together with other adjustments, such as the link with Songhai

Agricultural Center and the establishment of the CADAs, contributed to increase the

project’s relevance. Given the changes in the overall context and priorities, the re-

design was relevant. However, the adjustment took several years to materialize

because of the initial focus of activities and limited staff competencies on social

issues. The re-design caused some turbulence in programme implementation (for

instance with the introduction of CADAs and with the abandonment of some

infrastructure projects). The re-design also meant a change in the community

development plans that had already been agreed upon.18

13. The design of CBNRMP was quite ambitious and included a diverse range of

interventions: social and economic infrastructure development, agricultural

production, and multi-level capacity development components in an environment of

social unrest. In particular, the programme over-ambitiously assumed that the

states and the LGCs would pay their counterpart funds, which was not realistic and

it represents a clear design flaw.

14. Potential risks linked to local conflict and ethnic violence were recognized during

CBNRMP formulation, but no conflict analysis was done and no mitigation strategy

was developed. Insecurity did not affect service delivery because beneficiaries and

staff went to safer locations for delivery, but risk associated with not having done a

conflict analysis should not be under-estimated.

15. In summary, the project responded to the needs of beneficiaries and was well

aligned to government and IFAD priorities in the country, as observed above. Given

the overly ambitious design, the unrealistic reliance on state funding and the

absence of conflict analysis and mitigation strategies, the PCRV rates the relevance

criterion as moderately satisfactory, 4. This is higher than the CPE’s assessment

of relevance but one point below the Programme Management Department (PMD)

rating of satisfactory. The higher PMD rating, according to the PCRV, was mostly

driven by considerations on the appropriateness and usefulness of the re-design.

Effectiveness

16. The programme’s outreach was below target, but outreach to youth was good. The

programme reached 291,435 households (73 per cent of the appraisal target of

400,000) and benefitted an additional 104,565 households indirectly. CBNRMP

16

See Working Paper 1, Targeting Considerations, Appraisal Report 2002, p. 25ff. 17

There are 185 Local Government Areas (80 of which were selected to participate in the programme) and between 8,444-10,555 villages in the nine Niger Delta states. The cost of assembling screening data for all of these villages seemed to be prohibitive. 18

Country Programme Evaluation, 2016.

6

reached 2,783,399 beneficiaries. 1,087,012 of these beneficiaries were youth (53

per cent)19.

17. Objective 1: strengthen community development capacity of the rural

community and service providers. Component 1 covered capacity building,

institutional linkages, and internal and external communication. Almost all training

targets were achieved at the individual capacity building level.20 The training for

commodity groups and rural institutions members on various aspects of crop,

livestock, fisheries, processing/marketing, and community management was less

effective.21 The impact survey report data also show significant achievements in

this sub-component.

18. After the revisions introduced by the MTR, the programme adopted the CADA

model. 154 CADAs were formed and strengthened, reaching the appraisal target.

Youth in Agriculture Foundations were established in each of the nine states and

1083 Community Action Plans were developed in line with the CDD approach. As

proven by the supervision mission in 2015, some CADAs showed significant

momentum, implemented saving and credit activities and had a clear mandate and

sense of purpose.

19. In terms of institutional linkages (sub component 2), the programme connected 70

per cent of the 8,994 farmer groups to input, output and credit markets and

established linkages with the USAID-funded MARKETS II, World Bank-assisted

Fadama III, and Songhai Centre initiative. The link with the Songhai Center was

crucial as it allowed strong youth involvement in agro-enterprise groups. On the

other hand, despite some community-level achievement with strengthening

existing fishing protocols, policy gaps still remain (see Rural Impact Section-

Institutions and Policies). Also, the PCRV notes that many institutional linkages

foreseen at design, such as with non-governmental organisations, were not put in

place. With regards to communication and knowledge management, despite some

progress such as the development of a website, production and distribution of

informational materials, training modules, outreach activities, and the inclusion of

the programme in the IFAD central communication platform, a clear

Communication and Knowledge Management strategy was never developed.

20. In general, this component was quite satisfactory in terms of strengthening rural

institutions. As an immediate consequence, beneficiaries and youth began to view

agriculture as a business and entrepreneurship opportunity.

21. Objective 2: community development fund established and effectively

disbursing.22 With regard to the sustainable livelihood sub-component,

supervision missions and the impact survey confirm the successful establishment of

micro-enterprises.23 The exact number of livelihood micro-projects reported in the

PCR (12,790 in total) could not be verified24. The most profitable sub-sectors were

cassava production, followed by fisheries, poultry and yams. The PCR also reported

that aquaculture-related enterprises had higher production levels than predicted at

the time of appraisal.

19

Youth are citizens of Nigeria aged between 18–35 years of age - Second National Youth Policy Document of the Federal Republic of Nigeria 2009, p. 6 (CPE 2016). 20

The number of government official, staff of service providers and financial institutions trained reached 2,072, 103 per cent of the original target of 2014; 93 per cent of the target of 3,209 women and youth trained on income generating, life skill and vocational activities (Data from the PCR Log-frame updated in December 2015). 21

The programme trained 233,247 people, equal to 69 per cent of the target (out of 338,000 potential trainees).These figures were confirmed by the latest supervision mission in May 2015. 22

The overall assessment of this component in the PCR is moderately satisfactory. The Supervision Mission had rated the progress during the review period as satisfactory. 23

These were established in crop, livestock, fisheries, aquaculture, snail rearing, honey production, vegetable, and agro-processing as well as Non Timber Forest Products. 24

The 2015 Supervision Mission Report reported a total of 9,279 enterprises promoted by the programme, out of the 12,873 foreseen in the Appraisal. In general, the most profitable sub-sector was cassava production, followed by fisheries, poultry and yams.

7

22. The PCR reports that a total of 3,426 ha of land was cultivated under improved

technology, but this information is hard to verify. The Results and Impact

Management System (RIMS) data for 2015 report a total of 2,070 ha of land under

“improved management practice” and the impact survey revealed increases in

produce volume for most crops cultivated in the programme areas. This trend

affirms that the overall increase can be attributed to the training and improved

technologies introduced by the programme (see impact section). Among the

successful models introduced by CBNRMP, as described in the Innovation Section,

was the Youth Enterprise Incubation Model,25 which created job opportunities.

23. The sustainable Natural Resources Management sub-component, which promoted

sustainable aquaculture in order to avoid over-fishing, did not show high

performance. While CBNRMP recorded use of special fishing gear by communities

(especially in Warri North LGC and Rivers State) that was meant to protect the

environment, forest and waterways were nevertheless cleared and converted into

aquaculture enterprises. The absence of an environmental impact assessment was

a weakness (see the Environment and Natural Resources Management Section of

this report).

24. In terms of community infrastructure improvement, less was achieved than

expected. The impact survey estimates that only 34 per cent of the targeted

number of infrastructure projects was completed, while the functionality of the

existing infrastructure stood at roughly 77 per cent. The MTR had expressed

concerns about lack of NDDC and state government responsibility for completing

and ensuring the functionality of ongoing community infrastructure projects. At the

end of the programme there were 31 incomplete projects. The PCRV considers the

performance of the CDF interventions as a whole to be moderately satisfactory.26

25. In summary, CBNRMP has performed effectively in terms of outreach. The first

objective was nearly achieved. The second was achieved with improvement of

livelihoods of rural poor, through the establishment of microenterprises as

described above. The Natural Resources Management component under-performed

and, as addressed in the environmental and natural resources management

section, was rather ineffective in terms of sustainable use of natural resources.

Given this mixed effectiveness, the PCRV agrees with the PMD rating of

moderately satisfactory, 4.

Efficiency

26. Time lapse. CBNRMP became effective 24 months after it was signed and 31

months after it was approved. This is shorter than the average time lapse recorded

in IFAD programmes in the country (equal to 32 months), but much higher than

the average IFAD effectiveness lag (around 12 months).27 Reasons for the delay in

start-up and counterpart funding included the slow appointment of programme

staff and opening of accounts. It appears that no expenditures were made before

2009.28 After the MTR recommended a reallocation of funds between IFAD and the

LGCs, as described above, disbursements increased significantly.

27. Time overruns. As recommended by the MTR, the programme had a two year

extension to help the refocus on agriculture and to allow for more impact to be

realized using the CDD approach. The completion date was shifted from 30

September 2013 to 30 September 2015, and the revised closing date was 30

March 2016.

25

The PCR states that CBNRMP created 6,500 jobs in agro-enterprises and more than 63,000 jobs in services provision and non-farm enterprises. 26

As reported in the CPE, the CBNRMP has only built and maintained a relatively small part of the social and economic infrastructures planned: 18 out of 48 school buildings, five out of 25 health centers; 97 out of 120 boreholes; 39 out of 120 km of rural roads; 16 out of 52 small bridges; two out of landing jetties; 37 out of 90 agro-processing facilities. 27

Source: CPE, 2016. 28

Only 13 per cent and 20 per cent of the Annual Work Plan and Budget were spent in 2009 and 2010, respectively.

8

28. Cost per beneficiary. The PCR reports that the cumulative Cost per Beneficiary

(CPB) on the IFAD loan was US$7.41, as compared to the appraisal CPB of US$6.

The CPE reports an IFAD CPB equal to 5.9 at completion. The CPB for the CBNRMP-

ND is lower than the one attained by other IFAD programmes in Nigeria and lower

than in other IFAD-supported countries. High population density in the region

meant that reaching beneficiaries and serving communities was relatively cheap,

making CBNRMP more efficient than other IFAD projects in Nigeria between 2009

and 2015.

29. Economic Internal Rate of Return (EIRR) at project completion. The

analysis conducted at project completion showed an EIRR of 42 per cent against a

12 per cent cost of capital. No data was found on the estimated EIRR at project

appraisal. The financial analysis of individual enterprises also reported a positive

cost-benefit ratio, higher for honey production and fish production and lower for

goat rearing. This indicates that it was a good decision to promote farmer’s

investments in these enterprises.

30. Project costs. As stated above, government disbursements were below target:

percentages of disbursements are shown in Table 1, Annex I. IFAD financing

percentage for two of the categories in the CDF Component and one in the

Institutional Strengthening Component were increased from 22.5 per cent (initial

allocation) to 40 per cent in June 2013 and to 100 per cent in September 2014.

After the MTR, due to very high inflation rate, the expected contribution from the

federal and state governments was increased by US$11 million;29 the US$4.4

million expected contribution from the communities and the Technical Assistance of

US$3.8 million, which never materialized, were removed. The amendments to IFAD

financing percentages were not followed by appropriate adjustments in the

expected contributions from NDDC, federal and state governments and the LGCs.

Counterpart funding commitment also varied across states with Ondo and Cross

River States providing 73 per cent and 63 per cent against the original allocation

and Imo and Akwa States only providing 27 per cent and 33 per cent.

31. Project management costs. The estimated programme management cost for

CBNRMP, as a proportion of total programme cost, was 30 per cent.30 The high

costs can be attributed to the fact that programme coordination units were

stretched to work in many states and LGCs. In addition, as described in the

Partners section, the quality of programme management was not satisfactory. At

the Programme Support Office (PSO) and the State Programme Support Office

(SPSO) levels, management was weak due to a lack of induction and training at the

beginning of the programme. Low managerial and technical expertise of some staff

led to poor guidance and ultimately to a decrease in IFAD resources, with the result

that in 2014 the programme was classified as “at risk”. This low-quality programme

management helps explain low cost efficiency as well.

32. Overall, delays in effectiveness, high overheads, and high programme management

costs had a negative impact on efficiency. However, CBNRMP showed good

economic returns and cost-efficiency as demonstrated by high EIRR and low cost

per beneficiary. These two elements do not compensate for the disbursement

underperformance or the inefficiencies highlighted above. The PCRV therefore rates

efficiency as moderately unsatisfactory, 3 in agreement with the PCR rating and

the CPE rating.

Rural poverty impact

33. Household assets. Data on ownership of household assets in the Impact Survey

show that on average beneficiaries reported owning more assets compared to non-

29

The PCRV found a mistake in the PCR text (paragraph 64, page 32) related to the increase of LGCs disbursement of 15 million, which did not happen, as confirmed by the Finance Officer and the Country Presence Officer. 30

This compares unfavorably to the average of 20 per cent for the other IFAD-funded projects in Nigeria in the same period (CPE 2016).

9

beneficiaries.31 However, there is some variability across assets; beneficiaries

owned more radio, TV, refrigerators and other non-production related items while

non-beneficiaries owned more boats, motor-bikes and tractors. The impact survey

includes an analysis of assets ownership by quintile of the population. Based on the

survey data, well-being within the core poor (first quintile) was not superior to that

of the non-beneficiaries, therefore implying that the programme had least impact

on the poorest. In terms of financial assets RIMS Data from 2014 show a lower

than expected value of voluntary savings (only 37 per cent of the target), despite a

high number of savings and credit groups formed. Given the particular problems in

generating accurate household income data, attribution remains difficult and

depends on the presence or absence of other development actors. Despite the

unreliability of impact survey data, the CPE confirmed that beneficiary asset

ownership improved everywhere, except in regions affected by conflict where

inequality seems to have increased.

34. Food security, nutrition and agricultural productivity. Data from the Impact

Survey revealed that beneficiaries obtained higher yields as compared to non-

beneficiaries. The PCR makes a strong connection between this outcome and the

training that beneficiaries received on agricultural best practices and improved

technologies. It further states that the reduction in poverty rates and increase in

income amongst beneficiaries were due to productivity increases of agricultural

enterprises. However, the same survey data also show increases in agricultural

productivity for non-beneficiaries, albeit at a slower pace and improvement in

livestock production over the course of the programme, especially in poultry and

small ruminant production. There were also gains made in fishery production, and

the artisanal fisheries outperformed the aquaculture enterprises. It is difficult to

attribute productivity gains solely to project interventions. Other programmes32 are

supporting agriculture, irrigation schemes, and improved techniques in some states

in the region, like Imo state. Regardless, states still experienced increased

productivity in major crops, which made an impact at both the individual and

community levels. In terms of food security and nutrition, the analysis of RIMS

data in 2015 and the impact study revealed that households in both participating

and non-participating groups had at least three meals a day.33 The quantities of

rice, garri/fufu, beans, and plantains households consumed each week increased

over the course of the programme. The nutritional value of meals also improved as

people began to consume more eggs, milk, vegetables, and fruits. These results

were possible by an increase in household income, as explained below.

35. Income. As mentioned in the household asset section, household net income

increased as a result of increased participation in agricultural enterprise and

increased crop productivity. It is estimated that the net income of the enterprises

was NGN 303,227, higher than the national minimum wage (216,000) per annum

and 62 per cent of rural households reported an increase of income by 75 per cent.

As stated in the efficiency section, a high Benefit Cost Ratio in all enterprises

corroborates that businesses profits increased in target areas which translated into

higher income for groups of the population. The CPE reported that 88 per cent of

beneficiary households increased their income by 60 per cent (against a target of

half of beneficiaries increasing incomes by a quarter). In general, even though

making a quantified estimate of income change is difficult because of the quality of

the empirical evidence, the PCRV holds that the community-led interventions,

which were concentrated in selected communities over ten years, resulted in

income growth for beneficiaries.

31

Beneficiaries had a higher Asset Index Factor, equal to 2.4 at completion, compared with non-beneficiaries’ index (0.8), Impact Survey. 32

World Bank FADAMA, Federal Government of Nigeria, Agricultural Transformation Agenda Growth Enhancement Support Programme. 33

In 2007, 35.5 per cent of population in the Niger Delta region had less than three meals a day (National Statistics).

10

36. Human capital, social capital, and empowerment. The re-design of the CDD

approach allowed for a stronger focus on youth empowerment. The different forms

of agri-business (poultry, fishing, bee-keeping) attracted poor youth and women to

agri-business. The young people and women who participated in agri-business

increased their income as well as their confidence by participating in groups. Other

social benefits of the programme included a reduction in youth migration because

of increased employment and a decrease in the trafficking of young women, but

these impacts were not supported by strong evidence. Economic empowerment

impacts were measured through job creation for poor household members. It is

reported in the PCR and verified in supervision missions that the number of jobs

created was approximately 68,000, equal to 65 per cent of the target. Most of

these jobs were for youth (54 per cent) and women (45 per cent).

37. Institutions and policies. Strengthening institutions (including CADA and the

Youth in Agriculture Foundation, service providers, and the local government) was

among the intended outcomes of Component 1 and, as reported in the

effectiveness section, was satisfactorily achieved. The CDD approach improved

rural governance by successfully establishing a community-based development

mechanism at the village-level. The programme was able to help institute the

democratic election of local leaders,34 and encourage transparent accounting and

procurement processes. In terms of linkages and policies, as stated above under

Component 1, apart from links with initiatives like Songhai, USAID/Markets, and a

non-governmental organization called the Smallholder Foundation, no other

significant links were made. At the policy level, in Kuruma River State, community

members now have the legal right to fish and are legally obligated to fish

responsibly, with guidelines following the Food and Agriculture Organisation

recommendations for responsible fisheries. Nevertheless the programme under-

performed in terms of promoting pro-poor legislations and regulations.

38. In summary, the programme’s contribution to decreasing poverty was moderately

satisfactory, 4, the same rating assigned by the PMD. However, despite positive

results in terms of asset ownership, productivity, and income, the overall impact on

poverty reduction needs to take into account measurement errors and attribution

challenges.

Sustainability of benefits

39. Institutional sustainability and ownership. The MTR and supervision missions

indicate inadequate local government commitment. This low level of general LGC

commitment, including by their chairpersons, decreased the effectiveness of the

programme in the first years. Committees were formed within LGCs, but they were

non-functional and had no annual budget. Therefore programmes activities were

not internalised at the LGC level and within the Directorate of Agriculture and

Fisheries. The PCR states that an exit strategy that would distribute functions to

partner institutions was never developed. At the time of the project closure,

discussions were ongoing regarding the establishment of an Agriculture Enterprise

Development Support Unit (AEDSU) in NDCC, to continue the work on agri-

business development and to act as a structure to strategically uptake the CBNRMP

model. This unit, which is hosted in the Agriculture and Fishery Directorate, is

currently liaising with other agencies and the Federal Government of Nigeria to

ensure the continuation of the model. As noted in the relevance section, the

continuous changes and re-direction of the programme after the MTR reduced the

time that programme actors had to effectively implement activities and negatively

affected local institutions’ progress towards independence. At the community level,

the majority of CADAs and the Youth in Agriculture Foundation are sustainable

arrangements that are actively engaged in implementation, maintaining assets,

supporting enterprises groups and are, in turn, strongly supported by communities.

34

See Gender section for more details in female participation in leadership positions.

11

However, the 2015 supervision mission suggested a need for further capacity

building assistance and LGCs engagement in promoting CADA ownership by local

governments.

40. Economic, financial and technical sustainability. The programme promoted

the creation of a large number of enterprises. The enterprises categorized as

“strong” were self-sustainable and started offering mentorship and training to other

business owners. The model adopted by the programme had elements of

sustainability: the focus on high-value enterprises with potential for quick returns

for youth, incubation and mentorship of young businesses by leading

entrepreneurs, and individual ownership of enterprises. Other features of the

commodity groups and enterprises also contributed to their sustainability: record

keeping, analysis of financial viability, operational guides for the preparation of the

Community Action Plans and, most importantly, the functional linkages established

with other programmes meant to guarantee the continuation of support beyond the

CBNRMP.

41. The infrastructures established by the programme were functional and maintained

by communities and local authorities. Handover to the LGCs was completed, but

the latest supervision mission in 2015 reported that a proper business plan was not

yet in place. About 31 projects were still not completed and the NDDC was

supposed to finance their completion.

42. In summary, despite low LGC commitment and the uncertainty regarding the exit

strategy of the programme, the enterprise model was sustainable. Therefore the

sustainability of CBNRMP is rated by the PCRV as moderately satisfactory, 4.

This rating is equal to the rating assigned by PMD.

B. Other Criteria

Innovation

43. The most innovative idea introduced by the programme was its enterprise models.

In particular, the incubator/cluster delivery model35 was piloted by the CBNRMP in

the country and it led to employment creation and high youth engagement.

44. The use of CADAs marked a departure from the traditional CDD process and

reinforced the programme’s focus on enterprise development by commodity

groups. CADAs also helped institutionalize a participatory decision making process

in the communities. It is expected that CADAs will coordinate and supervise agro-

enterprises and commodity groups. CADAs are also expected to serve as an entry

point for other development partners and government into the community.

45. Another innovation introduced by the programme was the establishment of the

Youth in Agriculture Foundation. This rural coordination platform for agri-

enterprises facilitates policy dialogue with government and other development

partners. This forum, which at the time of programme’s closure had 880 members

(enterprises champions), successfully contributed to regional job creation and

youth poverty reduction. This innovation deliberately addressed youth crime and

unemployment in the Delta.

46. In recognition of these achievements, the PCRV considers the programme

satisfactory, 5, the same rating assigned by PMD to this criterion.

Scaling up

47. In terms of successful replication and scaling up of innovations introduced by

CBNRMP, the evidence is mixed. The PCR states that the modified CDD approach,

through the establishment of CADAs, is already being applied in the Value Chain

35

In this model, “champions” acted as mentors in each state and clustered unemployed youth as apprentices who would gain hands-on practical training on enterprise identification, planning, budgeting and management. The enterprises also received initial recovery seed capital to run their businesses. The net profits were then divided between the champions and the apprentices.

12

Development Programme and will be expanded in CASP programme’s areas.

Meanwhile, there is not much evidence of CADAs being replicated outside of IFAD

project areas. NDCC was invited to continue funding for two-three years from

2016, but no firm response has been given. At the time of the PCRV finalization,

the commission had carried out a stock-taking exercise and was awaiting national

budget by the parliament to continue with the follow-up of CADA and their

enterprises.

48. The Youth in Agriculture Foundation model was quite successful and is gaining

acceptance by other donors like the African Development Bank, who included it as

a youth empowerment strategy in its upcoming ENABLE Programme for Nigeria.

49. Overall, as affirmed by the 2016 Nigeria CPE, with the exception of the Youth in

Agriculture Foundation model, the project's success in promoting replication of

innovations was limited given the uncertainty regarding scaling up of the CADAs36.

The PCRV rates the scaling-up criterion as moderately unsatisfactory, 3, two

points below the PMD rating of Satisfactory.

Gender equality and women’s empowerment

50. CBNRMP was approved before IFAD gender policies were put into effect but since

the early 2000 the Government of Nigeria had shown commitment towards gender

equality37.The CBNRMP gender strategy38 aims at fostering female participation

through a gender-sensitive approach to community development and set quota for

women’s participation (40 per cent).

51. The programme benefitted a total of 291,435 households. 41 per cent of

individuals reached by the programme were female, close to the appraisal target of

42 per cent. 53 per cent of people participating in marketing groups were women,

50 per cent of people trained in income generating activities were women, and 45

per cent of voluntary savers were women39. The survey data shows that male

beneficiaries benefitted more from activities focused on the farm input

procurement process, keeping of farm records, savings strategies, conflict

resolution and management, and community participation activities. Female

beneficiaries benefitted more from linkages with non-governmental organizations,

market outlets, and enterprise management activities. The number of women in

leadership positions was below the target, suggesting that actions fostering social

change for women had less impact than envisioned.

52. Ascertaining female attendance rates from the gender disaggregated M&E data was

simple, but measuring female empowerment and gender equality is significantly

more difficult. The PCR states that the programme successfully increased gender

equality by including women in leadership positions, changing meeting venues to

outside the villages to allow them to speak freely, and establishing the YIAF. There

is, however, scant evidence of increase in terms of equality. The impact survey

reports that, although men still made more decisions, female decision-making

power was improved. However, there was no significant difference in female

income or output. No data was gathered to measure whether the female workload

increased due to their participation in programme activities, and the CPE

consultations with female beneficiaries reported that gender roles remained

unchanged. Therefore it seems that pre-programme inequalities were not impacted

much.

36

With regards to replication, the newly established AEDSU in the Directorate of Agriculture and Fisheries would be mandated to promote the up-scaling and replication of successful agricultural enterprises within and outside the participating communities. The AEDSU is not yet operational. 37

The National Policy on Women (2000) specifies the overriding principles that underpin the Government of Nigeria's commitment to equality of women and men before the law (CPE 2016). 38

Gender sensitive CDD approach integrated nine gender and poor-specific strategic interventions into programme components (capacity building, gender analysis and mainstreaming in CDD design, direct targeting, self-targeting, and gender-sensitive M&E); proportional quotas (40 per cent women beneficiaries) decided through stakeholder agreement (CPE 2016). 39

RIMS 2015.

13

53. Gender equality, mainstreaming, and women’s empowerment performance is

assessed as moderately satisfactory, 4 which is below the rating given to this

criterion by the PMD (5, satisfactory).

Environment and natural resources management

54. An Environmental Management Plan was included in the formulation document of

CBNRMP and indicates the major areas in which the programme could have had an

environmental impact. Possible negative impacts include disproportionate artisanal

fishing, damages to protected areas, deforestation, pollution from effluents and

from oil, land clearing and soil erosion, water pollution, and negative impact on

human health. The Environmental Management Plan also presents mitigation

measures.40 The environmental management plan was not reflected in the project's

implementation plan, nor was it systematically discussed in the progress reports.

No proper assessment of the impact of the programme on the environment was

done at the time of project completion.

55. The programme successfully promoted aquaculture and fishery enterprises and

infrastructure, but little attention was paid to the importance of protecting natural

resources or avoiding over fishing.41 LGCs did not pass as much pro-poor LGC

legislation and regulation on environmental protection42 as it was expected when

programme targets were set (only 60 per cent of the target policies were adopted).

Only 24 per cent of the land targeted for sustainable management was actually put

under sustainable management over the course of the programme (including

soil/water conservation and agro-forestry).

56. Based on the observations above, the PCRV assigns to the environmental

management criterion a rating of moderately unsatisfactory, 3, the same rating

assigned by PMD.

Adaptation to climate change

57. As stated above, the absence of an Environmental Impact Assessment during

implementation or at completion makes it difficult to comprehensively assess

whether the programme demonstrated environmental and climate-related risk

awareness. The Delta Region is characterized by high rainfall and river discharge

during rainy season combined with the low flat terrain and poorly drained soils

which make it particularly vulnerable to flooding and erosion. Deforestation due to

converting forest to agricultural land increases carbon emissions and in the case of

mangroves, has affected fish breeding. However, supervision reports, the MTR and

the PCR do not mention any specific measures aimed at lowering the risks posed

by the consequences of climatic changes. The PCRV assigns to this criterion a

rating of moderately unsatisfactory, 3, the same as the PMD rating.

C. Overall project achievement

58. The CBNRMP-ND made a moderate contribution to overall poverty reduction in the

Niger Delta Region. Sustainability, efficiency, environment, and climate change

were assessed as moderately unsatisfactory. Other criteria received a rating of 4.

Effectiveness and efficiency were reduced by the uncertainty surrounding

counterpart funding and the turbulence caused the re-design, both of which

affected output delivery. Targeting was a challenge because of the weak

disaggregated poverty statistics, but outreach was good, including for women and

youth. Notable successes of the programme were the use of the CDD model, the

40 The programme design was also based on an Environmental Impact Assessment of the Artisanal Fisheries Development Project – finalised in March 2002, and IFAD’s input to the Poverty and Environment Strategy for Nigeria in September 2001. 41

Large swamps, mangrove, rivers and waterways were cleared and converted to aquaculture enterprises without environmental impact assessment. For this reason, the physical performance of the Natural Resources Management subcomponent is rated moderately unsatisfactory. 42

These include: sanitation, waste management, erosion/flood and coastal zone management, plant, soil and water conservation.

14

introduction of innovative enterprise models, and strong youth engagement.

Inefficiencies in fund disbursement, poor documentation of lessons, and little focus

on sustainability during design and implementation made it difficult for the

programme to be successful in attaining its objectives. The PCRV assigns to the

overall programme achievement criterion a rating of 4, moderately satisfactory,

the same rating assigned by PMD.

D. Performance of partners

59. IFAD. IFAD’s overall performance in CBNRMP was good. IFAD took over the direct

supervision of the programme from the World Bank in June 2009. IFAD supervision

reports are of good quality; supervision missions were held twice a year since the

programme began43 and, according to the 2016 CPE the enhanced country

presence since 2008 improved programme quality. IFAD’s MTR introduced major

modifications which improved achievement of results. However, IFAD took more

than three years to process the loan agreement amendment needed to increment

the IFAD contribution, to reduce the contribution of LGCs44 and to re-adjust the

design. This negatively affected programme implementation, as stated above. In

terms of monitoring, IFAD gave sufficient support to setting up the baseline

(2006/2007), impact (2015), and thematic studies (2015). Although the M&E data

collection structure was well conceived, its operationalization and, in particular, the

use of self-monitoring community-based teams rather than fully automated

databases, increased the margin for human error and called the integrity of the

monitoring system into question, despite the introduction in 2013 of the

Performance Monitoring Plan45. IFAD’s overall performance in CBNRMP is rated as

moderately satisfactory, 4, the same rating as the one assigned by PMD.

60. Government. The Federal Government of Nigeria, through its main ministries,

FMF and FMARD, showed commitment to providing oversight during programme

implementation. The Federal Government of Nigeria was less reliable when it came

to financial management and disbursement. Although the FMF disbursed

approximately 83 per cent of the allocated budget (US$10,400,000), delays in

processing the amendment of the financing agreement caused problems during

implementation. FMARD performed well, and did especially well to establish the

Emergency Task Force to bring the programme out of risk. However, two

shortcomings in the Federal Government of Nigeria's performance were the

scrapping of the Project Coordination Unit, which was supposed to act as broker

between the state governments and NDDC and, secondly, the failure to establish a

Programme Management Coordination Group, which would have reviewed PSO

activities and kept the NDDC informed.

61. NDDC. The Niger Delta Development Commission’s mandate was to supervise

CBNRMP activities and finance the programme’s operation. The NDDC was able to

release more than 100 per cent of allocated funds and participated in the various

sensitization and awareness creation meetings, but some concerns remain about

its limited understanding of the CDD approach and limited capacity to internalize

youth and enterprise development strategies.

62. State Governments. The various states governments performed unevenly in

terms of disbursement as well as commitment and support to implementation.46

43

IFAD supervision missions were carried out in: January 2007; June 2007; January 2008; June 2008; January 2009; May 2009; November 2010; July 2011; July 2012; June 2013; November 2013; April 2014; October 2014; October 2015. 44

IFAD contribution was increased from 22.5 per cent to 62.5 per cent and LGCs contribution was decreased from 45 per cent to 5 per cent to support only the overhead and operational costs of LGC staff. 45

The Performance Monitoring Plan implied the use by farmers of simplified templates and farm record books to generate primary data which were routinely collated and transmitted to PSO by the SPSO staff. 46

The PCR reports that disbursements ranged from a low of 33 per cent in Akwa Ibon State to highs of 73 per cent and 63 per cent in Ondo State and Cross River, respectively. However, as reported in the Supervision Mission report in 2015, only three of the nine participating states (Abia, Cross Rivers and Rivers) paid arrears of counterpart funds during the 2014 review period.

15

The PCR reported a 94 per cent disbursement rate for state governments at

completion, but this seems unrealistic. Unavailability and delays of counterpart

disbursements have been the main reasons for slow completion of infrastructure

schemes and also affected the drawdown of IFAD funds.

63. Local Government Councils’ financial contributions have been poor. Only 13 per

cent of the planned funds for programming were released due to lack of financial

autonomy and political will. The institutions established by participating LGCs such

as the Local Government Development Committee, the Community Driven

Development Team, and the Local Government Technical Support Team, remained

un-functioning due to lack of funds.

64. State Governments’ financial under-performance (and fluctuations throughout the

programme’s life) demonstrates that agriculture was not a high priority on their

development agenda. Urban and industrial development is higher on the agenda in

this region. Given the under-achievement in disbursement, which caused non-

attainment of targets in some activities, the PCRV rates Government performance

as moderately unsatisfactory, 3. This rating is the same as the rating assigned

by PMD.

IV. Assessment of PCR quality 65. Scope. The PCR follows the standard outline for PCRs. All sections and annexes are

included and are of an appropriate length.47 RIMS data for 2014 is included, but

RIMS data for 2015 is not. No Environmental Impact Assessment is included. Most

of the sections are overly descriptive, especially the Innovation and Lessons

Learned Sections. Despite these minor shortcomings, the PCR scope is rated

satisfactory, 5.

66. Quality of data and process. The process of PCR preparation was satisfactory,

including review missions along with validation of findings with participation of the

main stakeholders. The PCR used a variety of data sources, including programme

progress reports compiled by the PSO, thematic studies, RIMS surveys, an impact

assessment survey, and stakeholders consultations’ findings. Participatory methods

of data gathering were also adopted and reflected in the PCR. However, the

reliability of data remains questionable. Instead of reporting tables showing the

physical progress of output delivery, Annex 8 reports a long list of charts that are

not easily understood.

67. Financial information reporting in the PCR is not always clear, especially with

regards to the loan amendments and disbursements of various partners, as

addressed in the efficiency section of this report. The PCRV noted a discrepancy in

the rating assigned to Gender between the PCR where this criterion was rated

moderately satisfactory and the annexed table, where the same criterion was rated

Satisfactory. The PCR quality is rated moderately satisfactory, 4.

68. Lessons learned. The PCR presents design and implementation information on

activities and processes that benefitted the project, and the PCRV concurs with its

statements. At the end of the document, the PCR highlights areas that should be

improved in future projects and IFAD programmes. The PCRV therefore rates the

lessons section of the PCR as satisfactory, 5.

69. Candour. The PCR provides information on project achievements with sufficient

evidence. PMD’s views on the replicability and sustainability of project activities are

also reported and substantiated. In certain instances, the PCRV finds that

assessments made in the PCR are overly positive and optimistic. There is

significantly less candour in the document’s discussion of programme weaknesses.

The PCR is assigned a candour rating of moderately satisfactory, 4.

47

The Targeting and Outreach sub-section in the Effectiveness section is missing a heading.

16

V. Lessons learned 70. The targeting approach used in the CBNRMP, which translated into a few

communities targeted in each Local Government Area, was among the causes of

the low interest and commitment by the LGCs. In terms of financing, IFAD and

beneficiaries should be financing activities, while the government and state

counterparts should only cover staff overhead and taxes, utilities, and operations

costs. Direct engagement of partners through inception meetings/start up

workshops is important to increasing counterpart buy-in, and thus enhancing

programme effectiveness.

71. An important lesson of the CBNRMP is the importance of documenting the

knowledge generated during the implementation. The lack of a Knowledge

Management Strategy affected the effective implementation of the programme.

72. A key success of the programme was the establishment of CADAs. In general, the

adaptation of the CDD approach to agro-business development and the

institutionalization of the CADAs as umbrella associations yielded positive results.

The programme highlights the adaptive nature of the CDD model as well as its

effectiveness in economically empowering rural communities.

73. Lastly, it is important to mention that in the CBNRMP the partnership with NDDC

was new: while this partner was seen at design as appropriate for IFAD’s work in

the Niger Delta, because of its role as supporting all development activities in the

region, this is an unusual partner for IFAD, given that its focus is on large

infrastructure investments and has little experience and weak capacity on CDD and

on smallholder agriculture. Moreover, lack of transparency and financial

mismanagement seem to have characterized the performance of NDDC and this

poses some concerns about its suitability as an IFAD partner in the long run.

Annex I

17

Project Financing

The table below is a comparison of appraisal allocations and actual disbursements per

financier. The PCR amounts are reported in column (2). Disbursements as per

Supervision Mission in 2015 and the data reported for CBNRMP in the CPE are also

reported for comparison purposes.

Table 1: Project costs (USD, 000)

Appraisal allocation

(1)

% of total Actual Disbursement

PCR

(2)

% of total Actual Disbursement

(SM May 2015)

Actual Disbursement (CPE 2016)

1

% Disbursed

(2/1)

IFAD loan 15,000 17.6 16,794 30.4 13,110 16, 471 112 %

NDCC (grant) 15,000 17.6 15,488 28 15,0002 9, 637

3 103 %

FNG (PSO counterpart)

10,200 12 8,442 15 8,288 6,636 83 %

States (State counterpart)

8,200 9.6 7,736 14 4,136 2, 078 94 %

LGCs 32,000 37.7 4,250 7.6 5,139 4,740 13 %

Beneficiaries 4,400 5 2,494 4.5 61 %

84,800 55,204 46,129 39, 563 65%

Source: PCR, Supervision Mission Report 2015, Country Programme Evaluation (CPE), 2016.

1 Data received from Programme Officers.

2 This refers to the eight-year funding. Additional 455.4 are reported for NDDC in the two-year extension allocation.

3 This figure is reported under “Others” in the CPE table.

Annex II

18

Definition and rating of the evaluation criteria used by IOE

Criteria Definition * Mandatory To be rated

Rural poverty impact Impact is defined as the changes that have occurred or are expected to occur in the lives of the rural poor (whether positive or negative, direct or indirect, intended or unintended) as a result of development interventions.

X Yes

Four impact domains

Household income and net assets: Household income provides a means

of assessing the flow of economic benefits accruing to an individual or group, whereas assets relate to a stock of accumulated items of economic value. The analysis must include an assessment of trends in equality over time.

No

Human and social capital and empowerment: Human and social capital

and empowerment include an assessment of the changes that have occurred in the empowerment of individuals, the quality of grass-roots organizations and institutions, the poor’s individual and collective capacity, and in particular, the extent to which specific groups such as youth are included or excluded from the development process.

No

Food security and agricultural productivity: Changes in food security

relate to availability, stability, affordability and access to food and stability of access, whereas changes in agricultural productivity are measured in terms of yields; nutrition relates to the nutritional value of food and child malnutrition.

No

Institutions and policies: The criterion relating to institutions and policies

is designed to assess changes in the quality and performance of institutions, policies and the regulatory framework that influence the lives of the poor.

No

Project performance Project performance is an average of the ratings for relevance, effectiveness, efficiency and sustainability of benefits. X Yes

Relevance The extent to which the objectives of a development intervention are consistent with beneficiaries’ requirements, country needs, institutional priorities and partner and donor policies. It also entails an assessment of project design and coherence in achieving its objectives. An assessment should also be made of whether objectives and design address inequality, for example, by assessing the relevance of targeting strategies adopted.

X Yes

Effectiveness The extent to which the development intervention’s objectives were achieved, or are expected to be achieved, taking into account their relative importance.

X

Yes

Efficiency

Sustainability of benefits

A measure of how economically resources/inputs (funds, expertise, time, etc.) are converted into results.

The likely continuation of net benefits from a development intervention beyond the phase of external funding support. It also includes an assessment of the likelihood that actual and anticipated results will be resilient to risks beyond the project’s life.

X

X

Yes

Yes

Other performance criteria

Gender equality and women’s empowerment

Innovation and scaling up

The extent to which IFAD interventions have contributed to better gender equality and women’s empowerment, for example, in terms of women’s access to and ownership of assets, resources and services; participation in decision making; work load balance and impact on women’s incomes, nutrition and livelihoods.

The extent to which IFAD development interventions:

(i) have introduced innovative approaches to rural poverty reduction; and (ii) have been (or are likely to be) scaled up by government authorities, donor organizations, the private sector and others agencies.

X

X

Yes

Yes

Environment and natural resources management

The extent to which IFAD development interventions contribute to resilient livelihoods and ecosystems. The focus is on the use and management of the natural environment, including natural resources defined as raw materials used for socio-economic and cultural purposes, and ecosystems and biodiversity - with the goods and services they provide.

X Yes

Adaptation to climate change

The contribution of the project to reducing the negative impacts of climate change through dedicated adaptation or risk reduction measures X Yes

Annex II

19

Criteria Definition * Mandatory To be rated

Overall project achievement

This provides an overarching assessment of the intervention, drawing upon the analysis and ratings for rural poverty impact, relevance, effectiveness, efficiency, sustainability of benefits, gender equality and women’s empowerment, innovation and scaling up, as well as environment and natural resources management, and adaptation to climate change.

X Yes

Performance of partners

IFAD

Government

This criterion assesses the contribution of partners to project design, execution, monitoring and reporting, supervision and implementation support, and evaluation. The performance of each partner will be assessed on an individual basis with a view to the partner’s expected role and responsibility in the project life cycle.

X

X

Yes

Yes

* These definitions build on the Organisation for Economic Co-operation and Development/Development Assistance Committee (OECD/DAC) Glossary of Key Terms in Evaluation and Results-Based Management; the Methodological Framework for Project Evaluation agreed with the Evaluation Committee in September 2003; the first edition of the Evaluation Manual discussed with the Evaluation Committee in December 2008; and further discussions with the Evaluation Committee in November 2010 on IOE’s evaluation criteria and key questions.

Annex III

20

Rating comparisona

Criteria

Programme Management Department (PMD) rating

IOE Project Completion Report Validation (PCRV) rating

Net rating disconnect (PCRV-PMD)

Rural poverty impact 4 4 0

Project performance

Relevance 5 4 -1

Effectiveness 4 4 0

Efficiency 3 3 0

Sustainability of benefits 4 4 0

Project performanceb 4 3.75 -0.25

Other performance criteria

Gender equality and women's empowerment 5 4 -1

Innovation 5 5 0

Scaling up 5 3 -2

Environment and natural resources management 3 3 0

Adaptation to climate change 3 3 0

Overall project achievementc 4 4 0

Performance of partnersd

IFAD 4 4 0

Government 3 3 0

Average net disconnect -4/12 = -0.33

a Rating scale: 1 = highly unsatisfactory; 2 = unsatisfactory; 3 = moderately unsatisfactory; 4 = moderately satisfactory; 5 =

satisfactory; 6 = highly satisfactory; n.p. = not provided; n.a. = not applicable. b Arithmetic average of ratings for relevance, effectiveness, efficiency and sustainability of benefits. c This is not an average of ratings of individual evaluation criteria but an overarching assessment of the project, drawing upon

the rating for relevance, effectiveness, efficiency, sustainability of benefits, rural poverty impact, gender, innovation and scaling up, environment and natural resources management, and adaptation to climate change. d The rating for partners’ performance is not a component of the overall project achievement rating.

Ratings of the project completion report quality

PMD rating IOE PCRV rating Net disconnect

Candour 4

Lessons 5

Quality (methods, data, participatory process) 4

Scope 5

Overall rating of the project completion report 4

Rating scale: 1 = highly unsatisfactory; 2 = unsatisfactory; 3 = moderately unsatisfactory; 4 = moderately satisfactory; 5 = satisfactory; 6 = highly satisfactory; n.p. = not provided; n.a. = not applicable

Annex IV

21

Bibliography

International Fund for Agricultural Development (IFAD). 2002. Community Based Natural

Resources Management Programme in the Niger Delta (CBNRMP-ND) - Formulation

Report, Rome: IFAD.

____. 2002. CBNRMP-ND - Appraisal Report, Rome: IFAD.

____. 2002. CBNRMP-ND - Report and recommendation of the President, Rome: IFAD

____. 2006. Guidelines for Project Completion, Programme Management Department,

Rome: IFAD.

____. 2010. Country Strategic Opportunities Programme, Rome: IFAD.

____. 2010. CBNRMP-ND - Supervision mission report (Nov 2010).

____. 2012. CBNRMP-ND - Supervision mission report (Aug 2011).

____. 2012. CBNRMP-ND - Supervision mission report (July 2014).

____. 2014. CBNRMP-ND - Supervision mission report (May 2014).

____. 2014. CBNRMP-ND - Supervision mission report (Nov 2014).

____. 2014. CBNRMP-ND - Annual RIMS Report, Rome: IFAD.

____. 2014. CBNRMP-ND - Annual RIMS Report, Rome: IFAD.

____. 2015. CBNRMP-ND - Annual RIMS Report, Rome: IFAD.

____. 2015. CBNRMP-ND - Supervision mission report (May 2015).

____. 2015. Evaluation Manual, Second Edition, Independent Office of Evaluation, Rome:

IFAD.

____. 2016. CBNRMP-ND, Project Completion Report, Rome: IFAD.

____. 2016. Country Programme Evaluation, Nigeria, Rome: IFAD.

IFAD and Niger Delta Development Commission. 2010. CBNRMP-ND - Mid Term Review.

Programme Support Office. Federal Ministry of Agriculture and Rural Development-

FMARD. 2014. A Beneficiary Impact Assessment Study of the IFAD-Assisted

Community-Based Natural Resource Management Programme – Niger Delta

(CBNRMP-ND).

Annex V

22

Abbreviations and acronyms

AEDSU Agricultural Enterprise Development Support Unit

CADA Commodity apex development association

CBNRMP-ND Community Based Natural Resource Management Programme, Niger

Delta CDD Community driven development

CDF Community Development Fund

COSOP Country strategic opportunities paper

CPB Cost per beneficiary

CPE Country programme evaluation

EIRR Economic Internal Rate of Return

FMARD Federal Ministry of Agriculture and Rural Development

FMF Federal Ministry of Finance

IFAD International Fund for Agricultural Development

IRR Internal rate of return

LGC LGC local government council

M&E Monitoring and Evaluation

MTR Mid-term review

NDDC Niger Delta Development Commission

PCR Project completion report

PMD Programme Management Department

PSO Programme Support Office

RIMS Results and Impact Management System

YEAP Youth Empowerment in Agriculture Programme