Evaluation of the Integrated Shelter and Protection ...

1

EvaluationoftheIntegratedShelterandProtectionImprovementsProgrammeforSyrianRefugeesandHostCommunitiesinTripoli,Lebanon

ElizabethParkerandVictoriaMaynard

26thOctober2018Acknowledgements

Firstly,wewouldliketothanktheindividualswhovolunteeredtheirtimetobeinterviewed,attendfocusgroupsandallowusintotheirhomes.Thankyouforcandidlysharingyourexperiences,thoughtsandreflections–wehopeyoufindthemrepresentedaccuratelyinthisreport.TheauthorsarealsoindebtedtoCAREInternationalinLebanonandtheirpartnerorganizationAkkarounawhoallowedustheopportunitytodocumentandsharetheirvaluablework.InparticularthanksgotoDanielDelati,AzzaAdra,TokaElKhodrandalltheteamfortheirsupportinundertakingtheresearch;inparticularAngieFarahandDaoudNakhoulfortheirhelpwiththefieldworkcoordination.Finally,ourthanksareofferedtoCAREInternationalUKforcoordinatingthisevaluation,providingfeedbackandhelpingtorefinetheconclusions.AbouttheauthorsElizabethParker’sworkhasfocusedonurbanresilience,disasterrecoveryandregenerationacrossarangeofgeographiessincecompletingherMAinDevelopmentandEmergencypracticeatOxfordBrookesUniversity.Originallytrainedasanarchitect,ElizabethspentfiveyearsworkingforArup,includingontheRockefellerFoundationfundedAsianCitiesClimateChangeResilienceNetwork(ACCCRN).Sheisanestablishedresearcherandevaluatorhaspublishedarangeofdocumentsonshelterself-recovery(SystematicReview),urbanplanningandcityresilience.VictoriaMaynardtrainedasanarchitectandhasworkedfororganizationssuchasUN-HabitatandtheIFRCsincebecominginvolvedinpost-disasterreconstructionfollowingtheIndianOceantsunami.SheiscurrentlycompletingaPhDatUniversityCollegeLondon,inpartnershipwithHabitatforHumanity,whereherresearchfocusesondecision-makingbythePhilippinegovernmentandhumanitarianorganizationsfollowingtyphoonHaiyaninthePhilippinesin2013.KeywordsUrban,refugees,Lebanon,Tripoli,Syria,area-basedapproach,neighborhood-basedapproach,multi-sectoral,cities,shelter,protection,humanitarian,displaced.

2

TableofContents

TableofContents...............................................................................................................2ExecutiveSummary...........................................................................................................4Lebanon,Tripoliandtheintegratedshelterandprotectionimprovementsprogramme..4Findings:PhaseIIIAssessment.....................................................................................................................4Findings:TheoryofChange...........................................................................................................................6Recommendationsforpolicy,practiceandfurtherresearch..........................................................7

1.0 Introduction............................................................................................................111.1Background:TheSyriancivilwarandLebanon.........................................................................111.2Intervention:IntegratedShelterandProtectionImprovementsprogramme...............111.3Context:Tripolianditsneighborhoods..........................................................................................122.0Methodology.............................................................................................................152.1Aimsandobjectives.................................................................................................................................152.2Evaluationapproach...............................................................................................................................152.3Researchmethods....................................................................................................................................172.4Limitations..................................................................................................................................................173.0Findings:PhaseIIIAssessment...................................................................................193.1Activitiesandtargetsrelatedtoobjective1:ShelterandWASH.........................................19Rehabilitation(Upgrade)ofindividualhousingunits....................................................................19Neighborhoodupgradestobuildingsandstreets.............................................................................20NeighborhoodCommittees..........................................................................................................................21

3.2Activitiesandtargetsrelatedtoobjective2:Protection.........................................................22PsychosocialSupportandPositiveParentingsessions...................................................................23InteractiveTheatre.........................................................................................................................................24Committeemeetingswithotherstakeholders....................................................................................24Referralstootherstakeholders.................................................................................................................24

3.3Discussion....................................................................................................................................................26Relevance:towhatextentweretheactivitiessuitedtotheprioritiesofthetargetgroup?.................................................................................................................................................................................26Accountability:howwastheprogrammeaccountabletothebeneficiaries?.......................27Effectiveness:towhatextentweretheprogramobjectivesachieved?....................................28Impact:whatwerethemainimpactsandeffectsoftheprogramme?....................................29

4.0Findings:ContributionAnalysis..................................................................................334.1Theoryofchange......................................................................................................................................334.2Programmeoutcomes............................................................................................................................371.Increasingaccesstoinfrastructure....................................................................................................372.Increasingtheknowledgeoftheresidents......................................................................................383.Improvingthehealthoftheresidents...............................................................................................384.Increasingthecommunitycohesion...................................................................................................405.Increasingtheconnectivitybetweenresidentsandexternalstakeholders......................41

4.3Enablingfactorsandchallenges.........................................................................................................42Objective1:Housingupgrades,communalupgradeprojectsandcommittees...................42Objective2:Protection..................................................................................................................................45Programmewide.............................................................................................................................................47

4.4Sustainability..............................................................................................................................................505.0Conclusionsandrecommendations............................................................................555.1Conclusionsfromthisevaluation......................................................................................................55PhaseIIIAssessment......................................................................................................................................55TheoryofChange.............................................................................................................................................56

3

5.2Recommendationsforpractice.........................................................................................................57Objective1(Housingupgrades,communalupgradeprojectsandcommittees).................57Objective2(Protection)...............................................................................................................................58Programmewide.............................................................................................................................................58

5.3Recommendationsforpolicyandfurtherresearch..................................................................58Acronyms........................................................................................................................60References.......................................................................................................................61ReportAnnexes...............................................................................................................64AnnexA:PhaseIIIIndicators......................................................................................................................64AnnexB:PhotosofCommunalStreetandBuildingUpgrades.....................................................65

4

ExecutiveSummary

Lebanon,TripoliandtheintegratedshelterandprotectionimprovementsprogrammeTheconflictinSyriahasdisplacednearlyhalfofthecountry’spopulation,withmorethan6.5millionpeopleinternallydisplacedand4.8millionbecomingrefugees.Relativetoitspopulation,LebanonhastakeninthelargestnumberofSyrianrefugees:itisestimatedthatthecountryhostsover1.5millionrefugees,outofaLebanesepopulationofaroundfourmillion.Tripoli,Lebanon’ssecond-largestcity,facesmanyurbanchallenges:poverty,awaningeconomy,highlevelsofunemployment,ineffectivegovernance,weakinfrastructuresupportandpolitical-sectariandivides.Theday-to-daychallengesoftheLebanesepopulationinTripolihavebeenmadeworsebytheinfluxofanestimated72,000refugees(aboutaquarterofthecity’spopulation)whohavemovedtothehigh-density,poorerneighborhoods.Thishasexacerbatedexistingvulnerabilitiesandaddedpressuretotheprovisionofbasicurbanservices.Since2015,CareInternationalinLebanon(CIL)anditslocalpartnerAkkarouna,haveprovidedshelter,waterandsanitation,andprotectionassistancetovulnerableSyrianrefugeesandLebanesehostcommunitymembersinTripoliandBeirutaspartofitsIntegratedShelterandProtectionImprovementsprogrammeforSyrianRefugeesandHostCommunities(the‘programme’).Theprogrammeisongoing–withphaseIVcontinuingfromSeptember2018toSeptember2019–andisfundedbytheUSGovernment’sBureauofPopulation,Refugees,andMigration(PRM).Theaimofthisevaluationisto‘provideguidancetoCARELebanonanditspartnersinordertolearnfromexperiences,strengthencapacitiesandidentifyopportunitiesforincreasedintegrationofsectoralapproachesasapathwaytowardsgreatereffectivenessandsustainability’.Therearetwoobjectivestotheevaluation,firstlyanassessmentofPhaseIIIoftheprogramme(completedfromSeptember2017toAugust2018);secondlyacontributionanalysisevaluationofPhasesI,II,andIIIoftheprogramme(from2015to2018)inordertodevelopatheoryofchange.Fieldworktocollectprimarydata-interviews,focusgroupsanddirectobservation-wascarriedoutinSeptember2018.Thiswascombinedwithanextensiveliteraturereviewinordertotriangulatethedataandrefinethefindings.

Findings:PhaseIIIAssessmentPhaseIIItheprogrammewasimplementedintheurbanneighborhoodsofTripoli,namelyAbuSamra(ShokandShalfeh),MankoubinandWadiNahle,byCILandAkkarouna.ThePhaseIIIprogrammeexceededitstargetsrelatedtoobjective1(SyrianrefugeesandhostcommunityindividualshaveimprovedshelterandWASHconditionsinurbanTripoli)andobjective2(Syrianindividualsandhostcommunityindividualshaveenhancedknowledgeofandaccesstoprotectionservices)-seetablei.Intotal,morethan559housingunitswereupgraded,35communalconstructionprojectsdeliveredand20neighborhoodcommitteesestablished.Furthermore,6900individualsbenefittedfromattendingpsychosocialsupportsessions,positiveparenthoodsessionsoran‘informationsession’toexplainabouttheprogramme.

5

Tablei: PhaseII I Goal,Objectives,ActivitiesandTargetsGoal

ContributetobuildingresilienceoftheaffectedpopulationinTripolithroughtherehabilitationofshelters,promotionofsocialprotection,anddevelopmentofsocialcapital

Target AchievedObjective1 Syrianrefugeesandhostcommunity

individualshaveimprovedshelterandWASHconditionsinurbanTripoli.

2,750beneficiaries(20%female)(50%Syrian,50%host)

2,845beneficiaries(48%female)(50.5%Syrian,49.5%host)

Activity1.1 Rehabilitationofindividualhousingunits 550housingunits

559housingunits

Activity1.2 Upgradestobuildingsandstreets 33buildings 35communalprojectsActivity1.3 NeighborhoodCommittees 20committees

160committeemembers

20committees213committeemembers(194Female,19Male)

Objective2 Syrianindividualsandhostcommunityindividualshaveenhancedknowledgeofandaccesstoprotectionservices.

3,000or3,5001beneficiaries(50%Syrian,50%host)

6900beneficiaries

Activity2.1 Awareness-RaisingandPsycho-SocialSupport

Relevance:TheprogrammeishighlyrelevanttotheneighborhoodsthatCILandAkkarounaaretargetingandiswellalignedwithregionalandnationalplanstosupportLebanontocopewiththeinfluxofSyrianrefugees.Accountability:CILandAkkarounahaveinplaceanumberofmechanismstosupportprogrammeaccountabilitytoresidents,theseincludequarterlymonitoring,a‘hotline’numbertosharefeedback,suggestionsandcomplaintsandregularformalandinformalmeetingswithneighborhoodcommittees.Therearelimitationsintheuseofthehotlineforeffectiveaccountability.Effectiveness:Theprogrammehaslargelyachieveditsobjectives.Forobjective1,residentswhosepropertiesreceivedhousingupgradesreporthighlevelsofsatisfactionwiththequalityofthematerialsusedandtheconstructionwork(90%+).However,thisresearchrevealedthattheremaybealargernumberofitemsthatarenotfunctioningthaniscurrentlyreported,forexampleduetothelimitationsoftheuseofthehotline.Thenumberofhouseholdswithitemsthatarenotcorrectlyfittedorofappropriatequalitywillimpactontheextenttowhichtheprogrammeachievesobjective1.Forobjective2:Attendeestopositiveparentingsessionsdemonstrateincreasedknowledgeofprotectionneedsandrightsinpre-postmonitoringtests.CILandAkkarounamade68referralstospecialistprotectionservices,forexamplewhenhouseholdsrequiredadditionalsupportfordrugaddictionordomesticviolence.Thuswhilstthereisimprovedknowledge,thereisnoavailableevidencetosuggestimproveddirectaccesstoprotectionservices(e.g.primarilyindirectlyvia.CIL/Akkarouna).Impact:Thestatedgoaloftheprogrammeisto‘contributetobuildingresilienceoftheaffectedpopulationinTripolithroughtherehabilitationofshelters,promotionofsocialprotection,anddevelopmentofsocialcapital’.Thisisahighlyambitiousgoal,witha 1Therearevaryingtargetsintheprojectdocumentation.2SocialProtectionisdefinedasprogrammesorpoliciesrelatedtosocialinsurance,socialassistanceand/or

6

numberofcomplexcomponentsthatarenotdefinednordetailedintheprogrammedocumentation.Theevidencesuggeststhattheprogrammehasbuiltresilienceoftheaffectedpopulationthroughtherehabilitationofsheltersandthedevelopmentofsocialcapital,withthelatterprimarilyfocusedaroundthecommitteemembers.However,thereisnoevidencetosuggestthattherehavebeenactivitiesundertakenthatpromotesocialprotection2.

Findings:TheoryofChangeTheultimategoalistocontributetobuildingresilienceofvulnerableneighborhoodcommunities3inTripoli.TheIntegratedShelterandProtectionImprovementsprogrammeforSyrianRefugeesandHostCommunitiesinTripoli,Lebanoncontributestobuildingresilienceby:

• Increasingaccesstoinfrastructurethroughupgradinghousingunitsandimplementingneighborhoodbuildingandstreetupgrades

• Increasingtheknowledgeoftheresidentsaboutprotectionissuesthroughsupportingrelevantinteractiveperformancesanddeliveringawarenessraisingsessionsforadultsandchildren

• Improvingthehealth4oftheresidentsthroughupgradinghousingunits,neighborhoodbuildingandstreetupgradesandrunningawarenessraisingsessions.

Furtherinvestigationisrequiredtoconfirmiftheprogrammecontributestobuildingresilienceby:

• Increasingthecommunitycohesionthroughestablishingtheneighborhoodcommitteesandrunningtrainingsessions

• IncreasingtheconnectivitybetweenresidentsandexternalstakeholdersthroughintroducingtheneighborhoodcommitteestothemunicipalityandCSOs

Thetheoryofchangeisdiagrammaticallyrepresentedinfiguresiandii.Thekeyenablingfactors(indicatedbyan*)andchallengesthatinfluenceprogrammeimplementationare:Objective1:Housingupgrades,neighborhoodbuildingandstreetupgradesandcommittees:

• Someresidentsdidnotconsidertheselectionprocessforhousingupgradestobe‘fair’

• Somehouseholdsreceivinghousingupgradesdidnotunderstandtheupgradeprocess

• Contractorsdidnotsystematicallycomplete‘snagging’5items• Processtoidentifyneighborhoodcommunalbuildingandstreetupgrade

projectswasnotoptimallytransparentandinclusive

2SocialProtectionisdefinedasprogrammesorpoliciesrelatedtosocialinsurance,socialassistanceand/orlabormarketregulation.However,theuseofthistermisunderstoodtohavebeenaneditingerrorintheoriginalprogrammeproposalasthemainnarrativeoftheprogrammeproposalprimarilydiscusses‘protection’or‘community-basedprotection’;not‘socialprotection’.3‘Community’isatermthatneedstobeusedwithcareespeciallywhendiscussingurbanenvironments.Inthistheoryofchange‘community’isusedtoindicateacommunityofplace,meaningtheresidentsthatliveintheneighborhoodwhereCIL/Akkarounawork.4Healthdefinedas‘astateofcompletephysical,mentalandsocialwell-beingandnotmerelytheabsenceofdiseaseorinfirmity’ 5‘Snagging’istheprocessofcheckinganewbuildingforminorfaultsthatneedtoberectified.

7

Objective2:Protection• Therewerenotenoughevents-quantityandfrequency-andenoughpeople

attendingtobringtheresidentstogether(e.g.PP,PSS,interactivetheatre)• PPandPSSsessionswererunbyadequatelyskilledtrainers*• Referralcaseswerenotsystematicallyfollowedupbyorganizationstowhom

thecaseswerereferred.Programmewide

• Deliveryofcombinationofmulti-layeredsupport*• Formalandinformalstakeholderswereappropriatelyengaged*• Suitableprogrammemanagementprocesseswerechallenging:governance,

communicationandprocurement• ResidentstrustedCIL/Akkarouna*• Religiousholidayswerenotsystematicallyplannedintotimeline• Timecontingencywasnotsystematicallyincludedtomitigatetheriskofsecurity

delays• One-yearfundingcyclesweretooshort

Thesefactorsarerisksorassumptionsunderpinningprogrammedelivery.Dependingonthecontext,thesefactorshavethepotentialtomaketheworktakelonger,requireadditionalfundingorimpactonthequalityoftheoutputsandoutcomes.Thefollowingfactorsthataffectprogrammesustainabilityareasfollows:

• Itemsinstalledaspartofhousingupgradesremainfunctionalforanappropriatelengthoftime

• Adequatemaintenanceandappropriateuseofupgradeditemsbyhouseholds• Adequatemaintenanceofneighborhoodassets• Committeesarerepresentativeofthecommunityandself-organized• LandlordscomplywiththeconditionsoftheMOU• HouseholdsreceivinghousingupgradescontactCIL/Akkarounawithconcerns,

queriesandfeedback

Recommendationsforpolicy,practiceandfurtherresearchConstructionquality:Investigatethereasonsandcircumstancesforsomeresidentsreportingnon-functioningitemsinhousing,buildingorneighborhoodupgrades.Identifythenumberofhousingunitsandneighborhoodupgradesaffectedandundertakerepairs.UpdatepoliciesandprocessestoimprovethequalityofmaterialsandworkmanshipinPhaseIVasrequired.Maintenance:Providetrainingtohouseholds,communitiesandcommitteessothattheyknowhowtouse,maintainandrepairthenewlyinstalledhousingupgradesandneighborhoodupgradeprojects.Engagewithmunicipalauthorities(inpartnershipwiththecommittees)toensureregularmaintenanceandrepairsofneighborhoodassetsarecarriedoutinatimelymanner.Evictions:InvestigatespecificcaseswhereevictionshavebeenthreatenedorenactedtofindoutwhathappenedandiftheMoUs/HandoverprocesscanbeimprovedCommunication:Improvecommunicationwithhouseholdswhoare(andarenot)selectedtoreceiveassistancesothateveryoneunderstandstheprocess,itistransparentandthemostvulnerablehouseholdsaresupported(asrequired).

8

Sustainabilityofcommittees:Investigatethefactorsthatmaketheneighborhoodcommitteesmoreorlesseffectiveandsustainable.Providecommitteememberswithadditionaltrainingfocusedonbuildingtheautonomyandsustainabilityofcommittees.Identifyopportunitiestoformalizethecommitteeandprovidesupporttoidentifyandarticulatetheirorganizational‘visionandmission’.Communitycohesion:Provideopportunityforincreasedinteractionbetweenresidents.Ensurethatallmembersofthecommunityknowtheroleofthecommitteemembers.InvolvemorepeopleintheParticipatoryApproachforSafeShelterAwareness(PASSA)processandmakeitmoretransparentandaccountable.Awarenessraisingsessions:Improvetheaccessibilityoftheawarenessraisingsessionsbyincreasingthevarietyoflocations,timingsandtargetaudiencesforthesessions–potentiallythroughworkingwithexistingorganizations/institutionssuchasschoolsorCBOs.InformationVolunteers:ContinuetheapproachofdeliveringawarenessraisingsessionsthroughspeciallyselectedandtrainedInformationVolunteersfromwithinthecommunities.Protectionreferrals:InvestigatetheeffectivenessoftheprotectionreferralprocessandifCIL/Akkarouna’sprogrammepoliciesandprocessescanbeadaptedtoaccommodatelimitedcapacityoflocalspecialistprotectionorganizationstorespondtoreferredcases.Multi-scaleandmulti-sectoralsupport:Continuetodelivermulti-scale(individual,household,neighborhood)andmulti-sector(shelter,waterandsanitation,infrastructure,protection)supportintheaffectedneighborhoods.Formalandinformalstakeholders:Continuetoengageformalandinformalstakeholdersthroughouttheprogrammetomitigatedelaysandsupportimplementation.Delays:Proactivelymanagedelaysbyidentifyingandincorporatingreligiousholidaysintotheprogrammetimelinefromtheoutset.Incorporateanappropriatetimecontingencyintotheprogrammetimelinefromtheoutsettomanageunknownrisks(e.g.security).Lengthofprogramme:Furtheradvocacytodonorsandotherstoincreaselengthoffundingcyclesformoreeffectiveandefficientprogrammedelivery.TheoryofChange:Identifyhowthetheoryofchangecanbeusedtoplan,monitorandevaluatetheprogrammesothattheconnectionbetweenactivitiesandintendedoutcomesisclear.Furtherresearch:TestandvalidatetheTheoryofChangethroughoutPhaseIV;includingbothprogrammeintegrationandacomprehensiveliteraturereviewofthemostrelevantanduptodatedocumentstodefining‘socialcohesion’,‘protection’,‘health’and‘resilience’.

OUTPUT:Upgradedunits

OUTPUT:Trained

individuals

OUTPUT:Commi7ees

OUTPUT:Communalconstruc9onprojects

MoU(CARE/AKK+Occupier/Landlord)

Handoverdocument

(CARE/AKK+Occupier/Landlord)

CA+commi7ees+residentsprepare

interac9vetheatre

CA+commi7ees+residentsgiveperformance

IVsinviteresidents

Residentsa7endPP+PPSsessions

Commi7eemembersmeetwithexternal

actors

Commi7eeintroducedtothecommunity

Commi7ee+residentscompletePASSA

Poten9alHHiden9fiedbycommi7ee,community,UNHCRor

Mun.

CARE/AKK+Mun.Iden9fypoten9al

Informa9onVolunteers(IVs)

CARE/AKK+Mun.Cost,feasibility,

sustainabilityassessmentof

projects

CARE+Mun.selectprojects

Contractor-Construc9on

Contractor-Snagging


CARE/AKKmonitoring

CARE/AKKmonitoring

CARE/AKKmonitoring

CARE/AKKvulnerabilityassessment

CARE/AKKselect

households

CARE/AKKTechnical

assessment/BoQ

CARE/AKKTender+appoint

contractor

CARE/AKKselect+train

IVs

CARE/AKKselect+traincommi7eemembers

CARE/AKKiden9fy

commi7eemembers

CARE/AKKTechnical

assessment/BoQ


contractor

IVsrun

‘informa9onsessions’

CARE/AKKselect

residentstoinvitetotraining

56

Objec)ve1:Housingupgrades,communalconstruc)onprojects&commi=ees1.  Someresidentsdidnotconsidertheselec9onprocessforhousingupgrades

tobe‘fair’2.  Somehouseholdsreceivinghousingupgradesdidnotunderstandthe

upgradeprocess3.  Contractorsdidnotsystema9callycomplete‘snagging’items4.  Processtoiden9fyneighborhoodcommunalbuildingandstreetupgrade

projectswasnotop9mallytransparentandinclusiveObjec)ve2:Protec)on5.  Therewerenotenoughevents-quan9tyandfrequency-andenoughpeople

a7endingtobringtheresidentstogether(e.g.PP,PSS,interac9vetheatre)6.  PPandPSSsessionswererunbyadequatelyskilledtrainers*7.  Referralcaseswerenotsystema9callyfollowedupbyorganiza9onstowhom

thecaseswerereferred.

Programmewide(notindicatedonthediagram)9.  Deliveryofcombina9onofmul9-layeredsupport*10.  Formalandinformalstakeholderswereappropriatelyengaged*11.  Suitableprogrammemanagementprocesseswerechallenging:governance,

communica9onandprocurement12.  ResidentstrustedCIL/Akkarouna*13.  Religiousholidayswerenotsystema9callyplannedinto9meline14.  Timecon9ngencywasnotsystema9callyincludedtomi9gatetheriskof

securitydelays15.  One-yearfundingcyclesweretooshort

Keyenablingfactors

Enablingfactors(1-7)

Outputs

Ac9vi9esled/carriedoutby:

Contractors

Communitymembers

CARE&Akkarouna

CARE&Akkarouna&Municipality

Legend

9

Riskofnega,veimpact(e.g.increasecommunitytensions)

Figurei:Activitiesandoutputs

4

1 2

3

CARE/AKKreferpeopletoNGOs+Mun.

CARE/AKKfeedbackhotline

7

On-goingAc9vi9es(notsequen9al)

HousingunitUpgrades

Communalconstruc9onprojects

Training

Commi7ees

Handoverdocument


Contractor-Snagging

CARE/AKKmonitoring

3

Ac9vi9es Outputs Outcomes Goal

Detailincludedinthisdiagram

CARE/AKKmonitoring


OUTPUT:Trained

individuals


GOAL:Increasedresilienceofcommuni9es

OUTPUT:Commi7ees

2.Increasedknowledgeofresidents

3.Improvedhealthofresidents

Improvedprivacy+security

Reducedhealththreats(heat,cold,damp)

1.Increasedaccessto

infrastructure

Improvedhygiene

(washingandcookingprac9ces)

4.Increasedconnec9vitybetween

commi7ees+externalactors

Commi7eesare

empoweredtocommunicate

needstoexternalactors

Traininga7endeeschangeprac9ce

HHliveinunitswithsecureinternal+externaldoorsand

windows

Neighbourhoodhasimprovedstreetligh9ng

HHliveinunitswithnowateringress

HHliveinunitswithsafeelectrics

HHliveinunitswithimprovedWASHfacili9es

HHliveinunitswithadequateaccesstowater

Increasedself-confidenceof,andtrustbetweencommi7ee

members

Residentsknowthecommi7ee+understandtheirrole

Traininga7endeeschangeajtudes

5.Increasedcommunitycohesion

Increasedinterac9onbetweenresidents

Dependingontrainingtopic>outcome3.Improvedhealthe.g.improvedhygiene(asabove).

1.  Itemsinstalledaspartofhousingupgradesremainfunc9onalforanappropriatelengthof9me

2.  Adequatemaintenanceandappropriateuseofupgradeditemsbyhouseholds

3.  Adequatemaintenanceofneighborhoodassets4.  Commi7eesarerepresenta9veofthecommunity

andself-organized5.  Landlordscomplywiththecondi9onsoftheMOU6.  HouseholdsreceivinghousingupgradescontactCIL/

Akkarounawithconcerns,queriesandfeedback

Outputs

Outcomes

Outcomes(IFRC)

Goal

Higherlevelofcertainty,

evidencesupportsToC

Lowerlevelofcertainty,

inves9ga9onrequired

Legend

Figureii:Outputs,outcomesandgoal Ac,vi,es Outputs Outcomes Goal


Increasedempathy+

trustbetweenresidents

Keyfactorsforsustainability

11

1.0 Introduction1.1Background:TheSyriancivilwarandLebanonTheconflictinSyriahasdisplacednearlyhalfofthecountry’spopulation,withmorethan6.5millionpeopleinternallydisplacedand4.8millionbecomingrefugees(Mourad&Piron2016).Relativetoitspopulation,LebanonhastakeninthelargestnumberofSyrianrefugees:itisestimatedthatthecountryhostsover1.5millionrefugees(GovernmentofLebanonandtheUnitedNations2017),outofaLebanesepopulationofaroundfourmillion(Mourad&Piron2016).NorthLebanonhasabsorbedmorethan250,000Syrianrefugees6.Suchaprofounddisplacementhas‘significantlyimpactedLebanon’ssocialandeconomicgrowth,causeddeepeningpovertyandhumanitarianneeds,andexacerbatedpre-existingdevelopmentconstraintsinthecountry’(GovernmentofLebanonandtheUnitedNations2017,p.8).InternationalresponsestotheSyrianrefugeecrisisareincreasinglycombininghumanitarianandstabilityobjectives,notonlytomeettheneedsofrefugeesbutalsotoassistLebanonincopingwiththecrisisandaddresstheunderlyingcausesofpovertyandvulnerabilitiesinhostcommunitiesinwhichtherefugeeshavesettled(Mourad&Piron2016).Thisincludesprogrammesprovidingservicedeliveryinthosemunicipalitiessignificantlyaffectedbytheinfluxofrefugeesinordertopromotestabilityandsocialcohesion(Ibid).

1.2Intervention:IntegratedShelterandProtectionImprovementsprogrammeSince2015CareInternationalinLebanon’s(CIL)‘IntegratedShelterandProtectionImprovementsprogrammeforSyrianRefugeesandHostCommunitiesinTripoli,Lebanon’(the‘programme’)hasprovidedWASH[water,sanitationandhygiene],shelterandprotectionassistancetovulnerableSyrianrefugeesandLebanesehostcommunitymembersinTripoliandBeirut.Theprogrammeison-going–withphaseIVlastingfromSeptember2018toSeptember2019andisfundedbytheUSGovernment’sBureauofPopulation,Refugees,andMigration(PRM). TheprogrammehasbeenimplementedbyCILinpartnershipwithAkkarouna7overthreephasesinavarietyofneighborhoods(Fig1):

• PhaseI(2015-2016)providedshelterandWASHimprovementsto512housingunitsinfourneighborhoodsinTripoli(Mina,Quobbe,AbuSamraandMankoubin),upgradestocommunalareasandstreets,awarenessraisingsessionsinWASH,GenderBasedViolence(GBV)andlifeskillsandestablished15committees;

• PhaseII(2016-2017)providedprotectionawarenessraisingsessionsandsupportto2,532peopleinadditiontoshelterandWASHimprovementsto600housingunitsinthreeneighborhoods(AbuSamra(includingHayelTanak),MankoubinandWadiNahle),upgradestocommunalareasandstreets,andestablishedtwofurthercommittees(bringingthetotalto17).

6https://data2.unhcr.org/en/situations/syria/location/747Forfurtherdetailsee:https://www.akkarouna.com/

12

• PhaseIII(2017-2018)continuedtoworkinAbuSamra,MankoubinandWadiNahleanddeliveredshelterandWASHimprovementsto559housingunits,repairstocommunalbuildingsandstreets,awarenessraisingsessionsforadultsandchildren,theatreperformancesandsupportto20neighborhoodcommittees(CIL2018a).

Figure1:LocationsofphasesI, I I andII I oftheprogramme

Reference:Basemap,(UN-HabitatLebanon2017)

1.3Context:TripolianditsneighborhoodsTripoliisthesecond-largestcityinLebanoninpopulationtermsafterthecapitalBeirut.FoundedintheportofAlMinainthe8thCentury,andmoved2kminlandinthe13thcentury,thecityhasarichandvibranthistory.However,Tripolitodayfacesmanyurbanchallenges:poverty,awaningeconomy,highlevelsofunemployment,inefficientgovernanceandweakinfrastructuresupport.Thecityhasalsobeen‘marredbyneighborhoodconflictsdatingtotheLebaneseCivilWarperiodandoccasionallyeruptingsincethe1980s’(UN-HabitatLebanon2017,p.4).Around58%oftheLebanesepopulationinTripoliarelivinginpoverty8(UN-HabitatLebanon2017).Inaddition35%ofTripoli’spopulationsufferfromhealthproblems,35%liveininadequatehousingand25%aredeprivedofeducation(UN-ESCWA2015).

8PovertydefinedassurvivingonlessthanUS$2.40perpersonperday

AbuSamra

Mankoubin

Phases:I,II,IIILegend

Phases:II,III

WadiNahle

Phase:IIonly

HayelTanak(AbuSamra)

Phase:Ionly

Mina

Quobbe

13

Theday-to-daychallengesoftheLebanesepopulationinTripolihavebeenfurthercompoundedbytheinfluxofanestimated72,000refugees-aboutaquarterofthecity’spopulation-whohavemovedtothehigh-density,poorerneighborhoods(UN-HabitatLebanon2017).Thishasexacerbatedexistingvulnerabilitiesandaddedpressuretotheprovisionofbasicurbanservices(WorldVisionInternational2015).HighlevelsofinsecurityandcompetitionoverjobsareaprimarysourceoflocaltensionsbetweenLebanesehostcommunitiesandrefugees(Mourad&Piron2016).IntheirCityProfilereportUN-Habitatsuggeststhat‘historicaleventscombinedwiththelevelofpovertyrepresentedacrossbothhostandrefugeecommunitieshaveyieldedasocio-economicandsectarianconflicttinderbox’(2017,p.96). AbuSamraisadenselypopulated,informalneighborhoodonthewestbankoftheAbuAliRivertothesoutheastofTripoli.Duetoincreasedpopulationpressuresfromrural-urbanmigration,theoldcityofTripoliexpandedbetween1900-1950intothesurroundingareas,includingAbuSamra;followingtheendoftheLebaneseCivilwarin1990,therewasafurtherconstructionboom(UN-HabitatLebanon2017).Thetypicalhousingtypologyismedium-rise(4-5story)concretebuildings,witheachflooraflatreachedbyaninternalcommunalstaircase.TheaveragerentisUSD211/month(CAREInternationalUK2015)withamajoritySyrianpopulation.Theareahasahistoryoftensionandviolentconflicts,forexampleintheearly1980sbetweentheanti-SyrianTawheedMovementandpro-SyrianAlawiteswhichresultedinseveredamagetotheurbanfabricandthedisplacementofaconsiderablenumberofinhabitants(Ibid).WadiNahle’sliteraltranslationisthe‘valleyofthebees’,withtheareahavingbeenprimarilyagriculturallanduntilaslateasthe1950s9.Theareahasarangeofhousingtypologies,includingmedium-rise(4-5story)concretebuildingsandsinglestorylargerdetachedhouses.ThemunicipalityinWadiNahle(whichincludesMankoubin)wasestablishedin2015,duringphaseIIofprogrammeimplementation(IN152018;IN272018;IN682018;IN062018).Atraditional,conservativearea,WadiNahleischaracterizedby‘clans’10whose(male)leadershavegreatauthorityandinfluence;therearethreetofivedifferentclans(IN272018;IN682018;FGM22018;IN512018).Duetothefamilynetworkstheareawasdescribedbyexternalstakeholdersas:‘youdon’tfeellikeyouareworkinginanarea,youfeelthatyouareworkinginahome’(IN512018).WadiNahlehasretainedamajorityLebanesepopulation,andonlyapproximately10%oftheresidentsareSyrianrefugees(IN062018).TheneighborhoodofMankoubinwasestablishedin1955asasocialhousingdevelopmentfollowingamajorfloodinTripolithatcreatedhighdemandforsafehousing:‘thedevelopment,whichremainsuncompleted,wasoccupiedbysquattersduringthe1975-1990civilwar’(UN-HabitatLebanon2017,p.55).Itremainsasquatteddevelopmenttopresent.Itissurroundedbyinformalconstructionandintermsofbuildingcondition,itisof“poor”quality’(Ibid).MankoubintranslatesliterallyfromArabicas‘thewretched’11.TheneighborhoodneighborsaUnitedNationsReliefandWorksAgency(UNWRA)runPalestiniancamp,Beddawi,whichwasestablishedin1955.Thehousingtypology‘consistsofsingle-storyandsometwo-storyunitsdistributedalonganorganicnetworkofroads’(UN–HABITATandUNDP2010,p.85)Waterandelectricityprovisionispoor;wateriscollectedfromwellswhichoftenprovidesalinewaterandcanbeeasilycontaminated.Theareaisalsosubjecttothe

9Personalcorrespondence,CIL14thSeptember201810TranslatingthistermfromArabictoEnglishwasnotstraightforward;sometimesthiswasalsodescribedas‘tribes’or‘largefamily’;‘clans’seemedthenearest,directtranslation.11Personalcorrespondence,CIL14thSeptember2018

14

periodicsecurityriskswhicharearesultoftheAlTabbanehandJabalMohsenclashes(CAREInternationalUK2015,p.28).

Figure2:NeighborhoodsincludedinPhaseII I

1

2

3

4

5

AbuSamra(1,2and3);WadiNahle(4)andMankoubin(5)-Streetscenesandbuildings

15

2.0Methodology

2.1AimsandobjectivesTheaimofthisevaluationisto‘provideguidancetoCARELebanonanditspartnersinordertolearnfromexperiences,strengthencapacitiesandidentifyopportunitiesforincreasedintegrationofsectoralapproachesasapathwaytowardsgreatereffectivenessandsustainability’(CIL2018e,p.3).CAREInternationalUK(CIUK)havecommissionedthisevaluationonbehalfofCIL.Therearetwoobjectivestotheevaluation:

A. AnassessmentofPhaseIIIoftheprogramme(completedfromSeptember2017toAugust2018).

B. AcontributionanalysisevaluationofPhasesI,II,andIIIoftheprogramme(from2015to2018).

2.2EvaluationapproachThisresearchstartedwithanassessmentoftheextenttowhichPhaseIIIoftheprogrammehadachieveditsstatedgoal,objectives,activitiesandtargets.Thisincludedaninvestigationintotherelevance,effectivenessandimpactoftheprogrammeusingtheDAC(DevelopmentAssistanceCommittee)CriteriaforEvaluatingDevelopmentAssistance,aswellasareviewoftheaccountabilityoftheprogrammetothoseitsupported.ThispartoftheevaluationisdetailedinSection3ofthereport.Secondly,thestudyadoptedaminimalistcontributionanalysisapproachtotheevaluationofPhasesI,IIandIIIoftheprogramme.Thisapproachwasselectedasbeingthemostappropriatemethodtoachievingtheaimoftheevaluationwithinthetimeandresourcesavailable12.ContributionAnalysisis‘anapproachdesignedtoreduceuncertaintyaboutthecontributiontheinterventionismakingtotheobservedresultsthroughanincreasedunderstandingofwhytheobservedresultshaveoccurred(ornot!)andtherolesplayedbytheinterventionandotherinternalandexternalfactors’(BetterEvaluationn.d.).ThispartoftheevaluationisdetailedinSection4ofthereport.ContributionAnalysisfollowsasix-stepprocess:

1. Setouttheproblemtobeaddressed2. Developatheoryofchangeandriskstoit3. Gathertheexistingevidenceonthetheoryofchange(seeBox1)4. Assembleandassessthenarrativeandchallengestoit5. Seekoutadditionalevidence6. Reviseand,wheretheadditionalevidencepermits,strengthenthenarrative

(Mayne2008).Giventhelimitationsoftheresearch(seeSection2.4)andbecausethefocusoftheevaluationwasontheorygenerationratherthantheorytesting,thisevaluationfocusedonsteps1-4.Theadditionaldatacollectedthroughthefieldworkwasusedto 12TheselectionandreviewofalternativeevaluationmethodswasguidedbytheBOND“ChoosingAppropriateEvaluationMethodsTool”.Forfurtherinformationsee:https://www.bond.org.uk/resources/evaluation-methods-toolForfurtherinformationonminimalistcontributionanalysissee:Mayne,J.(2008).

16

independentlyvalidateconclusionsdrawninsteps1-4,identifyandreinforcekeycausallinks(steps5-6)andidentifyfurtherareasofresearchtosystematicallytestthetheoryofchange.Box1:ConceptualizingresilienceOverthelasttenyears,humanitariananddevelopmentagencieshavesoughttounderstandanddefineresilienceasitbecomesacommongoalfortheirprogrammes.Typically,resilienceisdescribedas‘theabilityofsystems(andpeople)toeffectivelyrespondandadapttochangingcircumstancesandtodevelopskills,capacities,behaviorsandactionstodealwithadversity’(IFRC2014,p.6).CARErecognizesthat‘increasingresilienceisnotanoutcomethatcanbeachievedwithinaspecifictimeframe,but[is]anon-goingprocess’(CAREInternational2016,p.5);andhaveadoptedadynamicmodeltodescriberesilience:‘Ifthecapacitiesandassetstodealwithvariousshocks,stressesanduncertaintyarebuiltandsupportedandifdriversofriskarereducedandiftheseactionsaresupportedbyanenablingenvironment,thenresilienceisincreased’(Ibid).Forthisevaluation,andparticularlythecontributionanalysis,itwasnecessarytoidentifyaresilienceframeworktosupportthedevelopmentofthetheoryofchange.Specifically,itwasnecessarytodescribewhatresiliencewasinordertolinktheIntegratedShelterandProtectionImprovementsprogrammeactivitiesandoutputstoitsgoalofcontributing‘tobuildingresilienceoftheaffectedpopulationinTripoli’.Theauthorstestedtwoframeworkswhichusesystemsapproachestodescriberesilienceatacityscale(theCityResilienceIndicatorsusedbythe100Resilientcitiesprogramme(RockefellerFoundationandArup2016)andtheALNAP‘SteppingBack’(2016)fortheirusefulnessintermsofdevelopingthetheoryofchange.However,theyintroducedahighlevelofcomplexitythatwasnothelpfulindevelopingasimple,usefulandpracticaltheoryofchange.Frameworksthatdescribedresilienceatacommunityscaleprovedmoreuseful.Throughabriefprocessoftestingpotentialcityscaleandcommunityscaleframeworks,theIFRCFrameworkforCommunityResiliencewasidentifiedbytheauthorsasthemostapplicabletotheprogramme.Atitsmostbasiclevel,thisframeworkstatessimplythat‘aresilientcommunity...

...isknowledgeable,healthyandcanmeetitsbasicneeds

...issociallycohesive

...haseconomicopportunities

...haswell-maintainedandaccessibleinfrastructuresandservices

...canmanageitsnaturalassets

...isconnected[toexternalstakeholders]’(IFRC2014,p.11).Otherframeworksandmodelsofresilienceatavarietyofdifferentscalesareavailableandfurtherresearchcouldinterrogateandvalidatethisselection.

17

2.3ResearchmethodsThefieldworkteam13undertookdatacollectionduringafour-dayperiodinSeptember2018.Thefieldworkincluded15keyinformantinterviews,sixfocusgroupsanddirectobservation;oneadditionalinterviewwasundertakenbyvideoconferencetwoweekslater.Apurposefulapproachwasadoptedtoidentifyingkeyinformantsfortheinterviewsandfocusgroups.Acommonapproachinqualitativeresearch,thisenabledtheresearcherstofocusontheindividualsorgroupsofindividualsthatareespeciallyknowledgeableaboutorexperienced;thatarethemost‘informationrich’(Palinkasetal.2015)andrepresentarangeofstakeholdergroups14tocapturedifferentperspectives.InformantswereidentifiedthroughCILandAkkarounastaffmembersinthefieldworkteam.Datacollectedthroughdirectobservationincludedaguidedtourofeachofthethreeneighborhoods.AdrafttheoryofchangewasdiscussedinaworkshopwithCILandAkkarounastaff,andlatercombinedwithanextensiveliteraturereviewinordertotriangulatethedataandrefinethefindings.Datawerecollectedthroughsketches,comprehensivenotesandphotos.StafffromCIUKandCILreviewedandprovidedcommentandfeedbackonthedraftsofthisevaluation.ThisresearchhasappliedthetenDepartmentforInternationalDevelopment(DfID)EthicsPrinciplesforResearchandEvaluationtotheresearchapproach;includingdefiningtheresearchquestion,datacollection,analysisandreporting(DFID2011).Allinformantswereprovidedwithan‘informationsheet’priortotheinterviewsandrequestedtosigna‘consentform’toindicatetheirunderstandingoftheresearchandgivingtheirpermission.

2.4Limitations

Throughouttheresearchtheevaluationteamaimedtopresenta‘goodstandardofevidence’,andwherepossiblea‘goldstandardofevidence’(BONDn.d.)15.Howevertherewereafewexceptions.Forexample,itwasnotpossibletoinvolvebeneficiariesintheassessmentprocess-theywerenotinvolvedindesigning,analyzingdataorformulatingconclusions.Inaddition,whilstitwaspossibletodisaggregatesomefindings,accordingtogender,disabilityandotherrelevantsocialdifferences,thiswasnotcomprehensiveandsomedatamaybemissing.Thelowerqualityevidencewasduetoseveretimeconstraints(lessthanfourdaysincountrydatacollection;lessthantwoweekspreparationtime).

13TheResearchTeam:ElizabethParker,leadevaluator(Independent);WahibAyoub,Translator(Independent);AngieFarah,SeniorM&EOfficer(CIL),DaoudNakhoul,ProtectionOfficer(Akkarouna).OnlyMsParkerandMrAyoubundertookthesemi-structuredinterviews.Thewholeteamwerepresentforthefocusgroupdiscussions.14Thisincludedinterviewswithrepresentativesfromlocalgovernment(one),communityandcivilsocietyrepresentatives(one),landlords(two),committeemembers(three),tenantsrentingpropertiesthathadbeenupgraded(three),projectpartners(one)andCILandAkkarounastaff(four).Focusgroupdiscussionswereheldineachofthethreeneighborhoods,withseparatesessionsformenandwomen.InMankoubinasemi-structuredinterviewwasheldbecausetherewasnotenoughmenforafocusgroup.Afocusgroupwasalsoheldwiththe‘InformationVolunteers’.15TheBondPrinciplesandassociatedChecklistaretoolsforassessingthequalityofevidencecollectedandusedbyNGOstomeasure,learnfromanddemonstratetheirimpact.Therearefiveprinciples:voiceandinclusion,appropriateness,triangulationandcontributionandtransparency.Eachprinciplehasfourquestionsthatcanbeusedtoassessthequalityoftheevidence;thequestionisscored1-4-1)weakevidence,2)minimumstandard,3)goodpractice,4)goldstandard(BONDn.d.).

18

TheresearchwasundertakenthreeyearsafterthestartofPhaseIoftheprogrammeandmanykeyinformantsdidnothavestrongrecollectionsoftheearlystages,forexampleitwasnotalwaysclearwhatPhaseoftheprogrammepeoplewereinvolvedin.Whereverpossible,thestatementsofeachinformantweretriangulatedwiththoseofothersandavailablesecondarydata.However,ithasbeenchallengingtocaptureallthedetails,andsomegapsremain.TheassociationwithCILandAkkarounaalsopresentedapotentialbiasbecausetheresearcherswerelargelydependentonAkkarounatoprovideintroductionsforinterview.However,theadvantagesoutweighedthedisadvantagesbecauseitprovidedtheresearcherswithaccesstoawiderangeofkeystakeholdersanddetailedinsightintoCILandAkkarouna’swork.Thisriskofbiaswasmitigatedduringdatacollectionbytheinterviewsbeingundertakenonlybytheleadevaluator(ElizabethParker)andanindependenttranslator;nostafffromCILorAkkarounawerepresentduringtheinterviewsintheneighborhoods.ThemajorityoftheinterviewsandallthefocusgroupsweretranslatedfromArabic-Englishinreal-time.Aprofessionaltranslatorwasengagedtosupporthighqualitydatacollection,andtoreducetheriskoflossofdetailandnuance.Furthermore,thetranslatortookextensivenotestocapturediscussions,andduringthefocusgroupsasecondbi-lingualmemberoftheCIL/Akkarounateamprovidedadditionalsupportfortranslationintheeventthatasecondopinionwasrequired.

19

3.0Findings:PhaseIIIAssessmentThissectionofthereportpresentsthefindingsfromtheassessmentofPhaseIIIoftheIntegratedShelterandProtectionImprovementsprogrammeforSyrianRefugeesandHostCommunitiesinTripoli,Lebanon.

3.1Activitiesandtargetsrelatedtoobjective1:ShelterandWASH

Rehabilitation(Upgrade)ofindividualhousingunitsObjective1oftheprogrammewas:‘SyrianrefugeesandhostcommunityindividualshaveimprovedshelterandWASHconditionsinurbanTripoli’(CIL2017a).Theprogrammehasexceededitstargetsrelatedtotheupgradeofhousingunits.Theprogrammesupported2,845residentswithhousingupgradesfromaninitialtargetof2750,representingatotalof559housingunits,comparedtoatargetof550(Table5).Upgradesincludedexternalworks:waterproofingforroofs,wallsandfloors;replacingorrepairingwatertanksandensuringthepropertycanbesecurelylocked(replacingorrepairingexternalwindowsanddoors).Internalrepairsincludedinstallationofinternaldoorsandpartitions;safeandadequateelectrics(onepowersocketandlightineachroom,circuitbreaker);installationofakitchensink,mixertap,exhaustfanandtiling;installationoftoilet,electric/gas/woodwaterheater,washbasin,showermixerandwallandfloortilingasrequired(IN952018;DirectObservation2018;IN272018;CAREInternationalUK:EmergencyShelterTeam2018).Thereisaoneyearguaranteeforupgradeditems(IN952018).AtthebeginningofPhaseIII,theCIL/Akkarounashelterteamundertookarapidassessment(RA)toreviewthesocio-economicvulnerabilityandthesheltervulnerability(IN272018;CIL2018d);intotalmorethan2,300propertieswerevisited(CIL2018f).Householdsforpotentialupgradeswereidentifiedbycommitteemembers,communitymembers,referredbyUnitedNationsHighCommissionerforRefugees(UNHCR),informedbytheCIL/AkkarounaRAorbythelocalmunicipality(CIL2018f;IN682018;IN152018;IN062018).SubsequentlythehouseholdstoreceivetheupgradeswereselectedbyCARE/Akkarounaandtheshelterteamundertookatechnicalassessment(TA)inordertodeveloptheBillofQuantity(BOQ)(CIL2018f).Followingatenderprocess,twoofthethreepre-vettedcontractors-GreenArtandAlWissam–wereappointedtoundertakethehousingupgrades in phases16(CIL2018f).Athirdpre-vettedcontractor,ImadZaidanwasnotappointedfollowinga‘valueformoney’reviewprocess.AMemorandumofUnderstanding(MoU)wassignedbetweenCARE/Akkarounaandthehomeowners;orinthecaseofrentalunits,betweenCARE/Akkarouna,thelandlordandthetenant.AllsignedMoUswerewitnessedandsignedbyacommitteefocalpointfromthesameneighborhood;inadditionArabicBoQsforeachhousewereannexedtotheMoUs(CIL2018f;DirectObservation2018).Theappointedcontractorsthenundertooktheupgrades,asdetailedineachhouseholdBoQ.Duringconstruction,thecontractors’workwasmonitoredandfacilitatedbyAkkarouna’sShelterOfficersonaday-to-daybasiswithsupportfromAkkarouna’sProjectManager,CIL’sShelterOfficerandProjectManager(CIL2018f).Uponcompletionofthework,andinspectionoftheupgrades,theShelterOfficerspreparedaHandoverdocumentforthehomeownerortenanttosign(IN952018).ThisHandover 16WadiNahle-AlWissam;Mankoubin,ShokandShalfeh:allGreenArt(Personalcorrespondence,CIL4thOctober2018)

20

documentindicatedthattheoccupierwashappytosign-offontheworks,andalsodetailedany‘snagging’items(e.g.itemsthatwerenotcompleted,ornotcompletedsatisfactorily).The‘snagging’listwashandedovertothecontractortoaddress,andAkkarounafollowedupbyeithercallingtheoccupant,visitingthepropertyorbeinginformedbythecontractor(IN152018).

NeighborhoodupgradestobuildingsandstreetsTheprogrammehasexceededitstargetsrelatedtotheupgradeofcommunalbuildingsandstreets,delivering35projectscomparedtoatargetof33(CIL2018a).Toidentifythepriorityareasforcommunalupgrades,CILandAkkarounaintroducedtheParticipatoryApproachforSafeShelterAwareness(PASSA),aprocessthataimstodeveloplocalcapacitytoreduceshelterrelatedriskbyraisingawarenessanddevelopingskillsinjointanalysis,learninganddecision-makingatcommunitylevel17.PASSAwasundertakeninNovember-December2017,withthreegroups:inMankoubin,WadiNahleandAbuSamra.Ineachneighborhoodthegroupsformedamixofcommitteemembersandothers,withanaimtorepresenttheresidents.EachgroupmetforfivedaystogothroughthePASSAactivities,andtodevelopalistofcommunalprojectstodeliveraspartoftheprogramme,andalistofprojectsthatcouldbeadvocatedfor/referredtoathirdparty(CIL2018d).FollowingthePASSAprocessCARE/Akkarounastaffwentonfieldvisitswithsome‘focalpoints’fromthePASSAattendeesandadditionalprojectsweresuggested18.TheprojectssuggestedthroughthePASSAprocessandthefieldvisitswithfocalpoints‘wereanalyzedandassessedbytheprojecttechnicalteamincollaborationwiththemunicipalityforsustainability,feasibilityandcost-sharing’(CIL2018f,p.8).Table1providesanoverviewofthefinalworksexecuted.CILandAkkarounadevelopedtheBoQsandtenderedtheworks,advertisinginnationalnewspapersandonlineplatforms.Twocontractorswereappointed(ImadZaidanandAlWissam19).TheworkwasmonitoredandfacilitatedbyAkkarouna’stechnicalstaffwiththesupportofCIL(CIL2018f).Duringimplementation,theCIL/Akkarounatechnicalteamundertookregularmonitoringandfollowedupwiththecontractorsasrequired;theCIL/Akkarounatechnicalteamalsoreportedthe‘snagging’items’.Furthermore,duringmonitoringactivities,ifanyresidentcomplainedorreportedthatanyitemwasnotfunctioning,thecasewasreferredtothetechnicalteam20.Oncecompletedtherewasahandoverdocumentforthemunicipalityorrelevantlandlord(ifcommunalbuildingupgrading).

17ForfurtherinformationonPASSAsee:https://www.ifrc.org/PageFiles/95526/publications/305400-PASSA%20manual-EN-LR.pdf18Personalcorrespondence,CIL,4thOctober201819Contractorswereselectedbasedonvalueformoneyandweredividedbyarea.Onlythesolarlightingswasassignedforonecontractorindifferentareas..ZaidanworkedinShokandMankoubin;AlWissamworkedinWadiNahleandinstalledthesolarlights(Personalcorrespondence,CIL,4thOctober2018)20Personalcorrespondence,CIL,23rdOctober2018

21

Table1:UpgradestobuildingsandstreetsundertakenaspartofphaseII I

AbuSamra(Shok) WadiNahle Mankoubin

1. 2retainingwalls2. 1PVC8"sewageforbuilding*3. 22rainpipesforbuilding*4. 1ToTstaircase*5. 1electriccablesforbuilding6. 1steelstairforbuilding*7. 15Solarstreetlights*

1. 1staircase*2. 3Manholesand8"pipes*3. 1handrail4. 30Solarstreetlights*

1. 12concretemanholecovers*

2. 10,000lwatertank*

AlsoidentifiedduringPASSA,forexample:vocationalandilliteracyprojects,improvedsolidwastemanagement,roadupgrades,improvedaccesstodrinkingwater.

AlsoidentifiedduringPASSA,forexample:improvedsolidwastemanagement,improvedaccesstodrinkingwater,upgradetofoundations/walls,plantingtrees,improveddrainage.

AlsoidentifiedduringPASSA,forexample:Solarstreetlights,vocationalandilliteracyprojects,awarenesssessions,upgradestoelectricitypoles.

Legend:Itemsidentifiedwithanasterix(*)wereidentifiedduringthePASSAprocess;otherprojectswereidentifiedthroughdiscussionwith‘focalpoints’

Reference:(CIL2018d)Annex3,PASSAreport;and(CIL2018a)

NeighborhoodCommitteesTheprogrammehasmetitstargetsrelatedtotheestablishmentofneighborhoodcommitteesbysupporting20committees,with213committeemembers,fromanoriginaltargetof160(CIL2018a).DuringPhaseIIoftheprogrammetherewere17activecommittees;thesewerere-engaged.ThreefurthercommitteeswereestablishedinthenewzoneofWadiNahle(CIL2017c).CommitteememberswererequestedtosignaTermsofReference(ToR)andcodeofconducttoaligntheirrolesandattitudeswiththeprojectgoal(IN062018;CIL2017b).

Thecommitteestypicallyincludedamixtureofresidents,representingcommunityleaders,localresidents,landlords,tenantsandthosewhohavenotreceivedhousingupgrades(IN062018;DirectObservation2018;IN192018).Overall,thecommitteesaremadeupofaround90%women(194women,19men;acrossalltheneighborhoods)-seeTable2.Eachcommitteeisdifferent-seeTable3.Forexamplethecommitteesrangeinsizefromfour,to18members.Equallythereisarangeofdiversitywithinthegroups;thereare10committeesthatdonothaveanymalemembers,sixcommitteesthatonlyhavememberswhoareLebaneseandtwocommitteeswherethemembersareallSyrian.Table2:Disaggregationofcommitteemembersbynationalityandsex;phaseII I NATIONALITY SEX Lebanese Syrian Other Females MalesMankoubin 43 2 0 39 6WadiNahle 82 10 1(PRL) 88 5AbuSamra(Shok/Shalfeh)

27 48 0 67 8

Total 152 60 1 194 19Reference:Personalcorrespondence,CIL4thOctober2018

22

Table3:Disaggregationofcommitteemembersbycommitteeacrossneighborhoods;phaseII I Shalfeh Mankoubin Shok WadiNahle

1 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 6 7 8 9Nationality Lebanese 15 8 6 6 5 17 6 4 0 3 0 5 8 14 11 7 3 9 10 15PRL 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0

Syrian 3 0 0 2 1 0 12 8 6 10 8 3 2 0 0 0 1 0 2 2

Gender Female 18 8 6 6 5 14 17 9 4 11 8 8 10 12 9 8 4 8 12 17

Male 0 0 0 2 1 3 1 3 2 2 0 0 0 2 2 0 0 1 0 0Reference:Personalcorrespondence,CIL24thOctober2018

InMankoubinandAbuSamra,thebalanceofcommitteememberswithSyrian,Lebaneseorothernationalitiessitswithinaround10%ofthesameproportionfortheoverallpopulation(e.g.inMankoubin,4%ofthecommitteemembersareSyrians,withSyriansrepresentingaround15%ofthetotalpopulation;inAbuSamrathecommitteemembersare64%Syrianwithanoverallpopulationof57%).InWadiNahlethereisagreater%difference;11%ofthecommitteemembersareSyrian,butSyriansmakeup33%ofthepopulation21.Typically,thereisnohierarchywithinthecommittees(IN272018),thustherearenothematiccommittees(e.g.Youth)oraseparate‘leadership’council(CIL2017a).Onlyonecommitteememberinterviewednotedthathewasthe‘president’andhehadbeenappointedthisrolebytherestofthecommitteememberstoconveyconcernstotheMinistryofSocialAffairs(MoSA),CIL/Akkarounaandthemunicipality(IN232018).Allcommitteemembersweretrainedandreceivedcapacitybuildingtrainingover54sessions(CIL2018f,p.10).Thecommitteesweregroupedinto9groupsandeach‘group’received6-daysoftraining22.Thesessionstopicsincludingconflictresolution,stressmanagement,tenants’rights,GenderBasedViolence(GBV),domesticviolenceandearlymarriage(CIL2018f,p.10).ThetrainingwasdeliveredbySocialWorkersfromtheMoSA(CIL2017c).

3.2Activitiesandtargetsrelatedtoobjective2:ProtectionObjective2oftheprogrammewas:Syrianindividualsandhostcommunityindividualshaveenhancedknowledgeofandaccesstoprotectionservices(CIL2017a).Theprogrammeproposalnotesthat‘3,500newindividuals(1,750Syrianand1,750hostcommunitymembers)willbereached’throughobjective2(CIL2017a,p.8);itisnotexplicitwhichpartsoftheactivitiesundertakenaspartofobjective2thisrelatesto.PsychosocialSupport(PSS)sessionswereattendedby1286residents,comparedtoatargetof1200and310residentsattendedtheinteractivetheatre,comparedtoatargetof150(CIL2017a;CIL2018a).Furthermore,617residentsattendedthePositiveParenting(PP)sessionsand4997informationsessionswerecarriedout23(CIL2018a)-see(Table5)forfurtherdetailsonethnicandgenderdistribution.

21Personalcorrespondence,CIL4thOctober201822Personalcorrespondence,CIL19thOctober201823TheprogrammeproposaldoesnotstatetargetnumberofattendeesforPPsessionsnorinformationsessions(CIL2017a).HoweverintheirquarterlymonitoringreportsCILreportonthefollowingindicator

23

PsychosocialSupportandPositiveParentingsessionsCAREandAkkarounacoordinatedwithlocalmunicipalities(municipalityofTripoli,MankoubinandWadiNahle)inordertoidentifycandidatestobeInformationVolunteers(IVs).Allapplicantsundertookanexam,followingwhichAkkarounaselectedthetopnineInformationVolunteers(IVs);threefromeachneighborhood24.OftheIVs,sevenwerefemaleandtwoweremale.TheIVsreceivedfivedaysoftraininginOctober2017fromarangeoforganizations,includingSavetheChildrenaboutPsychosocialSupport(PSS),PositiveParenting(PP),safeidentificationandprotectionreferrals(CIL2017c).InNovember-December2017theIVsundertookdoor-to-doorassessments,introducingtheprogrammesobjectivesandanoverviewofthePSSandPPsessions(CIL2017c;FG52018);theseassessmentswerereferredtoas‘informationsessions’.IntheinformationsessionstheIVsalsocollecteddataaboutthehouseholds(forthePSSandPPsessions),andwiththesupervisionofAkkarouna’sprotectionfieldofficers,eachIVfilledregistrationformsforthechildrenandtheircaregivers(CIL2017c).Basedonthisfilleddata,beneficiarieswereselected,accordingtotheirage,toreceivethePSSandPPsessions(Ibid).Fromearly2018,PPsessions(foradults)andPSSsessions(forchildrenaged6-11and12-17,)wereheldinMankoubinandWadiNahle(CIL2017c);sessionsinAbuSamracommencedinMay2018(CIL2018f).Intotal1286residents(children)attendPSSsessionsand617residents(parents)attendedPPsessions(CIL2018a).ChildrenattendingthePSSsessionswerefairlybalancedintermsofgender(43%female;57%male)andnationality(41%Lebanese;58%Syrian).However,therewasasignificantgenderimbalanceofthoseattendingthePPsessions,with93%attendancefromwomenandonly7%frommen(withnomenattendingsessionsinMankoubin,onlyoneattendinginWadiNahle,and44inAbuSamra).Thesessionswereheldeitherinprivatehousesorincommunitybuildings/communalspaces;andforthelatter,thegroupsweretypicallynotmixedmale-female(FG52018).Table4:ParticipantsattendingPPdistributedbygenderandareaArea Male Female TotalMankoubin 0 146 146WadiNahle 1 146 147AbuSamra(Shok/Shalfeh) 44 280 324Total 45 572 617 7% 93%

Reference:(CIL2018a)

(thatwasnotintheoriginalproposal):#ofbeneficiarieswhoattendedpsycho-socialsupportsessions,positiveparenthood,andinformationsessions,andnotethetargetas‘3000’(CIL2018a).24TheprogrammeproposalstatestheintendednumberofIVsasten(CIL2017a),andintheirquarterlymonitoringreportsCILcontinuetoreportthetargetvalueasten(CIL2018f).However,inthefinalmonitoringreportthisvalueisthenstatedasnine(CIL2018a).

24

InteractiveTheatreInadditiontothePPandPSSsessions,aspecializednon-governmentalorganization(NGO)calledtheCrossArtsCulturalAssociation25wasengagedtodeliverthreeperformancesineachoftheneighborhoods.CrossArtsworkedwithcommitteemembersandotherresidentstoidentifythemesandkeymessages,suchasaroundearlymarriage.Thesewerethendevelopedintoaperformance-withCrossArtprovidingactortrainingforresidentsin‘interactivetheatretrainings’,andalsocreatingsceneryfortheperformancein‘recyclingworkshops’(CIL2018f;IN512018).Theinteractivetheatreactivityaimsto:‘remindthecommitteeabouttheawarenesstopics;deliverthekeymessagestothewholeneighborhoodthroughtheforumtheater;increasetheself-confidenceofthecommitteemembersandtheactors;andencourageinteractionbetweenthebeneficiariesoftheneighborhood,thelocalauthoritieswiththecommitteesandopenforumdiscussions’(CIL2017a,p.8).Twoperformancegroupswereformed,withMankoubinandWadiNahlemergedintoonetroupe,andAbuSamraasasecondtroupe(CIL2018f;IN512018).TheWadiNahle/Mankoubintroupewasmadeupofapproximately20women(nomen);almostallthewomenwereLebanese,withonlyoneortwoSyrianactors(IN512018).TheAbuSamragroupwasprimarilyyouth,withamixofgenderandnationality,althoughprimarilySyrian(IN512018).InJuly2018oneperformancewasheldinMankoubin,(100attendees),asecondinAbuSamra(150attendees)andathirdinWadiNahle(60attendees);eachperformanceincludedbothtroupes(CIL2018a).Theperformanceswerealsousedtobrieflyintroducethecommitteestothecommunities-thecommittee‘membersstatedtheirinitiativesandavailabilitytosupporttheircommunitieswhenneeded’(CIL2018a,p.13).

CommitteemeetingswithotherstakeholdersInMarch-April2018,sixmeetingswereheldbetweencommitteemembers,municipalitiesandCivilSocietyOrganizations(CSOs):includingtwowiththeSafadifoundation,twowithOumElNour,onewithTripoliMunicipalityandonewithLavajetthroughthemunicipality(forwastecollectionandcitycleaning)(CIL2018f).

ReferralstootherstakeholdersFinally,throughoutphaseIIIoftheprogramme,CIL/Akkarounareferred6826casestospecializedNGOsorUNHCRdependingontheneedandsituation-forexamplefordrugaddiction,healthissues,domesticviolenceand/oreducationservices(CIL2018a;IN062018).ThecasesforreferralwereeitheridentifiedbytheIVsduringthePPorPSSsessions,bytheCIL/Akkarounaprotectionstaff,bycommitteemembersorbyresidentsthemselvesviathehotline(CIL2018f;IN532018).

25Forfurtherdetailsee:http://www.annalindhfoundation.org/members/cross-arts-cultural-association26Personalcorrespondence,CIL,4thOctober2018

25

Table5:PhaseII I Goal, Objectives,ActivitiesandTargets Goal


TOTAL DISAGREGATEDBYNEIGHBORHOOD Target Achieved AbuSamra

(Shalfeh)AbuSamra(Shok)

Mankoubin WadiNahle

Objective1 SyrianrefugeesandhostcommunityindividualshaveimprovedshelterandWASHconditionsinurbanTripoli.

2,750beneficiaries(20%female)(50%Syrian,50%host)

2,845beneficiaries(48%female)(50.5%Syrian,49.5%host)

42beneficiaries(93%Syrian;7%host)

907beneficiaries(65%Syrian,35%host)



Activity1.1 Rehabilitationofindividualhousingunits

550housingunits

559housingunits8 193 125 233

Activity1.2 Upgradestobuildingsandstreets 33buildings 35communalprojects 027 29 2 4Activity1.3 NeighborhoodCommittees 20committees

160committeemembers

20committees213committeemembers(194Female,19Male)

1committee18committeemembers(4Syrians,14Lebanese;18Females,0Males)

5committees57committeemembers(44Syrians,13Lebanese;49Females,8Males)

5committees45committeemembers(2Syrians,43Lebanese;39Females,6Males)

9committees93committeemembers(10Syrians,82Lebanese,1PRL;88Females,5Males)

Objective2 Syrianindividualsandhostcommunityindividualshaveenhancedknowledgeofandaccesstoprotectionservices.

3,000beneficiaries(50%Syrian,50%host)28

6900beneficiariesNeighborhoodbreakdownnotavailableforinformationsessions(4997intotal)

PSSattendees:449(229Female,220Male)PPattendees:324(280Female,44Male)



Activity2.1 Awareness-RaisingandPsycho-SocialSupport

Ref:(CIL2017a;CIL2018a)

27NoupgradestobuildingsandstreetswerecarriedoutinShalfehduringPhaseIIIbecausetheyhadalreadybeenexecutedintheearlierPhases.28Asnotedabove,thistargetisnotstatedintheprojectproposal(CIL2017a,p.8)HoweverintheirquarterlymonitoringreportsCILreportonthefollowingindicator(thatwasnotintheoriginalproposal):#ofbeneficiarieswhoattendedpsycho-socialsupportsessions,positiveparenthood,andinformationsessions,andnotethetargetas‘3000’(CIL2018a).

26

3.3Discussion

Relevance:towhatextentweretheactivitiessuitedtotheprioritiesofthetargetgroup?TheIntegratedShelterandProtectionImprovementsprogrammeforSyrianRefugeesandHostCommunitiesinTripoli,Lebanon,ishighlyrelevanttotheneighborhoodsthatCAREandAkkarounaaretargeting.SincetheRapidUrbanAssessmentthatCAREundertookin2015(CAREInternationalUK2015),largenumbersofSyrianrefugeesfleeingthecivilwarcontinuetoliveinWadiNahle,AbuSamraandMankoubin;duringthistimetherehavenotbeenanyothersignificantpoliticalorsocio-economicchangesthathavebroughtmuchneededinvestmentintotheneighborhoods.TheprogrammecontributestotheLebanonCrisisResponsePlan(LCRP)2017-2020byprovidingshelter,alongwithactivitiesdesignedtosupportsocialstabilityandcopingstrategies(GovernmentofLebanonandtheUnitedNations2017).FurthermoretheworkrespondstotheUN3RP’sandLCRP’sfirstpriorityforhumanitarianassistance(specifically,improvedshelter)andprotection.Thisproject’sdesignincorporatesboththeLCRPandUN-Habitaturbanstrategycity-profilinginitiativesforTripoli(UN–HABITAT2016),aswellasdecisionsoftheneighborhoodupgradingsub-committeeanddirectivesfromUNHCR’sShelterWorkingGroup29.Focusedonobjective1(shelterandWASH),residentsnotethatthe‘upgradeswereverywelcome’andduringthedatacollectionstageofthisevaluationrequestedfurtherhousingupgradesupportfromCIL/Akkarouna(FGM22018;FGF72018).ThisincludesoccupantsofhousesthathavereceivedCIL/Akkarounasupportinpreviousphases,butwhowouldlikefurtherupgradestoimprovetheirlivingconditions;andalsohouseholdswhohavenotreceivedanyCIL/Akkarounasupportrequestingtobeincludedinfuturephases(FGM12018;FGF92018).Furthermore,thevastmajorityoftheupgradeditemsare‘continuingtobeused[bytheresidentsbecause]theywereneeded’(CIL2018a,p.5);therewasonlyonementionofahouseholdsellingtheirnewlyfittedwatertank;notbecauseitwasn’tneeded,butbecausethehouseholdhadmoreurgentfinancialneeds(IN952018).Finally,therecontinuestoberequestsforadditionalcommunalprojects‘suchas:Asphaltfortheroads,cleaningcampaigns,providingdrinkingwater;sewagesystems;activitiesforthechildrenandgardenorsafespacesforchildren’(CIL2018a;FGF62018;FGM22018).Alsounderobjective1,theneighborhoodcommitteesestablishedinWadiNahle,AbuSamraandMankoubinareuniqueinbringingtogetheradiversegroupofresidents-menandwomen;SyrianandLebanese;andresidentsofdifferentages.Therearenootherforumswherethistypeofinteractionisfacilitatedandthisactivitymeetsakeyneighborhoodneed(IN272018;IN062018;FGM12018).Howeverthecommitteesvaryconsiderablywithsomehavinggreatergender,ageandethnicdiversitythanothers-seeTable5.Finally,objective2(protection):duringthedatacollectionstageofthisevaluationresidentsrequestedfurtherPSS,PPandotherawarenessraisingsessionsfromCIL/Akkarouna(FGM22018;FGF72018;FGM12018),reinforcingtheirusefulness.100%ofattendeesreportedthatthekeymessagesfromthePPandPSSsessionswererelevanttotheireverydaylives(CIL2018a).

29Forfurtherinformationsee:https://data2.unhcr.org/en/working-group/24

27

Accountability:howwastheprogrammeaccountabletothebeneficiaries?CIL/Akkarounahaveinplaceanumberofmechanismstosupportprogrammeaccountability,theseinclude:

• Quarterlymonitoring• A‘hotline’numbertosharefeedback,suggestionsandcomplaints• Regularformalandinformalmeetingswithneighborhoodcommittees(CIL

2018a)

CILandAkkarounaspecialistM&Estaffundertookthequarterlymonitoring.Datacollectionincludedon-spotmonitoring(OSM)fortheconstructionwork,post-implementationmonitoring(PIM)withbeneficiariesreceivingshelterupgrades,focusgroupdiscussions(FGDs)withcommunities,committeesandbeneficiariesofthePPandPSSsessions;baselineandendlinesurveyswithcommitteemembers;andpre-posttestsandknowledge,attitudeandpractice(KAP)surveyswithbeneficiariesattendingpsychosocialsupportandpositiveparentingsessions(CIL2018a).QuarterlyreportsarecompiledandsharedwithCILandAkkarounaprogrammedeliverystaff;disseminationissometimessupportedbylessonslearnedworkshopsto‘discussthesuccessfulness(sic),challenges,andhowtoimprove’(CIL2018f,p.22).Thequarterlyreportsarestructuredaroundthe20projectindicators(seeAnnexA)anddonotincludeanyfinancialreporting.Thisregular,formalizedmonitoringprocessprovidestheopportunityforearlyidentificationofstrengthsandweaknessesofprogrammedeliveryagainsttheprojectindicators.TheCIL/AkkarounaShelterandProtectionofficershavedistributedthehotlinenumberdirectlyto:

• committeemembers;whohavebeengiventheresponsibilitytosharewithotherresidents

• householdsreceivingupgrades;thehotlinenumberwasalsoincludedontheMoUandHandoverpapers

• residentsduringtechnicalassessments• during‘informationsessions’(CIL2017c;CIL2018a;DirectObservation2018;

IN532018;IN952018).

DuringPhaseIII,411callsby355differentpeoplewerereceivedthroughthehotline(CIL2018a,p.17).Howevertherearebarrierstotheuseofthehotline.Firstly‘thereislimitedawarenessontheuseandimportanceofthehotline…manypeoplehavethenumberbutdonotcallorarenotawarewhenandwhytheycancall’(CIL2018a,p.17;DirectObservation2018).Whenaskedwhytheydonotcontactthehotline-forexampleifthebuildingmaterialsinstalledhadstoppedfunctioning-residentssaidthattheydidn’tthinkanysupportwouldbeprovidediftheydid,indicatinglowlevelsofconfidenceandtrustinauthorities(FGM12018).Alternativelyresidentsnotedthattheyhadtoldtheirconcernstosomeoneinperson,perhapsthecontractor,orshelterofficerandtheydidnotwantto‘duplicaterequests’,howeverthismeantthattheirconcernwasnotsystematicallyloggednoraddressed(FGM12018;FGF72018;FGF92018).Ifcomplaints,referralsorrequestsweremadetofieldstaffthiswasdiscussedduringweeklyCIL/Akkarounateammeetingsandtheresidentwasaskedtocallthehotlinetorecordtheissue30.

30PersonalCorrespondence,CIL,23rdOctober2018

28

Somehouseholdswerealsonotabletocall,forexampleiftheydidnothaveafunctioningphone(IN532018).Finally,morethan40%ofhouseholdsthatreceivedhousingupgrades‘werenotawareofanymeansofreportingcomplaintsordisputes,despitethefactthatahotlinecardwasprovided’(CIL2018c,p.6;DirectObservation2018;IN632018).Consequently,therearekeylimitationsontheuseofthehotlineforeffectiveaccountabilityandtransparency-seesection4.3forfurtherdiscussion.Seealsosection4.3foradiscussionofbeneficiaryselectionandidentificationofcommunalupgradeprojects.Thetransparencyoftheselectionofpeopleandprojectsfortheprogrammearecriticalforaccountability.

Effectiveness:towhatextentweretheprogramobjectivesachieved?Asnotedabove(section3.1),theprogrammemetorexceededallitstargetsforobjective1:‘SyrianrefugeesandhostcommunityindividualshaveimprovedshelterandWASHconditionsinurbanTripoli’.InternalCIL/Akkarounamonitoringindicatedthat91%reportedsatisfactionwiththematerialsused(70%highlysatisfiedand21%satisfied),and95%reportedsatisfactionwiththequalityofworkoftheserviceprovider(84%highlysatisfiedand11%satisfied)(CIL2018a,p.5).Inthehouseholdswheretheupgradeswerecompletedsatisfactorilyandarecontinuingtofunctionthefeedbackwasverypositive;householdsdescribedtheupgradesas‘goodqualityconstruction’(IN722018)andthateverythingis‘workingperfectly’(IN462018).However,therewereanumberofitemsthatwerenotsatisfactoryincludedplumbingitems(e.g.mixertaps,leakingpipes,showermixers,waterheaters,toilets,incorrectelectricconnectionleadingto‘electrocuting’)andaluminumwindowswithbrokenlocks(CIL2018a;CIL2018c;DirectObservation2018;CIL2018f;IN742018;IN322018;FGF92018;IN232018).AnumberofthepoorlyfunctioningitemswerereportedinMankoubin(CIL2018a,p.5;DirectObservation2018).AlsoinMankoubin,andpotentiallylinkedtothelowerlevelofsatisfactionwiththequalityofconstruction,residentsnotedthatsomeofthecontractorswerenotadequatelyskilled(CIL2018a,p.5;IN232018).Furthermore,aCIL/Akkarounapost-implementationmonitoringreport,fromMay2018,undertakenthreemonthsaftersomeoftheupgradeswerecompleted,reportsthat79%ofthefamiliesstillresidingintherehabilitatedshelterstatedthatalloftheitemsrepairedorinstalledduringtheconstructionworksarestillfunctioning,whilst21%notethatonly‘mostofthem’are(CIL2018c,p.5).Thishighlightsthataround20%ofhouseholdsarereportinghavingsomeitemsthatarenotfunctioningwithinjustthreemonthsoftheworkbeingcompleted.Thecommunalprojectsseemtohavebeenofvariedqualitywithsomeitemsfunctioningwellandappearingwellinstalled(e.g.thestreetlights),andothersraisingconcernsabouttherobustnessofconstruction(e.g.thesewerpipeinShok)(DirectObservation2018)-SeeAnnexBforfurtherdetails.Constructionqualityvariedbetweencontractors(IN952018).Duetothechallengesdiscussedabovewiththeuseofthehotline,theinternalmonitoringreports,andtheepisodicfeedbackreceivedinthefocusgroupsanddirectobservationvisitstopropertiesconductedaspartofthisevaluation,itispossiblethattherearealargernumberofitemsthatarenotfunctioningthaniscurrentlyreported.Thenumberofhouseholdswithitemsthatarenotcorrectlyfittedorofappropriatequalitywillsignificantlyaffecttheextenttowhichtheprogrammeachievesobjective1;thisisanimportantareaforfurtherenquiry.

29

Asnotedabove(section3.2),theprogrammemetitstargetsforobjective2:Syrianindividualsandhostcommunityindividualshaveenhancedknowledgeofandaccesstoprotectionservices.InternalCIL/Akkarounamonitoringdatahighlightsthatinpre-posttests,87%ofattendeestothePPhaveincreasedknowledgeofprotectionneedsandrights,withanevenhigherpercentagereportingincreasedknowledgeinfocusgroupdiscussions(96%)(CIL2018a).Withrespecttoaccesstoprotectionservices,asnotedabove,therehavebeen68referralstospecialistprotectionservices.Thereisnoevidencetosuggestimproveddirectaccesstoprotectionservices(e.g.notvia.CIL/Akkarouna).Thereisnoprogrammeobjectivethatsetsouttheintendedeffectsoftheneighborhoodcommittees,thusthisisdiscussedbelow.

Impact:whatwerethemainimpactsandeffectsoftheprogramme?ThestatedgoalofPhaseIIIoftheIntegratedShelterandProtectionImprovementsprogrammeforSyrianRefugeesandHostCommunitiesinTripoli,Lebanon,isto‘contributetobuildingresilienceoftheaffectedpopulationinTripolithroughtherehabilitationofshelters,promotionofsocialprotection,anddevelopmentofsocialcapital’(CIL2017a,p.1).Thisisahighlyambitiousgoal,withanumberofcomplexcomponentsthatarenotdefinednordetailedintheprogrammedocumentation.ThissectionprovidesadiscussionoftheimpactofthePhaseIIIwork.Section4.0seekstoprovidefurtherclarityandconnectionbetweentheactivities,outputs,outcomesandimpactsoftheprogrammeacrossPhasesI-IIIthroughthedevelopmentofatheoryofchange.Itisrecommendedtoreadthetwosections,plusbox1,togetherforacompletepicture.TheprogrammeaimstocontributetobuildingresilienceoftheaffectedpopulationinTripolithroughtherehabilitationofshelter,thisalignswiththeIFRCFrameworkforCommunityResiliencewhichstatesthataresilientcommunity‘haswell-maintainedandaccessibleinfrastructure’((IFRC2014,p.11)SeeBox1).DuringPhaseIIIupgradeswerecarriedouton559housingunits,tovaryingdegreesofsatisfaction(seediscussionaboveunder‘effectiveness’).Forthosehouseholdsthatreceivedupgradesandtheitemswereappropriatelyinstalledandcontinuetofunction,theprogrammeachieveditsgoal.Many of the residents noted that the upgrades were ‘perfect’ and ‘excellent’ (FGM12018).Akeyprojectsuccessandessentialfactortosustainedresilienceisthehighpercentageofhouseholdswhoarestilllivingintheupgradedpropertiesthreemonthsaftertheworkswerecompleted.CIL/Akkarounareportthat95%ofhouseholdscontinuetoliveinthepropertiesfollowingtheupgrades,with3-4%‘movingtobiggerapartments,orleavingduetopersonalreasonsnotrelatedtoconflictswiththelandlord’(CIL2018a,p.6);only1-2%wereevictedorthreatenedwitheviction(Ibid).Inaddition,97%oftenantsreportedthatthelandlordsmaintained,ortoalesserextentloweredtherentalratesfollowingtheupgrades(Ibid).Nonegativeeffectsofthehousingorcommunalbuildingupgradeworkswerereported(FGF62018;FGF72018).TheprogrammeproposalalsostatesthatitaimstocontributetobuildingresilienceoftheaffectedpopulationinTripolithroughthepromotionofsocialprotection.Socialprotectioncanbedefinedasthe‘setofpoliciesandprogramsaimedatprotectingallpeopleagainstpoverty,vulnerabilityandsocialexclusion…withaparticularemphasistowardshelpingvulnerablegroupstosurvive,thriveandberesilientwhenfacing

30

shocksanddisasters,‘leavingno-onebehind’’(UNHCR2018,p.1).Thepoliciesandprogrammesrelatedtosocialprotectionaretypicallygroupedunderthreemainheadingssocialinsurance,socialassistanceandlabormarketregulation31(UNRISD2010;Browne2015).ThereisnoevidencetosuggestthatanyoftheactivitiesundertakenduringPhaseIIIsupportedimprovementsforpoliciesorprogrammesrelatedtosocialinsurance,socialassistanceandlabormarketregulation.Thisdiscrepancybetweenthegoalandtheactivitiesdeliveredisunderstoodtohavebeenaneditingerrorintheoriginalprogrammeproposal(CIL2017a);themainbodymainbodynarrativeoftheprogrammeproposalprimarilydiscusses‘protection’or‘community-basedprotection’;anddoesnotreferto‘socialprotection’.Greaterclarityofdefinitionoftheseprotectiontermsfromtheoutsetwouldbevaluableforfutureprogrammestobeclearabouttheirimpacts.Finally,theprogrammeaimstocontributetobuildingresilienceoftheaffectedpopulationinTripolithroughthedevelopmentofsocialcapital(seeBox2fordefinitionof‘socialcapital’).ThisalignswiththeIFRCFrameworkforCommunityResiliencewhichstatesthataresilientcommunityissociallycohesiveandisconnected[toexternalstakeholders]’((IFRC2014,p.11)SeeBox1).Theprogrammehasimprovedthepersonalrelationshipsofthecommitteememberswhohavemetregularlyoverthelastyear,andindeedduringPhasesIandIIformanyofthecommittees.ResidentsreportstrengthenedrelationshipsbetweenSyrianandLebanesecommitteemembers,forexample‘havingcoffeetogether’(IN532018;IN742018).Itwasobservedhoweverthatthisincreaseinpersonalrelationshipsocialcapitalseemstobeprimarilyfocusedonthecommitteemembers,andtoalesserextenttheattendeesofthePPandPSSsessions(CIL2018a).Residentsinvolvedinthehousingupgrades,andtheinteractivetheatreperformancesstatedthattheirrelationshipswithintheneighborhoodarethesame-notbetterorworse(IN722018;IN462018).Equally,whenitcomestosocialnetworksupport,thecommitteemembershaveimprovedtheirsocialcapitalbybeingabletorelyoneachother;butneighborhoodresidents,outsideofthecommitteehavereceivedlessbenefit.Forexamplethereis‘limitedawarenessontheavailabilityofcommitteesandtheirroles’(CIL2018a;IN322018;IN462018;IN722018).Seesection4.2forfurtherdiscussion. Also,whilsttherehavebeensuccessfulmeetingsbetweenexternalkeystakeholderse.g.themunicipalityandCSOs,whichhaveyieldedpositiveactions(forexamplethestreetsinShalfeh,AbuSamrawerecleanedfollowingthemeetingwiththeserviceproviderandthemunicipality);themeetingshavenotdemonstrativelyledtostrengthenedpersonalrelationshipsbetweentheresidentsandtheexternalstakeholders(FGM12018;IN062018;IN682018).Thiscouldperhapsbeattributedtothelimitedcontact(one-twomeetings),powerimbalancebetweentheexternalstakeholdersandthecommittees,orthemeetingshavingbeenfacilitatedbyCIL/Akkarouna.Furtherinvestigationintothestrengthandsustainabilityoftherelationshipsbetweenresidentsandexternalstakeholdersisrequired. 31Furtherdetail:1)Socialinsuranceconsistsofprogrammesprovidingprotectionagainstlife-coursecontingenciessuchasmaternityandoldage,orwork-relatedcontingenciessuchasunemploymentorsickness.2)Socialassistanceprovidessupportforthoseinpoverty.Normally,socialinsuranceisfinancedfromcontributionsbyworkersandtheiremployers,whereassocialassistanceistax-financed.3)Laborandemploymentregulationensurebasicstandardsatwork,andextendrightstoorganizationandvoice(UNRISD2010).

31

Finally,theprogrammedidnotincreasethesocialtensionsoftheneighborhoodswhereitwasimplementedalongnationalorgenderlines.Whilstthiswasnotastatedgoalorobjective,itisanimportantaspectofthe‘donoharm’humanitarianprinciple(TheSphereProject2011).Forexample,akeyfactorthatunderpinnedthiswas‘thatbothSyrianandLebanesewerebenefitingfromtheproject,thereforetherewerenoissuesbetweenbothsides’(CIL2018a;CIL2018c).Asaresult,attendeesofthePPsessionsreportedthat‘tensions[betweenresidents]remainedthesame’(CIL2018f,p.9),thiswasalsoreportedtobethecaseforlandlordsandtenants(IN722018).Itisalsointerestingtonotethat48%ofcommitteemembersreportedreducedcommunitytensionwhentrackedviaabaseline/endline,comparedto27%ofthoseaskedinfocusgroupswhichincludedPPattendees,residentswhoreceivedhousingupgradesandcommitteemembers(CIL2018a);suggestingthatthecommitteemembersincreaseinsocialcapital,asdescribedabove,supportedtheirperceptionthattherewerereducedcommunitytensions.Howeverthreemonthsfollowingthehousingupgrades,46%ofresidentswhobenefitedfromthisaspectoftheprogrammealsoreportedreducedcommunitytensions(Ibid).Furtherinvestigationisrequiredtoexplorethedifferentperspectivesassociatedwithcommunitytensions.Moreover,asiscommoninhumanitarianprogrammesthereweretensionsreportedbetweenthosethatreceivedsupportfromCIL/Akkarouna,andthosethatdidnot;primarilycenteredaroundthehousingupgrades(CIL2018f;FGF72018;FGF92018)-seesection4.3forfurtherdetails.Box2:WhatisthedifferencebetweenSocialCohesionandSocialCapital?Asistypicalwithmanytermsusedinthehumanitariansectortherearenouniversallyagreedupondefinitionsof‘socialcohesion’and‘socialcapital’;withhumanitarianactorsandacademicstypicallydevelopingtheirownworkingdefinitions(WorldVisionInternational2015;Scrivens&Smith2013).Forexample,Grootaert&Bastelaer(2002)notethatoneofthedifficultiesassociatedwithsocialcapitalisthe‘varietyofdefinitionsthatexist,whichmakesitalmosteverythingandclosetonothingspecific’(Grootaert&Bastelaer2002,p.5).Socialcohesioncanbedefinedasthe‘natureandsetofrelationshipsbetweenindividualsandgroupsinaparticularenvironment(horizontalsocialcohesion)andbetweenthoseindividualsandgroupsandtheinstitutionsthatgoverntheminaparticularenvironment(verticalsocialcohesion).Strong,positive,integratedrelationshipsandinclusiveidentitiesareperceivedasindicativeofhighsocialcohesion,whereasweak,negativeorfragmentedrelationshipsandexclusiveidentitiesaretakentomeanlowsocialcohesion’(WorldVisionInternational2015,p.9).Othersdefinesocialcohesionasthe‘theon-goingprocessofdevelopingacommunityofsharedvaluesandchallengesandequalopportunitybasedonasenseofhope,trustandreciprocity’(Jeannotte,1997,inShuayb,2012:19(Mourad&Piron2016)).Equally,thereisamultitudeofapproachesto‘measuring’SocialCohesion.Forexample,arecentUSAIDpublication-evaluating‘TheNeighborhoodApproach’inanumberofurbanprogrammesacrossLatinAmericanandCaribbeanwithastrongDRRfocus–developedaSocialCohesionIndextomeasuretheperceivedsocialcohesionattheneighborhoodlevel.Thefollowingcategorieswereidentifiedintheindex: 1) Willingnesstoworktogether; 2) Helpingeachotherduringanemergency; 3) Belongingtothisneighborhood; 4) Havingasenseofcommunity(2018).Otherauthorsidentifydetailunderaseriesof‘domains’(Forrest&Kearns2001)-seefigurebelow.Furthermore,theOECDnotethatpossibleindicatorscanincludefrequencyofviolentinter-groupincidences(harassment,bullying,discrimination,isolation)orcommunicationof

32

negativefeelings(scapegoating,intergroupanxiety,perceptionsofthreat(2013).Socialcapitalcanbedefinedthroughfourrelatedcategories:1)personalrelationshipsandthesocialbehaviorsthatcontributetoestablishingandmaintainingthosenetworks,suchasspendingtimewithothers,orexchangingnewsbytelephoneoremail;2)Socialnetworksupport,whichisadirectoutcomeofthenatureofpeople’spersonalrelationships,andreferstotheresources–emotional,material,practical,financial,intellectualorprofessional-thatareavailabletoeachindividualthroughtheirpersonalsocialnetworks;3)Civicengagement,whichcomprisestheactivitiesandnetworksthroughwhichpeoplecontributetocivicandcommunitylife,suchasvolunteering,politicalparticipationandgroupmembership;4)Finally,trustandcooperativenorms,referringtothetrust,socialnormsandsharedvaluesthatunderpinsocietalfunctioningandenablemutuallybeneficialcooperation(Scrivens&Smith2013).Finally,thereisnocommonunderstandingofthedifference,oroverlapbetweensocialcohesionandsocialcapital.Howeversomeresearchersidentifysocialcapitalasasubsetofsocialcohesion(Forrest&Kearns2001).

33

4.0Findings:ContributionAnalysisThissectionofthereportpresentsthefindingsfromthe‘ContributionAnalysis’ofPhasesI,

IIandIIIoftheIntegratedShelterandProtectionImprovementsprogrammeforSyrian

RefugeesandHostCommunitiesinTripoli,Lebanon.

4.1TheoryofchangeGoal:TheultimategoalistocontributetobuildingtheresilienceofvulnerableneighborhoodcommunitiesinTripoli32Outcomes:Theprogrammeaimstocontributetobuildingresilienceby:

• Increasingaccesstoinfrastructure(throughupgradinghousingunitsandimplementingneighborhoodbuildingandstreetupgrades);

• Increasingtheknowledgeoftheresidentsaboutprotectionissues(throughsupportingrelevantinteractiveperformancesanddeliveringawarenessraisingsessionsforadultsandchildren);

• Improvingthehealth33oftheresidents(throughupgradinghousingunits,neighborhoodcommunalconstructionprojectsandrunningtrainingsessions);

• Increasingthecommunitycohesion(throughestablishingtheneighborhoodcommitteesandrunningawarenessraisingsessions);

• Increasingtheconnectivitybetweenresidentsandexternalstakeholders(throughintroducingtheneighborhoodcommitteestothemunicipalityandCSOs)34.

Figures3and4illustratethetheoryofchange:whilstforformattingpurposesthisspanstwopages,thetwodiagramsworktogethertolinktheprogrammeactivities,outputs,outcomesandultimategoal.Figure3detailsthelinkagesbetweentheactivitiesandtheoutputsandrelatesthekeyenablingfactorsandchallengestospecificactivities(seeSection3.1forfurtherdetailsontheactivitiesandoutputsandsection4.3foradiscussiononenablingfactorsandchallenges).Figure4detailsthelinkagesbetweentheoutputs,theoutcomesandthegoal(seeSection4.2forfurtherdetailontheoutcomesandsection4.4foradiscussionaboutthekeyfactorsforsustainability).Box3:Whatisatheoryofchangeandhowdoyouuseit?Atheoryofchangeisacomprehensivedescriptionandillustrationofhowandwhyadesiredchangeisexpectedtohappeninaparticularcontext.Thedesiredlong-termgoalisfirstidentifiedandthenworkedbackwardtoidentifyalltheconditions(outcomes)thatmustbeinplace,andhowtheyrelatecausally,forthegoaloccur.Thetheoryof 32‘Community’isatermthatneedstobeusedwithcareespeciallywhendiscussingurbanenvironments.Inthistheoryofchange‘community’isusedtoindicateacommunityofplace,meaningtheresidentsthatliveintheneighborhoodwhereCIL/Akkarounawork.33HealthdefinedbytheWorldHealthOrganizationas‘astateofcompletephysical,mentalandsocialwell-beingandnotmerelytheabsenceofdiseaseorinfirmity’(WHO2018).Furtherinvestigationintothemostusefuldefinitionof‘health’inthisprogrammecontextmaybeuseful.34TheseoutcomeshavebeendevelopedusingtheIFRCFrameworkforCommunityResilience(2014)andmuchoftheterminologyhasbeenretained(e.g.‘infrastructure’,‘health’etc).Testingandverificationofthesetermsandfurtherclarityaroundtheirdefinitionsisrecommendedforfurtherresearchtounderstandifadaptationisrequiredinthisprogrammecontext.PleaseseeBox1foradditionalinformationontheFrameworkandsection5forareasforfurtherresearch..

34

changeprovidesclarityamongstallstakeholdersaboutwhattheprogrammeisaimingtoachieve,whatdefinessuccessandwhatisnecessarytoachievethegoal(s).Thetheoryofchangeisapowerfulcommunicationtooltocapturethecomplexityandnuancesofanintervention.Throughthisapproachthelinksbetweentheactivitiesandtheoutcomesarebetterunderstood;andmoreclearlydefined,leadingtobetterprogrammeplanning.Atheoryofchangeisalsoakeytoolformonitoringandevaluationbecauseitispossibletomeasureprogresstowardstheachievementoflonger-termoutcomesandgoal(s)thatgoesbeyondtheidentificationofprogramoutputs

(CentreforTheoryofChange2018)


OUTPUT:Trained

individuals

OUTPUT:Commi7ees


MoU(CARE/AKK+Occupier/Landlord)

Handoverdocument


CA+commi7ees+residentsprepare

interac9vetheatre

CA+commi7ees+residentsgiveperformance

IVsinviteresidents

Residentsa7endPP+PPSsessions

Commi7eemembersmeetwithexternal

actors

Commi7eeintroducedtothecommunity

Commi7ee+residentscompletePASSA

Poten9alHHiden9fiedbycommi7ee,community,UNHCRor

Mun.

CARE/AKK+Mun.Iden9fypoten9al

Informa9onVolunteers(IVs)

CARE/AKK+Mun.Cost,feasibility,

sustainabilityassessmentof

projects

CARE+Mun.selectprojects


Contractor-Snagging


CARE/AKKmonitoring

CARE/AKKmonitoring

CARE/AKKmonitoring

CARE/AKKvulnerabilityassessment

CARE/AKKselect

households

CARE/AKKTechnical

assessment/BoQ


contractor

CARE/AKKselect+train

IVs

CARE/AKKselect+traincommi7eemembers

CARE/AKKiden9fy

commi7eemembers

CARE/AKKTechnical

assessment/BoQ


contractor

IVsrun

‘informa9onsessions’

CARE/AKKselect

residentstoinvitetotraining

56

Objec)ve1:Housingupgrades,communalconstruc)onprojects&commi=ees1.  Someresidentsdidnotconsidertheselec9onprocessforhousingupgrades

tobe‘fair’2.  Somehouseholdsreceivinghousingupgradesdidnotunderstandthe

upgradeprocess3.  Contractorsdidnotsystema9callycomplete‘snagging’items4.  Processtoiden9fyneighborhoodcommunalbuildingandstreetupgrade

projectswasnotop9mallytransparentandinclusiveObjec)ve2:Protec)on5.  Therewerenotenoughevents-quan9tyandfrequency-andenoughpeople

a7endingtobringtheresidentstogether(e.g.PP,PSS,interac9vetheatre)6.  PPandPSSsessionswererunbyadequatelyskilledtrainers*7.  Referralcaseswerenotsystema9callyfollowedupbyorganiza9onstowhom

thecaseswerereferred.

Programmewide(notindicatedonthediagram)9.  Deliveryofcombina9onofmul9-layeredsupport*10.  Formalandinformalstakeholderswereappropriatelyengaged*11.  Suitableprogrammemanagementprocesseswerechallenging:governance,

communica9onandprocurement12.  ResidentstrustedCIL/Akkarouna*13.  Religiousholidayswerenotsystema9callyplannedinto9meline14.  Timecon9ngencywasnotsystema9callyincludedtomi9gatetheriskof

securitydelays15.  One-yearfundingcyclesweretooshort

Keyenablingfactors

Enablingfactors(1-7)

Outputs

Ac9vi9esled/carriedoutby:

Contractors

Communitymembers

CARE&Akkarouna

CARE&Akkarouna&Municipality

Legend

9

Riskofnega,veimpact(e.g.increasecommunitytensions)

Figure3:Activitiesandoutputs

4

1 2

3

CARE/AKKreferpeopletoNGOs+Mun.

CARE/AKKfeedbackhotline

7

On-goingAc9vi9es(notsequen9al)

HousingunitUpgrades

Communalconstruc9onprojects

Training

Commi7ees

Handoverdocument


Contractor-Snagging

CARE/AKKmonitoring

3

Ac9vi9es Outputs Outcomes Goal


CARE/AKKmonitoring


OUTPUT:Trained

individuals


GOAL:Increasedresilienceofcommuni9es

OUTPUT:Commi7ees

2.Increasedknowledgeofresidents

3.Improvedhealthofresidents

Improvedprivacy+security

Reducedhealththreats(heat,cold,damp)

1.Increasedaccessto

infrastructure

Improvedhygiene

(washingandcookingprac9ces)

4.Increasedconnec9vitybetween

commi7ees+externalactors

Commi7eesare

empoweredtocommunicate

needstoexternalactors

Traininga7endeeschangeprac9ce

HHliveinunitswithsecureinternal+externaldoorsand

windows

Neighbourhoodhasimprovedstreetligh9ng

HHliveinunitswithnowateringress

HHliveinunitswithsafeelectrics

HHliveinunitswithimprovedWASHfacili9es

HHliveinunitswithadequateaccesstowater

Increasedself-confidenceof,andtrustbetweencommi7ee

members

Residentsknowthecommi7ee+understandtheirrole

Traininga7endeeschangeajtudes

5.Increasedcommunitycohesion

Increasedinterac9onbetweenresidents

Dependingontrainingtopic>outcome3.Improvedhealthe.g.improvedhygiene(asabove).

1.  Itemsinstalledaspartofhousingupgradesremainfunc9onalforanappropriatelengthof9me

2.  Adequatemaintenanceandappropriateuseofupgradeditemsbyhouseholds

3.  Adequatemaintenanceofneighborhoodassets4.  Commi7eesarerepresenta9veofthecommunity

andself-organized5.  Landlordscomplywiththecondi9onsoftheMOU6.  HouseholdsreceivinghousingupgradescontactCIL/

Akkarounawithconcerns,queriesandfeedback

Outputs

Outcomes

Outcomes(IFRC)

Goal

Higherlevelofcertainty,

evidencesupportsToC

Lowerlevelofcertainty,

inves9ga9onrequired

Legend

Figure4:Outputs,outcomesandgoal Ac,vi,es Outputs Outcomes Goal


Increasedempathy+

trustbetweenresidents

Keyfactorsforsustainability

37

4.2Programmeoutcomes

1.IncreasingaccesstoinfrastructureTheprogrammehascontributedtobuildingresilienceinurbanTripolibyincreasingaccesstoinfrastructurethroughupgradinghousingunitsandimplementingneighborhoodcommunalupgradeprojects.Between2015and2018theprogrammehasupgraded1671housingunits35andimplemented118communalprojects36.Housing:Asaresultofthehousingupgrades,themajorityofhouseholdswhoreceivedassistanceliveinpropertieswith:

• nowateringress(FGM22018;IN322018)• adequateaccesstopotablewater(FGM22018)• secureinternalandexternaldoorsandwindows(FGF72018;FGM22018;IN46

2018;DirectObservation2018)• safeelectrics(FGF92018)• improvedwaterandsanitationfacilities(CIL2018a;DirectObservation2018).

However,asignificantminorityofhouseholdswhoreceivedassistancereportproblemswiththework-possiblyasmanyas20%-withinthreemonthsoftheworkbeingcompleted(CIL2018c,p.5).Thiscallsintoquestiontheachievementandsustainabilityoftheprojectoutcomesinthisarea.Critically,afairlyhighpercentageofhouseholdsremainlivinginthepropertiesfollowingtheupgrade,whichiskeyforensuringthatthehouseholdbenefitsfromtheintendedoutcomes.Thepercentageofhouseholdslivinginthesamepropertyrangesfrom84%-PhaseI,twoyearsaftertheinterventionto95%-PhaseIII,threemonthsaftertheintervention(CIL2018a)-seetable6forfurtherdetails.Communalprojects:Asaresultofthecommunalprojects,theneighborhoodhas37:

• improvedstreetlighting(FGF62018;IN632018;IN802018;DirectObservation2018).

Wherethequalityofconstructionandmaterialsisadequate,thisoutcomeiscumulativeinthethreeneighborhoodswhereCIL/AkkarounahasworkedduringPhaseI,IIand/orIIIaseachyearadditionalhouseholdshaveincreasedaccesstoinfrastructure.

35Thistotalisaggregatedfrom559housing(PhaseIII),600housingunits(PhaseII)and512housingunits(PhaseI).36Thistotalisaggregatedfrom35projects(PhaseIII);40projectsaffecting50,390individuals(PhaseII);43projectsaffecting12825individuals(PhaseI).37Therewereawiderangeofcommunalprojects,frompurchasingwheeliebinsandinstallingroofsonstairs(PhaseII)torehabilitationofbuildingblocksandthecreationofparkspaces(PhaseI).Eachofthesecommunalprojectshasadifferentsetofoutcomes.ForthisiterationoftheTheoryofChangethesolarlightshavebeenhighlightedasacommonprojectacrossthethreephases;mappingallthecommunalprojectswouldrequireadditionaldataandmakethetheoryofchangeun-necessarilycomplex.Furtherinvestigationexploringandmappingfuture/proposedcommunalprojectsinPhaseIVandbeyondisrecommended.

38

Table6:Evictionratesfollowingupgrades

%offamiliesstillresidinginthesamedwelling

Evictionrate

RiskofEviction Movement

PRMIIIbeneficiaries3monthsafterintervention(PIMresults-May&July2018)

95% 1% 1% 4%

PRMIIbeneficiaries6monthsafterintervention(Outcomemonitoringreport-February2018)

86% 3% 2% 9%

PRMIbeneficiaries6monthsafterintervention(Outcomemonitoringreport-March2017)

88% 5% 13% 7%

PRMIbeneficiaries2yearsafterintervention(Outcomemonitoringreport-June2018)

84% 2% 0% 14%

Reference:(CIL2018a,p.8)

2.IncreasingtheknowledgeoftheresidentsTheprogrammehascontributedtobuildingresilienceinurbanTripolibyincreasingtheknowledgeoftheresidentsthroughsupportingtheatreperformancesanddeliveringawarenessraisingsessionsforadultsandchildren.DuringPhaseIII,preandpost-tests87%oftheresidentswhoattendedthePPsessionsdemonstrateincreasedknowledgeofthetopicscovered(CIL2018a).Topics covered in Phase II included tenancy rights, the services provided in legalassistance and counseling, earlymarriage, domestic violence, humanitarianprinciples,communication skills and referral pathways (Transformative and EmpoweringSolutionsLLC2017,p.14).DuringPhaseIawarenessraisingfocusedontenantsrights,WASH, hygiene promotion, earlymarriage, domestic violence, self-confidence and lifeskills(CIL2016).Asaresultoftheawarenessraisingsessionsandinteractivetheatre,theresidentshave

• changedattitudesaboutthetopicscoverede.g.earlymarriage,domesticviolence(IN532018;IN192018;IN062018;FGF72018)

• increasedinteractionbetweenresidents(FGM12018;IN532018)• increasedself-confidenceofcommitteemembers(IN152018).

ThisoutcomeiscumulativeinthethreeneighborhoodswhereCIL/AkkarounahasworkedduringPhaseI,IIand/orIIIaseachyearresidentsincreasetheirknowledgethroughattendingtheawarenessraisingsessions.

3.ImprovingthehealthoftheresidentsTheprogrammehascontributedtobuildingresilienceinurbanTripolibyimprovingthehealthoftheresidentsthroughupgradingthehousingunits,thecommunalupgradeprojectsandtheawarenessraisingsessions.Housingupgradesandcommunalupgradeprojects:Residentsreportthatasaresultoftheupgradesthereisnowateringressintotheirproperties(e.g.theroofnolongerleaks)theycan‘relaxanddon’tneedtoworry’(IN322018),they‘feelprotected’(IN232018)andtheirhealthhasimproved(FGM22018).Furthermore,householdsthatreceivedupgradestotheirelectricsreportthatitismuchsaferastheyarenotlinkinglivewiresbecausetheynowhaveon/offswitches(FGF92018).Theexposureofthese

39

residentstohealththreats(heat,cold,damp)hasreduced,whichcontributestoimprovedhealth(Fig4).Adequateaccesstopotablewater(e.g.asaresultofthetanksinstalled)hasreducedtheamountoftimehouseholdsspendsourcingwater.Residentsreportthattheyare‘emotionallybetternow,withlesstimethinkingaboutthisproblem’(FGM22018).This,combinedwiththeimprovedtoiletandkitchenfacilities(e.g.sinks,taps)hasledtoimprovedhygienepractices(CIL2018a;FGF62018;CIL2017b),whichcontributestoimprovedhealth(Fig4).Residentsreportthathavinginternaldoorsbetweensleepingareasandbathroomshaveresultedingreaterprivacyfortheoccupants(FGM22018;IN462018;IN632018).Theabilitytolocktheexternaldoorsandwindows:‘makesourliveseasier…[we]canleavethehouseandnotworryaboutourbelongings’(FGF72018);overallresidentsreportfeelingsaferasaresultofthemetalsteeldoorsinstalled(CIL2018a).Thesolarstreetlightshavealsoincreasedthesenseofsafetyandsecurityoftheneighborhood:‘theshapeofthewholestreethaschanged’(IN632018),residentsnotethattheyarelessconcernedaboutmovingabouttheareaatnight,anddosomorefreely(IN682018;IN802018;FGM22018;FGF62018;IN632018).Thisreportedimprovementinprivacyandsecuritycontributedtotheimprovedhealthofresidents(CIL2017b).However,asmentionedpreviously,householdswhohadsomeupgradeditemsthatwerenotfunctioningcorrectlydidnotfullybenefitfromalltheseintendedoutcomes.Awarenessraisingsessions:Residentsnotethatasaresultofthesessionstheirincreasedknowledgehasledtoachangeinattitude,whichinturnhaschangedtheirpractice(behavior)(CIL2018a).Forexamplemanyfocusgroupsandintervieweeshighlightedthatparentshaveeitherstopped,orreducedthefrequencywithwhichtheysmacktheirchildrenandimprovedcommunicationasaresultofthePPsessions(IN532018;FGM22018;FGF72018;FG52018;IN192018;FGF92018;CIL2018a).Furthermorethesessionsonearlymarriageraisedawarenessofthedisadvantagesofmarryingbeforethebridewas18yearsold,andareductioninchild-bridesisreported(IN192018;IN532018;IN062018;FGF72018).Thisreportedchangeinattitudeandbehaviorcontributestoimprovedhealthofresidents(Fig4).Howeverwhilstsomeresidentsreportedachangeinattitudeandbehavior,othersnotedthat‘evenifyouattendthesessions,itisreallyhardtochange’(FGF92018);andthatsomepeopleliketoraisetheirchildrenthewaytheywereraised(FG52018)andthusbeliefsstayedastheywere(Ibid).InparticularearlymarriageforSyrians‘isdeeprootedinourtraditions,itishardtoconvincepeople’tochange(FGM12018).ThisoutcomeiscumulativeinthethreeneighborhoodswhereCIL/AkkarounahasworkedduringPhaseI,IIand/orIII.

40

4.IncreasingthecommunitycohesionTheprogrammemayhavecontributedtobuildingresilienceinurbanTripolibyincreasingthecommunitycohesion38throughestablishingtheneighborhoodcommitteesandrunningawarenessraisingsessions.Throughattendingcommitteemeetingsandtrainingsessions,committeemembersreportincreasedinteractionbetweenresidents(FGF92018;CIL2018a),forexampleimprovedrelationshipsbetweenSyrianandLebanesemembers:‘InthebeginningIcouldnotletanySyriansinmyhouse,Icouldnotallowit.NowIamabletoreceivethemintomyhouse'(IN532018),and‘therelationshiphasgotmuchbetterintermsofcommunication,beforeitwasveryweak’(IN192018).Thishasalsoledtoanincreaseinempathyandtrustbetweencommitteemembersandotherresidents,forexample‘wehavefriendshipnow,wehavecoffeeandcigarettes’(IN742018)and‘wehelpeachotheralot.Wehavegottoknoweachotherbetter’(IN532018;IN232018).Thecommitteeshaveprovidedtheopportunitytoforresidentstorecognizethattheyhave‘commonconcernsandproblemsandtheybringustogether’(FGM12018).AgapindataexistsforresidentswhoattendedPPorPSSsessionsonly(e.g.whowerenotcommitteemembersanddidnotreceivehousingupgrades).Itisnotcleartheextenttowhichtheirinteractionsincreased,andifthisledtogreaterempathyandtrust.Thisisanareaforfutureenquiry39.Furthermore,duringthefieldworkforthisevaluation,residentswhoarenotmembersofthecommittees-forexampleresidentswhoreceivedhousingupgrades-reportedthattheyhadnotheardofthecommitteesanddidnotknowwhatroletheyplayed(IN322018;IN462018;IN722018;IN632018).ThiswasinitiallyidentifiedduringPhaseIwhentheinternalmonitoringhighlightedthat67%ofresidentswereunawareofthecommitteesand85%werenotabletoidentifytheirroles(CIL2016).However,forthecommitteestobeeffectiverepresentativesoftheirareatheyneedtohaveapresenceandresidentsneedtobeabletoidentifyandengagewiththem(CIL2018a,p.12).Thisisanareaforfutureenquiry.Finally,thereistheopportunitythroughparticipationinPASSAtoincreasecommunitycohesion,boththroughincreasedinteractionandengagementincollectivedecision-making,butalsothroughincreasingprideandasenseofbelonging.Thisisanareaforfutureenquiry.FurtherinvestigationisrequiredtounderstandthecumulativeoutcomesofincreasedcommunitycohesionduringPhaseI,IIand/orIII.

38Pleasenote:CIL/Akkarouna’sinternalmonitoringreportingusedavarietyofdatacollectionmethods(Baseline/Endlinesurvey,PIMsurveyandFGDs)toidentify‘%ofcommunitymembersreportingreducedcommunitytensions’.Wherethedataisqualitative(e.g.intheFGDs)andhighlightswhyorhowthetensionswerereduced,thishasbeenincorporatedintothissection.ThePIMandEndline/Baselinesurveysdonotaskhoworwhythetensionswerereducedsoitisnotpossibletovalidatethedatacollectedthroughthesechannels.39Researchquestionsmayinclude:Didtheresidentsattend‘enough’awarenessraisingsessions?Whatis‘enough’?Isthereacriticalmass/number/percentageofresidentswhoneedtoattendthesessionstoincreasetheinteractionsacrossthewholeneighborhood?

41

5.IncreasingtheconnectivitybetweenresidentsandexternalstakeholdersTheprogrammemayhavecontributedtobuildingresilienceinurbanTripolibyincreasingtheconnectivitybetweenresidentsandexternalstakeholdersthroughintroducingtheneighborhoodcommitteestothemunicipalityandCSOs.ThroughtheirengagementinthecommitteesCARE/Akkarounareportthatthecommitteemembershaveincreasedinconfidence(IN152018;IN432018).Committeemembersreported‘feelingpowerfulandknowledgeableenoughtomakeachangeandsupporttheirneighborswhenneeded’(CIL2017b,p.18).Anintendedoutcomewasthatthe‘neighborhoodcommittees[would]beempoweredtocommunicateneedsfromthegrassrootscommunities[toexternalactors]’(CIL2017a,p.14).Furtherinvestigationisrequiredtovalidatethisoutcomeandconfirmtheircontributiontoincreasingtheconnectivityoftheneighborhood.Finally,thereislimitedevidencetosuggestthatthecommitteesaredevelopingstrongbondswithexternalstakeholders,whonotethatthey‘prefertogothroughCARE/Akkarouna,tochanneleverythingthroughthem,sothereisachainofcommand[ratherthandirectlytoacommittee]’(IN682018)-Seefigure5.Meetingshavebeenheldwiththecommittees,municipalityandCIL/AkkarounasincePhaseIwiththesemeetingsfacilitatedbyCIL/Akkarouna(CIL2016).Thisisanareaforfutureenquirytobetterunderstandtheincreasedconnectivity.FurtherinvestigationisrequiredtounderstandthecumulativeoutcomesofincreasedconnectivitycohesionduringPhaseI,IIand/orIII.Figure5:Diagrammaticrepresentationofrelationshipbetweencommittee(s)andexternal

stakeholders

Externalactorse.g.municipality

CILandAkkarouna

Externalactorse.g.municipality

NeighborhoodResidents

NeighborhoodResidents

Wellfunc@oningcommiAeePoorlyfunc@oningcommiAee

A)Currentrela,onshipconnec,ons B)Desiredrela,onshipconnec,onsforimprovedsustainability

42

4.3EnablingfactorsandchallengesThefollowingenablingfactorsandchallengeswerefoundtoinfluencethespeedorcostofprogrammedelivery,orimpactonqualityofoutputsoroutcomes.

Objective1:Housingupgrades,communalupgradeprojectsandcommittees

Challenge:Someresidentsdidnotconsidertheselectionprocessforhousingupgradestobe‘fair’ThehouseholdstoreceivehousingupgradeswereselectedbyCARE/AkkarounafollowingaRAtoassesstheirsocio-economicandsheltervulnerability.ThePhaseI,IIandIIIproposalsidentifythatCAREwouldprioritizefemale-headedhouseholds,familieswitholderpersons,chronicallyill,disabled,familieswithmanychildren,andLGBTIcases(ProjectProposals,PhaseIII,IIandI).Howevertherearetwochallengesassociatedwithprioritizingthemostvulnerable.Firstly,forPhasesIIandIIItheprojecttargetstatedthat50%oftheresidentstoreceivehousingupgradeswereSyrianand50%Lebanese(forPhaseIitwas60%Syrianand40%Lebanese).TheneighborhoodswhereCIL/AkkarounaworkedhowevervaryincompositionfrommajorityLebanese(83%,Mankoubin)tomajoritySyrian(57%AbuSamra).The50%-50%targetwasachievedbyworkinginthesedifferentareastobalancetonumbersofSyriansandLebanesesupported(IN272018;IN062018).DuringPhaseIIIthepercentageofdifferentnationalityhouseholdssupportedineachareamirroredthetotalpercentageofthenationalityinthatarea-seeTable7.DuringPhaseItheprogrammemayhavenegativelyaffectedthecommunityinMankoubinbyinitiallysupportingagreaterpercentageofSyrians,withtheLebaneseresidentsfeelingitwasnot‘fair’astheywerealsovulnerable(IN062018);infact‘themostvulnerablehousesselectedtendedtobeLebanesehostsmorethanSyrianrefugees’(CIL2017b,p.2).

Table7:Residentsdemographicsbyneighborhoodandnationality

NeighborhoodDemographics:%ofcommunityproportion Syrian Lebanese OtherMankoubin 15 83 2WadiNahle 33 64 3AbuSamra(Shalfeh-Shok) 57 42 1PhaseIII:%ofcommunityproportiontoreceiveupgradesMankoubin 16 84 0WadiNahle 54 46 0Shalfeh 93 7 0Shok 65 35 0

Reference:(CIL2018a),PersonalCorrespondenceCIL,5thOctober2015Secondly,theprojectaimstotargetthemostvulnerablewhosepropertiesareinverypoorconditionandrequiresignificantinvestment(IN272018).DuringtheRAthepropertiesaregradedbasedontheirsheltervulnerability(e.g.severelyvulnerable,highlyvulnerable,moderatelyvulnerable,mildlyvulnerableetc.).Theprojectbudgetis$1,500/unit,butthecostofupgradingtheseverelyandhighlyvulnerablepropertiescangreatlyexceedthis.ForexamplethecostsoftheupgradesduringPhaseIIIrangedfromUSD$11,170toUSD$10040.Itisdifficulttoworkwiththemostvulnerablehouseholds 40PersonalCorrespondence,CIL,4thOctober2018

43

andadditionalfundsarerequiredtoretainthequalityofupgradeswithoutreducingtheprojectscope(IN272018;IN952018).Thedifferentpropertiesneededtobebalancedsothattheprogrammetargetsweremetwithinthebudgetavailable(IN272018);consequentlyitispossiblethatthenumberofvulnerablehouseholdsrequiringassistancefortunatelyself-balanced;alternativelyitispossiblethatfewervulnerablehouseholdswereassisted,orthatsomevulnerablehouseholdsdidnotreceivethesamelevelofupgradesasothers.CIL/Akkarounareportthattheyre-visitedpropertiestoexplainthebeneficiaryselectionprocessandwhyahousewasnotselectedforupgrade(IN152018)andexplainedtheselectioncriteriainvariousmeetingsduringPhasesI-III(IN062018;IN952018).However,thismaynothavebeendonesystematicallybecauseresidentsreportthatwhilstsomehouseswereassessedCIL/Akkarouna‘didnotcomebackanddidnottellthemwhytheywerenotincludedintheprogramme’(FGF72018)orthattheyasked‘the[CARE/Akkarouna]engineers,buttheengineersdon’tknow,thiscreatedlackoftrust’(FGM22018).Furthermore,someresidentsconsideredthatLebanesehouseholdswerebeing‘discriminatedagainst’(FGF62018);andthat‘manyhouseholdswerenotinneedandtheywereupgraded;buttherewereotherhouseholdsmoreinneed’(FGM22018;FGF92018).Thisreflectsthechallengeofdeliveringatargetof50%Syrian,50%LebanesehouseholdsreceivinghousingupgradesinneighborhoodsthathadmajorityLebanesepopulations;asaresult‘someSyrianhousingunitswereselectedalthoughlessinneedinordertomeettheindicatorthatholdsthe[50%]populationratio41.Finally,asaresultofthelackoftransparencyassociatedwiththebeneficiaryselectionprocessoneresidentalsoraisedaconcernthatpreferencewasgiventoresidentswhowereregisteredtovoteinAkkar(ratherthanTripoli)forpoliticalgain(becausethefounderofAkkarounaisaMinisterinAkkarandmanyresidentsintheprojectareaareactuallyregisteredtovoteinAkkar(IN802018)).ThisisunsubstantiatedhoweverastheAkkarounafoundersdonothavepoliticalbackgrounds42.Thisissuefurtherhighlightstheimportanceofclearlycommunicatingthebeneficiaryselectionprocess;notonlytopreventincreasingcommunitytensions,butalsotoprevent‘falsehoods’or‘rumors’thatcanalsocausereputationaldamageanderodetrust.

Recommendations:

• Makethebeneficiaryselectionprocessmoretransparent.Improvecommunication

withallresidents(notjustthosereceivinghousingupgrades)abouttheselection

criteriae.g.installaneighborhoodnoticeboard;systematicallyvisitalltheproperties

thatwereoriginallyassessedandhandoutleafletstoexplaintheprocessandthe

criteria,ensurethatallprogrammestaffunderstandtheselectionprocessandcan

explainit(includingengineers)etc.

• Investigatea‘fair’targetingapproachinaTripolicontext.Forexample,linkthetarget

%ofhouseholdstoreceiveupgradesofdifferentnationalities(e.g.Syrian/Lebanese)to

thetotal%populationintheneighborhood,sothatitisproportionalseemstobeseen

asa‘fair’approach,continuetomonitor;thismaynotalwaysbe50-50%dependingon

theneighborhoods.Analternativeapproachwouldbetolinkthetarget%tothe

relativeproportionof‘vulnerable’households-inthiscasecarewouldneedtobetaken

toensurethatthevulnerabilityassessmentprocesswastransparentandwell

communicated.

41CIL/Akkarouna,PersonalCorrespondence,19thOctober2018;(IN272018)42CIL/Akkarouna,PersonalCorrespondence,19thOctober2018

44

• EngagePRMinscenarioplanningtodeterminetheirprioritiesandpreferences(e.g.A

potentialquestionwouldbe:‘TheinitialRAsindicatethatwehavealargepercentage

of properties that require significant investment (<USD$4,000),would youpreferwe

addressthesepropertiesandmeettheneedsofthemostvulnerableandthusneedto

set new targets? Or would you prefer that we keep to our targets and balance the

highercostunitswithsomelessvulnerablehouseholds?’)

• Undertake a cost-benefit analysis to understand at what point is an investment to

upgrade a property not the best option; is there an upper-cost threshold e.g. what

otherpropertiesareavailabletorentorpurchase?

Challenge:SomehouseholdsreceivinghousingupgradesdidnotunderstandtheupgradeprocessTheprogrammeseekstosupportthemostvulnerableresidents,theymaybeilliterate,overwhelmed,haveadisabilityorotherbarrierstothemengagingwithprogramme.Residentsdonotalwaysunderstandtheconstructionprocess,forexamplethesignificanceofsigningtheMoUsandHandoverdocuments,norwhen/whytocallthehotline(IN952018).SomeresidentsalsobelievethattheyarereceivingmoreupgradesthanpreviouslyagreedwithCIL/Akkarouna(CIL2016).Thishasimplicationsfortheconstructionqualityandthelevelofhouseholdsatisfaction.

Recommendations:Additionalsupportisrequired.Thiscouldtaketheformofimproved

communicationbetweenCIL/Akkarounaandresidents(e.g.distributionofleafletsthat

betterexplaintheprocessatthekey‘contactpoints’),orsignificantsupport(e.g.a

‘residentliaisonofficer’whowouldberesponsibleforworkingwitheachhouseholdto

ensuretheyaresufficientlywellinformedabouttheirresponsibilitiesateachstage,the

significanceofthesignoffsandhowtousethenewlyinstalleditems.Itwouldbeadvisable

forthispersontositintheprotectionteam).Alternativelyitmightbepossibletoidentify

additionalsupportformorevulnerablehouseholdsfromwithintheneighborhood(e.g.

throughthecommitteesorresidentswithconstructionexperience).43Seealsosection4.4.

‘HouseholdsreceivinghousingupgradescontactCIL/Akkarounawithconcerns,queriesandfeedback’.

Challenge:Contractorsdidnotsystematicallycomplete‘snagging’44items.SomeresidentsreportthataftersigningtheHandoverpaper,some‘snagging’itemsremainedoutstanding(FGF72018).Inonefocusgroupresidentshighlightedthattheprotectionofficershademphasizedhowimportantitwastonotsignthehandoverpapersuntiltheworkhadbeencompletedsatisfactorilyandhowvaluabletheyhadfoundthisadvice(FGF72018).

Recommendations:Reviewthesnaggingprocess,andmakeanynecessarychangesto

ensureallitemsgetcompletedsatisfactorily.EnablingFactor:PPandPSSsessionswererunbyadequatelyskilledtrainers.TheChallenge:Processtoidentifyneighborhoodcommunalbuildingandstreetupgradeprojectswasnotoptimallytransparentandinclusive

43Forexample,onecommitteememberreportedoverseeingtheconstructionandpassingonfeedbacktothecontractor-thereweresomeelectricwiresthatshouldhavebeeninternal,butwereexternallyinstalled.Hisfeedbackwasnottakenonboard,andthewiresarestilllocatedoutside.OnlyatalaterCARE/Akkarounaevaluationsessionwasheabletogivefullfeedback[andfeellistenedto](IN742018).Thisroleofresident/overseerwouldneedtobeformalized;thereislikelytobeagender-elementthatmayneedinvestigating(asitwouldtypicallybemenworkinginconstruction).44Snagging’istheprocessofcheckinganewbuildingforminorfaultsthatneedtoberectified.

45

DuringtheearlierPhasesoftheprogrammethecommunityprojectswereidentifiedby‘thinkingofsolutions/activitieswhichINGOsarefamiliarwith–suchassolarlighting,ratherthanexploringproblemsfirstandthenworkshoppingpossiblesolutions’(IN432018).InPhaseIIIPASSAwasusedtodevelopamoreintegrated,participatorybottomupapproach-seesection3.1.TheuseofPASSAengagedcommitteemembersandotherresidentsandledthemthroughaprocessofcollectivedecision-makingandprioritization.HoweverfollowingPASSA,CIL/Akkarounaundertookfieldvisitswith‘focalpoints’fromtheattendeesandadditionalprojects(notpreviouslydiscussed)wereidentifiedandselectedforimplementation.ThisfinalstepintroducesalayerofambiguityaboutthedecisionsandunderminesthePASSAprocess,potentiallyleadingtodissatisfactionorincreasedneighborhoodtensions.InternalmonitoringdocumentsindicatethatinAbuSamraandWadiNahle‘thecommunalprojectsdonewerenotveryknowntothepublicbutoncetheywerementioned,participantsflaggedtheirneedintheareas’(CIL2018a,p.9).Thelimitedawarenessofthecommunalbuildingandstreetupdateprojectsbytheresidents;couldbeattributabletothembeingdeliveredinthelastquarterofprogrammeimplementation(Ibid).

Recommendations:

• ContinuetousethePASSAprocess,butdonotundermineitbymakingdecisionsor

prioritizingprojectsinbi-lateralmeetings.Seekopportunitiestostrengthenthe

PASSAprocess,forexampleratherthanthesuggestedprojectsbeinganalyzedand

assessedbytheprojecttechnicalteamandthemunicipality,involvetheresidents.

Engagethewidercommunity(e.g.notjustthoseattendingthePASSAsessions);for

exampleholdaneighborhoodmeetingwherethecommitteepresentsomeofthe

suggestedprojectstoallresidentsandcollectfeedbackandhelpprioritizeneed.

• Followingthecompletionofthecommunalupgradeprojectsitmaybeusefulto

revisitthePASSAprocess(perhapsanabridgedversion);tore-assessthesituation

andreprioritizeneed.Thiswouldleavethecommitteeswithausefultoolor

documentforfutureadvocacywithexternalactorsthatcancontinuebeyondthe

endoftheprojectfunding.

• Scheduletheneighborhoodcommunalbuildingstreetupgradeprojectsforearlyin

theprogrammetimeline(ideallyinthefirsthalf)tobettercatalyzetheopportunity

tobringtogetherresidents.

Objective2:ProtectionChallenge:Therewerenotenoughevents-quantityandfrequency-andenoughpeopleattendingtobringtheresidentstogether(e.g.PP,PSS,interactivetheatre).AnumberofhouseholdswhoreceivedhousingupgradesreportthattheywerenotinvitedtoattendPPorPSSsessionsandwerenotawarethattheywerebeingconducted(IN632018;IN322018;IN462018;IN722018).ThePPandPSSsessionsareaimedatfamilieswithchildrenaged6-17,consequentlyresidentswhoarenotparentswithchildren,werenotinvitedtoattendthesessionsanddidnotexperiencethebenefitsof‘increasedknowledge’,leadingtoincreased‘communitycohesion’,infactbetween6and14%ofthetotalpopulationattendedthePPandPSSsessionsineachneighborhood–seeFigure6.

46

Figure6:PercentageoftotalpopulationthatattendedPPorPSSsessions

Furthermore,asdiscussedinSection4.2,residentswerenotwellinformedaboutthecommitteesandtheroletheyplayed.DuringPhaseIIandIIIthecommitteememberswereintroducedtotheneighborhoodatsinglelargeevents(e.g.theinteractivetheatreinPhaseIIIand‘introductoryevents’inPhaseII,whichalsohadanelementofinteractivetheatre)forthewholetargetareae.g.onemeetinginWadiNahle,oneinMankoubinandoneinAbuSamra.Thenumberofattendeesrangedfrom150-600(CIL2017b).Committeememberspresentedtheirwork,andtalkedabouthowtheywouldplayanactiveroleintheircommunity(Ibid).

Recommendations:

• Providetheopportunityforincreasedinteractionbetweenresidents;itislikelythat

manydifferenteventsandmeetingsarerequiredthatarebothtargeted(e.g.women’s

groups,youthgroups,men’sgroups,baby/toddler/mothergroups)and

intergenerationalandintercultural(e.g.theinteractivetheatre).Supportingexisting

organizations/institutions–suchasschoolsorlocalCBOs-torunsessionsmightbea

cost-effectivewaytouseexistingresourcesanddevelopasustainableapproach.

• Increasethevisibilityofthecommittee(e.g.moreregularmeetings/eventse.g.PASSA

presentationasnotedabove,andaneighborhoodnoticeboard;smallerscale

introductoryeventsfocusingonintroducingonlyonecommitteetotheresidentsinthe

areathattheyrepresent,makecommitteemeetingsopentoallresidents,make

meetingminutesavailabletoallresidents).

146

262

5716

A)endeestoPPsessions

A)endeestoPPSsessions

Non-a)endees

Mankoubin

147

575

5,049

1

2

3

324449

11,910

1

2

3

WadiNahle AbuSamra(ShokandShalfeh)

146

262

5716

A)endeestoPPsessions

A)endeestoPPSsessions

Non-a)endees

7%ofpopula:ona;ended

14%ofpopula:ona;ended 6%ofpopula:ona;ended

A#endeestoPPsessionsA#endeestoPSSsessionsNon-a#endees

47

Box5:PPandPSSsessionsrecommendations

• Selectvenuesclosetowherepeoplelivesotheydon’thavetotravelfar• Askattendeesabouttheirpreferenceandavailabilitysothatyoucanschedule

thesessionsatthebesttimeforthemajoritytoattend• Sessionsjustwithmen,orjustwithwomenworkbest-itallowsthemtoopen

upmore• Groupsofabout10attendeesisoptimum• SchedulingPPandPSSsessionsatthesametime(e.g.torunsimultaneously)

workswellbecausethenthechildrenareoccupied/lookedafterinthePSSsessionandtheparentscanbetterconcentrateonthecontentofthePPsessions.

(IN742018;FG52018;IN192018)EnablingFactor:PPandPSSsessionswererunbyadequatelyskilledtrainers.TherecruitmentprocessandtrainingoftheIVsresultedinsuitablyqualifiedtrainerswhofacilitatedqualitydiscussions.Attendeesreportthatthe‘facilitatorsinthesessionswerespecialized[and]wereverygood’(FGF92018;FGF72018).TheIVsweresupportedbytheAkkarounafieldstafftowhomtheyescalatedconcernsandissues(FG52018).Asnotedearlier,ofthenineIVs,sevenwerefemaleandtwoweremale.

Recommendation:Continuethisapproachforfutureprogrammes.Investigateifthegender

oftheIVsimpactsontheattendeestotheadultawarenessraisingsessions(e.g.aremen

morelikelytoattendsessionsiftheyarerunbyothermen?)

Challenge:Referralcaseswerenotsystematicallyfollowedupbyorganizationstowhomthecaseswerereferred.DuringphasesI,IIandIIICIL/AkkarounahavereferredresidentstospecialistNGOsorotheragencies(e.g.UNHCR)forarangeofissuessuchasdrugaddiction,healthissues,domesticviolenceoreducationservices.Therearenoprotectioncase-officersemployedbyCIL/Akkarouna.CIL/Akkarounafollowupwiththespecialistagencytoconfirmifthecaseisclosedornot;howeversomeoftheagencieshavelimitedresourcesandcannottakeallthecases,andthelessurgentcaseswerenotbeingclosed(IN062018).

Recommendation:Furtherinvestigationisrequiredtovalidatethisfindingandto

recommendamendmentstotheprogrammebasedontheavailableresources.

ProgrammewideEnablingfactor:Deliveryofacombinationofmulti-scaleandmulti-sectoralsupport.Themulti-layered/scaleapproachthattheprogrammetakes,throughdeliveringhousingupgradestohouseholds,buildingupgradestoclustersofhouseholds,streetupgradesandawarenessraisingsessionsforthewidercommunity,providestheopportunityforallresidentstobenefit(IN432018;IN272018),withtheaimofmitigatingtheriskofcreatingtensionsorinequalitiesandafocusona‘donoharm’approach(CIL2017b).Furthermorethemulti-sectoralapproach-incorporatingshelter,WASHandprotectionsupport-offersresidentsamoreholisticresponsetotheirneeds(IN432018),andcreatesopportunitiesforthedifferentpartsoftheprogrammetosupporteachothersymbiotically(e.g.demonstrateresultsthroughthehousingupgrades,whichhelpsbuildtrustwithresidentsleadingtoimprovedengagementandprotectionsupportopportunities(IN062018).

Recommendation:Continuetodelivermulti-scaleandmulti-sectorsupportintheaffected

neighborhoods.

48

Enablingfactor:Formalandinformalstakeholderswereappropriatelyengaged.TheneighborhoodswhereCIL/Akkarounaareworkinghaveacomplexgovernancestructure,withformalandinformalactorsexertingdifferentlevelsofinfluenceandinterest.Stakeholdermappingexerciseswereundertakenearlyonintheproject,alsoduringimplementationthisanalysiswasupdatedasneedsemerged(e.g.ifresidentsrequesteddrugabuseawarenessCILidentifiedNGOsworkinginthisarea)45.ThroughouteachofthePhasesoftheprogrammeCIL/Akkarounahaveengagedwitharangeofstakeholdersforapprovals,particularlyforconstruction.Forexample,formalstakeholdersincludedthemayor,police,municipality;informal‘clans’(inWadiNahle),gangsandreligiousleaders(IN152018;CIL2017b;IN272018),thishashelpedmitigatedelaysandchallengeswithprogrammeimplementation.

Recommendation:Continuethisapproachforfutureprogrammes.

Challenge:Programmemanagementprocesseswerechallenging:governance,communicationandprocurementChallengesrelatedtointernalprogrammemanagementprocessesimpactsonthequalityandspeedofdelivery.Forexample,challengesincommunicationbetweenCILheadofficeinBeirutandCILfieldofficeinTripoli,therelationshipbetweenCILandAkkarounawithrespecttocapacityofstaffandclarityofrolesandresponsibilities,andinflexibleprocurementprocesses(TransformativeandEmpoweringSolutionsLLC2017;IN432018).AttheendofPhaseIIanin-depthprocessevaluationwascarriedoutbyTransformative

andEmpoweringSolutions,pleaseseethisdocumentfordetailedrecommendations

(2017).

Enablingfactor:ResidentstrustedCIL/Akkarouna.PhaseIoftheprogrammewasdifficultbecauseCIL/Akkarounawerenotknowninthearea;therewasnotrustbetweentheresidentsandCIL/Akkarounaandthistooktimetoestablish(IN062018;IN272018;IN532018).PreviousexperienceswithotherNGOshad‘damagedtrust’(FG52018);howeverresidentsreportthatwhenthey‘sawlotsofthings[happening]thatweregood’(IN532018)theywerepersuadedthatCIL/Akkarouna‘keeptheirpromises’(IN232018).ResidentsreportthatthefriendlyapproachtakenbyCIL/Akkarouna,andtheir‘simplicityandhumbleness’contributedtobuildingthistrust(IN532018).

Recommendation:Continuethisapproachforfutureprogrammes,asbelowfurther

advocacytodonorandotherstoincreasefundingcyclesforarea-basedapproaches.Challenge:ReligiousholidayswerenotsystematicallyplannedintotimelineDuringphasesI,IIandIIICILreportexperiencingdelaysorchallengesrelatedtoRamadanandtheholidays;thisisasaresultofdecreasedworkinghoursandlimitedaccesstopropertiestoupgrade(CIL2018f;IN272018;CIL2016;CIL2017b).Inordertofinishtheworkonscheduleitwasnecessarytoincreasethehoursofexistingstaff/contractorsorbringinadditionalmanpower(CIL2016;CIL2017b).

Recommendation:Proactivelymanagetheriskofdelaybyidentifyingandincorporating

religiousholidaysintotheprogrammetimelinefromtheoutset.

45Personalcorrespondence,CIL,23rdOctober2018

49

Challenge:TimecontingencywasnotsystematicallyincludedtomitigatetheriskofsecuritydelaysDuringphaseIItheworkwasbrieflydelayedforsecurityreasonsandescalatingviolence(CIL2017b).

Recommendation:Managetheriskoftimedelaysbyincorporatinganappropriatetime

contingencyintotheprogrammetimelinefromtheoutset.Challenge:One-yearfundingcyclesweretooshort.ThePRMfundingisreceivedinone-yeartrancheswhichisnotcompatiblewithanareabasedapproachsuchastheIntegratedShelterandProtectionImprovementsprogrammeforSyrianRefugeesandHostCommunitiesinTripoli,Lebanon(IN062018;IN432018;Parker&Maynard2015).Asaresultoftheconsecutivefundingyearsithasbeenpossibletohavealongertermvision,butasthesubsequentyearoffundingisneversecuredthereissignificantpressuretomeetannualtargets.Thisdoesnotnecessarilyresultinthemosteffectiveprogrammedeliveryandhasagreaterriskof‘doingharm’(IN432018;IN062018)-seeFigure7-e.g.ittakeslongertodelivertheequivalentnumberofhousingupgrades,inefficientuseoftimescalingupanddowneachyear,limitedopportunityforpilotphaseetc.Inparticularbuildingtrustwithresidents(asnotedabove)isnotpossibleinoneyear,andhasonlybeenpossibleinthisprogrammeoverthreeyears:‘ifyoudon’tfullyunderstandthesocialdynamic,youcandamagetrust’(IN062018).Equally,withtheambitiontochangebehavior(practice)throughthePPandPSSsessions‘thistakestime,andisnotalwayspossibleinonlysixsessions’(FG52018).

Recommendation:Furtheradvocacytodonorandotherstoincreaselengthoffunding

cyclesformoreeffectiveandefficientprogrammedelivery.

50

Figure7:Deliveryofhousingupgradesovertime;one-yearcyclesvs.threeyearcycles.

4.4SustainabilityThisevaluationwasundertakenonemonthonfromtheendofPhaseIIIoftheprogramme;assuchtherearelimitationstoassessingthesustainabilityandlongevityoftheoutcomes.However,usingthetheoryofchange(section4.1and4.2),thefollowingfactorshavebeenidentifiedthataffectprogrammesustainability.LandlordscomplywiththeconditionsoftheMoU.Asdiscussedinsection4.2thevastmajorityofthelandlordsarecomplyingwiththeconditionsoftheMoU;criticallytheyhavenotevictedthetenantsandtheyhavenotincreasedtherent.TheMoUsaresignedinthepresenceofacommitteememberwhoactsasawitness(CIL2017b).HowevertheMoUscannotberegisteredwiththemunicipalitiesbecausethelandlordsdonotholdofficialpapersfortheirhousingunits.ThustheMoUsarenotlegallybindingasanofficialrentalagreement,proofofhousingoraffidavitofresidence.TheMoUsexecutedbetweenthelandlord,tenantandtheNGOs(CAREandpartners)arethemostformalmeanspossibleofdocumentingthetermsofagreementbetweenparties(CIL2016,p.13).

ONEYEAR SECONDYEAR THIRDYEAR

500

1000

1500

Legend:Programmedeliveredinthree,oneyearphasesProgrammedeliveredinone,threeyearphase

Time

Scalingdown:Opportunitytosharelearning

Scalingup:RapidimplementaGon

PilotPhase:Opportunityforrefining

Advantagesofone,threeyearphase:

51

Recommendation:ContinuetosignMoUsbetweenlandlords,tenantsandCIL.Thoroughly

investigatespecificcaseswhereevictionshavebeenthreatenedorenactedtofindoutwhat

happenedandiftheMoUs/Handoverprocesscanbeimproved.Monitortrends,forexample

inhousingmarketandsocialtension,tounderstandhowtheyaffectthelikelihoodofthe

landlordcomplyingwiththeconditionsoftheMoU.

HouseholdsreceivinghousingupgradescontactCIL/Akkarounawithconcerns,queriesandfeedback.Asdiscussedinsection3.2(accountability),therehavebeenlimitationstotheuseofthehotline,andwhentheresidentstalktosomeoneface-to-facethereissometimesconfusionastoifthatpersonwasacontractororamemberofstafffromCIL/Akkarouna.Furthermore,inface-to-facemeetingstheissuesraiseddonotgetsystematicallylogged(astheydowhenresidentscallthehotline)andthusarenotalwaysfollowedup.

Recommendations:

• Increasethevisibilityandaccessibilityofthehotlinenumber(e.g.installa

neighborhoodnoticeboardinawell-frequented,neutral,location(nota

CIL/Akkarounaprojectnoticeboard),withthehotlinenumberhighlyvisible.The

noticeboardcouldalsocontaininformationaboutthebeneficiaryselectionprocess(as

notedabove),thecommitteeandtheirrole,upcomingtrainingorawarenessraising

events,theprogrammeactivities,otherkeycontactnumbers(municipality,service

providers,otherNGOs)andspaceforotherorganizationstopromoteneighborhood

activities.Thelocalcommitteecouldberesponsibledesigning,locatingand

maintainingtheboardtoensureitisaccessibletoasmanyresidentsaspossible).

• Investigatealternativewaystostrengthencommunicationandaccessibilityof

CIL/Akkarounastaff(e.g.suchasaresidentliaisonofficer)

• TrainallCIL/Akkarounastaffwhoareinroleswheretheyvisittheneighborhoods

wheretheprogrammeisbeingruntologverbalcomplaints,feedbackandrequests

(e.g.throughcallingthehotline).

ItemsinstalledaspartofhousingupgradesremainfunctionalforanappropriatelengthoftimeAsdiscussedabove,21%ofhouseholdsinAbuSamrainPhaseIIIreportedsomeitemswerenotfunctioningafterthreemonths(CIL2018c).Furthermore,outcomesmonitoringthatfollowedupwithhouseholdstwoyearsafterthecompletionofPhaseIoftheprogrammehighlightsthat51%oftheitemsinstalledorrepairedduringtheupgradeworksarestillfunctional.22%ofhouseholdsidentifythatmostoftheupgradeditemsremainfunctional,12%‘halfofthem’,9%‘fewofthem’andtheremaining7%statedthatnoneofthemwerestillfunctional(CIL2018b,p.4).Householdswereaskedthedurationoffunctionality‘32%mentionedthattheitemswerefunctionalfor6monthsto1yearaftertheintervention,5%after1to2years,16%after3to6monthsand47%after0to3months’(Ibid).Thishighlightsthatpreviousphases,andbasedonthedataavailable,potentiallyphaseIIIhaveexperiencedchallengesupgradinghouseholdstoasufficientlevelofqualitythattheinstalleditemsremainfunctioningforanappropriatelengthoftime.Non-functioningitemscanbeasaresultofpoorqualitymaterialsorworkmanship(discussedhere)orinappropriateuseormaintenanceofthehouseholds(seeitembelow).Housingupgradesarenotoriouslydifficultandpresentmanychallenges-everyhouseisdifferentandrequiresahighlevelofattentiontodetailtoensurethatallitemsareadequatelyaddressedanduniqueproblemsolvingbecauseeachunittobeupgradedisdifferent.Significantlevelsofsupervision/monitoringandhighlyskilledlaborersare

52

alsorequiredbecausemanyinstallationdecisionsaremadeon-site(e.g.therearenotconstructiondrawingsforeachunitetc.).DuringtheearlierphasesthecontractorsengagedbyCILtoundertakethehousingupgradesandcommunalupgradeprojectswererequiredtoemployacertainquotaoflocalresidents(IN272018;IN062018;IN952018).Thecontractorswererequiredtoemploy10%oflaborersfromtheneighborhoodswheretheprogrammewasbased,andinsomecasesaround50%ofthecontractorsstaffwerelocalresidents.46Howeverinsomecircumstancesthelocallyengagedworkersdidnotcompletetheworksatisfactorily,leadingtopoorqualityupgradesthatCIL/Akkarounarequiredthecontractortore-do(IN272018).InPhaseIIIcontractorshadmoreflexibilitytochoosetheirownworkerswhichimprovedtheconstructionqualityandpreventeddelaysduetoremedialworks(IN272018). Recommendation:

• Theprocessofmaterialpurchase,qualitycontrol,storageandtransportationto

site,isinvestigatedandimprovedwhererequired.Itisrecommendedthatthis

includesspecifyingtheexpectationofthelife-spanoftheupgradeditemswith

appropriatemaintenance(e.g.tapsshouldlast3-5yearsetc).Seealsodiscussionin

section4.4aboutappropriatehouseholdmaintenance.

• Theprocessofconstructionisinvestigatedandimprovedwhererequired;

includingemployingadequatelyskilledstaffinconjunctionwithappropriatelevels

ofsitesupervisionandmonitoring.

• Seekingopportunitiesforlocalemploymentisdesirable,howeverhardquotascan

affectthequalityofconstruction.Encouragecontractorstoemploylocalresidents

inappropriateroles,butensurethecontractallowsflexibilitysothatonlyresidents

withsuitableskillsandexperienceareemployed.Thereistheopportunityhereto

build on another characteristic of a resilient community, that it ‘has economic

opportunities’ (IFRC2014,p.11);thisshouldbeinvestigatedandfully integratedintothetheoryofchange.

Box4:Levelsof ‘satisfaction’vs. itemsthatarefunctioning-monitoringhousingupgradesHouseholdswho have received housing upgrades typically report higher percentagelevelsof‘satisfaction’withtheinstalleditems,thanmatchthepercentageofitemsthatare functioning. For example in Phase III, three months after completion 21% ofhouseholds reportedsome items thatarenot functional;but91%ofhouseholdsalsoreported satisfaction with the materials (68% highly satisfied, 23% satisfied, 9%neutral or dissatisfied) and 97% satisfaction with the quality of workmanship (CIL2018c).FurthermorepropertiesupgradedduringphaseI,andfolloweduptwoyearslate:49%ofhouseholdsreportedsomeitemsthatarenotfunctional;but78%reportsatisfactionwiththematerialsand68%satisfactionwiththequalityofworkmanship(CIL2018b,p.4).Whilstnotconclusive, thisdiscrepancysuggeststhat ‘levelofsatisfaction’maynotbethe most appropriate measure to assess if the programme is delivering the desiredoutcomes (see section 4.1 and 4.2); although it may be useful for other monitoringpurposes. 46CIL/Akkarouna,PersonalCorrespondence,19thOctober2018

53

Residents are highly appreciative of thework that CIL/Akkarouna are doing in theirneighborhood, for example ‘we are in desperate need, the area is very deprived andanything [CIL/Akkarouna]giveusmakesushappy’ (IN742018)andwhen itemsarenotfunctioningotherexplanationsaresought-forexampleaflatroofthatwasinstalledaspartofthePhaseIIprogrammewasleakingandtheresidentsnotedthatit‘couldbebecauseoftheweather’,butuponinspectionitwasclearthatitwasbecausetherewasinadequatedrainagesothewaterwaspooling(DirectObservation2018;IN632018).Thishighlevelofgratitudemaybeacontributingfactortohigherlevelsofsatisfactionthanfunctioningitems.

Householdsreceivinghousingupgradesappropriatelyuseandadequatelymaintainitems.TheCIL/Akkarounastaffreportmisuseorinadequatemaintenanceofitemsthatareinstalledintheproperties.Forexample,windowsanddoorsbeingslammedanddamaginglocks,toiletsbeingflushedwithbucketsandtapsnotbeingcleanedappropriatelyorbeingusedtooroughly(IN952018).DuringtheHandovertheCIL/Akkarounafieldstaffcheckthateverythingfunctionsappropriately,butthereisnodemonstrationorexplanationforresidents(IN952018).

Recommendation:Demonstratetoresidentshowtousethenewlyinstalleditemsand

emphasizetheimportanceofregularmaintenance;thiscould/shouldbedonebyanon-

technicalteammember(e.g.aresidentliaisonofficer).Explicitlystatetheexpected

lifespanofitemsthataremaintainedversusitemsthatarenot.Trainingor

demonstrationsshouldberepeatedmorethanonce;forexampletherecouldbeagroup

training,followedbyahouseholdvisit(perhapssupportedbyaleaflet),thenafollowup

visit(approximatelysix-monthspostcompletion)toconfirmallitemsarestillfunctioning,

andreferanythatarenottothecontractorforrepairwhilsttheyarestillwithintheyear

guarantee.

Neighborhoodassetsareadequatelymaintained.Theitemsinstalledaspartofthecommunitycommunalprojectarehandedovertorelevantauthorities;forexamplethesolarlightstothemunicipalityandthebuildingupgradestothebuildingowners.Representativesfromthecommitteeswerewitnessesinordertogivethemownershipoftheprojectsforbeingaccountabletomaintaintheinstalleditems(CIL2018f).Someoftheseitemsneedregularmaintenanceandinvestment,forexamplethesolarstreetlightsrequirethesolarpanelstobecleanedonceortwiceayear,andthebatteriesreplacedeverytwoyears.Todate,themunicipalityhascleanedthesolarpanelsonceayear,andthefirstsetofstreetlightsaredueforbatteryreplacement.

Recommendation:Continuetoengagewiththeappropriateauthoritytoensureregular

maintenanceandrepairsarecarriedoutinatimelymanner.Preparethecommitteesto

advocatetotheappropriateauthoritiesintheeventthatmaintenanceisnotundertaken.

Throughthecommittees,investigatethecapacityofthecommunitytoself-organizeand

undertakenecessarymaintenance(e.g.cleaningstairsandgutters).

Committeesarerepresentativeofthecommunityandself-organized.Asdiscussedinsection3.1,duringPhaseIIIaround90%ofthecommitteememberswerewomen,thiswasatasimilarlevelduringPhasesIandIIalso.TheneighborhoodswhereCIL/Akkarounaareworkingareverytraditional,therearesignificantlimitationsonthemovementandfreedomofwomen-forexampleremaininginthehome,requiringtheirhusbandspermissiontoleavetheproperty,limitedcontactwithothermenandwomen,andrestrictedemploymentopportunities(IN432018;CAREInternationalUK2015;IN272018).Thereisconcernthatinthecurrentsocialstructure‘womendon’t

54

necessarilyhaveavoice…[andisthelackofmenasignthat]thecommitteenotbeingtakenseriouslybythemen?’(IN272018)..Thelackofengagementbythemeninthecommitteesmayimpactontheabilityoftheprogrammetodevelopcommitteesthatareempoweredtocommunicateneighborhoodneedstoexternalactors.Furthermore,asdiscussedinsection3.1,thecommitteesdonothaveahierarchy,andthereisno‘leadership’council(CIL2017a).AsaresultthecommitteesoperateasvehicletosupportCARE/Akkarounaprogrammedelivery,butarenotautonomousandindependent,thishasimplicationsforthesustainabilityofthecommitteesfollowingtheendoftheprogramme.

Recommendation:

• Furtherinvestigationisrequiredtounderstandthefactorsthatmakethe

committeesmoreorlesseffective;thismayincludeprimaryandsecondarydata

collection.Forexampletounderstandthestrengthsandlimitationsofthe

committeesbeingpredominatelyfemale;aswellasbarrierstoencouragingmore

mentojointhecommittees(ifdesirable),andwaysofovercomingthesebarriers.

• Theprogrammeshouldprovideadditionalsupportandtrainingforcommitteesto

helpthembecomeautonomousandsustainable.Forexampleinvestigatehowthe

committeescanbelegally/formally/officiallyrecognized,identifyurbannetworks

ofcommunitybasedorganizations,suchasresidentsassociations;workwiththe

committeestodevelopa‘visionandmission’forwhattheywillbedoingin1year,

3yearsand5yearsetc.;supportselectionandtrainingofasecretary,treasurer,

chair;howtoappointpeopleforthesepositions‘fairly’,howtoengagewith

externalactors,howtomanageprojectsandbudgets.Amapsettingouttheareas

representedbythecommittee(s)wouldbeavaluablecommunicationtool,

especiallyforexternalstakeholderse.g.themunicipality.

• Giventhesizeoftheneighborhoodswheretheprogrammeisimplemented

(numberofhouseholdsrangingfromapproximately1200-2500),itmaynotbe

necessarytohavesomanycommittees(e.g.concentrateresourcesonmobilizing

engaged,activecommitteemembers).Furtherinvestigationisrequiredtoreview

thelevelofappropriaterepresentation.

55

5.0Conclusionsandrecommendations

5.1Conclusionsfromthisevaluation

PhaseIIIAssessmentThePhaseIIIprogrammeexceededitstargetsrelatedtoobjective1(SyrianrefugeesandhostcommunityindividualshaveimprovedshelterandWASHconditionsinurbanTripoli)andobjective2(Syrianindividualsandhostcommunityindividualshaveenhancedknowledgeofandaccesstoprotectionservices).Intotalmorethan559housingunitswereupgraded,35communalupgradeprojectsdeliveredand20neighborhoodcommitteesestablished.Furthermore6900individualsbenefittedfromattendingpsychosocialsupportsessions,positiveparenthoodsessionsoran‘informationsession’toexplainabouttheprogramme.Relevance:TheprogrammeishighlyrelevanttotheneighborhoodsthatCILandAkkarounaaretargetingandiswellalignedwithregionalandnationalplanstosupportLebanontocopewiththeinfluxofSyrianrefugees.Accountability:CILandAkkarounahaveinplaceanumberofmechanismstosupportprogrammeaccountabilitytoresidents,theseincludequarterlymonitoring,a‘hotline’numbertosharefeedback,suggestionsandcomplaintsandregularformalandinformalmeetingswithneighborhoodcommittees.However,therearelimitationsontheuseofthehotlineforeffectiveaccountability.

Effectiveness:Theprogrammehaslargelyachieveditsobjectives.Forobjective1,residentswhosepropertiesreceivedhousingupgradesreporthighlevelsofsatisfactionwiththequalityofthematerialsusedandtheconstructionwork(90%+).However,thisresearchrevealedthattheremaybealargernumberofitemsthatarenotfunctioningthaniscurrentlyreported,forexampleduetothelimitationsoftheuseofthehotline.Thenumberofhouseholdswithitemsthatarenotcorrectlyfittedorofappropriatequalitywillimpactontheextenttowhichtheprogrammeachievesobjective1.Forobjective2:Attendeestopositiveparentingsessionsdemonstrateincreasedknowledgeofprotectionneedsandrightsinpre-postmonitoringtests.CILandAkkarounamade68referralstospecialistprotectionservices,forexamplewhenhouseholdsrequiredadditionalsupportfordrugaddictionordomesticviolence.Thuswhilstthereisimprovedknowledge,thereisnoavailableevidencetosuggestimproveddirectaccesstoprotectionservices(e.g.primarilyindirectlyvia.CIL/Akkarouna).Impact:Thestatedgoaloftheprogrammeisto‘contributetobuildingresilienceoftheaffectedpopulationinTripolithroughtherehabilitationofshelters,promotionofsocialprotection,anddevelopmentofsocialcapital’.Thisisahighlyambitiousgoal,withanumberofcomplexcomponentsthatarenotdefinednordetailedintheprogrammedocumentation.Theevidencesuggeststhattheprogrammehasbuiltresilienceoftheaffectedpopulationthroughtherehabilitationofsheltersandthedevelopmentofsocialcapital,withthelatterprimarilyfocusedaroundthecommitteemembers.Thereisnoevidencetosuggestthattherehavebeenactivitiesundertakenthatpromotesocialprotection.

56

TheoryofChangeTheultimategoalistocontributetobuildingresilienceofvulnerableneighborhoodcommunitiesinTripoli.TheIntegratedShelterandProtectionImprovementsprogrammeforSyrianRefugeesandHostCommunitiesinTripoli,Lebanoncontributestobuildingresilienceby:

• Increasingaccesstoinfrastructurethroughupgradinghousingunitsandimplementingneighborhoodbuildingandstreetupgrades

• Increasingtheknowledgeoftheresidentsaboutprotectionissuesthroughsupportingrelevantinteractiveperformancesanddeliveringawarenessraisingsessionsforadultsandchildren

• Improvingthehealthoftheresidentsthroughupgradinghousingunits,neighborhoodbuildingandstreetupgradesandrunningawarenessraisingsessions.

Furtherinvestigationisrequiredtoconfirmiftheprogrammecontributestobuildingresilienceby:

• Increasingthecommunitycohesionthroughestablishingtheneighborhoodcommitteesandrunningtrainingsessions

• IncreasingtheconnectivitybetweenresidentsandexternalstakeholdersthroughintroducingtheneighborhoodcommitteestothemunicipalityandCSOs

Thekeyenablingfactors(indicatedbyan*)andchallengesthatinfluenceprogrammeimplementationare:Objective1:Housingupgrades,neighborhoodbuildingandstreetupgradesand

committees:• Someresidentsdidnotconsidertheselectionprocessforhousingupgradesto

be‘fair’• Somehouseholdsreceivinghousingupgradesdidnotunderstandtheupgrade

process• Contractorsdidnotsystematicallycomplete‘snagging’items• Processtoidentifyneighborhoodcommunalbuildingandstreetupgrade

projectswasnotoptimallytransparentandinclusiveObjective2:Protection

• Therewerenotenoughevents-quantityandfrequency-andenoughpeopleattendingtobringtheresidentstogether(e.g.PP,PSS,interactivetheatre)

• PPandPSSsessionswererunbyadequatelyskilledtrainers*• Referralcaseswerenotsystematicallyfollowedupbyorganizationstowhom

thecaseswerereferred.Programmewide

• Deliveryofcombinationofmulti-layeredsupport*• Formalandinformalstakeholderswereappropriatelyengaged*• Suitableprogrammemanagementprocesseswerechallenging:governance,

communicationandprocurement• ResidentstrustedCIL/Akkarouna*• Religiousholidayswerenotsystematicallyplannedintotimeline• Timecontingencywasnotsystematicallyincludedtomitigatetheriskofsecurity

delays• One-yearfundingcyclesweretooshort

Thesefactorsarerisksorassumptionsunderpinningprogrammedelivery.Dependingonthecontext,thesefactorshavethepotentialtomaketheworktakelonger,requireadditionalfundingorimpactonthequalityoftheoutputsandoutcomes.

57

Thefollowingfactorsthataffectprogrammesustainabilityareasfollows:

• Itemsinstalledaspartofhousingupgradesremainfunctionalforanappropriatelengthoftime

• Adequatemaintenanceandappropriateuseofupgradeditemsbyhouseholds• Adequatemaintenanceofneighborhoodassets• Committeesarerepresentativeofthecommunityandself-organized• LandlordscomplywiththeconditionsoftheMOU• HouseholdsreceivinghousingupgradescontactCIL/Akkarounawithconcerns,

queriesandfeedback

5.2Recommendationsforpractice

Objective1(Housingupgrades,communalupgradeprojectsandcommittees)Constructionquality:Investigatethereasonsandcircumstancesforsomeresidentsreportingnon-functioningitemsinsomehousing,buildingandneighborhoodupgrades.Identifythenumberofhousingunitsandcommunalprojectsaffectedandundertakerepairs.UpdatepoliciesandprocessestoimprovethequalityofmaterialsandworkmanshipinPhaseIV(particularlythosearoundtheselectionofcontractors,purchasingandqualitycontrolofmaterialsandworkmanship,thesnaggingandhandoverprocess).Assessthepossibility/feasibilityofincorporatingafurthercharacteristicofaresilientcommunity-thatit‘haseconomicopportunities’-intothetheoryofchangethroughtheemploymentoflocallaborersandcontractors;makeexplicitintheprogrammesmonitoringandevaluationprocesses.Maintenance:Providetrainingtohouseholds,communitiesandcommitteessothattheyknowhowtouse,maintainandrepairthenewlyinstalledhousingupgradesandcommunalupgradeprojects.Engagewithmunicipalauthorities(inpartnershipwiththecommittees)toensureregularmaintenanceandrepairsarecarriedoutinatimelymanner.Evictions:InvestigatespecificcaseswhereevictionshavebeenthreatenedorenactedtofindoutwhathappenedandiftheMoUs/Handoverprocesscanbeimproved;reviewcasesoverPhasesI,IIandIIItoinvestigate‘how’and‘why’.Forexample,thiscouldincludefollowingupnotjustwithevictedtenantsbutalsowithlandlordsandneighborstounderstandthemotivationsandseeifthereisatrendwhichwillhaveresultantimpacts(e.g.markets:supply&demand,protectionetc.).Communication:Improvecommunicationwithhouseholdswhoare(andarenot)selectedtoreceiveassistancesothateveryoneunderstandstheprocess.Thiscouldincludemakingthebeneficiaryselectionprocessmoretransparent,increasedvisibilityandaccessibilityofthehotlinenumber,installingacommunitynoticeboardtoprovidedetailsabouttheprogramme,additionalsupporttovulnerablehouseholds,distributionofleafletsandemployingspecificresidentliaisonofficer(s).Sustainabilityofcommittees:Investigatethefactorsthatmaketheneighborhoodcommitteesmoreorlesseffectiveandsustainable;thismayincludeprimaryandsecondarydatacollection.Providecommitteememberswithadditionaltrainingfocusedonbuildingtheautonomyandsustainabilityofcommittees.Forexampletrainingcouldbeprovidedontherolesandresponsibilitiesofacommitteechair,secretaryandtreasurer,howtoengagewithcommunities,howtoadvocatetoexternalactorsformaintenanceofcommunalinfrastructureoradditionalsupport.Identifyopportunities

58

toformalizethecommitteeandprovidesupporttoidentifyandarticulatetheirorganizational‘visionandmission’.

Objective2(Protection)Communitycohesion:Provideopportunityforincreasedinteractionbetweenresidents.Ensurethatallmembersofthecommunityknowtheroleofthecommitteemembers.InvolvemorepeopleinthePASSAprocessandmakeitmoretransparentandaccountable.Donotunderminetheprocessbymakingdecisionsorprioritizingprojectsinbi-lateralmeetings,involveresidentsinthetechnicalassessmentandselectionofneighborhoodprojects.AwarenessRaising:Improvetheaccessibilityofthesessionsbyincreasingthevarietyoflocations,timingsandtargetaudiencesforthesessions–potentiallythroughworkingwithexistingorganizations/institutionssuchasschoolsorCBOs.InformationVolunteers:ContinuetheapproachofdeliveringtrainingthroughspeciallyselectedandtrainedInformationVolunteersfromwithinthecommunities.InvestigateifthegenderoftheIVsimpactsontheattendeestotheadultawarenessraisingsessions(e.g.aremenmorelikelytoattendsessionsiftheyarerunbyothermen?)Protectionreferrals:InvestigatetheeffectivenessoftheprotectionreferralprocessandifCIL/Akkarouna’sprogrammepoliciesandprocessescanbeadaptedtoaccommodatelimitedcapacityoflocalspecialistprotectionorganizationstorespondtoreferredcases.Increasemonitoringandreviewofthelevelofdirectaccessofresidentstospecialistreferralservicesinordertomoreclearlyaddressobjective2;investigateappropriatetargetoutputsandindicators.

ProgrammewideMulti-scaleandmulti-sectoralsupport:Continuetodelivermulti-scale(individual,household,neighborhood)andmulti-sector(shelter,waterandsanitation,infrastructure,protection)supportintheaffectedneighborhoods.Formalandinformalstakeholders:Continuetoengageformalandinformalstakeholdersthroughouttheprogrammetomitigatedelaysandsupportimplementation.Delays:Proactivelymanagedelaysbyidentifyingandincorporatingreligiousholidaysintotheprogrammetimelinefromtheoutset.Incorporateanappropriatetimecontingencyintotheprogrammetimelinefromtheoutsettomanageunknownrisks(e.g.security).Lengthofprogramme:Furtheradvocacytodonorsandotherstoincreaselengthoffundingcyclesformoreeffectiveandefficientprogrammedelivery.TheoryofChange:Identifyhowthetheoryofchangecanbeusedtoplan,monitorandevaluatetheprogrammesothattheintendedoutcomesareclearlytargetedanddemonstrated.

5.3RecommendationsforpolicyandfurtherresearchTestandvalidatetheTheoryofChangethroughoutPhaseIV;includingbothprogrammeintegrationandacomprehensiveliteraturereviewofthemostrelevantanduptodate

59

documentstodefining‘socialcohesion’,‘wellbeing’,‘protection’,‘health’and‘resilience’.Clearlyarticulateandmonitorthepointsoftheprogrammewheretheoutcomeisto‘donoharm’(e.g.duringthebeneficiaryselectionprocessortheidentificationofthecommunalupgradeprojects);versusthepointsintheprogrammewheretheaimistodeliverapositiveoutcome(e.g.increasedknowledge,improvedaccesstoinfrastructureetc.).Undertake scenario planning with key stakeholders to better define the strategicapproachtoaddressingpropertiesthatrequiresignificantinvestment(<USD$2-4,000),Isitpreferabletotargetthesepropertiesandmeettheneedsofthemostvulnerable?OrisitbettertobalancethehighercostunitswithsomelessvulnerablehouseholdssothattheaveragepricecontinuestobeUSD$1,500/unit?Furtherdetailedresearchintothedifferentneighborhoods-perhapsusingacase-studybasedresearchapproach-wouldbevaluabletobetterunderstandtheenablingfactorsandchallengesinthedifferentcontexts;inparticularwithafocusonthetargetingapproachfor%ofLebaneseandSyrianhouseholdsbeingproportionaltotheoverallpopulationinthatneighborhood.

60

AcronymsBOQ BillofQuantityPRM BureauofPopulation,Refugees,andMigrationCIL CAREInternationalinLebanonCIUK CAREInternationalUKCSO CivilSocietyOrganizationsDfID DepartmentforInternationalDevelopmentDAC DevelopmentAssistanceCommitteeGBV GenderBasedViolenceIV InformationVolunteerIFRC InternationalFederationoftheRedCrossandRedCrescentSocietiesKAP Knowledge,attitudeandpracticeLCRP LebanonCrisisResponsePlanMOU MemorandumofUnderstandingMoSA MinistryofSocialAffairsNGO Non-governmentalorganizationPP PositiveParentingPSS PsychosocialSupportRA RapidassessmentUNDP UnitedNationsDevelopmentProgrammeUN-ESCWA UnitedNationsEconomicandSocialCommissionforWesternAsiaUN–HABITAT UnitedNationsHumanSettlementsProgrammeUNWRA UnitedNationsReliefandWorksAgencyUNHCR UnitedNationsHighCommissionerforRefugeesUS-AID UnitedStatesAgencyforInternationalDevelopmentTA TechnicalassessmentToR TermsofReferencePRL PalestinianRefugeeinLebanonPASSA ParticipatoryApproachforSafeShelterAwarenessWASH Water,sanitationandhygiene

61

ReferencesBetterEvaluation,ContributionAnalysis.Availableat:

www.betterevaluation.org/en/plan/approach/contribution_analysis[AccessedOctober2,1BC].

BOND,Anintroductiontotheprinciplesforassessingthequalityofevidence,Browne,E.,2015.Socialprotection:Topicguide,Birmingham,UK.Availableat:

http://www.gsdrc.org/docs/open/socialprotection.pdf.Campbell,L.,2016.Steppingback:Understandingcitiesandtheirsystems,Availableat:

https://www.alnap.org/help-library/stepping-back-understanding-cities-and-their-systems.

CAREInternational,2016.IncreasingResilience:TheoreticalGuidanceDocumentforCAREInternational,Availableat:https://careclimatechange.org/wp-content/uploads/2017/07/Increasing-Resilience-Guidance-Note-EN.pdf.

CAREInternationalUK,2015.ShelterneedsandthemostvulnerableinTripoli,Lebanon:RapidUrbanAssessment,Availableat:https://www.careemergencytoolkit.org/wp-content/uploads/2017/09/CARE_LB-Rapid-Shelter-Assessment-in-Tripoli2015.pdf.

CAREInternationalUK:EmergencyShelterTeam,2018.CARE’sOneNeighbourhoodApproach,

CentreforTheoryofChange,2018.TOCBenefits.Availableat:http://www.theoryofchange.org/what-is-theory-of-change/toc-background/toc-benefits/.

CIL,2017a.CAREInternationalLebanonCountryProgramSingleYearProposal(PhaseIII),

CIL,2017b.FinalProgramReport-PhaseII,CIL,2016.FinalProgramReport-PhaseI,CIL,2017c.FirstQuarterProgramReport:PhaseIII,CIL,2018a.IntegratedShelterandProtectionImprovementsforSyrianRefugeesandHost

CommunitiesinTripoli,Lebanon:PhaseIIIM&EFINALREPORT,CIL,2018b.OutcomeMonitoringReportBPRM-PhaseIII,May2018Annex2,CIL,2018c.Post-ImplementationMonitoringReportBPRM-PhaseIII,May2018Annex1,CIL,2018d.SecondQuarterProgramReport:PhaseIII,CIL,2018e.TermsofReferencefortheEvaluationIntegratedShelter&WASH-based

ImprovementswithGender,Protection,andSocialStabilityMainstreamedinUrban

Tripoli:PhaseIII,CIL,2018f.ThirdQuarterProgramReport:PhaseIII,DFID,2011.DFIDEthicsPrinciplesforResearchandEvaluation.Availableat:

https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/67483/dfid-ethics-prcpls-rsrch-eval.pdf.

DirectObservation,2018.Fieldwork,FG5,2018.FocusGroup,InformationVolunteers,FGF6,2018.FocusGroup,Female,WadiNahle,FGF7,2018.FocusGroup,Female,Shok,FGF9,2018.FocusGroup,Female,Mankoubin,FGM1,2018.FocusGroup,Male,Shok,FGM2,2018.FocusGroup,Male,WadiNahle,Forrest,J.&Kearns,A.,2001.SocialCohesion,SocialCapitalandtheNeighbourhood.

UrbanStudiesJournalLimited,38(12),pp.21225–2143.Availableat:https://pdfs.semanticscholar.org/fd6f/197c9ec99f7f9013f94b6bce8d7d17ed8dd0.pdf.

GovernmentofLebanonandtheUnitedNations,2017.LebanonCrisisResponsePlan2017-2020,Availableat:http://www.3rpsyriacrisis.org/wp-

62

content/uploads/2017/01/Lebanon-Crisis-Response-Plan-2017-2020.pdf.Grootaert,C.&Bastelaer,T.,2002.Theroleofsocialcapitalindevelopment:Anempirical

assessmen,Cambridge.IFRC,2014.IFRCFrameworkforCommunityResilience,Availableat:

http://www.ifrc.org/Global/Documents/Secretariat/Sendai/1284000-FrameworkforCommunityResilience-EN-LR.pdf.

IN06,2018.InterviewwithCARE/AkkarounaStaff,IN15,2018.InterviewwithCARE/AkkarounaStaff,IN19,2018.InterviewwithResident,IN23,2018.InterviewwithResident,IN27,2018.InterviewwithCARE/AkkarounaStaff,IN32,2018.InterviewwithResident,IN43,2018.InterviewwithCARE/AkkarounaStaff,IN46,2018.InterviewwithResident,IN51,2018.InterviewwithProgrammeStakeholder,IN53,2018.InterviewwithResident,IN63,2018.InterviewwithResident,IN68,2018.InterviewwithProgrammeStakeholder,IN72,2018.InterviewwithResident,IN74,2018.InterviewwithResident,IN80,2018.InterviewwithResident,IN95,2018.InterviewwithCARE/AkkarounaStaff,Mayne,J.,2008.Contributionanalysis:Anapproachtoexploringcauseandeffect,

Availableat:https://www.bond.org.uk/data/files/Contribution_analysis__An_approach_to_exploring_cause_and_effect.pdf.

Mourad,L.&Piron,L.,2016.MunicipalServiceDelivery,Stability,SocialCohesionandLegitimacyinLebanonAnanalyticalliteraturereview,

Palinkas,L.etal.,2015.Purposefulsamplingforqualitativedatacollectionandanalysisinmixedmethodimplementationresearch.AdmPolicyMentHealth,42(5),pp.533–544.Availableat:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4012002/.

Parker,E.&Maynard,V.,2015.Humanitarianresponsetourbancrises:areviewofarea-basedapproaches.,p.28.Availableat:http://pubs.iied.org/10742IIED.html[AccessedDecember8,2015].

RockefellerFoundationandArup,2016.CityResilienceIndex:Understandingandmeasuringcityresilience,Availableat:http://www.cityresilienceindex.org/wp-content/uploads/2016/05/160516-CRI-Brochure.pdf.

Sarmiento,J.P.etal.,2018.PerformanceEvaluationinLACUrbanDRRProgramming:TheNeighborhoodApproach,Availableat:https://pdf.usaid.gov/pdf_docs/PA00T34V.pdf.

Scrivens,K.&Smith,C.,2013.FourInterpretationsofSocialCapital:AnAgendaforMeasurement,Paris.Availableat:http://www.oecd-ilibrary.org/economics/four-interpretations-of-social-capital_5jzbcx010wmt-en.

TheSphereProject,2011.HumanitarianCharterandMinimumStandardsinHumanitarianResponse.Availableat:http://www.sphereproject.org/handbook/[AccessedDecember8,2015].

TransformativeandEmpoweringSolutionsLLC,2017.EvaluationReport:‘IntegratedShelter&WASH-basedImprovementswithGender,Protection,andSocialStability

MainstreamedinUrbanTripoli’project,UN-ESCWA,2015.PovertyinTripoli.Availableat:

https://www.unescwa.org/news/poverty-tripoli[AccessedOctober6,2018].UN-HabitatLebanon,2017.TripoliCityProfile2016(UpdatedSept2017),Availableat:

https://unhabitat.org/tripoli-city-profile-2016/.UN–HABITAT,2016.NeighbourhoodApproach.InInter-AgencyCoordinationLebanon.

63

Availableat:http://data.unhcr.org/syrianrefugees/download.php?id=11392.UN–HABITATandUNDP,2010.InvestigatingGreyAreas:AccesstoBasicUrbanServices

intheAdjacentAreasofPalestinianRefugeeCampsinLebanon,Availableat:http://www.undp.org.lb/communication/publications/downloads/fullstudy-InverstigatingGreyAreas.pdf.

UNHCR,2018.SocialProtectionandtheGlobalCompactonRefugees.Availableat:http://www.unhcr.org/uk/events/conferences/5b4f46817/social-protection-global-compact-refugees.html.

UNRISD,2010.SocialProtectionandPoverty,Availableat:http://www.unrisd.org/80256B3C005BCCF9/httpNetITFramePDF?ReadForm&parentunid=973B0F57CA78D834C12576DB003BE255&parentdoctype=paper&netitpath=80256B3C005BCCF9/(httpAuxPages)/973B0F57CA78D834C12576DB003BE255/$file/Barrientos-pp.pdf.

WHO,2018.Frequentlyaskedquestions.Availableat:http://www.who.int/suggestions/faq/en/[AccessedOctober25,2018].

WorldVisionInternational,2015.SocialCohesionBetweenSyrianRefugeesandUrbanHostCommunitiesinLebanonandJordan,

64

ReportAnnexes

AnnexA:PhaseIIIIndicatorsGoal


Target # and/or %Objective1 Syrianrefugeesandhostcommunityindividualshave

improvedshelterandWASHconditionsinurbanTripoli.

2,750 beneficiaries (20% female)(50%Syrian,50%host)

Indicator1 %ofHHbenefitingfromshelterupgradesreportsatisfactionwiththematerialsused

80%

Indicator2(Objective1)

#ofbeneficiarypopulationintheprogramareareceivingshelterassistance,bygenderandnationalityofHeadofHousehold

2,750 beneficiaries (20% female)(50%Syrian,50%host)

Indicator3(Activity1.1)

#ofhouseholdsreceivingshelterassistancewherethehouseholdisfreeofvisiblehealthandsafetyhazards

550housingunits

Indicator4 %ofHHbenefitingfromshelterupgradesreportsatisfactionwiththequalityofwork

80%

Indicator5 %offamiliesarestilllivinginthesamedwelling3monthsaftertheupgrade

90%

Indicator6 %oflandlordswhomaintain/lowerrentalratesorprovidearent-freeperiodasaresultofrehabilitationintervention

100%

Indicator7 %ofHHbenefitingfrombuildingupgradesreportfeelingsaferasaresultoftheintervention

80%


#ofbuildingsbenefitingfrominternalorexternalupgrades

33buildings

Target # and/or %Objective2 Syrianindividualsandhostcommunityindividualshave

enhancedknowledgeofandaccesstoprotectionservices.

3,500or3,000beneficiaries(50%Syrian,50%host)

Indicator1 %ofcommunitymembersreportingreducedcommunitytensions

35%

Indicator2 %ofneighborhoodcommitteemembersreportstrengtheningcommunityparticipationthroughactivecontributioninaddressingthecommunityneeds

70%


#ofoperationalcommittees 20committees


#ofneighborhoodcommitteemembersdisaggregatedbygender,ageandnationality

160committeemembers

Indicator5 #ofeventstointroducetheneighborhoodcommitteememberstothecommunity

3events

Indicator6 #ofneighborhoodcommitteemembersmeetingswiththemunicipalitiesandCSOs

4meetings

Indicator7 %ofbeneficiarieswhoreportkeytrainingmessagesarerelevanttotheireverydaylives

80%

Indicator8 %ofbeneficiarieswithincreasedknowledgeofprotectionneedsandrights

70%

Indicator9 #ofinformationvolunteersfromthecommunitytrainedinprotectiontopics

10volunteers


#ofbeneficiarieswhoattendedinteractivetheatre 150beneficiaries

Indicator11 %ofbeneficiarieswhoreportthesessionsattendedhaveaffectedpositivelytheirwellbeing

70%


#ofbeneficiarieswhoattendedpsycho-socialsupportsessions

1200beneficiaries

*Indicates‘targets’

65

AnnexB:PhotosofCommunalStreetandBuildingUpgradesCommunalBuildingandStreetWorks

AbuSamra:SolarPanelStreetLights.Fieldvisitduringtheday,notpossibletoseeifstreetlightsfunctioning.Residentsreportedthatthestreetlightswereworking.

AbuSamra:Sewagepipe(theorangeone;thewhitewasistheoldconnection)Concernsoverconstructionquality/robustnessofconstruction.Forexamplepipeappearstobesecuredtowallbyaseriesofwiresthataretiedtotherebarstickingoutoftheconcrete.Thisislikelytocorrode/breakrapidly.Recommendsecuringwithbrackets.

AbuSamra:RetainingwallNoconcerns.Constructionqualityseemsappropriate.Fenceappearssuitablesecured.Drainagepipesappeartobeinplaceatthebaseofthewall.

66

AbuSamra:ElectriccablesWereapproximately2mhighonwall(e.g.outofthereachofchildren).Theevaluatorisnotabletocommentontheconstructionquality.

AbuSamra:DownpipesPlasticdownpipesfittedtomanyofthebuildings.Concernsaboutconstructionquality/robustness.Variationinfittings-somesecuredappropriatelywithbrackets,otherstiedwithwire/string.Recommendallaresecuredwithbrackets.

WadiNahle:staircaseNoconstructionconcerns.Doesnotappeartobemaintainedhowever-significantvolumeofsolidwaste-couldbecomeahazardduringwetweather(e.g.stairsbecomeslippy).Nohandrail(aspictured).

Evaluation of the Integrated Shelter and Protection ...

Documents

Transcript of Evaluation of the Integrated Shelter and Protection ...