Mason,R.O.... - USAID

18
AGENCY FOR INTSIANArIONAL DEVELOPMENT R AID USE ONLY WASHINGTON. 0. C 20523 BIBLIOGRAPM!C INPUT SHEET A. PRIMARV I. SUBJECT Population PA00-0000-G730 CLASSI- . FICATION _,_ATO_ So SECONDARY General--Pakistan 2. TITLE AND SUBTITLE Maximizing the use of research-In population programand policy development'in Pakistan 3. AUTHOR(S) Mason,R.O.... 4. DOCUMENT OATE NUMBER OF PAGES 6. OF. ARC, NUMBER. 1976 I RJARC PK301.32072.M411,, 7. REFERENCE ORGANIZATION NAME AND ADDRESS APHA S. SUPPLEMENTARY NOTES (Sponsoring Organizationg PubIlahera, Avallabl#ty) 9. ABSTRACT 10. CONTROL NUMBER 11.PRICE OF DOCUMENT 12. DESCRIPTORS 13. PROJECT NUMBER Pakistan .... 14. CONTRACT NUMBER Pol icies Projects AID/pha-C-1100 GTS 15. TYPE OF DOCUMENT Research AID 590.1 t474)r

Transcript of Mason,R.O.... - USAID

AGENCY FOR INTSIANArIONAL DEVELOPMENT R AID USE ONLY WASHINGTON 0 C 20523

BIBLIOGRAPMC INPUT SHEET A PRIMARV

I SUBJECT Population PA00-0000-G730 CLASSI- FICATION __ATO_

So SECONDARYGeneral--Pakistan

2 TITLE AND SUBTITLE

Maximizing the use of research-In population programand policy developmentin Pakistan 3 AUTHOR(S)

MasonRO 4 DOCUMENT OATE NUMBER OF PAGES 6OF ARC NUMBER

1976 I RJARC PK30132072M411 7 REFERENCE ORGANIZATION NAME AND ADDRESS

APHA

S SUPPLEMENTARY NOTES (Sponsoring Organizationg PubIlahera Avallablty)

9 ABSTRACT

10 CONTROL NUMBER 11PRICE OF DOCUMENT

12 DESCRIPTORS 13 PROJECT NUMBER

Pakistan 14 CONTRACT NUMBERPol icies

Projects AIDpha-C-1100 GTS 15 TYPE OF DOCUMENTResearch

AID 5901 t474)r

MAXIMIZING THE USE OF RESEARCH IN POPULATION PROGRAM AND POLICY

DEVELOPMENT IN PAKISTAN

A Report Prepared By

RICHARD0 MASON PHD

During The Period

MAY27 THROUGH JUNE10 1976

Under The Auspices Of

AMERICAN PUBLIC HEALTH ASSOCIATION

In Agreement With The

U S AGENCY FOR INTERNATIONAL DEVELOPMENT

AUTHORIZATION -AIDphaC-11 0 Ltr PHAPOP 42776APHA Assgn No 1100-0135

MAXIMIZING THE USE OF RESEARCH IN POPULATION PROGRAM AND POLICY

DEVELOPMENT IN PAKISTAN

Introduction and Summary

At the request of the USAID Mission the author visited Islamabad Pakistan during the period May 27 to June 10 1976 The purpose was to consult on the design of a mechanism for maximizing the probability that policy-makers concerned with Pakistans population problems would increasingly base their decisions on research and development efforts The general terms of reference were to develop a strategy for implementing the communication and utilization aspects of the Population Impact Analysis Section (Section B) of the Population Grants Project (PRP 391-4110)

The consultant spent two weeks in Islamabad including a field trip to Lahore During this period a substantial number of documents were read and discussions were held with some 24 knowledgeable people

A general conclusion is that policy-makers are not adeshyquately informed on relevant population research and seldom consider it in the policy-making process Moreover little of the current re3earch underway is directly policy relevant in the sense that it suggests new courses of action for population policy-makers

The principle recommendation is to institute a new research utilization organization within the Population Planning CouncilDivision reporting directly to the Joint Secretary and the Director General The suggested title is Demographic PolicyResearch Utilization (DPRU) DPRU will have overall responsibishylity for monitoring ongoing research monitoring policy-maker needs acquiring research results and disseminating research results to policy-makers Specifically DPRU will engage in nine activities participation in the project steering committee preparation of executive summaries of research preparation of research briefings preparation of news releases creating a mailing list conducting workshops and seminars creating an inventory of institutions in Pakistan creating a clearingshyhouse on population policy relevant research and developing a newsletter It is proposed that these activities will lead toward more informed policy-making on population problems in Pakistan

I BACKGROUND AND PURPOSE

The purpose of this project is to forge a link between the research community and the policy-making structure so that population policy in Pakistan is informed by the latest research findings We hope to increase the probability that pertinent and

valid research findings will either be implemented directly or

-2shy

at least considered along with other variables in the policyshymaking process Simultaneously researchers should be informedabout problems confronting policy-makers and encouraged to undershytake projects which address the critical issues that policyshymakers face

Creating this like between researchers and policy-makers is a major undertaking in institutional capacity building Itrequires a great deal of learning and effort on the part ofall parties involved The recommendations contained in this report constitute a beginning for building this capacity inPakistan They represent a foundation upon which a more active and permanent integration of research and policy-making can be built

During this two-week assignment a considerable number ofdocuments have been reviewed and approximately 24 interviews conducted This investigation resulted in several impressionswhich serve as the assumptions upon which the recommendations in Section II are based

Assessment of the social science research community inPakistan indicates that the quality is uneven and generally lowSome reasonably good projects in economics demography and fertility have been completed or underway but these are exceptionsLittle of the work is directly related to policy problems or altershynatives Moreover the researchers themselves expressed frustrashytion at the fact that their research findings are not beingconsidered by policy-makers and their voice is not heard Onlyone specific instance was uncovered at TREC in which a researcher reported that research results in any way directly affected policychoice This concerned the use of the Sialkot experiment results in the decision to implement the Continuous Motivation SystemOther illustrations were less direct For example the FamilyPlanning Association of Pakistan reported that they believed thatseveral of their projects had influenced government policy

A review of the policy-making structure was also not enshycouraging The institutional structure of Pakistan at theoperating level is rather diffuse There are few if anypermenent or sustained institutions available which can interpretresearch results mobilize resources and allocate them to solve population problems Exclusive of the very highest levels ofgovernment we were able to identify only three organizationswhich hold promise as implementors of policy research in the area of population These are the Planning Commission (which has ahistory of and the talent for research utilization but appearsto be several steps removed from the policy-making authorities)The Population Planning CouncilDivision (which was recentlyorganized so that their effectiveness in influencing policy isunknown at this time) and The Family Planning Association of

-3-

Pakistan in Lahore (which carries out a relatively agressive program but which because of limited funds and the nonshygovernmental nature of its activities can generally onlyconduct demonstration projects and not nation-wide programs)All of the policy-makers interviewed indicated that they would like to receive more research results A statement which is undoubtedly somewhat platitudinal but partly genuineThey were quick to point out that there were substantial demands on their time and that they have little time to devote to reading research results They receive large volumes of information each day and report that most research monographsand articles were long ill organized for their purposesrepleat with data formula and tables and generally too technical to read A consistent complaint was that the research was not addressed to their particular policy-making needs as they saw them

In light of this situation of generally low quality and low relevancy research on the one hand and of a rather loose knit policy-making structure on the other hand it may appear that research utilization programs are premature Howshyever we are embroiled in a kind of chicken and egg problemhere A good research utilization program can help to deal with both problems This is because the basic motivation of researchers is to serve first their academic and research community needs and demands whereas the basic motivation of policy-makers is to try to cope with the pressing day-to-dayneeds of the practical problems they face Each then operatecurrently as essentially separate entities Until some social mechanism is put in place to link policy-makers and researchers more closely together it appears that each will continue to goits separate way

An effective research utilization program will work to reduce some of the limitations discussed above The social dynamics are such that once a mechanism exists for using research new pressures can be placed on the research communityfor both relevancy and quality If the researchers perceivethat there is money (in the form of grants and contracts) and status (in the form of recognition) for tLeir work as well as academic credit they will begin to respond in a more appropriate way Once policy-makers begin to achieve results from research findings and learn to trust them they will begin to rely on them Moreover the successful use of valid research conclushysions will serve to strengthen their policy-making institutions

The role of the population research utilization programrecommended in Section II is to initiate this social dynamicin a small way Our ambitions are modest but positive We should recognize that national and international economic and political concerns and the pressing problems of the moment will always outweigh the consisetent use of research results in the policy-makers eye But an effective research utilization program is an important and perhaps necessary first step to more informed policy judgments

-4-

The long-term objective of the research utilization programis to create the informed policy-makers This ideal is a policy-maker who is aware of research results understands thebasis upon which they were obtained and is able to incorporatethe into active policy making This does not mean that the policy-maker blindly implements recommendations based on research findings (a point many researchers fail to comprehend)It does mean however that he is aware of the research findingsactively considers them in arriving at policy and is able if pressed to produce an argument as to why the policy he chose differe from the findings

The route to the informied policy-maker as an ideal involves three major processes

1 Awareness -- the policy-maker needs to be aware of extent and possible relevancy of existing and on-going research

2 Dissemination -- the policy-maker needs to receive thebullresearch results in a readable and informative way He also needs to know how he can acquire more information on a topic

3 Utilization -- once alerted and in possession of research findings the policy-maker needs to be encouraged to incorporate them into the policy-making process This involves at least three possibilities

a Selection -- the choosing of research which is pertinent to the policy topics he faces

b Adoption the direct implementation and operashytiohalization of research findings

c Adaption -- the modification and re-arrangingof research results to apply them to the specific problem at hand

The organization and activities recommended in the followingsection are desigiied to create a new institution within thePopulation Planning CouncilDivision to formalize these processhyses These processes are achieved through four generic activitiesdepending on the source of initiation of the activity These activities may be described as follows

1 Researchers study policy-makers problems and designprojects to solve them

2 Researchers educate policy-makers on research methods

and possibilities and solicit policy-makers guidance in the design of projects

-5shy

3 Policy-makers learn about research methods and possishybilities and suggest relevant projects

4 Policy-makers describe their policy-making problems to researchers so that the researchers can design relevant projects

These three general processes and four generic activities are fundamental to achieving the informed policy-maker ideal They have served as guidelines in constructing the recommendashytions which follow

II RECOMMENDED RESEARCH UTILIZATION PROCESS

A General

It is proposed that a separate unit be established within the Population Planning DivisionCouncil to carry out research utilization activities The suggested title is Demographic Policy Research Utilization (DPRU) This unit would be responsible for knowing and assessing the state of the art in population research as it affects Pakistan and adapting it to Pakistans needs These conclusions should be communicated to policy-makers in a manner which relates directly to their policy-making requirements

In total DPRU will engage in nine basic activities which

are specified below

B Major Activities

1 Participation iw the Poptlatiorf Gants Steeriny Committee The population grants program calls for a steering committee comshyposed of outstanding community leaders in the society researchers and members of Government DPRU should serve as the information arm of that committee Working under the direction of the committee chairman DPRU should

a Set meeting dates and places b Publish the meeting agenda c Prepare background papers and briefings for

the meeting d Publish a summary of the meeting and distrishy

bute it to the members

At least once a year DPRU will prepare and deliver to the steering committee a State-of-Population Research Utilization in Pakistan report This report will contain the following sections

a The Problem -- a brief summary of key demographic statistics for the year (and historically)

b Current Research on the Problem-- a summaryof research completed or undertaken duringthe year and its major findings

C DPRU Programs -- a summary of activities undertaken by DPRU to relate the research to policy-makers

d Utilization -- a summary of instances whereresearch results were used in setting populashytion policy or in devising new programs Specishyfic research results need not have been adoptedas is or even adapted to a particular problemahowever to qualify as utilization there shouldbe some evidence that the policy-maker actuallyreceived the research findings evaluated themand actively considered them in the process of making policy

2 Prepare Executive Summaries of Completed Research DPRUwill be responsible for preparing an Executive Summary for eachcompleted research project The length of these summaries will vary with the content of the project howeverit is expected thatthe summaries will generally be about 2-8 pages in length Theyshould rarely exceed 25 pages The primary audience for theseExecutive Summaries is the policy-makers who make and influencepopulation and family planning decisions in Pakistan

The general outline of each Summary should be as follows

a One or two paragraphs (no more than one pagemaximum) describing the background and purposesof the research

b A list of the principal findings

c A list of the policy implications of the findings

d A discussion of the results of the research as theyrelate to policy This will include a discussion of the assumptions and conditions under which policyimpacts or recommendations are appropriate Thediscussions should also include an assessment of the adequacy of the data used in research theresearch design and the methods of analysis as theypertain to the validity of the policy implicationsA discussion of related research and its findings(including agreements and differences) should beincluded where appropriate

In general these Executive Summaries should meet the requireshyments of good journalism They should be concise readable simpleclear and closely related to the policy concerns of the audience

-7

Where possible graphs tables and other visuals should be employed Since the graphs and tables contained in many research reports are too detailed and busy DPRU often will have to redraw and simplify them so that the key points are better communicated to the audience

Executive Summaries will constitute series number one of the DPRU publications In the beginning of the program simple offshyset reproduction printing methods should be used A standard front cover should be used for t1eseries which clearly identishyfies that this is an Executive Summary and that DPRU is the source The last page of the Summary should inform the reader on how to acquire a copy of the complete research monograph and on the availability of other Summaries and Monographs

Executive Summaries should be prepared (required) for every project completed under the Population Grants Program and where possible for any other research project of potential use to policy-makers

3 Prepare Briefings on Completed Research The written word by iEself is not the most effective form of communication Dialogue discussion and personal involvement increase the degree of communication Consequently the Executive Summaries should be used to develop short briefings for policy-makers These briefings should be 15-20 minutes in length and should make use of visual displays An overhead projector with transparencies should be used most frequently but very important items might be prepared on large charts

Most of the briefings will be delivered to groups of 3-4 people but consideration should be given to the possibility of delivering the briefing to a single influencial person or to a group of say 25 In any event the briefing session should be scheuled so that ample time is available during each session for questions and discussions on the report The person presenting the briefing should be prepared with topics for discussion concerning the report and where possible and proper should engage people in discussion

A briefin i should always be scheduled for the Planning Commission and for the Population Planning Council Attempts should be made to brief the Minister of Health and other Minisshytries if possible As many other interested organizations and influencial parties as possible should also be briefed

In developing this program the DPRU should review the Audio-Visual Projects effort undeviay at the Family Plannng Association of Pakistan (Lahore) and other policy oriented audiovisual programs in Pakistan

--

8shy

4 Prepare and Distribute News releases Studies of policyshymakers in the United States find that they acquire most of theirscientific information from the newspapers Moreover personalexperience in working with US Congressional staffs and otherstaff members for influencial decision makers reveals that theyread news releases before they read many other materials Thereare several reasons for this News releases are short andgenerally well writtqp they focus on only the key points ofinterest they are timely and they reveal what the sourceorganization thinks is important Thus the news release itself becomes a communication medium

Using the Executive Sunmaries as background news releasesshould be prepared for completed research whenever the qualityis adequate They should be distributed to policy-makersand their staffs as well as to the press Special results mightwarrant a full-blown press conference One advantage of a pubshylished news item is that it raises the public consciousness aswell as that of the leaders

5 Maintain a Mailing List DPRU should develop and mainshytain a mailing list of people in population planning policy inPakistan This would include the names and addresses ofinfluential policy-makers and researchers with regard to populashytion problems in Pakistan It should be organized by institutionGovernment Industry Association University etc The listwill be used to send out items of interest to appropriate parties

DPRU can begin to constructthis list by drawing on existinglists For example FPAP has a list of 25000 to 35000 peoplewhich representatives indicated it would be willing to share

6 Create an Institutional Inventory In any social systempolicy is carried out via its institutions They are the bases upon which attitudes are formed and instrumentalities throughwhich resources are mobilized and allocated When they acceptan innovation the likelihood of adoption is increased When theyreject one they constitute a formidable barrier

Consequently DPRU should identify and record as much of theinstitutional structure of Pakistan as possible This recordshould include the institution its leadership its location andthe number of people affected by it (employees participants etc)

The inventory will include governments state provincialdistrict tehsil union council industry unions religiouisleaders newspapers universities associations etc Only thelargest and most important need be identified at the start butthe inventory should be expanded over the years Among the uses of the inventory are the following

a A basis for assessing social impactof populationpolicy recommendation

b A source for personnel to be included in the mailing list

c A source of sites for pilot and demonstration projects (and if necessary for experimental purposes for control sites)

7 Conduct Workshops and Seminars In a personalisticculture such as Pakistan face-to-face communication is imporshyotant Workshops and Seminars are one method by which this form of communication can be promoted DPRU should conduct workshopsof two types

a Problem Identification A quick review of some of the existing research and discussion with policy-makers suggests that much of the current research is tangentialto the central concerns of policy-makers The purpose of a problems identification workshop is to bring policyshymakers and researchers together in a format in which policyshymakers can indicate their needs and in which researchers can suggest possible projects for securing information consisshytent with these needs The ideal project should be both policy relevant and scientifically sound Sometimes these criteria are in conflict especially given limited budgets and short decision times Consequently one of the functions of the problem identification workshop is to reach comproshymises where these conflicts occur

A model for such a workshop is as follows

1 DPRU identifies one or two broad areas of policy relevance (eg education of women use of incentives value of children)

2 A leading policy-maker is asked to preside over ther workshop and to present some of his or herviews on the problem as a keynote on the topics

3 About five policy-makers or research users in the topicarea and five resear-hers plus a few other interested parties (eg representatives of Donor agencies) are invited to the workshop

4 The keynote is presented followed by a series of discussions on subtopics during which users relate their needs and researchers discuss the researchability of the topicsOf particular importance is a discussion of data availabilityThe chairman of the session seeks to secure some consensus of the nature of the problem and some acceptable research strateshygies As an option he may attempt to assign priorities to the possible research topics

10

5 The workshop is recorded (or a good scribe is employed)Following the workshop DPRU prepares a short report describingthe workshop and its key findings In completing the reportDPRU may want to contact participants for clarification andaugmentation of the ideas presented in the meeting The reportis distributed to both policy-makers and researchers These reports can be especially effective if they servc as the basis upon which research grants are made

b Seminars on Research Findings In addition tothe briefings described above it is often useful to holdseminars in which both policy-makers and researchers explorethe implications and possible utility of completed researchprojects The seminar should be designed to assess the strengthsand weaknesses of the research in terms of its internal and external validity and its relevance for policy making

A model for such a seminar is as follows

1) DPRU Identifies about 10 or 15 reseachers and policyshymakers with interest in the completed research and invites them to the seminar

2) a researcher (other than the whoone did the research)-is selected and starts off the seminar by presenting a summaryof the project This is followed by a critique -

3) a policy-maker reviews the researchandpresents an evaluation from a policy-making perspective

4) the researcher comments on the two preceeding presen- tations

5) the seminar is opened to general discussion

6) toward the end of the seminar the chairman attempts toreach agreement on action steps that might proceed on the basisof the results and on topics for further research

7) a record of the seminar and its conclusions if published

8 Create and Maintain a Clearinghouse on Research and Policy Sources Relevant to Pakistan Discussion with

both researchers and policy-makers indicates that there iscurrently an institutional deficiency in handling the volume of pertinent research results and making them available toresearchers and policy-makers DPRU should create a populationresearch clearinghouse to fill this void While this taskhas lesser priority than the preceeding ones it is neverthelessimportant to the overall improvement of population research utilization in Pakistan

The clearinghouse would maintain a file on three different kinds of information relevent to policy-making and research ie a) published works b) sources of data and c) names and addresses of individuals who have expertise in relevant fields

The clearinghouse should begin modestly and draw heavily on existing sources It should engage in the following activities

a Create a taxonomy for classifying published works (and expertise) The taxonomy should include policy variables (ie independent variables) measures of fertility and other outcomes (ie dependent variables) methodology data source and location of study A good place to start is to study the classification used by McGreevey in The Policy Relevance of Recent Social Research on Fertility Smithsonian Institute Occasional Monograph Series Number two

b Develop a biblicgraphy of pertinent works and classify existing research In doing these full use should be made of existing indexes such as those published by USAID TREC PIDE NRIFC and FPAP Each item of potential use to Pakistani researchers and policy-makers should be identified classified and summarized briefly A suitable technology for rimning the clearinghouse is the McBee key sort edge punched card system The particulars of the item are recorded in the body of the card and the classifications are recorded by notches in the edge of the card A needle is used on the pack of cards to outsort those which satisfy a particular inquiry for items subsumed under certain specified categories Each card should indicate where to find the document

c DPRU should keep an inventory of what data is available and where and how it can be accessed hbis will be used to answer iquiries by both reseachers and policy-makers who have a need for data

d Another edged punched card system should be set up to classify individuals both in Pakistan and elsewhere who have expertise on elevant topics The taxonomy discussed above would be the basis for classification An ideal use of the expert file would occur when a policyshymaker contacted DPRU in order to obtain advice on a topic of interest In addition to published works DPRU would suggest an expert or two in the area whose knowledge and opinion on the topic could be requested

9 Edit and Publish a Newsletter This is the lowest priority activity for DPRU however consideration should be given to publishing a newsletter containing concise articles on new research findings other items of interest and where and how to send for publication It would be distributed to

- 12 shy

the mailing list discussed above Its primary advantage is tokeep the reader aware of population problems research-based solutions and DPRU

_C Organization and Job Specifications

DPRU will be headed by a deputy director who reports directly to the Director (DPRC) and the Joint Secretary The -

Director initially will be supported by a communication specialist and a research analyst

1 Director The Deputy Director should be a person whois known and respected by the key policy-makers at PPC thePlanning Commission and the Ministries of Government Heshould have access to them for informal discussion as well asformal presentation He should be very familiar with thepopulation program in Pakistan If possible he should also befamiliar with current population research and research methodsbut this is a secondary requirement

The Director will be primary presentor at the briefings andat the stearing committee meetings He should also be active inthe workshops and seminars especially when high-level policyshymakers are involved His continuing responsibility is tolobby or implementation of research findings with policy-makersand to keep himself appraised of their concerns in the populationplanning area He should also maintain contact with organizationssuch as the Family Planning Association of Pakistan It is likelythat if some of the potentially useful findings of that organizashytion are mediated through DPRU the chances for adoption or adaptation will be improved

Under the supervision of the Director of DPRU are twospecialists--a communirtion specialist and a research analystwho must work together closely to accomplish the units tasks

2 Communication Specialist The person should have studiedjournalism and hopefully should have some experience in writingand reporting on scientific or technological activities Theability to write well and to present ideas clearly is critical to the functioning of the role

Primary responsibilities are to write executive summariesusing analysis prepared by the research analyst prepare briefshyings write news releases maintain mailing list create theinstitutional inventory participate in workshops preparepresentation for steering committee and edit and publish thenewsletter

13 shy

Research st This person should have experiencein research and researflchethodology Ideally this experience would be in population or related areas The individual need not be an accomplished researcher (although this is desirable)but should be able to converse with researchers on technical topics critique research studies from a methodological pointof -view summarize research findings and to relate them to other existing research

Primary responsiblities are to maintain liaison with researchers acquire completed research and to analyze research for its essential findings The role includes primary responsibishylity for maintaining the clearinghouse This person will also contribute to the other activities of the unit

D Time Phasing for the Installation of DPRU

Initially there will be little new coming research for DPRU to review and communicate During the development and transition to a steady state it is suggested that DPRU proceedin the following manner

The first task for DPRU will be to identify and assess the state of the art in population research in Pakistan This should be available at the first meeting of the steering commitshytee The assessment will serve as the basis for creating the clearinghouse Simultaneously the mailing list should be developed In addition to their substantive contributions the construction of the mailing list and the clearinghouse will force DPRU to become familiar with level of research and the researchers themselves currently active in Pakistan and also with the policy-makers with whom they are to communicate Early on a research problem identification workshop should be held

As research results become available DPRUs mode of activity shifts to the preparation of executive summaries briefings and workshops Then the clearing house and the mailing list are maintained When these activities are well underway the newsletter and institutional inventory can be considered

M Technical Assistance Required

The amount and character of further USAID technical assisshytance required to insure the DPRU has adequate capacity to fulfii its assigned tasks will depend largely on the talents and skills Df the 3 people it employs Since it is likely that all requisiteabilities will not be available some technical assistamcewill undoubtedly be required Potential requirements are specified below

- 14 shy

1 A consultant on the communication of scientific findingsto policy-makers for the period of approximately one monthPossible sources of the required expertise are policy orientedassociations such as TheConference Board media organizationssuch as Scientific American Science or Business Week and otherGovernment agencies The consultant would hold training sessionsfor the personnel and walk them through an application

2 A one or two-week course on preparing visual presentashytions and graphs to be used in the briefing and in the executivesummaries At the beginning this should concentrate on effecshytive use of overhead projectors and transparencies

3 The creation of the clearinghouse will require thesupport of a two-person team One person who is expert in thecurrent state-of-the-art in population research who will aid indivising the taxonomy and one person who is expert in classifishycation systems and information storage and retrieval using manualtechnologies who will aid in setting up the system and developingprocedures for running it This person will likely be found at a library school This will require about one month each

4 The creation of the institutional inventory may benefitfrom at least two weeks of the services of an anthropologistsociologist andor a political scientist who is familiar with Pakistan

5 The editing and publishing of the newsletter may benefitfrom the consultation of a successful newsletter editor in the USMajor problems are audience identification preparing copy layoutand pasting-up original forms for publication

6 These recommedations assume that adequate printing andreproduction facilities are available If not some additional support will be required in this area

F Other USAID Items of Concern

1 USAID Personnel should participate to the extent possishyble politically to insure that the Director of DPRU has the stature and talent required

2 USAID personnel should encourage the formation and periodic meetings of the steering committee-

G People interviewed

USAID

I Dr Steven W Sinding 2William R McIntyre 3 Marvin A Schwartz 4 Thomas R Mahoney

- 15 shy

5 Dr Andrew P Haynal 6 David Oot 7 Ruth S Plunkett 8 Hugh S Plunkett

POaulation Planning Council(PPC)

1 Mr M Alauddin Joint Secretary 2 Dr Wiqar Zaidi Director DPARC 3 Dr Makhdoom Ali Shah Director of Implementation

Planning Commission

1 Javid Hamid Chief of Economic Research 2 Jawaid Azfar Chief of Population Research

PIDE (Pakistan Institute of Development Economics)

1 M L Qureshi Director 2 Mohammad Afzal Chief of Population Section 3 Dr Steven Guisinger Economist 4 Dr Dennis DeTray EconomistDemographer

Family Planning Association of Pakistan 1 Mrs Surayya Jabeen Senior Director for Liaison

with Government and International Agenciesshy

2 Mr Naseer Chaudhry Assistant Director Field Operations

3 Mr Sabir Shah Field Representative

Note - FPAP arranged field trips to two familyplanning centers operated by the Pakistan Railway and to a village in the Shadab Pilot Project area where the family planning projectis integrated into the Integrated Rural Developshyment program These trips resulted in discusshysions with many participants including the President of the Peoples Welfare Society in the Shadab village

Training Research Evaluation Centre (TREC)

1 Mr Nizamuddin Deputy Director Social Research

Continus Motivation System (CMS)

1 Mrs Eatram -bullDistrict Population Planningliofficer Rawalpindi

- 16 o

Other Researchers

1 Mr Mahmood Roshan PhD Candidate (in dissertation)School of Public Health University of California Berkeley

Other Interested Parties

1 Dr John C -Cool Director of Ford Foundation in Pakistan

Private Firm Researchers 1 Mr Owais Akhlaq and Owais AdvertisingandMarket

Research

MAXIMIZING THE USE OF RESEARCH IN POPULATION PROGRAM AND POLICY

DEVELOPMENT IN PAKISTAN

A Report Prepared By

RICHARD0 MASON PHD

During The Period

MAY27 THROUGH JUNE10 1976

Under The Auspices Of

AMERICAN PUBLIC HEALTH ASSOCIATION

In Agreement With The

U S AGENCY FOR INTERNATIONAL DEVELOPMENT

AUTHORIZATION -AIDphaC-11 0 Ltr PHAPOP 42776APHA Assgn No 1100-0135

MAXIMIZING THE USE OF RESEARCH IN POPULATION PROGRAM AND POLICY

DEVELOPMENT IN PAKISTAN

Introduction and Summary

At the request of the USAID Mission the author visited Islamabad Pakistan during the period May 27 to June 10 1976 The purpose was to consult on the design of a mechanism for maximizing the probability that policy-makers concerned with Pakistans population problems would increasingly base their decisions on research and development efforts The general terms of reference were to develop a strategy for implementing the communication and utilization aspects of the Population Impact Analysis Section (Section B) of the Population Grants Project (PRP 391-4110)

The consultant spent two weeks in Islamabad including a field trip to Lahore During this period a substantial number of documents were read and discussions were held with some 24 knowledgeable people

A general conclusion is that policy-makers are not adeshyquately informed on relevant population research and seldom consider it in the policy-making process Moreover little of the current re3earch underway is directly policy relevant in the sense that it suggests new courses of action for population policy-makers

The principle recommendation is to institute a new research utilization organization within the Population Planning CouncilDivision reporting directly to the Joint Secretary and the Director General The suggested title is Demographic PolicyResearch Utilization (DPRU) DPRU will have overall responsibishylity for monitoring ongoing research monitoring policy-maker needs acquiring research results and disseminating research results to policy-makers Specifically DPRU will engage in nine activities participation in the project steering committee preparation of executive summaries of research preparation of research briefings preparation of news releases creating a mailing list conducting workshops and seminars creating an inventory of institutions in Pakistan creating a clearingshyhouse on population policy relevant research and developing a newsletter It is proposed that these activities will lead toward more informed policy-making on population problems in Pakistan

I BACKGROUND AND PURPOSE

The purpose of this project is to forge a link between the research community and the policy-making structure so that population policy in Pakistan is informed by the latest research findings We hope to increase the probability that pertinent and

valid research findings will either be implemented directly or

-2shy

at least considered along with other variables in the policyshymaking process Simultaneously researchers should be informedabout problems confronting policy-makers and encouraged to undershytake projects which address the critical issues that policyshymakers face

Creating this like between researchers and policy-makers is a major undertaking in institutional capacity building Itrequires a great deal of learning and effort on the part ofall parties involved The recommendations contained in this report constitute a beginning for building this capacity inPakistan They represent a foundation upon which a more active and permanent integration of research and policy-making can be built

During this two-week assignment a considerable number ofdocuments have been reviewed and approximately 24 interviews conducted This investigation resulted in several impressionswhich serve as the assumptions upon which the recommendations in Section II are based

Assessment of the social science research community inPakistan indicates that the quality is uneven and generally lowSome reasonably good projects in economics demography and fertility have been completed or underway but these are exceptionsLittle of the work is directly related to policy problems or altershynatives Moreover the researchers themselves expressed frustrashytion at the fact that their research findings are not beingconsidered by policy-makers and their voice is not heard Onlyone specific instance was uncovered at TREC in which a researcher reported that research results in any way directly affected policychoice This concerned the use of the Sialkot experiment results in the decision to implement the Continuous Motivation SystemOther illustrations were less direct For example the FamilyPlanning Association of Pakistan reported that they believed thatseveral of their projects had influenced government policy

A review of the policy-making structure was also not enshycouraging The institutional structure of Pakistan at theoperating level is rather diffuse There are few if anypermenent or sustained institutions available which can interpretresearch results mobilize resources and allocate them to solve population problems Exclusive of the very highest levels ofgovernment we were able to identify only three organizationswhich hold promise as implementors of policy research in the area of population These are the Planning Commission (which has ahistory of and the talent for research utilization but appearsto be several steps removed from the policy-making authorities)The Population Planning CouncilDivision (which was recentlyorganized so that their effectiveness in influencing policy isunknown at this time) and The Family Planning Association of

-3-

Pakistan in Lahore (which carries out a relatively agressive program but which because of limited funds and the nonshygovernmental nature of its activities can generally onlyconduct demonstration projects and not nation-wide programs)All of the policy-makers interviewed indicated that they would like to receive more research results A statement which is undoubtedly somewhat platitudinal but partly genuineThey were quick to point out that there were substantial demands on their time and that they have little time to devote to reading research results They receive large volumes of information each day and report that most research monographsand articles were long ill organized for their purposesrepleat with data formula and tables and generally too technical to read A consistent complaint was that the research was not addressed to their particular policy-making needs as they saw them

In light of this situation of generally low quality and low relevancy research on the one hand and of a rather loose knit policy-making structure on the other hand it may appear that research utilization programs are premature Howshyever we are embroiled in a kind of chicken and egg problemhere A good research utilization program can help to deal with both problems This is because the basic motivation of researchers is to serve first their academic and research community needs and demands whereas the basic motivation of policy-makers is to try to cope with the pressing day-to-dayneeds of the practical problems they face Each then operatecurrently as essentially separate entities Until some social mechanism is put in place to link policy-makers and researchers more closely together it appears that each will continue to goits separate way

An effective research utilization program will work to reduce some of the limitations discussed above The social dynamics are such that once a mechanism exists for using research new pressures can be placed on the research communityfor both relevancy and quality If the researchers perceivethat there is money (in the form of grants and contracts) and status (in the form of recognition) for tLeir work as well as academic credit they will begin to respond in a more appropriate way Once policy-makers begin to achieve results from research findings and learn to trust them they will begin to rely on them Moreover the successful use of valid research conclushysions will serve to strengthen their policy-making institutions

The role of the population research utilization programrecommended in Section II is to initiate this social dynamicin a small way Our ambitions are modest but positive We should recognize that national and international economic and political concerns and the pressing problems of the moment will always outweigh the consisetent use of research results in the policy-makers eye But an effective research utilization program is an important and perhaps necessary first step to more informed policy judgments

-4-

The long-term objective of the research utilization programis to create the informed policy-makers This ideal is a policy-maker who is aware of research results understands thebasis upon which they were obtained and is able to incorporatethe into active policy making This does not mean that the policy-maker blindly implements recommendations based on research findings (a point many researchers fail to comprehend)It does mean however that he is aware of the research findingsactively considers them in arriving at policy and is able if pressed to produce an argument as to why the policy he chose differe from the findings

The route to the informied policy-maker as an ideal involves three major processes

1 Awareness -- the policy-maker needs to be aware of extent and possible relevancy of existing and on-going research

2 Dissemination -- the policy-maker needs to receive thebullresearch results in a readable and informative way He also needs to know how he can acquire more information on a topic

3 Utilization -- once alerted and in possession of research findings the policy-maker needs to be encouraged to incorporate them into the policy-making process This involves at least three possibilities

a Selection -- the choosing of research which is pertinent to the policy topics he faces

b Adoption the direct implementation and operashytiohalization of research findings

c Adaption -- the modification and re-arrangingof research results to apply them to the specific problem at hand

The organization and activities recommended in the followingsection are desigiied to create a new institution within thePopulation Planning CouncilDivision to formalize these processhyses These processes are achieved through four generic activitiesdepending on the source of initiation of the activity These activities may be described as follows

1 Researchers study policy-makers problems and designprojects to solve them

2 Researchers educate policy-makers on research methods

and possibilities and solicit policy-makers guidance in the design of projects

-5shy

3 Policy-makers learn about research methods and possishybilities and suggest relevant projects

4 Policy-makers describe their policy-making problems to researchers so that the researchers can design relevant projects

These three general processes and four generic activities are fundamental to achieving the informed policy-maker ideal They have served as guidelines in constructing the recommendashytions which follow

II RECOMMENDED RESEARCH UTILIZATION PROCESS

A General

It is proposed that a separate unit be established within the Population Planning DivisionCouncil to carry out research utilization activities The suggested title is Demographic Policy Research Utilization (DPRU) This unit would be responsible for knowing and assessing the state of the art in population research as it affects Pakistan and adapting it to Pakistans needs These conclusions should be communicated to policy-makers in a manner which relates directly to their policy-making requirements

In total DPRU will engage in nine basic activities which

are specified below

B Major Activities

1 Participation iw the Poptlatiorf Gants Steeriny Committee The population grants program calls for a steering committee comshyposed of outstanding community leaders in the society researchers and members of Government DPRU should serve as the information arm of that committee Working under the direction of the committee chairman DPRU should

a Set meeting dates and places b Publish the meeting agenda c Prepare background papers and briefings for

the meeting d Publish a summary of the meeting and distrishy

bute it to the members

At least once a year DPRU will prepare and deliver to the steering committee a State-of-Population Research Utilization in Pakistan report This report will contain the following sections

a The Problem -- a brief summary of key demographic statistics for the year (and historically)

b Current Research on the Problem-- a summaryof research completed or undertaken duringthe year and its major findings

C DPRU Programs -- a summary of activities undertaken by DPRU to relate the research to policy-makers

d Utilization -- a summary of instances whereresearch results were used in setting populashytion policy or in devising new programs Specishyfic research results need not have been adoptedas is or even adapted to a particular problemahowever to qualify as utilization there shouldbe some evidence that the policy-maker actuallyreceived the research findings evaluated themand actively considered them in the process of making policy

2 Prepare Executive Summaries of Completed Research DPRUwill be responsible for preparing an Executive Summary for eachcompleted research project The length of these summaries will vary with the content of the project howeverit is expected thatthe summaries will generally be about 2-8 pages in length Theyshould rarely exceed 25 pages The primary audience for theseExecutive Summaries is the policy-makers who make and influencepopulation and family planning decisions in Pakistan

The general outline of each Summary should be as follows

a One or two paragraphs (no more than one pagemaximum) describing the background and purposesof the research

b A list of the principal findings

c A list of the policy implications of the findings

d A discussion of the results of the research as theyrelate to policy This will include a discussion of the assumptions and conditions under which policyimpacts or recommendations are appropriate Thediscussions should also include an assessment of the adequacy of the data used in research theresearch design and the methods of analysis as theypertain to the validity of the policy implicationsA discussion of related research and its findings(including agreements and differences) should beincluded where appropriate

In general these Executive Summaries should meet the requireshyments of good journalism They should be concise readable simpleclear and closely related to the policy concerns of the audience

-7

Where possible graphs tables and other visuals should be employed Since the graphs and tables contained in many research reports are too detailed and busy DPRU often will have to redraw and simplify them so that the key points are better communicated to the audience

Executive Summaries will constitute series number one of the DPRU publications In the beginning of the program simple offshyset reproduction printing methods should be used A standard front cover should be used for t1eseries which clearly identishyfies that this is an Executive Summary and that DPRU is the source The last page of the Summary should inform the reader on how to acquire a copy of the complete research monograph and on the availability of other Summaries and Monographs

Executive Summaries should be prepared (required) for every project completed under the Population Grants Program and where possible for any other research project of potential use to policy-makers

3 Prepare Briefings on Completed Research The written word by iEself is not the most effective form of communication Dialogue discussion and personal involvement increase the degree of communication Consequently the Executive Summaries should be used to develop short briefings for policy-makers These briefings should be 15-20 minutes in length and should make use of visual displays An overhead projector with transparencies should be used most frequently but very important items might be prepared on large charts

Most of the briefings will be delivered to groups of 3-4 people but consideration should be given to the possibility of delivering the briefing to a single influencial person or to a group of say 25 In any event the briefing session should be scheuled so that ample time is available during each session for questions and discussions on the report The person presenting the briefing should be prepared with topics for discussion concerning the report and where possible and proper should engage people in discussion

A briefin i should always be scheduled for the Planning Commission and for the Population Planning Council Attempts should be made to brief the Minister of Health and other Minisshytries if possible As many other interested organizations and influencial parties as possible should also be briefed

In developing this program the DPRU should review the Audio-Visual Projects effort undeviay at the Family Plannng Association of Pakistan (Lahore) and other policy oriented audiovisual programs in Pakistan

--

8shy

4 Prepare and Distribute News releases Studies of policyshymakers in the United States find that they acquire most of theirscientific information from the newspapers Moreover personalexperience in working with US Congressional staffs and otherstaff members for influencial decision makers reveals that theyread news releases before they read many other materials Thereare several reasons for this News releases are short andgenerally well writtqp they focus on only the key points ofinterest they are timely and they reveal what the sourceorganization thinks is important Thus the news release itself becomes a communication medium

Using the Executive Sunmaries as background news releasesshould be prepared for completed research whenever the qualityis adequate They should be distributed to policy-makersand their staffs as well as to the press Special results mightwarrant a full-blown press conference One advantage of a pubshylished news item is that it raises the public consciousness aswell as that of the leaders

5 Maintain a Mailing List DPRU should develop and mainshytain a mailing list of people in population planning policy inPakistan This would include the names and addresses ofinfluential policy-makers and researchers with regard to populashytion problems in Pakistan It should be organized by institutionGovernment Industry Association University etc The listwill be used to send out items of interest to appropriate parties

DPRU can begin to constructthis list by drawing on existinglists For example FPAP has a list of 25000 to 35000 peoplewhich representatives indicated it would be willing to share

6 Create an Institutional Inventory In any social systempolicy is carried out via its institutions They are the bases upon which attitudes are formed and instrumentalities throughwhich resources are mobilized and allocated When they acceptan innovation the likelihood of adoption is increased When theyreject one they constitute a formidable barrier

Consequently DPRU should identify and record as much of theinstitutional structure of Pakistan as possible This recordshould include the institution its leadership its location andthe number of people affected by it (employees participants etc)

The inventory will include governments state provincialdistrict tehsil union council industry unions religiouisleaders newspapers universities associations etc Only thelargest and most important need be identified at the start butthe inventory should be expanded over the years Among the uses of the inventory are the following

a A basis for assessing social impactof populationpolicy recommendation

b A source for personnel to be included in the mailing list

c A source of sites for pilot and demonstration projects (and if necessary for experimental purposes for control sites)

7 Conduct Workshops and Seminars In a personalisticculture such as Pakistan face-to-face communication is imporshyotant Workshops and Seminars are one method by which this form of communication can be promoted DPRU should conduct workshopsof two types

a Problem Identification A quick review of some of the existing research and discussion with policy-makers suggests that much of the current research is tangentialto the central concerns of policy-makers The purpose of a problems identification workshop is to bring policyshymakers and researchers together in a format in which policyshymakers can indicate their needs and in which researchers can suggest possible projects for securing information consisshytent with these needs The ideal project should be both policy relevant and scientifically sound Sometimes these criteria are in conflict especially given limited budgets and short decision times Consequently one of the functions of the problem identification workshop is to reach comproshymises where these conflicts occur

A model for such a workshop is as follows

1 DPRU identifies one or two broad areas of policy relevance (eg education of women use of incentives value of children)

2 A leading policy-maker is asked to preside over ther workshop and to present some of his or herviews on the problem as a keynote on the topics

3 About five policy-makers or research users in the topicarea and five resear-hers plus a few other interested parties (eg representatives of Donor agencies) are invited to the workshop

4 The keynote is presented followed by a series of discussions on subtopics during which users relate their needs and researchers discuss the researchability of the topicsOf particular importance is a discussion of data availabilityThe chairman of the session seeks to secure some consensus of the nature of the problem and some acceptable research strateshygies As an option he may attempt to assign priorities to the possible research topics

10

5 The workshop is recorded (or a good scribe is employed)Following the workshop DPRU prepares a short report describingthe workshop and its key findings In completing the reportDPRU may want to contact participants for clarification andaugmentation of the ideas presented in the meeting The reportis distributed to both policy-makers and researchers These reports can be especially effective if they servc as the basis upon which research grants are made

b Seminars on Research Findings In addition tothe briefings described above it is often useful to holdseminars in which both policy-makers and researchers explorethe implications and possible utility of completed researchprojects The seminar should be designed to assess the strengthsand weaknesses of the research in terms of its internal and external validity and its relevance for policy making

A model for such a seminar is as follows

1) DPRU Identifies about 10 or 15 reseachers and policyshymakers with interest in the completed research and invites them to the seminar

2) a researcher (other than the whoone did the research)-is selected and starts off the seminar by presenting a summaryof the project This is followed by a critique -

3) a policy-maker reviews the researchandpresents an evaluation from a policy-making perspective

4) the researcher comments on the two preceeding presen- tations

5) the seminar is opened to general discussion

6) toward the end of the seminar the chairman attempts toreach agreement on action steps that might proceed on the basisof the results and on topics for further research

7) a record of the seminar and its conclusions if published

8 Create and Maintain a Clearinghouse on Research and Policy Sources Relevant to Pakistan Discussion with

both researchers and policy-makers indicates that there iscurrently an institutional deficiency in handling the volume of pertinent research results and making them available toresearchers and policy-makers DPRU should create a populationresearch clearinghouse to fill this void While this taskhas lesser priority than the preceeding ones it is neverthelessimportant to the overall improvement of population research utilization in Pakistan

The clearinghouse would maintain a file on three different kinds of information relevent to policy-making and research ie a) published works b) sources of data and c) names and addresses of individuals who have expertise in relevant fields

The clearinghouse should begin modestly and draw heavily on existing sources It should engage in the following activities

a Create a taxonomy for classifying published works (and expertise) The taxonomy should include policy variables (ie independent variables) measures of fertility and other outcomes (ie dependent variables) methodology data source and location of study A good place to start is to study the classification used by McGreevey in The Policy Relevance of Recent Social Research on Fertility Smithsonian Institute Occasional Monograph Series Number two

b Develop a biblicgraphy of pertinent works and classify existing research In doing these full use should be made of existing indexes such as those published by USAID TREC PIDE NRIFC and FPAP Each item of potential use to Pakistani researchers and policy-makers should be identified classified and summarized briefly A suitable technology for rimning the clearinghouse is the McBee key sort edge punched card system The particulars of the item are recorded in the body of the card and the classifications are recorded by notches in the edge of the card A needle is used on the pack of cards to outsort those which satisfy a particular inquiry for items subsumed under certain specified categories Each card should indicate where to find the document

c DPRU should keep an inventory of what data is available and where and how it can be accessed hbis will be used to answer iquiries by both reseachers and policy-makers who have a need for data

d Another edged punched card system should be set up to classify individuals both in Pakistan and elsewhere who have expertise on elevant topics The taxonomy discussed above would be the basis for classification An ideal use of the expert file would occur when a policyshymaker contacted DPRU in order to obtain advice on a topic of interest In addition to published works DPRU would suggest an expert or two in the area whose knowledge and opinion on the topic could be requested

9 Edit and Publish a Newsletter This is the lowest priority activity for DPRU however consideration should be given to publishing a newsletter containing concise articles on new research findings other items of interest and where and how to send for publication It would be distributed to

- 12 shy

the mailing list discussed above Its primary advantage is tokeep the reader aware of population problems research-based solutions and DPRU

_C Organization and Job Specifications

DPRU will be headed by a deputy director who reports directly to the Director (DPRC) and the Joint Secretary The -

Director initially will be supported by a communication specialist and a research analyst

1 Director The Deputy Director should be a person whois known and respected by the key policy-makers at PPC thePlanning Commission and the Ministries of Government Heshould have access to them for informal discussion as well asformal presentation He should be very familiar with thepopulation program in Pakistan If possible he should also befamiliar with current population research and research methodsbut this is a secondary requirement

The Director will be primary presentor at the briefings andat the stearing committee meetings He should also be active inthe workshops and seminars especially when high-level policyshymakers are involved His continuing responsibility is tolobby or implementation of research findings with policy-makersand to keep himself appraised of their concerns in the populationplanning area He should also maintain contact with organizationssuch as the Family Planning Association of Pakistan It is likelythat if some of the potentially useful findings of that organizashytion are mediated through DPRU the chances for adoption or adaptation will be improved

Under the supervision of the Director of DPRU are twospecialists--a communirtion specialist and a research analystwho must work together closely to accomplish the units tasks

2 Communication Specialist The person should have studiedjournalism and hopefully should have some experience in writingand reporting on scientific or technological activities Theability to write well and to present ideas clearly is critical to the functioning of the role

Primary responsibilities are to write executive summariesusing analysis prepared by the research analyst prepare briefshyings write news releases maintain mailing list create theinstitutional inventory participate in workshops preparepresentation for steering committee and edit and publish thenewsletter

13 shy

Research st This person should have experiencein research and researflchethodology Ideally this experience would be in population or related areas The individual need not be an accomplished researcher (although this is desirable)but should be able to converse with researchers on technical topics critique research studies from a methodological pointof -view summarize research findings and to relate them to other existing research

Primary responsiblities are to maintain liaison with researchers acquire completed research and to analyze research for its essential findings The role includes primary responsibishylity for maintaining the clearinghouse This person will also contribute to the other activities of the unit

D Time Phasing for the Installation of DPRU

Initially there will be little new coming research for DPRU to review and communicate During the development and transition to a steady state it is suggested that DPRU proceedin the following manner

The first task for DPRU will be to identify and assess the state of the art in population research in Pakistan This should be available at the first meeting of the steering commitshytee The assessment will serve as the basis for creating the clearinghouse Simultaneously the mailing list should be developed In addition to their substantive contributions the construction of the mailing list and the clearinghouse will force DPRU to become familiar with level of research and the researchers themselves currently active in Pakistan and also with the policy-makers with whom they are to communicate Early on a research problem identification workshop should be held

As research results become available DPRUs mode of activity shifts to the preparation of executive summaries briefings and workshops Then the clearing house and the mailing list are maintained When these activities are well underway the newsletter and institutional inventory can be considered

M Technical Assistance Required

The amount and character of further USAID technical assisshytance required to insure the DPRU has adequate capacity to fulfii its assigned tasks will depend largely on the talents and skills Df the 3 people it employs Since it is likely that all requisiteabilities will not be available some technical assistamcewill undoubtedly be required Potential requirements are specified below

- 14 shy

1 A consultant on the communication of scientific findingsto policy-makers for the period of approximately one monthPossible sources of the required expertise are policy orientedassociations such as TheConference Board media organizationssuch as Scientific American Science or Business Week and otherGovernment agencies The consultant would hold training sessionsfor the personnel and walk them through an application

2 A one or two-week course on preparing visual presentashytions and graphs to be used in the briefing and in the executivesummaries At the beginning this should concentrate on effecshytive use of overhead projectors and transparencies

3 The creation of the clearinghouse will require thesupport of a two-person team One person who is expert in thecurrent state-of-the-art in population research who will aid indivising the taxonomy and one person who is expert in classifishycation systems and information storage and retrieval using manualtechnologies who will aid in setting up the system and developingprocedures for running it This person will likely be found at a library school This will require about one month each

4 The creation of the institutional inventory may benefitfrom at least two weeks of the services of an anthropologistsociologist andor a political scientist who is familiar with Pakistan

5 The editing and publishing of the newsletter may benefitfrom the consultation of a successful newsletter editor in the USMajor problems are audience identification preparing copy layoutand pasting-up original forms for publication

6 These recommedations assume that adequate printing andreproduction facilities are available If not some additional support will be required in this area

F Other USAID Items of Concern

1 USAID Personnel should participate to the extent possishyble politically to insure that the Director of DPRU has the stature and talent required

2 USAID personnel should encourage the formation and periodic meetings of the steering committee-

G People interviewed

USAID

I Dr Steven W Sinding 2William R McIntyre 3 Marvin A Schwartz 4 Thomas R Mahoney

- 15 shy

5 Dr Andrew P Haynal 6 David Oot 7 Ruth S Plunkett 8 Hugh S Plunkett

POaulation Planning Council(PPC)

1 Mr M Alauddin Joint Secretary 2 Dr Wiqar Zaidi Director DPARC 3 Dr Makhdoom Ali Shah Director of Implementation

Planning Commission

1 Javid Hamid Chief of Economic Research 2 Jawaid Azfar Chief of Population Research

PIDE (Pakistan Institute of Development Economics)

1 M L Qureshi Director 2 Mohammad Afzal Chief of Population Section 3 Dr Steven Guisinger Economist 4 Dr Dennis DeTray EconomistDemographer

Family Planning Association of Pakistan 1 Mrs Surayya Jabeen Senior Director for Liaison

with Government and International Agenciesshy

2 Mr Naseer Chaudhry Assistant Director Field Operations

3 Mr Sabir Shah Field Representative

Note - FPAP arranged field trips to two familyplanning centers operated by the Pakistan Railway and to a village in the Shadab Pilot Project area where the family planning projectis integrated into the Integrated Rural Developshyment program These trips resulted in discusshysions with many participants including the President of the Peoples Welfare Society in the Shadab village

Training Research Evaluation Centre (TREC)

1 Mr Nizamuddin Deputy Director Social Research

Continus Motivation System (CMS)

1 Mrs Eatram -bullDistrict Population Planningliofficer Rawalpindi

- 16 o

Other Researchers

1 Mr Mahmood Roshan PhD Candidate (in dissertation)School of Public Health University of California Berkeley

Other Interested Parties

1 Dr John C -Cool Director of Ford Foundation in Pakistan

Private Firm Researchers 1 Mr Owais Akhlaq and Owais AdvertisingandMarket

Research

MAXIMIZING THE USE OF RESEARCH IN POPULATION PROGRAM AND POLICY

DEVELOPMENT IN PAKISTAN

Introduction and Summary

At the request of the USAID Mission the author visited Islamabad Pakistan during the period May 27 to June 10 1976 The purpose was to consult on the design of a mechanism for maximizing the probability that policy-makers concerned with Pakistans population problems would increasingly base their decisions on research and development efforts The general terms of reference were to develop a strategy for implementing the communication and utilization aspects of the Population Impact Analysis Section (Section B) of the Population Grants Project (PRP 391-4110)

The consultant spent two weeks in Islamabad including a field trip to Lahore During this period a substantial number of documents were read and discussions were held with some 24 knowledgeable people

A general conclusion is that policy-makers are not adeshyquately informed on relevant population research and seldom consider it in the policy-making process Moreover little of the current re3earch underway is directly policy relevant in the sense that it suggests new courses of action for population policy-makers

The principle recommendation is to institute a new research utilization organization within the Population Planning CouncilDivision reporting directly to the Joint Secretary and the Director General The suggested title is Demographic PolicyResearch Utilization (DPRU) DPRU will have overall responsibishylity for monitoring ongoing research monitoring policy-maker needs acquiring research results and disseminating research results to policy-makers Specifically DPRU will engage in nine activities participation in the project steering committee preparation of executive summaries of research preparation of research briefings preparation of news releases creating a mailing list conducting workshops and seminars creating an inventory of institutions in Pakistan creating a clearingshyhouse on population policy relevant research and developing a newsletter It is proposed that these activities will lead toward more informed policy-making on population problems in Pakistan

I BACKGROUND AND PURPOSE

The purpose of this project is to forge a link between the research community and the policy-making structure so that population policy in Pakistan is informed by the latest research findings We hope to increase the probability that pertinent and

valid research findings will either be implemented directly or

-2shy

at least considered along with other variables in the policyshymaking process Simultaneously researchers should be informedabout problems confronting policy-makers and encouraged to undershytake projects which address the critical issues that policyshymakers face

Creating this like between researchers and policy-makers is a major undertaking in institutional capacity building Itrequires a great deal of learning and effort on the part ofall parties involved The recommendations contained in this report constitute a beginning for building this capacity inPakistan They represent a foundation upon which a more active and permanent integration of research and policy-making can be built

During this two-week assignment a considerable number ofdocuments have been reviewed and approximately 24 interviews conducted This investigation resulted in several impressionswhich serve as the assumptions upon which the recommendations in Section II are based

Assessment of the social science research community inPakistan indicates that the quality is uneven and generally lowSome reasonably good projects in economics demography and fertility have been completed or underway but these are exceptionsLittle of the work is directly related to policy problems or altershynatives Moreover the researchers themselves expressed frustrashytion at the fact that their research findings are not beingconsidered by policy-makers and their voice is not heard Onlyone specific instance was uncovered at TREC in which a researcher reported that research results in any way directly affected policychoice This concerned the use of the Sialkot experiment results in the decision to implement the Continuous Motivation SystemOther illustrations were less direct For example the FamilyPlanning Association of Pakistan reported that they believed thatseveral of their projects had influenced government policy

A review of the policy-making structure was also not enshycouraging The institutional structure of Pakistan at theoperating level is rather diffuse There are few if anypermenent or sustained institutions available which can interpretresearch results mobilize resources and allocate them to solve population problems Exclusive of the very highest levels ofgovernment we were able to identify only three organizationswhich hold promise as implementors of policy research in the area of population These are the Planning Commission (which has ahistory of and the talent for research utilization but appearsto be several steps removed from the policy-making authorities)The Population Planning CouncilDivision (which was recentlyorganized so that their effectiveness in influencing policy isunknown at this time) and The Family Planning Association of

-3-

Pakistan in Lahore (which carries out a relatively agressive program but which because of limited funds and the nonshygovernmental nature of its activities can generally onlyconduct demonstration projects and not nation-wide programs)All of the policy-makers interviewed indicated that they would like to receive more research results A statement which is undoubtedly somewhat platitudinal but partly genuineThey were quick to point out that there were substantial demands on their time and that they have little time to devote to reading research results They receive large volumes of information each day and report that most research monographsand articles were long ill organized for their purposesrepleat with data formula and tables and generally too technical to read A consistent complaint was that the research was not addressed to their particular policy-making needs as they saw them

In light of this situation of generally low quality and low relevancy research on the one hand and of a rather loose knit policy-making structure on the other hand it may appear that research utilization programs are premature Howshyever we are embroiled in a kind of chicken and egg problemhere A good research utilization program can help to deal with both problems This is because the basic motivation of researchers is to serve first their academic and research community needs and demands whereas the basic motivation of policy-makers is to try to cope with the pressing day-to-dayneeds of the practical problems they face Each then operatecurrently as essentially separate entities Until some social mechanism is put in place to link policy-makers and researchers more closely together it appears that each will continue to goits separate way

An effective research utilization program will work to reduce some of the limitations discussed above The social dynamics are such that once a mechanism exists for using research new pressures can be placed on the research communityfor both relevancy and quality If the researchers perceivethat there is money (in the form of grants and contracts) and status (in the form of recognition) for tLeir work as well as academic credit they will begin to respond in a more appropriate way Once policy-makers begin to achieve results from research findings and learn to trust them they will begin to rely on them Moreover the successful use of valid research conclushysions will serve to strengthen their policy-making institutions

The role of the population research utilization programrecommended in Section II is to initiate this social dynamicin a small way Our ambitions are modest but positive We should recognize that national and international economic and political concerns and the pressing problems of the moment will always outweigh the consisetent use of research results in the policy-makers eye But an effective research utilization program is an important and perhaps necessary first step to more informed policy judgments

-4-

The long-term objective of the research utilization programis to create the informed policy-makers This ideal is a policy-maker who is aware of research results understands thebasis upon which they were obtained and is able to incorporatethe into active policy making This does not mean that the policy-maker blindly implements recommendations based on research findings (a point many researchers fail to comprehend)It does mean however that he is aware of the research findingsactively considers them in arriving at policy and is able if pressed to produce an argument as to why the policy he chose differe from the findings

The route to the informied policy-maker as an ideal involves three major processes

1 Awareness -- the policy-maker needs to be aware of extent and possible relevancy of existing and on-going research

2 Dissemination -- the policy-maker needs to receive thebullresearch results in a readable and informative way He also needs to know how he can acquire more information on a topic

3 Utilization -- once alerted and in possession of research findings the policy-maker needs to be encouraged to incorporate them into the policy-making process This involves at least three possibilities

a Selection -- the choosing of research which is pertinent to the policy topics he faces

b Adoption the direct implementation and operashytiohalization of research findings

c Adaption -- the modification and re-arrangingof research results to apply them to the specific problem at hand

The organization and activities recommended in the followingsection are desigiied to create a new institution within thePopulation Planning CouncilDivision to formalize these processhyses These processes are achieved through four generic activitiesdepending on the source of initiation of the activity These activities may be described as follows

1 Researchers study policy-makers problems and designprojects to solve them

2 Researchers educate policy-makers on research methods

and possibilities and solicit policy-makers guidance in the design of projects

-5shy

3 Policy-makers learn about research methods and possishybilities and suggest relevant projects

4 Policy-makers describe their policy-making problems to researchers so that the researchers can design relevant projects

These three general processes and four generic activities are fundamental to achieving the informed policy-maker ideal They have served as guidelines in constructing the recommendashytions which follow

II RECOMMENDED RESEARCH UTILIZATION PROCESS

A General

It is proposed that a separate unit be established within the Population Planning DivisionCouncil to carry out research utilization activities The suggested title is Demographic Policy Research Utilization (DPRU) This unit would be responsible for knowing and assessing the state of the art in population research as it affects Pakistan and adapting it to Pakistans needs These conclusions should be communicated to policy-makers in a manner which relates directly to their policy-making requirements

In total DPRU will engage in nine basic activities which

are specified below

B Major Activities

1 Participation iw the Poptlatiorf Gants Steeriny Committee The population grants program calls for a steering committee comshyposed of outstanding community leaders in the society researchers and members of Government DPRU should serve as the information arm of that committee Working under the direction of the committee chairman DPRU should

a Set meeting dates and places b Publish the meeting agenda c Prepare background papers and briefings for

the meeting d Publish a summary of the meeting and distrishy

bute it to the members

At least once a year DPRU will prepare and deliver to the steering committee a State-of-Population Research Utilization in Pakistan report This report will contain the following sections

a The Problem -- a brief summary of key demographic statistics for the year (and historically)

b Current Research on the Problem-- a summaryof research completed or undertaken duringthe year and its major findings

C DPRU Programs -- a summary of activities undertaken by DPRU to relate the research to policy-makers

d Utilization -- a summary of instances whereresearch results were used in setting populashytion policy or in devising new programs Specishyfic research results need not have been adoptedas is or even adapted to a particular problemahowever to qualify as utilization there shouldbe some evidence that the policy-maker actuallyreceived the research findings evaluated themand actively considered them in the process of making policy

2 Prepare Executive Summaries of Completed Research DPRUwill be responsible for preparing an Executive Summary for eachcompleted research project The length of these summaries will vary with the content of the project howeverit is expected thatthe summaries will generally be about 2-8 pages in length Theyshould rarely exceed 25 pages The primary audience for theseExecutive Summaries is the policy-makers who make and influencepopulation and family planning decisions in Pakistan

The general outline of each Summary should be as follows

a One or two paragraphs (no more than one pagemaximum) describing the background and purposesof the research

b A list of the principal findings

c A list of the policy implications of the findings

d A discussion of the results of the research as theyrelate to policy This will include a discussion of the assumptions and conditions under which policyimpacts or recommendations are appropriate Thediscussions should also include an assessment of the adequacy of the data used in research theresearch design and the methods of analysis as theypertain to the validity of the policy implicationsA discussion of related research and its findings(including agreements and differences) should beincluded where appropriate

In general these Executive Summaries should meet the requireshyments of good journalism They should be concise readable simpleclear and closely related to the policy concerns of the audience

-7

Where possible graphs tables and other visuals should be employed Since the graphs and tables contained in many research reports are too detailed and busy DPRU often will have to redraw and simplify them so that the key points are better communicated to the audience

Executive Summaries will constitute series number one of the DPRU publications In the beginning of the program simple offshyset reproduction printing methods should be used A standard front cover should be used for t1eseries which clearly identishyfies that this is an Executive Summary and that DPRU is the source The last page of the Summary should inform the reader on how to acquire a copy of the complete research monograph and on the availability of other Summaries and Monographs

Executive Summaries should be prepared (required) for every project completed under the Population Grants Program and where possible for any other research project of potential use to policy-makers

3 Prepare Briefings on Completed Research The written word by iEself is not the most effective form of communication Dialogue discussion and personal involvement increase the degree of communication Consequently the Executive Summaries should be used to develop short briefings for policy-makers These briefings should be 15-20 minutes in length and should make use of visual displays An overhead projector with transparencies should be used most frequently but very important items might be prepared on large charts

Most of the briefings will be delivered to groups of 3-4 people but consideration should be given to the possibility of delivering the briefing to a single influencial person or to a group of say 25 In any event the briefing session should be scheuled so that ample time is available during each session for questions and discussions on the report The person presenting the briefing should be prepared with topics for discussion concerning the report and where possible and proper should engage people in discussion

A briefin i should always be scheduled for the Planning Commission and for the Population Planning Council Attempts should be made to brief the Minister of Health and other Minisshytries if possible As many other interested organizations and influencial parties as possible should also be briefed

In developing this program the DPRU should review the Audio-Visual Projects effort undeviay at the Family Plannng Association of Pakistan (Lahore) and other policy oriented audiovisual programs in Pakistan

--

8shy

4 Prepare and Distribute News releases Studies of policyshymakers in the United States find that they acquire most of theirscientific information from the newspapers Moreover personalexperience in working with US Congressional staffs and otherstaff members for influencial decision makers reveals that theyread news releases before they read many other materials Thereare several reasons for this News releases are short andgenerally well writtqp they focus on only the key points ofinterest they are timely and they reveal what the sourceorganization thinks is important Thus the news release itself becomes a communication medium

Using the Executive Sunmaries as background news releasesshould be prepared for completed research whenever the qualityis adequate They should be distributed to policy-makersand their staffs as well as to the press Special results mightwarrant a full-blown press conference One advantage of a pubshylished news item is that it raises the public consciousness aswell as that of the leaders

5 Maintain a Mailing List DPRU should develop and mainshytain a mailing list of people in population planning policy inPakistan This would include the names and addresses ofinfluential policy-makers and researchers with regard to populashytion problems in Pakistan It should be organized by institutionGovernment Industry Association University etc The listwill be used to send out items of interest to appropriate parties

DPRU can begin to constructthis list by drawing on existinglists For example FPAP has a list of 25000 to 35000 peoplewhich representatives indicated it would be willing to share

6 Create an Institutional Inventory In any social systempolicy is carried out via its institutions They are the bases upon which attitudes are formed and instrumentalities throughwhich resources are mobilized and allocated When they acceptan innovation the likelihood of adoption is increased When theyreject one they constitute a formidable barrier

Consequently DPRU should identify and record as much of theinstitutional structure of Pakistan as possible This recordshould include the institution its leadership its location andthe number of people affected by it (employees participants etc)

The inventory will include governments state provincialdistrict tehsil union council industry unions religiouisleaders newspapers universities associations etc Only thelargest and most important need be identified at the start butthe inventory should be expanded over the years Among the uses of the inventory are the following

a A basis for assessing social impactof populationpolicy recommendation

b A source for personnel to be included in the mailing list

c A source of sites for pilot and demonstration projects (and if necessary for experimental purposes for control sites)

7 Conduct Workshops and Seminars In a personalisticculture such as Pakistan face-to-face communication is imporshyotant Workshops and Seminars are one method by which this form of communication can be promoted DPRU should conduct workshopsof two types

a Problem Identification A quick review of some of the existing research and discussion with policy-makers suggests that much of the current research is tangentialto the central concerns of policy-makers The purpose of a problems identification workshop is to bring policyshymakers and researchers together in a format in which policyshymakers can indicate their needs and in which researchers can suggest possible projects for securing information consisshytent with these needs The ideal project should be both policy relevant and scientifically sound Sometimes these criteria are in conflict especially given limited budgets and short decision times Consequently one of the functions of the problem identification workshop is to reach comproshymises where these conflicts occur

A model for such a workshop is as follows

1 DPRU identifies one or two broad areas of policy relevance (eg education of women use of incentives value of children)

2 A leading policy-maker is asked to preside over ther workshop and to present some of his or herviews on the problem as a keynote on the topics

3 About five policy-makers or research users in the topicarea and five resear-hers plus a few other interested parties (eg representatives of Donor agencies) are invited to the workshop

4 The keynote is presented followed by a series of discussions on subtopics during which users relate their needs and researchers discuss the researchability of the topicsOf particular importance is a discussion of data availabilityThe chairman of the session seeks to secure some consensus of the nature of the problem and some acceptable research strateshygies As an option he may attempt to assign priorities to the possible research topics

10

5 The workshop is recorded (or a good scribe is employed)Following the workshop DPRU prepares a short report describingthe workshop and its key findings In completing the reportDPRU may want to contact participants for clarification andaugmentation of the ideas presented in the meeting The reportis distributed to both policy-makers and researchers These reports can be especially effective if they servc as the basis upon which research grants are made

b Seminars on Research Findings In addition tothe briefings described above it is often useful to holdseminars in which both policy-makers and researchers explorethe implications and possible utility of completed researchprojects The seminar should be designed to assess the strengthsand weaknesses of the research in terms of its internal and external validity and its relevance for policy making

A model for such a seminar is as follows

1) DPRU Identifies about 10 or 15 reseachers and policyshymakers with interest in the completed research and invites them to the seminar

2) a researcher (other than the whoone did the research)-is selected and starts off the seminar by presenting a summaryof the project This is followed by a critique -

3) a policy-maker reviews the researchandpresents an evaluation from a policy-making perspective

4) the researcher comments on the two preceeding presen- tations

5) the seminar is opened to general discussion

6) toward the end of the seminar the chairman attempts toreach agreement on action steps that might proceed on the basisof the results and on topics for further research

7) a record of the seminar and its conclusions if published

8 Create and Maintain a Clearinghouse on Research and Policy Sources Relevant to Pakistan Discussion with

both researchers and policy-makers indicates that there iscurrently an institutional deficiency in handling the volume of pertinent research results and making them available toresearchers and policy-makers DPRU should create a populationresearch clearinghouse to fill this void While this taskhas lesser priority than the preceeding ones it is neverthelessimportant to the overall improvement of population research utilization in Pakistan

The clearinghouse would maintain a file on three different kinds of information relevent to policy-making and research ie a) published works b) sources of data and c) names and addresses of individuals who have expertise in relevant fields

The clearinghouse should begin modestly and draw heavily on existing sources It should engage in the following activities

a Create a taxonomy for classifying published works (and expertise) The taxonomy should include policy variables (ie independent variables) measures of fertility and other outcomes (ie dependent variables) methodology data source and location of study A good place to start is to study the classification used by McGreevey in The Policy Relevance of Recent Social Research on Fertility Smithsonian Institute Occasional Monograph Series Number two

b Develop a biblicgraphy of pertinent works and classify existing research In doing these full use should be made of existing indexes such as those published by USAID TREC PIDE NRIFC and FPAP Each item of potential use to Pakistani researchers and policy-makers should be identified classified and summarized briefly A suitable technology for rimning the clearinghouse is the McBee key sort edge punched card system The particulars of the item are recorded in the body of the card and the classifications are recorded by notches in the edge of the card A needle is used on the pack of cards to outsort those which satisfy a particular inquiry for items subsumed under certain specified categories Each card should indicate where to find the document

c DPRU should keep an inventory of what data is available and where and how it can be accessed hbis will be used to answer iquiries by both reseachers and policy-makers who have a need for data

d Another edged punched card system should be set up to classify individuals both in Pakistan and elsewhere who have expertise on elevant topics The taxonomy discussed above would be the basis for classification An ideal use of the expert file would occur when a policyshymaker contacted DPRU in order to obtain advice on a topic of interest In addition to published works DPRU would suggest an expert or two in the area whose knowledge and opinion on the topic could be requested

9 Edit and Publish a Newsletter This is the lowest priority activity for DPRU however consideration should be given to publishing a newsletter containing concise articles on new research findings other items of interest and where and how to send for publication It would be distributed to

- 12 shy

the mailing list discussed above Its primary advantage is tokeep the reader aware of population problems research-based solutions and DPRU

_C Organization and Job Specifications

DPRU will be headed by a deputy director who reports directly to the Director (DPRC) and the Joint Secretary The -

Director initially will be supported by a communication specialist and a research analyst

1 Director The Deputy Director should be a person whois known and respected by the key policy-makers at PPC thePlanning Commission and the Ministries of Government Heshould have access to them for informal discussion as well asformal presentation He should be very familiar with thepopulation program in Pakistan If possible he should also befamiliar with current population research and research methodsbut this is a secondary requirement

The Director will be primary presentor at the briefings andat the stearing committee meetings He should also be active inthe workshops and seminars especially when high-level policyshymakers are involved His continuing responsibility is tolobby or implementation of research findings with policy-makersand to keep himself appraised of their concerns in the populationplanning area He should also maintain contact with organizationssuch as the Family Planning Association of Pakistan It is likelythat if some of the potentially useful findings of that organizashytion are mediated through DPRU the chances for adoption or adaptation will be improved

Under the supervision of the Director of DPRU are twospecialists--a communirtion specialist and a research analystwho must work together closely to accomplish the units tasks

2 Communication Specialist The person should have studiedjournalism and hopefully should have some experience in writingand reporting on scientific or technological activities Theability to write well and to present ideas clearly is critical to the functioning of the role

Primary responsibilities are to write executive summariesusing analysis prepared by the research analyst prepare briefshyings write news releases maintain mailing list create theinstitutional inventory participate in workshops preparepresentation for steering committee and edit and publish thenewsletter

13 shy

Research st This person should have experiencein research and researflchethodology Ideally this experience would be in population or related areas The individual need not be an accomplished researcher (although this is desirable)but should be able to converse with researchers on technical topics critique research studies from a methodological pointof -view summarize research findings and to relate them to other existing research

Primary responsiblities are to maintain liaison with researchers acquire completed research and to analyze research for its essential findings The role includes primary responsibishylity for maintaining the clearinghouse This person will also contribute to the other activities of the unit

D Time Phasing for the Installation of DPRU

Initially there will be little new coming research for DPRU to review and communicate During the development and transition to a steady state it is suggested that DPRU proceedin the following manner

The first task for DPRU will be to identify and assess the state of the art in population research in Pakistan This should be available at the first meeting of the steering commitshytee The assessment will serve as the basis for creating the clearinghouse Simultaneously the mailing list should be developed In addition to their substantive contributions the construction of the mailing list and the clearinghouse will force DPRU to become familiar with level of research and the researchers themselves currently active in Pakistan and also with the policy-makers with whom they are to communicate Early on a research problem identification workshop should be held

As research results become available DPRUs mode of activity shifts to the preparation of executive summaries briefings and workshops Then the clearing house and the mailing list are maintained When these activities are well underway the newsletter and institutional inventory can be considered

M Technical Assistance Required

The amount and character of further USAID technical assisshytance required to insure the DPRU has adequate capacity to fulfii its assigned tasks will depend largely on the talents and skills Df the 3 people it employs Since it is likely that all requisiteabilities will not be available some technical assistamcewill undoubtedly be required Potential requirements are specified below

- 14 shy

1 A consultant on the communication of scientific findingsto policy-makers for the period of approximately one monthPossible sources of the required expertise are policy orientedassociations such as TheConference Board media organizationssuch as Scientific American Science or Business Week and otherGovernment agencies The consultant would hold training sessionsfor the personnel and walk them through an application

2 A one or two-week course on preparing visual presentashytions and graphs to be used in the briefing and in the executivesummaries At the beginning this should concentrate on effecshytive use of overhead projectors and transparencies

3 The creation of the clearinghouse will require thesupport of a two-person team One person who is expert in thecurrent state-of-the-art in population research who will aid indivising the taxonomy and one person who is expert in classifishycation systems and information storage and retrieval using manualtechnologies who will aid in setting up the system and developingprocedures for running it This person will likely be found at a library school This will require about one month each

4 The creation of the institutional inventory may benefitfrom at least two weeks of the services of an anthropologistsociologist andor a political scientist who is familiar with Pakistan

5 The editing and publishing of the newsletter may benefitfrom the consultation of a successful newsletter editor in the USMajor problems are audience identification preparing copy layoutand pasting-up original forms for publication

6 These recommedations assume that adequate printing andreproduction facilities are available If not some additional support will be required in this area

F Other USAID Items of Concern

1 USAID Personnel should participate to the extent possishyble politically to insure that the Director of DPRU has the stature and talent required

2 USAID personnel should encourage the formation and periodic meetings of the steering committee-

G People interviewed

USAID

I Dr Steven W Sinding 2William R McIntyre 3 Marvin A Schwartz 4 Thomas R Mahoney

- 15 shy

5 Dr Andrew P Haynal 6 David Oot 7 Ruth S Plunkett 8 Hugh S Plunkett

POaulation Planning Council(PPC)

1 Mr M Alauddin Joint Secretary 2 Dr Wiqar Zaidi Director DPARC 3 Dr Makhdoom Ali Shah Director of Implementation

Planning Commission

1 Javid Hamid Chief of Economic Research 2 Jawaid Azfar Chief of Population Research

PIDE (Pakistan Institute of Development Economics)

1 M L Qureshi Director 2 Mohammad Afzal Chief of Population Section 3 Dr Steven Guisinger Economist 4 Dr Dennis DeTray EconomistDemographer

Family Planning Association of Pakistan 1 Mrs Surayya Jabeen Senior Director for Liaison

with Government and International Agenciesshy

2 Mr Naseer Chaudhry Assistant Director Field Operations

3 Mr Sabir Shah Field Representative

Note - FPAP arranged field trips to two familyplanning centers operated by the Pakistan Railway and to a village in the Shadab Pilot Project area where the family planning projectis integrated into the Integrated Rural Developshyment program These trips resulted in discusshysions with many participants including the President of the Peoples Welfare Society in the Shadab village

Training Research Evaluation Centre (TREC)

1 Mr Nizamuddin Deputy Director Social Research

Continus Motivation System (CMS)

1 Mrs Eatram -bullDistrict Population Planningliofficer Rawalpindi

- 16 o

Other Researchers

1 Mr Mahmood Roshan PhD Candidate (in dissertation)School of Public Health University of California Berkeley

Other Interested Parties

1 Dr John C -Cool Director of Ford Foundation in Pakistan

Private Firm Researchers 1 Mr Owais Akhlaq and Owais AdvertisingandMarket

Research

-2shy

at least considered along with other variables in the policyshymaking process Simultaneously researchers should be informedabout problems confronting policy-makers and encouraged to undershytake projects which address the critical issues that policyshymakers face

Creating this like between researchers and policy-makers is a major undertaking in institutional capacity building Itrequires a great deal of learning and effort on the part ofall parties involved The recommendations contained in this report constitute a beginning for building this capacity inPakistan They represent a foundation upon which a more active and permanent integration of research and policy-making can be built

During this two-week assignment a considerable number ofdocuments have been reviewed and approximately 24 interviews conducted This investigation resulted in several impressionswhich serve as the assumptions upon which the recommendations in Section II are based

Assessment of the social science research community inPakistan indicates that the quality is uneven and generally lowSome reasonably good projects in economics demography and fertility have been completed or underway but these are exceptionsLittle of the work is directly related to policy problems or altershynatives Moreover the researchers themselves expressed frustrashytion at the fact that their research findings are not beingconsidered by policy-makers and their voice is not heard Onlyone specific instance was uncovered at TREC in which a researcher reported that research results in any way directly affected policychoice This concerned the use of the Sialkot experiment results in the decision to implement the Continuous Motivation SystemOther illustrations were less direct For example the FamilyPlanning Association of Pakistan reported that they believed thatseveral of their projects had influenced government policy

A review of the policy-making structure was also not enshycouraging The institutional structure of Pakistan at theoperating level is rather diffuse There are few if anypermenent or sustained institutions available which can interpretresearch results mobilize resources and allocate them to solve population problems Exclusive of the very highest levels ofgovernment we were able to identify only three organizationswhich hold promise as implementors of policy research in the area of population These are the Planning Commission (which has ahistory of and the talent for research utilization but appearsto be several steps removed from the policy-making authorities)The Population Planning CouncilDivision (which was recentlyorganized so that their effectiveness in influencing policy isunknown at this time) and The Family Planning Association of

-3-

Pakistan in Lahore (which carries out a relatively agressive program but which because of limited funds and the nonshygovernmental nature of its activities can generally onlyconduct demonstration projects and not nation-wide programs)All of the policy-makers interviewed indicated that they would like to receive more research results A statement which is undoubtedly somewhat platitudinal but partly genuineThey were quick to point out that there were substantial demands on their time and that they have little time to devote to reading research results They receive large volumes of information each day and report that most research monographsand articles were long ill organized for their purposesrepleat with data formula and tables and generally too technical to read A consistent complaint was that the research was not addressed to their particular policy-making needs as they saw them

In light of this situation of generally low quality and low relevancy research on the one hand and of a rather loose knit policy-making structure on the other hand it may appear that research utilization programs are premature Howshyever we are embroiled in a kind of chicken and egg problemhere A good research utilization program can help to deal with both problems This is because the basic motivation of researchers is to serve first their academic and research community needs and demands whereas the basic motivation of policy-makers is to try to cope with the pressing day-to-dayneeds of the practical problems they face Each then operatecurrently as essentially separate entities Until some social mechanism is put in place to link policy-makers and researchers more closely together it appears that each will continue to goits separate way

An effective research utilization program will work to reduce some of the limitations discussed above The social dynamics are such that once a mechanism exists for using research new pressures can be placed on the research communityfor both relevancy and quality If the researchers perceivethat there is money (in the form of grants and contracts) and status (in the form of recognition) for tLeir work as well as academic credit they will begin to respond in a more appropriate way Once policy-makers begin to achieve results from research findings and learn to trust them they will begin to rely on them Moreover the successful use of valid research conclushysions will serve to strengthen their policy-making institutions

The role of the population research utilization programrecommended in Section II is to initiate this social dynamicin a small way Our ambitions are modest but positive We should recognize that national and international economic and political concerns and the pressing problems of the moment will always outweigh the consisetent use of research results in the policy-makers eye But an effective research utilization program is an important and perhaps necessary first step to more informed policy judgments

-4-

The long-term objective of the research utilization programis to create the informed policy-makers This ideal is a policy-maker who is aware of research results understands thebasis upon which they were obtained and is able to incorporatethe into active policy making This does not mean that the policy-maker blindly implements recommendations based on research findings (a point many researchers fail to comprehend)It does mean however that he is aware of the research findingsactively considers them in arriving at policy and is able if pressed to produce an argument as to why the policy he chose differe from the findings

The route to the informied policy-maker as an ideal involves three major processes

1 Awareness -- the policy-maker needs to be aware of extent and possible relevancy of existing and on-going research

2 Dissemination -- the policy-maker needs to receive thebullresearch results in a readable and informative way He also needs to know how he can acquire more information on a topic

3 Utilization -- once alerted and in possession of research findings the policy-maker needs to be encouraged to incorporate them into the policy-making process This involves at least three possibilities

a Selection -- the choosing of research which is pertinent to the policy topics he faces

b Adoption the direct implementation and operashytiohalization of research findings

c Adaption -- the modification and re-arrangingof research results to apply them to the specific problem at hand

The organization and activities recommended in the followingsection are desigiied to create a new institution within thePopulation Planning CouncilDivision to formalize these processhyses These processes are achieved through four generic activitiesdepending on the source of initiation of the activity These activities may be described as follows

1 Researchers study policy-makers problems and designprojects to solve them

2 Researchers educate policy-makers on research methods

and possibilities and solicit policy-makers guidance in the design of projects

-5shy

3 Policy-makers learn about research methods and possishybilities and suggest relevant projects

4 Policy-makers describe their policy-making problems to researchers so that the researchers can design relevant projects

These three general processes and four generic activities are fundamental to achieving the informed policy-maker ideal They have served as guidelines in constructing the recommendashytions which follow

II RECOMMENDED RESEARCH UTILIZATION PROCESS

A General

It is proposed that a separate unit be established within the Population Planning DivisionCouncil to carry out research utilization activities The suggested title is Demographic Policy Research Utilization (DPRU) This unit would be responsible for knowing and assessing the state of the art in population research as it affects Pakistan and adapting it to Pakistans needs These conclusions should be communicated to policy-makers in a manner which relates directly to their policy-making requirements

In total DPRU will engage in nine basic activities which

are specified below

B Major Activities

1 Participation iw the Poptlatiorf Gants Steeriny Committee The population grants program calls for a steering committee comshyposed of outstanding community leaders in the society researchers and members of Government DPRU should serve as the information arm of that committee Working under the direction of the committee chairman DPRU should

a Set meeting dates and places b Publish the meeting agenda c Prepare background papers and briefings for

the meeting d Publish a summary of the meeting and distrishy

bute it to the members

At least once a year DPRU will prepare and deliver to the steering committee a State-of-Population Research Utilization in Pakistan report This report will contain the following sections

a The Problem -- a brief summary of key demographic statistics for the year (and historically)

b Current Research on the Problem-- a summaryof research completed or undertaken duringthe year and its major findings

C DPRU Programs -- a summary of activities undertaken by DPRU to relate the research to policy-makers

d Utilization -- a summary of instances whereresearch results were used in setting populashytion policy or in devising new programs Specishyfic research results need not have been adoptedas is or even adapted to a particular problemahowever to qualify as utilization there shouldbe some evidence that the policy-maker actuallyreceived the research findings evaluated themand actively considered them in the process of making policy

2 Prepare Executive Summaries of Completed Research DPRUwill be responsible for preparing an Executive Summary for eachcompleted research project The length of these summaries will vary with the content of the project howeverit is expected thatthe summaries will generally be about 2-8 pages in length Theyshould rarely exceed 25 pages The primary audience for theseExecutive Summaries is the policy-makers who make and influencepopulation and family planning decisions in Pakistan

The general outline of each Summary should be as follows

a One or two paragraphs (no more than one pagemaximum) describing the background and purposesof the research

b A list of the principal findings

c A list of the policy implications of the findings

d A discussion of the results of the research as theyrelate to policy This will include a discussion of the assumptions and conditions under which policyimpacts or recommendations are appropriate Thediscussions should also include an assessment of the adequacy of the data used in research theresearch design and the methods of analysis as theypertain to the validity of the policy implicationsA discussion of related research and its findings(including agreements and differences) should beincluded where appropriate

In general these Executive Summaries should meet the requireshyments of good journalism They should be concise readable simpleclear and closely related to the policy concerns of the audience

-7

Where possible graphs tables and other visuals should be employed Since the graphs and tables contained in many research reports are too detailed and busy DPRU often will have to redraw and simplify them so that the key points are better communicated to the audience

Executive Summaries will constitute series number one of the DPRU publications In the beginning of the program simple offshyset reproduction printing methods should be used A standard front cover should be used for t1eseries which clearly identishyfies that this is an Executive Summary and that DPRU is the source The last page of the Summary should inform the reader on how to acquire a copy of the complete research monograph and on the availability of other Summaries and Monographs

Executive Summaries should be prepared (required) for every project completed under the Population Grants Program and where possible for any other research project of potential use to policy-makers

3 Prepare Briefings on Completed Research The written word by iEself is not the most effective form of communication Dialogue discussion and personal involvement increase the degree of communication Consequently the Executive Summaries should be used to develop short briefings for policy-makers These briefings should be 15-20 minutes in length and should make use of visual displays An overhead projector with transparencies should be used most frequently but very important items might be prepared on large charts

Most of the briefings will be delivered to groups of 3-4 people but consideration should be given to the possibility of delivering the briefing to a single influencial person or to a group of say 25 In any event the briefing session should be scheuled so that ample time is available during each session for questions and discussions on the report The person presenting the briefing should be prepared with topics for discussion concerning the report and where possible and proper should engage people in discussion

A briefin i should always be scheduled for the Planning Commission and for the Population Planning Council Attempts should be made to brief the Minister of Health and other Minisshytries if possible As many other interested organizations and influencial parties as possible should also be briefed

In developing this program the DPRU should review the Audio-Visual Projects effort undeviay at the Family Plannng Association of Pakistan (Lahore) and other policy oriented audiovisual programs in Pakistan

--

8shy

4 Prepare and Distribute News releases Studies of policyshymakers in the United States find that they acquire most of theirscientific information from the newspapers Moreover personalexperience in working with US Congressional staffs and otherstaff members for influencial decision makers reveals that theyread news releases before they read many other materials Thereare several reasons for this News releases are short andgenerally well writtqp they focus on only the key points ofinterest they are timely and they reveal what the sourceorganization thinks is important Thus the news release itself becomes a communication medium

Using the Executive Sunmaries as background news releasesshould be prepared for completed research whenever the qualityis adequate They should be distributed to policy-makersand their staffs as well as to the press Special results mightwarrant a full-blown press conference One advantage of a pubshylished news item is that it raises the public consciousness aswell as that of the leaders

5 Maintain a Mailing List DPRU should develop and mainshytain a mailing list of people in population planning policy inPakistan This would include the names and addresses ofinfluential policy-makers and researchers with regard to populashytion problems in Pakistan It should be organized by institutionGovernment Industry Association University etc The listwill be used to send out items of interest to appropriate parties

DPRU can begin to constructthis list by drawing on existinglists For example FPAP has a list of 25000 to 35000 peoplewhich representatives indicated it would be willing to share

6 Create an Institutional Inventory In any social systempolicy is carried out via its institutions They are the bases upon which attitudes are formed and instrumentalities throughwhich resources are mobilized and allocated When they acceptan innovation the likelihood of adoption is increased When theyreject one they constitute a formidable barrier

Consequently DPRU should identify and record as much of theinstitutional structure of Pakistan as possible This recordshould include the institution its leadership its location andthe number of people affected by it (employees participants etc)

The inventory will include governments state provincialdistrict tehsil union council industry unions religiouisleaders newspapers universities associations etc Only thelargest and most important need be identified at the start butthe inventory should be expanded over the years Among the uses of the inventory are the following

a A basis for assessing social impactof populationpolicy recommendation

b A source for personnel to be included in the mailing list

c A source of sites for pilot and demonstration projects (and if necessary for experimental purposes for control sites)

7 Conduct Workshops and Seminars In a personalisticculture such as Pakistan face-to-face communication is imporshyotant Workshops and Seminars are one method by which this form of communication can be promoted DPRU should conduct workshopsof two types

a Problem Identification A quick review of some of the existing research and discussion with policy-makers suggests that much of the current research is tangentialto the central concerns of policy-makers The purpose of a problems identification workshop is to bring policyshymakers and researchers together in a format in which policyshymakers can indicate their needs and in which researchers can suggest possible projects for securing information consisshytent with these needs The ideal project should be both policy relevant and scientifically sound Sometimes these criteria are in conflict especially given limited budgets and short decision times Consequently one of the functions of the problem identification workshop is to reach comproshymises where these conflicts occur

A model for such a workshop is as follows

1 DPRU identifies one or two broad areas of policy relevance (eg education of women use of incentives value of children)

2 A leading policy-maker is asked to preside over ther workshop and to present some of his or herviews on the problem as a keynote on the topics

3 About five policy-makers or research users in the topicarea and five resear-hers plus a few other interested parties (eg representatives of Donor agencies) are invited to the workshop

4 The keynote is presented followed by a series of discussions on subtopics during which users relate their needs and researchers discuss the researchability of the topicsOf particular importance is a discussion of data availabilityThe chairman of the session seeks to secure some consensus of the nature of the problem and some acceptable research strateshygies As an option he may attempt to assign priorities to the possible research topics

10

5 The workshop is recorded (or a good scribe is employed)Following the workshop DPRU prepares a short report describingthe workshop and its key findings In completing the reportDPRU may want to contact participants for clarification andaugmentation of the ideas presented in the meeting The reportis distributed to both policy-makers and researchers These reports can be especially effective if they servc as the basis upon which research grants are made

b Seminars on Research Findings In addition tothe briefings described above it is often useful to holdseminars in which both policy-makers and researchers explorethe implications and possible utility of completed researchprojects The seminar should be designed to assess the strengthsand weaknesses of the research in terms of its internal and external validity and its relevance for policy making

A model for such a seminar is as follows

1) DPRU Identifies about 10 or 15 reseachers and policyshymakers with interest in the completed research and invites them to the seminar

2) a researcher (other than the whoone did the research)-is selected and starts off the seminar by presenting a summaryof the project This is followed by a critique -

3) a policy-maker reviews the researchandpresents an evaluation from a policy-making perspective

4) the researcher comments on the two preceeding presen- tations

5) the seminar is opened to general discussion

6) toward the end of the seminar the chairman attempts toreach agreement on action steps that might proceed on the basisof the results and on topics for further research

7) a record of the seminar and its conclusions if published

8 Create and Maintain a Clearinghouse on Research and Policy Sources Relevant to Pakistan Discussion with

both researchers and policy-makers indicates that there iscurrently an institutional deficiency in handling the volume of pertinent research results and making them available toresearchers and policy-makers DPRU should create a populationresearch clearinghouse to fill this void While this taskhas lesser priority than the preceeding ones it is neverthelessimportant to the overall improvement of population research utilization in Pakistan

The clearinghouse would maintain a file on three different kinds of information relevent to policy-making and research ie a) published works b) sources of data and c) names and addresses of individuals who have expertise in relevant fields

The clearinghouse should begin modestly and draw heavily on existing sources It should engage in the following activities

a Create a taxonomy for classifying published works (and expertise) The taxonomy should include policy variables (ie independent variables) measures of fertility and other outcomes (ie dependent variables) methodology data source and location of study A good place to start is to study the classification used by McGreevey in The Policy Relevance of Recent Social Research on Fertility Smithsonian Institute Occasional Monograph Series Number two

b Develop a biblicgraphy of pertinent works and classify existing research In doing these full use should be made of existing indexes such as those published by USAID TREC PIDE NRIFC and FPAP Each item of potential use to Pakistani researchers and policy-makers should be identified classified and summarized briefly A suitable technology for rimning the clearinghouse is the McBee key sort edge punched card system The particulars of the item are recorded in the body of the card and the classifications are recorded by notches in the edge of the card A needle is used on the pack of cards to outsort those which satisfy a particular inquiry for items subsumed under certain specified categories Each card should indicate where to find the document

c DPRU should keep an inventory of what data is available and where and how it can be accessed hbis will be used to answer iquiries by both reseachers and policy-makers who have a need for data

d Another edged punched card system should be set up to classify individuals both in Pakistan and elsewhere who have expertise on elevant topics The taxonomy discussed above would be the basis for classification An ideal use of the expert file would occur when a policyshymaker contacted DPRU in order to obtain advice on a topic of interest In addition to published works DPRU would suggest an expert or two in the area whose knowledge and opinion on the topic could be requested

9 Edit and Publish a Newsletter This is the lowest priority activity for DPRU however consideration should be given to publishing a newsletter containing concise articles on new research findings other items of interest and where and how to send for publication It would be distributed to

- 12 shy

the mailing list discussed above Its primary advantage is tokeep the reader aware of population problems research-based solutions and DPRU

_C Organization and Job Specifications

DPRU will be headed by a deputy director who reports directly to the Director (DPRC) and the Joint Secretary The -

Director initially will be supported by a communication specialist and a research analyst

1 Director The Deputy Director should be a person whois known and respected by the key policy-makers at PPC thePlanning Commission and the Ministries of Government Heshould have access to them for informal discussion as well asformal presentation He should be very familiar with thepopulation program in Pakistan If possible he should also befamiliar with current population research and research methodsbut this is a secondary requirement

The Director will be primary presentor at the briefings andat the stearing committee meetings He should also be active inthe workshops and seminars especially when high-level policyshymakers are involved His continuing responsibility is tolobby or implementation of research findings with policy-makersand to keep himself appraised of their concerns in the populationplanning area He should also maintain contact with organizationssuch as the Family Planning Association of Pakistan It is likelythat if some of the potentially useful findings of that organizashytion are mediated through DPRU the chances for adoption or adaptation will be improved

Under the supervision of the Director of DPRU are twospecialists--a communirtion specialist and a research analystwho must work together closely to accomplish the units tasks

2 Communication Specialist The person should have studiedjournalism and hopefully should have some experience in writingand reporting on scientific or technological activities Theability to write well and to present ideas clearly is critical to the functioning of the role

Primary responsibilities are to write executive summariesusing analysis prepared by the research analyst prepare briefshyings write news releases maintain mailing list create theinstitutional inventory participate in workshops preparepresentation for steering committee and edit and publish thenewsletter

13 shy

Research st This person should have experiencein research and researflchethodology Ideally this experience would be in population or related areas The individual need not be an accomplished researcher (although this is desirable)but should be able to converse with researchers on technical topics critique research studies from a methodological pointof -view summarize research findings and to relate them to other existing research

Primary responsiblities are to maintain liaison with researchers acquire completed research and to analyze research for its essential findings The role includes primary responsibishylity for maintaining the clearinghouse This person will also contribute to the other activities of the unit

D Time Phasing for the Installation of DPRU

Initially there will be little new coming research for DPRU to review and communicate During the development and transition to a steady state it is suggested that DPRU proceedin the following manner

The first task for DPRU will be to identify and assess the state of the art in population research in Pakistan This should be available at the first meeting of the steering commitshytee The assessment will serve as the basis for creating the clearinghouse Simultaneously the mailing list should be developed In addition to their substantive contributions the construction of the mailing list and the clearinghouse will force DPRU to become familiar with level of research and the researchers themselves currently active in Pakistan and also with the policy-makers with whom they are to communicate Early on a research problem identification workshop should be held

As research results become available DPRUs mode of activity shifts to the preparation of executive summaries briefings and workshops Then the clearing house and the mailing list are maintained When these activities are well underway the newsletter and institutional inventory can be considered

M Technical Assistance Required

The amount and character of further USAID technical assisshytance required to insure the DPRU has adequate capacity to fulfii its assigned tasks will depend largely on the talents and skills Df the 3 people it employs Since it is likely that all requisiteabilities will not be available some technical assistamcewill undoubtedly be required Potential requirements are specified below

- 14 shy

1 A consultant on the communication of scientific findingsto policy-makers for the period of approximately one monthPossible sources of the required expertise are policy orientedassociations such as TheConference Board media organizationssuch as Scientific American Science or Business Week and otherGovernment agencies The consultant would hold training sessionsfor the personnel and walk them through an application

2 A one or two-week course on preparing visual presentashytions and graphs to be used in the briefing and in the executivesummaries At the beginning this should concentrate on effecshytive use of overhead projectors and transparencies

3 The creation of the clearinghouse will require thesupport of a two-person team One person who is expert in thecurrent state-of-the-art in population research who will aid indivising the taxonomy and one person who is expert in classifishycation systems and information storage and retrieval using manualtechnologies who will aid in setting up the system and developingprocedures for running it This person will likely be found at a library school This will require about one month each

4 The creation of the institutional inventory may benefitfrom at least two weeks of the services of an anthropologistsociologist andor a political scientist who is familiar with Pakistan

5 The editing and publishing of the newsletter may benefitfrom the consultation of a successful newsletter editor in the USMajor problems are audience identification preparing copy layoutand pasting-up original forms for publication

6 These recommedations assume that adequate printing andreproduction facilities are available If not some additional support will be required in this area

F Other USAID Items of Concern

1 USAID Personnel should participate to the extent possishyble politically to insure that the Director of DPRU has the stature and talent required

2 USAID personnel should encourage the formation and periodic meetings of the steering committee-

G People interviewed

USAID

I Dr Steven W Sinding 2William R McIntyre 3 Marvin A Schwartz 4 Thomas R Mahoney

- 15 shy

5 Dr Andrew P Haynal 6 David Oot 7 Ruth S Plunkett 8 Hugh S Plunkett

POaulation Planning Council(PPC)

1 Mr M Alauddin Joint Secretary 2 Dr Wiqar Zaidi Director DPARC 3 Dr Makhdoom Ali Shah Director of Implementation

Planning Commission

1 Javid Hamid Chief of Economic Research 2 Jawaid Azfar Chief of Population Research

PIDE (Pakistan Institute of Development Economics)

1 M L Qureshi Director 2 Mohammad Afzal Chief of Population Section 3 Dr Steven Guisinger Economist 4 Dr Dennis DeTray EconomistDemographer

Family Planning Association of Pakistan 1 Mrs Surayya Jabeen Senior Director for Liaison

with Government and International Agenciesshy

2 Mr Naseer Chaudhry Assistant Director Field Operations

3 Mr Sabir Shah Field Representative

Note - FPAP arranged field trips to two familyplanning centers operated by the Pakistan Railway and to a village in the Shadab Pilot Project area where the family planning projectis integrated into the Integrated Rural Developshyment program These trips resulted in discusshysions with many participants including the President of the Peoples Welfare Society in the Shadab village

Training Research Evaluation Centre (TREC)

1 Mr Nizamuddin Deputy Director Social Research

Continus Motivation System (CMS)

1 Mrs Eatram -bullDistrict Population Planningliofficer Rawalpindi

- 16 o

Other Researchers

1 Mr Mahmood Roshan PhD Candidate (in dissertation)School of Public Health University of California Berkeley

Other Interested Parties

1 Dr John C -Cool Director of Ford Foundation in Pakistan

Private Firm Researchers 1 Mr Owais Akhlaq and Owais AdvertisingandMarket

Research

-3-

Pakistan in Lahore (which carries out a relatively agressive program but which because of limited funds and the nonshygovernmental nature of its activities can generally onlyconduct demonstration projects and not nation-wide programs)All of the policy-makers interviewed indicated that they would like to receive more research results A statement which is undoubtedly somewhat platitudinal but partly genuineThey were quick to point out that there were substantial demands on their time and that they have little time to devote to reading research results They receive large volumes of information each day and report that most research monographsand articles were long ill organized for their purposesrepleat with data formula and tables and generally too technical to read A consistent complaint was that the research was not addressed to their particular policy-making needs as they saw them

In light of this situation of generally low quality and low relevancy research on the one hand and of a rather loose knit policy-making structure on the other hand it may appear that research utilization programs are premature Howshyever we are embroiled in a kind of chicken and egg problemhere A good research utilization program can help to deal with both problems This is because the basic motivation of researchers is to serve first their academic and research community needs and demands whereas the basic motivation of policy-makers is to try to cope with the pressing day-to-dayneeds of the practical problems they face Each then operatecurrently as essentially separate entities Until some social mechanism is put in place to link policy-makers and researchers more closely together it appears that each will continue to goits separate way

An effective research utilization program will work to reduce some of the limitations discussed above The social dynamics are such that once a mechanism exists for using research new pressures can be placed on the research communityfor both relevancy and quality If the researchers perceivethat there is money (in the form of grants and contracts) and status (in the form of recognition) for tLeir work as well as academic credit they will begin to respond in a more appropriate way Once policy-makers begin to achieve results from research findings and learn to trust them they will begin to rely on them Moreover the successful use of valid research conclushysions will serve to strengthen their policy-making institutions

The role of the population research utilization programrecommended in Section II is to initiate this social dynamicin a small way Our ambitions are modest but positive We should recognize that national and international economic and political concerns and the pressing problems of the moment will always outweigh the consisetent use of research results in the policy-makers eye But an effective research utilization program is an important and perhaps necessary first step to more informed policy judgments

-4-

The long-term objective of the research utilization programis to create the informed policy-makers This ideal is a policy-maker who is aware of research results understands thebasis upon which they were obtained and is able to incorporatethe into active policy making This does not mean that the policy-maker blindly implements recommendations based on research findings (a point many researchers fail to comprehend)It does mean however that he is aware of the research findingsactively considers them in arriving at policy and is able if pressed to produce an argument as to why the policy he chose differe from the findings

The route to the informied policy-maker as an ideal involves three major processes

1 Awareness -- the policy-maker needs to be aware of extent and possible relevancy of existing and on-going research

2 Dissemination -- the policy-maker needs to receive thebullresearch results in a readable and informative way He also needs to know how he can acquire more information on a topic

3 Utilization -- once alerted and in possession of research findings the policy-maker needs to be encouraged to incorporate them into the policy-making process This involves at least three possibilities

a Selection -- the choosing of research which is pertinent to the policy topics he faces

b Adoption the direct implementation and operashytiohalization of research findings

c Adaption -- the modification and re-arrangingof research results to apply them to the specific problem at hand

The organization and activities recommended in the followingsection are desigiied to create a new institution within thePopulation Planning CouncilDivision to formalize these processhyses These processes are achieved through four generic activitiesdepending on the source of initiation of the activity These activities may be described as follows

1 Researchers study policy-makers problems and designprojects to solve them

2 Researchers educate policy-makers on research methods

and possibilities and solicit policy-makers guidance in the design of projects

-5shy

3 Policy-makers learn about research methods and possishybilities and suggest relevant projects

4 Policy-makers describe their policy-making problems to researchers so that the researchers can design relevant projects

These three general processes and four generic activities are fundamental to achieving the informed policy-maker ideal They have served as guidelines in constructing the recommendashytions which follow

II RECOMMENDED RESEARCH UTILIZATION PROCESS

A General

It is proposed that a separate unit be established within the Population Planning DivisionCouncil to carry out research utilization activities The suggested title is Demographic Policy Research Utilization (DPRU) This unit would be responsible for knowing and assessing the state of the art in population research as it affects Pakistan and adapting it to Pakistans needs These conclusions should be communicated to policy-makers in a manner which relates directly to their policy-making requirements

In total DPRU will engage in nine basic activities which

are specified below

B Major Activities

1 Participation iw the Poptlatiorf Gants Steeriny Committee The population grants program calls for a steering committee comshyposed of outstanding community leaders in the society researchers and members of Government DPRU should serve as the information arm of that committee Working under the direction of the committee chairman DPRU should

a Set meeting dates and places b Publish the meeting agenda c Prepare background papers and briefings for

the meeting d Publish a summary of the meeting and distrishy

bute it to the members

At least once a year DPRU will prepare and deliver to the steering committee a State-of-Population Research Utilization in Pakistan report This report will contain the following sections

a The Problem -- a brief summary of key demographic statistics for the year (and historically)

b Current Research on the Problem-- a summaryof research completed or undertaken duringthe year and its major findings

C DPRU Programs -- a summary of activities undertaken by DPRU to relate the research to policy-makers

d Utilization -- a summary of instances whereresearch results were used in setting populashytion policy or in devising new programs Specishyfic research results need not have been adoptedas is or even adapted to a particular problemahowever to qualify as utilization there shouldbe some evidence that the policy-maker actuallyreceived the research findings evaluated themand actively considered them in the process of making policy

2 Prepare Executive Summaries of Completed Research DPRUwill be responsible for preparing an Executive Summary for eachcompleted research project The length of these summaries will vary with the content of the project howeverit is expected thatthe summaries will generally be about 2-8 pages in length Theyshould rarely exceed 25 pages The primary audience for theseExecutive Summaries is the policy-makers who make and influencepopulation and family planning decisions in Pakistan

The general outline of each Summary should be as follows

a One or two paragraphs (no more than one pagemaximum) describing the background and purposesof the research

b A list of the principal findings

c A list of the policy implications of the findings

d A discussion of the results of the research as theyrelate to policy This will include a discussion of the assumptions and conditions under which policyimpacts or recommendations are appropriate Thediscussions should also include an assessment of the adequacy of the data used in research theresearch design and the methods of analysis as theypertain to the validity of the policy implicationsA discussion of related research and its findings(including agreements and differences) should beincluded where appropriate

In general these Executive Summaries should meet the requireshyments of good journalism They should be concise readable simpleclear and closely related to the policy concerns of the audience

-7

Where possible graphs tables and other visuals should be employed Since the graphs and tables contained in many research reports are too detailed and busy DPRU often will have to redraw and simplify them so that the key points are better communicated to the audience

Executive Summaries will constitute series number one of the DPRU publications In the beginning of the program simple offshyset reproduction printing methods should be used A standard front cover should be used for t1eseries which clearly identishyfies that this is an Executive Summary and that DPRU is the source The last page of the Summary should inform the reader on how to acquire a copy of the complete research monograph and on the availability of other Summaries and Monographs

Executive Summaries should be prepared (required) for every project completed under the Population Grants Program and where possible for any other research project of potential use to policy-makers

3 Prepare Briefings on Completed Research The written word by iEself is not the most effective form of communication Dialogue discussion and personal involvement increase the degree of communication Consequently the Executive Summaries should be used to develop short briefings for policy-makers These briefings should be 15-20 minutes in length and should make use of visual displays An overhead projector with transparencies should be used most frequently but very important items might be prepared on large charts

Most of the briefings will be delivered to groups of 3-4 people but consideration should be given to the possibility of delivering the briefing to a single influencial person or to a group of say 25 In any event the briefing session should be scheuled so that ample time is available during each session for questions and discussions on the report The person presenting the briefing should be prepared with topics for discussion concerning the report and where possible and proper should engage people in discussion

A briefin i should always be scheduled for the Planning Commission and for the Population Planning Council Attempts should be made to brief the Minister of Health and other Minisshytries if possible As many other interested organizations and influencial parties as possible should also be briefed

In developing this program the DPRU should review the Audio-Visual Projects effort undeviay at the Family Plannng Association of Pakistan (Lahore) and other policy oriented audiovisual programs in Pakistan

--

8shy

4 Prepare and Distribute News releases Studies of policyshymakers in the United States find that they acquire most of theirscientific information from the newspapers Moreover personalexperience in working with US Congressional staffs and otherstaff members for influencial decision makers reveals that theyread news releases before they read many other materials Thereare several reasons for this News releases are short andgenerally well writtqp they focus on only the key points ofinterest they are timely and they reveal what the sourceorganization thinks is important Thus the news release itself becomes a communication medium

Using the Executive Sunmaries as background news releasesshould be prepared for completed research whenever the qualityis adequate They should be distributed to policy-makersand their staffs as well as to the press Special results mightwarrant a full-blown press conference One advantage of a pubshylished news item is that it raises the public consciousness aswell as that of the leaders

5 Maintain a Mailing List DPRU should develop and mainshytain a mailing list of people in population planning policy inPakistan This would include the names and addresses ofinfluential policy-makers and researchers with regard to populashytion problems in Pakistan It should be organized by institutionGovernment Industry Association University etc The listwill be used to send out items of interest to appropriate parties

DPRU can begin to constructthis list by drawing on existinglists For example FPAP has a list of 25000 to 35000 peoplewhich representatives indicated it would be willing to share

6 Create an Institutional Inventory In any social systempolicy is carried out via its institutions They are the bases upon which attitudes are formed and instrumentalities throughwhich resources are mobilized and allocated When they acceptan innovation the likelihood of adoption is increased When theyreject one they constitute a formidable barrier

Consequently DPRU should identify and record as much of theinstitutional structure of Pakistan as possible This recordshould include the institution its leadership its location andthe number of people affected by it (employees participants etc)

The inventory will include governments state provincialdistrict tehsil union council industry unions religiouisleaders newspapers universities associations etc Only thelargest and most important need be identified at the start butthe inventory should be expanded over the years Among the uses of the inventory are the following

a A basis for assessing social impactof populationpolicy recommendation

b A source for personnel to be included in the mailing list

c A source of sites for pilot and demonstration projects (and if necessary for experimental purposes for control sites)

7 Conduct Workshops and Seminars In a personalisticculture such as Pakistan face-to-face communication is imporshyotant Workshops and Seminars are one method by which this form of communication can be promoted DPRU should conduct workshopsof two types

a Problem Identification A quick review of some of the existing research and discussion with policy-makers suggests that much of the current research is tangentialto the central concerns of policy-makers The purpose of a problems identification workshop is to bring policyshymakers and researchers together in a format in which policyshymakers can indicate their needs and in which researchers can suggest possible projects for securing information consisshytent with these needs The ideal project should be both policy relevant and scientifically sound Sometimes these criteria are in conflict especially given limited budgets and short decision times Consequently one of the functions of the problem identification workshop is to reach comproshymises where these conflicts occur

A model for such a workshop is as follows

1 DPRU identifies one or two broad areas of policy relevance (eg education of women use of incentives value of children)

2 A leading policy-maker is asked to preside over ther workshop and to present some of his or herviews on the problem as a keynote on the topics

3 About five policy-makers or research users in the topicarea and five resear-hers plus a few other interested parties (eg representatives of Donor agencies) are invited to the workshop

4 The keynote is presented followed by a series of discussions on subtopics during which users relate their needs and researchers discuss the researchability of the topicsOf particular importance is a discussion of data availabilityThe chairman of the session seeks to secure some consensus of the nature of the problem and some acceptable research strateshygies As an option he may attempt to assign priorities to the possible research topics

10

5 The workshop is recorded (or a good scribe is employed)Following the workshop DPRU prepares a short report describingthe workshop and its key findings In completing the reportDPRU may want to contact participants for clarification andaugmentation of the ideas presented in the meeting The reportis distributed to both policy-makers and researchers These reports can be especially effective if they servc as the basis upon which research grants are made

b Seminars on Research Findings In addition tothe briefings described above it is often useful to holdseminars in which both policy-makers and researchers explorethe implications and possible utility of completed researchprojects The seminar should be designed to assess the strengthsand weaknesses of the research in terms of its internal and external validity and its relevance for policy making

A model for such a seminar is as follows

1) DPRU Identifies about 10 or 15 reseachers and policyshymakers with interest in the completed research and invites them to the seminar

2) a researcher (other than the whoone did the research)-is selected and starts off the seminar by presenting a summaryof the project This is followed by a critique -

3) a policy-maker reviews the researchandpresents an evaluation from a policy-making perspective

4) the researcher comments on the two preceeding presen- tations

5) the seminar is opened to general discussion

6) toward the end of the seminar the chairman attempts toreach agreement on action steps that might proceed on the basisof the results and on topics for further research

7) a record of the seminar and its conclusions if published

8 Create and Maintain a Clearinghouse on Research and Policy Sources Relevant to Pakistan Discussion with

both researchers and policy-makers indicates that there iscurrently an institutional deficiency in handling the volume of pertinent research results and making them available toresearchers and policy-makers DPRU should create a populationresearch clearinghouse to fill this void While this taskhas lesser priority than the preceeding ones it is neverthelessimportant to the overall improvement of population research utilization in Pakistan

The clearinghouse would maintain a file on three different kinds of information relevent to policy-making and research ie a) published works b) sources of data and c) names and addresses of individuals who have expertise in relevant fields

The clearinghouse should begin modestly and draw heavily on existing sources It should engage in the following activities

a Create a taxonomy for classifying published works (and expertise) The taxonomy should include policy variables (ie independent variables) measures of fertility and other outcomes (ie dependent variables) methodology data source and location of study A good place to start is to study the classification used by McGreevey in The Policy Relevance of Recent Social Research on Fertility Smithsonian Institute Occasional Monograph Series Number two

b Develop a biblicgraphy of pertinent works and classify existing research In doing these full use should be made of existing indexes such as those published by USAID TREC PIDE NRIFC and FPAP Each item of potential use to Pakistani researchers and policy-makers should be identified classified and summarized briefly A suitable technology for rimning the clearinghouse is the McBee key sort edge punched card system The particulars of the item are recorded in the body of the card and the classifications are recorded by notches in the edge of the card A needle is used on the pack of cards to outsort those which satisfy a particular inquiry for items subsumed under certain specified categories Each card should indicate where to find the document

c DPRU should keep an inventory of what data is available and where and how it can be accessed hbis will be used to answer iquiries by both reseachers and policy-makers who have a need for data

d Another edged punched card system should be set up to classify individuals both in Pakistan and elsewhere who have expertise on elevant topics The taxonomy discussed above would be the basis for classification An ideal use of the expert file would occur when a policyshymaker contacted DPRU in order to obtain advice on a topic of interest In addition to published works DPRU would suggest an expert or two in the area whose knowledge and opinion on the topic could be requested

9 Edit and Publish a Newsletter This is the lowest priority activity for DPRU however consideration should be given to publishing a newsletter containing concise articles on new research findings other items of interest and where and how to send for publication It would be distributed to

- 12 shy

the mailing list discussed above Its primary advantage is tokeep the reader aware of population problems research-based solutions and DPRU

_C Organization and Job Specifications

DPRU will be headed by a deputy director who reports directly to the Director (DPRC) and the Joint Secretary The -

Director initially will be supported by a communication specialist and a research analyst

1 Director The Deputy Director should be a person whois known and respected by the key policy-makers at PPC thePlanning Commission and the Ministries of Government Heshould have access to them for informal discussion as well asformal presentation He should be very familiar with thepopulation program in Pakistan If possible he should also befamiliar with current population research and research methodsbut this is a secondary requirement

The Director will be primary presentor at the briefings andat the stearing committee meetings He should also be active inthe workshops and seminars especially when high-level policyshymakers are involved His continuing responsibility is tolobby or implementation of research findings with policy-makersand to keep himself appraised of their concerns in the populationplanning area He should also maintain contact with organizationssuch as the Family Planning Association of Pakistan It is likelythat if some of the potentially useful findings of that organizashytion are mediated through DPRU the chances for adoption or adaptation will be improved

Under the supervision of the Director of DPRU are twospecialists--a communirtion specialist and a research analystwho must work together closely to accomplish the units tasks

2 Communication Specialist The person should have studiedjournalism and hopefully should have some experience in writingand reporting on scientific or technological activities Theability to write well and to present ideas clearly is critical to the functioning of the role

Primary responsibilities are to write executive summariesusing analysis prepared by the research analyst prepare briefshyings write news releases maintain mailing list create theinstitutional inventory participate in workshops preparepresentation for steering committee and edit and publish thenewsletter

13 shy

Research st This person should have experiencein research and researflchethodology Ideally this experience would be in population or related areas The individual need not be an accomplished researcher (although this is desirable)but should be able to converse with researchers on technical topics critique research studies from a methodological pointof -view summarize research findings and to relate them to other existing research

Primary responsiblities are to maintain liaison with researchers acquire completed research and to analyze research for its essential findings The role includes primary responsibishylity for maintaining the clearinghouse This person will also contribute to the other activities of the unit

D Time Phasing for the Installation of DPRU

Initially there will be little new coming research for DPRU to review and communicate During the development and transition to a steady state it is suggested that DPRU proceedin the following manner

The first task for DPRU will be to identify and assess the state of the art in population research in Pakistan This should be available at the first meeting of the steering commitshytee The assessment will serve as the basis for creating the clearinghouse Simultaneously the mailing list should be developed In addition to their substantive contributions the construction of the mailing list and the clearinghouse will force DPRU to become familiar with level of research and the researchers themselves currently active in Pakistan and also with the policy-makers with whom they are to communicate Early on a research problem identification workshop should be held

As research results become available DPRUs mode of activity shifts to the preparation of executive summaries briefings and workshops Then the clearing house and the mailing list are maintained When these activities are well underway the newsletter and institutional inventory can be considered

M Technical Assistance Required

The amount and character of further USAID technical assisshytance required to insure the DPRU has adequate capacity to fulfii its assigned tasks will depend largely on the talents and skills Df the 3 people it employs Since it is likely that all requisiteabilities will not be available some technical assistamcewill undoubtedly be required Potential requirements are specified below

- 14 shy

1 A consultant on the communication of scientific findingsto policy-makers for the period of approximately one monthPossible sources of the required expertise are policy orientedassociations such as TheConference Board media organizationssuch as Scientific American Science or Business Week and otherGovernment agencies The consultant would hold training sessionsfor the personnel and walk them through an application

2 A one or two-week course on preparing visual presentashytions and graphs to be used in the briefing and in the executivesummaries At the beginning this should concentrate on effecshytive use of overhead projectors and transparencies

3 The creation of the clearinghouse will require thesupport of a two-person team One person who is expert in thecurrent state-of-the-art in population research who will aid indivising the taxonomy and one person who is expert in classifishycation systems and information storage and retrieval using manualtechnologies who will aid in setting up the system and developingprocedures for running it This person will likely be found at a library school This will require about one month each

4 The creation of the institutional inventory may benefitfrom at least two weeks of the services of an anthropologistsociologist andor a political scientist who is familiar with Pakistan

5 The editing and publishing of the newsletter may benefitfrom the consultation of a successful newsletter editor in the USMajor problems are audience identification preparing copy layoutand pasting-up original forms for publication

6 These recommedations assume that adequate printing andreproduction facilities are available If not some additional support will be required in this area

F Other USAID Items of Concern

1 USAID Personnel should participate to the extent possishyble politically to insure that the Director of DPRU has the stature and talent required

2 USAID personnel should encourage the formation and periodic meetings of the steering committee-

G People interviewed

USAID

I Dr Steven W Sinding 2William R McIntyre 3 Marvin A Schwartz 4 Thomas R Mahoney

- 15 shy

5 Dr Andrew P Haynal 6 David Oot 7 Ruth S Plunkett 8 Hugh S Plunkett

POaulation Planning Council(PPC)

1 Mr M Alauddin Joint Secretary 2 Dr Wiqar Zaidi Director DPARC 3 Dr Makhdoom Ali Shah Director of Implementation

Planning Commission

1 Javid Hamid Chief of Economic Research 2 Jawaid Azfar Chief of Population Research

PIDE (Pakistan Institute of Development Economics)

1 M L Qureshi Director 2 Mohammad Afzal Chief of Population Section 3 Dr Steven Guisinger Economist 4 Dr Dennis DeTray EconomistDemographer

Family Planning Association of Pakistan 1 Mrs Surayya Jabeen Senior Director for Liaison

with Government and International Agenciesshy

2 Mr Naseer Chaudhry Assistant Director Field Operations

3 Mr Sabir Shah Field Representative

Note - FPAP arranged field trips to two familyplanning centers operated by the Pakistan Railway and to a village in the Shadab Pilot Project area where the family planning projectis integrated into the Integrated Rural Developshyment program These trips resulted in discusshysions with many participants including the President of the Peoples Welfare Society in the Shadab village

Training Research Evaluation Centre (TREC)

1 Mr Nizamuddin Deputy Director Social Research

Continus Motivation System (CMS)

1 Mrs Eatram -bullDistrict Population Planningliofficer Rawalpindi

- 16 o

Other Researchers

1 Mr Mahmood Roshan PhD Candidate (in dissertation)School of Public Health University of California Berkeley

Other Interested Parties

1 Dr John C -Cool Director of Ford Foundation in Pakistan

Private Firm Researchers 1 Mr Owais Akhlaq and Owais AdvertisingandMarket

Research

-4-

The long-term objective of the research utilization programis to create the informed policy-makers This ideal is a policy-maker who is aware of research results understands thebasis upon which they were obtained and is able to incorporatethe into active policy making This does not mean that the policy-maker blindly implements recommendations based on research findings (a point many researchers fail to comprehend)It does mean however that he is aware of the research findingsactively considers them in arriving at policy and is able if pressed to produce an argument as to why the policy he chose differe from the findings

The route to the informied policy-maker as an ideal involves three major processes

1 Awareness -- the policy-maker needs to be aware of extent and possible relevancy of existing and on-going research

2 Dissemination -- the policy-maker needs to receive thebullresearch results in a readable and informative way He also needs to know how he can acquire more information on a topic

3 Utilization -- once alerted and in possession of research findings the policy-maker needs to be encouraged to incorporate them into the policy-making process This involves at least three possibilities

a Selection -- the choosing of research which is pertinent to the policy topics he faces

b Adoption the direct implementation and operashytiohalization of research findings

c Adaption -- the modification and re-arrangingof research results to apply them to the specific problem at hand

The organization and activities recommended in the followingsection are desigiied to create a new institution within thePopulation Planning CouncilDivision to formalize these processhyses These processes are achieved through four generic activitiesdepending on the source of initiation of the activity These activities may be described as follows

1 Researchers study policy-makers problems and designprojects to solve them

2 Researchers educate policy-makers on research methods

and possibilities and solicit policy-makers guidance in the design of projects

-5shy

3 Policy-makers learn about research methods and possishybilities and suggest relevant projects

4 Policy-makers describe their policy-making problems to researchers so that the researchers can design relevant projects

These three general processes and four generic activities are fundamental to achieving the informed policy-maker ideal They have served as guidelines in constructing the recommendashytions which follow

II RECOMMENDED RESEARCH UTILIZATION PROCESS

A General

It is proposed that a separate unit be established within the Population Planning DivisionCouncil to carry out research utilization activities The suggested title is Demographic Policy Research Utilization (DPRU) This unit would be responsible for knowing and assessing the state of the art in population research as it affects Pakistan and adapting it to Pakistans needs These conclusions should be communicated to policy-makers in a manner which relates directly to their policy-making requirements

In total DPRU will engage in nine basic activities which

are specified below

B Major Activities

1 Participation iw the Poptlatiorf Gants Steeriny Committee The population grants program calls for a steering committee comshyposed of outstanding community leaders in the society researchers and members of Government DPRU should serve as the information arm of that committee Working under the direction of the committee chairman DPRU should

a Set meeting dates and places b Publish the meeting agenda c Prepare background papers and briefings for

the meeting d Publish a summary of the meeting and distrishy

bute it to the members

At least once a year DPRU will prepare and deliver to the steering committee a State-of-Population Research Utilization in Pakistan report This report will contain the following sections

a The Problem -- a brief summary of key demographic statistics for the year (and historically)

b Current Research on the Problem-- a summaryof research completed or undertaken duringthe year and its major findings

C DPRU Programs -- a summary of activities undertaken by DPRU to relate the research to policy-makers

d Utilization -- a summary of instances whereresearch results were used in setting populashytion policy or in devising new programs Specishyfic research results need not have been adoptedas is or even adapted to a particular problemahowever to qualify as utilization there shouldbe some evidence that the policy-maker actuallyreceived the research findings evaluated themand actively considered them in the process of making policy

2 Prepare Executive Summaries of Completed Research DPRUwill be responsible for preparing an Executive Summary for eachcompleted research project The length of these summaries will vary with the content of the project howeverit is expected thatthe summaries will generally be about 2-8 pages in length Theyshould rarely exceed 25 pages The primary audience for theseExecutive Summaries is the policy-makers who make and influencepopulation and family planning decisions in Pakistan

The general outline of each Summary should be as follows

a One or two paragraphs (no more than one pagemaximum) describing the background and purposesof the research

b A list of the principal findings

c A list of the policy implications of the findings

d A discussion of the results of the research as theyrelate to policy This will include a discussion of the assumptions and conditions under which policyimpacts or recommendations are appropriate Thediscussions should also include an assessment of the adequacy of the data used in research theresearch design and the methods of analysis as theypertain to the validity of the policy implicationsA discussion of related research and its findings(including agreements and differences) should beincluded where appropriate

In general these Executive Summaries should meet the requireshyments of good journalism They should be concise readable simpleclear and closely related to the policy concerns of the audience

-7

Where possible graphs tables and other visuals should be employed Since the graphs and tables contained in many research reports are too detailed and busy DPRU often will have to redraw and simplify them so that the key points are better communicated to the audience

Executive Summaries will constitute series number one of the DPRU publications In the beginning of the program simple offshyset reproduction printing methods should be used A standard front cover should be used for t1eseries which clearly identishyfies that this is an Executive Summary and that DPRU is the source The last page of the Summary should inform the reader on how to acquire a copy of the complete research monograph and on the availability of other Summaries and Monographs

Executive Summaries should be prepared (required) for every project completed under the Population Grants Program and where possible for any other research project of potential use to policy-makers

3 Prepare Briefings on Completed Research The written word by iEself is not the most effective form of communication Dialogue discussion and personal involvement increase the degree of communication Consequently the Executive Summaries should be used to develop short briefings for policy-makers These briefings should be 15-20 minutes in length and should make use of visual displays An overhead projector with transparencies should be used most frequently but very important items might be prepared on large charts

Most of the briefings will be delivered to groups of 3-4 people but consideration should be given to the possibility of delivering the briefing to a single influencial person or to a group of say 25 In any event the briefing session should be scheuled so that ample time is available during each session for questions and discussions on the report The person presenting the briefing should be prepared with topics for discussion concerning the report and where possible and proper should engage people in discussion

A briefin i should always be scheduled for the Planning Commission and for the Population Planning Council Attempts should be made to brief the Minister of Health and other Minisshytries if possible As many other interested organizations and influencial parties as possible should also be briefed

In developing this program the DPRU should review the Audio-Visual Projects effort undeviay at the Family Plannng Association of Pakistan (Lahore) and other policy oriented audiovisual programs in Pakistan

--

8shy

4 Prepare and Distribute News releases Studies of policyshymakers in the United States find that they acquire most of theirscientific information from the newspapers Moreover personalexperience in working with US Congressional staffs and otherstaff members for influencial decision makers reveals that theyread news releases before they read many other materials Thereare several reasons for this News releases are short andgenerally well writtqp they focus on only the key points ofinterest they are timely and they reveal what the sourceorganization thinks is important Thus the news release itself becomes a communication medium

Using the Executive Sunmaries as background news releasesshould be prepared for completed research whenever the qualityis adequate They should be distributed to policy-makersand their staffs as well as to the press Special results mightwarrant a full-blown press conference One advantage of a pubshylished news item is that it raises the public consciousness aswell as that of the leaders

5 Maintain a Mailing List DPRU should develop and mainshytain a mailing list of people in population planning policy inPakistan This would include the names and addresses ofinfluential policy-makers and researchers with regard to populashytion problems in Pakistan It should be organized by institutionGovernment Industry Association University etc The listwill be used to send out items of interest to appropriate parties

DPRU can begin to constructthis list by drawing on existinglists For example FPAP has a list of 25000 to 35000 peoplewhich representatives indicated it would be willing to share

6 Create an Institutional Inventory In any social systempolicy is carried out via its institutions They are the bases upon which attitudes are formed and instrumentalities throughwhich resources are mobilized and allocated When they acceptan innovation the likelihood of adoption is increased When theyreject one they constitute a formidable barrier

Consequently DPRU should identify and record as much of theinstitutional structure of Pakistan as possible This recordshould include the institution its leadership its location andthe number of people affected by it (employees participants etc)

The inventory will include governments state provincialdistrict tehsil union council industry unions religiouisleaders newspapers universities associations etc Only thelargest and most important need be identified at the start butthe inventory should be expanded over the years Among the uses of the inventory are the following

a A basis for assessing social impactof populationpolicy recommendation

b A source for personnel to be included in the mailing list

c A source of sites for pilot and demonstration projects (and if necessary for experimental purposes for control sites)

7 Conduct Workshops and Seminars In a personalisticculture such as Pakistan face-to-face communication is imporshyotant Workshops and Seminars are one method by which this form of communication can be promoted DPRU should conduct workshopsof two types

a Problem Identification A quick review of some of the existing research and discussion with policy-makers suggests that much of the current research is tangentialto the central concerns of policy-makers The purpose of a problems identification workshop is to bring policyshymakers and researchers together in a format in which policyshymakers can indicate their needs and in which researchers can suggest possible projects for securing information consisshytent with these needs The ideal project should be both policy relevant and scientifically sound Sometimes these criteria are in conflict especially given limited budgets and short decision times Consequently one of the functions of the problem identification workshop is to reach comproshymises where these conflicts occur

A model for such a workshop is as follows

1 DPRU identifies one or two broad areas of policy relevance (eg education of women use of incentives value of children)

2 A leading policy-maker is asked to preside over ther workshop and to present some of his or herviews on the problem as a keynote on the topics

3 About five policy-makers or research users in the topicarea and five resear-hers plus a few other interested parties (eg representatives of Donor agencies) are invited to the workshop

4 The keynote is presented followed by a series of discussions on subtopics during which users relate their needs and researchers discuss the researchability of the topicsOf particular importance is a discussion of data availabilityThe chairman of the session seeks to secure some consensus of the nature of the problem and some acceptable research strateshygies As an option he may attempt to assign priorities to the possible research topics

10

5 The workshop is recorded (or a good scribe is employed)Following the workshop DPRU prepares a short report describingthe workshop and its key findings In completing the reportDPRU may want to contact participants for clarification andaugmentation of the ideas presented in the meeting The reportis distributed to both policy-makers and researchers These reports can be especially effective if they servc as the basis upon which research grants are made

b Seminars on Research Findings In addition tothe briefings described above it is often useful to holdseminars in which both policy-makers and researchers explorethe implications and possible utility of completed researchprojects The seminar should be designed to assess the strengthsand weaknesses of the research in terms of its internal and external validity and its relevance for policy making

A model for such a seminar is as follows

1) DPRU Identifies about 10 or 15 reseachers and policyshymakers with interest in the completed research and invites them to the seminar

2) a researcher (other than the whoone did the research)-is selected and starts off the seminar by presenting a summaryof the project This is followed by a critique -

3) a policy-maker reviews the researchandpresents an evaluation from a policy-making perspective

4) the researcher comments on the two preceeding presen- tations

5) the seminar is opened to general discussion

6) toward the end of the seminar the chairman attempts toreach agreement on action steps that might proceed on the basisof the results and on topics for further research

7) a record of the seminar and its conclusions if published

8 Create and Maintain a Clearinghouse on Research and Policy Sources Relevant to Pakistan Discussion with

both researchers and policy-makers indicates that there iscurrently an institutional deficiency in handling the volume of pertinent research results and making them available toresearchers and policy-makers DPRU should create a populationresearch clearinghouse to fill this void While this taskhas lesser priority than the preceeding ones it is neverthelessimportant to the overall improvement of population research utilization in Pakistan

The clearinghouse would maintain a file on three different kinds of information relevent to policy-making and research ie a) published works b) sources of data and c) names and addresses of individuals who have expertise in relevant fields

The clearinghouse should begin modestly and draw heavily on existing sources It should engage in the following activities

a Create a taxonomy for classifying published works (and expertise) The taxonomy should include policy variables (ie independent variables) measures of fertility and other outcomes (ie dependent variables) methodology data source and location of study A good place to start is to study the classification used by McGreevey in The Policy Relevance of Recent Social Research on Fertility Smithsonian Institute Occasional Monograph Series Number two

b Develop a biblicgraphy of pertinent works and classify existing research In doing these full use should be made of existing indexes such as those published by USAID TREC PIDE NRIFC and FPAP Each item of potential use to Pakistani researchers and policy-makers should be identified classified and summarized briefly A suitable technology for rimning the clearinghouse is the McBee key sort edge punched card system The particulars of the item are recorded in the body of the card and the classifications are recorded by notches in the edge of the card A needle is used on the pack of cards to outsort those which satisfy a particular inquiry for items subsumed under certain specified categories Each card should indicate where to find the document

c DPRU should keep an inventory of what data is available and where and how it can be accessed hbis will be used to answer iquiries by both reseachers and policy-makers who have a need for data

d Another edged punched card system should be set up to classify individuals both in Pakistan and elsewhere who have expertise on elevant topics The taxonomy discussed above would be the basis for classification An ideal use of the expert file would occur when a policyshymaker contacted DPRU in order to obtain advice on a topic of interest In addition to published works DPRU would suggest an expert or two in the area whose knowledge and opinion on the topic could be requested

9 Edit and Publish a Newsletter This is the lowest priority activity for DPRU however consideration should be given to publishing a newsletter containing concise articles on new research findings other items of interest and where and how to send for publication It would be distributed to

- 12 shy

the mailing list discussed above Its primary advantage is tokeep the reader aware of population problems research-based solutions and DPRU

_C Organization and Job Specifications

DPRU will be headed by a deputy director who reports directly to the Director (DPRC) and the Joint Secretary The -

Director initially will be supported by a communication specialist and a research analyst

1 Director The Deputy Director should be a person whois known and respected by the key policy-makers at PPC thePlanning Commission and the Ministries of Government Heshould have access to them for informal discussion as well asformal presentation He should be very familiar with thepopulation program in Pakistan If possible he should also befamiliar with current population research and research methodsbut this is a secondary requirement

The Director will be primary presentor at the briefings andat the stearing committee meetings He should also be active inthe workshops and seminars especially when high-level policyshymakers are involved His continuing responsibility is tolobby or implementation of research findings with policy-makersand to keep himself appraised of their concerns in the populationplanning area He should also maintain contact with organizationssuch as the Family Planning Association of Pakistan It is likelythat if some of the potentially useful findings of that organizashytion are mediated through DPRU the chances for adoption or adaptation will be improved

Under the supervision of the Director of DPRU are twospecialists--a communirtion specialist and a research analystwho must work together closely to accomplish the units tasks

2 Communication Specialist The person should have studiedjournalism and hopefully should have some experience in writingand reporting on scientific or technological activities Theability to write well and to present ideas clearly is critical to the functioning of the role

Primary responsibilities are to write executive summariesusing analysis prepared by the research analyst prepare briefshyings write news releases maintain mailing list create theinstitutional inventory participate in workshops preparepresentation for steering committee and edit and publish thenewsletter

13 shy

Research st This person should have experiencein research and researflchethodology Ideally this experience would be in population or related areas The individual need not be an accomplished researcher (although this is desirable)but should be able to converse with researchers on technical topics critique research studies from a methodological pointof -view summarize research findings and to relate them to other existing research

Primary responsiblities are to maintain liaison with researchers acquire completed research and to analyze research for its essential findings The role includes primary responsibishylity for maintaining the clearinghouse This person will also contribute to the other activities of the unit

D Time Phasing for the Installation of DPRU

Initially there will be little new coming research for DPRU to review and communicate During the development and transition to a steady state it is suggested that DPRU proceedin the following manner

The first task for DPRU will be to identify and assess the state of the art in population research in Pakistan This should be available at the first meeting of the steering commitshytee The assessment will serve as the basis for creating the clearinghouse Simultaneously the mailing list should be developed In addition to their substantive contributions the construction of the mailing list and the clearinghouse will force DPRU to become familiar with level of research and the researchers themselves currently active in Pakistan and also with the policy-makers with whom they are to communicate Early on a research problem identification workshop should be held

As research results become available DPRUs mode of activity shifts to the preparation of executive summaries briefings and workshops Then the clearing house and the mailing list are maintained When these activities are well underway the newsletter and institutional inventory can be considered

M Technical Assistance Required

The amount and character of further USAID technical assisshytance required to insure the DPRU has adequate capacity to fulfii its assigned tasks will depend largely on the talents and skills Df the 3 people it employs Since it is likely that all requisiteabilities will not be available some technical assistamcewill undoubtedly be required Potential requirements are specified below

- 14 shy

1 A consultant on the communication of scientific findingsto policy-makers for the period of approximately one monthPossible sources of the required expertise are policy orientedassociations such as TheConference Board media organizationssuch as Scientific American Science or Business Week and otherGovernment agencies The consultant would hold training sessionsfor the personnel and walk them through an application

2 A one or two-week course on preparing visual presentashytions and graphs to be used in the briefing and in the executivesummaries At the beginning this should concentrate on effecshytive use of overhead projectors and transparencies

3 The creation of the clearinghouse will require thesupport of a two-person team One person who is expert in thecurrent state-of-the-art in population research who will aid indivising the taxonomy and one person who is expert in classifishycation systems and information storage and retrieval using manualtechnologies who will aid in setting up the system and developingprocedures for running it This person will likely be found at a library school This will require about one month each

4 The creation of the institutional inventory may benefitfrom at least two weeks of the services of an anthropologistsociologist andor a political scientist who is familiar with Pakistan

5 The editing and publishing of the newsletter may benefitfrom the consultation of a successful newsletter editor in the USMajor problems are audience identification preparing copy layoutand pasting-up original forms for publication

6 These recommedations assume that adequate printing andreproduction facilities are available If not some additional support will be required in this area

F Other USAID Items of Concern

1 USAID Personnel should participate to the extent possishyble politically to insure that the Director of DPRU has the stature and talent required

2 USAID personnel should encourage the formation and periodic meetings of the steering committee-

G People interviewed

USAID

I Dr Steven W Sinding 2William R McIntyre 3 Marvin A Schwartz 4 Thomas R Mahoney

- 15 shy

5 Dr Andrew P Haynal 6 David Oot 7 Ruth S Plunkett 8 Hugh S Plunkett

POaulation Planning Council(PPC)

1 Mr M Alauddin Joint Secretary 2 Dr Wiqar Zaidi Director DPARC 3 Dr Makhdoom Ali Shah Director of Implementation

Planning Commission

1 Javid Hamid Chief of Economic Research 2 Jawaid Azfar Chief of Population Research

PIDE (Pakistan Institute of Development Economics)

1 M L Qureshi Director 2 Mohammad Afzal Chief of Population Section 3 Dr Steven Guisinger Economist 4 Dr Dennis DeTray EconomistDemographer

Family Planning Association of Pakistan 1 Mrs Surayya Jabeen Senior Director for Liaison

with Government and International Agenciesshy

2 Mr Naseer Chaudhry Assistant Director Field Operations

3 Mr Sabir Shah Field Representative

Note - FPAP arranged field trips to two familyplanning centers operated by the Pakistan Railway and to a village in the Shadab Pilot Project area where the family planning projectis integrated into the Integrated Rural Developshyment program These trips resulted in discusshysions with many participants including the President of the Peoples Welfare Society in the Shadab village

Training Research Evaluation Centre (TREC)

1 Mr Nizamuddin Deputy Director Social Research

Continus Motivation System (CMS)

1 Mrs Eatram -bullDistrict Population Planningliofficer Rawalpindi

- 16 o

Other Researchers

1 Mr Mahmood Roshan PhD Candidate (in dissertation)School of Public Health University of California Berkeley

Other Interested Parties

1 Dr John C -Cool Director of Ford Foundation in Pakistan

Private Firm Researchers 1 Mr Owais Akhlaq and Owais AdvertisingandMarket

Research

-5shy

3 Policy-makers learn about research methods and possishybilities and suggest relevant projects

4 Policy-makers describe their policy-making problems to researchers so that the researchers can design relevant projects

These three general processes and four generic activities are fundamental to achieving the informed policy-maker ideal They have served as guidelines in constructing the recommendashytions which follow

II RECOMMENDED RESEARCH UTILIZATION PROCESS

A General

It is proposed that a separate unit be established within the Population Planning DivisionCouncil to carry out research utilization activities The suggested title is Demographic Policy Research Utilization (DPRU) This unit would be responsible for knowing and assessing the state of the art in population research as it affects Pakistan and adapting it to Pakistans needs These conclusions should be communicated to policy-makers in a manner which relates directly to their policy-making requirements

In total DPRU will engage in nine basic activities which

are specified below

B Major Activities

1 Participation iw the Poptlatiorf Gants Steeriny Committee The population grants program calls for a steering committee comshyposed of outstanding community leaders in the society researchers and members of Government DPRU should serve as the information arm of that committee Working under the direction of the committee chairman DPRU should

a Set meeting dates and places b Publish the meeting agenda c Prepare background papers and briefings for

the meeting d Publish a summary of the meeting and distrishy

bute it to the members

At least once a year DPRU will prepare and deliver to the steering committee a State-of-Population Research Utilization in Pakistan report This report will contain the following sections

a The Problem -- a brief summary of key demographic statistics for the year (and historically)

b Current Research on the Problem-- a summaryof research completed or undertaken duringthe year and its major findings

C DPRU Programs -- a summary of activities undertaken by DPRU to relate the research to policy-makers

d Utilization -- a summary of instances whereresearch results were used in setting populashytion policy or in devising new programs Specishyfic research results need not have been adoptedas is or even adapted to a particular problemahowever to qualify as utilization there shouldbe some evidence that the policy-maker actuallyreceived the research findings evaluated themand actively considered them in the process of making policy

2 Prepare Executive Summaries of Completed Research DPRUwill be responsible for preparing an Executive Summary for eachcompleted research project The length of these summaries will vary with the content of the project howeverit is expected thatthe summaries will generally be about 2-8 pages in length Theyshould rarely exceed 25 pages The primary audience for theseExecutive Summaries is the policy-makers who make and influencepopulation and family planning decisions in Pakistan

The general outline of each Summary should be as follows

a One or two paragraphs (no more than one pagemaximum) describing the background and purposesof the research

b A list of the principal findings

c A list of the policy implications of the findings

d A discussion of the results of the research as theyrelate to policy This will include a discussion of the assumptions and conditions under which policyimpacts or recommendations are appropriate Thediscussions should also include an assessment of the adequacy of the data used in research theresearch design and the methods of analysis as theypertain to the validity of the policy implicationsA discussion of related research and its findings(including agreements and differences) should beincluded where appropriate

In general these Executive Summaries should meet the requireshyments of good journalism They should be concise readable simpleclear and closely related to the policy concerns of the audience

-7

Where possible graphs tables and other visuals should be employed Since the graphs and tables contained in many research reports are too detailed and busy DPRU often will have to redraw and simplify them so that the key points are better communicated to the audience

Executive Summaries will constitute series number one of the DPRU publications In the beginning of the program simple offshyset reproduction printing methods should be used A standard front cover should be used for t1eseries which clearly identishyfies that this is an Executive Summary and that DPRU is the source The last page of the Summary should inform the reader on how to acquire a copy of the complete research monograph and on the availability of other Summaries and Monographs

Executive Summaries should be prepared (required) for every project completed under the Population Grants Program and where possible for any other research project of potential use to policy-makers

3 Prepare Briefings on Completed Research The written word by iEself is not the most effective form of communication Dialogue discussion and personal involvement increase the degree of communication Consequently the Executive Summaries should be used to develop short briefings for policy-makers These briefings should be 15-20 minutes in length and should make use of visual displays An overhead projector with transparencies should be used most frequently but very important items might be prepared on large charts

Most of the briefings will be delivered to groups of 3-4 people but consideration should be given to the possibility of delivering the briefing to a single influencial person or to a group of say 25 In any event the briefing session should be scheuled so that ample time is available during each session for questions and discussions on the report The person presenting the briefing should be prepared with topics for discussion concerning the report and where possible and proper should engage people in discussion

A briefin i should always be scheduled for the Planning Commission and for the Population Planning Council Attempts should be made to brief the Minister of Health and other Minisshytries if possible As many other interested organizations and influencial parties as possible should also be briefed

In developing this program the DPRU should review the Audio-Visual Projects effort undeviay at the Family Plannng Association of Pakistan (Lahore) and other policy oriented audiovisual programs in Pakistan

--

8shy

4 Prepare and Distribute News releases Studies of policyshymakers in the United States find that they acquire most of theirscientific information from the newspapers Moreover personalexperience in working with US Congressional staffs and otherstaff members for influencial decision makers reveals that theyread news releases before they read many other materials Thereare several reasons for this News releases are short andgenerally well writtqp they focus on only the key points ofinterest they are timely and they reveal what the sourceorganization thinks is important Thus the news release itself becomes a communication medium

Using the Executive Sunmaries as background news releasesshould be prepared for completed research whenever the qualityis adequate They should be distributed to policy-makersand their staffs as well as to the press Special results mightwarrant a full-blown press conference One advantage of a pubshylished news item is that it raises the public consciousness aswell as that of the leaders

5 Maintain a Mailing List DPRU should develop and mainshytain a mailing list of people in population planning policy inPakistan This would include the names and addresses ofinfluential policy-makers and researchers with regard to populashytion problems in Pakistan It should be organized by institutionGovernment Industry Association University etc The listwill be used to send out items of interest to appropriate parties

DPRU can begin to constructthis list by drawing on existinglists For example FPAP has a list of 25000 to 35000 peoplewhich representatives indicated it would be willing to share

6 Create an Institutional Inventory In any social systempolicy is carried out via its institutions They are the bases upon which attitudes are formed and instrumentalities throughwhich resources are mobilized and allocated When they acceptan innovation the likelihood of adoption is increased When theyreject one they constitute a formidable barrier

Consequently DPRU should identify and record as much of theinstitutional structure of Pakistan as possible This recordshould include the institution its leadership its location andthe number of people affected by it (employees participants etc)

The inventory will include governments state provincialdistrict tehsil union council industry unions religiouisleaders newspapers universities associations etc Only thelargest and most important need be identified at the start butthe inventory should be expanded over the years Among the uses of the inventory are the following

a A basis for assessing social impactof populationpolicy recommendation

b A source for personnel to be included in the mailing list

c A source of sites for pilot and demonstration projects (and if necessary for experimental purposes for control sites)

7 Conduct Workshops and Seminars In a personalisticculture such as Pakistan face-to-face communication is imporshyotant Workshops and Seminars are one method by which this form of communication can be promoted DPRU should conduct workshopsof two types

a Problem Identification A quick review of some of the existing research and discussion with policy-makers suggests that much of the current research is tangentialto the central concerns of policy-makers The purpose of a problems identification workshop is to bring policyshymakers and researchers together in a format in which policyshymakers can indicate their needs and in which researchers can suggest possible projects for securing information consisshytent with these needs The ideal project should be both policy relevant and scientifically sound Sometimes these criteria are in conflict especially given limited budgets and short decision times Consequently one of the functions of the problem identification workshop is to reach comproshymises where these conflicts occur

A model for such a workshop is as follows

1 DPRU identifies one or two broad areas of policy relevance (eg education of women use of incentives value of children)

2 A leading policy-maker is asked to preside over ther workshop and to present some of his or herviews on the problem as a keynote on the topics

3 About five policy-makers or research users in the topicarea and five resear-hers plus a few other interested parties (eg representatives of Donor agencies) are invited to the workshop

4 The keynote is presented followed by a series of discussions on subtopics during which users relate their needs and researchers discuss the researchability of the topicsOf particular importance is a discussion of data availabilityThe chairman of the session seeks to secure some consensus of the nature of the problem and some acceptable research strateshygies As an option he may attempt to assign priorities to the possible research topics

10

5 The workshop is recorded (or a good scribe is employed)Following the workshop DPRU prepares a short report describingthe workshop and its key findings In completing the reportDPRU may want to contact participants for clarification andaugmentation of the ideas presented in the meeting The reportis distributed to both policy-makers and researchers These reports can be especially effective if they servc as the basis upon which research grants are made

b Seminars on Research Findings In addition tothe briefings described above it is often useful to holdseminars in which both policy-makers and researchers explorethe implications and possible utility of completed researchprojects The seminar should be designed to assess the strengthsand weaknesses of the research in terms of its internal and external validity and its relevance for policy making

A model for such a seminar is as follows

1) DPRU Identifies about 10 or 15 reseachers and policyshymakers with interest in the completed research and invites them to the seminar

2) a researcher (other than the whoone did the research)-is selected and starts off the seminar by presenting a summaryof the project This is followed by a critique -

3) a policy-maker reviews the researchandpresents an evaluation from a policy-making perspective

4) the researcher comments on the two preceeding presen- tations

5) the seminar is opened to general discussion

6) toward the end of the seminar the chairman attempts toreach agreement on action steps that might proceed on the basisof the results and on topics for further research

7) a record of the seminar and its conclusions if published

8 Create and Maintain a Clearinghouse on Research and Policy Sources Relevant to Pakistan Discussion with

both researchers and policy-makers indicates that there iscurrently an institutional deficiency in handling the volume of pertinent research results and making them available toresearchers and policy-makers DPRU should create a populationresearch clearinghouse to fill this void While this taskhas lesser priority than the preceeding ones it is neverthelessimportant to the overall improvement of population research utilization in Pakistan

The clearinghouse would maintain a file on three different kinds of information relevent to policy-making and research ie a) published works b) sources of data and c) names and addresses of individuals who have expertise in relevant fields

The clearinghouse should begin modestly and draw heavily on existing sources It should engage in the following activities

a Create a taxonomy for classifying published works (and expertise) The taxonomy should include policy variables (ie independent variables) measures of fertility and other outcomes (ie dependent variables) methodology data source and location of study A good place to start is to study the classification used by McGreevey in The Policy Relevance of Recent Social Research on Fertility Smithsonian Institute Occasional Monograph Series Number two

b Develop a biblicgraphy of pertinent works and classify existing research In doing these full use should be made of existing indexes such as those published by USAID TREC PIDE NRIFC and FPAP Each item of potential use to Pakistani researchers and policy-makers should be identified classified and summarized briefly A suitable technology for rimning the clearinghouse is the McBee key sort edge punched card system The particulars of the item are recorded in the body of the card and the classifications are recorded by notches in the edge of the card A needle is used on the pack of cards to outsort those which satisfy a particular inquiry for items subsumed under certain specified categories Each card should indicate where to find the document

c DPRU should keep an inventory of what data is available and where and how it can be accessed hbis will be used to answer iquiries by both reseachers and policy-makers who have a need for data

d Another edged punched card system should be set up to classify individuals both in Pakistan and elsewhere who have expertise on elevant topics The taxonomy discussed above would be the basis for classification An ideal use of the expert file would occur when a policyshymaker contacted DPRU in order to obtain advice on a topic of interest In addition to published works DPRU would suggest an expert or two in the area whose knowledge and opinion on the topic could be requested

9 Edit and Publish a Newsletter This is the lowest priority activity for DPRU however consideration should be given to publishing a newsletter containing concise articles on new research findings other items of interest and where and how to send for publication It would be distributed to

- 12 shy

the mailing list discussed above Its primary advantage is tokeep the reader aware of population problems research-based solutions and DPRU

_C Organization and Job Specifications

DPRU will be headed by a deputy director who reports directly to the Director (DPRC) and the Joint Secretary The -

Director initially will be supported by a communication specialist and a research analyst

1 Director The Deputy Director should be a person whois known and respected by the key policy-makers at PPC thePlanning Commission and the Ministries of Government Heshould have access to them for informal discussion as well asformal presentation He should be very familiar with thepopulation program in Pakistan If possible he should also befamiliar with current population research and research methodsbut this is a secondary requirement

The Director will be primary presentor at the briefings andat the stearing committee meetings He should also be active inthe workshops and seminars especially when high-level policyshymakers are involved His continuing responsibility is tolobby or implementation of research findings with policy-makersand to keep himself appraised of their concerns in the populationplanning area He should also maintain contact with organizationssuch as the Family Planning Association of Pakistan It is likelythat if some of the potentially useful findings of that organizashytion are mediated through DPRU the chances for adoption or adaptation will be improved

Under the supervision of the Director of DPRU are twospecialists--a communirtion specialist and a research analystwho must work together closely to accomplish the units tasks

2 Communication Specialist The person should have studiedjournalism and hopefully should have some experience in writingand reporting on scientific or technological activities Theability to write well and to present ideas clearly is critical to the functioning of the role

Primary responsibilities are to write executive summariesusing analysis prepared by the research analyst prepare briefshyings write news releases maintain mailing list create theinstitutional inventory participate in workshops preparepresentation for steering committee and edit and publish thenewsletter

13 shy

Research st This person should have experiencein research and researflchethodology Ideally this experience would be in population or related areas The individual need not be an accomplished researcher (although this is desirable)but should be able to converse with researchers on technical topics critique research studies from a methodological pointof -view summarize research findings and to relate them to other existing research

Primary responsiblities are to maintain liaison with researchers acquire completed research and to analyze research for its essential findings The role includes primary responsibishylity for maintaining the clearinghouse This person will also contribute to the other activities of the unit

D Time Phasing for the Installation of DPRU

Initially there will be little new coming research for DPRU to review and communicate During the development and transition to a steady state it is suggested that DPRU proceedin the following manner

The first task for DPRU will be to identify and assess the state of the art in population research in Pakistan This should be available at the first meeting of the steering commitshytee The assessment will serve as the basis for creating the clearinghouse Simultaneously the mailing list should be developed In addition to their substantive contributions the construction of the mailing list and the clearinghouse will force DPRU to become familiar with level of research and the researchers themselves currently active in Pakistan and also with the policy-makers with whom they are to communicate Early on a research problem identification workshop should be held

As research results become available DPRUs mode of activity shifts to the preparation of executive summaries briefings and workshops Then the clearing house and the mailing list are maintained When these activities are well underway the newsletter and institutional inventory can be considered

M Technical Assistance Required

The amount and character of further USAID technical assisshytance required to insure the DPRU has adequate capacity to fulfii its assigned tasks will depend largely on the talents and skills Df the 3 people it employs Since it is likely that all requisiteabilities will not be available some technical assistamcewill undoubtedly be required Potential requirements are specified below

- 14 shy

1 A consultant on the communication of scientific findingsto policy-makers for the period of approximately one monthPossible sources of the required expertise are policy orientedassociations such as TheConference Board media organizationssuch as Scientific American Science or Business Week and otherGovernment agencies The consultant would hold training sessionsfor the personnel and walk them through an application

2 A one or two-week course on preparing visual presentashytions and graphs to be used in the briefing and in the executivesummaries At the beginning this should concentrate on effecshytive use of overhead projectors and transparencies

3 The creation of the clearinghouse will require thesupport of a two-person team One person who is expert in thecurrent state-of-the-art in population research who will aid indivising the taxonomy and one person who is expert in classifishycation systems and information storage and retrieval using manualtechnologies who will aid in setting up the system and developingprocedures for running it This person will likely be found at a library school This will require about one month each

4 The creation of the institutional inventory may benefitfrom at least two weeks of the services of an anthropologistsociologist andor a political scientist who is familiar with Pakistan

5 The editing and publishing of the newsletter may benefitfrom the consultation of a successful newsletter editor in the USMajor problems are audience identification preparing copy layoutand pasting-up original forms for publication

6 These recommedations assume that adequate printing andreproduction facilities are available If not some additional support will be required in this area

F Other USAID Items of Concern

1 USAID Personnel should participate to the extent possishyble politically to insure that the Director of DPRU has the stature and talent required

2 USAID personnel should encourage the formation and periodic meetings of the steering committee-

G People interviewed

USAID

I Dr Steven W Sinding 2William R McIntyre 3 Marvin A Schwartz 4 Thomas R Mahoney

- 15 shy

5 Dr Andrew P Haynal 6 David Oot 7 Ruth S Plunkett 8 Hugh S Plunkett

POaulation Planning Council(PPC)

1 Mr M Alauddin Joint Secretary 2 Dr Wiqar Zaidi Director DPARC 3 Dr Makhdoom Ali Shah Director of Implementation

Planning Commission

1 Javid Hamid Chief of Economic Research 2 Jawaid Azfar Chief of Population Research

PIDE (Pakistan Institute of Development Economics)

1 M L Qureshi Director 2 Mohammad Afzal Chief of Population Section 3 Dr Steven Guisinger Economist 4 Dr Dennis DeTray EconomistDemographer

Family Planning Association of Pakistan 1 Mrs Surayya Jabeen Senior Director for Liaison

with Government and International Agenciesshy

2 Mr Naseer Chaudhry Assistant Director Field Operations

3 Mr Sabir Shah Field Representative

Note - FPAP arranged field trips to two familyplanning centers operated by the Pakistan Railway and to a village in the Shadab Pilot Project area where the family planning projectis integrated into the Integrated Rural Developshyment program These trips resulted in discusshysions with many participants including the President of the Peoples Welfare Society in the Shadab village

Training Research Evaluation Centre (TREC)

1 Mr Nizamuddin Deputy Director Social Research

Continus Motivation System (CMS)

1 Mrs Eatram -bullDistrict Population Planningliofficer Rawalpindi

- 16 o

Other Researchers

1 Mr Mahmood Roshan PhD Candidate (in dissertation)School of Public Health University of California Berkeley

Other Interested Parties

1 Dr John C -Cool Director of Ford Foundation in Pakistan

Private Firm Researchers 1 Mr Owais Akhlaq and Owais AdvertisingandMarket

Research

b Current Research on the Problem-- a summaryof research completed or undertaken duringthe year and its major findings

C DPRU Programs -- a summary of activities undertaken by DPRU to relate the research to policy-makers

d Utilization -- a summary of instances whereresearch results were used in setting populashytion policy or in devising new programs Specishyfic research results need not have been adoptedas is or even adapted to a particular problemahowever to qualify as utilization there shouldbe some evidence that the policy-maker actuallyreceived the research findings evaluated themand actively considered them in the process of making policy

2 Prepare Executive Summaries of Completed Research DPRUwill be responsible for preparing an Executive Summary for eachcompleted research project The length of these summaries will vary with the content of the project howeverit is expected thatthe summaries will generally be about 2-8 pages in length Theyshould rarely exceed 25 pages The primary audience for theseExecutive Summaries is the policy-makers who make and influencepopulation and family planning decisions in Pakistan

The general outline of each Summary should be as follows

a One or two paragraphs (no more than one pagemaximum) describing the background and purposesof the research

b A list of the principal findings

c A list of the policy implications of the findings

d A discussion of the results of the research as theyrelate to policy This will include a discussion of the assumptions and conditions under which policyimpacts or recommendations are appropriate Thediscussions should also include an assessment of the adequacy of the data used in research theresearch design and the methods of analysis as theypertain to the validity of the policy implicationsA discussion of related research and its findings(including agreements and differences) should beincluded where appropriate

In general these Executive Summaries should meet the requireshyments of good journalism They should be concise readable simpleclear and closely related to the policy concerns of the audience

-7

Where possible graphs tables and other visuals should be employed Since the graphs and tables contained in many research reports are too detailed and busy DPRU often will have to redraw and simplify them so that the key points are better communicated to the audience

Executive Summaries will constitute series number one of the DPRU publications In the beginning of the program simple offshyset reproduction printing methods should be used A standard front cover should be used for t1eseries which clearly identishyfies that this is an Executive Summary and that DPRU is the source The last page of the Summary should inform the reader on how to acquire a copy of the complete research monograph and on the availability of other Summaries and Monographs

Executive Summaries should be prepared (required) for every project completed under the Population Grants Program and where possible for any other research project of potential use to policy-makers

3 Prepare Briefings on Completed Research The written word by iEself is not the most effective form of communication Dialogue discussion and personal involvement increase the degree of communication Consequently the Executive Summaries should be used to develop short briefings for policy-makers These briefings should be 15-20 minutes in length and should make use of visual displays An overhead projector with transparencies should be used most frequently but very important items might be prepared on large charts

Most of the briefings will be delivered to groups of 3-4 people but consideration should be given to the possibility of delivering the briefing to a single influencial person or to a group of say 25 In any event the briefing session should be scheuled so that ample time is available during each session for questions and discussions on the report The person presenting the briefing should be prepared with topics for discussion concerning the report and where possible and proper should engage people in discussion

A briefin i should always be scheduled for the Planning Commission and for the Population Planning Council Attempts should be made to brief the Minister of Health and other Minisshytries if possible As many other interested organizations and influencial parties as possible should also be briefed

In developing this program the DPRU should review the Audio-Visual Projects effort undeviay at the Family Plannng Association of Pakistan (Lahore) and other policy oriented audiovisual programs in Pakistan

--

8shy

4 Prepare and Distribute News releases Studies of policyshymakers in the United States find that they acquire most of theirscientific information from the newspapers Moreover personalexperience in working with US Congressional staffs and otherstaff members for influencial decision makers reveals that theyread news releases before they read many other materials Thereare several reasons for this News releases are short andgenerally well writtqp they focus on only the key points ofinterest they are timely and they reveal what the sourceorganization thinks is important Thus the news release itself becomes a communication medium

Using the Executive Sunmaries as background news releasesshould be prepared for completed research whenever the qualityis adequate They should be distributed to policy-makersand their staffs as well as to the press Special results mightwarrant a full-blown press conference One advantage of a pubshylished news item is that it raises the public consciousness aswell as that of the leaders

5 Maintain a Mailing List DPRU should develop and mainshytain a mailing list of people in population planning policy inPakistan This would include the names and addresses ofinfluential policy-makers and researchers with regard to populashytion problems in Pakistan It should be organized by institutionGovernment Industry Association University etc The listwill be used to send out items of interest to appropriate parties

DPRU can begin to constructthis list by drawing on existinglists For example FPAP has a list of 25000 to 35000 peoplewhich representatives indicated it would be willing to share

6 Create an Institutional Inventory In any social systempolicy is carried out via its institutions They are the bases upon which attitudes are formed and instrumentalities throughwhich resources are mobilized and allocated When they acceptan innovation the likelihood of adoption is increased When theyreject one they constitute a formidable barrier

Consequently DPRU should identify and record as much of theinstitutional structure of Pakistan as possible This recordshould include the institution its leadership its location andthe number of people affected by it (employees participants etc)

The inventory will include governments state provincialdistrict tehsil union council industry unions religiouisleaders newspapers universities associations etc Only thelargest and most important need be identified at the start butthe inventory should be expanded over the years Among the uses of the inventory are the following

a A basis for assessing social impactof populationpolicy recommendation

b A source for personnel to be included in the mailing list

c A source of sites for pilot and demonstration projects (and if necessary for experimental purposes for control sites)

7 Conduct Workshops and Seminars In a personalisticculture such as Pakistan face-to-face communication is imporshyotant Workshops and Seminars are one method by which this form of communication can be promoted DPRU should conduct workshopsof two types

a Problem Identification A quick review of some of the existing research and discussion with policy-makers suggests that much of the current research is tangentialto the central concerns of policy-makers The purpose of a problems identification workshop is to bring policyshymakers and researchers together in a format in which policyshymakers can indicate their needs and in which researchers can suggest possible projects for securing information consisshytent with these needs The ideal project should be both policy relevant and scientifically sound Sometimes these criteria are in conflict especially given limited budgets and short decision times Consequently one of the functions of the problem identification workshop is to reach comproshymises where these conflicts occur

A model for such a workshop is as follows

1 DPRU identifies one or two broad areas of policy relevance (eg education of women use of incentives value of children)

2 A leading policy-maker is asked to preside over ther workshop and to present some of his or herviews on the problem as a keynote on the topics

3 About five policy-makers or research users in the topicarea and five resear-hers plus a few other interested parties (eg representatives of Donor agencies) are invited to the workshop

4 The keynote is presented followed by a series of discussions on subtopics during which users relate their needs and researchers discuss the researchability of the topicsOf particular importance is a discussion of data availabilityThe chairman of the session seeks to secure some consensus of the nature of the problem and some acceptable research strateshygies As an option he may attempt to assign priorities to the possible research topics

10

5 The workshop is recorded (or a good scribe is employed)Following the workshop DPRU prepares a short report describingthe workshop and its key findings In completing the reportDPRU may want to contact participants for clarification andaugmentation of the ideas presented in the meeting The reportis distributed to both policy-makers and researchers These reports can be especially effective if they servc as the basis upon which research grants are made

b Seminars on Research Findings In addition tothe briefings described above it is often useful to holdseminars in which both policy-makers and researchers explorethe implications and possible utility of completed researchprojects The seminar should be designed to assess the strengthsand weaknesses of the research in terms of its internal and external validity and its relevance for policy making

A model for such a seminar is as follows

1) DPRU Identifies about 10 or 15 reseachers and policyshymakers with interest in the completed research and invites them to the seminar

2) a researcher (other than the whoone did the research)-is selected and starts off the seminar by presenting a summaryof the project This is followed by a critique -

3) a policy-maker reviews the researchandpresents an evaluation from a policy-making perspective

4) the researcher comments on the two preceeding presen- tations

5) the seminar is opened to general discussion

6) toward the end of the seminar the chairman attempts toreach agreement on action steps that might proceed on the basisof the results and on topics for further research

7) a record of the seminar and its conclusions if published

8 Create and Maintain a Clearinghouse on Research and Policy Sources Relevant to Pakistan Discussion with

both researchers and policy-makers indicates that there iscurrently an institutional deficiency in handling the volume of pertinent research results and making them available toresearchers and policy-makers DPRU should create a populationresearch clearinghouse to fill this void While this taskhas lesser priority than the preceeding ones it is neverthelessimportant to the overall improvement of population research utilization in Pakistan

The clearinghouse would maintain a file on three different kinds of information relevent to policy-making and research ie a) published works b) sources of data and c) names and addresses of individuals who have expertise in relevant fields

The clearinghouse should begin modestly and draw heavily on existing sources It should engage in the following activities

a Create a taxonomy for classifying published works (and expertise) The taxonomy should include policy variables (ie independent variables) measures of fertility and other outcomes (ie dependent variables) methodology data source and location of study A good place to start is to study the classification used by McGreevey in The Policy Relevance of Recent Social Research on Fertility Smithsonian Institute Occasional Monograph Series Number two

b Develop a biblicgraphy of pertinent works and classify existing research In doing these full use should be made of existing indexes such as those published by USAID TREC PIDE NRIFC and FPAP Each item of potential use to Pakistani researchers and policy-makers should be identified classified and summarized briefly A suitable technology for rimning the clearinghouse is the McBee key sort edge punched card system The particulars of the item are recorded in the body of the card and the classifications are recorded by notches in the edge of the card A needle is used on the pack of cards to outsort those which satisfy a particular inquiry for items subsumed under certain specified categories Each card should indicate where to find the document

c DPRU should keep an inventory of what data is available and where and how it can be accessed hbis will be used to answer iquiries by both reseachers and policy-makers who have a need for data

d Another edged punched card system should be set up to classify individuals both in Pakistan and elsewhere who have expertise on elevant topics The taxonomy discussed above would be the basis for classification An ideal use of the expert file would occur when a policyshymaker contacted DPRU in order to obtain advice on a topic of interest In addition to published works DPRU would suggest an expert or two in the area whose knowledge and opinion on the topic could be requested

9 Edit and Publish a Newsletter This is the lowest priority activity for DPRU however consideration should be given to publishing a newsletter containing concise articles on new research findings other items of interest and where and how to send for publication It would be distributed to

- 12 shy

the mailing list discussed above Its primary advantage is tokeep the reader aware of population problems research-based solutions and DPRU

_C Organization and Job Specifications

DPRU will be headed by a deputy director who reports directly to the Director (DPRC) and the Joint Secretary The -

Director initially will be supported by a communication specialist and a research analyst

1 Director The Deputy Director should be a person whois known and respected by the key policy-makers at PPC thePlanning Commission and the Ministries of Government Heshould have access to them for informal discussion as well asformal presentation He should be very familiar with thepopulation program in Pakistan If possible he should also befamiliar with current population research and research methodsbut this is a secondary requirement

The Director will be primary presentor at the briefings andat the stearing committee meetings He should also be active inthe workshops and seminars especially when high-level policyshymakers are involved His continuing responsibility is tolobby or implementation of research findings with policy-makersand to keep himself appraised of their concerns in the populationplanning area He should also maintain contact with organizationssuch as the Family Planning Association of Pakistan It is likelythat if some of the potentially useful findings of that organizashytion are mediated through DPRU the chances for adoption or adaptation will be improved

Under the supervision of the Director of DPRU are twospecialists--a communirtion specialist and a research analystwho must work together closely to accomplish the units tasks

2 Communication Specialist The person should have studiedjournalism and hopefully should have some experience in writingand reporting on scientific or technological activities Theability to write well and to present ideas clearly is critical to the functioning of the role

Primary responsibilities are to write executive summariesusing analysis prepared by the research analyst prepare briefshyings write news releases maintain mailing list create theinstitutional inventory participate in workshops preparepresentation for steering committee and edit and publish thenewsletter

13 shy

Research st This person should have experiencein research and researflchethodology Ideally this experience would be in population or related areas The individual need not be an accomplished researcher (although this is desirable)but should be able to converse with researchers on technical topics critique research studies from a methodological pointof -view summarize research findings and to relate them to other existing research

Primary responsiblities are to maintain liaison with researchers acquire completed research and to analyze research for its essential findings The role includes primary responsibishylity for maintaining the clearinghouse This person will also contribute to the other activities of the unit

D Time Phasing for the Installation of DPRU

Initially there will be little new coming research for DPRU to review and communicate During the development and transition to a steady state it is suggested that DPRU proceedin the following manner

The first task for DPRU will be to identify and assess the state of the art in population research in Pakistan This should be available at the first meeting of the steering commitshytee The assessment will serve as the basis for creating the clearinghouse Simultaneously the mailing list should be developed In addition to their substantive contributions the construction of the mailing list and the clearinghouse will force DPRU to become familiar with level of research and the researchers themselves currently active in Pakistan and also with the policy-makers with whom they are to communicate Early on a research problem identification workshop should be held

As research results become available DPRUs mode of activity shifts to the preparation of executive summaries briefings and workshops Then the clearing house and the mailing list are maintained When these activities are well underway the newsletter and institutional inventory can be considered

M Technical Assistance Required

The amount and character of further USAID technical assisshytance required to insure the DPRU has adequate capacity to fulfii its assigned tasks will depend largely on the talents and skills Df the 3 people it employs Since it is likely that all requisiteabilities will not be available some technical assistamcewill undoubtedly be required Potential requirements are specified below

- 14 shy

1 A consultant on the communication of scientific findingsto policy-makers for the period of approximately one monthPossible sources of the required expertise are policy orientedassociations such as TheConference Board media organizationssuch as Scientific American Science or Business Week and otherGovernment agencies The consultant would hold training sessionsfor the personnel and walk them through an application

2 A one or two-week course on preparing visual presentashytions and graphs to be used in the briefing and in the executivesummaries At the beginning this should concentrate on effecshytive use of overhead projectors and transparencies

3 The creation of the clearinghouse will require thesupport of a two-person team One person who is expert in thecurrent state-of-the-art in population research who will aid indivising the taxonomy and one person who is expert in classifishycation systems and information storage and retrieval using manualtechnologies who will aid in setting up the system and developingprocedures for running it This person will likely be found at a library school This will require about one month each

4 The creation of the institutional inventory may benefitfrom at least two weeks of the services of an anthropologistsociologist andor a political scientist who is familiar with Pakistan

5 The editing and publishing of the newsletter may benefitfrom the consultation of a successful newsletter editor in the USMajor problems are audience identification preparing copy layoutand pasting-up original forms for publication

6 These recommedations assume that adequate printing andreproduction facilities are available If not some additional support will be required in this area

F Other USAID Items of Concern

1 USAID Personnel should participate to the extent possishyble politically to insure that the Director of DPRU has the stature and talent required

2 USAID personnel should encourage the formation and periodic meetings of the steering committee-

G People interviewed

USAID

I Dr Steven W Sinding 2William R McIntyre 3 Marvin A Schwartz 4 Thomas R Mahoney

- 15 shy

5 Dr Andrew P Haynal 6 David Oot 7 Ruth S Plunkett 8 Hugh S Plunkett

POaulation Planning Council(PPC)

1 Mr M Alauddin Joint Secretary 2 Dr Wiqar Zaidi Director DPARC 3 Dr Makhdoom Ali Shah Director of Implementation

Planning Commission

1 Javid Hamid Chief of Economic Research 2 Jawaid Azfar Chief of Population Research

PIDE (Pakistan Institute of Development Economics)

1 M L Qureshi Director 2 Mohammad Afzal Chief of Population Section 3 Dr Steven Guisinger Economist 4 Dr Dennis DeTray EconomistDemographer

Family Planning Association of Pakistan 1 Mrs Surayya Jabeen Senior Director for Liaison

with Government and International Agenciesshy

2 Mr Naseer Chaudhry Assistant Director Field Operations

3 Mr Sabir Shah Field Representative

Note - FPAP arranged field trips to two familyplanning centers operated by the Pakistan Railway and to a village in the Shadab Pilot Project area where the family planning projectis integrated into the Integrated Rural Developshyment program These trips resulted in discusshysions with many participants including the President of the Peoples Welfare Society in the Shadab village

Training Research Evaluation Centre (TREC)

1 Mr Nizamuddin Deputy Director Social Research

Continus Motivation System (CMS)

1 Mrs Eatram -bullDistrict Population Planningliofficer Rawalpindi

- 16 o

Other Researchers

1 Mr Mahmood Roshan PhD Candidate (in dissertation)School of Public Health University of California Berkeley

Other Interested Parties

1 Dr John C -Cool Director of Ford Foundation in Pakistan

Private Firm Researchers 1 Mr Owais Akhlaq and Owais AdvertisingandMarket

Research

-7

Where possible graphs tables and other visuals should be employed Since the graphs and tables contained in many research reports are too detailed and busy DPRU often will have to redraw and simplify them so that the key points are better communicated to the audience

Executive Summaries will constitute series number one of the DPRU publications In the beginning of the program simple offshyset reproduction printing methods should be used A standard front cover should be used for t1eseries which clearly identishyfies that this is an Executive Summary and that DPRU is the source The last page of the Summary should inform the reader on how to acquire a copy of the complete research monograph and on the availability of other Summaries and Monographs

Executive Summaries should be prepared (required) for every project completed under the Population Grants Program and where possible for any other research project of potential use to policy-makers

3 Prepare Briefings on Completed Research The written word by iEself is not the most effective form of communication Dialogue discussion and personal involvement increase the degree of communication Consequently the Executive Summaries should be used to develop short briefings for policy-makers These briefings should be 15-20 minutes in length and should make use of visual displays An overhead projector with transparencies should be used most frequently but very important items might be prepared on large charts

Most of the briefings will be delivered to groups of 3-4 people but consideration should be given to the possibility of delivering the briefing to a single influencial person or to a group of say 25 In any event the briefing session should be scheuled so that ample time is available during each session for questions and discussions on the report The person presenting the briefing should be prepared with topics for discussion concerning the report and where possible and proper should engage people in discussion

A briefin i should always be scheduled for the Planning Commission and for the Population Planning Council Attempts should be made to brief the Minister of Health and other Minisshytries if possible As many other interested organizations and influencial parties as possible should also be briefed

In developing this program the DPRU should review the Audio-Visual Projects effort undeviay at the Family Plannng Association of Pakistan (Lahore) and other policy oriented audiovisual programs in Pakistan

--

8shy

4 Prepare and Distribute News releases Studies of policyshymakers in the United States find that they acquire most of theirscientific information from the newspapers Moreover personalexperience in working with US Congressional staffs and otherstaff members for influencial decision makers reveals that theyread news releases before they read many other materials Thereare several reasons for this News releases are short andgenerally well writtqp they focus on only the key points ofinterest they are timely and they reveal what the sourceorganization thinks is important Thus the news release itself becomes a communication medium

Using the Executive Sunmaries as background news releasesshould be prepared for completed research whenever the qualityis adequate They should be distributed to policy-makersand their staffs as well as to the press Special results mightwarrant a full-blown press conference One advantage of a pubshylished news item is that it raises the public consciousness aswell as that of the leaders

5 Maintain a Mailing List DPRU should develop and mainshytain a mailing list of people in population planning policy inPakistan This would include the names and addresses ofinfluential policy-makers and researchers with regard to populashytion problems in Pakistan It should be organized by institutionGovernment Industry Association University etc The listwill be used to send out items of interest to appropriate parties

DPRU can begin to constructthis list by drawing on existinglists For example FPAP has a list of 25000 to 35000 peoplewhich representatives indicated it would be willing to share

6 Create an Institutional Inventory In any social systempolicy is carried out via its institutions They are the bases upon which attitudes are formed and instrumentalities throughwhich resources are mobilized and allocated When they acceptan innovation the likelihood of adoption is increased When theyreject one they constitute a formidable barrier

Consequently DPRU should identify and record as much of theinstitutional structure of Pakistan as possible This recordshould include the institution its leadership its location andthe number of people affected by it (employees participants etc)

The inventory will include governments state provincialdistrict tehsil union council industry unions religiouisleaders newspapers universities associations etc Only thelargest and most important need be identified at the start butthe inventory should be expanded over the years Among the uses of the inventory are the following

a A basis for assessing social impactof populationpolicy recommendation

b A source for personnel to be included in the mailing list

c A source of sites for pilot and demonstration projects (and if necessary for experimental purposes for control sites)

7 Conduct Workshops and Seminars In a personalisticculture such as Pakistan face-to-face communication is imporshyotant Workshops and Seminars are one method by which this form of communication can be promoted DPRU should conduct workshopsof two types

a Problem Identification A quick review of some of the existing research and discussion with policy-makers suggests that much of the current research is tangentialto the central concerns of policy-makers The purpose of a problems identification workshop is to bring policyshymakers and researchers together in a format in which policyshymakers can indicate their needs and in which researchers can suggest possible projects for securing information consisshytent with these needs The ideal project should be both policy relevant and scientifically sound Sometimes these criteria are in conflict especially given limited budgets and short decision times Consequently one of the functions of the problem identification workshop is to reach comproshymises where these conflicts occur

A model for such a workshop is as follows

1 DPRU identifies one or two broad areas of policy relevance (eg education of women use of incentives value of children)

2 A leading policy-maker is asked to preside over ther workshop and to present some of his or herviews on the problem as a keynote on the topics

3 About five policy-makers or research users in the topicarea and five resear-hers plus a few other interested parties (eg representatives of Donor agencies) are invited to the workshop

4 The keynote is presented followed by a series of discussions on subtopics during which users relate their needs and researchers discuss the researchability of the topicsOf particular importance is a discussion of data availabilityThe chairman of the session seeks to secure some consensus of the nature of the problem and some acceptable research strateshygies As an option he may attempt to assign priorities to the possible research topics

10

5 The workshop is recorded (or a good scribe is employed)Following the workshop DPRU prepares a short report describingthe workshop and its key findings In completing the reportDPRU may want to contact participants for clarification andaugmentation of the ideas presented in the meeting The reportis distributed to both policy-makers and researchers These reports can be especially effective if they servc as the basis upon which research grants are made

b Seminars on Research Findings In addition tothe briefings described above it is often useful to holdseminars in which both policy-makers and researchers explorethe implications and possible utility of completed researchprojects The seminar should be designed to assess the strengthsand weaknesses of the research in terms of its internal and external validity and its relevance for policy making

A model for such a seminar is as follows

1) DPRU Identifies about 10 or 15 reseachers and policyshymakers with interest in the completed research and invites them to the seminar

2) a researcher (other than the whoone did the research)-is selected and starts off the seminar by presenting a summaryof the project This is followed by a critique -

3) a policy-maker reviews the researchandpresents an evaluation from a policy-making perspective

4) the researcher comments on the two preceeding presen- tations

5) the seminar is opened to general discussion

6) toward the end of the seminar the chairman attempts toreach agreement on action steps that might proceed on the basisof the results and on topics for further research

7) a record of the seminar and its conclusions if published

8 Create and Maintain a Clearinghouse on Research and Policy Sources Relevant to Pakistan Discussion with

both researchers and policy-makers indicates that there iscurrently an institutional deficiency in handling the volume of pertinent research results and making them available toresearchers and policy-makers DPRU should create a populationresearch clearinghouse to fill this void While this taskhas lesser priority than the preceeding ones it is neverthelessimportant to the overall improvement of population research utilization in Pakistan

The clearinghouse would maintain a file on three different kinds of information relevent to policy-making and research ie a) published works b) sources of data and c) names and addresses of individuals who have expertise in relevant fields

The clearinghouse should begin modestly and draw heavily on existing sources It should engage in the following activities

a Create a taxonomy for classifying published works (and expertise) The taxonomy should include policy variables (ie independent variables) measures of fertility and other outcomes (ie dependent variables) methodology data source and location of study A good place to start is to study the classification used by McGreevey in The Policy Relevance of Recent Social Research on Fertility Smithsonian Institute Occasional Monograph Series Number two

b Develop a biblicgraphy of pertinent works and classify existing research In doing these full use should be made of existing indexes such as those published by USAID TREC PIDE NRIFC and FPAP Each item of potential use to Pakistani researchers and policy-makers should be identified classified and summarized briefly A suitable technology for rimning the clearinghouse is the McBee key sort edge punched card system The particulars of the item are recorded in the body of the card and the classifications are recorded by notches in the edge of the card A needle is used on the pack of cards to outsort those which satisfy a particular inquiry for items subsumed under certain specified categories Each card should indicate where to find the document

c DPRU should keep an inventory of what data is available and where and how it can be accessed hbis will be used to answer iquiries by both reseachers and policy-makers who have a need for data

d Another edged punched card system should be set up to classify individuals both in Pakistan and elsewhere who have expertise on elevant topics The taxonomy discussed above would be the basis for classification An ideal use of the expert file would occur when a policyshymaker contacted DPRU in order to obtain advice on a topic of interest In addition to published works DPRU would suggest an expert or two in the area whose knowledge and opinion on the topic could be requested

9 Edit and Publish a Newsletter This is the lowest priority activity for DPRU however consideration should be given to publishing a newsletter containing concise articles on new research findings other items of interest and where and how to send for publication It would be distributed to

- 12 shy

the mailing list discussed above Its primary advantage is tokeep the reader aware of population problems research-based solutions and DPRU

_C Organization and Job Specifications

DPRU will be headed by a deputy director who reports directly to the Director (DPRC) and the Joint Secretary The -

Director initially will be supported by a communication specialist and a research analyst

1 Director The Deputy Director should be a person whois known and respected by the key policy-makers at PPC thePlanning Commission and the Ministries of Government Heshould have access to them for informal discussion as well asformal presentation He should be very familiar with thepopulation program in Pakistan If possible he should also befamiliar with current population research and research methodsbut this is a secondary requirement

The Director will be primary presentor at the briefings andat the stearing committee meetings He should also be active inthe workshops and seminars especially when high-level policyshymakers are involved His continuing responsibility is tolobby or implementation of research findings with policy-makersand to keep himself appraised of their concerns in the populationplanning area He should also maintain contact with organizationssuch as the Family Planning Association of Pakistan It is likelythat if some of the potentially useful findings of that organizashytion are mediated through DPRU the chances for adoption or adaptation will be improved

Under the supervision of the Director of DPRU are twospecialists--a communirtion specialist and a research analystwho must work together closely to accomplish the units tasks

2 Communication Specialist The person should have studiedjournalism and hopefully should have some experience in writingand reporting on scientific or technological activities Theability to write well and to present ideas clearly is critical to the functioning of the role

Primary responsibilities are to write executive summariesusing analysis prepared by the research analyst prepare briefshyings write news releases maintain mailing list create theinstitutional inventory participate in workshops preparepresentation for steering committee and edit and publish thenewsletter

13 shy

Research st This person should have experiencein research and researflchethodology Ideally this experience would be in population or related areas The individual need not be an accomplished researcher (although this is desirable)but should be able to converse with researchers on technical topics critique research studies from a methodological pointof -view summarize research findings and to relate them to other existing research

Primary responsiblities are to maintain liaison with researchers acquire completed research and to analyze research for its essential findings The role includes primary responsibishylity for maintaining the clearinghouse This person will also contribute to the other activities of the unit

D Time Phasing for the Installation of DPRU

Initially there will be little new coming research for DPRU to review and communicate During the development and transition to a steady state it is suggested that DPRU proceedin the following manner

The first task for DPRU will be to identify and assess the state of the art in population research in Pakistan This should be available at the first meeting of the steering commitshytee The assessment will serve as the basis for creating the clearinghouse Simultaneously the mailing list should be developed In addition to their substantive contributions the construction of the mailing list and the clearinghouse will force DPRU to become familiar with level of research and the researchers themselves currently active in Pakistan and also with the policy-makers with whom they are to communicate Early on a research problem identification workshop should be held

As research results become available DPRUs mode of activity shifts to the preparation of executive summaries briefings and workshops Then the clearing house and the mailing list are maintained When these activities are well underway the newsletter and institutional inventory can be considered

M Technical Assistance Required

The amount and character of further USAID technical assisshytance required to insure the DPRU has adequate capacity to fulfii its assigned tasks will depend largely on the talents and skills Df the 3 people it employs Since it is likely that all requisiteabilities will not be available some technical assistamcewill undoubtedly be required Potential requirements are specified below

- 14 shy

1 A consultant on the communication of scientific findingsto policy-makers for the period of approximately one monthPossible sources of the required expertise are policy orientedassociations such as TheConference Board media organizationssuch as Scientific American Science or Business Week and otherGovernment agencies The consultant would hold training sessionsfor the personnel and walk them through an application

2 A one or two-week course on preparing visual presentashytions and graphs to be used in the briefing and in the executivesummaries At the beginning this should concentrate on effecshytive use of overhead projectors and transparencies

3 The creation of the clearinghouse will require thesupport of a two-person team One person who is expert in thecurrent state-of-the-art in population research who will aid indivising the taxonomy and one person who is expert in classifishycation systems and information storage and retrieval using manualtechnologies who will aid in setting up the system and developingprocedures for running it This person will likely be found at a library school This will require about one month each

4 The creation of the institutional inventory may benefitfrom at least two weeks of the services of an anthropologistsociologist andor a political scientist who is familiar with Pakistan

5 The editing and publishing of the newsletter may benefitfrom the consultation of a successful newsletter editor in the USMajor problems are audience identification preparing copy layoutand pasting-up original forms for publication

6 These recommedations assume that adequate printing andreproduction facilities are available If not some additional support will be required in this area

F Other USAID Items of Concern

1 USAID Personnel should participate to the extent possishyble politically to insure that the Director of DPRU has the stature and talent required

2 USAID personnel should encourage the formation and periodic meetings of the steering committee-

G People interviewed

USAID

I Dr Steven W Sinding 2William R McIntyre 3 Marvin A Schwartz 4 Thomas R Mahoney

- 15 shy

5 Dr Andrew P Haynal 6 David Oot 7 Ruth S Plunkett 8 Hugh S Plunkett

POaulation Planning Council(PPC)

1 Mr M Alauddin Joint Secretary 2 Dr Wiqar Zaidi Director DPARC 3 Dr Makhdoom Ali Shah Director of Implementation

Planning Commission

1 Javid Hamid Chief of Economic Research 2 Jawaid Azfar Chief of Population Research

PIDE (Pakistan Institute of Development Economics)

1 M L Qureshi Director 2 Mohammad Afzal Chief of Population Section 3 Dr Steven Guisinger Economist 4 Dr Dennis DeTray EconomistDemographer

Family Planning Association of Pakistan 1 Mrs Surayya Jabeen Senior Director for Liaison

with Government and International Agenciesshy

2 Mr Naseer Chaudhry Assistant Director Field Operations

3 Mr Sabir Shah Field Representative

Note - FPAP arranged field trips to two familyplanning centers operated by the Pakistan Railway and to a village in the Shadab Pilot Project area where the family planning projectis integrated into the Integrated Rural Developshyment program These trips resulted in discusshysions with many participants including the President of the Peoples Welfare Society in the Shadab village

Training Research Evaluation Centre (TREC)

1 Mr Nizamuddin Deputy Director Social Research

Continus Motivation System (CMS)

1 Mrs Eatram -bullDistrict Population Planningliofficer Rawalpindi

- 16 o

Other Researchers

1 Mr Mahmood Roshan PhD Candidate (in dissertation)School of Public Health University of California Berkeley

Other Interested Parties

1 Dr John C -Cool Director of Ford Foundation in Pakistan

Private Firm Researchers 1 Mr Owais Akhlaq and Owais AdvertisingandMarket

Research

--

8shy

4 Prepare and Distribute News releases Studies of policyshymakers in the United States find that they acquire most of theirscientific information from the newspapers Moreover personalexperience in working with US Congressional staffs and otherstaff members for influencial decision makers reveals that theyread news releases before they read many other materials Thereare several reasons for this News releases are short andgenerally well writtqp they focus on only the key points ofinterest they are timely and they reveal what the sourceorganization thinks is important Thus the news release itself becomes a communication medium

Using the Executive Sunmaries as background news releasesshould be prepared for completed research whenever the qualityis adequate They should be distributed to policy-makersand their staffs as well as to the press Special results mightwarrant a full-blown press conference One advantage of a pubshylished news item is that it raises the public consciousness aswell as that of the leaders

5 Maintain a Mailing List DPRU should develop and mainshytain a mailing list of people in population planning policy inPakistan This would include the names and addresses ofinfluential policy-makers and researchers with regard to populashytion problems in Pakistan It should be organized by institutionGovernment Industry Association University etc The listwill be used to send out items of interest to appropriate parties

DPRU can begin to constructthis list by drawing on existinglists For example FPAP has a list of 25000 to 35000 peoplewhich representatives indicated it would be willing to share

6 Create an Institutional Inventory In any social systempolicy is carried out via its institutions They are the bases upon which attitudes are formed and instrumentalities throughwhich resources are mobilized and allocated When they acceptan innovation the likelihood of adoption is increased When theyreject one they constitute a formidable barrier

Consequently DPRU should identify and record as much of theinstitutional structure of Pakistan as possible This recordshould include the institution its leadership its location andthe number of people affected by it (employees participants etc)

The inventory will include governments state provincialdistrict tehsil union council industry unions religiouisleaders newspapers universities associations etc Only thelargest and most important need be identified at the start butthe inventory should be expanded over the years Among the uses of the inventory are the following

a A basis for assessing social impactof populationpolicy recommendation

b A source for personnel to be included in the mailing list

c A source of sites for pilot and demonstration projects (and if necessary for experimental purposes for control sites)

7 Conduct Workshops and Seminars In a personalisticculture such as Pakistan face-to-face communication is imporshyotant Workshops and Seminars are one method by which this form of communication can be promoted DPRU should conduct workshopsof two types

a Problem Identification A quick review of some of the existing research and discussion with policy-makers suggests that much of the current research is tangentialto the central concerns of policy-makers The purpose of a problems identification workshop is to bring policyshymakers and researchers together in a format in which policyshymakers can indicate their needs and in which researchers can suggest possible projects for securing information consisshytent with these needs The ideal project should be both policy relevant and scientifically sound Sometimes these criteria are in conflict especially given limited budgets and short decision times Consequently one of the functions of the problem identification workshop is to reach comproshymises where these conflicts occur

A model for such a workshop is as follows

1 DPRU identifies one or two broad areas of policy relevance (eg education of women use of incentives value of children)

2 A leading policy-maker is asked to preside over ther workshop and to present some of his or herviews on the problem as a keynote on the topics

3 About five policy-makers or research users in the topicarea and five resear-hers plus a few other interested parties (eg representatives of Donor agencies) are invited to the workshop

4 The keynote is presented followed by a series of discussions on subtopics during which users relate their needs and researchers discuss the researchability of the topicsOf particular importance is a discussion of data availabilityThe chairman of the session seeks to secure some consensus of the nature of the problem and some acceptable research strateshygies As an option he may attempt to assign priorities to the possible research topics

10

5 The workshop is recorded (or a good scribe is employed)Following the workshop DPRU prepares a short report describingthe workshop and its key findings In completing the reportDPRU may want to contact participants for clarification andaugmentation of the ideas presented in the meeting The reportis distributed to both policy-makers and researchers These reports can be especially effective if they servc as the basis upon which research grants are made

b Seminars on Research Findings In addition tothe briefings described above it is often useful to holdseminars in which both policy-makers and researchers explorethe implications and possible utility of completed researchprojects The seminar should be designed to assess the strengthsand weaknesses of the research in terms of its internal and external validity and its relevance for policy making

A model for such a seminar is as follows

1) DPRU Identifies about 10 or 15 reseachers and policyshymakers with interest in the completed research and invites them to the seminar

2) a researcher (other than the whoone did the research)-is selected and starts off the seminar by presenting a summaryof the project This is followed by a critique -

3) a policy-maker reviews the researchandpresents an evaluation from a policy-making perspective

4) the researcher comments on the two preceeding presen- tations

5) the seminar is opened to general discussion

6) toward the end of the seminar the chairman attempts toreach agreement on action steps that might proceed on the basisof the results and on topics for further research

7) a record of the seminar and its conclusions if published

8 Create and Maintain a Clearinghouse on Research and Policy Sources Relevant to Pakistan Discussion with

both researchers and policy-makers indicates that there iscurrently an institutional deficiency in handling the volume of pertinent research results and making them available toresearchers and policy-makers DPRU should create a populationresearch clearinghouse to fill this void While this taskhas lesser priority than the preceeding ones it is neverthelessimportant to the overall improvement of population research utilization in Pakistan

The clearinghouse would maintain a file on three different kinds of information relevent to policy-making and research ie a) published works b) sources of data and c) names and addresses of individuals who have expertise in relevant fields

The clearinghouse should begin modestly and draw heavily on existing sources It should engage in the following activities

a Create a taxonomy for classifying published works (and expertise) The taxonomy should include policy variables (ie independent variables) measures of fertility and other outcomes (ie dependent variables) methodology data source and location of study A good place to start is to study the classification used by McGreevey in The Policy Relevance of Recent Social Research on Fertility Smithsonian Institute Occasional Monograph Series Number two

b Develop a biblicgraphy of pertinent works and classify existing research In doing these full use should be made of existing indexes such as those published by USAID TREC PIDE NRIFC and FPAP Each item of potential use to Pakistani researchers and policy-makers should be identified classified and summarized briefly A suitable technology for rimning the clearinghouse is the McBee key sort edge punched card system The particulars of the item are recorded in the body of the card and the classifications are recorded by notches in the edge of the card A needle is used on the pack of cards to outsort those which satisfy a particular inquiry for items subsumed under certain specified categories Each card should indicate where to find the document

c DPRU should keep an inventory of what data is available and where and how it can be accessed hbis will be used to answer iquiries by both reseachers and policy-makers who have a need for data

d Another edged punched card system should be set up to classify individuals both in Pakistan and elsewhere who have expertise on elevant topics The taxonomy discussed above would be the basis for classification An ideal use of the expert file would occur when a policyshymaker contacted DPRU in order to obtain advice on a topic of interest In addition to published works DPRU would suggest an expert or two in the area whose knowledge and opinion on the topic could be requested

9 Edit and Publish a Newsletter This is the lowest priority activity for DPRU however consideration should be given to publishing a newsletter containing concise articles on new research findings other items of interest and where and how to send for publication It would be distributed to

- 12 shy

the mailing list discussed above Its primary advantage is tokeep the reader aware of population problems research-based solutions and DPRU

_C Organization and Job Specifications

DPRU will be headed by a deputy director who reports directly to the Director (DPRC) and the Joint Secretary The -

Director initially will be supported by a communication specialist and a research analyst

1 Director The Deputy Director should be a person whois known and respected by the key policy-makers at PPC thePlanning Commission and the Ministries of Government Heshould have access to them for informal discussion as well asformal presentation He should be very familiar with thepopulation program in Pakistan If possible he should also befamiliar with current population research and research methodsbut this is a secondary requirement

The Director will be primary presentor at the briefings andat the stearing committee meetings He should also be active inthe workshops and seminars especially when high-level policyshymakers are involved His continuing responsibility is tolobby or implementation of research findings with policy-makersand to keep himself appraised of their concerns in the populationplanning area He should also maintain contact with organizationssuch as the Family Planning Association of Pakistan It is likelythat if some of the potentially useful findings of that organizashytion are mediated through DPRU the chances for adoption or adaptation will be improved

Under the supervision of the Director of DPRU are twospecialists--a communirtion specialist and a research analystwho must work together closely to accomplish the units tasks

2 Communication Specialist The person should have studiedjournalism and hopefully should have some experience in writingand reporting on scientific or technological activities Theability to write well and to present ideas clearly is critical to the functioning of the role

Primary responsibilities are to write executive summariesusing analysis prepared by the research analyst prepare briefshyings write news releases maintain mailing list create theinstitutional inventory participate in workshops preparepresentation for steering committee and edit and publish thenewsletter

13 shy

Research st This person should have experiencein research and researflchethodology Ideally this experience would be in population or related areas The individual need not be an accomplished researcher (although this is desirable)but should be able to converse with researchers on technical topics critique research studies from a methodological pointof -view summarize research findings and to relate them to other existing research

Primary responsiblities are to maintain liaison with researchers acquire completed research and to analyze research for its essential findings The role includes primary responsibishylity for maintaining the clearinghouse This person will also contribute to the other activities of the unit

D Time Phasing for the Installation of DPRU

Initially there will be little new coming research for DPRU to review and communicate During the development and transition to a steady state it is suggested that DPRU proceedin the following manner

The first task for DPRU will be to identify and assess the state of the art in population research in Pakistan This should be available at the first meeting of the steering commitshytee The assessment will serve as the basis for creating the clearinghouse Simultaneously the mailing list should be developed In addition to their substantive contributions the construction of the mailing list and the clearinghouse will force DPRU to become familiar with level of research and the researchers themselves currently active in Pakistan and also with the policy-makers with whom they are to communicate Early on a research problem identification workshop should be held

As research results become available DPRUs mode of activity shifts to the preparation of executive summaries briefings and workshops Then the clearing house and the mailing list are maintained When these activities are well underway the newsletter and institutional inventory can be considered

M Technical Assistance Required

The amount and character of further USAID technical assisshytance required to insure the DPRU has adequate capacity to fulfii its assigned tasks will depend largely on the talents and skills Df the 3 people it employs Since it is likely that all requisiteabilities will not be available some technical assistamcewill undoubtedly be required Potential requirements are specified below

- 14 shy

1 A consultant on the communication of scientific findingsto policy-makers for the period of approximately one monthPossible sources of the required expertise are policy orientedassociations such as TheConference Board media organizationssuch as Scientific American Science or Business Week and otherGovernment agencies The consultant would hold training sessionsfor the personnel and walk them through an application

2 A one or two-week course on preparing visual presentashytions and graphs to be used in the briefing and in the executivesummaries At the beginning this should concentrate on effecshytive use of overhead projectors and transparencies

3 The creation of the clearinghouse will require thesupport of a two-person team One person who is expert in thecurrent state-of-the-art in population research who will aid indivising the taxonomy and one person who is expert in classifishycation systems and information storage and retrieval using manualtechnologies who will aid in setting up the system and developingprocedures for running it This person will likely be found at a library school This will require about one month each

4 The creation of the institutional inventory may benefitfrom at least two weeks of the services of an anthropologistsociologist andor a political scientist who is familiar with Pakistan

5 The editing and publishing of the newsletter may benefitfrom the consultation of a successful newsletter editor in the USMajor problems are audience identification preparing copy layoutand pasting-up original forms for publication

6 These recommedations assume that adequate printing andreproduction facilities are available If not some additional support will be required in this area

F Other USAID Items of Concern

1 USAID Personnel should participate to the extent possishyble politically to insure that the Director of DPRU has the stature and talent required

2 USAID personnel should encourage the formation and periodic meetings of the steering committee-

G People interviewed

USAID

I Dr Steven W Sinding 2William R McIntyre 3 Marvin A Schwartz 4 Thomas R Mahoney

- 15 shy

5 Dr Andrew P Haynal 6 David Oot 7 Ruth S Plunkett 8 Hugh S Plunkett

POaulation Planning Council(PPC)

1 Mr M Alauddin Joint Secretary 2 Dr Wiqar Zaidi Director DPARC 3 Dr Makhdoom Ali Shah Director of Implementation

Planning Commission

1 Javid Hamid Chief of Economic Research 2 Jawaid Azfar Chief of Population Research

PIDE (Pakistan Institute of Development Economics)

1 M L Qureshi Director 2 Mohammad Afzal Chief of Population Section 3 Dr Steven Guisinger Economist 4 Dr Dennis DeTray EconomistDemographer

Family Planning Association of Pakistan 1 Mrs Surayya Jabeen Senior Director for Liaison

with Government and International Agenciesshy

2 Mr Naseer Chaudhry Assistant Director Field Operations

3 Mr Sabir Shah Field Representative

Note - FPAP arranged field trips to two familyplanning centers operated by the Pakistan Railway and to a village in the Shadab Pilot Project area where the family planning projectis integrated into the Integrated Rural Developshyment program These trips resulted in discusshysions with many participants including the President of the Peoples Welfare Society in the Shadab village

Training Research Evaluation Centre (TREC)

1 Mr Nizamuddin Deputy Director Social Research

Continus Motivation System (CMS)

1 Mrs Eatram -bullDistrict Population Planningliofficer Rawalpindi

- 16 o

Other Researchers

1 Mr Mahmood Roshan PhD Candidate (in dissertation)School of Public Health University of California Berkeley

Other Interested Parties

1 Dr John C -Cool Director of Ford Foundation in Pakistan

Private Firm Researchers 1 Mr Owais Akhlaq and Owais AdvertisingandMarket

Research

a A basis for assessing social impactof populationpolicy recommendation

b A source for personnel to be included in the mailing list

c A source of sites for pilot and demonstration projects (and if necessary for experimental purposes for control sites)

7 Conduct Workshops and Seminars In a personalisticculture such as Pakistan face-to-face communication is imporshyotant Workshops and Seminars are one method by which this form of communication can be promoted DPRU should conduct workshopsof two types

a Problem Identification A quick review of some of the existing research and discussion with policy-makers suggests that much of the current research is tangentialto the central concerns of policy-makers The purpose of a problems identification workshop is to bring policyshymakers and researchers together in a format in which policyshymakers can indicate their needs and in which researchers can suggest possible projects for securing information consisshytent with these needs The ideal project should be both policy relevant and scientifically sound Sometimes these criteria are in conflict especially given limited budgets and short decision times Consequently one of the functions of the problem identification workshop is to reach comproshymises where these conflicts occur

A model for such a workshop is as follows

1 DPRU identifies one or two broad areas of policy relevance (eg education of women use of incentives value of children)

2 A leading policy-maker is asked to preside over ther workshop and to present some of his or herviews on the problem as a keynote on the topics

3 About five policy-makers or research users in the topicarea and five resear-hers plus a few other interested parties (eg representatives of Donor agencies) are invited to the workshop

4 The keynote is presented followed by a series of discussions on subtopics during which users relate their needs and researchers discuss the researchability of the topicsOf particular importance is a discussion of data availabilityThe chairman of the session seeks to secure some consensus of the nature of the problem and some acceptable research strateshygies As an option he may attempt to assign priorities to the possible research topics

10

5 The workshop is recorded (or a good scribe is employed)Following the workshop DPRU prepares a short report describingthe workshop and its key findings In completing the reportDPRU may want to contact participants for clarification andaugmentation of the ideas presented in the meeting The reportis distributed to both policy-makers and researchers These reports can be especially effective if they servc as the basis upon which research grants are made

b Seminars on Research Findings In addition tothe briefings described above it is often useful to holdseminars in which both policy-makers and researchers explorethe implications and possible utility of completed researchprojects The seminar should be designed to assess the strengthsand weaknesses of the research in terms of its internal and external validity and its relevance for policy making

A model for such a seminar is as follows

1) DPRU Identifies about 10 or 15 reseachers and policyshymakers with interest in the completed research and invites them to the seminar

2) a researcher (other than the whoone did the research)-is selected and starts off the seminar by presenting a summaryof the project This is followed by a critique -

3) a policy-maker reviews the researchandpresents an evaluation from a policy-making perspective

4) the researcher comments on the two preceeding presen- tations

5) the seminar is opened to general discussion

6) toward the end of the seminar the chairman attempts toreach agreement on action steps that might proceed on the basisof the results and on topics for further research

7) a record of the seminar and its conclusions if published

8 Create and Maintain a Clearinghouse on Research and Policy Sources Relevant to Pakistan Discussion with

both researchers and policy-makers indicates that there iscurrently an institutional deficiency in handling the volume of pertinent research results and making them available toresearchers and policy-makers DPRU should create a populationresearch clearinghouse to fill this void While this taskhas lesser priority than the preceeding ones it is neverthelessimportant to the overall improvement of population research utilization in Pakistan

The clearinghouse would maintain a file on three different kinds of information relevent to policy-making and research ie a) published works b) sources of data and c) names and addresses of individuals who have expertise in relevant fields

The clearinghouse should begin modestly and draw heavily on existing sources It should engage in the following activities

a Create a taxonomy for classifying published works (and expertise) The taxonomy should include policy variables (ie independent variables) measures of fertility and other outcomes (ie dependent variables) methodology data source and location of study A good place to start is to study the classification used by McGreevey in The Policy Relevance of Recent Social Research on Fertility Smithsonian Institute Occasional Monograph Series Number two

b Develop a biblicgraphy of pertinent works and classify existing research In doing these full use should be made of existing indexes such as those published by USAID TREC PIDE NRIFC and FPAP Each item of potential use to Pakistani researchers and policy-makers should be identified classified and summarized briefly A suitable technology for rimning the clearinghouse is the McBee key sort edge punched card system The particulars of the item are recorded in the body of the card and the classifications are recorded by notches in the edge of the card A needle is used on the pack of cards to outsort those which satisfy a particular inquiry for items subsumed under certain specified categories Each card should indicate where to find the document

c DPRU should keep an inventory of what data is available and where and how it can be accessed hbis will be used to answer iquiries by both reseachers and policy-makers who have a need for data

d Another edged punched card system should be set up to classify individuals both in Pakistan and elsewhere who have expertise on elevant topics The taxonomy discussed above would be the basis for classification An ideal use of the expert file would occur when a policyshymaker contacted DPRU in order to obtain advice on a topic of interest In addition to published works DPRU would suggest an expert or two in the area whose knowledge and opinion on the topic could be requested

9 Edit and Publish a Newsletter This is the lowest priority activity for DPRU however consideration should be given to publishing a newsletter containing concise articles on new research findings other items of interest and where and how to send for publication It would be distributed to

- 12 shy

the mailing list discussed above Its primary advantage is tokeep the reader aware of population problems research-based solutions and DPRU

_C Organization and Job Specifications

DPRU will be headed by a deputy director who reports directly to the Director (DPRC) and the Joint Secretary The -

Director initially will be supported by a communication specialist and a research analyst

1 Director The Deputy Director should be a person whois known and respected by the key policy-makers at PPC thePlanning Commission and the Ministries of Government Heshould have access to them for informal discussion as well asformal presentation He should be very familiar with thepopulation program in Pakistan If possible he should also befamiliar with current population research and research methodsbut this is a secondary requirement

The Director will be primary presentor at the briefings andat the stearing committee meetings He should also be active inthe workshops and seminars especially when high-level policyshymakers are involved His continuing responsibility is tolobby or implementation of research findings with policy-makersand to keep himself appraised of their concerns in the populationplanning area He should also maintain contact with organizationssuch as the Family Planning Association of Pakistan It is likelythat if some of the potentially useful findings of that organizashytion are mediated through DPRU the chances for adoption or adaptation will be improved

Under the supervision of the Director of DPRU are twospecialists--a communirtion specialist and a research analystwho must work together closely to accomplish the units tasks

2 Communication Specialist The person should have studiedjournalism and hopefully should have some experience in writingand reporting on scientific or technological activities Theability to write well and to present ideas clearly is critical to the functioning of the role

Primary responsibilities are to write executive summariesusing analysis prepared by the research analyst prepare briefshyings write news releases maintain mailing list create theinstitutional inventory participate in workshops preparepresentation for steering committee and edit and publish thenewsletter

13 shy

Research st This person should have experiencein research and researflchethodology Ideally this experience would be in population or related areas The individual need not be an accomplished researcher (although this is desirable)but should be able to converse with researchers on technical topics critique research studies from a methodological pointof -view summarize research findings and to relate them to other existing research

Primary responsiblities are to maintain liaison with researchers acquire completed research and to analyze research for its essential findings The role includes primary responsibishylity for maintaining the clearinghouse This person will also contribute to the other activities of the unit

D Time Phasing for the Installation of DPRU

Initially there will be little new coming research for DPRU to review and communicate During the development and transition to a steady state it is suggested that DPRU proceedin the following manner

The first task for DPRU will be to identify and assess the state of the art in population research in Pakistan This should be available at the first meeting of the steering commitshytee The assessment will serve as the basis for creating the clearinghouse Simultaneously the mailing list should be developed In addition to their substantive contributions the construction of the mailing list and the clearinghouse will force DPRU to become familiar with level of research and the researchers themselves currently active in Pakistan and also with the policy-makers with whom they are to communicate Early on a research problem identification workshop should be held

As research results become available DPRUs mode of activity shifts to the preparation of executive summaries briefings and workshops Then the clearing house and the mailing list are maintained When these activities are well underway the newsletter and institutional inventory can be considered

M Technical Assistance Required

The amount and character of further USAID technical assisshytance required to insure the DPRU has adequate capacity to fulfii its assigned tasks will depend largely on the talents and skills Df the 3 people it employs Since it is likely that all requisiteabilities will not be available some technical assistamcewill undoubtedly be required Potential requirements are specified below

- 14 shy

1 A consultant on the communication of scientific findingsto policy-makers for the period of approximately one monthPossible sources of the required expertise are policy orientedassociations such as TheConference Board media organizationssuch as Scientific American Science or Business Week and otherGovernment agencies The consultant would hold training sessionsfor the personnel and walk them through an application

2 A one or two-week course on preparing visual presentashytions and graphs to be used in the briefing and in the executivesummaries At the beginning this should concentrate on effecshytive use of overhead projectors and transparencies

3 The creation of the clearinghouse will require thesupport of a two-person team One person who is expert in thecurrent state-of-the-art in population research who will aid indivising the taxonomy and one person who is expert in classifishycation systems and information storage and retrieval using manualtechnologies who will aid in setting up the system and developingprocedures for running it This person will likely be found at a library school This will require about one month each

4 The creation of the institutional inventory may benefitfrom at least two weeks of the services of an anthropologistsociologist andor a political scientist who is familiar with Pakistan

5 The editing and publishing of the newsletter may benefitfrom the consultation of a successful newsletter editor in the USMajor problems are audience identification preparing copy layoutand pasting-up original forms for publication

6 These recommedations assume that adequate printing andreproduction facilities are available If not some additional support will be required in this area

F Other USAID Items of Concern

1 USAID Personnel should participate to the extent possishyble politically to insure that the Director of DPRU has the stature and talent required

2 USAID personnel should encourage the formation and periodic meetings of the steering committee-

G People interviewed

USAID

I Dr Steven W Sinding 2William R McIntyre 3 Marvin A Schwartz 4 Thomas R Mahoney

- 15 shy

5 Dr Andrew P Haynal 6 David Oot 7 Ruth S Plunkett 8 Hugh S Plunkett

POaulation Planning Council(PPC)

1 Mr M Alauddin Joint Secretary 2 Dr Wiqar Zaidi Director DPARC 3 Dr Makhdoom Ali Shah Director of Implementation

Planning Commission

1 Javid Hamid Chief of Economic Research 2 Jawaid Azfar Chief of Population Research

PIDE (Pakistan Institute of Development Economics)

1 M L Qureshi Director 2 Mohammad Afzal Chief of Population Section 3 Dr Steven Guisinger Economist 4 Dr Dennis DeTray EconomistDemographer

Family Planning Association of Pakistan 1 Mrs Surayya Jabeen Senior Director for Liaison

with Government and International Agenciesshy

2 Mr Naseer Chaudhry Assistant Director Field Operations

3 Mr Sabir Shah Field Representative

Note - FPAP arranged field trips to two familyplanning centers operated by the Pakistan Railway and to a village in the Shadab Pilot Project area where the family planning projectis integrated into the Integrated Rural Developshyment program These trips resulted in discusshysions with many participants including the President of the Peoples Welfare Society in the Shadab village

Training Research Evaluation Centre (TREC)

1 Mr Nizamuddin Deputy Director Social Research

Continus Motivation System (CMS)

1 Mrs Eatram -bullDistrict Population Planningliofficer Rawalpindi

- 16 o

Other Researchers

1 Mr Mahmood Roshan PhD Candidate (in dissertation)School of Public Health University of California Berkeley

Other Interested Parties

1 Dr John C -Cool Director of Ford Foundation in Pakistan

Private Firm Researchers 1 Mr Owais Akhlaq and Owais AdvertisingandMarket

Research

10

5 The workshop is recorded (or a good scribe is employed)Following the workshop DPRU prepares a short report describingthe workshop and its key findings In completing the reportDPRU may want to contact participants for clarification andaugmentation of the ideas presented in the meeting The reportis distributed to both policy-makers and researchers These reports can be especially effective if they servc as the basis upon which research grants are made

b Seminars on Research Findings In addition tothe briefings described above it is often useful to holdseminars in which both policy-makers and researchers explorethe implications and possible utility of completed researchprojects The seminar should be designed to assess the strengthsand weaknesses of the research in terms of its internal and external validity and its relevance for policy making

A model for such a seminar is as follows

1) DPRU Identifies about 10 or 15 reseachers and policyshymakers with interest in the completed research and invites them to the seminar

2) a researcher (other than the whoone did the research)-is selected and starts off the seminar by presenting a summaryof the project This is followed by a critique -

3) a policy-maker reviews the researchandpresents an evaluation from a policy-making perspective

4) the researcher comments on the two preceeding presen- tations

5) the seminar is opened to general discussion

6) toward the end of the seminar the chairman attempts toreach agreement on action steps that might proceed on the basisof the results and on topics for further research

7) a record of the seminar and its conclusions if published

8 Create and Maintain a Clearinghouse on Research and Policy Sources Relevant to Pakistan Discussion with

both researchers and policy-makers indicates that there iscurrently an institutional deficiency in handling the volume of pertinent research results and making them available toresearchers and policy-makers DPRU should create a populationresearch clearinghouse to fill this void While this taskhas lesser priority than the preceeding ones it is neverthelessimportant to the overall improvement of population research utilization in Pakistan

The clearinghouse would maintain a file on three different kinds of information relevent to policy-making and research ie a) published works b) sources of data and c) names and addresses of individuals who have expertise in relevant fields

The clearinghouse should begin modestly and draw heavily on existing sources It should engage in the following activities

a Create a taxonomy for classifying published works (and expertise) The taxonomy should include policy variables (ie independent variables) measures of fertility and other outcomes (ie dependent variables) methodology data source and location of study A good place to start is to study the classification used by McGreevey in The Policy Relevance of Recent Social Research on Fertility Smithsonian Institute Occasional Monograph Series Number two

b Develop a biblicgraphy of pertinent works and classify existing research In doing these full use should be made of existing indexes such as those published by USAID TREC PIDE NRIFC and FPAP Each item of potential use to Pakistani researchers and policy-makers should be identified classified and summarized briefly A suitable technology for rimning the clearinghouse is the McBee key sort edge punched card system The particulars of the item are recorded in the body of the card and the classifications are recorded by notches in the edge of the card A needle is used on the pack of cards to outsort those which satisfy a particular inquiry for items subsumed under certain specified categories Each card should indicate where to find the document

c DPRU should keep an inventory of what data is available and where and how it can be accessed hbis will be used to answer iquiries by both reseachers and policy-makers who have a need for data

d Another edged punched card system should be set up to classify individuals both in Pakistan and elsewhere who have expertise on elevant topics The taxonomy discussed above would be the basis for classification An ideal use of the expert file would occur when a policyshymaker contacted DPRU in order to obtain advice on a topic of interest In addition to published works DPRU would suggest an expert or two in the area whose knowledge and opinion on the topic could be requested

9 Edit and Publish a Newsletter This is the lowest priority activity for DPRU however consideration should be given to publishing a newsletter containing concise articles on new research findings other items of interest and where and how to send for publication It would be distributed to

- 12 shy

the mailing list discussed above Its primary advantage is tokeep the reader aware of population problems research-based solutions and DPRU

_C Organization and Job Specifications

DPRU will be headed by a deputy director who reports directly to the Director (DPRC) and the Joint Secretary The -

Director initially will be supported by a communication specialist and a research analyst

1 Director The Deputy Director should be a person whois known and respected by the key policy-makers at PPC thePlanning Commission and the Ministries of Government Heshould have access to them for informal discussion as well asformal presentation He should be very familiar with thepopulation program in Pakistan If possible he should also befamiliar with current population research and research methodsbut this is a secondary requirement

The Director will be primary presentor at the briefings andat the stearing committee meetings He should also be active inthe workshops and seminars especially when high-level policyshymakers are involved His continuing responsibility is tolobby or implementation of research findings with policy-makersand to keep himself appraised of their concerns in the populationplanning area He should also maintain contact with organizationssuch as the Family Planning Association of Pakistan It is likelythat if some of the potentially useful findings of that organizashytion are mediated through DPRU the chances for adoption or adaptation will be improved

Under the supervision of the Director of DPRU are twospecialists--a communirtion specialist and a research analystwho must work together closely to accomplish the units tasks

2 Communication Specialist The person should have studiedjournalism and hopefully should have some experience in writingand reporting on scientific or technological activities Theability to write well and to present ideas clearly is critical to the functioning of the role

Primary responsibilities are to write executive summariesusing analysis prepared by the research analyst prepare briefshyings write news releases maintain mailing list create theinstitutional inventory participate in workshops preparepresentation for steering committee and edit and publish thenewsletter

13 shy

Research st This person should have experiencein research and researflchethodology Ideally this experience would be in population or related areas The individual need not be an accomplished researcher (although this is desirable)but should be able to converse with researchers on technical topics critique research studies from a methodological pointof -view summarize research findings and to relate them to other existing research

Primary responsiblities are to maintain liaison with researchers acquire completed research and to analyze research for its essential findings The role includes primary responsibishylity for maintaining the clearinghouse This person will also contribute to the other activities of the unit

D Time Phasing for the Installation of DPRU

Initially there will be little new coming research for DPRU to review and communicate During the development and transition to a steady state it is suggested that DPRU proceedin the following manner

The first task for DPRU will be to identify and assess the state of the art in population research in Pakistan This should be available at the first meeting of the steering commitshytee The assessment will serve as the basis for creating the clearinghouse Simultaneously the mailing list should be developed In addition to their substantive contributions the construction of the mailing list and the clearinghouse will force DPRU to become familiar with level of research and the researchers themselves currently active in Pakistan and also with the policy-makers with whom they are to communicate Early on a research problem identification workshop should be held

As research results become available DPRUs mode of activity shifts to the preparation of executive summaries briefings and workshops Then the clearing house and the mailing list are maintained When these activities are well underway the newsletter and institutional inventory can be considered

M Technical Assistance Required

The amount and character of further USAID technical assisshytance required to insure the DPRU has adequate capacity to fulfii its assigned tasks will depend largely on the talents and skills Df the 3 people it employs Since it is likely that all requisiteabilities will not be available some technical assistamcewill undoubtedly be required Potential requirements are specified below

- 14 shy

1 A consultant on the communication of scientific findingsto policy-makers for the period of approximately one monthPossible sources of the required expertise are policy orientedassociations such as TheConference Board media organizationssuch as Scientific American Science or Business Week and otherGovernment agencies The consultant would hold training sessionsfor the personnel and walk them through an application

2 A one or two-week course on preparing visual presentashytions and graphs to be used in the briefing and in the executivesummaries At the beginning this should concentrate on effecshytive use of overhead projectors and transparencies

3 The creation of the clearinghouse will require thesupport of a two-person team One person who is expert in thecurrent state-of-the-art in population research who will aid indivising the taxonomy and one person who is expert in classifishycation systems and information storage and retrieval using manualtechnologies who will aid in setting up the system and developingprocedures for running it This person will likely be found at a library school This will require about one month each

4 The creation of the institutional inventory may benefitfrom at least two weeks of the services of an anthropologistsociologist andor a political scientist who is familiar with Pakistan

5 The editing and publishing of the newsletter may benefitfrom the consultation of a successful newsletter editor in the USMajor problems are audience identification preparing copy layoutand pasting-up original forms for publication

6 These recommedations assume that adequate printing andreproduction facilities are available If not some additional support will be required in this area

F Other USAID Items of Concern

1 USAID Personnel should participate to the extent possishyble politically to insure that the Director of DPRU has the stature and talent required

2 USAID personnel should encourage the formation and periodic meetings of the steering committee-

G People interviewed

USAID

I Dr Steven W Sinding 2William R McIntyre 3 Marvin A Schwartz 4 Thomas R Mahoney

- 15 shy

5 Dr Andrew P Haynal 6 David Oot 7 Ruth S Plunkett 8 Hugh S Plunkett

POaulation Planning Council(PPC)

1 Mr M Alauddin Joint Secretary 2 Dr Wiqar Zaidi Director DPARC 3 Dr Makhdoom Ali Shah Director of Implementation

Planning Commission

1 Javid Hamid Chief of Economic Research 2 Jawaid Azfar Chief of Population Research

PIDE (Pakistan Institute of Development Economics)

1 M L Qureshi Director 2 Mohammad Afzal Chief of Population Section 3 Dr Steven Guisinger Economist 4 Dr Dennis DeTray EconomistDemographer

Family Planning Association of Pakistan 1 Mrs Surayya Jabeen Senior Director for Liaison

with Government and International Agenciesshy

2 Mr Naseer Chaudhry Assistant Director Field Operations

3 Mr Sabir Shah Field Representative

Note - FPAP arranged field trips to two familyplanning centers operated by the Pakistan Railway and to a village in the Shadab Pilot Project area where the family planning projectis integrated into the Integrated Rural Developshyment program These trips resulted in discusshysions with many participants including the President of the Peoples Welfare Society in the Shadab village

Training Research Evaluation Centre (TREC)

1 Mr Nizamuddin Deputy Director Social Research

Continus Motivation System (CMS)

1 Mrs Eatram -bullDistrict Population Planningliofficer Rawalpindi

- 16 o

Other Researchers

1 Mr Mahmood Roshan PhD Candidate (in dissertation)School of Public Health University of California Berkeley

Other Interested Parties

1 Dr John C -Cool Director of Ford Foundation in Pakistan

Private Firm Researchers 1 Mr Owais Akhlaq and Owais AdvertisingandMarket

Research

The clearinghouse would maintain a file on three different kinds of information relevent to policy-making and research ie a) published works b) sources of data and c) names and addresses of individuals who have expertise in relevant fields

The clearinghouse should begin modestly and draw heavily on existing sources It should engage in the following activities

a Create a taxonomy for classifying published works (and expertise) The taxonomy should include policy variables (ie independent variables) measures of fertility and other outcomes (ie dependent variables) methodology data source and location of study A good place to start is to study the classification used by McGreevey in The Policy Relevance of Recent Social Research on Fertility Smithsonian Institute Occasional Monograph Series Number two

b Develop a biblicgraphy of pertinent works and classify existing research In doing these full use should be made of existing indexes such as those published by USAID TREC PIDE NRIFC and FPAP Each item of potential use to Pakistani researchers and policy-makers should be identified classified and summarized briefly A suitable technology for rimning the clearinghouse is the McBee key sort edge punched card system The particulars of the item are recorded in the body of the card and the classifications are recorded by notches in the edge of the card A needle is used on the pack of cards to outsort those which satisfy a particular inquiry for items subsumed under certain specified categories Each card should indicate where to find the document

c DPRU should keep an inventory of what data is available and where and how it can be accessed hbis will be used to answer iquiries by both reseachers and policy-makers who have a need for data

d Another edged punched card system should be set up to classify individuals both in Pakistan and elsewhere who have expertise on elevant topics The taxonomy discussed above would be the basis for classification An ideal use of the expert file would occur when a policyshymaker contacted DPRU in order to obtain advice on a topic of interest In addition to published works DPRU would suggest an expert or two in the area whose knowledge and opinion on the topic could be requested

9 Edit and Publish a Newsletter This is the lowest priority activity for DPRU however consideration should be given to publishing a newsletter containing concise articles on new research findings other items of interest and where and how to send for publication It would be distributed to

- 12 shy

the mailing list discussed above Its primary advantage is tokeep the reader aware of population problems research-based solutions and DPRU

_C Organization and Job Specifications

DPRU will be headed by a deputy director who reports directly to the Director (DPRC) and the Joint Secretary The -

Director initially will be supported by a communication specialist and a research analyst

1 Director The Deputy Director should be a person whois known and respected by the key policy-makers at PPC thePlanning Commission and the Ministries of Government Heshould have access to them for informal discussion as well asformal presentation He should be very familiar with thepopulation program in Pakistan If possible he should also befamiliar with current population research and research methodsbut this is a secondary requirement

The Director will be primary presentor at the briefings andat the stearing committee meetings He should also be active inthe workshops and seminars especially when high-level policyshymakers are involved His continuing responsibility is tolobby or implementation of research findings with policy-makersand to keep himself appraised of their concerns in the populationplanning area He should also maintain contact with organizationssuch as the Family Planning Association of Pakistan It is likelythat if some of the potentially useful findings of that organizashytion are mediated through DPRU the chances for adoption or adaptation will be improved

Under the supervision of the Director of DPRU are twospecialists--a communirtion specialist and a research analystwho must work together closely to accomplish the units tasks

2 Communication Specialist The person should have studiedjournalism and hopefully should have some experience in writingand reporting on scientific or technological activities Theability to write well and to present ideas clearly is critical to the functioning of the role

Primary responsibilities are to write executive summariesusing analysis prepared by the research analyst prepare briefshyings write news releases maintain mailing list create theinstitutional inventory participate in workshops preparepresentation for steering committee and edit and publish thenewsletter

13 shy

Research st This person should have experiencein research and researflchethodology Ideally this experience would be in population or related areas The individual need not be an accomplished researcher (although this is desirable)but should be able to converse with researchers on technical topics critique research studies from a methodological pointof -view summarize research findings and to relate them to other existing research

Primary responsiblities are to maintain liaison with researchers acquire completed research and to analyze research for its essential findings The role includes primary responsibishylity for maintaining the clearinghouse This person will also contribute to the other activities of the unit

D Time Phasing for the Installation of DPRU

Initially there will be little new coming research for DPRU to review and communicate During the development and transition to a steady state it is suggested that DPRU proceedin the following manner

The first task for DPRU will be to identify and assess the state of the art in population research in Pakistan This should be available at the first meeting of the steering commitshytee The assessment will serve as the basis for creating the clearinghouse Simultaneously the mailing list should be developed In addition to their substantive contributions the construction of the mailing list and the clearinghouse will force DPRU to become familiar with level of research and the researchers themselves currently active in Pakistan and also with the policy-makers with whom they are to communicate Early on a research problem identification workshop should be held

As research results become available DPRUs mode of activity shifts to the preparation of executive summaries briefings and workshops Then the clearing house and the mailing list are maintained When these activities are well underway the newsletter and institutional inventory can be considered

M Technical Assistance Required

The amount and character of further USAID technical assisshytance required to insure the DPRU has adequate capacity to fulfii its assigned tasks will depend largely on the talents and skills Df the 3 people it employs Since it is likely that all requisiteabilities will not be available some technical assistamcewill undoubtedly be required Potential requirements are specified below

- 14 shy

1 A consultant on the communication of scientific findingsto policy-makers for the period of approximately one monthPossible sources of the required expertise are policy orientedassociations such as TheConference Board media organizationssuch as Scientific American Science or Business Week and otherGovernment agencies The consultant would hold training sessionsfor the personnel and walk them through an application

2 A one or two-week course on preparing visual presentashytions and graphs to be used in the briefing and in the executivesummaries At the beginning this should concentrate on effecshytive use of overhead projectors and transparencies

3 The creation of the clearinghouse will require thesupport of a two-person team One person who is expert in thecurrent state-of-the-art in population research who will aid indivising the taxonomy and one person who is expert in classifishycation systems and information storage and retrieval using manualtechnologies who will aid in setting up the system and developingprocedures for running it This person will likely be found at a library school This will require about one month each

4 The creation of the institutional inventory may benefitfrom at least two weeks of the services of an anthropologistsociologist andor a political scientist who is familiar with Pakistan

5 The editing and publishing of the newsletter may benefitfrom the consultation of a successful newsletter editor in the USMajor problems are audience identification preparing copy layoutand pasting-up original forms for publication

6 These recommedations assume that adequate printing andreproduction facilities are available If not some additional support will be required in this area

F Other USAID Items of Concern

1 USAID Personnel should participate to the extent possishyble politically to insure that the Director of DPRU has the stature and talent required

2 USAID personnel should encourage the formation and periodic meetings of the steering committee-

G People interviewed

USAID

I Dr Steven W Sinding 2William R McIntyre 3 Marvin A Schwartz 4 Thomas R Mahoney

- 15 shy

5 Dr Andrew P Haynal 6 David Oot 7 Ruth S Plunkett 8 Hugh S Plunkett

POaulation Planning Council(PPC)

1 Mr M Alauddin Joint Secretary 2 Dr Wiqar Zaidi Director DPARC 3 Dr Makhdoom Ali Shah Director of Implementation

Planning Commission

1 Javid Hamid Chief of Economic Research 2 Jawaid Azfar Chief of Population Research

PIDE (Pakistan Institute of Development Economics)

1 M L Qureshi Director 2 Mohammad Afzal Chief of Population Section 3 Dr Steven Guisinger Economist 4 Dr Dennis DeTray EconomistDemographer

Family Planning Association of Pakistan 1 Mrs Surayya Jabeen Senior Director for Liaison

with Government and International Agenciesshy

2 Mr Naseer Chaudhry Assistant Director Field Operations

3 Mr Sabir Shah Field Representative

Note - FPAP arranged field trips to two familyplanning centers operated by the Pakistan Railway and to a village in the Shadab Pilot Project area where the family planning projectis integrated into the Integrated Rural Developshyment program These trips resulted in discusshysions with many participants including the President of the Peoples Welfare Society in the Shadab village

Training Research Evaluation Centre (TREC)

1 Mr Nizamuddin Deputy Director Social Research

Continus Motivation System (CMS)

1 Mrs Eatram -bullDistrict Population Planningliofficer Rawalpindi

- 16 o

Other Researchers

1 Mr Mahmood Roshan PhD Candidate (in dissertation)School of Public Health University of California Berkeley

Other Interested Parties

1 Dr John C -Cool Director of Ford Foundation in Pakistan

Private Firm Researchers 1 Mr Owais Akhlaq and Owais AdvertisingandMarket

Research

- 12 shy

the mailing list discussed above Its primary advantage is tokeep the reader aware of population problems research-based solutions and DPRU

_C Organization and Job Specifications

DPRU will be headed by a deputy director who reports directly to the Director (DPRC) and the Joint Secretary The -

Director initially will be supported by a communication specialist and a research analyst

1 Director The Deputy Director should be a person whois known and respected by the key policy-makers at PPC thePlanning Commission and the Ministries of Government Heshould have access to them for informal discussion as well asformal presentation He should be very familiar with thepopulation program in Pakistan If possible he should also befamiliar with current population research and research methodsbut this is a secondary requirement

The Director will be primary presentor at the briefings andat the stearing committee meetings He should also be active inthe workshops and seminars especially when high-level policyshymakers are involved His continuing responsibility is tolobby or implementation of research findings with policy-makersand to keep himself appraised of their concerns in the populationplanning area He should also maintain contact with organizationssuch as the Family Planning Association of Pakistan It is likelythat if some of the potentially useful findings of that organizashytion are mediated through DPRU the chances for adoption or adaptation will be improved

Under the supervision of the Director of DPRU are twospecialists--a communirtion specialist and a research analystwho must work together closely to accomplish the units tasks

2 Communication Specialist The person should have studiedjournalism and hopefully should have some experience in writingand reporting on scientific or technological activities Theability to write well and to present ideas clearly is critical to the functioning of the role

Primary responsibilities are to write executive summariesusing analysis prepared by the research analyst prepare briefshyings write news releases maintain mailing list create theinstitutional inventory participate in workshops preparepresentation for steering committee and edit and publish thenewsletter

13 shy

Research st This person should have experiencein research and researflchethodology Ideally this experience would be in population or related areas The individual need not be an accomplished researcher (although this is desirable)but should be able to converse with researchers on technical topics critique research studies from a methodological pointof -view summarize research findings and to relate them to other existing research

Primary responsiblities are to maintain liaison with researchers acquire completed research and to analyze research for its essential findings The role includes primary responsibishylity for maintaining the clearinghouse This person will also contribute to the other activities of the unit

D Time Phasing for the Installation of DPRU

Initially there will be little new coming research for DPRU to review and communicate During the development and transition to a steady state it is suggested that DPRU proceedin the following manner

The first task for DPRU will be to identify and assess the state of the art in population research in Pakistan This should be available at the first meeting of the steering commitshytee The assessment will serve as the basis for creating the clearinghouse Simultaneously the mailing list should be developed In addition to their substantive contributions the construction of the mailing list and the clearinghouse will force DPRU to become familiar with level of research and the researchers themselves currently active in Pakistan and also with the policy-makers with whom they are to communicate Early on a research problem identification workshop should be held

As research results become available DPRUs mode of activity shifts to the preparation of executive summaries briefings and workshops Then the clearing house and the mailing list are maintained When these activities are well underway the newsletter and institutional inventory can be considered

M Technical Assistance Required

The amount and character of further USAID technical assisshytance required to insure the DPRU has adequate capacity to fulfii its assigned tasks will depend largely on the talents and skills Df the 3 people it employs Since it is likely that all requisiteabilities will not be available some technical assistamcewill undoubtedly be required Potential requirements are specified below

- 14 shy

1 A consultant on the communication of scientific findingsto policy-makers for the period of approximately one monthPossible sources of the required expertise are policy orientedassociations such as TheConference Board media organizationssuch as Scientific American Science or Business Week and otherGovernment agencies The consultant would hold training sessionsfor the personnel and walk them through an application

2 A one or two-week course on preparing visual presentashytions and graphs to be used in the briefing and in the executivesummaries At the beginning this should concentrate on effecshytive use of overhead projectors and transparencies

3 The creation of the clearinghouse will require thesupport of a two-person team One person who is expert in thecurrent state-of-the-art in population research who will aid indivising the taxonomy and one person who is expert in classifishycation systems and information storage and retrieval using manualtechnologies who will aid in setting up the system and developingprocedures for running it This person will likely be found at a library school This will require about one month each

4 The creation of the institutional inventory may benefitfrom at least two weeks of the services of an anthropologistsociologist andor a political scientist who is familiar with Pakistan

5 The editing and publishing of the newsletter may benefitfrom the consultation of a successful newsletter editor in the USMajor problems are audience identification preparing copy layoutand pasting-up original forms for publication

6 These recommedations assume that adequate printing andreproduction facilities are available If not some additional support will be required in this area

F Other USAID Items of Concern

1 USAID Personnel should participate to the extent possishyble politically to insure that the Director of DPRU has the stature and talent required

2 USAID personnel should encourage the formation and periodic meetings of the steering committee-

G People interviewed

USAID

I Dr Steven W Sinding 2William R McIntyre 3 Marvin A Schwartz 4 Thomas R Mahoney

- 15 shy

5 Dr Andrew P Haynal 6 David Oot 7 Ruth S Plunkett 8 Hugh S Plunkett

POaulation Planning Council(PPC)

1 Mr M Alauddin Joint Secretary 2 Dr Wiqar Zaidi Director DPARC 3 Dr Makhdoom Ali Shah Director of Implementation

Planning Commission

1 Javid Hamid Chief of Economic Research 2 Jawaid Azfar Chief of Population Research

PIDE (Pakistan Institute of Development Economics)

1 M L Qureshi Director 2 Mohammad Afzal Chief of Population Section 3 Dr Steven Guisinger Economist 4 Dr Dennis DeTray EconomistDemographer

Family Planning Association of Pakistan 1 Mrs Surayya Jabeen Senior Director for Liaison

with Government and International Agenciesshy

2 Mr Naseer Chaudhry Assistant Director Field Operations

3 Mr Sabir Shah Field Representative

Note - FPAP arranged field trips to two familyplanning centers operated by the Pakistan Railway and to a village in the Shadab Pilot Project area where the family planning projectis integrated into the Integrated Rural Developshyment program These trips resulted in discusshysions with many participants including the President of the Peoples Welfare Society in the Shadab village

Training Research Evaluation Centre (TREC)

1 Mr Nizamuddin Deputy Director Social Research

Continus Motivation System (CMS)

1 Mrs Eatram -bullDistrict Population Planningliofficer Rawalpindi

- 16 o

Other Researchers

1 Mr Mahmood Roshan PhD Candidate (in dissertation)School of Public Health University of California Berkeley

Other Interested Parties

1 Dr John C -Cool Director of Ford Foundation in Pakistan

Private Firm Researchers 1 Mr Owais Akhlaq and Owais AdvertisingandMarket

Research

13 shy

Research st This person should have experiencein research and researflchethodology Ideally this experience would be in population or related areas The individual need not be an accomplished researcher (although this is desirable)but should be able to converse with researchers on technical topics critique research studies from a methodological pointof -view summarize research findings and to relate them to other existing research

Primary responsiblities are to maintain liaison with researchers acquire completed research and to analyze research for its essential findings The role includes primary responsibishylity for maintaining the clearinghouse This person will also contribute to the other activities of the unit

D Time Phasing for the Installation of DPRU

Initially there will be little new coming research for DPRU to review and communicate During the development and transition to a steady state it is suggested that DPRU proceedin the following manner

The first task for DPRU will be to identify and assess the state of the art in population research in Pakistan This should be available at the first meeting of the steering commitshytee The assessment will serve as the basis for creating the clearinghouse Simultaneously the mailing list should be developed In addition to their substantive contributions the construction of the mailing list and the clearinghouse will force DPRU to become familiar with level of research and the researchers themselves currently active in Pakistan and also with the policy-makers with whom they are to communicate Early on a research problem identification workshop should be held

As research results become available DPRUs mode of activity shifts to the preparation of executive summaries briefings and workshops Then the clearing house and the mailing list are maintained When these activities are well underway the newsletter and institutional inventory can be considered

M Technical Assistance Required

The amount and character of further USAID technical assisshytance required to insure the DPRU has adequate capacity to fulfii its assigned tasks will depend largely on the talents and skills Df the 3 people it employs Since it is likely that all requisiteabilities will not be available some technical assistamcewill undoubtedly be required Potential requirements are specified below

- 14 shy

1 A consultant on the communication of scientific findingsto policy-makers for the period of approximately one monthPossible sources of the required expertise are policy orientedassociations such as TheConference Board media organizationssuch as Scientific American Science or Business Week and otherGovernment agencies The consultant would hold training sessionsfor the personnel and walk them through an application

2 A one or two-week course on preparing visual presentashytions and graphs to be used in the briefing and in the executivesummaries At the beginning this should concentrate on effecshytive use of overhead projectors and transparencies

3 The creation of the clearinghouse will require thesupport of a two-person team One person who is expert in thecurrent state-of-the-art in population research who will aid indivising the taxonomy and one person who is expert in classifishycation systems and information storage and retrieval using manualtechnologies who will aid in setting up the system and developingprocedures for running it This person will likely be found at a library school This will require about one month each

4 The creation of the institutional inventory may benefitfrom at least two weeks of the services of an anthropologistsociologist andor a political scientist who is familiar with Pakistan

5 The editing and publishing of the newsletter may benefitfrom the consultation of a successful newsletter editor in the USMajor problems are audience identification preparing copy layoutand pasting-up original forms for publication

6 These recommedations assume that adequate printing andreproduction facilities are available If not some additional support will be required in this area

F Other USAID Items of Concern

1 USAID Personnel should participate to the extent possishyble politically to insure that the Director of DPRU has the stature and talent required

2 USAID personnel should encourage the formation and periodic meetings of the steering committee-

G People interviewed

USAID

I Dr Steven W Sinding 2William R McIntyre 3 Marvin A Schwartz 4 Thomas R Mahoney

- 15 shy

5 Dr Andrew P Haynal 6 David Oot 7 Ruth S Plunkett 8 Hugh S Plunkett

POaulation Planning Council(PPC)

1 Mr M Alauddin Joint Secretary 2 Dr Wiqar Zaidi Director DPARC 3 Dr Makhdoom Ali Shah Director of Implementation

Planning Commission

1 Javid Hamid Chief of Economic Research 2 Jawaid Azfar Chief of Population Research

PIDE (Pakistan Institute of Development Economics)

1 M L Qureshi Director 2 Mohammad Afzal Chief of Population Section 3 Dr Steven Guisinger Economist 4 Dr Dennis DeTray EconomistDemographer

Family Planning Association of Pakistan 1 Mrs Surayya Jabeen Senior Director for Liaison

with Government and International Agenciesshy

2 Mr Naseer Chaudhry Assistant Director Field Operations

3 Mr Sabir Shah Field Representative

Note - FPAP arranged field trips to two familyplanning centers operated by the Pakistan Railway and to a village in the Shadab Pilot Project area where the family planning projectis integrated into the Integrated Rural Developshyment program These trips resulted in discusshysions with many participants including the President of the Peoples Welfare Society in the Shadab village

Training Research Evaluation Centre (TREC)

1 Mr Nizamuddin Deputy Director Social Research

Continus Motivation System (CMS)

1 Mrs Eatram -bullDistrict Population Planningliofficer Rawalpindi

- 16 o

Other Researchers

1 Mr Mahmood Roshan PhD Candidate (in dissertation)School of Public Health University of California Berkeley

Other Interested Parties

1 Dr John C -Cool Director of Ford Foundation in Pakistan

Private Firm Researchers 1 Mr Owais Akhlaq and Owais AdvertisingandMarket

Research

- 14 shy

1 A consultant on the communication of scientific findingsto policy-makers for the period of approximately one monthPossible sources of the required expertise are policy orientedassociations such as TheConference Board media organizationssuch as Scientific American Science or Business Week and otherGovernment agencies The consultant would hold training sessionsfor the personnel and walk them through an application

2 A one or two-week course on preparing visual presentashytions and graphs to be used in the briefing and in the executivesummaries At the beginning this should concentrate on effecshytive use of overhead projectors and transparencies

3 The creation of the clearinghouse will require thesupport of a two-person team One person who is expert in thecurrent state-of-the-art in population research who will aid indivising the taxonomy and one person who is expert in classifishycation systems and information storage and retrieval using manualtechnologies who will aid in setting up the system and developingprocedures for running it This person will likely be found at a library school This will require about one month each

4 The creation of the institutional inventory may benefitfrom at least two weeks of the services of an anthropologistsociologist andor a political scientist who is familiar with Pakistan

5 The editing and publishing of the newsletter may benefitfrom the consultation of a successful newsletter editor in the USMajor problems are audience identification preparing copy layoutand pasting-up original forms for publication

6 These recommedations assume that adequate printing andreproduction facilities are available If not some additional support will be required in this area

F Other USAID Items of Concern

1 USAID Personnel should participate to the extent possishyble politically to insure that the Director of DPRU has the stature and talent required

2 USAID personnel should encourage the formation and periodic meetings of the steering committee-

G People interviewed

USAID

I Dr Steven W Sinding 2William R McIntyre 3 Marvin A Schwartz 4 Thomas R Mahoney

- 15 shy

5 Dr Andrew P Haynal 6 David Oot 7 Ruth S Plunkett 8 Hugh S Plunkett

POaulation Planning Council(PPC)

1 Mr M Alauddin Joint Secretary 2 Dr Wiqar Zaidi Director DPARC 3 Dr Makhdoom Ali Shah Director of Implementation

Planning Commission

1 Javid Hamid Chief of Economic Research 2 Jawaid Azfar Chief of Population Research

PIDE (Pakistan Institute of Development Economics)

1 M L Qureshi Director 2 Mohammad Afzal Chief of Population Section 3 Dr Steven Guisinger Economist 4 Dr Dennis DeTray EconomistDemographer

Family Planning Association of Pakistan 1 Mrs Surayya Jabeen Senior Director for Liaison

with Government and International Agenciesshy

2 Mr Naseer Chaudhry Assistant Director Field Operations

3 Mr Sabir Shah Field Representative

Note - FPAP arranged field trips to two familyplanning centers operated by the Pakistan Railway and to a village in the Shadab Pilot Project area where the family planning projectis integrated into the Integrated Rural Developshyment program These trips resulted in discusshysions with many participants including the President of the Peoples Welfare Society in the Shadab village

Training Research Evaluation Centre (TREC)

1 Mr Nizamuddin Deputy Director Social Research

Continus Motivation System (CMS)

1 Mrs Eatram -bullDistrict Population Planningliofficer Rawalpindi

- 16 o

Other Researchers

1 Mr Mahmood Roshan PhD Candidate (in dissertation)School of Public Health University of California Berkeley

Other Interested Parties

1 Dr John C -Cool Director of Ford Foundation in Pakistan

Private Firm Researchers 1 Mr Owais Akhlaq and Owais AdvertisingandMarket

Research

- 15 shy

5 Dr Andrew P Haynal 6 David Oot 7 Ruth S Plunkett 8 Hugh S Plunkett

POaulation Planning Council(PPC)

1 Mr M Alauddin Joint Secretary 2 Dr Wiqar Zaidi Director DPARC 3 Dr Makhdoom Ali Shah Director of Implementation

Planning Commission

1 Javid Hamid Chief of Economic Research 2 Jawaid Azfar Chief of Population Research

PIDE (Pakistan Institute of Development Economics)

1 M L Qureshi Director 2 Mohammad Afzal Chief of Population Section 3 Dr Steven Guisinger Economist 4 Dr Dennis DeTray EconomistDemographer

Family Planning Association of Pakistan 1 Mrs Surayya Jabeen Senior Director for Liaison

with Government and International Agenciesshy

2 Mr Naseer Chaudhry Assistant Director Field Operations

3 Mr Sabir Shah Field Representative

Note - FPAP arranged field trips to two familyplanning centers operated by the Pakistan Railway and to a village in the Shadab Pilot Project area where the family planning projectis integrated into the Integrated Rural Developshyment program These trips resulted in discusshysions with many participants including the President of the Peoples Welfare Society in the Shadab village

Training Research Evaluation Centre (TREC)

1 Mr Nizamuddin Deputy Director Social Research

Continus Motivation System (CMS)

1 Mrs Eatram -bullDistrict Population Planningliofficer Rawalpindi

- 16 o

Other Researchers

1 Mr Mahmood Roshan PhD Candidate (in dissertation)School of Public Health University of California Berkeley

Other Interested Parties

1 Dr John C -Cool Director of Ford Foundation in Pakistan

Private Firm Researchers 1 Mr Owais Akhlaq and Owais AdvertisingandMarket

Research

- 16 o

Other Researchers

1 Mr Mahmood Roshan PhD Candidate (in dissertation)School of Public Health University of California Berkeley

Other Interested Parties

1 Dr John C -Cool Director of Ford Foundation in Pakistan

Private Firm Researchers 1 Mr Owais Akhlaq and Owais AdvertisingandMarket

Research