Module 4
M&E Plan and Data Collection
Methods
At the end of this module you will be able to:
1. Understand the basic components of a M&E plan
2. Understand the data quality issues
3. Be familiar with data collection methods
1
Each indicator must have an M&E plan
Data Acquisition & Reporting
Baseline & Targets Method Critical
Assumptions
Indicator Res- (Risks)
Definition Data ponsible
Baseline Frequency source/Met Party
Target Values (/Year) /Schedule hod
1 2 3 4 5
Clear and Value of the Intended value of the External
precise indicator at the indicator at the end of factors that
definition of beginning of a specified points in could
what will be the program time, against which significantly
measured (used as a actual results will be affect the
and unit of point of measured achievement
measure comparison to of the
measuring targets
progress If you don’t know where you are, how can
toward a you tell where you are going?
specific target)
Total annual 10 11 12 12 12 12 Annually Agency Tax Macro
revenues (1 June) records/ Agency economic
collected by the Taxpayers conditions
Tax declaration maintained
Administration forms 10
($) 2
M&E Data Sources
Internal External
(Common Source: (Common Source: Rapid Appraisal &
Administrative Data) Survey methods)
OUTCOMES
Short- Medium- Long-
Inputs Activities Outputs Term Term
Term
Financial & Progress in the Output
human implementation indicators Indicators of
resources of planned Indicators of access & use improvement
indicators activities in living
standards
◼ Data collected from the Government ◼ Data collected directly from the
Management Information Systems beneficiaries
◼ Analyze the implementation ◼ Monitor the effectiveness of
performance of government government programs and projects
programs and projects
Both data sources are important for M&E purposes 3
Key M&E Data Collection Methods
Rigor/Difficulty
(Cost/Time)
Census
Panel
Surveys
Experimental
One-Time design
Survey
Focus Direct
Group Observation
Interviews
Key Informant
Interviews Community
Interviews Validity
Reliability
Statistical Emphasis Credibility
◼ Question to be answered
Develop a data
◼ Quality of information needed
collection strategy
◼ Time frame in which information is needed
that is based on
◼ Cost
4
Key M&E Data Collection Methods (Cont.)
Examples: Which data collection method is appropriate in
providing an answer to the following questions?
▪ What % of population which perceive the police is
corrupt?
▪ Why didn’t more people use newly established call center
to report corruption acts?
▪ Did the Local Governance project implemented in
participating municipalities contributed to the
improvement in the quality of urban service delivery? 5
Module 4: Developing an M&E/ Performance Monitoring Plan
Key Data Quality Issues
◼ Data quality is critically important for credibility
◼ Indicators are useless without good quality data
◼ Use available data whenever possible (faster, cheaper,
easier), but consider the following key quality issues:
Reliability
Stable and consistent data
collection process & analysis
methods over time
Timeliness
Data current & available Validity
for all appropriate Directly measure the
intervals intended results
Integrity/Accuracy Precision
Minimize transcription error Change
measured > margin of errors
and data manipulation
6
ANALYSIS OF SURVEY DATA
Better Same or Worse http://www.glob
46 29
➢ Conclusion:
People in most countries think
that an Obama presidency would
improve relations with the world
➢ Question:
Are these results
representative of the view of http://www.globescan.com/news_archives/images/pipa_web31h.gif
World’s population ?
7
SAMPLING: Sample Size and Sampling Error
Sampling Sample
Error Poluation Size of 1000 Size Sample Size (5% level of precision)
300
12%
10% 250
8% 200
6% 150
4%
100
2%
50
0%
0 200 400 600 800 0
0 1,000 2,000 3,000
Sample Size Population Size
◼ The more precise you want to ◼ Sample size is function of size
be, the larger the sample size of population, BUT the
relationship is not linear
8
Sampling vs. Non-Sampling Errors
Error
Total
Error
Sample Size
9
What are the critical elements of an
effective M&E System?
◼ Active involvement of customers and partners (planning,
conducting, reviewing, & interpreting performance information)
◼ Fully integrated into the government’s existing management
systems at the central and local level
◼ Responsive to information need for management and policy
making of government institutions at the central and local
levels
◼ Built around reporting requirements
◼ M&E capacity in place for collecting, analyzing, and reporting
performance information
10
Results Reporting
➢ Program reports (annual reports, supervision reports, final
reports) should be linked to results
• Early stages of the program: Focus on reporting on inputs &
outputs with clear linkage with outcomes
• End stages of the program: Focus on reporting on results
Which 1. A workshop was held to train 100 participants from the Ministry
statement of health to use the new computerized support system.
is result
2. As a results of the organized workshop, the Ministry of Health is
focused?
moving to the use of the new computerized support system to
improve the efficiency of health services. The workshop was
attended by 100 MOH staffs.
➢ Provide significance and magnitude when reporting numbers
Example : % of budget allocated to the health centers increased by 10 %.
11
Exercise 9. Developing Project M&E Plan
Assignment
Break out into 6 teams. Based on your area of expertise,
develop a M&E plan for one of the cases developed in
the previous assignment (Exercise 8).
For each outcome indicator:
1. Provide a clear definition and unit of measurement
2. Baseline and annual target values
3. Data acquisition method
4. Data analysis and reporting method
5. Critical assumptions
12
