Monitoring and Evaluation

Monitoring, Evaluation and Learning

Monitoring and evaluation (M&E) are complementary functions that help organizations learn about what works and what does not, adjust programs to meet planned objectives and account for the outcomes and results achieved. To be able to determine the effectiveness, efficiency, impact and sustainability of projects and to apply new knowledge and incorporate lessons learned, monitoring and evaluation is key.

CAMRIS provides technical assistance to clients and partners to strengthen programs through state of the art M&E techniques. We also provide consulting services to develop and strengthen M&E systems for other organizations. Our support helps organizations to:

  • Improve data quality for research and programs.
  • Provide information on results and impact to project sponsors.
  • Meet stakeholders' needs for results and impact information.
  • Contribute to learning and development at the project and sectorial level.

CAMRIS provides support for M&E efforts across program areas and sectors, from work on improving governance and promoting peace and security to health, workforce capacity building, and research.

CAMRIS Monitoring and Evaluation services capabilities include:

  • Design and implementation of qualitative and quantitative evaluation services.
    • Identification of key evaluation questions.
    • Collecting high quality baseline data.
    • Establish parallel evaluation mechanism at project inception for impact evaluations.
  • Technical assistance for missions, implementing partners and host country government counterparts.
  • Capacity building for local evaluation institutions to meet or exceed international evaluation standards.
  • Performance evaluation.
  • Impact evaluation.
  • Meta-evaluation.
  • Quasi-experimental design.
  • Regional and national population surveys.
  • Dissemination of evaluation findings.

Challenge

The USAID/Nepal Monitoring and Evaluation (M&E) Contract supports achievement of USAID/Nepal’s Country Development Cooperation Strategy (CDCS) Development Objectives, including agriculture, health, democracy and governance, education, and environment and climate change by assisting the Mission in planning, designing, conducting, disseminating, and learning from more rigorous monitoring and evaluation of development activities. This includes designing and implementing both quantitative and qualitative evaluations and assessments, as well as providing expert analysis and technical assistance to USAID/Nepal’s programs. The Contract also assists the Mission to measure the effectiveness of its efforts to promote gender equality and inclusion of persons with disabilities, LGBTI individuals, and historically disadvantaged caste and ethnic groups.

CAMRIS Approach

The CAMRIS team supports USAID in working with its IPs to determine performance indicators and evaluation designs as new activities begin – including conducting baseline surveys – so that their impact can be evaluated over time. In cases in which the activities are already underway, the team conducts data quality assessments and evaluates activity performance.  

CAMRIS uses the products, deliverables, and data from the Nepal Monitoring, Evaluation and Learning (MEL) project to:

  • Facilitate informed program management.
  • Shape the longer-term strategic direction of programs and decision-making within the Mission.
  • Enable USAID/Nepal to comply with Agency accountability and M&E requirements.

Result

Component 1 

Support greater rigor and coherence in USAID/Nepal’s M&E efforts by providing technical assistance for the Performance Management Plan (PMP) and Project and Activity level M&E plans, strengthening the capacity of USAID/Nepal staff to conduct M&E tasks and use data effectively, and strengthening the performance monitoring capacity of USAID/Nepal implementing partners.

  • Developed a Mission-approved M&E training and capacity development plan for USAID and IP staff.
  • Performed a geographic information system (GIS) assessment of the Missions and IP’s use of GIS technology for performance management and decision-making, knowledge management, and learning.
  • Reviewed six USAID IP project M&E plans and presented findings, recommendations and conclusions to the Mission to strengthen current and future M&E plans.
  • Conducted a two-day learning summit on M&E lessons learned, which involved for both days over 100 participants IP key personnel and Mission technical staff.

Component 2

Design and conduct analyses, evaluations, surveys, studies, and assessments.  

  • Conducted five of six evaluations to date across DOs including health, education, agriculture, and democracy and governance.
  • Conducted a review of the Mission’s 2014-2019 Performance Management Plan (PMP), assessing the appropriateness and feasibility of indicators – including cross-cutting indicators – at the goal, DO, intermediate result (IR), and sub-IR levels.

Component 3

Support improved knowledge management within the Mission.

  • Assessed the Mission’s knowledge management (KM) tools and practices and reviewed institutional and informational challenges to effective KM within the Mission and across its IPs. The KM Assessment’s findings and recommendations supported the Mission’s efforts to strengthen collaborating, learning, and adapting (CLA).

Challenge

A comprehensive review of the performance, impact, and lessons learned of USAID’s 20-country Tuberculosis Control Assistance Program (TB CAP).

CAMRIS Approach

A CAMRIS-led team analyzed past and present TB CAP activities and management through a desk review of TB CAP documents and materials, field visits to four TB CAP countries, meetings with technical agencies and donors, as well as interviews with stakeholders in 16 other TB CAP countries, including missions, TB CAP partners, and national TB programs.

Result

The review outlined TB CAP’s collective performance, impact, and lessons learned, as well as its attainment of various technical results. The evaluation also measured impact in individual TB CAP countries against the goals and objectives set by the World Health Organization’s global Stop TB Partnership in a collaborative, efficient, and cost-effective manner.

Challenge

Assess the national health sector in El Salvador to identify needs in the areas of service provision, administrative and management systems, and human resources that could be addressed with USAID support over a five-year strategy period.

CAMRIS Approach

The CAMRIS team reviewed relevant documents, interviewed stakeholders, analyzed interview results for prevailing themes, explored opportunities for intersectoral synergies, and visited field sites with good intersectoral collaboration to learn from best practices.

Result

The assessment reported on main results achieved and lessons learned to date and identified gaps to be addressed, with conclusions and recommendations organized by five thematic areas:

  • Policy and legislation.
  • Education.
  • Quality of services.
  • Intersectoral collaboration.
  • Private sector involvement.

Challenge

Determine whether the data management systems of USAID/Malawi’s implementing partners are in line with new data collection and reporting processes.

CAMRIS Approach

A data quality assessment (DQA) for all indicators of the USAID/Malawi development program. The DQA analyzed program indicator data, using U.S. Government data quality standards of validity, reliability, integrity, precision, and timeliness, as well as the processes by which data are collected, stored, and provided to USAID/Malawi and USAID/Washington. The assessment covered the monitoring and evaluation procedures of development partners and grantees at each stage of the data management process.

Result

The DQA facilitated the improvement of performance monitoring systems of USAID/Malawi’s development partners. The CAMRIS DQA team suggested that USAID/Malawi come up with a continuous DQA process or a best practices guide for monitoring implementing partners’ activities.

The team’s report can be found here.

Challenge

Advance global understanding of health and population trends in developing countries.

CAMRIS Approach

CAMRIS was a subcontractor on the third phase of the Monitoring and Evaluation to Assess and Use Results (MEASURE) Demographic and Health Surveys (DHS) project. With more than 240 surveys conducted in over 90 countries, MEASURE DHS has earned a worldwide reputation for collecting, analyzing, and disseminating accurate nationally representative data. Survey types include:

  • Standard Demographic and Health Surveys
  • Interim DHS
  • AIDS Indicator Surveys
  • Malaria Indicator Surveys
  • Service Provision Assessments
  • Collection of biomarkers and measurements
  • Geographic information systems

Result

CAMRIS staff on the DHS III contract assisted and conducted DHS activities in Malawi, Tanzania, Zimbabwe, and the prime contractor’s Washington-area headquarters. USAID and other donors, governments, and international health organizations use DHS results to inform their program planning and implementation in HIV/AIDS; tuberculosis; malaria; maternal, neonatal, and child health; family planning and reproductive health; water supply and sanitation; and other global health concerns.