PE-DEV Toolkit / Trousse à outils de MP-DEV/part1/measurement

ADD INTRO AND DESIGN

Evaluation

While being an important part of any project or initiative, the evaluation phase is often a challenging exercise. We acknowledge and recognize that evaluating engagement projects is even more challenging due to its complex and nuance nature.

More specifically, we understand that we do not have common engagement definitions, objectives, or tools across the sector. The same goes for the establishment of appropriate indicators to measure the success of engagement initiatives.

Global Affairs Canada and its partners are currently reflecting on the best ways to approach the measurement of engagement.

We invite you to contribute to our reflection by sending us your ideas by email.

Some elements to consider when planning the evaluation of your initiative include:

Evaluating behaviour change:

•Plan surveys, focus groups or telephone interviews or prepare comment cards to evaluate changes in behaviour over time.

•Consult the results of surveys done by other public engagement and development partners before preparing a survey.

•Follow up with Canadians who have agreed to participate in order to evaluate changes in behaviour following completion of a project and in future years, and use this information to plan upcoming projects

Evaluating Development Communications:

•Include an evaluation plan right at the start that identifies the key pillars of the communications program;

•Measure progress on the communication strategy;

•Set goals and agree on a baseline that allows for performance to be monitored on an ongoing basis;

•Make use of small efficient instruments (e.g. templates and social media tools) throughout the process, making sure to evaluate their effectiveness so improvements can be introduced along the way;

•Keep checking data as it comes in to ensure it is adequate and correct;

•Triangulate and test the validity of the data gathered using old and new approaches with common sense and trust

Theory of change & indicators

The project level indicators to be tracked and reported on should leverage methodology including pre, post, and follow-up participant survey methods through their Performance Management Frameworks.

Elements to consider include:

•Level of awareness after participating in an in-person or interactive digital activities on international assistance issues.

•These include persons attending public events, information sessions, webinars, interactive exhibitions, etc.

•

•Level of knowledge after consulting and engaging with online information or resources on international assistance issues and number of people consulting and engaging with online resources on international assistance issues.

•These include reading, sharing, commenting on, contributing to etc. Online resources: social media, Web content, articles, stories from the field, newsletters, brochures, documentaries, etc.

•

•Level of capacity on international assistance issues after participation in capacity building activities.

•These include: training, workshops, experiential learning opportunities, educational programs, experiences in developing countries, participation in national and international for a, others.

•

•Level of active global citizen engagement in international assistance activities.

•These include: volunteering; engaging others in the issue; working in the sector; actively seeking out information and research; publishing, liking and sharing posts on social media platform; fundraising or make a donation actively to support FIAP action fields and the SDGs; other actions.