1.3 - Measuring progress

Evaluation of engagement

An important part of any project or initiative is the evaluation process in establishing the criteria for success. However, evaluating public engagement projects and their impacts on changes in behavior can be challenging, due to the long-term investment needed to realize behavior change. As well, there is no common approach regarding engagement definitions, objectives or tools across the sector. The same goes for the establishment of appropriate indicators to measure the success of engagement initiatives.

Global Affairs Canada and its partners are currently in the process of reflecting on the best ways to approach the measurement of engagement. We invite you to contribute to our reflection by sending us your ideas by EMAIL TO COME.

Some elements to consider when planning the evaluation of your initiative include:

Evaluating behaviour change: (IN REVISION)

• Plan surveys, focus groups or telephone interviews or prepare comment cards to evaluate changes in behaviour over time.
• Consult the results of surveys done by other public engagement and development partners before preparing a survey.
• Follow up with Canadians who have agreed to participate in order to evaluate changes in behaviour following completion of a project and in future years, and use this information to plan upcoming projects.

Evaluating Development Communications (IN REVISION)

• Measure progress on the communications strategy.
• Set goals and agree on a baseline that allows for performance to be monitored on an ongoing basis.
• Make use of small efficient instruments (e.g. templates and social media tools) throughout the process, making sure to evaluate their effectiveness so improvements can be introduced along the way.
• Keep checking data as it comes in to ensure it is adequate and correct.
• Triangulate and test the validity of the data gathered using old and new approaches with common sense and trust.

Theory of change and indicators

The project level indicators to be tracked and reported on should leverage methodology pre-, post- and follow-up participant surveys methods through their performance management frameworks.

Elements to consider include:

Level of awareness after participating in an in-person or interactive digital activities on international assistance issues.

• These include persons attending public events, information sessions, webinars, interactive exhibitions, etc.

Level of knowledge after consulting and engaging with online information or resources on international assistance issues and number of people consulting and engaging with online resources on international assistance issues.

• These include reading, sharing, commenting on contributing to online resources, such as social media, Web content, articles, stories from the field, newsletters, brochures and documentaries.

Level of capacity on international assistance issues and the number of people participating in capacity building activities.

• These include training, workshops, experiential learning opportunities, educational programs, experiences in developing countries, participation in national and international forums.

Level of active global citizen engagement in international assistance activities.