Difference between revisions of "1.3 - Measuring progress"
Jump to navigation
Jump to search
| (29 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
| + | [[File:22-234 IDW 2022 Web-Banner 2800x347 v1 .jpg|alt=|center|frameless|1442x1442px]] | ||
{| class="wikitable" | {| class="wikitable" | ||
| − | |[[Engaging Canadians| | + | |'''[[Virtual Engagement Resource Centre for All|Main]]''' |
| + | [[Engaging Canadians|'''Page''']] | ||
|'''[[1.1 – Understanding public engagement and global citizenship|Understanding public engagement and global citizenship]]''' | |'''[[1.1 – Understanding public engagement and global citizenship|Understanding public engagement and global citizenship]]''' | ||
| − | |'''[[1.2 - Basic guidelines| | + | |'''[[1.2 - Basic guidelines|Tools and guidance]]''' |
|'''[[1.3 - Measuring progress|Measuring progress]]''' | |'''[[1.3 - Measuring progress|Measuring progress]]''' | ||
|'''[[2.1 – Resources from the Government of Canada|Resources from the Government of Canada]]''' | |'''[[2.1 – Resources from the Government of Canada|Resources from the Government of Canada]]''' | ||
| Line 8: | Line 10: | ||
|'''[[2.3 – Going further|Going further]]''' | |'''[[2.3 – Going further|Going further]]''' | ||
|} | |} | ||
| − | [[ | + | [[1.3 - Mesurer les progrès|Français]] |
| − | |||
=== Evaluation of engagement === | === Evaluation of engagement === | ||
An important part of any project or initiative is the evaluation process in establishing the criteria for success. However, evaluating public engagement projects and their impacts on changes in behavior can be challenging, due to the long-term investment needed to realize behavior change. As well, there is no common approach regarding engagement definitions, objectives or tools across the sector. The same goes for the establishment of appropriate indicators to measure the success of engagement initiatives. | An important part of any project or initiative is the evaluation process in establishing the criteria for success. However, evaluating public engagement projects and their impacts on changes in behavior can be challenging, due to the long-term investment needed to realize behavior change. As well, there is no common approach regarding engagement definitions, objectives or tools across the sector. The same goes for the establishment of appropriate indicators to measure the success of engagement initiatives. | ||
| Line 16: | Line 17: | ||
==== '''Some elements to consider when planning the evaluation of your initiative include:''' ==== | ==== '''Some elements to consider when planning the evaluation of your initiative include:''' ==== | ||
| − | ''Evaluating behaviour change: | + | ''Evaluating behaviour change:'' |
* Plan surveys, focus groups or telephone interviews or prepare comment cards to evaluate changes in behaviour over time. | * Plan surveys, focus groups or telephone interviews or prepare comment cards to evaluate changes in behaviour over time. | ||
* Consult the results of surveys done by other public engagement and development partners before preparing a survey. | * Consult the results of surveys done by other public engagement and development partners before preparing a survey. | ||
* Follow up with Canadians who have agreed to participate in order to evaluate changes in behaviour following completion of a project and in future years, and use this information to plan upcoming projects. | * Follow up with Canadians who have agreed to participate in order to evaluate changes in behaviour following completion of a project and in future years, and use this information to plan upcoming projects. | ||
| − | ''Evaluating Development Communications | + | ''Evaluating Development Communications:'' |
* | * | ||
| Line 28: | Line 29: | ||
* Keep checking data as it comes in to ensure it is adequate and correct. | * Keep checking data as it comes in to ensure it is adequate and correct. | ||
* Triangulate and test the validity of the data gathered using old and new approaches with common sense and trust. | * Triangulate and test the validity of the data gathered using old and new approaches with common sense and trust. | ||
| − | |||
| − | |||
==== Theory of change and indicators ==== | ==== Theory of change and indicators ==== | ||
| − | The project | + | The indicators in a project's performance management framework should be monitored and reported. They must also be based on a methodology for surveying participants before and after the project. |
| − | Elements to consider include: | + | '''Elements to consider include:''' |
'''Level of awareness''' after participating in an in-person or interactive digital activity on international assistance issues. | '''Level of awareness''' after participating in an in-person or interactive digital activity on international assistance issues. | ||
* These include persons attending public events, information sessions, webinars, interactive exhibitions, etc. | * These include persons attending public events, information sessions, webinars, interactive exhibitions, etc. | ||
| − | '''Level of knowledge''' after consulting and engaging with online information or resources on international assistance issues and number of people consulting and engaging with online resources on international assistance issues. | + | '''Level of knowledge''' after consulting and engaging with online information or resources on international assistance issues and the number of people consulting and engaging with online resources on international assistance issues. |
* These include reading, sharing, commenting on contributing to online resources, such as social media, Web content, articles, stories from the field, newsletters, brochures and documentaries. | * These include reading, sharing, commenting on contributing to online resources, such as social media, Web content, articles, stories from the field, newsletters, brochures and documentaries. | ||
| − | '''Level of capacity''' on international assistance issues and the number of people participating in capacity building activities. | + | '''Level of capacity''' on international assistance issues and the number of people participating in capacity-building activities. |
* These include training, workshops, experiential learning opportunities, educational programs, experiences in developing countries, participation in national and international forums. | * These include training, workshops, experiential learning opportunities, educational programs, experiences in developing countries, participation in national and international forums. | ||
'''Level of active global citizen engagement''' in international assistance activities. | '''Level of active global citizen engagement''' in international assistance activities. | ||
| − | * These include, volunteering, engaging others in the issue, working in the sector, actively seeking out information and research, publishing, liking, and sharing posts on social media | + | * These include, volunteering, engaging others in the issue, working in the sector, actively seeking out information and research, publishing, liking, and sharing posts on social media platforms, fundraising or making donations actively to support the Feminist International Assistance Policy (FIAP) action fields and the Sustainable Development Goals (SDGs). |
* | * | ||
Latest revision as of 10:48, 27 February 2024
| Main | Understanding public engagement and global citizenship | Tools and guidance | Measuring progress | Resources from the Government of Canada | External resources | Going further |
Evaluation of engagement
An important part of any project or initiative is the evaluation process in establishing the criteria for success. However, evaluating public engagement projects and their impacts on changes in behavior can be challenging, due to the long-term investment needed to realize behavior change. As well, there is no common approach regarding engagement definitions, objectives or tools across the sector. The same goes for the establishment of appropriate indicators to measure the success of engagement initiatives.
Global Affairs Canada and its partners are currently in the process of reflecting on the best ways to approach the measurement of engagement. We invite you to contribute to our reflection by sending us your ideas by email to: engagement.dev@international.gc.ca
Some elements to consider when planning the evaluation of your initiative include:
Evaluating behaviour change:
- Plan surveys, focus groups or telephone interviews or prepare comment cards to evaluate changes in behaviour over time.
- Consult the results of surveys done by other public engagement and development partners before preparing a survey.
- Follow up with Canadians who have agreed to participate in order to evaluate changes in behaviour following completion of a project and in future years, and use this information to plan upcoming projects.
Evaluating Development Communications:
- Measure progress on the communications strategy.
- Set goals and agree on a baseline that allows for performance to be monitored on an ongoing basis.
- Make use of small efficient instruments (e.g. templates and social media tools) throughout the process, making sure to evaluate their effectiveness so improvements can be introduced along the way.
- Keep checking data as it comes in to ensure it is adequate and correct.
- Triangulate and test the validity of the data gathered using old and new approaches with common sense and trust.
Theory of change and indicators
The indicators in a project's performance management framework should be monitored and reported. They must also be based on a methodology for surveying participants before and after the project.
Elements to consider include:
Level of awareness after participating in an in-person or interactive digital activity on international assistance issues.
- These include persons attending public events, information sessions, webinars, interactive exhibitions, etc.
Level of knowledge after consulting and engaging with online information or resources on international assistance issues and the number of people consulting and engaging with online resources on international assistance issues.
- These include reading, sharing, commenting on contributing to online resources, such as social media, Web content, articles, stories from the field, newsletters, brochures and documentaries.
Level of capacity on international assistance issues and the number of people participating in capacity-building activities.
- These include training, workshops, experiential learning opportunities, educational programs, experiences in developing countries, participation in national and international forums.
Level of active global citizen engagement in international assistance activities.
- These include, volunteering, engaging others in the issue, working in the sector, actively seeking out information and research, publishing, liking, and sharing posts on social media platforms, fundraising or making donations actively to support the Feminist International Assistance Policy (FIAP) action fields and the Sustainable Development Goals (SDGs).
