Let’s Innovate Together

Transforming ROEB, One Experiment at a Time.
Innovation Workshops: Toronto, Montreal
Who is involved?
- Technology and Business Innovation, Planning and Operations, Regulatory Operations and Enforcement Branch, Health Canada

Introduction

Technology and Business Innovation (TBI) under the Planning and Operations Directorate (POD) is responsible for leading the development of the Regulatory Operations and Enforcement Branch (ROEB) investment plan, improving business, and solving problems. Investing in innovation is a major pillar for TBI; it aims to position the Branch as a leader in compliance and enforcement excellence by using innovative approaches to improve regulatory operations.

There is a new Innovation group in TBI called “remic” with a focus on novel approaches, testing via experiments to assess new technologies to potentially modernize and transform ROEB inspection service delivery systems. Remic brings together regulators, researchers, social scientists, data scientists, business and industry experts to collaborate, share, and co-create solutions to support ROEB objectives.

To support capacity building and co-learning within ROEB, TBI planned and executed two workshop sessions with an emphasis on sharing and exploring. The goal was to:

Promote mindset, skills and behaviours necessary for innovation and experimentation
Highlight employee-led experimentation (innovation) initiative
Build knowledge and capacity in ROEB and be leaders in the C&E Transformation
Nurture ideas into future projects (Submit ideas to Solutions Fund)

During February 2020, TBI visited Toronto and Montreal to facilitate the ‘innovation workshop’ sessions. This report will provide the detailed summary of the workshops and the collected results.

Purpose

In June 2019, the Government of Canada launched a public consultation on a number of initiatives that focused on modernizing the Canadian regulatory system. The intent of the process was to address the regulatory issues by encouraging innovation and competitiveness. A 2016 directive to the Deputy Head of the Federal Departments also ensures that the Government of Canada is committed to devote a fixed percentage of program funds to experimentation that brings new approaches and creates an environment of measurement, evaluation and innovation in program and policy design and delivery. There is a shift in the approach government is taking when investing for the future.

In order to leverage these Government of Canada opportunities ROEB has laid out its 2019-2022 strategic plan that focuses on three key priorities including modernizing the program delivery system, transformation of compliance and enforcement, and achieving excellence in people and workplace. As a result, ROEB is investing in experimentation to advance business processes in the digital era.

Under this plan, ROEB is creating an environment that is conducive to culture shifts to support change and evolution. As well, connecting and sharing with our national Branch partners with a purpose of co-learning and co-creating through experimentation is one of the first steps. The original intent was to visit six cities (Burnaby, Edmonton, Winnipeg, Toronto, Montreal, and Halifax); only Toronto and Montreal was visited – with a plan to visit the other cities in the future.

The purpose of the workshops were the following:

Share ROEB learnings on experimentation to date, along with information from our corporate partners regarding innovation and experimentation relating to regulatory excellence;
Expose participants to experimentation methodology, problem framing and design approaches to problem solving; and
Leverage the workshop as a “launch pad” to co-create with our national partners to solve wicked problems through continuous learning, support, and partnerships.

What We Shared

The workshop was broken up into two portions. In the morning, participants heard presentations from various enablers of experimentation who shared their first-hand experience in developing an innovation project, including the lessons learned and the resources and support available. The workshop presented an introduction to understanding the innovation mindset, framing problems, and the process of experimentation. In the afternoon, participants took part in a hands-on workshop where they collectively chose a problem and applied design thinking principles. The problems they chose were from a list presented by the participants themselves.

The morning programming included the following:

Share insight from internal and external partners:
- Martin Bernard, Opening Remarks
- Scott McNaughton, Canada School of Public Service, Showcasing Regulatory Innovation
- Fariba Anderson, Gartner, The Language of Change
- Paul Twig, Sierra Systems, Innovation Perspectives from Industry
- Sarah Kennedy, Health Canada’s Solutions Fund: Enabling Experimentation @ HC
- Kimberley Shirley, IMSD: Supporting Experimentation @ HC
Provide overview on methods and approaches to problem framing and experimentation design
- Peter Yoon, Innovation Mindset, An Open Mindset to Experiment

The morning was to set the stage to provide perspectives from the Government of Canada model to experimentation to the approach adopted by Health Canada. All presentations are available at the TBI GCconnex page: https://gcconnex.gc.ca/file/group/40861893/all#61558995.

Workshop Session

Image 1: Workshop Programme

The afternoon was dedicated to allow participants gain hands on experience applying a ‘design model’ to problem framing and idea generation. It focused on a process that put the emphasis on understanding the problem through an exploration of the persona – or the person that owns the problem. This is an approach to ensure that the right problem is being solved, and not the symptom(s).

As part of the process to register, each participant was asked to submit a problem or opportunity they are passionate about. This was used as the case studies for the workshop. The goal was to choose a problem and work through the problem by using the following 10 steps:

Choosing a Problem
Identify the Persona
Refine the Problem
What are the Needs?
What can we Leverage?
Measuring Success
Brainstorm for Ideas
Select Ideas for Testing
The Pitch
Ranking & Prioritizing

The traditional approach to problem solving tackles problems directly with an attempt to find a solution as quickly as possible. The exercise shifts the traditional approach by leaving the ‘problem solving’ portion near the end of the exercise; instead, the focus is put on understanding the people, their needs, available resources, and how success can be measured. In the following two sections, the results from each of the workshops has been summarized.

Results from Toronto

The Toronto co-design workshop was on February 26, 2020, at 2301 Midland Avenue. Sixteen registered participants attended the session, along with six facilitators and presenters (Martin Bernard, Peter Yoon, Amy McDonald, Sarah Kennedy, Scott McNaughton, Fariba Anderson). The session had 23 people who registered; due to weather and various operational pressures, some were not able to attend. As part of the registration process enabled by Eventbrite, participants were asked to submit a problem or opportunity they are passionate about. The following is the list provided by many that registered prior to the workshop.

The time it takes to perform general drug screening for samples takes too long.
Foreign paper based inspections could use innovation.
Case management record keeping is disjointed; needs modernization.
Buy in for a project that may not be a priority for the stakeholders due to other urgent priorities.
Maintenance of the facilities that everyone uses in the laboratory.
Streamlining the initial inspection process (based on risk). Initial inspections are added work on top of regular scheduled inspections. Is it always necessary to go onsite?
Site inspection note taking is a time-intensive activity. Are there ways to improve the process?
Working within the resources and parameters of being in the public sector, how do we adapt our training and processes so that we can work with the public while not completely overhauling all the systems and policies that currently exist?
Reporting tools that we use are very primitive and do not support simultaneous use by multiple users.
Are there better ways to connect to our stakeholders to execute outreach activities?
Unable to increase CMP as a trusted or #1 source of public information for risk management.
Shared Drives: there is a lot of duplicate folders and documents in multiple locations in the shared drives. Is there a better way?

During the afternoon portion of the workshop, three teams of 5 or 6 were formed to apply a hybrid ‘design thinking’ approach. This approach combined Human Centric Design and the Double Diamond Design models. The goal was to help participants feel comfortable with a different process/approach to problem solving. Each group was asked to choose one of the 12 submitted problems/opportunities; they were also given the choice to present a new problem if desired. The following are the summaries from the exercise.


Team Name	Problem	Persona	Impact	Pitch
KZPMK (KZ)	Inability to compile and share information in real-time. The Environmental Health Program compiles activities by each region. Each region has its own ‘system’ to track this data; consolidation for reporting is incredibly time consuming and has potentials for human error as the synthesis is done manually. How can we support a decentralized model to collect and track data with improved accuracy and speed?	Environmental Health Officer	Ability to generate accurate reports, in real-time and improve efficiency and productivity.	Auto file consolidation “dropbox” (auto reconciliation). A data synthesis system that allows regions to drop/submit files in any data format; generates standardized reports required for various stakeholders without the need for any human intervention.
Storm	How might reducing the time to take inspection notes for inspectors in order to increase productivity and efficiency for inspectors? (Site inspection note taking is a time-intensive activity. Are there ways to improve the process?)	public, inspector, management, industry, HQ	Shorter inspection times; more “inspections” complete; quality of reports; collaboration with industry	A program that reads all company documents and generates a report.
Vanilla#	(Start) Case management record keeping is disjointed; needs modernization.	ROEB Employees Steve and Alison	accuracy of information available in systems; efficient processes that drive business outcomes; accessibility of real-time information	An incentivised system to promote individual competition within public service by using training, vacation, and other ‘currencies’ to enable higher outputs.

Image 2:Ideas from Toronto session mapped against Value and Complexity.

Once the groups presented their problem and idea, it was mapped against two variables: value and complexity. This provided an opportunity to evaluate potential effort and the return on investment. By no means was this exercise scientific. As part of the continuous learning incorporated within design thinking, check points to question and criticize are critical to ensure probability of success. This exercise was used as one mechanism to quickly discuss and evaluate the solution.

Results from Montreal

The Montreal co-design workshop was on February 27, 2020, at 200 Boulevard René Lévesque Ouest, Complexe Guy Favreau. Twelve participants attended the session, along with five facilitators and presenters (Martin Bernard, Peter Yoon, Amy McDonald, Sarah Kennedy, Scott McNaughton). The session had 18 people who registered; due to weather and various operational pressures, some were not able to attend. As part of the registration process enabled by Eventbrite, participants were asked to submit a problem or opportunity they are passionate about. The following is the list provided by many that registered prior to the workshop.

To list all information of products inspected by hand writing.
Comment mieux gérer les nombreux et très complexes documents soumis dans le cadre du processus d'évaluation des impacts d'un projet? L'objectif étant d'assurer la transparence et une accessibilité de l'information pour le public.
Complex laboratory analysis of new substances available on the market.
As a team lead, a project that we are putting in place to ensure uniformity across country need anti-resistance strategy. Also, the direction seems to be transfer from RORB to OCS during the deployment.
Environnement de travail sans papier et automatisation de rapport de base de donnée.
How to better use and/or link databases across the branch in order to complement each other and have more complete and reliable data.
How to have data available in a more timely manner using automation in order to take action to improve the health of Canadians.
I’m a new employee at ROEB and I don’t know if I have all the relevant data available to make a reliable decision when regulating health products. It seems that many systems and sources each provide one piece of the puzzle; what I’m missing the big picture. How can I be more confident that I’m using all the right data – and that I can trust that data?
I found some data that could be valuable for my work but leveraging it isn’t easy – it’s in a proprietary format and I need to do a manual extract and go through several cleansing steps to be able to use it.
How can I make this more straightforward and easier?
Équipe dispersée et plusieurs intervenants dans notre programme.
Le manque de ressources dans un contexte où il y a de multiples priorités à gérer.
There is no consistency on how tobacco industry keeps track of their internal documentation (No GMP required). Difficult to audit.
Streamlining the initial inspection process (based on risk). Initial inspections are added work on top of regular scheduled inspections. Is it always necessary to go onsite?
Is there a better way we can tackle learning about inspections for those that are new? How can we transfer experience from experts to novice employees in a more efficient way?

During the afternoon portion of the workshop, two teams of 5 and 6 were formed to apply a hybrid ‘design thinking’ approach. This approach combined Human Centric Design and the Double Diamond Design models. The goal was to help participants feel comfortable with a different process/approach to problem solving. Each group was asked to choose one of the 15 submitted problems/opportunities; they were also given the choice to present a new problem if desired. The following are the summaries from the exercise.


Team Name/Nom de l'équipe	Problem/Problématique	Persona/Personnage	Impact	Pitch/pas
HC.13.5-001 (HC.13)	How can we allow the supervisor to adequately plan on-site inspections based on the risk in order to ensure that we are fulfilling our mandate as efficiently as possible within our allocated budget?	Supervisor/manager	Performance measurement indicators, Improved compliance level of the industry, Improved impact of the inspections, Ability to use inspection data, User friendly for the supervisor/manager, Completing the inspections within the allocated budget, Reduced stress level for inspectors and management, Meeting inspections number goal.	Risk assessment tool using inspection and regulated parties data in real time
Multitaskers (M)	Les inspecteurs estiment que l'industrie est de plus en plus frustrée par tous les organismes d'inspection (SC, AAM, OMS) en raison du manque de la coordination dans les dates d'inspection. Les inspecteurs des différentes agences se présentent souvent à quelques jours d'intervalle pour examiner les mêmes produits/services dans les laboratoires. Les inspecteurs sont tout aussi frustrés, car ils traitent ces plaintes depuis des années et pensent qu'il y a une duplication du travail, ce qui résulte en un gaspillage de temps et de ressources.	Hugo	Promouvoir une culture. Réduire les coûts. Promouvoir une bonne santé mentale. Solution proposée: Les inspecteurs proposent de développé un calendrier ou un système de planification qui établit un lien entre les visites et les rapports des d'inspection. Ce système permettrait d'éviter la duplication des inspections, de fournir un moyen de communication et un calendrier à la fois aux inspecteurs et à l'industrie, ce qui permet d'économiser du temps et des ressources.

Image 3: Ideas from Montreal session mapped against Value and Complexity.

Once the groups presented their problem and idea, it was mapped against two variables: value and complexity. This provided an opportunity to evaluate potential effort and the return on investment. By no means was this exercise scientific. As part of the continuous learning incorporated within design thinking, check points to question and criticize are critical to ensure probability of success. This exercise was used as one mechanism to quickly discuss and evaluate the solution.

Observation & Comments

Planning for the innovation workshop began in June 2019. The original plan was to visit six cities to share, learn, and co-create in Burnaby, Edmonton, Winnipeg, Toronto, Montreal, and Halifax. Due to various factors, the workshops were limited to Toronto and Montreal. Many observations and lessons have been collected; POD-TBI is looking to use these lessons to continuously improve efforts to engage and collaborate with internal and external partners. The following are a list of observations and comments from prior, during, and after the Toronto and Montreal workshops.

Why many people did not register:

Not able to obtain approval from manager
Not enough awareness
No travel policies close to year-end
Operational requirements prevented participating in an all-day workshop
Collision with priorities with year-end activities
Communication and outreach lacked reach
Description, purpose, and intent was not clear
Employees felt the material/topic is not applicable to their work
Lack of flexibility and empowerment from manager

What Worked Well

Both venues in Toronto and Montreal were excellent for workshop formats
Collection of speakers were diverse with a good range in perspectives
The programming for the day was well sequenced
The co-design workshop had positive participation energy from all attendees
Collecting the problem statements in advance expedited the workshop
Open and safe atmosphere for sharing and collaborating
Attendees were open to learning and exploring

What Didn’t Work Well:

Greater advanced notice of workshop may have allowed more people to register
Email from ADMO was not noticed by many
Content from industry did not connect well with audience (was cut for Montreal)
Speakers that participated via WebEx were not able to connect as well as those in person
The experimentation and innovation ‘primer’ video was not well viewed by attendees
Communication and promotion could be improved increase reach
Slido was not well used (this could be a sign that all participants felt comfortable to engage directly during workshop, instead of resorting to Slido)
Greater consistency between co-design sessions to improve comparative analysis between cities
Purpose of workshop could have been clearer; linked to communication and promotion

General Comments:

Attempting to run six sessions in one month across the country would have been difficult
The culture for change is not consistent across Canada
Participants were engaged and motivation increase as day progressed
Participants were putting into practice what they learned in the morning. We saw a change/growth in their mindset
Respectful and appreciative of each other and the presenters
Many great questions were raised – a sign of high interest from attendees
There seems to be a desire to have more sessions like these
Feedback in general have been extremely positive
Participants requested more information to support their continuous learning on innovation/experimentation/design-thinking/solution funds
There is an appetite for more information on new and existing innovation project

Next Steps

As part of the open approach taken to deliver the workshop, it was made clear that POD-TBI are not experts in innovation, experimentation, or even applying design approaches to problems. The goal was to connect with as many ROEB employees as possible throughout Canada and share our story, and use the forum as a launch pad to collaborate, co-develop, co-design a transformative future of our Branch.

A single day workshop is not sufficient to train and equip anyone of all tools needed to experiment toward innovation. The intent was to allow participants to have an introduction to already existing experiments underway within ROEB and harness a path forward to continuously learn together, by working on projects together. To ensure this is possible, POD-TBI made the following three commitments:

Share all information presented and collected during the workshop with not only those that participated, but with all of ROEB;
Follow up with all those registered to explore the submitted problems further through whatever means necessary that is appropriate, including the five ideas generated in Montreal and Toronto;
Maintain openness and the willingness to learn and share together to ensure our Branch employees has a safe place to explore problems/opportunities using controlled testing methodologies.

The initial feedback has been incredibly positive. The innovation team at POD-TBI is planning to run future workshops, next being scheduled within the National Capital Region in the coming Fiscal Year.

Finally, a note to those that participated. Without their commitment to learn and opening themselves to a workshop that put an emphasis on learning together, this experience would not have been a success. The ability to leverage vulnerability to explore and learn is a critical component of experimentation.