|
Special Edition of the CES AB/NWT Newsletter
CES National Conference 2025
Doing Good (In) Evaluation: the Basics and Beyond
May 12, 14 and 16, 2025
The Canadian Evaluation Society's wildly popular annual National Conference is a mere 3 weeks away. It looks to be three days of interesting presentations, workshops, seminars and panels, all curated to meet the professional development needs of you, our members.
Given the state of the world, it will also serve as an important opportunity to come together as colleagues and, through participation, engagement and discussion, try to make sense of where our world is headed.
In addition to promoting the conference, we are issuing this "special edition" newsletter to create awareness about specific conference events that are being presented, in whole or in part, by your AB/NWT Chapter colleagues at this year's conference. We encourage you to review the list below and sign up today for the presentations, workshops, meetup and panels that interest you. Dates for each event are highlighted in blue at the bottom of each abstract.
We look forward to seeing you at the Conference!
General information about the conference is available here.
The full conference program is here.
Online registration is open and available to members in good standing (you) here.
| | Post Conference Watch Parties | | |
Join Us for CES Watch Parties – Coming in June 2025!
Reconnect, recharge, and rewatch! CES Watch Parties are coming to Edmonton, Calgary, and Yellowknife this June (after the conference). These in-person gatherings are your chance to explore CES 2025 conference sessions that sparked particular interest among evaluators in Alberta and the Northwest Territories—and to dig deeper into the ideas that matter most in our region.
Let’s learn together and grow the field—one conversation at a time.
In-person. Local. Collaborative.
📆 Early June – Dates and session info coming soon!
| |
|
1. Title: How and why pragmatic evaluation is most suitable framework for qualitative
data
Abstract:
This presentation will explain how and why pragmatic evaluation is most suitable framework for qualitative data that is experiential or phenomenological. Mixed methods for quantifying this data will be explored. Standpoint analysis techniques will also be described. As well, modelling will be a key tool to unraveling the experience of users. To end, attendees will be encouraged to adopt a technique to report and reveal the details for these experiences, in a way that is most easy to understand by their client and audience.
Presenter: Janette Leung
Date/Time: May 12, 14:15-14:45
2. Title: How well does the Co-design Approach Work with Teams in Healthcare?
Learning through Developmental Evaluation
Abstract:
Over the past five years, co-design, also referred to as co-development/co-production, has been used in different sectors including healthcare. However, not many have evaluated co-design either as an approach or in terms of its effectiveness. In our work within Alberta Health Services, we explored the development, implementation and evaluation of a phased co-design approach with diverse care setting teams consisting of staff, care providers, leaders, patient/family advisors, quality and safety consultants and others. We applied Developmental Evaluation throughout the co-design phases capturing the experiences and perspectives of all those involved in the different care settings. Our evaluation questions explored individual and collective team dynamics, engagement/involvement and various experiences including with clarity/understanding what, how, why, and when of the co-design process and related outcomes. As data were gathered in real time, we applied the findings to make adjustments to the co- design approach to improve the experiences and outcomes of those involved. Based on all of the findings across the different care settings we were able to refine our co-design approach and develop a guide which others can apply, not only in healthcare but other sectors as well. We will share what we did and the results, including the Developmental Evaluation methodology.
Presenters: Katharina Kovacs Burns, Marian George
Date/Time: May 12, 14:15-14:45
3. Title: Doing Good, Getting Better: The Role of Professionalization in Elevating
Canadian Evaluation Practice
Abstract:
This presentation examines the role of professionalization in elevating the practice, positioning, and employability of evaluators, with a focus on its impact in Canada and insights from international contexts. Grounded in research conducted as part of a dissertation, the study explores the influence of the Canadian Evaluation Society’s Professional Designation Program and its CE credential. Using a mixed, multi-methods approach, data were collected from Canadian and international evaluators to assess how professionalization shapes the field and practitioners’ contributions to ethical and effective evaluation practice. The findings highlight the complexities of professionalization, including its socially constructed nature, challenges in implementing qualification-based models, and its multifaceted impact on the profession. The presentation offers comparative insights between Canada and other international models, exploring the experiences of credentialed evaluators and their perceptions of professionalization's role in advancing "doing good" in evaluation. By addressing these dimensions, the session provides valuable reflections for practitioners, policymakers, and professional associations. Attendees will leave with a deeper understanding of professionalization’s role in strengthening evaluators' capacity to deliver impactful work and strategies to apply these findings to their own contexts. This research contributes to ongoing efforts to develop the evaluation profession globally.
Presenter: Krista Brower
Date/Time: May 14, 11:30-12:00
4. Title: Data-Driven Policing: An Interim Evaluation of the EPS Crime Reduction Plan in Downtown Edmonton
Abstract:
The Edmonton Police Service (EPS) is committed to combating crime and fostering community safety partnerships. To this end, the EPS Crime Reduction Plan aims to reduce violent crime and weapons offenses in Edmonton. Teams of police officers are proactively deployed to high-crime areas to apply data-driven interventions designed to prevent further incidents. The plan employs three evidence-based policing strategies: high-visibility policing, problem-oriented policing, and focused deterrence, all underpinned by intelligence. Geographic information systems (GIS) identified areas for the Crime Plan, dividing the city into 100m x 100m cells. Crime data highlighted cells with elevated violent crime rates. The evaluators developed tools to support police officers monitor their fidelity to the plan and performance. An evaluation rubric facilitated regular review and decision-making. Initial results suggest the Crime Plan reduced violence and weapon incidents in the targeted grids. This presentation will support technical competency development by describing the findings from a six-month interim evaluation of the Crime Plan, and the advanced methods used to collect and analyze the data to arrive at the findings. The presenters will reflect on the value of adapting “basic” evaluation principles to empower people to make frontline data-based decisions and hold themselves accountable for performance.
Presenters: Stephanie Gazzola, Wijaya Dassanayake
Date/Time: May 14, 12:30-13:00
5. Title: Forget About the Funders For a Moment: Carving Out a Space for Internal
Evaluation at a Social Impact Nonprofit
Abstract:
In the funding cycle-driven nonprofit world, program data are collected and analyzed primarily for use in funding reports and applications, but many program staff do not see this data reported back to themselves. They record activities and administer questionnaires because “the funders want it”, and may regard these tasks as administrative busywork that hold little relevance to their daily practice, especially in the face of ever-shifting reporting requirements. The perception of evaluation in this scenario is simple number crunching to help secure funding for another cycle. This presentation describes efforts to address worker apathy/antipathy toward evaluation and cultivate a culture of developmental evaluation at a social impact nonprofit – i.e. evaluation that is internally-oriented, not tied to funding requirements, embedded with programs and ongoing, co-interpretive with program staff, and oriented toward identifying successes and opportunities. This entailed presenting program data to teams to discuss alignment of practice to theories of change and the potential need for revision, exploring concerns about the appropriateness, validity, and clinical utility of mandated questionnaires, advising on how to navigate the administration of questionnaires to vulnerable populations in a trauma-informed manner, and surveying staff on the uses that they have for evaluation "products"
Presenters: Mitchell Parkinson
Date/Time: May 14, 15:45-16:15
6. Title: Beyond the basics of evaluation in law enforcement: evaluating the Human-
centered Engagement Liaison Partnership (HELP)
Abstract:
The Impact and Evaluation Section (IES) at the Edmonton Police Service (EPS) in Alberta, Canada is responsible for leading large-scale evaluations and providing consultation support on initiatives across the service. From 2023 to 2024, the IES completed an evaluation of the Human-centered Engagement Liaison Partnership (HELP), a multi-disciplinary program that pairs civilian navigators from social agencies with EPS constables. This evaluation went beyond a basic process or outcome evaluation to comprehensively explore the health of the HELP partnership and its stakeholder relationships. Guided by a project team, the evaluation also incorporated a collaborative approach and equity lens. In this presentation, I will discuss the rationale for this approach, key considerations for ensuring its appropriateness, and the challenges and opportunities of implementing collaborative evaluation in a law enforcement context. I will also share lessons learned, some cautions, and practical examples of how these lessons can be applied to doing good evaluation in other contexts.
Presenter: Kayla Atkey
Date/Time: May 14, 16:30-17:00
| | |
1. Title: Doing Good (Evaluation) in Law Enforcement
Abstract:
What is good law enforcement? What does it mean to be effective, efficient, and equitable in policing? These are questions that evaluators in law enforcement ask and answer daily. On one hand, policing practices and budgets are under increased public scrutiny. On another, technological innovations are presenting opportunities and risks to frontline policing, intelligence analysis, and decision-making. This dynamic context requires dynamic evaluation approaches that adapt to innovation while maintaining a foundation in transparency, informed decision- making, high-quality data, and responsible evaluation practices. At this meet-up, evaluators currently working in a law enforcement agency will lead a discussion on doing good evaluation in law enforcement agencies. Situational and reflective competencies will be centered as we navigate a complex and, at times controversial, space. This meet-up is open to evaluators situated in a law enforcement or justice context, and those curious about the unique challenges and opportunities for evaluators in law enforcement.
Facilitator: Stephanie Gazzola
Date/Time: May 12, 15:15-16:15
2. Title: Help us understand your experience
Abstract:
Member experience is about feeling valued, understood, and supported throughout one’s involvement with an organization. It includes the tangible benefits conveyed through membership, as well as the emotional connection of belonging to an organization. The 2024 CES National member survey provided some insights about members’ experiences. We heard members value CES opportunities for professional learning and connecting with other evaluators. Most are satisfied with the Society’s communications, such as the weekly messages, and the website upgrades. We also heard about areas for improvement, as many told us they do not reach out to engage with CES, and they do not use the membership perks and benefits. Join us, the co-Directors of CES Engagement and Memberships, for a lively breakfast discussion to share your experiences as members of CES. Together, let’s explore what helps all of us feel valued and engaged, what we find frustrating, and what keeps us from getting involved with CES. Our collective insights will help strengthen efforts to make belonging to CES a great experience!
Facilitators: Sharlene Wolbeck Minke, Diane Billingsley
Date/Time: May 12, 15:15-16:15
| | |
1. Title: Widening Our Worldview: A Reflective Story On the Evaluation Capacity
Network's Journey Towards Decolonial Practices in Evaluation
Abstract:
Movements to transform evaluation through decolonial, culturally responsive, and equitable approaches are emerging internationally. Despite public commitments to dismantle colonial structures and promote equitable practices, many Canadian Indigenous communities and allies feel that colonization still permeates evaluation practices and understanding. To build a better future for just and transformative evaluation, collective action and learning are vital in strengthening capacity for culturally responsive evaluation that leverages the perspectives of emerging evaluators and marginalized voices. During this storytelling presentation, we share our reflections from our webinar series on Indigenous-informed methodologies in evaluation. We will share why we curated the webinars, attendee takeaways, and how these sessions highlight various Indigenous perspectives, thereby representing the heterogeneity of Turtle Island’s Indigenous Peoples. We envision our programming as an educational experience for settlers and Indigenous practitioners alike so they can include Indigenous frameworks within their evaluation practices and respectfully serve the highly Indigenous demographics in Canada. The work done through our community-campus partnerships is vital in addressing global and local societal problems. Through this learning journey, we continue to explore educational experiences to support evaluators and practitioners, encourage collaboration, share resources recommended by our facilitators, and create spaces for multiple Indigenous perspectives to be heard.
Storytellers: Aaliyah Jafarian-Oshtbin, Abigail Gallimore, Cheryl Lee-Yow, Melissa Tremblay, Michelle Searle, Rebecca Gokiert
Date/Time: May 14, 16:30-17:00
2. Title: Beyond the Basics: Creating Meaningful, Culturally Relevant Evaluations in Pro- Bono Legal Services
Abstract:
In this session, we will share a personal journey that highlights the challenges and triumphs of creating meaningful, culturally relevant evaluations in the pro bono legal services sector. Beginning with Western methods of evaluation—basic surveys, case reviews, and legal outcomes— then evolving as we navigated the limitations of these approaches in capturing the full impact of justice-based services. Through engaging with clients, communities, and cultural advisors, we push beyond these conventional methods to incorporate trauma-informed and culturally sensitive evaluation practices, often drawing on Indigenous and non-Western perspectives. This narrative will explore both the successes and the struggles of applying these alternative approaches in real-world legal services, where Western evaluation practices often clash with the realities of serving marginalized communities. By sharing these authentic experiences, we hope to spark a broader conversation about how we, as evaluators, can embrace new ways of measuring success—ways that prioritize equity, dignity, and social justice while honoring the voices of those we serve. Through this storytelling journey, we invite participants to reflect on their own experiences, challenge western evaluation norms, and consider how they might also push beyond the basics to create truly transformative evaluations.
Storytellers: Melina deKoninck, Sarah Sinclair
Date/Time: May 16, 13:00-14:00
| | |
1. Title: Telling a Story of Collective Impact through Individual and Collaborative
Evaluations in the Network Environments for Indigenous Health Research (NEIHRs)
Abstract:
In 2019, the Canadian Institutes of Health Research (CIHR), announced the creation of nine Network Environments for Indigenous Health Research (NEIHR) across Canada along with a National Coordinating Centre as a secretariat. With the Canadian Government’s largest single investment ever, these networks are intended to be funded from 2020-2035. Each autonomous NEIHR aims to provide supportive Indigenous health research environments driven by and grounded in Indigenous communities. The NEIHRs are being evaluated at the regional and national level, for their communities and for CIHR. Evaluation has proven challenging as there are few models for Indigenous evaluation of networks, particularly at the national level, to evaluate the impact of a network of networks. This panel will provide an overview of Indigenous evaluation approaches used across individual NEIHRs, including strengths and limitations. It will also explore strengths and challenges of the current national performance measurement framework and discuss alternate approaches. The discussion will include the needs of NEIHRs’ diverse stakeholders and striking a balance between conventional evaluation methods (e.g., Rossi, Lipsey, Henry, 2018), Indigenous approaches to evaluation (e.g., LaFrance & Nichols, 2009), and potentially complementary approaches (e.g., Patton, 2017), and how each can help tell the story of NEIHRs’ collective impact.
Panelists: Adam Murry, Fleur Macqueen Smith, Krista Stelkia, Leila Qashu, Marni Amirault, Micheal Heimlick, Mikaela Gabriel, Sabina Mirza, Sherri Bisset, Sulia'n Johnson, Tara Erb
Date/Time: May 14, 12:30-13:30
2. Title: Indigenous Evaluation Supply and Demand: highlights from new and
established practitioners
Abstract:
The Canadian Evaluation Society is committed to advancing reconciliation and Indigenous sovereignty and to implementing recommendations from the UNDRIP Working Group report presented in May 2024. This includes partnerships to offer financial and organizational supports required to strengthen the presence and influence of Indigenous evaluators in the field. In this panel, emerging and established Indigenous evaluators from across the continent will discuss significant milestones as ongoing priorities related to the production and use, supply and demand, of evaluation by, for and as Indigenous practitioners.
Panelists: Debbie Delancey, Madelynn Slade, Terrelynn Fearn
Date/Time: May 16, 13:00-14:00
| | |
1. Title: miywatoskêwin: Doing Good
Abstract:
This 3-hour workshop explores Indigenous evaluation frameworks within a municipal community context. We'll delve into the limitations of traditional evaluation models when applied to Indigenous initiatives and discuss culturally appropriate alternatives that prioritize self-determination, Indigenous knowledge systems, and community-driven priorities. Participants will learn about key principles such as respect, reciprocity, and responsibility, and how these inform evaluation design and implementation at a City level. The workshop includes a digital hands-on community mapping activity. This interactive session will demonstrate how mapping can be a powerful tool for gathering qualitative data, visualizing community assets and needs, and fostering collaborative evaluation processes. Participants will gain practical skills in using mapping techniques to support culturally responsive and meaningful evaluation in their own work.
Facilitator: Madelynn Slade
Date/Time: May 15, 14:30-17:30
| | |
Questions? Comments? Contact us at:
cesab-admin@evaluationcanada.ca
| | | | |