Developmental Evaluation in Action: The Team Primary Care Experience
In 2022, LogicalOutcomes set out to support the largest developmental evaluation in Canadian history. 18 months later, we reflect on some key project achievements and evaluation learnings. What a ride!
About Team Primary Care
Team Primary Care: Training for Transformation was an initiative that aimed to accelerate transformative change in the way primary care practitioners train to work together. The initiative brought together an extensive network of partners to enhance the capacity of interprofessional comprehensive primary care through improved training for practitioners, supports for teams, and tools for planners and employers.
The initiative
engaged over 15,000 individuals
supported more than 40 project partners at both national and provincial levels
represented more than 7,000 individuals from equity-deserving groups
collaborated with over 20 provider groups and educational organizations
connected with more than 200 organizations involved in primary care practice, education, policy, and government.
Through its comprehensive approach, TPC identified crucial needs in the healthcare system, including the importance of embedding interprofessional and primary care competencies into the training of all health practitioners, enhancing team-based care at every level, and redesigning training across all professions guided by core principles of Interprofessionalism, Equity Diversity Inclusion and Accountability, Truth and Reconciliation, Psychological Health and Safety, and Social Accountability.
Ending the project on a high note, a Call to Action was unveiled at the TPC Summit in February, urging governments to invest in policy, training, and infrastructure reforms to support effective team-based comprehensive primary care. The Call was endorsed by over 800 individuals and 24 healthcare organizations.
Key findings from the evaluation of the TPC project highlighted the importance of diverse partnerships, cultural humility in advancing health equity, and the power of open collaboration in creating sustainable innovation within primary care communities.
Photo: DE team member Marie-Claire (in purple) captures insights from a conversation table at the TPC Summit in February.
Team Work makes the Dream Work
In addition to managing funder required data collection and reporting for the project*, LogicalOutcomes recruited 8 developmental evaluators from across Canada.
Joining two Senior Developmental Evaluators Martha McGuire and Zeenat Ladak, the ‘DE’ team included Doug Archibald, Richard Buote, Jennifer Fawcett, Setareh Rouhani, Marie-Claire Ishimo, Shera Hosseini, Michee-Ana Hamilton, and Scott Christian.
The team flourished under the leadership of Evaluation lead Deena Hamza; Deena is the Director of Research and Innovation, and Evaluation Lead in the Postgraduate Medical Education in the Faculty of Medicine and Dentistry at the University of Alberta. The team received frequent coaching support from evaluation expert Michael Quinn Patton, author of Developmental Evaluation and Frances Westley, known for her work in social innovation.
Photo Left to Right, Sophie and Neil pictured with DE team members Martha, Scott and Jennifer at the Canadian Evaluation Society conference.
In May, some of the DE team presented key insights for conducting large developmental evaluations at the Canadian Evaluation Society conference. View these insights in graphic format on LinkedIn.
Practical insights for conducting large developmental evaluations.
Find your seat at the table: to effectively engage in this work, act as an embedded participant observer and reflective documenter. Approach others with humility and respect, focusing on building relationships by fostering rapport and trust. Take the time to meet people where they are and accompany them on their journey, showing genuine interest and support.
Working in an uncertain, dynamic, complex environment: embrace uncertainty and develop comfort in navigating complex situations. Cultivate an agile toolkit of skills that allows you to pivot as needed. Use reflexivity to guide your story collection and determine the next wise action. Address emerging questions with best-fit methods, adapting your approach to suit the evolving context.
Teamwork makes the dreamwork: Invest in the growth and development of your evaluation team. Hold regular meetings that balance technical content with unstructured discussions. Create opportunities for generative sharing and peer support, fostering a collaborative and supportive environment where team members can learn from and inspire each other.
Have an appreciative eye, and generative voice: Adopt a value-laden approach that focuses on strengths and possibilities. Use generative questions to stimulate momentum and inspire positive change. Build confidence in the appreciative approach by sharing progress and insights regularly, demonstrating the value of this perspective in driving meaningful outcomes.
In conclusion
The Team Primary Care project has not only set a new standard for developmental evaluation in Canada but has also illuminated a path forward for primary care reform. As we reflect on this journey, we're filled with gratitude for the dedication of our evaluation team, project leadership and all those who participated. Their collective efforts have laid a foundation for a more equitable, efficient, and responsive healthcare system – a legacy that will benefit Canadians for generations to come.
* The TPC data system included
Bilingual data privacy agreements signed by 40 project partners
Unique survey links emailed to each partner over 18 months/five reporting periods.
PowerBi dashboard reports for Activities, Outputs, and participant counts
Data analysis coaching and support
Ad hoc evaluation and feedback surveys
LogicalOutcomes managed all aspects, including direct partner communications, support, technical design, maintenance and archiving.