References | Optimising the impact of health services research on the organisation and delivery of health services: a mixed-methods study

Optimising the impact of health services research on the organisation and delivery of health services: a mixed-methods study · References

References

Lomas J. Essay: using ‘linkage and exchange’ to move research into policy at a Canadian foundation: encouraging partnerships between researchers and policymakers is the goal of a promising new Canadian initiative. Health Aff 2000;19:236–40. 10.1377/hlthaff.19.3.236
Rycroft-Malone J, Wilkinson J, Burton CR, Harvey G, McCormack B, Graham I, Staniszewska S. Collaborative action around implementation in Collaborations for Leadership in Applied Health Research and Care: towards a programme theory. J Health Serv Res Policy 2013;18(Suppl. 3):13–26. 10.1177/1355819613498859
Davies HT, Powell AE, Nutley SM. Mobilising knowledge to improve UK health care: learning from other countries and other sectors – a multimethod mapping study. Health Serv Deliv Res 2015;3(27). 10.3310/hsdr03270
Boaz A, Davies H, Fraser A, Nutley S. What Works Now? Evidence-informed Policy and Practice. Bristol: Policy Press; 2019.
Mitton C, Adair CE, McKenzie E, Patten SB, Waye Perry B. Knowledge transfer and exchange: review and synthesis of the literature. Milbank Q 2007;85:729–68. 10.1111/j.1468-0009.2007.00506.x18070335
Greenhalgh T, Wieringa S. Is it time to drop the ‘knowledge translation’ metaphor? A critical literature review. J R Soc Med 2011;104:501–9. 10.1258/jrsm.2011.11028522179293
Engebretsen E, Sandset TJ, Ødemark J. Expanding the knowledge translation metaphor. Health Res Pol Syst 2017;15:19. 10.1186/s12961-017-0184-x
Ferlie E, Crilly T, Jashapara A, Peckham A. Knowledge mobilisation in healthcare: a critical review of health sector and generic management literature. Soc Sci Med 2012;74:1297–304. 10.1016/j.socscimed.2011.11.04222385813
Nutley S, Walter I, Davies H. Using Evidence: How Research Can Inform Public Services. Bristol: Policy Press; 2007. 10.2307/j.ctt9qgwt1
Soper B, Hinrichs S, Drabble S, Yaqub O, Marjanovic S, Hanney S, et al. Delivering the aims of the Collaborations for Leadership in Applied Health Research and Care: understanding their strategies and contributions. Health Serv Deliv Res 2015;3(25). 10.3310/hsdr03250
Salter KL, Kothari A. Knowledge ‘translation’ as social learning: negotiating the uptake of research-based knowledge in practice. BMC Med Educ 2016;16:76. 10.1186/s12909-016-0585-526925578
Bullock A, Morris ZS, Atwell C. A Formative Evaluation of the Service Delivery and Organisation (SDO) Management Fellowships. Final Report. Southampton: NIHR Service Delivery and Organisation programme; 2012.
Currie G, Waring J, Finn R. The limits of knowledge management for UK public services modernization: the case of patient safety and service quality. Public Adm 2008;86:363–85. 10.1111/j.1467-9299.2007.00705.x
Best A, Greenhalgh T, Lewis S, Saul JE, Carroll S, Bitz J. Large-system transformation in health care: a realist review. Milbank Q 2012;90:421–56. 10.1111/j.1468-0009.2012.00670.x22985277
Martin GP, Williams O. Evidence and Service Delivery. In Boaz A, Davies H, Fraser A, Nutley S, editors. What Works Now?: Evidence-Informed Policy and Practice. Bristol: Policy Press; 2019. pp. 41–60.
Kitson A, Brook A, Harvey G, Jordan Z, Marshall R, O’Shea R, Wilson D. Using complexity and network concepts to inform healthcare knowledge translation. Int J Health Policy Manag 2018;7:231–43. 10.15171/ijhpm.2017.7929524952
Beckett K, Farr M, Kothari A, Wye L, le May A. Embracing complexity and uncertainty to create impact: exploring the processes and transformative potential of co-produced research through development of a social impact model. Health Res Policy Syst 2018;16:118. 10.1186/s12961-018-0375-030537975
Reed MS, Stringer LC, Fazey I, Evely AC, Kruijsen JHJ. Five principles for the practice of knowledge exchange in environmental management. J Environ Manage 2014;146:337–45. 10.1016/j.jenvman.2014.07.02125194520
Greenhalgh T, Papoutsi C. Studying complexity in health services research: desperately seeking an overdue paradigm shift. BMC Med 2018;16:95. 10.1186/s12916-018-1089-429921272
Greenhalgh T. What is this knowledge that we seek to ‘exchange’? Milbank Q 2010;88:492. 10.1111/j.1468-0009.2010.00610.x21166867
Wehrens R. Beyond two communities – from research utilization and knowledge translation to co-production? Public Health 2014;128:545–51. 10.1016/j.puhe.2014.02.00424854762
Jackson CL, Greenhalgh T. Co-creation: a new approach to optimising research impact? Med J Aust 2015;203:283–4. 10.5694/mja15.0021926424059
McCabe KE, Wallace A, Crosland A. A model for collaborative working to facilitate knowledge mobilisation in public health. Evid Policy 2015;11:559–76. 10.1332/174426415X14298767491657
Clarke J, Waring J, Timmons S. The challenge of inclusive coproduction: the importance of situated rituals and emotional inclusivity in the coproduction of health research projects. Soc Policy Admin 2019;53:233–48. 10.1111/spol.12459
Duijn M, Rijnveld M, van Hulst M. Meeting in the middle: joining reflection and action in complex public sector projects. Public Money Manag 2010;30:227–33. 10.1080/09540962.2010.492183
Beebeejaun Y, Durose C, Rees J, Richardson J, Richardson L. Public harm or public value? Towards coproduction in research with communities. Environ Plan 2015;33:552–65. 10.1068/c12116
Ostrom E. Crossing the great divide: coproduction, synergy, and development. World Dev 1996;24:1073–87. 10.1016/0305-750X(96)00023-X
Boyle D, Harris M. The Challenge of Co Production: How Equal Partnerships between Professionals and the Public Are Crucial to Improving Public Services. London: New Economics Foundation; 2009.
Osborne SP, Strokosch K. It takes two to tango? Understanding the co-production of public services by integrating the services management and public administration perspectives. Br J Manag 2013;24:S31–S47. 10.1111/1467-8551.12010
Orr K, Bennett M. The politics of co-produced research: editorial. Public Money Manag 2010;30:199–203. 10.1080/09540962.2010.492171
Orr K, Bennett M. Public administration scholarship and the politics of coproducing academic–practitioner research. Public Adm Rev 2012;72:487–95. 10.1111/j.1540-6210.2011.02522.x
Heaton J, Day J, Britten N. Collaborative research and the co-production of knowledge for practice: an illustrative case study. Implement Sci 2016;11:20. 10.1186/s13012-016-0383-926897169
Rycroft-Malone J, Burton CR, Bucknall T, Graham ID, Hutchinson AM, Stacey D. Collaboration and co-production of knowledge in healthcare: opportunities and challenges. Int J Health Policy Manag 2016;5:221–3. 10.15171/ijhpm.2016.0827239867
Brandsen T, Verschuere B, Pestoff V. Conclusion: Taking Research on Co-production a Step Further. In Pestoff V, Brandsen T, Verschuere B, editors. New Public Governance, the Third Sector, and Co-Production. London: Routledge; 2012. pp. 399–406. 10.4324/9780203152294-29
Verschuere B, Brandsen T, Pestoff V. Co-production: the state of the art in research and the future agenda. VOLUNTAS 2012;23:1083–101. 10.1007/s11266-012-9307-8
Durose C, Needham C, Mangan C, Rees J. Generating ‘good enough’ evidence for co-production. Evid Policy 2017;13:135–51. 10.1332/174426415X14440619792955
Hewison A, Gale N, Shapiro J. Co-production in research: some reflections on the experience of engaging practitioners in health research. Public Money Manag 2012;32:297–302. 10.1080/09540962.2012.691311
Flinders M, Wood M, Cunningham M. The politics of co-production: risks, limits and pollution. Evid Policy 2016;12:261–79. 10.1332/174426415X14412037949967
Crompton A. Inside co-production: stakeholder meaning and situated practice. Soc Policy Admin 2019;53:219–32. 10.1111/spol.12466
Bell DM, Pahl K. Co-production: towards a utopian approach. Int J Soc Res Methodol 2018;21:105–17. 10.1080/13645579.2017.1348581
Weiss CH. Research for policy’s sake: the enlightenment function of social research. Policy Anal 1977;3:531–45.
Kothari A, Wathen CN. Integrated knowledge translation: digging deeper, moving forward. J Epidemiol Community Health 2017;71:619–23. 10.1136/jech-2016-20849028298415
Miles S, Renedo A, Marston C. ‘Slow co-production’ for deeper patient involvement in health care. JHD 2018;3:57–62. 10.21853/JHD.2018.39
Pollard K, Moule P, Evans D, Donald C, Donskoy A, Rice C. User Engagement in the Co-production of Knowledge for Knowledge Exchange in Health and Social Care. Bristol: University of the West of England Bristol; 2020.
Kislov R, Wilson PM, Knowles S, Boaden R. Learning from the emergence of NIHR Collaborations for Leadership in Applied Health Research and Care (CLAHRCs): a systematic review of evaluations. Implement Sci 2018;13:111. 10.1186/s13012-018-0805-y30111339
Boaz A, Hanney S, Borst R, O’Shea A, Kok M. How to engage stakeholders in research: design principles to support improvement. Health Res Policy Syst 2018;16:60. 10.1186/s12961-018-0337-629996848
Gradinger F, Elston J, Asthana S, Martin S, Byng R. Reflections on the researcher-in-residence model co-producing knowledge for action in an integrated care organisation: a mixed methods case study using an impact survey and field notes. Evid Pol 2019;15:197–215. 10.1332/174426419X15538508969850
Gagliardi AR, Berta W, Kothari A, Boyko J, Urquhart R. Integrated knowledge translation (IKT) in health care: a scoping review. Implement Sci 2016;11:38. 10.1186/s13012-016-0399-126988000
Graham ID, Kothari A, McCutcheon C, Integrated Knowledge Translation Research Network Project Leads. Moving knowledge into action for more effective practice, programmes and policy: protocol for a research programme on integrated knowledge translation. Implement Sci 2018;13:22. 10.1186/s13012-017-0700-y29394932
Bailie J, Cunningham FC, Bainbridge RG, Passey ME, Laycock AF, Bailie RS, et al. Comparing and contrasting ‘innovation platforms’ with other forms of professional networks for strengthening primary healthcare systems for Indigenous Australians. BMJ Glob Health 2018;3:e000683. 10.1136/bmjgh-2017-000683
Kanani N, Hahn EE, Gould MK, Brunisholz KD, Savitz LA, Holve EC. Academy Health’s Delivery System Science Fellowship: training embedded researchers to design, implement, and evaluate new models of care. J Hosp Med 2017;12:570–4. 10.12788/jhm.277628699948
Ghaffar A, Langlois EV, Rasanathan K, Peterson S, Adedokun L, Tran NT. Strengthening health systems through embedded research. Bull World Health Organ 2017;95:87. 10.2471/BLT.16.18912628250505
Glegg SM, Hoens A. Role domains of knowledge brokering: a model for the health care setting. J Neurol Phys Ther 2016;40:115–23. 10.1097/NPT.000000000000012226937654
Hoens AM, Reid WD, Camp PG. Knowledge brokering: an innovative model for supporting evidence-informed practice in respiratory care. Can Respir J 2013;20:271–4. 10.1155/2013/12165423936885
Ward V, Smith S, House A, Hamer S. Exploring knowledge exchange: a useful framework for practice and policy. Soc Sci Med 2012;74:297–304. 10.1016/j.socscimed.2011.09.02122014420
Wright N. First-time knowledge brokers in health care: the experiences of nurses and allied health professionals of bridging the research-practice gap. Evid Pol 2013;9:557–70. 10.1332/174426413X13836462527470
Chew S, Armstrong N, Martin G. Institutionalising knowledge brokering as a sustainable knowledge translation solution in healthcare: how can it work in practice? Evid Pol 2013;9:335–51. 10.1332/174426413X662734
Frost H, Geddes R, Haw S, Jackson CA, Jepson R, Mooney JD, et al. Experiences of knowledge brokering for evidence-informed public health policy and practice: three years of the Scottish Collaboration for Public Health Research and Policy. Evid Pol 2012;8:347–59. 10.1332/174426412X654068
Booth A. Bridging the ‘Know–Do Gap’: a role for health information professionals? Health Info Libr J 2011;28:331–4. 10.1111/j.1471-1842.2011.00960.x22051133
Dobbins M, Greco L, Yost J, Traynor R, Decorby-Watson K, Yousefi-Nooraie R. A description of a tailored knowledge translation intervention delivered by knowledge brokers within public health departments in Canada. Health Res Policy Syst 2019;17:63. 10.1186/s12961-019-0460-z31221187
Marshall MN. Bridging the ivory towers and the swampy lowlands; increasing the impact of health services research on quality improvement. Int J Qual Health Care 2014;26:1–5. 10.1093/intqhc/mzt076
Marshall M. Researchers-in-residence: a solution to the challenge of evidence-informed improvement? Prim Health Care Res Dev 2014;15:337–8. 10.1017/S146342361400031025111565
Marshall M, Eyre L, Lalani M, Khan S, Mann S, de Silva D, Shapiro J. Increasing the impact of health services research on service improvement: the researcher-in-residence model. J R Soc Med 2016;109:220–5. 10.1177/014107681663431826933156
Eyre L, George B, Marshall M. Protocol for a process-oriented qualitative evaluation of the Waltham Forest and East London Collaborative (WELC) integrated care pioneer programme using the researcher-in-residence model. BMJ Open 2015;5:e009567. 10.1136/bmjopen-2015-009567
Vindrola-Padros C, Eyre L, Baxter H, Cramer H, George B, Wye L, et al. Addressing the challenges of knowledge co-production in quality improvement: learning from the implementation of the researcher-in-residence model. BMJ Qual Saf 2019;28:67–73. 10.1136/bmjqs-2017-007127
Langley J, Wolstenholme D, Cooke J. ‘Collective making’ as knowledge mobilisation: the contribution of participatory design in the co-creation of knowledge in healthcare. BMC Health Serv Res 2018;18:585. 10.1186/s12913-018-3397-y30045726
Embedded Research. Embedded Research: Increasing the Influence of Health Services Research on Decisions about the Improvement and Redesign of NHS Services. What is Embedded Research? URL: www.embeddedresearch.org.uk (accessed 1 March 2021).
Bate P, Robert G. Experience-based design: from redesigning the system around the patient to co-designing services with the patient. Qual Saf Health Care 2006;15:307–10. 10.1136/qshc.2005.01652717074863
Snape D, Kirkham J, Preston J, Popay J, Britten N, Collins M, et al. Exploring areas of consensus and conflict around values underpinning public involvement in health and social care research: a modified Delphi study. BMJ Open 2014;4:e004217. 10.1136/bmjopen-2013-004217
Sunderji N, Nicholas EA, Polaha J, Gao C. Why and how to use patient-oriented research to promote translational research. Fam Syst Health 2019;37:1–9. 10.1037/fsh000040530920259
Boaz A, Locock L, Ward V. Whose evidence is it anyway? Evid Pol 2015;11:145–8. 10.1332/174426515X14313738355534
Lancaster K, Seear K, Treloar C, Ritter A. The productive techniques and constitutive effects of ‘evidence-based policy’ and ‘consumer participation’ discourses in health policy processes. Soc Sci Med 2017;176:60–8. 10.1016/j.socscimed.2017.01.03128131022
Kouri D. Knowledge exchange strategies for interventions and policy in public health. Evid Pol 2009;5:71–83. 10.1332/174426409X395420
Ward V. Why, whose, what and how? A framework for knowledge mobilisers. Evid Pol 2017;13:477–97. 10.1332/174426416X14634763278725
Glasziou P, Haynes B. The paths from research to improved health outcomes. Evid Based Nurs 2005;8:36–8. 10.1136/ebn.8.2.3615830412
Dopson S, Locock L, Gabbay J, Ferlie E, Fitzgerald L. Evidence-based medicine and the implementation gap. Health 2003;7:311–30. 10.1177/1363459303007003004
Davies H, Nutley S, Walter I. Why ‘knowledge transfer’ is misconceived for applied social research. J Health Serv Res Policy 2008;13:188–90. 10.1258/jhsrp.2008.00805518573770
Fitzgerald L, Harvey G. Translational networks in healthcare? Evidence on the design and initiation of organizational networks for knowledge mobilization. Soc Sci Med 2015;138:192–200. 10.1016/j.socscimed.2015.06.01526117554
Filipe A, Renedo A, Marston C. The co-production of what? Knowledge, values, and social relations in health care. PLOS Biol 2017;15:e2001403. 10.1371/journal.pbio.200140328467412
Holmes B, Best A, Davies H, Hunter D, Kelly M, Marshall M, et al. Mobilising knowledge in complex health systems: a call to action. Evid Pol 2016;13:539–60. 10.1332/174426416X14712553750311
Palmer VJ, Weavell W, Callander R, Piper D, Richard L, Maher L, et al. The Participatory Zeitgeist: an explanatory theoretical model of change in an era of coproduction and codesign in healthcare improvement. Med Humanit 2019;45:247–57. 10.1136/medhum-2017-01139829954854
Oliver K, Kothari A, Mays N. The dark side of coproduction: do the costs outweigh the benefits for health research? Health Res Pol Syst 2019;17:33. 10.1186/s12961-019-0432-3
Nicholas G, Foote J, Kainz K, Midgley G, Prager K, Zurbriggen C. Towards a heart and soul for co-creative research practice: a systemic approach. Evid Pol 2019;15:353–70. 10.1332/174426419X15578220630571
Smith S, Ward V. The role of boundary maintenance and blurring in a UK collaborative research project: how researchers and health service managers made sense of new ways of working. Soc Sci Med 2015;130:225–33. 10.1016/j.socscimed.2015.02.02325721334
Torraco RJ. Writing integrative literature reviews: guidelines and examples. Hum Resour Dev Rev 2005;4:356–67. 10.1177/1534484305278283
Barnett-Page E, Thomas J. Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol 2009;9:59. 10.1186/1471-2288-9-5919671152
Dixon-Woods M. Using framework-based synthesis for conducting reviews of qualitative studies. BMC Med 2011;9:39. 10.1186/1741-7015-9-3921492447
Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol 2013;13:117. 10.1186/1471-2288-13-11724047204
Jabareen Y. Building a conceptual framework: philosophy, definitions, and procedure. Int J Qual Methods 2009;8:49–62. 10.1177/160940690900800406
Lövbrand E. Co-producing European climate science and policy: a cautionary note on the making of useful knowledge. Sci Public Policy 2011;38:225–36. 10.3152/030234211X12924093660516
Jull J, Giles A, Graham ID. Community-based participatory research and integrated knowledge translation: advancing the co-creation of knowledge. Implement Sci 2017;12:150. 10.1186/s13012-017-0696-329258551
Rowley E, Morriss R, Currie G, Schneider J. Research into practice: Collaboration for Leadership in Applied Health Research and Care (CLAHRC) for Nottinghamshire, Derbyshire, Lincolnshire (NDL). Implement Sci 2012;7:40. 10.1186/1748-5908-7-4022553966
Hutchins K, Lindenfeld LA, Bell KP, Leahy J, Silka L. Strengthening knowledge co-production capacity: examining interest in community-university partnerships. Sustainability 2013;5:3744–70. 10.3390/su5093744
Martin S. Co-production of social research: strategies for engaged scholarship. Public Money Manag 2010;30:211–8. 10.1080/09540962.2010.492180
Greenhalgh T, Jackson C, Shaw S, Janamian T. Achieving research impact through co-creation in community-based health services: literature review and case study. Milbank Q 2016;94:392–429. 10.1111/1468-0009.1219727265562
Klenk N, Meehan K. Climate change and transdisciplinary science: problematizing the integration imperative. Environ Sci Policy 2015;54:160–7. 10.1016/j.envsci.2015.05.017
Brown MB. Politicizing science: conceptions of politics in science and technology studies. Soc Stud Sci 2015;45:3–30. 10.1177/030631271455669425803915
Olesen BR, Nordentoft HM. Walking the talk? A micro-sociological approach to the co-production of knowledge and power in action research. Int J Action Res 2013;9:67–94.
Anderson L, Ellwood P, Coleman C. The impactful academic: relational management education as an intervention for impact. Brit J Manag 2017;28:14–28. 10.1111/1467-8551.12202
Wall TU, McNie E, Garfin GM. Use-inspired science: making science usable by and useful to decision makers. Front Ecol Environ 2017;15:551–9. 10.1002/fee.1735
Scaratti G, Galuppo L, Gorli M, Gozzoli C, Ripamonti S. The social relevance and social impact of knowledge and knowing. Manag Learn 2017;48:57–64. 10.1177/1350507616680563
Antonacopoulou EP. Beyond co-production: practice-relevant scholarship as a foundation for delivering impact through powerful ideas. Public Money Manag 2010;30:219–26. 10.1080/09540962.2010.492182
Pain R, Kesby M, Askins K. Geographies of impact: power, participation and potential. Area 2011;43:183–8. 10.1111/j.1475-4762.2010.00978.x
Cherney A. Academic–industry collaborations and knowledge co-production in the social sciences. J Sociol 2015;51:1003–16. 10.1177/1440783313492237
Bremer S, Meisch S. Co-production in climate change research: reviewing different perspectives. Wiley Interdiscip Rev Clim Change 2017;8:e482. 10.1002/wcc.482
Durose C, Beebeejaun Y, Rees J, Richardson J, Richardson L. Towards Co-production in Research with Communities. Manchester: Arts and Humanities Research Council, The University of Manchester; 2012.
Rossi F, Rosli A, Yip N. Academic engagement as knowledge co-production and implications for impact: evidence from knowledge transfer partnerships. J Bus Res 2017;80:1–9. 10.1016/j.jbusres.2017.06.019
Campbell LK, Svendsen ES, Roman LA. Knowledge co-production at the research–practice interface: embedded case studies from urban forestry. Environ Manage 2016;57:1262–80. 10.1007/s00267-016-0680-826902482
Kitson AL, Harvey G. Methods to succeed in effective knowledge translation in clinical practice. J Nurs Scholarsh 2016;48:294–302. 10.1111/jnu.1220627074390
Kothari A, Hovanec N, Hastie R, Sibbald S. Lessons from the business sector for successful knowledge management in health care: a systematic review. BMC Health Serv Res 2011;11:173. 10.1186/1472-6963-11-17321787403
Nowotny H. Democratising expertise and socially robust knowledge. Sci Public Policy 2003;30:151–6. 10.3152/147154303781780461
Kothari A, Wathen CN. A critical second look at integrated knowledge translation. Health Policy 2013;109:187–91. 10.1016/j.healthpol.2012.11.00423228520
Phillips LJ. Analysing the dialogic turn in the communication of research-based knowledge: an exploration of the tensions in collaborative research. Public Underst Sci 2011;20:80–100. 10.1177/0963662509340092
Pohl C, Rist S, Zimmermann A, Fry P, Gurung GS, Schneider F, et al. Researchers’ roles in knowledge co-production: experience from sustainability research in Kenya, Switzerland, Bolivia and Nepal. Sci Public Policy 2010;37:267–81. 10.3152/030234210X496628
Schuttenberg H, Guth HK. Seeking our shared wisdom: a framework for understanding knowledge coproduction and coproductive capacities. Ecol Soc 2015;20:15. 10.5751/ES-07038-200115
Jagosh J, Macaulay AC, Pluye P, Salsberg J, Bush PL, Henderson J, et al. Uncovering the benefits of participatory research: implications of a realist review for health research and practice. Milbank Q 2012;90:311–46. 10.1111/j.1468-0009.2012.00665.x22709390
Rycroft-Malone J, Langley J. Re-framing the knowledge to action challenge through NIHR knowledge mobilisation research fellows; comment on “CIHR Health System Impact Fellows: Reflections on ‘Driving Change’ within the health system”. Int J Health Policy Manag 2020;9:531–5. 10.15171/ijhpm.2020.0232610771
O’Hare P, Coaffee J, Hawkesworth M. Managing sensitive relations in co-produced planning research. Public Money Manag 2010;30:243–50. 10.1080/09540962.2010.492188
Burns D, Hyde P, Killett A, Poland F, Gray R. Participatory organizational research: examining voice in the co-production of knowledge. Br J Manag 2014;25:133–44. 10.1111/j.1467-8551.2012.00841.x
Klenk NL, Wyatt S. The design and management of multi-stakeholder research networks to maximize knowledge mobilization and innovation opportunities in the forest sector. For Policy Econ 2015;61:77–86. 10.1016/j.forpol.2015.06.008
Fenge L-A, Fannin A, Hicks C. Co-production in scholarly activity: valuing the social capital of lay people and volunteers. J Soc Work 2012;12:545–59. 10.1177/1468017310393796
Arancibia F. Rethinking activism and expertise within environmental health conflicts. Sociol Compass 2016;10:477–90. 10.1111/soc4.12374
Orr K, Bennett M. Down and out at the British Library and other dens of co-production. Manag Learn 2012;43:427–42. 10.1177/1350507612440409
Pinfold V, Szymczynska P, Hamilton S, Peacocke R, Dean S, Clewett N, et al. Co-production in mental health research: reflections from the People Study. MHRJ 2015;20:220–31. 10.1108/MHRJ-09-2015-0028
Lehmann U, Gilson L. Action learning for health system governance: the reward and challenge of co-production. Health Policy Plan 2015;30:957–63. 10.1093/heapol/czu09725161271
Miszczak S, Patel Z. The role of engaged scholarship and co-production to address urban challenges: a case study of the Cape Town Knowledge Transfer Programme. S Afr Geogr J 2018;100:233–48. 10.1080/03736245.2017.1409649
Campbell H, Vanderhoven D. Knowledge that Matters: Realising the Potential of Co-production. Manchester: N8 Research Partnership; 2016.
Polk M. Transdisciplinary co-production: designing and testing a transdisciplinary research framework for societal problem solving. Futures 2015;65:110–22. 10.1016/j.futures.2014.11.001
Bremer S, Funtowicz S. Negotiating a place for sustainability science: narratives from the Waikaraka Estuary in New Zealand. Environ Sci Policy 2015;53:47–59. 10.1016/j.envsci.2014.11.006
Ospina S, El Hadidy W, Hofmann-Pinilla A. Cooperative inquiry for learning and connectedness. Action Learn Res Pract 2008;5:131–47. 10.1080/14767330802185673
Kernick D, Mitchell A. Working with lay people in health service research: a model of co-evolution based on complexity theory. J Interprof Care 2010;24:31–40. 10.3109/1356182090301207319718571
Borg M, Karlsson B, Kim HS, McCormack B. Opening up for many voices in knowledge construction. Article 1. Forum Qual Soc Res 2012;13.
Edelenbos J, Van Buuren A, van Schie N. Co-producing knowledge: joint knowledge production between experts, bureaucrats and stakeholders in Dutch water management projects. Environ Sci Policy 2011;14:675–84. 10.1016/j.envsci.2011.04.004
Chesters G. Social movements and the ethics of knowledge production. Soc Mov Stud 2012;11:145–60. 10.1080/14742837.2012.664894
Jasanoff S. The Idiom of Co-production and Ordering Knowledge. In Jasanoff S, editor. States of Knowledge. Oxford: Routledge; 2004. 10.4324/9780203413845
Castree N. Coproducing global change research and geography: the means and ends of engagement. Dialogues Hum Geogr 2015;5:343–8. 10.1177/2043820615613265
Cunliffe AL. Reflexive inquiry in organizational research: questions and possibilities. Hum Relat 2003;56:983–1003. 10.1177/00187267030568004
Bekker M, van Egmond S, Wehrens R, Putters K, Bal R. Linking research and policy in Dutch healthcare: infrastructure, innovations and impacts. Evid Pol 2010;6:237–53. 10.1332/174426410X502464
Pols J. Enacting appreciations: beyond the patient perspective. Health Care Anal 2005;13:203–21. 10.1007/s10728-005-6448-616223211
Ewert B, Evers A. An ambiguous concept: on the meanings of co-production for health care users and user organizations? VOLUNTAS 2014;25:425–42. 10.1007/s11266-012-9345-2
Nunn N. Emotional and relational approaches to masculine knowledge. Soc Cult Geogr 2017;18:354–70. 10.1080/14649365.2016.1180705
Maclean K, Cullen L. Research methodologies for the co production of knowledge for environmental management in Australia. J R Soc N Z 2009;39:205–8. 10.1080/03014220909510581
Gillard S, Simons L, Turner K, Lucock M, Edwards C. Patient and public involvement in the coproduction of knowledge: reflection on the analysis of qualitative data in a mental health study. Qual Health Res 2012;22:1126–37. 10.1177/104973231244854122673090
Frantzeskaki N, Kabisch N. Designing a knowledge co-production operating space for urban environmental governance – lessons from Rotterdam, Netherlands and Berlin, Germany. Environ Sci Policy 2016;62:90–8. 10.1016/j.envsci.2016.01.010
Klenk N, Fiume A, Meehan K, Gibbes C. Local knowledge in climate adaptation research: moving knowledge frameworks from extraction to co-production. Wiley Interdiscip Rev Clim Change 2017;8:e475. 10.1002/wcc.475
Ward V, Tooman T, Reid B, Davies H, Marshall M. Embedding researchers into organisations: a study of the features of embedded research initiatives [published online ahead of print 19 April 2021]. Evid Policy 2021. 10.1332/174426421X16165177580453
World Health Organization (WHO). Changing Mindsets: Strategy on Health Policy and Systems Research. Geneva: WHO; 2012.
Koon AD, Rao KD, Tran NT, Ghaffar A. Embedding health policy and systems research into decision-making processes in low- and middle-income countries. Health Res Policy Syst 2013;11:30. 10.1186/1478-4505-11-3023924162
Wolfenden L, Yoong SL, Williams CM, Grimshaw J, Durrheim DN, Gillham K, Wiggers J. Embedding researchers in health service organizations improves research translation and health service performance: the Australian Hunter New England Population Health example. J Clin Epidemiol 2017;85:3–11. 10.1016/j.jclinepi.2017.03.00728341367
Eyre L, Farrelly M, Marshall M. What can a participatory approach to evaluation contribute to the field of integrated care? BMJ Qual Saf 2017;26:588–94. 10.1136/bmjqs-2016-005777
Marshall M, Pagel C, French C, Utley M, Allwood D, Fulop N, et al. Moving improvement research closer to practice: the Researcher-in-Residence model. BMJ Qual Saf 2014;23:801–5. 10.1136/bmjqs-2013-002779
Cheetham M, Wiseman A, Khazaeli B, Gibson E, Gray P, Van der Graaf P, Rushmer R. Embedded research: a promising way to create evidence-informed impact in public health? J Public Health 2018;40:i64–i70. 10.1093/pubmed/fdx125
Cunliffe AL, Scaratti G. Embedding impact in engaged research: developing socially useful knowledge through dialogical sensemaking. Br J Manag 2017;28:29–44. 10.1111/1467-8551.12204
Wong S. Tales from the frontline: the experiences of early childhood practitioners working with an ‘embedded’ research team. Eval Program Plann 2009;32:99–108. 10.1016/j.evalprogplan.2008.10.00319036451
Duggan JR. Critical friendship and critical orphanship: embedded research of an English local authority initiative. Manag Educ 2014;28:12–8. 10.1177/0892020613510118
Rowley H. Going beyond procedure: engaging with the ethical complexities of being an embedded researcher. Manag Educ 2014;28:19–24. 10.1177/0892020613510119
Booth A, Harris J, Croot E, Springett J, Campbell F, Wilkins E. Towards a methodology for cluster searching to provide conceptual and contextual ‘richness’ for systematic reviews of complex interventions: case study (CLUSTER). BMC Med Res Methodol 2013;13:118. 10.1186/1471-2288-13-11824073615
Vindrola-Padros C, Pape T, Utley M, Fulop NJ. The role of embedded research in quality improvement: a narrative review. BMJ Qual Saf 2017;26:70–80. 10.1136/bmjqs-2015-004877
Bate P. Synthesizing research and practice: using the action research approach in health care settings. Soc Policy Admin 2000;34:478–93. 10.1111/1467-9515.00205
Cheek J. The Practice and Politics of Funded Qualitative Research. In Denzin N, Lincoln Y, editors. The SAGE Handbook of Qualitative Research. 3rd edn. Thousand Oaks, CA: SAGE Publications Ltd; 2005. pp. 387–410.
Hackett EJ, Rhoten DR. Engaged, embedded, enjoined: science and technology studies in the National Science Foundation. Sci Eng Ethics 2011;17:823–38. 10.1007/s11948-011-9307-x21993903
Wye L, Cramer H, Beckett K, Farr M, le May A, Carey J, et al. Collective knowledge brokering: the model and impact of an embedded team. Evid Pol 2019;16:429–52. 10.1332/174426419X15468577044957
Crowe S, Grieco L, Vindrola-Padros C, Elkhodair S. Multidisciplinary embedded research to identify solutions to emergency department overcrowding. Int J Qual Health Care 2017;29:55–6. 10.1093/intqhc/mzx125.8927836999
Jenness V. Pluto, prisons, and plaintiffs: notes on systematic back-translation from an embedded researcher. Soc Probl 2008;55:1–22. 10.1525/sp.2008.55.1.1
Lewis SJ, Russell AJ. Being embedded: a way forward for ethnographic research. Ethnogr 2011;12:398–416. 10.1177/1466138110393786
Wye L, Cramer H, Carey J, Anthwal R, Rooney J, Robinson R, et al. Knowledge brokers or relationship brokers? The role of an embedded knowledge mobilisation team. Evid Pol 2019;15:277–92. 10.1332/174426417X15123845516148
Van de Ven AH, Johnson PE. Knowledge for theory and practice. Acad Manage Rev 2006;31:802–21. 10.5465/amr.2006.22527385
Gibbons M. The New Production of Knowledge: The Dynamics of Science and Research in Contemporary Societies. London: SAGE Publications Ltd; 1994.
Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care 2007;19:349–57. 10.1093/intqhc/mzm04217872937
Carlile PR. A pragmatic view of knowledge and boundaries: boundary objects in new product development. Organ Sci 2002;13:442–55. 10.1287/orsc.13.4.442.2953
Waring J, Clarke JM, Vickers R. A comparative ethnographic study of collective knowledge brokering across the syntactic, semantic and pragmatic knowledge boundaries in applied health research. Evid Pol 2021;17:111–30. 10.1332/174426420X15825348594538
Stake RE. The Art of Case Study Research. London: SAGE Publications Ltd; 1995.
Flyvbjerg B. Five misunderstandings about case-study research. Qual Inq 2006;12:219–45. 10.1177/1077800405284363
Yin RK. Case Study Research: Design and Methods. 4th edn. London: SAGE Publications Ltd; 2009.
Knoke D, Yang S. Social Network Analysis. 2nd edn. Thousand Oaks, CA: SAGE Publications Ltd; 2008. 10.4135/9781412985864
Corbin J, Strauss A. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. London: SAGE Publications Ltd; 2014.
Clarke V, Braun V, Hayfield N. Thematic Analysis. In Smith JA, editor. Qualitative Psychology: A Practical Guide to Research Methods. London: SAGE Publications Ltd; 2015. pp. 222–48.
Ward V, Tooman T, Reid B, Davies H, O’Brien B, Mear L, et al. A framework to support the design and cultivation of embedded research initiatives [published online ahead of print 19 April 2021]. Evid Policy 2021. 10.1332/174426421X16165177707227
University of St Andrews. Welcome to the RURU Website! URL: www.ruru.ac.uk (accessed 10 March 2021).
Contandriopoulos D, Lemire M, Denis JL, Tremblay E. Knowledge exchange processes in organizations and policy arenas: a narrative systematic review of the literature. Milbank Q 2010;88:444–83. 10.1111/j.1468-0009.2010.00608.x21166865
Ogrinc G, Davies L, Goodman D, Batalden P, Davidoff F, Stevens D. SQUIRE 2.0 (Standards for QUality Improvement Reporting Excellence): revised publication guidelines from a detailed consensus process. BMJ Qual Saf 2016;25:986–92. 10.1136/bmjqs-2015-004411
Walshe K, Davies HT. Health research, development and innovation in England from 1988 to 2013: from research production to knowledge mobilization. J Health Serv Res Policy 2013;18(Suppl. 3):1–12. 10.1177/1355819613502011
Ovretveit J, Hempel S, Magnabosco JL, Mittman BS, Rubenstein LV, Ganz DA. Guidance for research-practice partnerships (R-PPs) and collaborative research. J Health Organ Manag 2014;28:115–26. 10.1108/JHOM-08-2013-016424783669
Gould MK, Sharp AL, Nguyen HQ, Hahn EE, Mittman BS, Shen E, et al. Embedded research in the learning healthcare system: ongoing challenges and recommendations for researchers, clinicians, and health system leaders. J Gen Intern Med 2020;35:3675–80. 10.1007/s11606-020-05865-432472492
Nyström ME, Hansson J, Garvare R, Andersson-Bäck M. Locally based research and development units as knowledge brokers and change facilitators in health and social care of older people in Sweden. Evid Pol 2015;11:57–80. 10.1332/174426514X14098428292539
Greene SM, Reid RJ, Larson EB. Implementing the learning health system: from concept to action. Ann Intern Med 2012;157:207–10. 10.7326/0003-4819-157-3-201208070-0001222868839
Antil T, Desrochers M, Joubert P, Bouchard C. Implementation of an innovative grant programme to build partnerships between researchers, decision-makers and practitioners: the experience of the Quebec Social Research Council. J Health Serv Res Policy 2003;8(Suppl. 2):35–43. 10.1258/13558190332240515314596746
Walter I, Davies H, Nutley S. Increasing research impact through partnerships: evidence from outside health care. J Health Serv Res Policy 2003;8(Suppl. 2):58–61. 10.1258/13558190332240518014596749
Chafe R, Dobrow M. Health services researchers working within healthcare organizations: the intriguing sound of three hands clapping. Healthc Policy 2008;4:37–45. 10.12927/hcpol.2008.2026619377368
Bammer G, Michaux A, Sanson A. Bridging the ‘Know–Do’ Gap: Knowledge Brokering to Improve Child Wellbeing. Canberra, ACT: ANU Press; 2010. 10.26530/OAPEN_458835
Mitchell P, Pirkis J, Hall J, Haas M. Partnerships for knowledge exchange in health services research, policy and practice. J Health Serv Res Policy 2009;14:104–11. 10.1258/jhsrp.2008.00809119299264
Campbell DM, Redman S, Jorm L, Cooke M, Zwi AB, Rychetnik L. Increasing the use of evidence in health policy: practice and views of policy makers and researchers. Aust New Zealand Health Policy 2009;6:21. 10.1186/1743-8462-6-2119698186
Lomas J. The in-between world of knowledge brokering. BMJ 2007;334:129–32. 10.1136/bmj.39038.593380.AE17235094
Phipps D, Morton S. Qualities of knowledge brokers: reflections from practice. Evid Pol 2013;9:255–65. 10.1332/174426413X667784
Bevir M, Needham C, Waring J. Inside co production: ruling, resistance, and practice. Soc Policy Admin 2019;53:197–202. 10.1111/spol.12483
Cooke J. Building research capacity for impact in applied health services research partnerships; comment on “Experience of Health Leadership in Partnering With University-Based Researchers in Canada – A Call to ‘Re-imagine’ Research”. Int J Health Pol Manag 2020;10:93–7. 10.15171/ijhpm.2020.11
Cruz Rivera S, Kyte DG, Aiyegbusi OL, Keeley TJ, Calvert MJ. Assessing the impact of healthcare research: a systematic review of methodological frameworks. PLOS Med 2017;14:e1002370. 10.1371/journal.pmed.100237028792957
Williams O, Sarre S, Papoulias SC, Knowles S, Robert G, Beresford P, et al. Lost in the shadows: reflections on the dark side of co-production. Health Res Policy Syst 2020;18:43. 10.1186/s12961-020-00558-032380998
Morton S, Wilson S, Inglis S, Ritchie K, Wales A. Developing a framework to evaluate knowledge into action interventions. BMC Health Serv Res 2018;18:133. 10.1186/s12913-018-2930-329466994
Fazey I, Bunse L, Msika J, Pinke M, Preedy K, Evely AC, et al. Evaluating knowledge exchange in interdisciplinary and multi-stakeholder research. Global Environ Chang 2014;25:204–20. 10.1016/j.gloenvcha.2013.12.012
Patton MQ. Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use. New York, NY: The Guildford Press; 2011.
Silverman D. Qualitative Research. 4th edn. London: SAGE Publications Ltd; 2016.
Miles MB, Huberman AM. Qualitative Data Analysis: An Expanded Sourcebook. London: SAGE Publications Ltd; 1994.

Attribution. Martin Marshall; Huw Davies; Vicky Ward; Justin Waring; Naomi J Fulop; Liz Mear et al. (2022). Optimising the impact of health services research on the organisation and delivery of health services: a mixed-methods study. NIHR Journals Library. Copyright © Queen’s Printer and Controller of HMSO 2022. This work was produced by Marshall et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care. This issue may be freely reproduced for the purposes of private research and study and extracts (or indeed, the full report) may be included in professional journals provided that suitable acknowledgement is made and the reproduction is not associated with any form of advertising. Applications for commercial reproduction should be addressed to: NIHR Journals Library, National Institute for Health Research, Evaluation, Trials and Studies Coordinating Centre, Alpha House, University of Southampton Science Park, Southampton SO16 7NS, UK. Licensed under CC BY 4.0. NCBI Bookshelf NBK577853. CC BY 4.0. Original source ↗. Text reproduced from the Bookshelf XML without changing wording; figures, images and supplements are not reproduced.