Econometric model estimation
1. Introduction
Over the last decade there has been widespread interest in the Organization for Economic Co-operation and Development (OECD) countries in ensuring that the best available evidence underpins policymaking process and the ways in which health services are organized and delivered (Lavis, Rottingen et al. 2012). The rational underlining this paradigm is of two perspectives: an economic one that supports a return of investment from public funded research and a social one that supports a better care and better health outcomes for individuals and the entire population. In Canada, this is reflected in the structure of the federal and provincials’ health systems (introduction of research and development units to support policy and decision making) and the specific programs of funding agencies (grants for systematic reviews projects, for knowledge dissemination activities, for collaborative and applied research, and the investment in CADRE program) (CIHR 2007).
The emergence of the evidence based paradigm and the actual policy discourse of the knowledge economy offer an ideal platform for collaborative research. Considering particularities of academia and public health professionals one can imagine that new challenges have to be addressed by academics (Limb 2012): 1) how to produce operational outputs and 2) How to transfer them effectively to public health policy makers? In the healthcare sector, knowledge and scientific evidence flow are now considered critical for health system development and for population health status (Ettelt and Mays 2011). For public health sector, the remaining question is: how to effectively integrate evidence on modifiable risk factors and cost-effectiveness of population-based interventions designed to reduce these risks in public health programs and policies development? Governments around the world had developed public capital ventures to support applied and fundamental research to improve the impact of publicly funded research, seen as a public good, and increase the return on investment for a much more cost-effective health system, a better population health status and the reduction of health inequalities (Orton, Lloyd-Williams, et al. 2011; Waters 2011). In short, this perspective puts universities as key actors to drive societies towards the knowledge economy. For public health sector, universities produce evidence, expertise and knowledge through various traditional channels of information i.e. human resources training (graduate and post-graduate), applied research, translational research and academic consulting. Recently, universities have been encouraged to develop links with governmental institutions in a series of new modes of partnership: collaborative research, participative action research, evaluative research, experts groups on specific topics and academic policy informing (policy briefs). “
However, during the last two decades, the health sector has been under tremendous pressure in responding to the ongoing global political situation, economic constraints, ecologic changes and social and demographic challenges. Thinking new ways to support decision making, in such rapidly changing context, calls for proactive strategies and timely actions. Evidence-based public health policy informing through academic policy briefings provision is different from evidence based medicine, in which gold standards evidence, is mainly systematic reviews, meta-analysis and randomized controlled trials. Public health policy process is complex, involves series of actors (institutions and individuals) and decision levels (micro, meso and macro level) and requires evidence from different research domains policy sciences, economics, epidemiology, community health or healthcare management that may offer sometimes conflicting information.
Literature on public health policy making process and impact of evidence and research findings on this process is not optimal and calls for rethinking knowledge transfer strategies in this domain, especially through the perspective of health academics. Indeed, traditionally health and medical academics role was exclusively centred on teaching and leading research on clinical practices, patients’ behaviour and healthcare management with a major focus on evidence based decision making in clinical practices. Less attention had been paid to public health policy informing and evidence-based public health. Therefore, public health policy informing requires not only the production of useful knowledge, which relates to the needs of public health, but also to ensure its transfer to policy makers in timely, easy and ready to use format. According to authors (Carroll, Cooke et al. 2006; Jetha, Robinson et al. 2008; Lavis, Moynihan et al. 2008), informing public health policymaking through academic policy briefings (APB) is an effective strategy to improve healthy policies formulation and to consolidate the strategic interface between academics and the governmental organizations. Canada has promoted knowledge brokers and health policy analysts as key actors (or intermediaries) to close the university-government gap. However, these new roles are still to develop and to better clarify for an optimal effectiveness. Public health policies as an evidence informed policy making process has implication for researchers, who should be striving to be more involved with policy making and studying the implications of policies on public health care interventions and programs (De Palma 2002; Hanney and Block 2009; Lomas and Brown 2009). Major researches had been done to better understand what determine decision makers’ utilization of research results and evidence. However, we still not know much on what makes health and medical academics perform knowledge translation activities, especially in terms of APB. Indeed, implementing academic policy informing as a new role for health and medical academics will need strategic approaches to support its performance and maintenance as a routine strategy to foster public health knowledge translation into health policies. Thus, in this paper, we propose to explore determinants of health and medical academics involvement in preparing and presenting APB to public health policy makers, as part of their contribution to the knowledge translation process.
2. Overview of the existing literature
One of the greatest challenges facing evidence informed policymaking is not necessarily the accessibility to evidence but actually getting it used while the process is under a series of internal and external pressures such as stakeholders influences (lobbying and administrative bureaucracy), economic factors (cost containing, efficiency and systems performance), and professionals (corporative pressure and clinical autonomy) (Moore 2006; Bowen, Erickson, et al. 2009). More recently, with the spreading of the evidence informing policy paradigm, universities and academics are seen as an additional major pressure (Clancy et al. 2012). The Canadian health care system, like those in OECD countries, confronts continued pressures (cost constraints; systems performance and services quality challenges; population health demographics and epidemiology). Public health researchers can influence policy making in different ways. Providing valuable information to policy makers is a challenging process for researchers. It implies not only the demonstration of lab or pilot effectiveness but also their transferability at large, their flexibility to contextualization, the clarification of needed resources and the anticipation of impacts on the system and the population. Such type of information requires clear understanding of policy formulation process, public health programs development and management, health professionals’ constraints and population and social values and expectations. Involving health researchers in policy makers’ informing through APB calls for rethinking academics’ social role and a major shift from “Neutral technicians” to “Issue Advocate” (Sabatier and Jenkins-Smith 1999). Knowledge transfer literature shows that APB should be thought of as a set of rules and institutional arrangements designed to encourage transparent and balanced use of evidence and research results in health policy making (Cookson 2005). In a dynamic world where contingencies and crisis are constant the evidence and research results are to inform rather to shape the process. Thus, researchers have to engage in better highlighting information that is relevant for decision and policymaking (Lavis, Davies et al. 2005). But a range of barriers to knowledge and/or evidence utilization in health policy making process still exist such as the system bureaucratization, the decision-making centralization, the conflict of evidences/values/culture, the nature of evidence and knowledge (qualitative research…), policymakers attributes (lack of research culture, competencies, skills and resources) and the persistent asymmetry of information between researchers and policy makers (Hanney, Gonzalez-Block et al. 2003, Thacker et al. 2005). Nutley and al. (2003) summarise the four key requirements that are necessary for improving evidence use in policy and one of them is the effective
3. Conceptual framework
The move to more informed policy making has been a recent and much-advocated feature of public policy, especially in health and social care. An essential element of this approach is to make available synthesis of evidence in an accessible format. APB the most studied formats, had been explored under policy analysts’ perspective but never under health academics’ perspective. A range of issues limit research results use in policy making process. Two broad areas of issues: the format in which the results are presented and the forum for whom the results are designated. The format issues include the manner, the time and the philosophy in which research reports are presented. The forum issues involve undertaking a clear response to specific problems or concerns, so as to guide decision and action. I did an extended review of the literature to clarify the concept of APB performance by health academics. There is a wide consensus on the fact that APB should be better approached as a personal behavior. Literature presents APB as a dual phenomenon based on two conceptual components: 1) the structural component that depends closely on both organizational and individual characteristics and 2) the relational component that depends on networks and links. Thus, we extracted from the literature a range of factors that have a confirmed or potential effect on APB performance by academic researchers (Figure 1): Relational capital (governmental health organizations), domain of research (health policy, health services, population health) and orientation of research (applied or basic research), self perceptions (efficacy, credibility, barriers to research utilization), personal area of interests (systematic review, clinical guidelines), Existence of a clear strategy of research dissemination, availability of electronic channel for information flow (such as Internet, weekly published newsletters, electronic Websites), participation in expert groups and committees (consultancy), radicalness of research results and individual characteristics (gender, education, university position, diversification of workplace).
This paper considers the role of health academics as actors in social and health development, and the implications for approaches to knowledge, through knowledge transfer and exchange (KT&E) activities. It will determine the major factors that explain why health academics write and transmit APB to policy makers and derive incentives and strategies to put in place to support them perform this KT&E activity that consolidate the Triple Helix interface between universities and governments.
4. Methodology and data
4.1. Population under study
The project titled “Factors that incite researchers in the health sciences to engage in KT activities leading to the utilization of their results in Canadian health care system.” Ad concerned a representative sample (health research domains and Canadian provinces) of researchers from all Canadian medical schools and faculties (medicine, nursing, pharmacy, community medicine, healthcare management and policy). Names and addresses of researchers were collected from provincial registries of health researchers and from the websites of all the 16 Canadian medical schools with no regard to their status as faculty members or other categories of researchers, since provincial registries do not specify this information. We selected a stratified random sample of 3814 health researchers from the 5712 that have been identified, with stratification designed to ensure a regional distribution in line with the distribution of the Canadian population and the distribution of Canadian medical school revenues for biomedical and health care research. Among the 3814 individuals in the original sample, 2207 were deemed ineligible. The reasons for their ineligibility are the following: the language used was different from English or French (n=11), part of an over-sample in a single province that had been requested by a financing partner (n=120), impossible to reach either an individual or voice mail after more than 25 calls (n=707), and other reasons (n=1369) such as not a faculty member, not conducting research anymore, on sabbatical vacation or in an administrative post, moved, retired, or incorrect or discontinued telephone numbers. From the 1607 faculty members eligible to be included in the final sample, 10 asked to be interviewed later but were never reached again, 23 ended the call before the questionnaire had been completed, and 596 refused to participate (after a recall). The survey generated 978 adequate responses to the questionnaires for a net response rate of 60.86%. The regional distribution of respondents is very close to what was originally targeted in the sampling strategy.
4.2. Instrument for data collection
Based on an extended review of the literature and on a previous questionnaire developed by authors to explore knowledge transfer activities among social sciences researchers (Landry and Amara 2001), we built a comprehensive questionnaire to map knowledge translation activities and their predictors. The questionnaire was assessed by an advisory committee comprised of health researchers, clinicians, health system managers and policymakers. They reviewed its preliminary drafts in regard of its feasibility (length), its appropriateness (concordance with academic professional context) and its intelligibility (clarity of questions). The questionnaire includes close-ended questions and was administered by telephone by a survey firm that uses computer-assisted telephone interviewing (CATI) technology, which allows for simultaneous data entry and data coding.
4.3. Data analysis
A range of issues limit the research results used in the policymaking process (Gregrich, 2003). There are two broad areas of issues: those linked to the format and those related to the forum. The format issues include the manner, the time and the philosophy in which research reports are presented. The forum issues involve undertaking a clear response to specific problems or concerns, so as to guide decision and action (Gregrich, 2003). Based on those two assumptions, we built a question to measure PMI. We considered that involvement in PMI is accomplished when both actions are completed: preparing and presenting targeted reports on specific health topics. The question that measures the PMI is
The analysis plan is based on the estimation of an econometric model through a Logistic regression model applied to identify predictors of APB among public health academics.
APB = β0 + β1 INFOCHAN + β2 LnUNSIZ + β3 STRATKET +β4 RELCADM +
Where,
βi (i= 0…….15) are the coefficients to estimate.
5. Results
5.1. Descriptive statistics
Of the 978 respondents who participated in the survey, the average number of researchers that had undergone APB is 35%. Among the 978 respondents, 91.6% had a PhD/MSc and 8.4% had only a professional degree such as medical doctor, nurse or pharmacist. However, 78.5% of the respondents were men. Among the respondents, 85.6% carry their work at university, 60.6% at a teaching hospital and 8.0% in other type of organizations. The population repartition of the study by fields of activity reveals that 44.3% declare working in fundamental health sciences, 43.8 % in clinical sciences and 12.0% in public health or population health sciences (Health policy research, health services research, health promotion research).
Only 35% of the respondents consider that they perform APB. While 72% of them declared that they are active in applied research and 14% active in political sciences research. The sample is made of 78.5% of men, 83.6% hold a PhD, 25.7% hold a clinical certification (MD, Nurse, pharmacist…) and 46.1% are professors or assistant professors.
5.2. Logistic regression model estimation
The econometric model used here to estimate the predictors of APB performance among health academics show that there are seven facilitators and two barriers. Having a clear and well defined strategy for KT&E is a predictor of APB. The KT&E strategy as measured in this work relate on 4 activities: to define the intended users or beneficiaries of the project’s results, the description of dissemination goals and strategies, the researcher personal follow-up with users to assess how useful project information is and the personal follow-up with users to assess how easily project information could be applied. Such an approach is drawn on the participatory action research perspective.
The results presented here show that effective collaboration between academics and governments institutions is based on the relational aspects (relational capital with government has a positive impact on APB) but also on structural aspects (KT&E formal strategy). More, health academics’ research profile is important in terms of APB performance. For example, being active researcher in political sciences, combination of research settings (at the hospital and at the university) and developing innovative research are predictors of APB. The perceived credibility has also a positive impact on APB. The past professional experience, as health administrators, has also a positive and significant impact on APB. However, the results show that being active in applied research and the availability of electronic channels of research information flow are inhibitors of APB performance by health academics.
|
||
|
|
|
|
||
Availability of electronic channels of information flow [INFOCHAN] | -.630(***) | .533 |
Size of research unit [LnUNSIZ] | .1389(NS) | 1.148 |
Formal Strategy for KE&T [STRATKET] | .467(***) | 1.596 |
|
||
Relational capital with Government [RELCADM] | .961(***) | 2.614 |
Combination of research settings [HOSP&UNIV] | .410(*) | 1.507 |
Perceived credibility [PERCRED] | .865 (**) | 2.374 |
Perceived efficacy on policy decision making [PEREFFIK] | .169 (NS) | 1.184 |
Administrative Experiential Assets [EXPERPRO] | .019(*) | 1.019 |
Health Policy Research [RESPECIA] | 1.340(**) | 3.818 |
Cognitive Assets [MOSDEG] | .012(NS) | 1.012 |
Academic position [PROFES] | -.174(NS) | .841 |
Gender [GENDER] | .118(NS) | 1.125 |
|
||
Users’ receptive capacity [USRECAP] | .093(NS) | 1.097 |
|
||
Applied research projects [APPLYRES] | -.445(*) | .641 |
Innovativeness of research [INNOVAT] | .260(*) | 1.297 |
Constant | -5.031(***) | .007 |
|
606 | |
|
171.626 (15) | |
|
.351 | |
|
77.9% |
6. Conclusion and implications
With this contribution, we take a first step toward closing the gap in the literature concerning APB, with a special emphasis on the role of medical schools. The overarching hypothesis in this study, therefore, is: academic policy briefing development is a function of its endowments in financial, relational and intellectual capital with the two first being provided by the university and the others by the researcher. We test this hypothesis on a pan Canadian sample of researchers affiliated to medical schools.
Strong relationships between academics and policymakers appear to increase the prospects for research use (Lavis, Moynihan et al. 2008). Many research projects have been undertaken to address the factors that increase the prospects for research use by public policymakers and encourage partnerships between researchers and policymakers that allow for their interaction around the tasks of asking and answering relevant policy questions (Lavis 2006). Much less progress has been made understanding what factors impact on academics involvement in the triple helix model and especially in its non commercial part as for developing academic policy briefings (APB). We still need to address APB performance determinants among public health academics to improve the evidence informed policy making process. An important proportion of public health research is related to social and welfare care dimensions and topics and has no impact on patenting or copyright which may inhibit its dissemination to policymakers and may rely exclusively on researchers’ involvement in research push activities, such as APB performance.
The results presented here show that APB performance is an individual behavior that is under specific professional orientation, organizational structural factors and personal motivation rather than individual social and demographic characteristics such as gender, most advanced education degree or academic position. Indeed, public health academics seem to be of traditional culture since they still relate on personnel relational capital (the relational capital with governmental institutions through face-to-face meetings and collaborative research) rather than electronic interface (through websites and electronic newsletters) to disseminate their research results. Moreover, organizational factors are of major relevance to support APB performance among public health academics. Having a formal strategy of knowledge exchange and transfer is an important factor for facilitating evidence flow from academic department to policymakers’ offices. Universities have to support and stimulate administrative involvement of public health researchers. This type of activities may raise more awareness about stakes of policy decision making context and helps academics understand the contingencies of administrative decision process and the relevance of developing APB to improve the follow of research results to support this process. Moreover, researchers how carried out their research in different research settings, at the university and at the clinical settings, performed APB more than those having a single setting of research, at the university. This result lets us suggest that public health researchers need to be exposed to different realities and contingencies to better perform APB. Bilateral collaboration between university and government institutions had been developed extensively these last two decades and resulted, unfortunately, in innovations that lacked a context to be put to use. Health sector had beneficed largely from these collaborations with little accountability since intellectual property and its translation into policies, services products and process had been called the “death valley”. The emergence of public health entrepreneurs called for more accountability and more knowledge translation among public health researchers. Thus, developing effective multi-sectors networks is a critical activity to improve and innovate in teaching and training for strategic knowledge transfer competencies among public health researchers.
In terms of research related factors, being involved in health policy research and developing innovative research are major factors of APB performance. However, those involved in applied research were less likely to perform APB. These results let us suggest that more efforts have to be invested to support applied research academics and show them how to develop and how to disseminate APB to improve utilization of their research results. Finally, we found out that the perceived credibility has a positive impact on APB performance. In fact, the more the researcher believes that his research is useful and is used to support policymaking the more he gets involved in APB development and dissemination to targeted audiences.
In knowledge transfer literature, less attention had been paid to the existing differences between academics, political analyst and knowledge brokers in terms of roles, legitimacy and inputs in developing policy briefings. Indeed, policy briefings had traditionally been prepared by policy analysts. The evidence based paradigm has raised new concerns about who would analyze and synthesize research results. In Canada,
Acknowledgments
Authors would like to thank the Canadian Institute for Health Research (CIHR) for the financial support provided to Pr Réjean Landry, director of the CIHR Chair on knowledge transfer and innovation (Université Laval). Dr. Jalila Jbilou contribution was supported by the CIHR Team in Familial Risks of Breast Cancer Grant (CRN-8752-1) and the Ministry of Economic Development, Innovation and Export Trade of Quebec – Supporting grant (PSR-SIIRI-701).References
- 1.
Bowen S T Erickson et al 2009 More Than "Using Research": The Real Challenges in Promoting Evidence-Informed Decision-Making." Healthc Policy4 3 87 102 - 2.
Collender G S Gabrysch et al 2012 Reducing maternal mortality: better monitoring, indicators and benchmarks needed to improve emergency obstetric care. Research summary for policymakers." Trop Med Int Health. - 3.
Carroll C J Cooke et al 2006 Bridging the gap: the development of knowledge briefings at the health and social care interface." Health Soc Care Community14 6 491 8 - 4.
Clancy C. M andGlied S. A Lurie N 2012 From Research to Health Policy Impact". Health Services Research,47 337 343 doi: j.1475-6773.2011.01374.x - 5.
Cookson R 2005 Evidence-based policy making in health care: what it is and what it isn’t." J Health Serv Res Policy10 2 118 21 - 6.
Dobbins M P Robeson et al 2009 A description of a knowledge broker role implemented as part of a randomized controlled trial evaluating three knowledge translation strategies." Implement Sci 4: 23. - 7.
Dobrow M. J V Goel et al 2004 Evidence-based health policy: context and utilisation." Soc Sci Med58 1 207 17 - 8.
El- Jardali F N Ataya et al 2012 A multi-faceted approach to promote knowledge translation platforms in eastern Mediterranean countries: climate for evidence-informed policy." Health Res Policy Syst 10(1): 15. - 9.
andEttelt S N Mays 2011 Health services research in Europe and its use for informing policy." J Health Serv Res Policy 16 Suppl2 48 60 - 10.
Field P R Gauld et al 2012 Evidence-informed health policy- the crucial role of advocacy." Int J Clin Pract66 4 337 41 - 11.
Hanney S. R M. A Gonzalez-block et al 2003 The utilisation of health research in policy-making: concepts, examples and methods of assessment." Health Res Policy Syst 1(1): 2. - 12.
andHanney S. R M. A Gonzalez-block 2009 Evidence-informed health policy: are we beginning to get there at last?" Health Res Policy Syst 7:30 - 13.
Jbilou J N Amara et al 2007 Research-based-decision-making in Canadian health organizations: a behavioural approach." J Med Syst31 3 185 96 - 14.
Jetha N K Robinson et al 2008 Supporting knowledge into action: The Canadian Best Practices Initiative for Health Promotion and Chronic Disease Prevention." Can J Public Health 99(5): I1 8 - 15.
Lavis J H Davies et al 2005 Towards systematic reviews that inform health care management and policy-making." J Health Serv Res Policy 10 Suppl1 35 48 - 16.
Lavis J. N 2006 Research, public policymaking, and knowledge-translation processes: Canadian efforts to build bridges." J Contin Educ Health Prof26 1 37 45 - 17.
Lavis J. N R Moynihan et al 2008 Evidence-informed health policy4 Case descriptions of organizations that support the use of research evidence." Implement Sci 3: 56. - 18.
Lavis J. N G Permanand et al 2009 SUPPORT Tools for evidence-informed health Policymaking (STP) 13: Preparing and using policy briefs to support evidence-informed policymaking." Health Res Policy Syst 7 Suppl 1: S13. - 19.
Lavis J. N J. A Rottingen et al 2012 Guidance for evidence-informed policies about health systems: linking guidance development to policy development." PLoS Med 9(3): e1001186. - 20.
Limb M 2012 Evidence is still not informing policy on obesity, conference hears." BMJ 344: e1023. - 21.
andLomas J A. D Brown 2009 Research and advice giving: a functional view of evidence-informed policy advice in a Canadian Ministry of Health." Milbank Q87 4 903 26 - 22.
Kurko T A Silvast et al 2012 Is pharmaceutical policy evidence-informed? A case of the deregulation process of nicotine replacement therapy products in Finland." Health Policy 105(2-3): 246-55. - 23.
andMitton C C Donaldson 2004 Health care priority setting: principles, practice and challenges." Cost Eff Resour Alloc 2(1): 3. - 24.
Moore R. A 2006 Evidence-based policy-making." Clin Chem Lab Med44 6 678 82 - 25.
Niedzwiedzka B. M 2003 Barriers to evidence-based decision making among Polish healthcare managers." Health Serv Manage Res16 2 106 15 - 26.
Ouimet M R Landry et al 2006 What factors induce health care decision-makers to use clinical guidelines? Evidence from provincial health ministries, regional health authorities and hospitals in Canada." Soc Sci Med62 4 964 76 - 27.
Orton L F Lloyd-williams et al 2011 The use of research evidence in public health decision making processes: systematic review." PLoS One 6(7): e21704. - 28.
Peirson L D Ciliska et al 2012 Building capacity for evidence informed decision making in public health: a case study of organizational change." BMC Public Health 12: 137. - 29.
Pope C N Mays et al 2006 Informing policy making and management in healthcare: the place for synthesis." Healthc Policy1 2 43 8 - 30.
andSabatier P. A H. C Jenkins-smith 1999 Theories of the Policy Process., Boulder: Westview Press. - 31.
Thacker S. B R. M Ikeda et al 2005 The evidence base for public health informing policy at the Centers for Disease Control and Prevention." Am J Prev Med29 3 227 33 - 32.
Uneke C. J A. E Ezeoha et al 2012 Promotion of evidence-informed health policymaking in Nigeria: Bridging the gap between researchers and policymakers." Glob Public Health. - 33.
Waters E 2011 Evidence of new innovations: investing in evidence synthesis, generation and translation ensures public health innovations improve population health." Perspect Public Health 131(3): 103. - 34.
andWalshe K T. G Rundall 2001 Evidence-based management: from theory to practice in health care." Milbank Q79 3 429 57 IV-V. - 35.
Hurst S. A B Borisch et al 2011 Public health: how much evidence is needed to support our policies?" J Public Health Policy32 1 135 41 - 36.
Katikireddi S. V M Higgins et al 2011 How evidence based is English public health policy?" BMJ 343: d7310. - 37.
Larsen M G Gulis et al 2011 Use of evidence in local public health work in Denmark." Int J Public Health57 3 477 83 - 38.
andMacdonald I. A R Atkinson 2011 Public health initiatives in obesity prevention: the need for evidence-based policy." Int J Obes (Lond) 35(4): 463. - 39.
Waters E B. J Hall et al 2011 Essential components of public health evidence reviews: capturing intervention complexity, implementation, economics and equity." J Public Health (Oxf)33 3 462 5