Design and implementation of a survey of senior Canadian healthcare decision-makers: Organization-wide resource allocation processes — Oak Academic Publishing
Research ArticleOpen AccessGoogle Scholar indexed
Design and implementation of a survey of senior Canadian healthcare decision-makers: Organization-wide resource allocation processes
Centre for Clinical Epidemiology & Evaluation, Vancouver Coastal Health Research Institute, Vancouver, Canada
,
School of Population and Public Health, University of British Columbia, Vancouver, Canada
,
aculty of Health and Social Development, University of British Columbia Okanagan, Kelowna, Canada
,
epartment of Health Policy, Management & Evaluation, University of Toronto, Toronto, Canada
,
Canadian Centre for Applied Research in Cancer Control (ARCC), Vancouver, Canada
,
School of Population and Public Health, University of British Columbia, Vancouver, Canada
,
Glasgow Caledonian University, Glasgow, UK
1 Centre for Clinical Epidemiology & Evaluation, Vancouver Coastal Health Research Institute, Vancouver, Canada
2 School of Population and Public Health, University of British Columbia, Vancouver, Canada
3 aculty of Health and Social Development, University of British Columbia Okanagan, Kelowna, Canada
4 epartment of Health Policy, Management & Evaluation, University of Toronto, Toronto, Canada
5 Canadian Centre for Applied Research in Cancer Control (ARCC), Vancouver, Canada
6 School of Population and Public Health, University of British Columbia, Vancouver, Canada
A three-year research project based in British Columbia, Canada, is attempting to develop a framework and tools to assist healthcare system decision-makers achieve “high performance” in resource allocation. In pursuit of this objective, a literature search was conducted and two phases of primary data collection are being undertaken: an online survey of senior healthcare decision-makers, and in-depth case studies of potential “high performing” organizations. This paper addresses the survey phase; our aim is to provide a practical example of the mechanics of survey design, of benefit to those who want to better understand our forthcoming results, but also as an aid to other researchers grappling with the hard choices and trade-offs involved in the survey development process. Survey content is described in light of the existing literature, with discussion of the choices made by the research team to decide what questions and items would be included and excluded. The target population for the survey was senior managers in Canadian regional health authorities (or the closest equivalent organizations) in each of the 10 provinces and 3 territories. The paper dis- cusses how this sample was obtained, and describes the survey implementation process.
Baker, G.R., MacIntosh-Murray, A., Porcellato, C., Dionne, L., Stelmacovich, K. and Born, K. (2008) High performing healthcare systems: delivering quality by design. Longwoods Publishing Corporation, Toronto.
Tsourapas, A. and Frew, E. (2011) Evaluating “success” in programme budgeting and marginal analysis: A literature review. Journal of Health Services Research and Policy, 16, 177-183. doi:10.1258/jhsrp.2010.009053
Mitton, C. and Donaldson, C. (2004) Priority setting toolkit: A guide to the use of economics in healthcare decision making. BMJ Books, London.
Dionne, F., Mitton, C., Smith, N. and Donaldson, C. (2009) Evaluation of the impact of program budgeting and marginal analysis in vancouver island health authority. Journal of Health Services Research and Policy, 14, 234- 242. doi:10.1258/jhsrp.2009.008182
Dionne, F., Mitton, C., Smith, N. and Donaldson, C. (2008) Decision maker views on priority setting in the vancouver island health authority. Cost Effectiveness and Resource Allocation, 6, 13. doi:10.1186/1478-7547-6-13
Lomas, J., Veenstra. G. and Woods, J. (1997) Devolving authority for health care in Canada’s provinces: 2. Backgrounds, resources and activities of board members. Canadian Medical Association Journal, 156, 513-520.
Mitton, C. and Donaldson, C. (2003) Setting priorities and allocating resources in health regions: lessons from a project evaluating program budgeting and marginal analysis (PBMA). Health Policy, 64, 335-348. doi:10.1016/S0168-8510(02)00198-7
Menon, D., Stafinski, T. and Martin, D. (2007) Priority-setting for healthcare: who, how, and is it fair? Health Policy, 84, 220-233. doi:10.1016/j.healthpol.2007.05.009
Bate, A., Donaldson, C., Hunter, D.J., McCafferty, S., Robinson, S. and Williams, I. (2011) Implementation of the world class commissioning competencies: A survey and case-study evaluation. UK Department of Health: Policy Research Programme, London.
Robinson, S., Dickinson, H., Williams, I., Freeman, T., Rumbold, B. and Spence, K. (2011) Setting priorities in health: Research report. Nuffield Trust, London & University of Birmingham, Health Services Management Centre, Birmingham.
Schulz, A.J., Parker, E.A., Israel, B.A., Becker, A.B., Maciak, B.J. and Hollis, R. (1998) Conducting a participatory community-based survey for a community health intervention on Detroit’s east side. Journal of Public Health Management and Practice, 4, 10-24.
Fasuru, B., Daley, C.M., Gajewski, B., Pacheco, C.M. and Choi, W.S. (2010) A longitudinal study of tobacco use among American Indian and Alaska Native tribal college students. BMC Public Health, 10.
Aicken, C.R.H., Cassell, J.A., Estcourt, C.S., Keane ,F., Brook, G., Rait, G., White, P.J. and Mercer, C.H. (2011) Rationale and development of a survey tool for describing and auditing the composition of, and flows between, specialist and community clinical services for sexually transmitted infections. BMC Health Services Research, 11, 30. doi:10.1186/1472-6963-11-30
Alreck, P.L. and Settle, R.B. (1985) The survey research handbook. Irwin, Home-wood.
Eglene, O. and Dawes, S.S. (2006) Challenges and strategies for conducting international public management re-search. Administration and Society, 38, 596-622. doi:10.1177/0095399706291816
Walker, R.M. and Enticott, G. (2004) Using multiple-informants in public administration: Revisiting the managerial values and action debate. Journal of Public Administration Research and Theory, 14, 417-434. doi:10.1093/jopart/muh022
Peacock, S., Mitton, C., Bate, A., McCoy, B. and Donaldson, C. (2009) Overcoming barriers to priority setting using interdisciplinary methods. Health Policy, 92, 124-132. doi:10.1016/j.healthpol.2009.02.006
Bate, A., Donaldson, C. and Murtagh, M.J. (2007) Managing to manage healthcare resources in the English NHS? What can health economics teach? What can health economics learn? Health Policy, 84, 249-261. doi:10.1016/j.healthpol.2007.04.001
Gibson, J.L., Martin, D.K. and Singer, P.A. (2004) Setting priorities in health care organizations: Criteria, processes, and parameters of success. BMC Health Services Research, 4, 25. doi:10.1186/1472-6963-4-25
Martin, D.K., Giacomini, M. and Singer, P.A. (2002) Fairness, accountability for reasonableness, and the views of priority setting decision-makers. Health Policy, 61, 279-290. doi:10.1016/S0168-8510(01)00237-8
Foglia, M.B., Pearlman, R.A., Bottrell, M.M., Altemose, J.K. and Fox, E. (2007) Priority setting and the ethics of resource allocation within VA healthcare facilities: Results of a survey. Organizational Ethics, 4, 83-96.
Bruni, R., Laupacis, A. and Martin, D.K. (2008) Public engagement in setting priorities in health care. Canadian Medical Association Journal, 179, 15-18. doi:10.1503/cmaj.071656
Mitton, C., Smith, N., Peacock, S., Evoy, B. and Abelson, J. (2009) Public participation in health care priority setting: A scoping review. Health Policy, 91, 219-228. doi:10.1016/j.healthpol.2009.01.005
Lomas, J., Culyer, T., McCutcheon, C., McAuley, L. and Law, S. (2005) Conceptual-izing and combining evidence for health system guidance. Ca-nadian Health Services Research Foundation, Otta-wa.
Mitton, C., Dionne, F., Damji, R., Campbell, D. and Bryan, S. (2011) Difficult decisions in times of constraint: Cri-teria based resource allocation in the Vancouver Coastal Health Authority. BMC Health Services Research, 11, 169. doi:10.1186/1472-6963-11-169
Teng, F., Mitton, C. and MacKenzie, J. (2007) Priority setting in the provincial health services authority: Survey of key decision-makers. BMC Health Services Research, 7, 84. doi:10.1186/1472-6963-7-84
Kapariri, L. and Martin, D.K. (2009) Successful priority setting in low and middle income countries: A framework for evaluation. Health Care Analysis, 18, 129-127. doi:10.1007/s10728-009-0115-2
Smith, N., Mitton, C., Cornelissen, E., Gibson, J. and Peacock, S. (2012) Using eval-uation theory in priority setting and resource allocation. Journal of Health Organization and Management, 26, 655-671.
Sibbald, S.L., Gibson, J.L., Singer, P.A., Upshur, R. and Martin, D.K. (2010) Evaluating priority setting success in healthcare: A pilot study. BMC Health Services Research, 10, 131. doi:10.1186/1472-6963-10-131
Sibbald, S.L., Singer, P.A., Upshur, R. and Martin, D.K. (2009) Priority setting: What constitutes success? A conceptual framework for successful priority setting. BMC Health Services Research, 9, 43. doi:10.1186/1472-6963-9-43
Enticott, G., Boyne, G.A. and Walker, R.W. (2009) The use of multiple informants in public administration research: Data aggregation using organizational echelons. Journal of Public Administration Research and Theory, 19, 229-253. doi:10.1093/jopart/mun017
Starbuck, W.H. and Mezias, J.M. (1996) Opening Pandora’s box: Studying the accuracy of managers’ perceptions. Journal of Organizational Behavior, 17, 99-117. doi:10.1002/(SICI)1099-1379(199603)17:2 3.0.CO;2-2
Dillman, D. (2007) Mail and internet surveys: The tailored design method. 2nd Edition, John Wiley and Sons, Hoboken.
Cook, C., Heath, F. and Thompson, R.L. (2000) A meta-analysis of response rates in web- or internet-based surveys. Educational and Psychological Measurement, 60, 821-836. doi:10.1177/00131640021970934
Shih, T. and Fan, X. (2009) Comparing response rates in e-mail and paper surveys: A meta-analysis. Educational Research Review, 4, 26-40. doi:10.1016/j.edurev.2008.01.003