Preliminary conference program as at 31 August 2017, subject to change
Monday, 23 October 2017 - Pre-conference workshops 09:00 – 10:30
Introduction to realist evaluation Andrew Hawkins, ARTD Consultants, Australia
Complexity and realist approaches Gill Westhorp, Charles Darwin University, Australia
Applying realism to ethnographic research methods Rebecca Hardwick, University of Exeter and Lisa Burrows, University of Plymouth, UK
10:30 – 10:45 10:45 – 12:30
Morning tea Introduction to realist evaluation (continued)
Complexity and realist approaches (continued)
Applying realism to ethnographic research methods (continued)
12:30 – 13:30 13:30 – 15:00
Lunch A realist approach to qualitative interviewing and analysis: Translating an interview regarding Indian Residential School experience into CMOCs Tracey Carr, University of Saskatchewan, Canada Afternoon tea A realist approach to qualitative interviewing and analysis: Translating an interview regarding Indian Residential School experience into CMOCs (continued)
Introduction to realist synthesis Gill Westhorp, Charles Darwin University, Australia
Realist quantitative methods John Eastwood, Sydney Local Health District, Australia
Introduction to realist synthesis (continued)
Realist quantitative methods (continued)
15:00 – 15:15 15:15 – 17:00
Realist Evaluation and Synthesis 2017 Conference Program
Page | 1
Tuesday, 24 October 2017 08:00 – 17:30 09:00 – 09:30 09:30 – 10:30
10:30 – 11:00 11:00 – 11:25 11:30 – 12:30 Theme 11:30 – 12:00
12:00 – 12:30
12:30 – 13:55 14:00 – 15:30 Theme 14:00 – 14:30
14:30 – 15:00
Registration open Official opening, welcome to country Keynote presentation Realistic evaluation: Origins and destinations Nick Tilley, University College London, UK Invited panel – Geoff Wong, Gary Groot, Bruno Marchal and Bronny Walsh Morning tea Concurrent session 1 Methods Realist process Conceptualising context evaluations of trials INVITED Process evaluation of Putting a box around PRESENTATION a randomised context: When do we Walking the talk: Being controlled trial of have the whole story? realist in practice family-led Leslie Johnson, Emory Geoff Wong, University rehabilitation post University, USA of Oxford, UK stroke in India Huei Ming Liu, The George Institute for Global Health, Australia When, for whom, and how serious gaming outcomes are achieved by patients during multidisciplinary rehabilitation: a realist process evaluation Miel Vugts Tranzo, Tilburg University, The Netherlands Lunch Concurrent session 2 International Methods Health, theory and development technology INVITED Realist evaluation To be advised PRESENTATION identifies community Realist approaches in and programmatic international factors influencing development effective use of system Bruno Marchal, dynamic models Institute of Tropical Karen Minyard, Medicine, Belgium Georgia Health Policy Center, Georgia State University, USA A complex realist To be advised inquiry exploring the implementation of a peer support initiative in the prison setting: Application of key concepts Kara Danks, Northumbria University, UK
Realist Evaluation and Synthesis 2017 Conference Program
Indigenous focus INVITED PRESENTATION Supporting Saskatchewan’s Indigenous peoples in making optimal patientcentred health decisions: The development and assessment of realist program theory Gary Groot, Tamara Waldron and Tracey Carr, University of Saskatchewan, Canada
Use of realist findings: Health Using the findings of a realist synthesis to select and adapt a self-management support training intervention for health professionals Freya Davies, Cardiff University, UK From evidence to health system change: A case study of the efficacy of realist methodology applied to rural surgical networks Jude Kornelsen, Department of Family Practice, UBC, Canada
Combining methods
Methods
INVITED PRESENTATION Realist economic evaluation Julian King, Julian King and Associates, New Zealand and Bronny Walsh, Bronny Walsh and Associates, Australia
The role of qualitative interviews in assembling, refining and consolidating program theory Jo Durham, University of Queensland, Australia
Evaluating values based culture change – values as mechanisms? Deborah Blackman, UNSW Canberra, Australia
Page | 2
15:00 – 15:30
15:30 – 15:55 16:00 – 17:30 Theme 16:00 – 16:30
16:30 – 17:00
17:00 – 17:30
17:30 – 19:00 Evening
The realist approach to policy implementation: How to capture the multilevel interactions that explain adoption, implementation and outcome? Jean-Paul Dossou, Institute of Tropicale Medicine, Belgium Afternoon tea Concurrent session 3 Adapting realist review Locating middlerange theory by adapting realist synthesis: The case of workplace harassment interventions Tracey Carr, University of Saskatchewan, Canada Effects of mHealth for maternal health workers in low and middle-income countries: Findings from a realist review Ibukun-Oluwa Adepoju, Vrije Universiteit, The Netherlands Realist secondary analysis of evaluation data Bronny Walsh, Bronny Walsh and Associates, Australia
Is a realist dosage different? How and why? Emma Williams, Northern Institute, CDU, Australia and Ruth Nicholls, Department of the Prime Minister and Cabinet, Australia
To be advised
Complementary mindsets: Using realist evaluation and design thinking to co-design and test new initiatives. Kaye Stevens, RMIT University, Australia
More than tea and cake: Using ethnographic methods to uncover how and why memory cafes work Lisa Burrows, PenCLAHRC, Plymouth University, UK
Philosophy and methods
Methodology
Indigenous focus
Capacity building
Investigating policy systems and outcomes using realism and new institutionalism Patrick Harris and Brendan Clifford, The University of Sydney, Australia and Ashley Schram, Australian National University, Australia
Combining realist and developmental approaches in a multisite evaluation of collaboratives planning innovative financing strategies for health Karen Minyard, Georgia Health Policy Center, Georgia State University, USA
Realist methods in an Aboriginal community context Sharon Barnes and Lawurrpa Maypilama, IPSOS, Australia
Use of NVivo in a realist evaluation: An interactive skillsbased workshop Sonia Dalkin, Northumbria University, UK
Creating a realist methodology (and a methodology for creating a methodology) Fiona Haigh, UNSW Sydney, Australia
Success principles for useability of realist evaluation findings: A government and university partnership co-creating implementation resources for the playgroup model Kate Williams, Queensland University of Technology, Australia and Iona Tait, Department of Education and Training, Australia
A realist view of throughcare for women in the Northern Territory Emma Williams, Northern Institute, CDU, Australia and Anika Frieling, Darwin YWCA, Australia
Welcome reception – conference foyer Dine-around An opportunity for you to join other conference delegates at a local restaurant for dinner. A list will be available at the conference for you to select from.
Realist Evaluation and Synthesis 2017 Conference Program
Page | 3
Wednesday, 25 October 2017 08:00 – 17:00 08:30 – 10:30 08:30 – 09:30 09:30 – 10:30 10:30 – 10:55 11:00 – 12:30 Theme 11:00 – 11:45
11:45 – 12:30
12:30 – 13:55 14:00 – 15:30 Theme 14:00 – 14:30
14:30 – 15:00
Registration open Keynote presentation Realist evaluation in the real world Penny Hawkins, Independent Evaluation Consultant, New Zealand Seven challenges for RE/RS. Seven tasks for the conference! Raymond Pawson, University of Leeds, UK (in absentia) Morning tea Concurrent session 4 Qualitative methods Learning from RE International development Testing realist Methodology for less Using realist evaluation program theory – harmful, more helpful in evaluations of aid quantitative and evaluation in natural interventions: qualitative impact resource management Recounting the Belgian evaluation programmes in South Development Agency’s Andrew Hawkins, Africa 5-year experience with ARTD Consultants, Eureta Rosenberg, RE Australia Rhodes University, Sara Van Belle, Institute South Africa of Tropical Medicine, Paul Bossyns and Karel To be advised No ‘Silver Bullets’: Bhyselinck, BTC Belgian Learning from realist Development Agency, evaluation in an Belgium education context Graham Francis, Ken Lountain and Gill Westhorp Lunch - POSTER PRESENTATIONS Concurrent session 5 Use of realist findings Commissioning and Realist approaches for doing realist reviews health systems reform Realist evaluation What works to improve A qualitative realist results: Enlightening child wellbeing? From approach to evaluating or too nuanced? policy to programme health system reform in Lesley Middleton, theory to practitioners: Saskatchewan and Victoria University of Reflections on a realist Tasmania Wellington, New journey Leigh Kinsman, Zealand Emma Coles, Nursing University of Tasmania Midwifery & Allied and Tasmanian Health Health Professions Service, Australia Research Unit, University of Stirling, UK The safety of rural Catalysing health maternity care system transformation: without local access Learning from realist to caesarean section: evaluation Changing policy Karen Minyard, Georgia through realist Health Policy Center, methodology in two Georgia State University, jurisdictions USA Jude Kornelsen, Department of Family Practice, UBC, Canada and Lesley Barclay, Sydney University School of Medicine, Australia
Realist Evaluation and Synthesis 2017 Conference Program
Indigenous focus Adventures in commissioning: Testing the fit in Indigenous affairs Kim Grey, Charles Darwin University and PM&C and Kylie Brosnan and Sharon Barnes, IPSOS, Australia
PhD students and supervisors "I'm new here". Session for supervisors to learn more about realist research and supervising a realist research PhD and student Rebecca Hardwick, University of Exeter, UK and Geoff Wong, University of Oxford, UK
Indigenous focus
My thesis in focus
Useful (or not) for whom, in what respects, why?: Reflections on the utility of a realist evaluation at multiple levels Emma Williams, Northern Institute, CDU, Australia
Strategies to improve uptake of domestic and family violence knowledge translation: A realist review Jacqui Cameron and Cathy Humphreys, The University of Melbourne, Australia
Bilingual education in the Northern Territory 45 years on: Really researching at Gäwa Ben van Gelderen, Charles Darwin University, Australia
Complexity of decision making in healthcare: What method of data collection would be most effective in realist research and evaluation? Angela McKay, University of Tasmania, Australia
Page | 4
15:00 - 15:30
Capacity building and the use of realist evaluation findings Andreas Sihotang and Timothy Nugroho Adi, Wahana Visi Indonesia, and Elvi Tambunan, World Vision, Indonesia
15:30 – 15:55 16:00 – 17:00 Theme
Afternoon tea Concurrent session 6 Combining methods
16:00 – 16:30
Combining realist evaluation, cost analysis and impact assessment of a policy for better TB care in Georgia Ariadna Nebot Giralt, Bruno Marchal, Institute of Tropical Medicine, Belgium and Akaki Zoidze, Curatio Foundation International, Georgia
16:30 – 17:00
18:00
Advancing from an Lplate to a P-plate in commissioning rapid realist reviews: Using notes from a forklift driving manual Ruth Nicholls, Department of the Prime Minister and Cabinet, Australia
‘Telehanced’: Realist evaluation of how telehealth coordinators can enhance access to telehealth for children in rural and remote Australia Alexandra Martiniuk, The University of Sydney, Australia and Katherine Burchfield, Royal Far West, Australia
Bilingual education in the Northern Territory 45 years on: Really researching at Gäwa Ben van Gelderen, Charles Darwin University, Australia (continued)
A realist evaluation of an interprofessional learning program for final year medical and nursing students Bronwyn Maddock, Monash University, Australia
Representing realist theory Communicating complication and complexity Patricia Rogers, ANZSOG, Australia
RR in environment and climate science Evaluating complex programmes: Reflections on realism and resilience Edward Boydell, Climate Change and Resilience
Indigenous focus
Learning from realist methods in health Maintaining selfdetermination for people with dementia living in residential care facilities: State of the art and preliminary results Jogé Boumans, Tilburg University, The Netherlands Motivating oneself to keep on going; insights from a realist evaluation of walking after stroke Caroline Stretton, AUT University, New Zealand
A comprehensive model for preventing sexual violence and abuse in two Australian Indigenous communities: A realist evaluation Susan RaymentMcHugh, Griffith Criminology Institute, Australia A realist explanatory theory of sexual violence and abuse concentrations Susan RaymentMcHugh, Griffith Criminology Institute, Australia
Property regimes, contextual factors and environmental outcomes: Applying a realist synthesis approach to a systematic review of marine protected areas Stephen Lawry, Center for International Forestry Research, CIFOR, Indonesia Conference Dinner - South Bank Surf Club, 30aa Stanley Plaza, South Bank Parklands
Realist Evaluation and Synthesis 2017 Conference Program
Page | 5
Thursday, 26 October 2017 08:30 – 09:00 09:00 – 10.00
10:00 – 10:25 10:30 – 12:30 Theme
10:30 – 11:00
Registration open Keynote presentation Using qualitative approaches in realist evaluation Joseph Maxwell, George Mason University, USA Morning tea Concurrent session 7 Methods Combining methods
From realist evaluation to realist research. Is there a need to adapt the analytical toolbox? Emilie Robert, Research Institute of the McGill University Health Centre, Canada and Sara Van Belle, Institute of Tropical Medicine, Belgium
To be advised
11:00 – 11:30
Learning from realist methods in health
Use of realist findings
The promise, practice and problems of realist evaluation in Singapore Milawaty Nurjono, National University of Singapore, Singapore and Hubertus Vrijhoef, Panaxea, The Netherlands
Supporting policy dialogue for health planning and financing: A realist intervention theory of the Universal Health Coverage Partnership Emilie Robert, McGill University, Canada and Denis Porignon, World Health Organisation, Switzerland Using realist review to inform the development of a complex intervention using technology to engage hospitalised patients in their care Shelley Roberts, Griffith University, Australia
A realist review of Comprehensive Geriatric Assessment in primary care Suzanne Hodgkin, La Trobe University, Australia
Theme
International development
Combining methods
Future directions
11:30 – 12:00
RE-LIVING: Integrating a realist evaluation in the LIVING trial study in Kenya – Why, what and how Bruno Marchal and Ariadna Nebot, Institute of Tropical Medicine, Belgium and Janice Lee, Drugs for Neglected Diseases initiative, Switzerland
Combining results based accountability and realist evaluation: A journey in evaluation use Patrick Maher, DCSI and Bronny Walsh, Bronny Walsh and Associates, Australia Modified MSC for realist evaluation in international development Andreas Sihotang and Timothy Nugroho Adi, Wahana Visi Indonesia, Indonesia and Elvi Tambunan, World Vision Indonesia, Indonesia
Supporting realist methods in future: Towards an international association? (Open session)
12:00 – 12:30
12:30 – 13:25
Implications of realist findings for policy and practice Evaluating the capacity building ability of the Queensland Country Women’s Association Country Kitchens program Claire Palermo, Monash University, Australia Exposing the impact of intensive advice services on health; a realist evaluation Sonia Dalkin, Northumbria University, UK
PhD students and supervisors: My thesis in focus Realist evaluation of intersectoral oral health promotion interventions for schoolchildren living in rural Andean communities Dave Bergeron, Université de Sherbrooke, Canada
A realist evaluation: The role of institutional entrepreneurs in building adaptive capacity in not-forprofit healthcare organisations Sweatha Iyengar, The University of Queensland, Australia Software for qualitative analysis In what contexts and to what degree does (which) qualitative software package work for realist analysis? Adrienne Levay, University of British Columbia, Canada
Lunch
Realist Evaluation and Synthesis 2017 Conference Program
Page | 6
13:30 – 15:00 Theme 13:30 – 14:00
14:00 – 14:30
14:30 – 15:00
15:00 – 15:25 15:30 – 16:30
Concurrent session 8 Making realist findings useful Does peer review improve the quality of energy and climate change evaluations and how does it do so? In what circumstances is peer review likely to be successful and when is it likely to be unsuccessful? Charles Michaelis, Strategy Development Solutions Ltd Mining the Mechanisms of Influence: A realist approach to maximising the impact of evaluation on policy and practice Julie Harris, University of Bedfordshire, UK Development and Refinement of Q Methodology in Realist Evaluations Steven Henderson Southampton Solent University
Realist methods across stages of design Social exclusion, infant behaviour, social isolation, and maternal expectations independently predict maternal depressive symptoms: A realist nonlinear principal component analysis John Eastwood, Sydney Local Health District, Australia
Designing initiatives for vulnerable families: From theory to design in Sydney, Australia John Eastwood, Sydney Local Health District, Australia
Designing an integrated care initiative for vulnerable families: Operationalisation of realist causal and programme theory, Sydney Australia John Eastwood, Sydney Local Health District, Australia
Realism and experimental designs Critical realist randomised controlled trials: Theory, method and application Sam Porter, Bournemouth University, UK
Combining quasiexperimental and realist evaluation: The value for commissioners Gill Westhorp, Charles Darwin University
Indigenous focus WORKSHOP FOR AUSTRALIAN INDIGENOUS PARTICIPANTS How do realist methods align (or not) with Indigenous ways of knowing? Sharon Barnes, IPSOS, Australia
PhD students and supervisors Woulda, coulda, shoulda: Overcoming challenges in realist evaluation Ibukun-Oluwa Adepoju, Vrije Universiteit, The Netherlands; Dimitri Renmans, University of Antwerp; Institute of Tropical Medicine, Belgium; Marsha Orgill, University of Cape Town, South Africa and Jean Paul Dossou, Institute of Tropical Medicine, Belgium; Centre de Recherche en Reproduction Humaine et en Démographie, Benin
Afternoon tea Final plenary
Friday, 27 October 2017 - Post-conference workshop 09:00 – 12:30
Integrating your learning Active reflection immediately after new learning supports the integration and use of the knowledge acquired. This half day session will provide an opportunity for you to reflect, in small groups and with the whole group, about your learning from the conference; to identify any questions that have not yet been answered; and to consider the implications for your own research and evaluation work. The session is likely to be particularly useful for PhD students and their supervisors, who may use the time to identify what the lessons learned imply for study design; early career researchers, and those whose busy schedules when they return to work may interrupt active reflection and synthesis of new learning.
Realist Evaluation and Synthesis 2017 Conference Program
Page | 7
