EVALUATION OF FASD PREVENTION AND FASD SUPPORT PROGRAMS Participant Outcomes: Self-Confidence, Self- Esteem and Hope
www.fasd-evaluation.ca
Self-‐confidence, self-‐esteem and hope Introduction Presented below is a chart containing examples of outcomes, indicators, outputs, and data collection methods and tools related to Participants’ self-‐confidence, self-‐esteem and hope. Following this chart are examples of tools and/or survey/questionnaire items that have been used in evaluations to assess these participant outcomes. All of these tools and questions can be adapted for use in focus groups, semi-‐structured interview guides, questionnaires or surveys. As well, references are included for the evaluation-‐related resources used to create this document. We recognize that every program and every program evaluation is unique -‐ differing as a function of a program’s specific goals, setting and resources, as well as the community’s context, history, and so forth. Thus, every program evaluation will have its own ideas about the outcomes, indicators, data collection methods and tools that are most appropriate and feasible – and you need to decide what is best for you. Examples of program activities related to this outcome: o o o
Providing (1 to 1) support, advocacy, role modeling and skill development Facilitating groups to provide/engage in recreation, skill development and support Providing accompaniment and transportation (to appointments)
2
Participant Outcomes and Indicators
(Please note that outcomes and outputs/indicators in bold have been used in at least two of the evaluations referenced.)
Early
positive response (participation, increased knowledge)
Participants can identify their strengths, skills and goals Participants have a better understanding of their rights, responsibilities and abilities to make positive choices that affect themselves and their families
Participant Outcomes Intermediate
active engagement, attitude change, behaviour change
Participants have improved self-esteem, self-confidence Participants have increased sense of hope Participants develop/increase their sense of control and efficacy over their own lives Participants feel validated in terms of their experiences Participants have increased confidence in relation to contributing to the project/program or their community
Long term
desired outcome
Participants enhance their capacity to influence and control elements of their lives Participants contribute/ give back to the project/program and/or community in ways of their choice
Outputs/Indicators
Data Collection Methods & Tools
Pre/post score on self-‐ esteem scale Pre/post-‐score on self-‐ efficacy scale Pre/post-‐score on Aurora Centre Hope Scale Participants report positive changes in self- esteem, self-confidence and/or sense of hope Participants report taking on an active role or leadership in their activities and/or the program Staff report/rate increases in participants’ self-confidence, self- esteem and sense of hope
Pre/post interviews/ q’naires with participants Interviews/Focus groups with families Interviews with program staff Staff Ratings of Participant Outcomes (see Rutman et al, 2011) Pre/post Rosenberg Self- esteem Scale (see Rosenberg, 1965) Pre/post General Self-‐ efficacy Scale (see: Schwarzer & Jerusalem, 1995) Pre/post Aurora Centre Hope Scale (Poole, unpublished)
3
Possible Data Collection Tools
1) General Self-Efficacy Scale Source: Schwarzer, R. & Jerusalem, M. (1995). Generalized Self-‐Efficacy Scale. In J. Weinman, S Wright, & M Johnston, (Eds), Measures in health psychology: A user’s portfolio. Causal and control beliefs (pp. 35-‐37) Retrieved June 12, 1012 via http://userpage.fu-‐berlin.de/health/engscal.htm Questionnaire item I can always manage to solve difficult problems if I try hard enough If someone opposes me, I can find the means and ways to get what I want It is easy for me to stick to my aims and accomplish my goals I am confident that I could deal efficiently with unexpected events Thanks to my resourcefulness, I know how to deal with unforeseen situations I can solve most problems if I invest the necessary effort I can remain calm when facing difficulties because I can rely on my coping abilities When I am confronted with a problem, I can generally find several solutions If I am in trouble, I can usually think of a solution I can usually handle whatever comes my way
Not at all true
Hardly true
Moderatel y true
Exactly true
1 1
2 2
3 3
4 4
1 1 1
2 2 2
3 3 3
4 4 4
1 1
2 2
3 3
4 4
1
2
3
4
1 1
2 2
3 3
4 4
4
2) Rosenberg Self-esteem Scale Source: Rosenberg, M. (1965). Society and the Adolescent Self-Image. Princeton, NJ: Princeton University Press Questionnaire item On the whole, I am happy with myself. At times I think I am no good at all. I feel that I have a number of good qualities. I am able to do things as well as most other people. I feel I do not have much to be proud of. I certainly feel useless at times. I feel that I'm a person of worth, at least on an equal basis as others. I wish I could have more respect for myself. All in all, I feel that I am a failure. I take a positive attitude toward myself.
Strongly Agree SA SA SA SA SA SA SA
Agree
Disagree
A A A A A A A
D D D D D D D
Strongly Disagree SD SD SD SD SD SD SD
SA SA SA
A A A
D D D
SD SD SD
5
3) Program Participant Survey (developed and used by the Canadian Prenatal Nutrition Program (CPNP) and the Community Action Program for Children (CAPC) Source: Public Health Agency of Canada. (2005). Participant Level Questions [for the evaluation of CAPC and CPNP projects]. Halifax: Atlantic Region Office, Public Health Agency of Canada. “Please indicate how strongly you agree or disagree with the statements below as they reflect your experience with the project’s environment and/or atmosphere. (Circle only one response for each statement.) Questionnaire items Not Somewhat Very Doesn’t helpful helpful helpful apply Please indicate how helpful the program/project was in: Strengthening my comfort level with service providers (e.g. public 1 2 3 9 health nurses, doctors, teachers, etc) Enhancing my ability to deal with difficult situations 1 2 3 9 Strengthening my ability to handle conflict with others 1 2 3 9 Building on my ability to stand up for myself 1 2 3 9 Enhancing my ability to problem solve 1 2 3 9 Appreciating my own value 1 2 3 9 Questionnaire items Less often No change More Doesn’t often apply Since becoming involved in the project: I find myself taking the lead on things 1 2 3 9 If circumstances allowed, I would ne interested in participating in 1 2 3 9 an advisory group/committee or Board connected to the project. I have gained organizational skills (e.g., co-‐facilitate a group, chair a 1 2 3 9 meeting, organize an event, etc.) I am more active in my community (joined other groups, 1 2 3 9 volunteering) I am more active in the project (volunteering, joined other groups) 1 2 3 9
6
4) Staff Ratings of Participant Outcomes Source: Rutman, D., Hubberstey, C. & Hume, S. (2011). Youth Outreach Program, Final Evaluation Report. Prepared for the College of New Caledonia, Burns Lake, BC. Unpublished report.
Please reflect on ways that you believe that the program has made a difference to each participant in the program, and for each participant, please indicate your view of outcomes relative to how things were before their involvement with the Program: Strong Some No chg/ Some Strong Don’t positive positive impact negative negative know/ change change that I see change change can’t tell Participant had someone to talk to about things that matter to them Participant had greater self-‐ confidence, self-‐esteem (e.g. makes more eye contact, is more communicative, etc.) Participant felt more positive and hopeful
7
5) Aurora Centre Hope Scale Source: Poole, N. Unpublished How hopeful are you that you can successfully make the life changes needed, to recover from problems with alcohol and drug use? Circle one of the marks already on the line to show your level of hope, or make a new mark on the line at the place which best shows your level of hope.
|____________________|_____________________|_______________________|____________________| I do not think that I can make the needed changes
I have a 25% chance of making the needed changes
I have a 50% chance of making the needed changes
I have a 75% chance of making the needed changes
I think that I definitely will make the needed changes
8
References
Friesen, K. & Patton, D. (2007). Evaluation of the Women Invested in Sobriety, Empowered in Recovery (WISER): A Women’s Program of the Addictions Foundation of Manitoba. Retrieved June 11, 2012 via: http://www.afm.mb.ca/About%20AFM/documents/WISERreport.pdf (Relevance: WISER Evaluation used Rosenberg Self-‐ esteem Scale to explore program’s impact in terms of changes in participants’ self-‐esteem.) Grant, B., Furlong, A., Hume, L., White, T & Doherty, S. (2008). The Women Offender Substance Abuse Programming: Interim Research Report. Ottawa: Addiction Research Centre, Research Branch, Correctional Service Canada. Retrieved June 12, 2012 via: http://www.csc-‐scc.gc.ca/text/rsrch/reports/r171/r171-‐eng.pdf . (Relevance: The WOSAP Evaluation used the Rosenberg Self-‐Esteem Scale and the Alcohol Abstinence Self-‐Efficacy Scale to explore the program’s impact on participants’ self-‐esteem and sense of self-‐efficacy.) Hume, S., Rutman, D., Hubberstey, C & MacFeeters, L. (2006). “With A Little Help From My Friends”: Final Process And Outcome Evaluation Report. Ottawa, ON: National Crime Prevention Centre. . (Relevance: “With A Little Help From My friends” Evaluation used qualitative interviews and Rosenberg Self-‐esteem Scale to explore the program’s impact on changes in participants’ self-‐esteem and sense of self-‐efficacy.) Hume, S., Rutman, D. & Hubberstey, C. (2007). Journey Women – Scouting New Paths Evaluation Report. Prepared for the National Crime Prevention Centre. Unpublished document. (Relevance: Journey Women – Scouting New Paths Evaluation used qualitative interviews, General Self-‐Efficacy Scale, and Rosenberg Self-‐esteem Scale to explore the program’s impact on changes in participants’ self-‐esteem and sense of self-‐efficacy.) Poole, N. Aurora Centre Hope Scale. Unpublished Public Health Agency of Canada. (2005). Participant Level Questions [for the evaluation of CAPC and CPNP projects]. Halifax: Atlantic Region Office, Public Health Agency of Canada.
9
Rosenberg, M. (1965). Society and the Adolescent Self-Image. Princeton, NJ: Princeton University Press. (Relevance: This article includes the Rosenberg Self-‐Esteem Scale, which has been used extensively as a means to explore a program’s impact on participants’ sense of self-‐esteem.) Rutman, D., Hubberstey, C. & Hume, S. (2011). Youth Outreach Program, Final Evaluation Report. Prepared for the College of New Caledonia, Burns Lake, BC. Unpublished report. Schwarzer, R. & Jerusalem, M. (1995). Generalized Self-‐Efficacy Scale. In J. Weinman, S Wright, & M Johnston, (Eds), Measures in health psychology: A user’s portfolio. Causal and control beliefs (pp. 35-‐37) Retrieved June 12, 1012 via http://userpage.fu-‐ berlin.de/health/engscal.htm Sword, W. Niccols, A. & ,Fan, A. (2004). “New choices” for women with addictions: Perceptions of program participants. Public Health Journal, 4, 10, Published online 2004 April 15. doi: 10.1186/1471-‐2458-‐4-‐10 (Relevance: New Choices Pilot Evaluation used qualitative interviews and focus group with program participants to explore program’s impact on participants’ self-‐esteem and self-‐confidence. Funding for this project has been received from the Public Health Agency of Canada, Fetal Alcohol Spectrum Disorder (FASD) National Strategic Project Fund. The views expressed herein do not necessarily represent the views of the Public Health Agency of Canada. Suggested Citation: Nota Bene Consulting Group and BCCEWH. (2013). Participant Outcomes: Self-‐Confidence, Self-‐Esteem and Hope. In Evaluation of FASD Prevention and FASD Support Programs. Vancouver, BC: British Columbia Centre of Excellence for Women's Health. For more tools and resources related to evaluating community-‐based FASD prevention programs for women including pregnant women and recent mothers, supportive intervention programs for adults and older youth with FASD, and FASD programs in Aboriginal communities, please visit: www.fasd-evaluation.ca
10
