APPENDIX SEVEN

 

Qualitative Comments:

Client Assessment Worksheet

 

General Comments – Clinician

 

4Rivers


·            I’m very concerned that, with so few clients & staff from McGrath participating, the weight of the feedback will not be sufficiently strong; that our input may be buried in the input from the urban centers.

·            It is my sincere hope that the low number of patients represented by these worksheets will not diminish the influence of this rural mental health center in the overall development of the Performance Measures Project.

·            Just because we are small with a small population does not diminish the importance of our experience with the project.

·            Indeed, unless the information we provide to the whole process is appreciated by the project, then the overall value of the project will be significantly diminished in rural communities.

·            Some questions (1, 3, 8 & 9) were so wordy and convoluted that I had to repeat and explain them; need to simplify the language. 

·            I found the language of the questions to be convoluted, verbose and sometimes confusing.

·            So much data is presented in each question that, by the time the patient is ready to select a response, the question needed to be read and explained again.

·            Only one client is Alaska Native, which tells you something about who’s seeking services.

 

Norton Sound

·            The ‘sterility’ and ‘clinical’ nature of the instrument’s phrasing is user unfriendly at best, and abrasive and somewhat demoralizing.  The phrasing of the questions and statements is at least culturally insensitive (with ‘culture’ defined as ‘clinician’/non-clinician’) to consumers, and in my opinion jeopardizes rudimentary validity and reliability of the instrument.

·            One suggestion (besides vocabulary) is to make the statement portions (or operational portions) of the questions before asking the questions.

·            In my opinion, the instrument elicits responses that will gravely contribute to extraneous variables in developing an instrument with significance for validity and reliability.

·            Thank you for the opportunity of providing feedback.


 

 

Clinician Comments by Question

 

1.  During the last few (2-3) months, how often have you engaged in productive activity?  Productive activities include subsistence activities, full or part-time employment, volunteer work, church activities, school, sports, or social activity.

 


4Rivers

·            Simplify the language

 

Alternatives

·            ‘Social activity’ – What does this mean?  Client keeps appointments and has these 6 days a week

 

Norton Sound

·            ‘Productive’ – not a great choice of term

·            ‘Engaged in productive activity’ is awkward, mechanic, robotic

 

 

SCC

·            Consumers stated they would have answered this question differently if agency group activities had been a choice for them as it is in this area that they are active. 

·            In asking about productive activity, it may be beneficial to include therapeutic group activities participated in within their treatment center.

·            Instead of indicating ‘not active’, it may be helpful to state ‘none’.

·            Consumer works 5-6 days per week and was confused by the 2-5 day category.

 

SCC cont’d

·            Offers answers in days per week and days per month, which is more complicated than necessary.  How about ‘Approximately how many days per week do you engage in productive activity?’  The interviewer can explain what is meant by ‘productive activity’ and write the number given by the client in reply.


 

 

2.  Which of the following best describes your legal status during the last few (2-3) months?

 


Alternatives

·            Need to be more age-appropriate questions.  Wrote in N/A.

 

Norton Sound

·            ‘Legal status’ should appear much later in the body of the questionnaire, after a non-threatening warm-up.  This question (and phrasing) tweaks my paranoia, makes me defensive and seriously challenges my own internal validity by wondering ‘What are they really measuring?’

 

SCC

·            In looking at legal status, it may be helpful to have ‘non-criminal divorce/child custody’ stand alone, not categorized together with probation and parole. 

·            It is unclear what ‘extreme impact’ means.

·            Not clear in terms of criminal & non-criminal activity

·            Might include Title 12 option

·            Might also offer the option of Title 12. 

·            What is meant by ‘extreme impact’?  If I don’t know, I doubt the clients will. 

·            I think it is easy to confuse (answer) 3 ‘legal issues now pending’ with answer 4.  For example, isn’t ‘awaiting sentencing’ a legal issue ‘now pending’? 

·            Offers many different scenarios.  Might these be differentiated and allow client to check ‘all that apply’?

·            Incarceration: should ask number of times and length of stay


 

 

3.  During the last few (2-3) months, how would you best describe your feeling of general safety?  General safety refers to issues such as domestic violence, homelessness, safety of community or village, reliable transportation, prejudice, or parental discord?

 


4Rivers           

·            Simplify the language

 

Alternatives

·            Child answered this

 

Norton Sound

·            ‘Safety’ (?) – ‘security’ may be more applicable…. for starters


 

 

4.  During the past few (2-3) months, how would you describe your economic security?

 


Norton Sound

·            ‘Economic’ (?) – ‘financial’ may be more appropriate…for starters

 

SCC

·            Several of the consumers had difficulty understanding what ‘economic security’ meant and had difficulty following the question.  The wording may be very difficult for some people to understand-- referring specifically to ‘economic security’.  It may be helpful to restate it as ‘financial security’. 

·            Client did not understand what ‘economic security’ meant; had difficulty following the question

·            May want to reword to the following:

·            Very secure financially

·            I am financially secure most of the time, very few concerns.

·            Consumer asked what ‘economically secure’ meant


 

5.  During the last few (2-3) months, how would you describe your housing situation?

 


Alternatives

·            Answer 1:  ‘Independent living’ – This is the name

of a program for men that is not the definition you have here.

 

Alternatives cont’d

·            Answer 3:  ‘supported apartment program’ – This need to be clearer and separate.  A financial assistance program for housing is totally different than ‘residential’.

·            N/A.   He is living with his family and they rent an apartment.

 

Norton Sound

·            ‘Habitable’ (?).  ‘Custodial relationship’ (?), etc., etc.  #5 needs more help than space allows here.

 

 

 

SCC

·            One consumer resides in transitional housing and this was not a clear option for this question, making it confusing and difficult for that person to answer. 

·            This does not address the large population of people who reside in transitional housing.  Would that fit into the homeless category?

·            Option 5 repeats the term ‘most of the time’.  It is only needed once.

·            Transitional housing (hotels, etc.) is not clearly an option.


6.  Dual diagnosis (substance abuse) is a common problem that often goes along with being mentally ill.  We are not here to judge you but to get information that will help improve your treatment.  Please answer the following questions.

 

a.      Have friends or relatives asked you to Cut down on alcohol, tobacco, or other drugs, or quit entirely?

b.       Are you Annoyed by friends or relatives who question your use?

c.       Have you experienced Guilt because of your drinking or use?

d.      Do you need an Eye opener in the morning (alcohol, tobacco, or other drugs) to get started?

 


Alternatives

·            ‘Tobacco’ taints all questions.  Could make results look like all substance abuse problems when it’s only tobacco. 

·            Ask substances separately.

·            Add ‘N/A or never used’

·            There are three different, separate issues and need separate questions.  These questions (6 &7) do not usually apply to children. 

·            Add ‘N/A’ response

·            Delete tobacco

·            ‘tobacco’ – This is different than using alcohol or drugs and needs to be separate.  Each could be separate questions: alcohol, drugs and tobacco

·            Client doesn’t use at all

·            Not applicable for children (‘n/a’ was written in next to each answer)

 

Norton Sound

·            Language choice – something else besides referring to clients as ‘mentally ill’

·            ‘Mentally ill’ – Ouch!

·            ‘We’…‘not here to judge you’.  Really?  I feel mentally ill, watched by an unseen ‘we’, and judged!

 

SCC

·            Several of the consumers stated tobacco or caffeine was what they needed (in response to ‘d’).  Caffeine was not a choice, though is often considered an addictive substance.  Client noted this.

·            The overall consensus was that the wording was poor!  In asking about substance use, it may be helpful to simply state that substance use/abuse is a common problem, etc. 

·            It does not include caffeine in the choice of used substances, which is very common and problematic. 

·            In not being specific in these questions, if a person had answered ‘yes’ to all (or any) and their substance of choice was caffeine or tobacco, it could appear as if this person had an alcohol or drug problem.

·            Time frame?  The consumer answered ‘yes’, though time period was quite some time ago (10+ years), with the exception of tobacco & caffeine.  

·            It does not give a time frame to look at, like the other questions (2 months? 2 years?). 

·            Client does not use (drugs/alcohol)

·            Although, this is not a current problem, apparently it has been in the past and appeared to be embarrassing (for the client).

·            Client answered these questions, but said that they did not apply to him because he is now clean & sober.  Should there be a timeframe?

·            6c discusses guilt with drinking or use – use of drugs & tobacco?

·            Might offer a range, like ‘sometimes’ instead of just yes or no

·            Some clients have been in remission for years and would still answer ‘yes’ to these questions for past use.  What is the purpose of this question?  If it is to determine the prevalence of comorbidity, you might ask ‘Are you currently using drugs or alcohol?’ and

SCC cont’d

‘Have you ever had a problem with drugs or alcohol?’ If in remission, how long in remission? 

·            I also think it is a mistake to include tobacco with drugs and alcohol as the vast majority of clients smoke or use tobacco.  Many clients also abuse caffeine and OTC drugs.  You might not include tobacco with drugs and alcohol and ask ‘Do you smoke or use tobacco products?’  And ‘Do you use over-the-counter drugs?’ 

·            The questions asked in #6 are those asked in assessing whether or not someone has a dependence or abuse problem.  Our clients are not social drinkers; either they use to excess or they don’t use at all.

·            Finally, if the purpose of this question is to determine prevalence of comorbidity, this information can be gotten from the charts.  If the purpose is to assess improvement (outcomes) in the client, then these questions do not work as it stands.  Perhaps if you put the time frame in front of each question: ‘In the last six months, have friends…’

·            Many clients use OTC drugs – might specifically mention OTC drugs

·            Most clients smoke – might want to differentiate between smokers who do not use alcohol or drugs

·            Tobacco is this person’s targeted substance of choice, but on this form it could be perceived as ETOH or other drugs


 

 

To how many of the above questions you answer “Yes”?

 


SCC

·            Though these substances can all create problems, there is a wide range of severity of substance effects on functioning and need for treatment. 

·            What is the relevance to answering how many of the questions were answered ‘yes’?

·            Need to make this question ‘e’ and add ‘did’


 

7.  During the last six months, how many times have you been hospitalized for mental health treatment?

 


Norton Sound

·            Phrasing is offensive

 

SCC

·            Besides the number of times of hospitalization,

·            length of stay might be considered.  One person might have one admission for four months and another client have four admission of one day each.  A similar question should be asked about incarceration:  number of times and length


·            of stay, perhaps part of #2.

 


 

8a.  Which of the following best describes how you get your regular medical care?  Regular health care is defined as health care received from your primary or family physician in a physician’s office or clinic.

 


4Rivers

·            Definition for ‘regular health care’ leaves out everyone in the Bush.

·            The stated assumption of this question is that the patient has access to regular health care from a primary or family physician.  In the entire 48,000 square miles of the Iditarod area, there is not one physician. 

·            Regular medical care is provided by health aides or, at best, Physician’s Assistants or Family Nurse Practitioners who operate in health clinics in the villages.  In the four Yukon River villages, those health aides are supervised by staff of the Yukon-Kuskokwim Health Corporation in Bethel.  In the four Kuskokwim River villages of the area, the village health aides are supervised by the Physician Assistant based at the McGrath Health Clinic.  At present, because of the inadequate and gross mismanagement of the McGrath Health Center by Tanana Chiefs Conference, Fairbanks, there is no Physician Assistant or other mid-level health care provider in the McGrath Health Clinic.  In the past, when there was a mid-level in the Clinic, the clinical supervision for that position was provided by Alaska Native Medical Center, but not the management.  So you can begin to get a sense of the confusion we have here.

·            How do we get the State of Alaska to understand that we have no physicians out here?

·            How do we get the Division of Mental Health to understand that the requirement for rural mental health centers to have a physician make regular

4Rivers cont’d

·            monthly supervision in the clinics is a stupid regulation?  Clearly, it is evident to me that the people making up these rules have not bothered to leave the comfort of their urban offices in Juneau and Anchorage.

·            The point is that Question 8a is totally inappropriate here.

·            ‘In physician’s office or clinic’ doesn’t apply to rural Alaska at all.  There are no physicians anywhere in the McGrath service area.

·            The clinic here is managed by Tanana Chiefs who won’t provide services to non-native persons.

·            It’s stupid to include this requirement for the Bush.  It shows absolute ignorance of rural service areas.

·            Not pertinent to McGrath

·            No MD in McGrath

 

 

Alternatives

·            Answer 1:  ‘Denali Kid Care’ was written in

 

Norton Sound

·            Phrasing is offensive.

 

SCC

·            This was difficult for most of the consumers to follow and determine which was most appropriate for them as Medicaid has clear limitations about health care to be received, and most of the people receive care only when needed and do not receive health care services on a regular, on-going basis.

·            These questions do not clearly include eye/dental care in reference to regular health care. 

·            In referring to ‘access’, is it that one can or does receive regular health care?


 

 


8b.  During the last few (2-3) months, how often have physical medical problems interfered with your normal activities?


 


Norton Sound

·            Phrasing is offensive.

 

 

 

SCC

·            It is asked to answer questions with a time period of 2-3 months, though on answer 8b2 it refers to the last 6 months.

 


 

9.  Which of the following best describes how your health care is paid for?

 


4Rivers

·            Simplify the language

·            Answer #3, add ‘pay’ to ‘…but I have to pay about half’

·            Bad question

 

Norton Sound

·            Phrasing is offensive.

 

SCC

·            This question was difficult for 4 out of 5 consumers who answered this question.  It was difficult for them to follow and they became easily confused. 

·            Did not clearly differentiate between answers #1 and #2 as people with Medicaid have a co-payment they are responsible for, thus there is a nominal fee for service. 

·            Medicaid participants are charged a co-pay and this was not addressed, making this question difficult for many to answer.

·            This whole question is cumbersome to follow.  It is poorly worded and too wordy.  It would be easier for people to follow if questions were shorter.  

·            There was also one participant in the questionnaire who has no medical coverage and receives services on a sliding scale fee and medications on sliding scale and scholarships.  This area was also not addressed.

·            None (of the responses) actually applied to consumer’s circumstance.

·            Response 3 – need to add the word ‘pay’ in, ‘but I have to pay for…


 

 

 


Follow-up Questions – Consumer Comments

 


1.  Were any of the questions hard to answer?  Which ones?  Why?

 


4Rivers

·            Yes, #9.  So wordy it was confusing.  Options are so similar.

·            8a – no emergency services in McGrath

·            No (6)

 

Alternatives

·            For a child, yes, they are.  The questions do not pertain to the child; more geared toward teens or adults

·            None were hard

·            Dealing with finances – varies – depends on circumstances (#4)

·            The questions on additions were hard.  They did not apply to my child and questions should be more applicable to his age.

·            2, 5, 6

·            No (4)

·            No comments (4)

 

SCC

·            #4, 6, 9 – difficult to understand

·            Only the ones that are personal.  Who is asking the questions?

·            Yes, a little difficult.  The words are too complicated.  I have to look at it and hear it several times.

·            #1 – what do they mean by ‘subsistence activity’?  #6 – confusing, too many parts

·            #8b – difficult as consumer has multiple medical issues that exacerbate mental health issues when focused on.

·            #5 & 9 – not clear enough

·            #8a – client wrote ‘some things are not covered under Medicaid’; 8b – client wrote ‘not sure, has some limitations’

·            #7 – client added comment ‘outpatient for quite some time’

·            #6 – client wrote ‘don’t use alcohol or drugs, never had a problem’

·            #6a – client underlined ‘tobacco’

·            Yes, answers did not always apply directly (2, 8b)

·            Not really

·            #9

·            Yes 

·            Yes, all of the questions.  Hard to make a choice/decision

·            No (20)

·            No comments


 

 

2.  Were any of the questions unclear?  Which ones?  Why?

 


4Rivers

·            No, convoluted

·            #3 – What’s physical?  What’s emotional?

·            No (6)

 

·            Alternatives

·            Yes, financial questions

·            All as it was unclear which questions are for parents’ activities or my child’s

·            Not unclear, just stupid to combine them

·            No (3)

·            For teen vocabulary is unclear

·            No comments (6)

 

SCC

·            #9 didn’t address co-payment for Medicaid 

·            No, it was pretty understandable.

·            Why did I have to tell you how many times I answered ‘yes’ to the drug?

·            Yes.  “How many above did you answer ‘yes’?”, then the # do not match amount of times.

·            Could have gone into more detail on some.

·            Too many parts to the questions.  Needed to have questions explained to me.

·            #6 – appears ‘yes’ was answered to at least one question.

·            #6 – asking for answer with too many questions; would require review; frustrating.

·            #5 & 9 – not clear enough.

·            #6a – client circled ‘tobacco’; 6c – client wrote in ‘tobacco’; 6d – client wrote in ‘coffee’

·            #8a – client wrote in ‘no dental’

·            #6a & b – client wrote in ‘not anymore’

·            #6c – client wrote in ‘when I was drinking’

·            #6e2 – client wrote after answer 2 ‘with qualifier, no longer user’

·            Not really

·            #6d – client specified ‘coffee’

·            #9 because #3 wasn’t on there

·            #9

·            Very clear

·            No (14)

·            No comments (3)


 

3.  Do you have any other comments?  (Use reverse side if needed)

 


4Rivers

·            I hope it helps their efforts.

·            Want consistent, quality mid-level in McGrath

·            No (5)

·            No comment

 

Alternatives

·            No (2)

·            None

·            This is a dumb survey.

·            Pretty much irrelevant

·            Does not pertain to the child

·            It doesn’t really apply to children.  It would need to be worded differently to apply to children.

·            It does not apply to children and would need to be reworded to apply to children.

·            What does this survey about me (Mom) have to do with care?

·            Needs to be age-appropriate and more specific.  Need to have age-related questions pertaining to children.

·            No comments (3)

 

SCC

·            People are different in understanding things

·            Get rid of that?

·            I think they could have asked other questions such as how well you like services, how long been a client, what do you like, what don’t you like, etc.

·            I need to read it and have someone explain.  Paperwork is complicated to me.

·            Transportation to and from the facility is a big concern, especially when on Interim (assistance).  Need to ask questions about it.

·            Some questions are too intrusive, i.e., legal questions cover a lot.  Some questionnaires are too frustrating.  SCC PSA – I liked this one – easier to complete.

·            I might not have enough money for my blood study.

·            Can’t think of any

·            Not really

·            Not inclusive of all issues such as food addiction

·            Grant funds pay for services (mental health, meds, dental, vision)

·            Don’t know how to answer

·            I’m having problems making decisions right now.  Could answer ‘true/false’ easier

·            No (13)

·            No comments (4)


 

 

 

Follow-up Questions – Clinician Comments

 

1.  Did consumers have problems with any of the questions?  Which questions?  What problems?

 


4Rivers

·            No comments here – see clinician comments above

 

Alternatives

·            Most questions did not relate to children and couldn’t be asked of the children.  I asked the child one question (#3).

·            As stated above (in consumer comments)

·            No (2)

·            No comments (9)

 

SCC

·            Yes.  All questions had some degree of difficulty

·            #9 doesn’t address individual without benefits

·            #4 – client feels ‘secure economically’ because he is living in SRO Aurora Lodge

·            Defining ‘physical health’


·            In assisting consumers in completing questionnaires, it was clear there were many stumbling blocks for them, although most were reluctant to verbalize to me that they had difficulty with the questionnaire.

·            I assisted one consumer in completing the confidential questionnaire, as this person is unable to read/write. 

·            On one of the questions it asked about advocacy.  Client was unable to understand what that word meant. 

·            Had some difficulty with 8a & 9.

·            The questions on dual diagnosis. This consumer has a borderline intellectual capacity and needed to have many of the questions reworded so she could understand.

·            #1 & 6 (see client’s comments)

 

SCC cont’d

·            Most questions were fine, except as client indicated.  She is having a lot of physical problems now that are making her depression worse.

·            Client needed a few explained in more detail; #5 & 9 – confused as to where he fit.

·            Yes, 2 & 8b – some confusion about how the answer choices directly fit their situation.

·            #2 – Client currently involved with ‘legal’ due to having an attorney represent her for SSI.

·            No (4)


 

2.  Were any of the questions unclear?  If yes, please tell us which questions were unclear.



4Rivers

·            See clinician comments above

 

Alternatives

·            I agree that the questions should be more clear as to whether they are referring to the parent or the child.

·            No (2)

·            No comments (10)

 

SCC

·            Client did not report anything being unclear.  Client did need to read the questionnaire as well hear the questions administered.

·            Most are clear; however, pose a problem to people with developmental difficulties due to cognitive problems or lack of education.

·            Client indicated that the questions with several parts or unfamiliar terms were more difficult, i.e., subsistence activities.

·            #5 & 9 

·            #2 – Client involuntarily committed to API by police

·            #2

·            Client receives GRM only

·            #9 – Mental health services covered by grant money.  Dental & vision covered by special funding.

·            No (5)


 

 

3.  Were there things we did not ask that you feel we should add?

 


4Rivers

·            No comments here– see clinician comments above

 

Alternatives

·            It should clarify who answered these questions, (i.e., foster parent, bioparent, legal guardian, etc).  The child’s age should also be on here.

·            No (2)

·            No comments (8)

 

 

SCC

·            No

·            #4, 6, 9 – difficult to understand

·            Have a place for clinicians to comment beside the questions, i.e., if a person has a conservator, guardian, payee, etc. 

·            Ask what the consumers’ economic resources are, i.e., ATAP, SSI, APA, etc.

·            Gaps in mental/physical health care re: dental, limited individual, etc.

·            Perhaps the barriers to accessing mental/medical care, even if the client has insurance/benefits, i.e., anxiety, transportation, etc.

·            Dental needs, transportation, how familiar are they with their community/supports available.

·            More about barriers to getting needed TX even though there may be medical/mental health coverage.

·            In the housing options, you might want to use the term ‘assisted living’.  This would be helpful for seniors.

·            6d – coffee

·            Extra services – dental

·            Many clients get ‘physical’ health care needs met through Anchorage Neighborhood Health Center homeless program

·            No (3)

·            No comment



 

4.  Do you have any other comments?

 


4Rivers

·            Questions are wordy and convoluted

 

 

Alternatives

·            Maybe a place for age of consumer or year of birth on this form.

·            If a child, who is answering most of the questions (primary caregiver or consumer)?  Add a place to specify this.

·            This parent has two children in services and it has asked if that information needed to be either asked or a place to check off.

·            Client does not understand how questionnaire relates to client satisfaction.

·            Add  'age, caregiver, and length of time as caregiver' 

·            No comments (9)

 

SCC

·            The person who completed this survey has low intellectual functioning and does not read/write (very limited).  This person required assistance in understanding the words and content of most questions.

·            The survey seemed more like a quality of life assessment vs. a skill or resource need assessment, which is critical in developing an effective treatment plan. 

·            The order of the questions seemed out of place.  The questionnaire didn’t seem to flow in an organized manner.

·            When developing a form for consumers to complete with the goal of completion of the form being independently done without use of case management services, it may be helpful to have the wording as basic as possible as there is a wide range of education barriers with the population.

·            Participants were willing to complete the questionnaires.  This questionnaire asks some useful questions and, with some changes, could be very beneficial to clinicians. 

·            I am enclosing psychosocial assessment tools that used to be implemented which we found helpful in the past.  Some of these questions would be helpful if added to the questionnaire.

·            After administering the questionnaire, I noticed it might have been more beneficial to let the client read it as well, instead of just asking the questions. I still believe, however, that it would be difficult for her (DD client) to understand.

·            Client felt it was helpful to have the questionnaire to read off as the questionnaire was being administered to her.

·            Consumer had no additional comments.

·            Some people we see don’t identify with the term ‘mentally ill’.  This seems to make some people defensive.

·            This seems to assume that people have very serious problems.  Sometimes people are just getting a little help and they might not like being asked all of these questions, especially the term ‘mental illness’.

·            The timeframe given is 2-3 months.  I am not sure how often clients are to be assessed.  I’m thinking it might be every six months.  If it is every six months, then perhaps these questions might be based on the entire six-month period between assessments (question 7 does use the six-month criteria).

·            Client reports questions on first survey were hard to answer.

·            Clients do not understand funded programs vs. Medicaid

·            Most clients don’t understand ‘funding vs. insurance

·            No (4)


APPENDIX EIGHT

 

Qualitative Comments:

Mental Health Consumer Satisfaction Survey – Demographic Questions (Adult)

 

 

 

Question 7.  Comments.  Is there anything else that you would like to tell us about yourself or the services (you) receive that might help us to better serve you?

 


4Rivers

·            It is extremely helpful to have both male & female counselors.  All three staff at 4Rivers are very professional.  Staff is excellent.

·            No comments (4)

 

LifeQuest

·            No comments

 

Norton Sound

·            I am Alaskan Native.  The intake specialist was Caucasian.  I was asked a direct question by another staff member – “Sir, can I have that client file, please?’  Intake specialist said ‘don’t call him Sir.  He’s (name).  He works here at Norton Sound.’

 

SCC

·            Lisa Link is a true miracle worker.  I don’t know what I would have done without the staff at SCC.  They are true angels in my book.

·            Just keep up the good work.

·            N/A

·            I realize that there have been major cuts in grants, Medicaid, and has affected what SCC can offer.  But I do believe that there should be more appts allowed for individual sessions with therapist – from 10 allowable to 12.  I’m in the Adult Services, so I can only speak on that.  I also think they need to continue offering psycho-educational groups, especially Building Blocks.  I think it is important to have at least one group a client can attend, if offered.

·            Can’t think of much.

·            Not really.  People here listen to me.

·            I (have) been a client at Annex – its okay.  It helps me come in the morning to take my meds and to get out of my house.

·            Do things that they should and not do other things until one person is taken care of.

·            I think cuts in services would be detrimental to consumers’ mental health progress.

·            Yes, I’m schizophrenic for over ten years and I’m happy.

·            Nothing that I know of.

·            I have returned after being away for 9 years and have only been back for 3 weeks.

·            Not that I can think of

·            Service is fine

·            No comments (17)


 

 

 

Follow-up Questions - Consumers

 

 

Were any of the questions hard to understand?  Which ones?  Why?

 


4Rivers

·            No (2)

·            No comments

 

Norton Sound

·            No comments

 

 

 

SCC

·            The questions were not hard to understand.

·            No, easier.  My case manager read the questions to me.

·            With assistance, no

·            Yes

·            No (17)

·            No comments (5)


 

Were any of the questions unclear?  Which ones?  Why

 


4Rivers

·            The questions were clear.

·            No (2)

·            No comments

 

Norton Sound

·            No

 

SCC

·            Yes, 4a

·            No (19)

·            No comments (5)


 

 

Was the questionnaire too long?

 


4Rivers

·            No

 

Norton Sound

·            No

 

SCC

·            Yes

·            No (19)

·            ?

·            No comments (7)


 

Did we ask everything that you think is important about mental health services?

 


4Rivers

·            No

 

Norton Sound

·            You need room for complaints about direct services as well as intake.

 

SCC

·            Perhaps some questions about how you come to SCC as your mental health provider

·            Probably

·            Yes (12)

·            ?

·            No (3)

·            No comments (7)


 

 

Are there any questions that we should add?

 


4Rivers

·            Yes

·            No

·            No comments

 

Norton Sound

·            No comments

 

SCC

·            How comfortable the patient is in facility

·            Why have you chosen (or been asked) to come here?

·            Did not mention groups.

·            There might be…

·            See above (#4)

·            ?

·            No (14)

·            No comments (9)


 

 

Do you have any other comments? (Please use the reverse side if needed)

 


4Rivers

·            No (2)

·            No comments

 

Norton Sound

·            Yes.  I believe during an initial intake process…No one should ever be faced with any comment that demeans anyone’s ethnic background, employment.  I felt embarrassed by this employee.  Just because I work at NSHC and receive or ask to receive services does not make me less as a person.  I felt anger, helplessness, shame, and embarrassment.  I felt hopeless and frustrated to say the least to begin with.  I don’t need that kind of treatment especially while I am reaching out for help from an agency I trust.  If I didn’t know better, what would I think

Norton Sound cont’d

about NSHC as a whole?  Thank you for listening to me and my complaint.

 

 

SCC

·            I just don’t have time or space to tell you how important comfort can be in knowing I’m safe with you people and accepted so that I don’t have to worry when I station myself at the beginning line every morning as I’m OK.  I like being a little crazy anyway because it gives me something to think about.  SCC threw me a rope which I lost my grip on a few times.  I caught it again and I am trying to help them bring me to shore safely.

·            How to get the word out to the community.  So many of us come to mental health services finally out of desperation, not knowing what our diagnosis is.  There is still a lack of education and stigma in the public sector.

·            I’ve grown and in my place people _____ cause after 10 years I’m finally got almost my meds and I’ve done

·            Thank you immensely for these services.  In the short time I’ve been coming they have helped considerably.

·            Treatment is good, but won’t solve everything.

·            No (12)

·            No comments (8)


 


APPENDIX NINE

 

Qualitative Comments:

Mental Health Consumer Satisfaction Survey – Demographic Questions (Child & Family)

 

Question 8.  Comments.  Is there anything else that you would like to tell us about yourself or the services that (you) receive that might help us to better serve you?

·            None

 

 

Follow-up Questions – Consumer Comments

 

Were any of the questions hard to understand?  Which ones?  Why

·            No

 

Were any of the questions unclear?  Which ones?  Why?

·            No

 

Was the questionnaire too long?

·            No

 

Did we ask everything that you think is important about mental health services?

·            Think so

 

Are there any questions we should add?

·            No

 

Do you have any other comments?  (Please use the reverse side if needed)


·                     None
APPENDIX TEN

 

Qualitative Comments:

MHSIP (Adult)

 

 


Were any of the questions hard to understand?  Which ones?  Why?

 


4Rivers

·            Questions are fine, easy to understand

·            No (4)

 

Norton Sound

·            No comments

 

SCC

·            Some were because I tend to be more undecided than neutral.

·            I think I understood the questions.

·            My case manager had to ask me the questions.

·            Yes

·            Not so hard

·            Advocacy

·            Some

·            #13

·            #26 – don’t go to school or work

·            No (18)

·            No comments (5)

 


 


Were any of the questions unclear?  Which ones?  Why?


 


4Rivers

·            No, they were not unclear

·            No (4)

 

Norton Sound

·            No comments

 

SCC

·            It seems so because I put greater value on support received than in the actual result.

·            The questions were clear.

·            #24 I didn’t think was specific enough.

·            A couple; can’t remember which ones.  Hard words, too long.

·            #13

·            Yes, 12

·            N/A

·            No (18)

·            No comments (7)


 

Was the questionnaire too long?

 


4Rivers

·            Just right

·            Not bad

·            No (3)

 

Norton Sound

·            No

 

 

 

SCC

·            I really don’t like the questionnaires like this.  I would rather have questions that I could answer

·             with a sentence, not just circle something.

·            Yes

·            Yes

·            Some

·            No (24)

·            No comments (3)


 

Did we ask everything that you think is important about mental health services?

 


4Rivers

·            Yes (3)

·            No

·            I’m not sure

 

 

 

Norton Sound

·            No.  One staff member was rude and demeaning during my intake process.  (Person) said ‘Don’t call him sir.  He’s (name).  He works here.’

 

SCC

·            Yes (14)

·            Some

·            I think you covered the bases.

·            No, there are a lot of questions you could have asked.

·            This is my first experience in trying to deal with depression – with help.

·            No (10)

·            No comments (3)



Are there any questions that we should add?

 


4Rivers

·            Can’t think of any

·            Not that I can think of

·            We have no doctor in this town.  My medical needs have to be sought out (Anchorage, Portland, Oregon).

·            ?

·            No

 

Norton Sound

·            No comments

 

SCC

·            Food Q’s

·            No idea

·            Unknown

·            Not that I can think of

·            How do you feel about the staff?  What would you like to see improved?  What do you like?  How do you feel about the progress you made, etc?

·            Was it easy to get in touch with my case manager?

·            I feel better about myself.  I am better able to plan ahead.

·            Not that I can think of

·            More groups

·            N/A

·            Don’t know

·            No (13)

·            No comments (8)


 

Do you have any other comments? (Please use the reverse side if needed)

 


4Rivers

·            I am grateful for 4Rivers.  I don’t know where I would be without these services.

·            I’m thankful for the help and support that has been given.

·            Flying into Anchorage for medical needs costs too much.  We have limited income.

·            No

·            No comment

 

Norton Sound

·            I received great services.  But the one staff member’s comments about my employment at NSHC.  I wanted to complaint about it and didn’t feel like I was given a chance.

 

SCC

·            I strongly feel that results and improvements are a product for which I am responsible, mental health professionals merely provide needed support, i.e., counseling, medications, participation in groups and studies.  The ball is on my shoulders to see how I respond.  If this is the case, than from day one I have received treatment according to my level of wellness.  On the other hand, I much doubt whether the end product would be as it is had I not sought help through psychiatric involvement.  That being the case my only question, which cannot be answered, is have I regretted enlisting professional help in resolving mental crisis?  At this time, no; although there were painful times, mostly around med-compliance.  I am here to say and cheerfully so that cooperating with my own conscience has done wonders to improve my lifestyle!  And SCC has walked with me through a lot of it like a friend.

·            I like the care I receive here.

·            I need improvement in my life.

·            #4 – need to increase individual sessions; lack of or possibility of no groups.

·            I like my case manager.  She has been real helpful. 

·            #5 of the questionnaire.  I receive services as long as there is insurance coverage for services.  With financial cut offs, SCC is no longer able to carry people who have no coverage.  #8 on questionnaire:  Experienced difficulty getting services one time when in crisis.  Ran into an attitude of indifference, but I think it was a problem more with one or two individuals than with SCC as a whole.  #23 on questionnaire:  I still experience times of crisis, and in my case I withdraw and don’t necessarily use Emergency Services.  I think there is a gap for people like me.

·            I have not been involved long enough recently to know what direct result is occurring, so many of the questions are answered N/A.

·            No (13)

·            No comments (10)


APPENDIX ELEVEN

 

Qualitative Comments:

MHSIP (YSS-F)

 

 

Were any of the questions hard to understand?  Which ones?  Why?

·            No

 

Were any of the questions unclear?  Which ones?  Why?

·            No

 

Was the questionnaire too long?

·            No

 

Did we ask everything that you think is important about mental health services?

·            Think so

 

Are there any questions we should add?

·            No

 

Do you have any other comments?  (Please use the reverse side if needed)

·            None

 

 


APPENDIX TWELVE

 

<Agency>

Client Functional Assessment – Adult (Revised)

 

c     Initial Assessment       c     3-Month         c     6-Month c     Annual

Text Box: For current clients, timeframe is from the date of the last functional assessment; for new clients, the last 6 months.

 

 

 

 

Client Number                                                                          Date                            

 

Program                                                                                  

                                   

           

1.   How often are you involved in activities that are important to you?  (Such activities might include subsistence activities (hunting, fishing, berry picking, etc.), full or part time employment, volunteer work, church activities, school, sports, or social activity.)

 

c         1          Usually every day

c         2          2 – 5 days a week

c         3          1 – 4 days a month

c         4          5 – 10 days a month

c         5          Not active

 

2.   Which of the following categories describes your legal involvement?

 

c         1          None

c         2          Limited  (no threat of jail such as truancy or minor litigation, misdemeanor charges, non-criminal divorce or child custody proceedings, filed TRO or been served TRO, court-ordered out-patient mental health/substance abuse TX)

c         3          Significant (probation, parole, felony charges pending, awaiting sentencing, SIS)

c         4          Extreme (incarcerated in jail or lock-up facility, Title 12 hospitalization, in-patient TX in lieu of incarceration with charges pending TX outcome)

c         5          Unable to determine

 

 

3.       Which of the following best describes your financial situation most of the time?

 

c        1           Very secure financially (enough income to pay for all basic needs, such as food, housing, clothing)

c        2           Financially secure most of the time (some financial problems that are manageable)

c        3           Many financial problems (not enough income to pay for some basic needs)

c        4           Extreme financial hardship (not enough income to pay for most basic needs)

c        5           Unable to determine


 


4.   Which of the following categories best describes your housing situation most of the time?

 

c        1           Independent  (own or rent safe, adequate house, apartment or trailer, or I chose to live with others)

c        2           Live with others  (family or others who helped care for me)

c         3            Residential facility  (Domiciliary, group home, assisted living facility, staffed apartment, half-way house with 24-hour staff supervision)

c        4           Sheltered care  (supervised SRO, adult foster home, supported apartment program)

c        5          Institution  (hospital, prison)

c        6          Homeless  (shelter, on the street, vehicle, unsafe, inadequate apartment/house/trailer, transitional housing such as hotel, staying with family/friends temporarily)   

 

 

5.   Please answer the following questions about drug and alcohol use:

a.  Have friends or relatives asked you to Cut down on alcohol or other drugs, or quit entirely?

                              c  Yes                                    c  No

      b.  Are you Annoyed by friends or relatives who question your use?

                              c  Yes                                    c  No

      c.  Have you experienced Guilt because of your drinking or use?

                              c  Yes                                    c  No

d.  Do you need an Eye opener in the morning (alcohol or other drugs) to get started?

                              c  Yes                                    c  No

 

Clinician: How many of the above questions were answered “Yes”: _______

 

 

 

6.   How many times have you been hospitalized for mental health treatment?  (Indicate length of stay for each hospitalization.)

 

c         1          None

c         2          Once                      _____________________________________________ 

c         3          2 times                   _____________________________________________ 

c         4          3 times                   _____________________________________________ 

c         5          4 or more times      _____________________________________________ 

 

 

7.   How often can you get the physical health care that you need? (Physical health care includes dental and eye care, and is defined as care received from your primary/family doctor, physician’s assistant or nurse in a doctor’s office or clinic.) 

 

c         1          All of the time

c         2          Most of the time

c          3           Sometimes (occasionally use the Emergency Room (ER) and/or Emergency Medical Technicians (EMT))

c         4          Limited  (use the ER and/or EMTs most of the time)

c         5          Almost Never (use ER and/or EMTs all the time)

c         6          Other _________________________________________________

 


8.   How often do physical health problems keep you from doing your normal activities?

 

c                  1           Never

c                    2          Occasionally 

c               3          Often

c               4          Regularly

c               5          Always

c                6         Other _________________________________________________

 

 

9.   How do you pay for your physical health care?

 

c               1          Fully insured or use an Indian Health Service facility (with no charges)

c               2          Insured (includes Medicaid/Medicare or Indian Health Service facility;  pay for some of the charges, such as percentage or co-pay)

c               3          Some insurance  (pay about half of the cost)

c               4          Very little insurance  (pay most of the cost)

c              5           No insurance  (pay all of the cost)

c               6          Other  ______________________________

 

 

 

 

Additional comments: 

 

______________________________________________________________________________________________________________________________________________________________

_____________________________________________________________________________________________________________________________________________________________________________________________________________________________________________

 


APPENDIX THIRTEEN

 

<Agency>

DEMOGRAPHIC  QUESTIONNAIRE (Adult) - Revised

 

This questionnaire is part of the attached Consumer Satisfaction Survey.  These questions will help us better understand the consumers who use mental health services and how those services affect our different population.  There is no place that asks for your name or any other information that could identify you.  There are no codes on the forms or envelopes.  A random number will be added after the agency receives these questionnaires that will be used only for the purpose of analyzing your responses.    This is a completely anonymous survey.

 

Date __________________

 

1.        How old are you? ____________

 

2.    Do you have a guardian, conservator or payee?        c      Yes          c      No

 

            If yes, please indicate which one.   _________________________________________________

               

3.    Which of the following best describes the race or ethnic group that you consider yourself?

 

            c     African American                                     c     Alaska Native/American Indian

            c     Asian/Pacific Islander                               c     Caucasian

            c     Hispanic/Latino                                         c     Other                                           

 

4.    Gender:      c     Female         c     Male

 

5.    Which of the following services have you received in the last year from <agency>?  (Check all that apply)

 

c     Therapy/Counseling                                   c     Case Management

c     Housing                                                    c     Employment

c     Family Services                                         c     Substance Abuse Treatment

c     Transportation Services                             c     Advocacy Services

c     Psychiatric Services/Medication                 c     Other  ______________________________

 

6.   Are you still receiving services from <agency>?         c     Yes         c     No

7.    How long have you been receiving, or did you receive, services from <agency>?

            c     Less than six months                                 c     2 to 5 years

            c     6 months to 2 years                                   c     More than 5 years

8.  About how often do (or did) you receive services from <agency>?

c     Daily                                                        c     Twice a month

c     Once a week                                             c     Every other month

            c     Twice a week                                           c    Every three months

            c     Once a month                                           c     Other ______________________

 

9.   Comments.  Is there anything else that you would like to tell us about yourself or the services that you receive that might help us to better serve you?  (Please use the reverse side if needed.)

 

____________________________________________________________________________________________________________________________________________________________________

Thank you for taking the time to answer these questions about yourself.
APPENDIX FOURTEEN

 

 

<Agency>

DEMOGRAPHIC  QUESTIONNAIRE (Child & Family) - Revised

 

This questionnaire is part of the attached Consumer Satisfaction Survey.  Your answers will help us better understand the consumers who use mental health services and how those services affect our different population.  There is no place that asks for your name or any other information that could identify you.  There are no codes on the forms or envelopes.  A random number will be added after the agency receives these questionnaires that will be used only for the purpose of analyzing your responses.  This is a completely anonymous survey.

 

Date ________________________   

                                                           

Completed by:         c     Biological Parent          c     Foster Parent                    c    Guardian      

c     Adolescent                c     Other  __________________

 

1.         How old is your child? _______________

   

2.    Which of the following best describes the race/ethnicity that you consider yourself?

 

            c     African American                          c    Alaska Native/American Indian

            c    Asian/Pacific Islander                    c     Caucasian

            c     Hispanic/Latino                              c     Other                                            

 

3.    Gender:                  c     Female                  c     Male

 

4.   What is your school situation?           c     Grade ______       c     Not in school         c     Working on GED

                                                            c     Other  _________________________

 

5.   Are you (or is the child/adolescent) in protective custody?      c     Yes              c     No

If yes, please select one of the following and indicate for how long?   ______________________

 

c     Division of Family and Youth Services (DFYS)

c     Division of Juvenile Justice (DJJ)

c     Parent-Guardian

c     Other  ________________________

 

6.   Who referred you (or your child) to <agency> for mental health services?

 

 c     Self-referred                     c     DFYS                  c     School

             c     Parent/Guardian                c     DJJ                      c      Other  ________________________

 

7.    Which of the following services have you received in the last year from <agency>?  (Check all that apply)

 

c     Therapy/Counseling                                    c     Treatment Foster Care 

c     Life Skills Specialist Services                      c     Psychiatric Services/Medication

c     Family Skills Development                              c     Other ____________________________

c     Case Management            

 

8.   Are you still receiving services from <agency>?        c     Yes                    c     No

 

8.        How long have you been receiving, or did you receive, services from <agency>?

 

            c     Less than six months                                 c     2 to 5 years

              c     6 months to 2 years                                   c     More than 5 years

 

10.  About how often do (or did) you receive services from <agency>?

 

c     Daily                 c     Twice a week          c     Twice a month             c     Every three months

c     Once a week         c     Once a month           c     Every other month       c     Other  ______________

 

                                                                       

11.   Comments.  Is there anything else that you would like to tell us about yourself or the services that you receive that might help us to better serve you?  (Please use the reverse side if needed.)

 

________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________

 

 

 

 

 

 

 

 

Thank you for taking the time to answer these questions.