Performance Measures Methodology

Measure 1.a: Measure 1.a is calculated using taxfiler data from Statistics Canada. The total aggregate income of Alberta seniors is divided by the number of seniors (65 or older) receiving income to attain the average total income of Alberta seniors. The same calculation is performed on data for Canadian seniors to attain the average total income for this population. The percentage difference between the average total income of Alberta seniors and Canadian seniors is then calculated. Incomes are reported using unadjusted dollars. To increase clarity, beginning in 2011-12 the wording of this measure will be changed to “Percentage by which senior’s average total income in Alberta exceeds the Canadian average”.

Measure 1.b: Results for Measure 1.b were calculated using data from the Special Needs Assistance Information System. The results identify the number of working days from the received date to the decision date. Working days are normal business days and do not include weekends and holidays.

Measure 2.a: The data for performance measure 2.a were collected through a telephone survey conducted by an independent research firm. Respondents are asked to answer the question “As a result of receiving [name of benefit] are you able to live more independently than if you were unable to access this benefit?” using a four-point agreement scale (strongly disagree, disagree, agree, or strongly agree). Scores 3 and 4 are combined in the results to obtain an overall rating of agreement. A total of 406 AISH clients who received at least one personal benefit responded to the telephone survey during the first two weeks of February 2011. Surveys were conducted until the targeted sample of 400 or more was reached. The resulting sample size produces results that are considered accurate to within +/- 4.9 percentage points, 19 times out of 20. For surveys up to and including the 2009-10 survey year, the population was based on clients who received personal benefits during 10 months of the fiscal year (April 1 through January 31). To meet new annual reporting deadlines, the population for the 2010-11 survey was limited to clients who received benefits during the first 8 months of the fiscal year (April 1 through November 30). In comparing 2010-11 results to prior years’ results, this methodological adjustment should be noted, but is not considered to significantly impair comparability.

Measure 3.a: Measure 3.a counts the number of affordable supportive living spaces that will be developed using grant funding committed to projects by the Ministry during 2010-11, as documented in the Affordable Supportive Living Initiative funding commitments.

Measure 4.a: Data for measure 4.a were collected by an independent research firm through telephone and mail surveys. The survey is conducted every two years. For the 2009-10 survey, the last year for which results are available, responses were collected from 1,200 randomly selected clients. To ensure representativeness, a quota for each of 5 AADL benefit categories was established and data are weighted to represent the actual distribution of clients among benefit groups. The target respondents for this measure are adults 18 years or over who have received benefits in 2009-10 through the AADL program or are caregivers for clients of the program. Caregivers were respondents in cases where the beneficiary is unable to complete the survey on his or her own. Palliative care patients are excluded from the research. The research was conducted between February 24 and March 22, 2010. Using a seven-point scale, respondents were asked to rate their level of agreement with the following statement: “The equipment or supplies you received through AADL helped you be more independent in your home or residence.” Response categories of 4 through 7 (moderately agree to strongly agree) were combined to obtain an overall satisfaction rating. The level of accuracy for this sample is +/- 2.8 per cent, 19 times out of 20. Similar survey research has been conducted with AADL clients in 2004, 2006, and 2008.

Measure 5.a: Results for Measure 5.a are derived from a survey conducted every two years by an independent research firm. In 2010-11, a written questionnaire and information about the online survey option was sent by mail to legal guardians, including public and private guardians and/or family members of adults with developmental disabilities receiving services funded by PDD. A total of 6,008 survey forms were distributed in 2010-11. A total of 2,187 survey forms were returned, representing a response rate of 36.4 per cent. With respect to the indicators that constitute the performance measure, a total of 1,913 respondents (87.5 per cent) provided valid responses. Responses of strongly agree, agree and somewhat agree were combined and are reported as satisfied. Responses of somewhat disagree, disagree and strongly disagree were combined and reported as dissatisfied. Of these valid responses, 85.3% reported overall satisfaction with funded services. Results are estimated to be accurate to within +/- 1.3%, 19 times out of 20. Surveys prior to 2008-09 used a 4-point response scale (strongly agree -- agree -- disagree -- strongly disagree). Additional response categories were added in 2008-09 to provide the program area with more detailed satisfaction data. As in prior years, performance measure results were calculated by combining all responses indicating a level of agreement or disagreement. In comparing results from 2008-09 and after to earlier results, this methodological adjustment should be noted, but is not considered to significantly impair comparability.

Measure 5.b: Data for measure 5.b is collected through a telephone survey conducted by an independent research firm of randomly selected clients and family/caregivers from lists provided by service delivery agencies funded by the Ministry. In the 2010-11 survey, the comparable client population was 1,486, and the sample included 418 respondents. Results for the client survey are considered accurate to within +/- 5 per cent 19 times out of 20. The caregiver population was 375. The caregiver sample of 222 respondents yields results that are considered accurate to within +/- 5 per cent, 19 times out of 20. In all cases, minimum surveying quotas were met to ensure a representative sample by program type or service category.

Measure 5.c: Satisfaction data for the Seniors Information Line services was collected through telephone questionnaires of 350 randomly selected clients who had contacted the Ministry on the previous day. A total of 350 surveys were completed, representing a response rate of 30.8%. The 2010-11 survey was conducted by independent surveyors from October 19 to November 1, 2010. The top two response categories (“very satisfied” and “satisfied”) of a six-point scale were combined for an overall rating of satisfaction. Prior to 2009-10, surveys were conducted during two periods of the year. Analysis of the historical data revealed no relationship between the period of the survey and satisfaction results; therefore, the second survey period was dropped for 2009-10 and subsequent years. The 2010-11 survey is considered accurate to within 5.2 per cent, 19 times out of 20.

Measure 6.a: The surveys for the Office of the Public Guardian (OPG) are conducted by telephone every two years by an independent research firm. For 2009-10, the last year for which data are available, the survey was conducted in January and February of 2010. The OPG provided a list of all private guardians who had applied for or renewed a guardianship order within 12 months of the survey. From this list of 1,269 private guardians, a random sample of 955 private guardians were notified that they may be contacted to participate in a survey. Telephone surveys were conducted until responses were obtained from 308 private guardians. This sample is directly comparable to the 2006 and 2008 surveys which focused on private guardians who had applied for or renewed a guardianship order within 12 months. Respondents were asked to use a 4-point scale of (1) “Very Satisfied”, (2) “Somewhat Satisfied”, (3) “Somewhat Dissatisfied”, (4) “Very Dissatisfied”. The responses to “Very Satisfied” and “Somewhat Satisfied” are combined in the results to obtain an overall rating of satisfaction. The results are considered accurate to within +/- 4.9 percentage points, 19 times out of 20. The OPG provided the survey firm with a list of 554 Service Providers known to have had contact with the OPG and responses were obtained from 355 service providers. Results for this survey are considered to be accurate to within +/- 3.1 per cent, 19 times out of 20.

Interviews with represented adults were undertaken by a research and service agency specializing in disability-related research. The methodology used to gather information in the 2010 survey differed from that used in 2008. In 2008, focus group discussions were held with OPG clientele. Based on feedback provided by the 2008 focus group facilitator (e.g., some represented adults experienced anxiety in a group setting), individual interviews were utilized in 2010. Due to the unique methodological constraints and small sample size for the Represented Adults survey, caution is required in comparing results across years or generalizing results to the full population. Results are considered accurate to within +/- 14.5 per cent, 19 times out of 20.