Punching Above your Weight & ILC

If you are running a peer support program for the disability sector in Australia then you are apt to either be receiving, or aspiring to accept, funding from the NDIA by way of its ILC grants. The NDIA have very clear ILC outcomes they are seeking from any programs they will fund. When orchestrating an application for ILC funding, your organisation has to pinpoint how the endeavour adds to one or more of the five ILC outcomes and how you will assemble evidence on this effort. Consequently, grant applications ought to contain outcome assessment information. This will function as one dynamic of our ‘Funders’ perspective within the BSC. In a majority of circumstances, peer programs will come via ‘Individual Capacity Building’ for which the outcome objective is as follows:

ILC funded peer programs are be required to track, assess and formally document both process and activity outcomes. Gathering evidence on the process of delivering an ILC activity incites a give and take of feedback between peer organisations and their members. Gathering evidence on process outcomes enables the peer program to capture greater insight into the effectiveness of the program for people with disability, in real-time. You gather evidence to detect any enablers for this success and any outside barriers that may be constraining the program. Monitoring and reporting of activity outcomes will be one facet of the reporting requirements for attaining ILC funding from the NDIA. Activity evidence regards: To what extent are things being done? How well is this happening? Moreover, which shifts took place in participants’ lives? This is the difference that your peer program has made for individual members, and could be evidenced by storytelling, case studies or pre-and-post-surveys.

ILC, as potential funders, want peer organisations to have the capacity to measure, amass evidence, and report on outcomes. Outcome evidence shows the ILC that your peer team have embedded an outcomes orientation for their peer program. Unless your peer organisation is able to establish a system, which reflects activity and process outcomes for the funder ‘ILC’, it is improbable you will be able to work well in this space. This is one of the main aims for the development of this training resource.

‘Why is it important to measure outcomes?
Shifting to an outcome-focused way of measuring your activities is important. It will help ensure you are delivering tangible results for people with disability. It will also:

Prove your impact in a clear and compelling way

Improve the impact of your services over time

Increase your funding sustainability (e.g. bulk funding arrangements, pay by results contracts, social benefit/impact bonds)

Demonstrate that your organisation’s approach is unique, integrated and good value for money’

SELF STUDY Q7.2

Why do you need to focus on outcomes when considering evidence collection for the ILC?

What is the most important thing you want the ILC to know about your peer program?

Which of your BSC objectives does this relate to? (Perhaps add a ‘*’ on this in your BSC table to ensure you focus on this).

It is very clear that concentrating on outcomes is critical for achieving future support from the ILC. It is also apparent that the NDIS is re-evaluating and adjusting this investment area. ILC details are presently in the restructuring stage. As such, this resource is taking a very broad view to ensure our foundations remain relevant, and our evidence useful, regardless of the ILC specifics which correlate with ILC assessment and reporting responsibilities. Changing your unique ‘compass’ whenever the ILC changes its tool or reporting requirements would be less than ideal. It would call for additional staff investments around learning, training, change management and alike. This would also not allow you to see your journey thus far very clearly.

The NDIA have also recently (end of 2018) announced a new investment strategy for ILC. They state that they ‘have learned a lot about what works and what doesn’t during the early implementation of the ILC program and have been listening to feedback from the community and key stakeholders’. Consequently they are changing the approach to the way they invest in building individual and community capacity and have released ‘The Strengthening ILC: A national strategy towards 2022’ to explain the new approach.

Consequently, while we have alluded to inclusion of ILC outcomes being a principal dimension of objectives within the ‘Funders’ perspective, it is not the only outcomes to consider. We aspire to compile evidence about essential outcomes, centring on our robust foundation – our Human Rights beliefs. As was reflected upon more deeply in Section 5, we anticipate you will apply survey data for analysing a portion of ILC Outcomes. We presented you with an example survey and show you now its development from the ILC Framework in place, at that time:

Performance Indicators	Brief Description/Notes
Increased understanding of the NDIS and the principles which underpin it	Local Support Group members need an increased understanding of the NDIS and its underlying principles to fully participate and benefit from this new disability system. We have gained feedback on this indicator in a range of ways: Level of provision of NDIS information at groups and our volunteer training retreat; Individual surveys relating to ILC objectives; National evaluation data; and, Group surveys data relating to NDIS knowledge 1. NDIS Information Provided at LSGs 2016: A new topic has been delivered at various groups this year. This directed attention towards the NDIS and its underlying principles including choice and control, the insurance model and its focus on goals. To further our understanding, the topic has been provided throughout the year as we move toward full rollout for adults from July 2017, further ensuring we increase understanding of the NDIS and the principles underlying it: In addition, the focus on goals and holding valued roles within the community has been delivered via three of our new LSGs for 2016 – the Planning Cohorts. These three cohorts each take 5-8 people with disability and, supported by their own support network of family and friends (who are all encouraged to attend), work through a life planning process, a central theme of which, is, helping the person with disability to articulate their life goals and aspirations. There is a focus on the use of informal supports, and we take all participants through the required thinking this underpins the NDIS. We believe these groups; most fully prepare attendees for the NDIS. 2. NDIS Information Provided at Retreat 2016: At the retreat held in late May/early June, participants were offered a range of NDIS information. Through this, our group leaders can become ambassadors for the new disability system, providing answers to member requests and confidence about the process ahead. Our evaluation then assessed whether this resource gave improved NDIS knowledge, and it is clear from responses it did: Some of the quotes received in response to a question on the most helpful information from the retreat included: All the latest on the NDIS, NDIA and ILC. Information regarding the NDIS. This is information I need to hear a number of times to begin to understand it. I do have a clearer idea of what is happening now and of what is yet to be determined. ILC framework introduction. NDIS, ILC framework, financials and where do we go from here. Upgrades on the changes on NDIS, NDIA. Finding out where we are at re NDIS/NDIA, although there are still “unknowns” externally that could enable forward planning. Making sure we are all on the same page. 3. NDIS Individual Survey Data: Our individual surveys included questions relating to the NDIS – specifically questions 12 and 6. The responses to these questions are provided here and illustrate we are building NDIS knowledge in our members: Question 12: Has being a member helped you to know more about the NDIS and what supports are available under this scheme? This question was rated 1, 0, -1 and entered into our evaluation data spreadsheet. From the 19 surveys recorded, 12 members agreed LSGs have assisted members to know more about what is available, five respondents were unsure, and one did not think we had assisted. Out of the six respondents unsure or not agreeing, five had not had the NDIS topic delivered at their LSG at the time of the survey being undertaken. We feel these results are impressive particularly given that, in reality, a majority of members are yet to be able to access the NDIS for another 12 months. Due to the timing, our team made the decision to keep our NDIS sessions broad and focussed on concepts such as choice and control rather than specifics, as this will be delivered in 2017 sessions (if we are able to continue operating as a DSO). *Question 6:* Do you feel that Families4Families effectively promotes the independence and full participation of people with ABI and their families? This question was rated 1, 0, -1 and entered into our spreadsheet and 100% of members agreed that our LSGs have promoted their full community participation and independence. 4. National Evaluation Interview Data: The national lead agency undertook independent evaluations of DSO members from all the DSOs throughout May 2016. The summary report from this is provided in Appendix C. The specific comments most relevant in providing outcome data on NDIS knowledge and principles are as follows: *Question (topic 2):* Would you like your peer group to keep going to help you understand more about the NDIS? Key themes: 2a) Definitely want peer groups to continue with rollout of NDIS. Initial discussions on NDIS have commenced, focusing on what is a good life and the importance of planning Started talking about NDIS – doing a group of planning session to do our plans for NDIS. Coming to terms with NDIS. ‘Planning a good life’ sessions. Going through how things affect us and what we want, to see what goals could be, and what our fears are. Doing posters and planning book. Each week a different topic/ poster. F4F will give us a template for planning. Giving us 3-4 pages at a time – gradually – not overwhelming. Will make a difference with NDIS – enables family to understand what’s going us and each to get to understand what the other wants. Understanding NDIS process better now. I can target things I know I need with NDIS e.g. physio, cleaner, shopping assistance. Preparing for the NDIS now. F4F briefed us on what it is and maybe what it can do for you. Helping me put together a plan in readiness for NDIS. Didn’t realize how important a plan was. I don’t know what they can do for me yet. I don’t want others making a plan for my life or decisions for me that are not right for me. The planning provided for F4F is crucial. I didn’t know it was that important to have a plan. Without the plan I wouldn’t know what to ask or tell the NDIS. Will need more NDIS sessions. As things change the NDIS is impacting on people differently. Not really sure what NDIS can do for me yet. Need the supports through the NDIS to maintain a good life. We need to aim big. Hearing about the NDIS from others perspective is really good. 5. Group Survey Data: Many of our Local Support Groups were surveyed during June 2016 as an update to the group surveys undertaken in the second half of 2015. Question 5, the last one, asked ‘if Families4Families and its groups didn’t exist, would you have any unmet needs? If so, how else could they be met?’. In LSG019, one of our Planning Cohorts evaluated on 14 June, a response specifically addresses this indicator: No knowledge about information.; Only through F4F meetings did members learn about information about NDIA. Only through F4F did member learn where to seek leg brace to support him. In summary, Families4Families has provided clear evidence of its members and LSG participants having an increased understanding of the NDIS, and the principles which underpin it.

Performance Indicators

Brief Description/Notes

Increased understanding of the NDIS and the principles which underpin it

Local Support Group members need an increased understanding of the NDIS and its underlying principles to fully participate and benefit from this new disability system. We have gained feedback on this indicator in a range of ways:

Level of provision of NDIS information at groups and our volunteer training retreat;
Individual surveys relating to ILC objectives;
National evaluation data; and,
Group surveys data relating to NDIS knowledge

1. NDIS Information Provided at LSGs 2016:

A new topic has been delivered at various groups this year. This directed attention towards the NDIS and its underlying principles including choice and control, the insurance model and its focus on goals. To further our understanding, the topic has been provided throughout the year as we move toward full rollout for adults from July 2017, further ensuring we increase understanding of the NDIS and the principles underlying it:

In addition, the focus on goals and holding valued roles within the community has been delivered via three of our new LSGs for 2016 – the Planning Cohorts. These three cohorts each take 5-8 people with disability and, supported by their own support network of family and friends (who are all encouraged to attend), work through a life planning process, a central theme of which, is, helping the person with disability to articulate their life goals and aspirations. There is a focus on the use of informal supports, and we take all participants through the required thinking this underpins the NDIS. We believe these groups; most fully prepare attendees for the NDIS.

2. NDIS Information Provided at Retreat 2016:

At the retreat held in late May/early June, participants were offered a range of NDIS information. Through this, our group leaders can become ambassadors for the new disability system, providing answers to member requests and confidence about the process ahead. Our evaluation then assessed whether this resource gave improved NDIS knowledge, and it is clear from responses it did:

Some of the quotes received in response to a question on the most helpful information from the retreat included:

All the latest on the NDIS, NDIA and ILC.
Information regarding the NDIS. This is information I need to hear a number of times to begin to understand it. I do have a clearer idea of what is happening now and of what is yet to be determined. ILC framework introduction.
NDIS, ILC framework, financials and where do we go from here.
Upgrades on the changes on NDIS, NDIA.
Finding out where we are at re NDIS/NDIA, although there are still “unknowns” externally that could enable forward planning. Making sure we are all on the same page.

3. NDIS Individual Survey Data:

Our individual surveys included questions relating to the NDIS – specifically questions 12 and 6. The responses to these questions are provided here and illustrate we are building NDIS knowledge in our members:

Question 12: Has being a member helped you to know more about the NDIS and what supports are available under this scheme? This question was rated 1, 0, -1 and entered into our evaluation data spreadsheet. From the 19 surveys recorded, 12 members agreed LSGs have assisted members to know more about what is available, five respondents were unsure, and one did not think we had assisted. Out of the six respondents unsure or not agreeing, five had not had the NDIS topic delivered at their LSG at the time of the survey being undertaken. We feel these results are impressive particularly given that, in reality, a majority of members are yet to be able to access the NDIS for another 12 months. Due to the timing, our team made the decision to keep our NDIS sessions broad and focussed on concepts such as choice and control rather than specifics, as this will be delivered in 2017 sessions (if we are able to continue operating as a DSO).
Question 6: Do you feel that Families4Families effectively promotes the independence and full participation of people with ABI and their families? This question was rated 1, 0, -1 and entered into our spreadsheet and 100% of members agreed that our LSGs have promoted their full community participation and independence.

4. National Evaluation Interview Data:

The national lead agency undertook independent evaluations of DSO members from all the DSOs throughout May 2016. The summary report from this is provided in Appendix C. The specific comments most relevant in providing outcome data on NDIS knowledge and principles are as follows:

Question (topic 2): Would you like your peer group to keep going to help you understand more about the NDIS?

Key themes: 2a) Definitely want peer groups to continue with rollout of NDIS. Initial discussions on NDIS have commenced, focusing on what is a good life and the importance of planning

Started talking about NDIS – doing a group of planning session to do our plans for NDIS. Coming to terms with NDIS.
‘Planning a good life’ sessions. Going through how things affect us and what we want, to see what goals could be, and what our fears are. Doing posters and planning book. Each week a different topic/ poster.
F4F will give us a template for planning. Giving us 3-4 pages at a time – gradually – not overwhelming.
Will make a difference with NDIS – enables family to understand what’s going us and each to get to understand what the other wants.
Understanding NDIS process better now. I can target things I know I need with NDIS e.g. physio, cleaner, shopping assistance.
Preparing for the NDIS now. F4F briefed us on what it is and maybe what it can do for you. Helping me put together a plan in readiness for NDIS.
Didn’t realize how important a plan was. I don’t know what they can do for me yet. I don’t want others making a plan for my life or decisions for me that are not right for me.
The planning provided for F4F is crucial. I didn’t know it was that important to have a plan. Without the plan I wouldn’t know what to ask or tell the NDIS.
Will need more NDIS sessions. As things change the NDIS is impacting on people differently.
Not really sure what NDIS can do for me yet. Need the supports through the NDIS to maintain a good life. We need to aim big.
Hearing about the NDIS from others perspective is really good.

5. Group Survey Data:

Many of our Local Support Groups were surveyed during June 2016 as an update to the group surveys undertaken in the second half of 2015. Question 5, the last one, asked ‘if Families4Families and its groups didn’t exist, would you have any unmet needs? If so, how else could they be met?’. In LSG019, one of our Planning Cohorts evaluated on 14 June, a response specifically addresses this indicator:

No knowledge about information.;
Only through F4F meetings did members learn about information about NDIA.
Only through F4F did member learn where to seek leg brace to support him.

In summary, Families4Families has provided clear evidence of its members and LSG participants having an increased understanding of the NDIS, and the principles which underpin it.

At the commencement of the DSO project, the ILC Team set a range of specific performance indicators. This example survey was utilised within the Families4Families peer support network. A component of reporting required feedback on these indicators. It was a condition; they needed to be addressed through written reports. Nevertheless, a report constructed from evidence collated on a sole performance indicator (‘Increased understanding of the NDIS and the principles which underpin it’), is presented in the following table.

As you can see in this single item table, evidence on that specific indicator was collected and presented in several different ways. The focus of this report was depicting not only the outcomes that group members gained but also illustrating the variety of ways the peer program ensured this coverage as well as the variety of ways evidence was collected. Naturally, having different data sources always improves the strength of evidence you are presenting. The technical term for ensuring you have evidence collected from multiple sources, using multiple methods, is triangulation:

Triangulation is a powerful technique that facilitates validation of data through cross verification from two or more sources. In particular, it refers to the application and combination of several research methods in the study of the same phenomenon.

Bogdan and Biklen, 2006

holistic approach to our reporting to them. For our ILC reporting requirements, we will more than likely be able to utilise the same collected and collated information required to assess our Balanced Scorecard objectives. We will also be able to provide evidence of our past success, learnings, knowledge and expertise so crucial for ILC grant funding submission success. This prepares us to explain our evaluation model and plan, another key requirement for ILC grant funding submission success.

One of the most exciting benefits of excellent peer program information gathering plans is that your evidence can successfully pitch you against the ‘big players’ in the marketplace. Evidence enables you to illustrate your experience and hard-earned expertise. This guarantees your place as a market leader, despite being a relatively small user-led organisation.

Capsule: As a user-led peer organisation, your tailored evaluation plan will be essential for ILC grant success and your evidence will enable you to bid against larger players in the marketplace – ‘punching above your weight’.

SELF STUDY Q7.3

Write 2-3 sentences on why you believe your peer program ‘punches above its weight’. For example, is this because of your people, knowledge & experience, your history, and/or perhaps the links you have with other community groups?

Briefly write one way you could prove this to the ILC decision makers using collected evidence.

Previous Next