NACCHO Aboriginal Health and Smoking : Download Tackling Indigenous Smoking Program prelim. evaluation report

 ” The overall goal of the national Tackling Indigenous Smoking (TIS) program is to improve the health of Aboriginal and Torres Strait Islander people through local population specific efforts to reduce harm from tobacco.

The purpose of this preliminary report is to provide a mid-term evaluation of progress to date in implementing the first year of the three year (2015-2018) TIS program.

The TIS programme with a budget of $116.8 million over 3 years ($35.3 million in 2015-16; $37.5 million in 2016-17 and $44 million in 2017-18) was announced by the Government, on 29 May 2015.”

Download 133 page PDF report Here :

NACCHO Download Dept Health Tackling Indigenous Smoking Evaluation June 2017

The report found the program is operating effectively, using proven approaches to change smoking behaviours, and delivering evidence-based local tobacco health promotion activities. I am pleased the report recommends it continues,

Smoking is the most preventable cause of disease and early death among Aboriginal people and accounts for almost one-quarter of the difference in average health outcomes between indigenous and non-indigenous Australians.

“The program provides grants in 37 urban, rural, regional and remote areas to assist local communities to develop localised anti-smoking campaigns

Minister Ken Wyatt

Read over 100 plus NACCHO articles published in past 5 years

This mid-term evaluation looks at progress to date of the TIS program, particularly in terms of regional grants delivering localised Indigenous tobacco interventions.

Source of intro

See list all 35 Recipients below

It does not look at long-term impact in relation to a reduction of smoking rates at a national level.

Findings focus on (see in full below 1-9)

  • the shift to TIS
  • community engagement and partnerships
  • localised health promotion
  • access to quit support
  • contribution to evidence base
  • National Best Practice Unit and TIS portal
  • governance and communications.

A number of key recommendations emerging from the evaluation are included in the report.(see Below Part 2)

Findings

1. Shift to TIS

Since the implementation of the TIS program, all grant recipients are primarily focused on planning for, and/or delivering, targeted and tailored activities that directly address reduction of smoking prevalence within communities.

For some grant recipients, broader health promotion activities without a clear link to tobacco reduction have dropped off significantly as a result of the shift to TIS, whilst for others the integration of healthy lifestyle and tobacco control strategies has been successful. There are varying degrees of clarity among grant recipients about the extent to which there is flexibility to tap into healthy lifestyle activities under the new guidelines.

2.Community engagement and partnerships

Community engagement and involvement in the design and planning of localised TIS programs is a key priority for grant recipients, and a key indicator of successful TIS activities.

While challenges were identified in terms of handling competing priorities in community, adhering to cultural protocols, and the change in focus of the TIS program and uncertainty about ongoing funding, in the main, grant recipients have demonstrated substantial progress in involving community in design and planning and garnering support for TIS activities.

This is evidenced by the popularity of community events hosted/attended by the TIS team and the proactivity of local community and Elders in advocating for tobacco control.

The success of the TIS program and the capacity for grant recipients to operate as a multi-level population health program in their region is highly dependent upon the quality and reach of partnerships between grant recipients and other agencies/organisations.

Whilst challenges to regional collaborations were reported, overall there has been a noticeable increase in the reporting of grant recipient collaboration and partnerships, representing an important shift to both a wider regional focus and wider community approach to tobacco reduction.

3.Localised health promotion

At the local level, a range of multi-component health promotion activities around tobacco control are being undertaken by grant recipients, in collaboration with external stakeholders. Local partnerships are crucial to the successful implementation of localised health promotion activities through facilitating access to priority populations, supporting capacity-building and enabling a broader population reach to achieve awareness and understanding of the health impacts of smoking and quitting pathways. viii

Increased levels of community support and ownership for local solutions to tackling Indigenous smoking are being seen across the TIS sites.

4.Community education

Community education, is being undertaken by all grant recipients. This manifests in a range of ways, including health promotion activities at community/sporting events, drama shows and comedy and social marketing.

The involvement of local champions and Elders in local education and awareness raising events and activities is recognised as central to tobacco control messages resonating with target audiences.

It has also been recognised that targeting priority groups, such as young people and pregnant women, requires the adaptation of messages so that they resonate with those groups.

Grant recipients are partnering with key local organisations (e.g. schools, other AMS etc.) to overcome some of the challenges around access to these priority groups.

Many grant recipients have established or showed progress in establishing social marketing campaigns to supplement other health promotion activities. Campaigns are developed largely through a strength-based approach, with ‘local faces and local places’ taking precedence. Grant recipients have acknowledged the challenges in measuring the impact of social marketing campaigns although some are demonstrating a commitment to collecting data on awareness, and influences on motivations and attempts to quit.

5.Smoke-free environments

An area that has been recognised by grant recipients as requiring attention is the promotion and establishment of smoke-free environments, particularly in rural and remote locations. Modelling smoke-free environments within the grant recipients’ own workplace is one way in which this issue is being addressed, with some evidence of success.

Challenges to the implementation of smoke-free workplaces include getting support from senior leaders or Board members who smoke, and organisations where tobacco control is not the main priority. Monitoring the compliance of smoke-free environments presented an additional challenge to grant recipients. Some external organisations have requested support to become smoke-free, and successful examples of smoke-free environments including smoke-free community events are evident.

Shifting attitudes around second-hand smoke (e.g. smoking indoors and in cars) and some evidence of behaviour change were reported by grant recipients and community members.

6.Access to quit support

TIS funded organisations are encouraged to take a systems approach to activity planning. The TIS program is part of a larger preventive health care system, all connected in different ways such as through referral pathways, and client appointments.

A key component of the TIS program is therefore enhancement of referral pathways and promoting access to quit support. Grant recipients have developed a range of opportunities for community members to achieve smoking cessation, with referral pathways having been established in two key areas: clinic-based referrals within their organisation and referrals made during localised TIS health promotion activities.

For some, successful referral pathways are dependent upon grant recipients partnering with external organisations.

Improving access to culturally appropriate support to quit has been a key focus of the grant recipients over the past 12 months.

Quitline enhancements are a component of the TIS program and data suggests that referrals to Quitline are higher in urban and some rural areas. Continuing to build strong partnerships between grant recipients and Quitline will be key to increasing referrals from local TIS programs into Quitline where appropriate.

Another key focus for grant recipients has been in increasing the skills of TIS workers and other professionals in contact with Aboriginal and Torres Strait Islander people to provide smoking cessation education and brief interventions. Quits kills training, and other smoking cessation education programs, have been accessed to support this goal.

7.Contributions to evidence base

The shift to delivering activities based in evidence and focusing more on outcomes than outputs has been welcomed by grant recipients, in the main, and has provided greater direction for activities and a goal to work towards.

A range of activities were undertaken by grant recipients to develop or strengthen their evidence base and work towards measurable outcomes. Collecting data remained challenging for some remote grant recipients operating in contexts with low literacy levels and where English is not the first language. Health service grant recipients wanting to collect population level data was also challenging when services are operating on different databases within a region and where there was an unwillingness to share data.

Overall, grant recipients expressed a willingness to focus on outcomes, and the confidence and capability to obtain data, although interpreting and reporting on data was presented as a challenge.

8.National Best Practice Unit and TIS portal

Advice and guidance around monitoring, measuring and further improving local TIS programs is provided to grant recipients through the NBPU TIS. Grant recipients have indicated that they value the support and advice provided through the NBPU TIS and this has aided in building their confidence and capacity to undertake monitoring and evaluation activities.

Some grant recipients reported that an additional level of support from NBPU TIS was needed. Resistance to change is common in any business when new processes are set in place. NBPU TIS therefore expected, and has witnessed, some resistance to this change. However, it continues to engage with grant recipients and support significant processes of change, not just reporting and compliance.

Another component of the work of the NBPU TIS is the development and ongoing maintenance and improvement of the Tackling Indigenous Smoking Resource and Information Centre (TISRIC) and its home, the TIS Portal (hosted by Australian Indigenous HealthInfoNet).

Information and resources to support grant recipients in planning, monitoring, and evaluating activities, as well as information on workforce development is provided through the TIS Portal.

In addition, the Portal hosts an online forum (TIS Yarning Place) that enables grant recipients from across the country to share information and ask questions. Evaluation findings suggest that, whilst grant recipients are utilising the TIS Portal, some grant recipients have identified opportunities to enhance the useability of the TIS Portal.

9.Governance and communications

Various components of support are provided to grant recipients by the department and the NBPU TIS regarding the new focus and priorities and expectations of the TIS program.

To ensure consistent program messaging, and to enhance performance reporting, a range of initiatives were undertaken in the latter half of 2016 to clarify the roles and responsibilities of the various ‘players’ in the national TIS program.

The loss of experienced staff due to funding uncertainty has represented a significant challenge for several grant recipients in their planning and implementing activities.

Particularly in remote areas, recruitment has been an issue for many grant recipients due to the mix of skills demanded of TIS staff. Grant recipients report continued issues attracting and retaining staff with only short term contracts under the new TIS program.

Despite these concerns, indications are that providing grant recipients are given sufficient time and support to execute their Action Plans, they are on track for achieving stated tobacco reduction outcomes. The key risk to this is workforce stability, which would be mitigated by timely advice about the outcome of ongoing funding arrangements.

A number of key recommendations have emerged out of the evaluation findings:

Overall recommendations

1. Department: The TIS program in its current form should be continued, with a move away from short-term funding cycles.

2. Department: Provide immediate advice about the funding of TIS from June 2017 to end of current funding cycle.

Shift to TIS

3. Department: Provide clarity around what is allowable in relation to healthy lifestyle activities within the current iteration of the TIS program  Community engagement and partnerships

4. Grant recipients: Continue to broker partnerships and leverage relationships.

5. NBPU TIS: Continue to build capability of grant recipients to broker partnerships and leverage relationships through the distribution and promotion of relevant resources.

Community education and awareness

6. Grant recipients: Continue to identify and prioritise key groups, especially pregnant women.

7. Grant recipients: Ensure evidence-based best practice community education models (including monitoring and evaluation approaches) are sought and adopted where appropriate.

8. NBPU TIS: Ensure the evidence-based best practice community education models (including monitoring and evaluation approaches) are available, particularly for priority target groups such as pregnant women and activities around social marketing.

Smoke-free environments

9. Grant recipients: Continue to explore implementing smoke-free workplaces and enhance support for smoke-free public spaces.

10. National Coordinator: Lead a dialogue between regional leaders, including CEOs, Board members of TIS and non-TIS funded organisations around establishing smoke-free environments.

Access to quitting support

11. Grant recipients: Continue to strengthen partnerships with Quitline and other quit support structures where appropriate.  Contribution to larger evidence base

12. Grant recipients: Build on routine and existing data sources to reduce data collection burden.

National support

13. Grant recipients: Continue to seek feedback from NBPU TIS regarding M&E activities where required.

14. NBPU TIS: Continue to respond to feedback from GRs around M&E needs and TIS portal content and use ability.

15. Department: Articulate the role of the National coordinator  in the context that the program has evolved and as such his role has evolved. Governance and communication

16. Department: Provide greater clarification of TIS funding parameters, especially in terms of incorporation of healthy lifestyle activities and one-on-one smoking cessation support.

The Tackling Indigenous Smoking (TIS) regional tobacco control grants aim to improve the wellbeing of Aboriginal and Torres Strait Islander people through population health activities to reduce tobacco use. It is an initiative of the Australian Government Department of Health (DoH).

At the end of 2015, a number of organisations were notified of their success in gaining a TIS grant for culturally appropriate tobacco cessation programs. The grants were awarded to a variety of service providers across the nation.

The 35 organisations that have commenced their programs are:

With the program funding provided until 2018, the successful organisations will work towards the intended outcomes of the TIS programme, including:

  • encouraging community involvement in and support for local tobacco control activities
  • increasing community understanding of the dangers of smoking and chewing tobacco
  • improving knowledge, skills and a better understanding of the health impacts of smoking.

Aboriginal Health Programs-Debate : Evaluating #Indigenous programs : a toolkit for change

 

 ” The Federal Government recently announced it will allocate $10 million a year over four years to strengthen the evaluation of Indigenous programs.

However, given that the average cost of an evaluation is $382,000, the extra $10 million a year for Indigenous program evaluations will not go far.

To make the most of this additional funding the government must change the way it evaluates and monitors programs.”

Sarah Hudson Researcher The Centre for Independent Studies

Download the report HERE

Evaluating Indigenous programs a tool kit for change

” Aboriginal community-controlled organisations treat health not just as a physical problem, but see it as tied in with the social, emotional and cultural wellbeing of the whole community, in which each individual is able to achieve their full potential as a human being.

While this has its roots in Aboriginal cultural norms, she says, it also mirrors well-known social determinants of health.”

 ” Victoria’s peak Aboriginal health body was recently given two days to respond to a draft family violence plan “the size of a PhD”, its CEO says. It’s another example of governments just not getting how to work with Aboriginal communities.

Co-design with community groups cannot work if government asks for input after the big decisions have already been made or rush consultation, warns the head of Victoria’s peak body for the Aboriginal community health system.

“It’s not an equal partnership. We’re at their whim, and we’ve got to run to their agenda,”

Victorian Aboriginal Community Controlled Health Organisation CEO Jill Gallagher said last week in a speech at the University of Melbourne. See Article 2 Below

” Evaluation at the contract, program and outcome level will ensure we not only know where the money is being spent, but we will know what works and why.

“This is important for the government and taxpayers, but more important for communities in whose name the money is spent.

“It will also mean we will be better able to assess where our investm­ent needs to be focused in the future — and ensure the IAS continues to deliver outcomes for indigenous communities.”

From Indigenous Affairs Minister Nigel Scullion Article 3 below

 Feb 3 2017 NACCHO Aboriginal Health #IAS Funding : Turnbull government to spend $40m evaluating effectiveness of Indigenous programs 

Although formal evaluations for large government programs are important, evaluation need not involve outside contractors. Government must adopt a learning and developmental approach that embeds evaluation into a program’s design as part of a continuous quality improvement process.

It is not enough just to evaluate, government must actually use the findings from evaluations to improve service delivery. Unfortunately, many government agencies ignore evaluations when making funding decisions or implementing new programs.

Analysis of 49 Indigenous program evaluation reports, found only three used rigorous methodology.

Overall, the evaluations were characterised by a lack of data and the absence of a control group, as well as an overreliance on anecdotal evidence.

Adopting a co-accountability approach to evaluation will ensure that both the government agency funding the program and the program provider delivering the program are held accountable for results.

An overarching evaluation framework could assist with the different levels of outcomes expected over the life of the program and the various indicators needed to measure whether the program is meeting its objectives.

Feedback loops and a process to escalate any concerns will help to ensure government and program providers keep each other honest and lessons are learnt.

Analysis of Indigenous program evaluations

Mapping of total federal, state and territory and non-government/not-for-profit Indigenous programs identified 1082 Indigenous specific programs. Of these:

49 were federal government programs;

• 236 were state and territory programs; and

• 797 were programs delivered by non-government organisations.

The largest category of programs were health related programs (n=568) followed by cultural programs (n=145) then early childhood and education programs (n=130) — see Figure 1.

The program category with the highest number of evaluations was health (n=44), followed by early childhood and education (n=16). However, percentage wise, more programs were evaluated under the jobs and economy category (15%) than the other program categories.

Of the 490 programs delivered by Aboriginal organisations, only 20 were evaluated (4%). The small number of businesses delivering a program (n=6) meant that while there were only two evaluations of Indigenous programs provided by a business, this category had the highest percentage of programs evaluated (33%).

Similarly, while only six of the 33 programs delivered by schools and universities were evaluated, this category had the second highest percentage of programs evaluated (23%). Conversely, government and non-Indigenous NGO delivered programs had the highest number of evaluations, n=36 and n=24, but much lower percentages of evaluations as the number of overall programs was higher, n=278 and n=276.

A total of 49 evaluation reports were analysed and assessed against a scale rating the rigour of the methodology. Only three evaluation reports utilised strong methodology (see Figure 4).

In general, Indigenous evaluations are characterised by a lack of data and the absence of a control group, as well as an over-reliance on anecdotal evidence

Suggestions for policy makers and program funders include:

  • Embedding evaluation into program design and practice — evaluation should not be viewed as an ‘add on’ but should be built into a program’s design and presented as part of a continuous quality improvement process with funding for self-evaluation provided to organisations.
  • Developing an evidence base through an accountability framework with regular feedback loops via an online data management system — to ensure data being collected is used to inform practice and improve program outcomes and there is a process for escalating concerns.

Suggestions for program providers include:

  • Embedding evaluation into program practice — evaluation should not be viewed as a negative process, but as an opportunity to learn.
  • Developing an evidence base through the regular collection of data via an online data management system to not only provide a stronger evidence base for recurrent funding, but also to improve service delivery and ensure client satisfaction with the program

Article 2 Govt co-design ‘not an equal partnership’: Aboriginal health CEO

Victoria’s peak Aboriginal health body was recently given two days to respond to a draft family violence plan “the size of a PhD”, its CEO says. It’s another example of governments just not getting how to work with Aboriginal communities.

Co-design with community groups cannot work if government asks for input after the big decisions have already been made or rush consultation, warns the head of Victoria’s peak body for the Aboriginal community health system.

“It’s not an equal partnership. We’re at their whim, and we’ve got to run to their agenda,” Victorian Aboriginal Community Controlled Health Organisation CEO Jill Gallagher said last week in a speech at the University of Melbourne.

A particularly vivid example of this is engagement on the establishment of family violence hubs around the state. Gallagher, who is on the family violence industry taskforce, said she was handed a draft plan already outlining the main priorities on Monday, and asked to provide a written response by Wednesday. “A report the size of a PhD,” she added.

“So when they say ‘we want to co-design with you guys’, always ask them what their version of co-designing is,” she told the audience. “Without systematic change in mainstream attitudes and practices, and incorporation of Aboriginal peoples in all stages of policy design, health policies will remain unproductive.”

While Gallagher says she understands the challenges of trying to co-design with a community, government needed to make a more concerted effort to do it properly.

“It doesn’t give us due respect of being part of the beginning right through to the evaluation.”

Culture is strength

Aboriginal culture is often seen in the wider Australian population as a barrier to health, implying that assimilation is the only way forward, Gallagher said.

She rejects this idea. “Cultural differences need to be celebrated and preserved. They are a source of strength and resilience for our peoples, which offer protective factors against traumatic life events.”

Cultural safety and trust can have a big impact on engagement with institutions. She points to the fact that around the country, Aboriginal people are discharged against medical advice or at their own risk at eight times the rate of the rest of the population. This has obvious flow on effects for overall wellbeing.

“When we have a culturally safe place for patients and our people, we improve access to services and improve health for individuals, therefore health for families, therefore health for communities.”

Also in The MandarinIndigenous policy evidence, where it exists, over-relies on anecdotal evidence

Creating that environment should not only be up to Aboriginal employees or a good CEO, but come out of an organisation’s systems. This means more than just creating a few identified positions — it’s everyone’s responsibility.

Aboriginal community-controlled organisations treat health not just as a physical problem, but see it as tied in with the social, emotional and cultural wellbeing of the whole community, in which each individual is able to achieve their full potential as a human being. While this has its roots in Aboriginal cultural norms, she says, it also mirrors well-known social determinants of health.

“Possessing a strong sense of cultural identity is also vital for one’s self-esteem. A positive cultural connection not only contributes to better mental health and physical health, but may lessen the consequences of social prejudice against Aboriginal peoples.”

Yet despite plenty of experience to show the importance of culture as a source of resilience, it “remains largely unexplored” as a public health resource, she says.

Funding models that don’t fit

Governments ignoring the role of culture creates other problems, Gallagher explains.

The Commonwealth made a capital investment a few years ago to create a childcare centre and kindergarten in Melbourne’s northern suburbs called Bubup Wilam. Recurrent funding was only given for two years, with the idea that it would become self-sustaining by the end of that short period.

“Bubup Wilam grew and evolved and it’s a beautiful childcare centre and kindergarten for Aboriginal children, where they can learn and express aboriginal culture but also have access to what every other kid has access to.

Despite the success, it’s “struggling to continue that at the moment” and is trying to raise funds in the community, she says, “because it doesn’t just provide a kindergarten like for a mainstream nuclear family.”

“Because a lot of the kids and families that access Bubup Wilam are families that live well under the poverty line, a lot of them are touched by the child protection system. What Bubup Wilam tries to do is work with the children, but also work with the families — the mum or the dad or the caregiver — and that takes a lot of resources.

“So our model there does not fit within the mainstream model of how they fund a nuclear, non-Aboriginal childcare centre. … So that’s an example of how the differences and different needs and funding formulas don’t fit what we need to achieve.”

This comes back to the co-design problem: governments aren’t paying enough attention to what the community says, and end up designing the system to fit what they think the community needs, which is different to what it really needs.

“It’s about involving us from the word go,” says Gallagher.

“What Fitzroy might need is different to what Fitzroy Crossing might need.”

Part 3 : Indigenous Affairs Minister Nigel Scullion

The Turnbull government will spend $40 million evaluating its indigenous affairs programs in an attempt to counter a national audit office report expected to be harshly critical of the way billions of dollars have been allocated.

Sidelined prime ministerial indigen­ous adviser Warren Mundine said yesterday the report, to be tabled today, was expected to be “damning”, as was the official Clos­ing the Gap report due within days.

The audit office report follows a Senate inquiry last year that blasted the 2014 implementation of the Abbott government’s flagship multi-billion-dollar Indigenous Advancement Strategy.

A 2015 Productivity Commission report found there was insufficient evidence being collected about the outcomes of indigenous programs and that “formal rigorous evaluations of indigenous programs that set the benefits of particular policies for reducing disadvantage against the costs are relatively scarce”.

Spending on mainstream and indigenous-specific programs and services has been estimated by the government to be worth $30 billion. A Centre for Independent Studies report last year found only 8 per cent of 1082 indigenous-spec­ific programs, worth $5.9bn, had been effectively evaluated.

However, Indigenous Affairs Minister Nigel Scullion, who will announce the four-year evalua­tion program today, said reporting, monitoring and evaluation of the IAS had already been improved­, and accounting for how much was being spent in the portfolio was now possible.

“However, we need to continually build on this and further strengthen the evaluation of our investment to ensure that money allocated through the IAS is invest­ed in ways that make the greatest difference for our first Australians,” Senator Scullion said. “By establishing a multi-year funding allocation, we are ensuring there will be a long-term plan for evaluation and a formal strategy to monitor and review how individ­ual contracts and program streams are contributing to our effort­s to deliver better outcomes for indigenous Australians.

Senator Scullion said the evaluation would be rolled out in close consultation with Aborigines and Torres Strait Islanders, including­ indigenous-run firms. “Indig­enous-run companies are currently delivering rigorous evaluation for the government and this new framework will continue this partnership,” he said.