![Data is at the heart of today’s government services. This is reflected in the federal government’s Data and Digital Government Strategy (the Strategy), which highlights its goal to use data, analytics, and technology to deliver simple, accessible services for people and businesses by 2030. As noted in the strategy, Australians expect personalised, integrated, and easy-to-use services from government entities they engage with. Such personalisation, especially across digital channels, is heavily dependent on data. Delivering such services becomes more effective when the data is more accurate and up-to-date. This is where real-time data comes into play. Why? Real-time data is more accurate because it is always up-to-date. This, in turn, improves the customer experience by enabling services to be more dynamic and interactive. However, because batch processing still accounts for the majority of data processing in government ranks, even the most recent data may become outdated when used to deliver government services. Engage with data in motion Batch processing is when the processing and analysis happen on a set of data that has already been stored for a period of time. This may be days, weeks, or even months, which just doesn't cut it for delivering dynamic and interactive citizen services. In recent years, data streaming has emerged as the technology that allows organizations to tap into their data in real-time in order to improve citizen engagement and experience. Event streaming, another name for data streaming, describes the continuous flow of data as it occurs. This enables true real-time processing and analysis for immediate insights. Streaming data distinguishes itself from batch processing by delivering the most up-to-date information when required. Apache Kafka, one of the most successful open source projects, is used by over 70% of Fortune 500 companies today and is well recognised as the de facto standard for data streaming. The open-source nature of Kafka lowered the entry barrier for working with streaming data, allowing companies to easily build use cases and solutions. However, as with all open-source software, there are limitations. Companies often end up spending more to efficiently manage, scale, secure, and evolve the streaming infrastructure. Why are we still using batch processing if data streaming is the future? Batch processing is still simpler to implement than stream processing, and successfully moving from batch to streaming requires a significant change to a team’s habits and processes, as well as a meaningful upfront investment. That is why Confluent has rearchitected Kafka to create a complete platform that provides a fully managed, cloud-native data streaming solution with the ability to turn data events into outcomes, enable real-time apps, and empower teams and systems to act on data instantly. Personalised for the people Confluent’s ability to utilise data as a continually updating stream of events rather than discrete snapshots means that public sector organisations can leverage data streaming to improve citizen engagement by offering personalised, data-driven services and insights. Confluent’s data streaming platform also enables real-time monitoring and analysis of government services and infrastructure, allowing public sector entities to quickly respond to critical events such as natural disasters or public health emergencies. At a more mundane level, Confluent supports data sharing and collaboration among government agencies, facilitating the seamless exchange of information to serve the public better and optimise resource allocation. And, importantly for government organisations, Confluent’s data streaming capabilities can enhance cyber security by detecting and mitigating threats in real time and safeguarding sensitive government data—a critical element in maintaining our national security. Indeed, 53% of Australian businesses surveyed in a recent Confluent study cited security and compliance awareness as the most applicable use cases for data streaming. It should come as little surprise, then, that industry analyst firm Forrester views Confluent as “an excellent fit for organisations that need to support a high-performance, scalable, multi-cloud data pipeline with extreme resilience.” Streamlining service improvement Data streaming is driving greater efficiency in more than three of four companies across Asia Pacific, according to Confluent research. Meanwhile, 65% of IT leaders polled see significant or emerging product and service benefits from data streaming. With this in mind, the potential for the government to do more with its data is clear, and personalisation is top of mind. Personalising citizen service experiences requires knowing who a customer is at any given moment. This is made possible by accessing data in motion, especially across multiple touchpoints. At the very least, this can help citizens avoid having to provide the same information over and over again as they interact with government agencies. And now, with Confluent assessed under the Australian Information Security Registered Assessors Programme (IRAP), government agencies with an Information Security Manual PROTECTED level requirement can use Confluent Cloud across Amazon Web Services (AWS), Google Cloud, and Microsoft Azure. Australian government agencies will then be able to gather and share data across departments, offices, and agencies securely and at scale. This means even more government agencies will be able to tap data in motion to integrate information across their applications and systems in real time and reinvent employee and citizen experiences for the better.](https://publicspectrum.co/wp-content/uploads/2024/05/Confluent-Advertorial.png)
Amidst the looming federal election, the urgency to engage strategically escalates for the social and not-for-profit sectors. With parties unveiling their main election platforms (such as “A Future Made in Australia” for ALP and “Back to Basics” for Libs), social sector organisations must assess how their priorities align with these platforms and where they may need to advocate to ensure their issue—and the communities they represent—aren’t left with crumbs (or nothing at all) on election night.
Given that elections only happen every three years or so, they present a rare opportunity to drive significant policy changes and secure essential funding.
Currently, we are in the period between budget cycles (June to September). Organisations should take advantage of this time to establish strong relationships with MPs from major and minor parties to ensure effective engagement come October. This is crucial as October marks the beginning of the government’s budget planning process, including allocating new funds for the election. You could aim for MYEFO, but to do so, you’ll need to begin right away. And in reality, the election is where the biggest gain can be made.
The government’s attention is finite, and you can try your best to time your message with the Overton window, but in practice, organisations that delay engaging to build relationships risk being overlooked for the election. Early engagement ensures sustained interaction and avoids competing with a flood of latecomers. Effective government engagement demands a focused strategy and a tailored set of tactics to achieve the desired outcomes. Politics is, after all, as much art as science.
Looking ahead to the election, it’s imperative for organisations to make progress in securing commitments from both major and minor parties. A straightforward tactic involves obtaining a commitment from one major party and then persuading the other major party to match it. By adopting this simple strategic approach, not-for-profits can make great headway in obtaining their fair share of funding from elections.
For example, at Tanck, we’ve helped a not-for-profit in the health field that was keen on securing bipartisan funding for their projects in an election. Cautious about offending either side, by crafting messaging and a project that homed in on political priorities (jobs, health, security, etc.), we were able to secure almost matching announcements that framed the project to the particular worldview of the different parties. What this achieved was to enable both major parties to claim a win, as well as secure similar (but not identical) funding commitments for our client.
It’s key to point out that tactics vary across sectors, as some issues fluctuate in popularity or controversy from one election to another. So, it’s crucial to gauge the current status of a given issue and adapt tactics accordingly.
However, a consistently unsuccessful tactic is to make bold demands or public declarations without leverage. Politicians easily dismiss such actions, often leading to a loss of political goodwill and relationships without gaining any tangible benefits. Regrettably, I see this all too often played out by well-meaning leaders.
Across social sectors, the challenges vary significantly. This variability stems from the fluctuating attention different issues receive in the media or public discourse, often depending on chance. The goal should be to establish a structured government engagement process that not only addresses challenges but also positions your charity to capitalise on favourable circumstances as they arise. There are alternatives, but none of them are strategic.
So, what does this all mean? The upcoming federal election represents a pivotal moment for the social and not-for-profit sectors, offering rare opportunities to shape policy changes and secure vital funding. As parties unveil their election platforms, organisations must assess alignment with their priorities and engage with policymakers strategically. You can wait, but you’ll be waiting at least another three years if you do.
Angus, a co-founding director of Tanck, is a seasoned political advisor with a deep understanding of government decision-making. His ministerial career includes social and economic super portfolios, managing projects worth over $4 billion. Since leaving politics, Angus has been instrumental in helping various social sector and purpose-led organisations establish effective government engagement and advocacy systems, achieving sector firsts in policy statement delivery and funding certainty.
A proud LGBTIQ+ advocate, Angus’ personal journey and experience in supporting marginalised Australians have instilled in him a profound sense of empathy. A desire to effect meaningful social change and empower the social sector to effectively compete with lobbyists and private interests drives his work. His next step with Tanck embodies this commitment, aiming to contribute to a better future.