Digital transformation has led to a huge volume and variety of available data, and this has created challenges where government agencies have to improve their data management in order to continue providing successful government policies or strategies. 

While data management strategies have been updated and reworked, some data teams have used DataOps to handle large volumes of data successfully.

DataOps, also called data operations, combines agile and continuous data development methods while being supported by IT resources, focusing on collaboration and automation in the entire data life cycle of an organisation. 

Under this new set of practices, technology is used to automate the design, deployment and management of data. 

“Traditional data management practices don’t work well in AI,” says Lothar Schubert, senior director of technical marketing at Hitachi Vantara’s Senior Director of Technical Marketing Lothar Schubert says in an MIT Technology Review Insights paper on DataOps. 

“You need to be able to apply more data with new data feeds, much more frequent updates, and new data pipelines. A more agile approach is needed.” 

Aside from using technologies such as artificial intelligence, machine learning and deep learning, DataOps also enhances the use and value of data in a dynamic environment through the use of metadata. 

According to the MIT Technology Review Insights paper, collaboration between leaders, data scientists, analysts, and IT is needed under DataOps, as establishing good communication, integration and automation can be helpful in creating controllable data workflows. 

While DataOps can help government agencies fuel faster innovation and better public services, data leaders must still ensure that their new data practice is tailored for their agency as there is no all-encompassing process to it. 

As the government continues to undergo digital transformation, agencies can harness the potential power of DataOps to further protect their data and build more agile data workflows at a bigger and faster scale. 

Eliza Sayon

Website | + posts

Eliza is a content producer and editor at Public Spectrum. She is an experienced writer on topics related to the government and to the public, as well as stories that uplift and improve the community.

• Developing an effective data ecosystem
• The journey of building an ecosystem through data
• NZ government strengthens data privacy laws against third parties
• eSafety Commissioner issues legal notice against Twitter