Trust in government data systems is a delicate balance, and officials are emphasizing the importance of transparency. However, a recent release of heavily redacted documents has sparked controversy and left many questions unanswered.
The Power of Transparency
In a world where data is king, ensuring the public's trust in how their information is used is paramount. Officials recognize this, stating that transparency is crucial to building confidence in the government's data infrastructure. Yet, when it comes to the business case for expanding the Integrated Data Infrastructure (IDI), a critical system, the details are largely obscured.
A Blank Canvas
Over two-thirds of the 95-page business case document is redacted, leaving little insight into the government's plans. The red pen has covered up options, costs, and even the cost-benefit analysis. Despite this, the report hints at the need for clearer communication about data use, access, and safeguards, a sentiment echoed by various groups during workshops.
The Trust Factor
Some groups have expressed deep-rooted mistrust in the government's data practices. Stats NZ acknowledges this, emphasizing that trust and reciprocity are foundational to any future data system. The IDI is a powerful tool, integral to the government's social investment approach, but it faces barriers.
A Social License to Operate
The report raises concerns about the untested social license for expanded social investment. It highlights the need for robust data ethics practices and safeguards to maintain public trust. The government must ensure individuals and communities feel comfortable sharing their data.
The Urgent Need for Transformation
Both the business case and a Cabinet paper emphasize the urgency of modernizing the "clunky and slow" IDI. The IDI is described as the tool that "brings it all together," yet the reasons for its overhaul are largely hidden behind redactions.
What's Left Unsaid
The redacted sections include options, comparisons, and recommendations. The "Economic Case," "Commercial Case," and "Financial Case" sections are entirely blanked out, leaving the public in the dark about funding models and affordability. Key risks, constraints, and assumptions are also missing, making it difficult to understand the full scope of the project.
Uncharted Territory
The report hints at the potential for the IDI's transformation to venture into uncharted territory. Currently, the IDI's data is de-identified, limiting its use for case management or targeting services to individuals. Any shift towards individual targeting would require significant legislative changes and a strong social license.
The IDI's Limitations
The IDI, with its 15 billion rows of data, faces challenges. It can only be refreshed three times a year due to its slow processing speed, taking up to 14 weeks per refresh. The system struggles to keep up with demand, particularly as the government expands its social investment initiatives.
A Geographic Barrier
Data Labs, the only way to access the IDI, are geographically concentrated. Over half are in Wellington, with a limited presence in other regions. This geographical barrier poses challenges for researchers, especially those outside the main centers. The business case acknowledges the need for real-time access but provides little insight into how this will be achieved.
A Slow and Steady Overhaul
The IDI overhaul has faced delays, with the indicative business case report delivered a year overdue. Stats NZ attributes this to competing priorities, including modernizing the census and social investment. The dedicated data support team, meant to be established by October, faced contract issues, leading to internal improvements instead.
A Commitment to Transparency
Stats NZ emphasizes its commitment to building public trust and confidence. Transparency is a key aspect, but it must be balanced with confidentiality requirements to comply with various guidelines and legal frameworks.
And this is where the controversy lies: How can we strike a balance between transparency and confidentiality when it comes to government data systems? What are your thoughts on the redacted business case? Do you think the government is being transparent enough? Let's discuss in the comments!
