São Paulo's Digital Archive Crisis: What Officials, Experts and Key Figures Are Saying About Duplicate Image Replacement

São Paulo's municipal and private digital infrastructure is sitting on a growing backlog of duplicated image files — redundant copies of photographs, scanned documents and architectural records that are quietly inflating storage costs and complicating data retrieval across city systems. The issue surfaced publicly this week after municipal technology administrators flagged the problem inside the Prefeitura de São Paulo's Secretaria Municipal de Inovação e Tecnologia, prompting a broader conversation among archivists, software engineers and urban planners about how Brazil's largest city handles its visual data.

The timing matters. São Paulo is midway through a multi-year push to digitise its urban planning and public services infrastructure — part of a wider programme championed under the Lula federal government's agenda for smart cities. With thousands of building permits, flooding-related inspection reports and public works photographs being uploaded daily to city servers, the volume of image data is expanding faster than the systems designed to manage it. Duplicate image replacement — the automated or manual process of identifying and substituting redundant files with single canonical copies — sits at the centre of that bottleneck.

Why the Problem Is Bigger Than It Looks

Digital records managers working with the city's Centro de Processamento de Dados (CPD), the municipal IT body based in the Bela Vista neighbourhood, have described the problem in internal documentation as a systemic gap between legacy archiving habits and modern cloud infrastructure demands. The CPD manages data across more than 30 secretariats, meaning a single aerial photograph of the Marginal Tietê flooding zone can appear in several departmental databases simultaneously — each copy consuming server space and slowing search functions.

At the Arquivo Público do Estado de São Paulo on Rua Voluntários da Pátria in Santana, archivists have been wrestling with a parallel challenge: digitisation projects from the early 2010s produced multiple scanned versions of the same physical document, often at different resolutions, with no standardised policy for which version to keep. A 2024 federal audit by the Controladoria-Geral da União identified digital redundancy as a material inefficiency across state-level archives in Brazil, though it did not publish São Paulo-specific storage cost figures.

Technology specialists in the private sector are also weighing in. Companies operating out of the Vila Olímpia and Berrini tech corridor, where several of São Paulo's recognised unicorn startups are headquartered, have dealt with equivalent problems at scale. Data engineers at firms using machine-learning pipelines to process satellite and street-level imagery — inputs essential for logistics, urban mobility and fintech risk modelling — say that without robust deduplication protocols, storage bills and processing times spiral disproportionately. One widely cited industry benchmark holds that duplicate files account for between 20 and 30 percent of enterprise storage consumption, though figures vary considerably by sector and organisation.

What Should Happen Next

Urban technology consultants advising the Secretaria Municipal de Urbanismo e Licenciamento recommend a phased approach: first, deploy hashing algorithms — software tools that assign a unique identifier to each image file based on its content — to flag duplicates across existing databases; second, establish a clear retention policy distinguishing master files from working copies; and third, train staff at Subprefeituras across the city's 32 administrative districts to upload images through a single validated portal rather than directly to departmental drives.

The Escola de Administração de Empresas de São Paulo at Fundação Getulio Vargas in the Itaim Bibi neighbourhood has incorporated digital records governance into its public management curriculum, reflecting how seriously the field is now taken at the institutional level. Meanwhile, Mayor Ricardo Nunes's office has not issued a formal public statement on the archival question, though the Secretaria de Inovação has indicated that a broader data governance review is scheduled for the second half of 2026.

For ordinary Paulistanos, the practical upshot is straightforward: cleaner city databases mean faster processing of building licences, more reliable flood-risk maps and lower IT costs that, at least in theory, redirect public money toward street-level services. Getting there requires unglamorous administrative work — but experts say São Paulo has both the technical capacity and the institutional architecture to do it before the problem compounds further.