Introduction

Imagine a world without archives. Without records, people could not prove where and when they were born or who owns the property they live in. They could not trace their ancestry, explore their collective and individual identities or hold government and organizations to account. The impact of archives is felt right across society, underpinning academic research, fuelling the digital economy and inspiring innovation and creativity. In short: archives matter!

In this age of inquiries, public appreciation of the importance of archives has never been higher – but this comes with increased expectations about ease of accessibility and the ability to find everything at the click of a mouse. Archives are also at a cross-roads; facing unprecedented opportunities, especially the opportunities offered by digital technology. They need to undergo fundamental transformation to capitalize on these opportunities.

Archives Inspire

Archives inspire rights: ‘Black Power’ demonstration, London, 1970

The National Archives, catalogue reference MEPO 31/21. The background to the demonstration, giving the story of the ‘Mangrove Nine’ can, be read on The National Archives blog1

In April 2015 The National Archives2 launched Archives Inspire.3 This four-year strategy aspires to change the way that people think about archives by articulating what archives are for, rather than what they do. Archives Inspire is an audience-based strategy and recognizes that The National Archives needs to think and organize itself differently if it is to meet the needs of its four core audiences: government, the public, academia and the archive sector. At the outset, Archives Inspire explicitly identified digital as the single biggest challenge facing the organization and the sector, while implicitly identifying the need for greater collaboration and partnership. For the archive sector, Archives Inspire recognized the need to work together with the sector and its stakeholders to make the case for archives as a vital part of the nation’s heritage.

Archives Unlocked

Archives Unlocked4 is the UK government’s strategic vision for archives launched by the then Minister for Digital and Culture, Matt Hancock, on 29 March 2017.5 The development of the vision was led by The National Archives. However, it was very much the sector’s own vision, developed through an extensive process of co-creation with the sector and with key partners. The scale of the challenges facing archives can be overwhelming, so the vision needed to present an inspiring message for the future, to help direct archives through the cross-roads of change. It also needed to be something that resonated with the whole archive sector, while providing a compelling message for decision makers and funders.

The UK benefits from an extensive distributed archival collection and from sound professional practice that has evolved over the last century. The National Archives works with over 2,500 archives across the country, funded by and belonging to an expansive range of organizations including local authorities, universities, businesses, charities, religious bodies and private individuals. Each archive is different and the leadership approach to the sector reflects this diversity. Together the sector forms a rich ecosystem of interconnected collections and information and a profession that is well networked to support researchers to connect and analyse records from many different sources. The breadth of this infrastructure is a great strength as it means archives are not dependent on one source of funding, and the ecosystem can evolve and adapt as funding climates change. However, such diversity also presents challenges when creating overarching strategies that are meaningful to such a broad constituency. Furthermore, agendas can change quickly so the new vision needed to focus on the fundamental values that archives bring to society, creating a vision that would remain inspiring over time while providing both sustainability and the impetus for sector transformation.

The National Archives embarked on a year-long process of co-creation to develop the vision. From the outset, this was far more than just a consultation. The intention was to start with a blank sheet and work with the archive sector and stakeholders to generate a vision that could deliver a sense of true ownership. This had to be a real tool for change, not a glossy brochure that sat, forgotten, on a shelf. The co-creation work began with a series of round-table events throughout the country, attended by representatives from across the archive sector and beyond. The emerging vision was then subsequently tested through an open survey, explored in a series of targeted interviews and analysed with expert panels to draw in knowledge from organizations that sit within and around the archive sector, including digital bodies. Throughout, the process was supported by a reference group of thought leaders, innovators and sector leads who critically assessed the emerging vision in terms of ambition and deliverability.6

From this wide-ranging co-creation process, a coherent message emerged about the role of archives. This was then distilled into three core values: archives will strengthen society through the trust they inspire, the enrichment they offer and their openness to all. In 1989 in England, 96 people tragically lost their lives owing to overcrowding in a Sheffield football stadium. The Independent Police Complaints Commission, the body then responsible for overseeing complaints against police forces in England and Wales, conducted an investigation into this tragedy, which became known as the Hillsborough disaster. The investigation7 provided a powerful example of trust illustrating the vital role archives play in providing information and evidence to underpin the democratic process. The integrity of such archival processes and safe custody of records like these reassure the public that archives can be relied on to support accountability. The vision used further case studies, including the archive of the children’s charity, Barnardo’s,8 the archive of the John Lewis Partnership, one of the UK’s most prominent retailers,9 and the digital mapping project for the West of England, Know Your Place,10 to bring to life, in practical and inspiring ways, how archives are inspiring trust, enriching people’s lives and opening themselves up to innovative use and reuse. These practical case studies were complemented by think-pieces from contributors within and beyond the archive sector, challenging existing norms and provoking new ideas for the future.

Finally, the co-creation process explored the key development challenges facing the archive sector, to enable the creation of a clear action plan to underpin the vision. The action plan was a vital part of building confidence in the vision and in securing commitment from the wide range of cross-sectoral delivery partners. Three specific areas for development were identified within the action plan: to build digital capacity, engineer resilience and demonstrate impact. The plan includes a wide range of initiatives under each area, including pilot programmes and innovation testing, targeted grants programmes, training programmes, guidance and advice. The focus for the first year has been on developing coherent and multifaceted strategies for workforce development and digital capacity building.

The action plan is supported by over £1.5million of funding, including £825,000 under the Archives Revealed initiative, a partnership programme between The National Archives and the heritage grant-giving body, The Pilgrim Trust,11 with additional financial support from the Wolfson Foundation.12 It is the only funding stream available in the UK dedicated to cataloguing and unlocking archival content. A further £749,000 was secured from the Heritage Lottery Fund (HLF), the body in the UK which distributes lottery funding to heritage projects, to help expand digital expertise across the archive sector. The funding for this Bridging the Digital Gap13 initiative, awarded as part of HLF’s Skills for the Future programme, will fund 24 digital trainees to help drive forward the digital archive skills that are essential to the survival and promotion of the nation’s digital heritage. Bridging the Digital Gap is supported by the Archives and Records Association14 (the professional body for archivists and records managers in the United Kingdom and the Republic of Ireland) and by the Digital Preservation Coalition (DPC).15

The digital challenge

Interior of a digital tape library

Creative Commons copyright waived

As outlined above, Archives Unlocked frames the major challenges facing the archive sector. Of those challenges, the most pressing and the most urgent is the challenge of digital. The shift to digital is transforming every aspect of the archival landscape, be it appraisal and selection, preservation, access, presentation or use. Each and every archival function is being or will be profoundly changed. Where yesterday’s records were tangible, those of today and tomorrow will be intangible. Even the very nature of records will change as data and code themselves become not only part of the record, but the record. Archives need to develop new capacity and capabilities to ensure that digital records continue to be kept and used.

It was therefore not surprising that of the three major themes to emerge from Archives Unlocked, digital capacity was at the forefront. However, the UK archive sector, renowned for its pragmatism, was looking for something more than just a vision. It wanted action and it wanted tangible outcomes. As stated earlier, Archives Unlocked was therefore accompanied by an action plan that set out what The National Archives and its partners would do to implement the strategy and in doing so address the burning issues facing the sector. In the area of digital, the following actions were identified:

  • scope a digital capacity-building programme for the sector to address digital preservation, discoverability and digitization
  • foster expertise and shared solutions through a learning set of local and regional digital preservation projects
  • increase access to archives through innovation in online catalogues, data collection, analysis and reuse
  • build partnerships with digital and IT leaders to establish shared standards and models of good practice
  • develop digital standards within the archive service accreditation scheme, to support improved management of hybrid and digital collections.

Since the vision was launched, The National Archives has worked hard to take forward initiatives to support this digital programme. An Archives Unlocked board has been established, comprising representatives not only from archives, but from the wider digital, professional and cultural sectors, to take forward the vision. Over the course of 2018-2019, working in conjunction with the board, a coherent strategy for digital capacity will also be developed.

In the meantime, The National Archives has already supported some specific initiatives. For example: research in Dorset, south-west England, into digital audience expectations, which will be used as a template for other archives; funding and support for a number of pilot projects in digital preservation; and the delivery, in collaboration with the internationally renowned British arts organization, Tate,16 and the not-for-profit digital services and solutions body, Jisc,17 of digitization seminars to help address sector need. In addition, the foundations have been laid for a number of broader pieces of work, including an invitation to tender for the facilitation of a Digital Action Learning Set, sharing learning through a series of events to join up knowledge and approaches in the digital area, and the commissioning of an audit of sector digital skills to inform a training and development programme. Archives Unlocked and the challenges it aims to address are of relevance to other sectors too, so The National Archives has established a Memorandum of Understanding (MoU) with Jisc, developed its current MoU with Research Libraries UK18 and continues to work on a range of issues with the DPC.

The digital capacity strand of Archives Unlocked does not, however, sit in isolation from the rest of The National Archives. It is closely connected to The National Archives’ Digital Strategy,19 published in March 2017, the same month as the launch of the vision. The Digital Strategy’s focus on the areas of preservation, context, presentation and enabling use and reuse directly maps onto the Archives Unlocked ambitions of trust, enrichment and openness. Trust in the digital archive can only be achieved if users can be assured of the provenance and authenticity of the documents contained in it. Furthermore, it can only enrich and be open if people can use it and find what they need. This strategy sets out a radical new departure in thinking, recognizing that many core principles of archival theory will no longer be valid in the digital era and that the digital archive may need a completely new set of practices. The Digital Strategy therefore sets out ambitious plans to meet the challenges presented by digital records. It aims to:

  • create the ‘disruptive’ digital archive
  • extend reach and engage new audiences using the web
  • transform how the physical archive is accessed and used
  • develop digital capability, skills and culture
  • forge partnerships with other archives progressing digital transformation.

This searching focus on the challenge of digital ensures that The National Archives can continue to provide leadership and support to the wider archive sector as the outputs of this high-level work filter down into common practice. However, in order to achieve the paradigm shift and to find solutions to the digital challenges and opportunities facing archives, the sector also needs to invest in digital skills and undertake digital research.

Alongside the HLF-funded programme, Bridging the Digital Gap, The National Archives is therefore also investing directly in digital skills development. In 2017 five software developer apprentices from Ada, the National College of Digital Skills,20 started at The National Archives on a two-year apprenticeship as part of their foundation degree in Digital Innovation.21

Two years ago The National Archives commissioned work on digital research challenges, which was then subsequently taken forward to form a Digital Research Roadmap,22 since wrapped into the organization’s broader Research Strategy.23 The Head of Research is currently developing research themes and questions so funding can be targeted and research partnerships developed that will test approaches to address some of the key problems raised by the shift to digital. Staff at The National Archives are already working on projects to explore innovative solutions. For example, the Archangel project in partnership with the University of Surrey24 is investigating whether distributed-ledger technology could provide a new approach to digital authenticity. It needs to be stressed that digital brings as many opportunities as it does challenges. The National Archives’ recent research project, Traces through time,25 uses linking methodologies alongside mathematical certainty measures to suggest potential matches for archival search queries, offering researchers results they might otherwise have missed. It is through research and partnerships such as these that the wider information sector, both nationally and internationally, will move forward.

Archives Inspire the world

Collaboration is the golden thread that links the organizational strategy of the UK National Archives, Archives Inspire, and the UK government sector vision, Archives Unlocked. The National Archives’ international strategy, Archives Inspire the world,26 aims to leverage international collaboration to build a future for archives on a global scale. This is an international calling card encouraging collaborators from around the world to work together to drive the development of an exciting future for archives.

By working in partnership with other government bodies, archives, cultural and heritage organizations, academic institutions and businesses, The National Archives aims to be a champion of:

  • collections by promoting their value and enabling greater access
  • digital by pioneering sustainable solutions for digital preservation
  • commercial by generating income through appropriate and profitable activity
  • research by developing innovative resources and networks to share knowledge and expertise
  • standards by supporting policy development, standard setting and access to legislation.

Bridgetown, Barbados, 1950–1968

The National Archives, catalogue reference INF10/39

Archivists are born collaborators and there should be no geographical borders to collaboration. The challenges and opportunities facing the UK archive sector are shared by archives around the world. This is especially true of digital access and preservation. Digital preservation is an international team sport but, like any sport, it requires determination, effort and focus to achieve results, not just a predilection for collaboration.

Archivists are fortunate to work in a sector that finds itself at a once-in-a-lifetime watershed moment. They have the commitment and the appetite, if not yet all of the skills, to enable transformational change. The National Archives is as proud of being the leadership body for the archive sector as it is privileged to be the custodian of some of the nation’s most iconic documents dating back more than 1,000 years. Archives present a uniquely personal experience within the cultural sector and the sector must continue to engage audiences in new and exciting ways. Digital has transformed the way that researchers and archivists think about records, the way that archives look after them and the way that access is provided to them. But this is not really about a shift from paper to digital; it is fundamentally about preserving and rejoicing in the nation’s shared physical heritage while exploiting the endless virtual opportunities presented by digital technology. Digital has transformed access to that shared content, opening up collections and transforming people’s lives wherever they live, irrespective of where the record resides.

For the last 12 months the organization has been working with volunteers from the Friends of the National Archives27 on an ambitious project to open up prisoner-of-war collections, involving almost 200,000 records of allied servicemen captured in German-occupied territory in the Second World War – Not just British prisoners of war but individuals from Australia, Canada, New Zealand and South Africa. The project blog has attracted comments from across the globe, connecting generations and enhancing the collective understanding of who we are, where we came from and where we are going.28

The discoverability of, understanding of, and access to collections across the world is being enhanced through partnership working. In 2017 The National Archives began a collaboration with the National Archives of the United Arab Emirates (UAE) to digitize and make available records relating to the UAE and other Gulf States. The Arabian Gulf Digital Archive combines the skills and knowledge of both institutions to make available 500,000 images from the UK National Archives’ holdings. A two-decade-long research collaboration with the University of Oldenburg to uncover hundreds of thousands of letters and papers confiscated from ships captured by the British between 1652 and 1815 begins in 2018. The Prize Papers project is funded by the German Academy Programme and is of unprecedented scale for a humanities research project.29

The challenges and opportunities facing archives around the world at the local, national and international level demand strong strategic leadership. The Forum of National Archivists (FAN), a section of the International Council on Archives,30 is the body of national archivists responsible for developing high-level strategic responses to the contemporary challenges of managing archives. FAN has identified digital as its key strategic priority and is in the process of sharing best practice and encouraging new approaches that can inform and benefit national, regional and local practices.

Conclusion

This is an exciting time for archives: for those who care for them and for those who use them. The records, both physical and digital, held in archives around the UK and across the world can change people’s lives. There can be no doubt that archives matter. The challenge for archivists is to ensure that the records of the past and the future not only survive but thrive. By working in partnership, as part of a broader archive ecology, archives can ensure that more and more people are connected and inspired by the records they look after and ultimately help change the way people think about archives.