Metadata in motion
building datasets from library catalogues
Keywords:
collections as data, metadata datasetsAbstract
This article explores how library catalogue metadata can be transformed into computationally useful datasets through the lens of LSE Library’s pilot project to publish metadata for its print PhD theses holdings. It outlines the rationale for approaching collections as data as part of digital scholarship support, describes practical decisions around scope, licensing, formats, documentation and publication, and reflects on the substantial work involved in cleaning, selecting and reconciling metadata. Drawing on lessons learned during the creation of the dataset, the article highlights the continuing value of traditional metadata expertise while showing how that expertise can be applied beyond catalogue discovery. It also considers the ethical responsibilities of dataset creation and stewardship, particularly in relation to transparency, bias, sustainability and AI use, and looks ahead to future collections as data work at LSE Library.
References
Always Already Computational (2024) Available at: https://collectionsasdata.github.io/ [Accessed: 18 August 2026]
British Library (no date) Researcher Format Datasets from Collection Metadata. Available at: https://doi.org/10.23636/jyxw-xa90 [Accessed: 18 August 2026]
Chiu, J. (2025b) Reconciliation Service for OpenRefine. Available at: https://refine.codefork.com/ [Accessed: 18 August 2026]
Collections as Data (2023) Available at: https://collectionsasdata.github.io/part2whole/ [Accessed: 18 August 2026]
Creative Commons (no date) CC0 1.0 Universal (CC0). Available at: https://creativecommons.org/publicdomain/zero/1.0/ [Accessed: 18 August 2026]
Deutsche National Bibliothek (2024) DNBLab: Our data in practise. Available at: https://www.dnb.de/librarylabpractice [Accessed: 18 August 2026]
Gebru, T. et al. (2021) Datasheets for Datasets. ArXiv. Available at: https://doi.org/10.48550/arXiv.1803.09010 [Accessed: 3 September 2026]
Frenzel, F. (2026a) How to use the conciliator extension for OpenRefine and run your own server for it. Available at: https://meriban.github.io/notes/openrefine_conciliator/
Frenzel, F. (2026b) Using the id.loc.gov API for entity reconciliation or information retrieval in OpenRefine. Available at: https://meriban.github.io/notes/loc_api_openrefine/
Frenzel, F. and Williams, H. K. R. (2026) ‘LSE Print PhD theses 1905-2011’. Available at: https://doi.org/10.21953/researchonline.lse.ac.uk.00137571
Library of Congress (no date) Labs. Available at: https://labs.loc.gov/ [Accessed: 18 August 2026]
LSEThesisProject (2026) Available at: https://www.wikidata.org/wiki/Wikidata:WikiProject_LSEThesisProject [Accessed: 18 August 2026]
LSE Library (2026a) Digital scholarship. Available at: https://www.lse.ac.uk/library/research-support/digital-scholarship [Accessed: 18 August 2026]
LSE Library (2026b) The Women's Library. Available at: https://www.lse.ac.uk/library/collection-highlights/the-womens-library [Accessed: 18 August 2026]
Microsoft (no date) Data Documentation. Available at: https://web.archive.org/web/20260214043105/https://www.microsoft.com/en-us/research/project/datasheets-for-datasets/ [Accessed: 18 August 2026]
Microsoft’s Aether Transparency Working Group (2022) Aether Data Documentation Template (DRAFT 08/25/2022). Available at: https://www.microsoft.com/en-us/research/wp-content/uploads/2022/07/aether-datadoc-082522.pdf [Accessed: 18 August 2026]
National Library of Scotland (no date) Data Foundry: Open data collections from the National Library of Scotland. Available at: https://data.nls.uk/ [Accessed: 18 August 2026]
Padilla, T. et al. (2019a) Always Already Computational: Collections as Data. Final Report. Available at: https://doi.org/10.5281/zenodo.3152934 [Accessed: 18 August 2026]
Padilla, T. et al. (2019b) Santa Barbara Statement on Collections as Data. Available at: https://doi.org/10.5281/zenodo.3066209 [Accessed: 18 August 2026]
Padilla, T. et al. (2023) Vancouver Statement on Collections as Data. Available at: https://doi.org/10.5281/zenodo.8341519 [Accessed: 18 August 2026]
Padilla, T., Scates Kettler, H. and Shorish, Y. (2023) Collections as Data: Part to Whole. Final report. Available at: https://zenodo.org/records/10161976 [Accessed: 18 August 2026]
Roman, A. C. et al. (2024) Open Datasheets: Machine-readable Documentation for Open Datasets and Responsible AI Assessments. ArXiv. Available at: https://doi.org/10.48550/arXiv.2312.06153 [Accessed: 3 September 2026]
Wikipedia (2025) Thesis as a collection of articles. Available at: https://en.wikipedia.org/wiki/Thesis_as_a_collection_of_articles [Accessed: 18 August 2026]
Williams, H. K. R. (2021) 'Wikidata: what? why? how?', Catalogue and Index, 203, pp. 28–35. Available at: https://www.cilip.org.uk/media/zyzfxkln/catalogue_and_index_203.pdf [Accessed: 3 September 2026]
Williams, H. K. R. (2022) 'LSE’s adventures in Wikidata-land: tears and triumphs down the rabbit hole'. Catalogue and Index, 206, pp. 2–6. Available at: https://www.cilip.org.uk/media/k3mixw30/catalogue_and_index_206.pdf [Accessed: 3 September 2026]
Williams, H. K. R. and Elder, R. (2023) Wikidata Thesis Toolkit. Available at: https://www.wikidata.org/wiki/Wikidata:WikiProject_Wikidata_Thesis_Toolkit [Accessed: 18 August 2026]
Williams, H. K. R. and Elder, R. (2024) 'Introducing the Wikidata Thesis Toolkit', Catalogue and Index, 208, pp. 26–26. Available at: https://journals.cilip.org.uk/catalogue-and-index/article/view/622 [Accessed: 18 August 2026]
Reese, T. (2026) MarcEdit [Software]. Available at: https://marcedit.reeset.net/downloads
Chiu, Jeff (2025a) conciliator [Software]. Available at: https://github.com/codeforkjeff/conciliator
Delpeuch, A. et al. (2025) OpenRefine [Software]. Available at: https://openrefine.org/download, https://github.com/OpenRefine/OpenRefine, https://doi.org/10.5281/zenodo.595996
Library of Congress (no date) Linked Data Service. Available at: https://id.loc.gov/
Library of Congress (no date) Linked Data Service APIs. Available at: https://id.loc.gov/views/pages/swagger-api-docs/index.html
Microsoft (2023a) Open Datasheets. Available at: https://microsoft.github.io/opendatasheets, https://github.com/microsoft/opendatasheets-framework Accessed: 18 August 2026]
OCLC (2023) FAST Converter [Software]. Available at: https://fast.oclc.org/lcsh2fast/
Pushkarna, M. et al. (2022) The Data Cards Playbook. Available at: https://sites.research.google/datacardsplaybook/, https://github.com/PAIR-code/datacardsplaybook
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Fran Frenzel
This work is licensed under a Creative Commons Attribution 4.0 International License.
