Data management

This collection of modules from the PARTHENOS project comprise the 'PARTHENOS Complete Guide to Research Infrastructures'. Each module meets the needs of users at different levels: An 'Introduction to Research Infrastructures' for Beginners; 'Management Challenges in Research Infrastructures' for Intermediate level; and 'Introduction to Collaborations in Research Infrastructures' for Advanced levels.

This curriculum introduces main concepts of Git. It offers a step-by-step tutorial for beginners to get started with Git, a free and open-source version control system.

In diesem Curriculum wird die Erhaltung des Lebenszyklus von geisteswissenschaftlichen (Forschungs-)Daten thematisiert. Schwerpunkte sind Datenmanagement, Metadaten und Langzeitarchivierung.

Learn how community-building projects can engage local stakeholders, pull insights from diverse perspectives, and influence urban redevelopment authorities. Hear state-of-the-art theories and approaches to sustainable heritage, with reflections from experienced architects, academics, and urban thinkers. Identify critical issues of urban gentrification, place-making, and the pressures faced by historic urban neighbourhoods in Southern Europe. See state-of-the-art technologies deployed for rapid 3D reconstruction, documentation, and urban co-design with non-experts. We specifically explore augmented reality as a possible solution to scalable public outreach.

The DESIR Winter School provided a unique opportunity to learn about how to maximize the potential of scholarly resources and to take practical steps in opening up research in ethically and legally responsible ways.

The conference aimed to examine the possibilities of connecting information sciences and computer science with performing arts, focusing on three thematic blocks: archiving, artistic practices and scholarly research. The international scientific and professional conference is part of the project of the same name by the DARIAH-EU Working Group Theatralia, which is dedicated to the research of digital technology in the performing arts and the digitization of theatralia, financed from DARIAH-EU funds.

DARIAH Winter School 2016 explored the evolution of publication issues in social sciences and humanities in a context of Open Access, with the underlying goal of promoting open science through the question of open data citation.

Hosted by King's Digital Lab (KDL) at King's College London, the workshop introduced participants to best practices in project management, the Agile Dynamic System Development Methods (DSDM) as well as various theoretical and practical approaches to digital cultural heritage.

This international workshop, funded by the DARIAH Working Group Activities 2023-2025 programme, was organised by the CNR Institute of Heritage Science with the Cyprus Institute and the University of Catania, supported by the Municipality of Poggioreale. It addressed digital methods for conserving and reusing tangible and intangible construction heritage, highlighting Heritage Building Information Modelling for data acquisition, interoperability, and interdisciplinary collaboration.

This event, organised and provided by the CLS INFRA project, offers an introductory course to textual data annotation. The workshop introduces learners to how to edit, annotate, and query a text corpus without a single line of code, how to structure texts with the XML-TEI, and how to run an NLP tool to add linguistic information.

This workshop, focussing on "Spatial data medieval to modern", is the first of a series of workshops from the NOS-HS project "Linking, Building, and Sustaining Humanities Digital Spatial Infrastructures for Research in the Nordic Countries". The main aims of this workshop were to define key concepts (spatial infrastructures, Linked Open Data, metadata, ontology), outline major challenges in the field, and to provide an opportunity to share experiences of addressing the issues in individual and national projects across the Nordic countries.

A digital gazetteer records information associated with specific places. This lesson teaches you how to create a gazetteer from a historical text, using the Linked Places Delimited (LP-TSV) format.

Many tools and examples that are of interest to those wishing to explore, experiment, and develop projects for digital humanities or data analysis and other tasks are based on a Linux operating system. Mac iOS laptops support Linux fairly easily. However, until recently, Windows OS users have had difficulty in accessing programs and techniques that require a Linux operating system. This short tutorial will demonstrate a simple way for most Windows 10 users to run Linux programs and systems through Windows Subsystem for Linux (WSL).

Many Galleries, Libraries, Archives, and Museums (GLAMs) face difficulties sharing their collections metadata in standardised and sustainable ways, meaning that staff rely on more familiar general purpose office programs such as spreadsheets. However, while these tools offer a simple approach to data registration and digitisation they don't allow for more advanced uses. This blogpost from EHRI explains a procedure for producing EAD (Encoded Archival Description) files from an Excel spreadsheet using OpenRefine.

Tableau is a powerful digital tool for analysing data that can help with mapping and interrogating data. In this short guide we will focus on an aspect of data analysis using mapping that has particular application for Holocaust and refugee studies.

OpenCV is a very popular, free and open source software system used for a large variety of computer vision applications. This article is intended to help you get started in experimenting with OpenCV using an example of face detection in images as a case study.

The SSHOC-DARIAH Train-the-Trainer Research Data Management Bootcamp ('Research Data Management Bootcamp' for short) took place over two half-day workshops that gave access to experts in the field and allowed for real-time activities between the sessions. It was co-organised by the SSHOC project and the DARIAH 'Research Data Management' Working Group.

In this lesson, you will learn how to download YouTube video comments and use the R programming language to analyze the dataset with Wordfish, an algorithm designed to identify opposing ideological perspectives within a corpus.

In this lesson, you will be introduced to 'scalable reading' and how to apply this workflow to your analysis of structured data.

This is a record of a webinar dedicated to the phases of the research lifecycle "Carry out Research" & "Analyse Data" in the context of a research infrastructure. Carrying out research and analysis in the context of a research infrastructure requires a change in approach to research, where the harmonization of data and the ability to access and deploy interoperable services is crucial. This webinar gives an overview of the necessary elements required to set up a sustainable research infrastructure with regards to the management of data and services.

Knowledge Organization Systems provide the foundation for searching and retrieving information objects across digital collections and cultural heritage information systems. Starting from case studies this course provides an introduction to knowledge organization systems and their practical application in research contexts.

Sometimes it can be useful to take information from a website, such as document lists from archives, for future reference. This short resource will show the user how to download an extension to copy tables from websites and then import the table into a spreadsheet program.

This is a record of a webinar dedicated to the phase of the research life cycle "Plan Research Project". It first introduces the participants to an understanding of the advantages and practicalities of research collaboration in and with Research infrastructures. It then dives into details of project planning, touches upon the basics of the FAIR principles, and focuses especially on the importance of using standards in Digital Humanities and Cultural Heritage research and how to identify relevant standards for the participants' own research. This webinar gives an introduction to the Standards Survival Kit that is developed within PARTHENOS. It also cross-links to other materials developed within PARTHENOS and by the PARTHENOS Cluster Partners.

The need to reference webpages in academic work is growing all the time, particularly in the digital humanities. There are many different reference management systems that exist to help researchers sort and find their sources and the most accessible of these is Zotero.

This module is specifically aimed at those who are not yet familiar with ontologies as a means of research data management, and will take you through some of the main features of ontologies, and the reasons for using them.

This resource offers a starting point to learn more about the different types of multidimensional media, as well as managing media in a way which promotes the FAIR principles. The resource also introduces the concept of a Virtual Research Environment to support retrieval and curation of multidimensional data for storytelling via interoperable frameworks.

The EHRI (European Holocaust Research Infrastructure) Search API provides a way to retrieve information about items in the EHRI portal in JSON (JavaScript Object Notation) format by making HTTP requests to particular URLs. This short tutorial shows learners how use a command line tool (CuRL) to fetch structured data and transform it into CSV (comma separated values) format for import into a spreadsheet like Excel or Google Docs.

Topic modelling is a technique by which documents within a corpus are clustered based on how certain groups of terms are used together within the text. The commonalities between such term groupings tend to form what we would normally call "topics", providing a way to automatically categorise documents by their structural content, rather than a more metadata-based knowledge system. Using resources held with EHRI's collections, this notebook offers learners an introduction to 'LDA' topic modelling using Python in a step-by-step guide.

EHRI (European Holocaust Research Infrastructure) supports the use of digital tools that can assist in the research of Holocaust and refugee related topics. In a continued effort to make these tools as accessible as possible so that researchers who have no experience with digital tools will consider trying new ways of using their data, this GitHub-based lesson showcases the use of entity match tools when dealing with geographic data.

This blog examines TEITOK, which is a corpus framework used as an alternative to Omeka. TEITOK is centered around texts and is similar to the Omeka interface – both allow you to search through the documents, and display the transcription. The main difference is that Omeka treats the transcription as an object description, whereas TEITOK not only shows that a word appears in a document, but also where it appears and how it is used.

What does "curating data stories" mean from a technical and academic perspective? This podcast from the curiositas5.0 project features a discussion between Jane Haller and Joana Meier about experimenting with digital exhibitions.

This resource is an introduction to 360 degrees panorama photography. It explores different types of panoramic representations and examples of 360 degree panoramas in the cultural heritage domain. Practical advice and step by step guidance on how to capture data and process them is also included in order to produce and publish 360 degrees panorama images.

This resource aims to introduce the main aspects of data ethics in the cultural heritage domain. It also examines how data management can be supported to become more ethical, while also addressing topical discourse about data ethics in the sector. The resource also aims to support in critically reflecting on some case studies with evident digital data ethics considerations.

In this lesson, you will use Qt Designer and Python to design and implement a simple graphical user interface and application to merge PDF files. This lesson also demonstrates how to package the application for distribution to other personal computers.

This resource offers an introduction to copyright laws within the UK context when dealing with multidimensional media from repositories, archives and collections from that country.

This is a record of a webinar dedicated to the phase of the research life cycle "Develop Research Questions". It dives into details of the topic of developing research questions with RIs, especially on finding, working with and contributing data to RI collections, using Virtual Research Environments, and tools.

This lesson covers tokenization, part-of-speech tagging, and lemmatization, as well as automatic language detection, for non-English and multilingual text. You'll learn how to use the Python packages NLTK, spaCy, and Stanza to analyze a multilingual Russian and French text.

Many academic disciplines use data science to analyze contemporary culture. The question posed by Lev Manovich in this lecture is: shall we continue to aggregate big cultural data and reduce it to a small set of patterns? Or shall we refuse this dominant paradigm instead and focus on diversity, variability and differences (including tiny ones), i.e., work on big cultural data without aggregation and with attention to what is infrequent and outliers?

Data as a term is too flat an ontology for the kinds of things that we are all dealing with, argues Sally Wyatt in this keynote lecture. It reduces people, events, objects to things, bits, to be imagined as impersonal, scientific and neutral. Also, she contends, the use of the word 'data' tends to assume that everything is digital. In this keynote, she explains her argument that this is wrong and asks: 'what are we talking about when we talk about data in the humanities?'

What are the big challenges and opportunities for data-intensive research over the next ten years? This panel discusses digital transformations in the humanities and arts, data ethics and sovereignty, and infrastructure with impact. It features presentations by Dr James Rose (Indigenous Studies Unit, Melbourne School of Population and Global Health) on Data Sovereignty in a Colonial Context: Towards an Integrated National Governance Framework for Australia, Dr James Smithies (Director, King's Digital Lab) on Integrating DH into the longue durée: Research Laboratories, History, Methods.

Prof. Dan O'Donnell (University of Lethbridge) discusses the CARE principles, how they sit alongside the FAIR Principles, and how (digital) humanists can apply them in their research. He presents examples from his own research, particularly around studies of historical artefacts in small rural communities in Scotland.

This training event from the TRIPLE Project was devoted specifically to the Open Access publishing platform Open Research Europe (ORE) and provided technical details on how ORE works and what benefits it has for researchers.

Polifonia is a H2020 project that aims at harmonising diverse information sources in the landscape of musical heritage and scholarship. The challenges are many, from data management, to knowledge organisation and dissemination barriers. In this talk, an ontology driven strategy to organise, share, and interact with the wealth of music data on the web, is presented. This include solutions to engage with scholars and lay persons, with an emphasis on data visualisation and storytelling.

What connects analysing the creative process of a performance using 20,000 collected digital documents, reconstructing an artist's career from programme data, and preserving a touring show? Following a state-of-the-art review of research in performing arts and digital humanities (literature, history, and representation analysis), this Friday Frontiers webinar addresses current challenges, including data modelling, multimodal analysis, and artificial intelligence.

This module looks at emerging trends and best practice in data management, quality assessment and IPR issues. It looks at policies regarding data management and their implementation, particularly in the framework of a Research Infrastructure.

Dieser Kurs gibt einen Einblick in die langfristige Bewahrung digitaler Daten, d.h. die Archivierung digitaler Daten. Es werden praktische Tipps aus der Perspektive der Datenersteller gegeben.

This webinar focuses on 'Persistent Identifiers' (PIDs) and basic concepts of referencing objects. It discusses why so many PID platforms exist, presents aspects of sustainability, demonstrates some added-value services, and talks about practical experiences and open issues.

This post is a quick reference guide to the DYLEN tool, an interactive visualisation tool that the Diachronic Dynamics of Lexical Networks project team created to provide insights into the dynamic lexical changes of Austrian German during the 21st century. It helps lexicographers and linguists to analyse the development of Austrian German lexemes over the course of time. It is an open source tool that can be used free of charge.

The goal of this course is to introduce the Collections as Data principles in the cultural heritage sector to make available a digital collection suitable for computational use. Students will have a fundamental understanding of the complexities of Collections as Data as well as an appreciation of the diversity of the content provided by cultural heritage institutions. This course will be useful for small and medium-sized institutions willing to make available their digital collections suitable for computational use.

Dieses Kapitel erläutert einige grundlegende Regeln für ein aktives und gutes Datenmanagement und beschreibt, wie Dateien und Ordner sinnvoll und eindeutig benannt und strukturiert werden können, wie man mit Versionierung arbeitet und welche Dateiformate für die Nachnutzbarkeit und Langzeitarchivierung geeignet sind.

Getting access to the data on GitLab is different on all three operating systems. This post shows how to use the code editor VS Code with its graphical user interface for working collaboratively in Git with Windows, Mac and Linux.

This article introduces the main concepts in Git and basic Git commands that can be used from the command line. Understanding these commands will help you with using Git in a code editor, the Git desktop and other options, like GitHub online.

This short course will help learners understand how to work with Git in a collaborative setting such as teamwork or group projects, and how to make use of platforms like GitHub or GitLab to complete that work.

In this lecture, Roxanne Wyns discusses her experiences with research infrastructures and, specifically, the challenges we face concerning sustainability.

This training event from the TRIPLE Project was devoted specifically to FAIR Data in SSH and provided answers to the following questions, among others: How is research data defined in SSH; Why are FAIR principles important for the management of research data in SSH; How can FAIR principles be implemented in SSH.

As part of the DARIAH Friday Frontiers in-house webinar series, Erzsébet Tóth-Czifra and Laure Barbot provide an introduction to EOSC and open science projects for researchers and practitioners working in the Arts and Humanities. They include a brief walk through the EOSC landscape, and how different EOSC projects are working towards ensuring open science for all.

Anschließend an die "Grundlagen des Datenmanagements" und der praktischen Übung zu Datenmanagement bietet dieser Kurs eine Einführung in das Thema Metadaten. Was sind Metadaten? Aus welchen Komponenten bestehen sie? Und welche Typen von Metadaten können wir unterscheiden?

Since May 2018, the GDPR (General Data Protection Regulation) has been in force in all European member states. This affects not only the private sector, but also the academic one. With this tutorial, we would like to introduce you to the most important terms and concepts of the GDPR and also to the ELDAH Consent Form Wizard, a tool that allows you to easily create GDPR-compliant consent forms for personal data collection in a research context.

\"What gets into your dataset and what doesn't?\" For database projects in the humanities and social sciences, having a concrete idea of your project scope can be very important. This resource covers scoping methods for Database projects to help narrow down and accurately size the database you are working with in your research.

Humanities and social scientific data is fundamentally different in type to a great deal of data available in the sciences. This resource will help you to understand your data, and therefore how to handle it. This resource looks at humanities data and its reliability, as well as different types of data you may encounter.

An entity is an object with its own characteristics, defined according to the specificities of a given field. This resource covers associations between entities, attributes of entities, identifiers of entities and cardinalities of entities.

The data you generate in humanities and social science projects may well need longer term storage beyond the scope of your own research project. Medium to long term data storage is vital for allowing other scholars to examine and test your data and models, and ensuring open access to your data is an increasingly prominent issue. This resource will guide you through a thoughtful discussion of Data Management and Storage.

In this resource students will learn what a database is and how it is used in humanities research, go through examples of Humanities Databases in use by researchers today, learn when a researcher would need to use a database and how to distinguish between different database technologies.

The DARIAH Winter School 'Open Data Citation for Social Sciences and Humanities' brought together researchers, professionals with various backgrounds, and students from 15 countries. In total 38 people met in Prague, Czech Republic, to learn about various aspects of open access and open data, as well as many other subjects on digital research.

This video tutorial provides a step-by-step guide through the DARIAH-DE Publikator, a tool that enables its users to upload data(-sets) into the DARIAH-DE Repository and index them with metadata. The tool is part of the larger DARIAH-DE Data Federation Architecture, aiming to support the FAIRification of research data with regards to the research data life cycle.

In this lecture, Mark Cote takes us on a journey through a host of research projects that contextualise the way that he and other researchers try to address cultural data.

This video presentation from Clare Lanigan at the Digital Repository of Ireland (DRI) on the 'Archiving Reproductive Health' project, and discusses archival activism more broadly. In particular she gives a demonstration of the current collections available through the archive, provides details of how items were compiled, and also discusses the more pastoral and welfare issues for archival staff when dealing with items relating to political or social activism.

Mikko Tolonen was the first keynote speaker at the DARIAH Annual Event 2016. His talk was entitled 'Applying modern data analytics to classical questions in the humanities: a perspective from Finland'. It drew attention to the benefits of interdisciplinarity and effective communication between 'centred' disciplines for research in the digital humanities

This DARIAH Guide brings together tools, videos, short articles and other training materials that might be relevant when reflecting on your data management processes both in the immediate context of your research and in their broader disciplinary context. Its aim is to equip you with tools and practical advice, but more importantly, with conceptual twists that will help you to establish ethically committed, optimal and as open as possible research and data management workflows.