Skip to main content

Tutorial for VOICE 3.0

Authors
Topics:

In September 2021, the VOICE CLARIAH project team developed the new VOICE 3.0 Online interface for the Vienna-Oxford International Corpus of Enlgish, VOICE. VOICE is a computerized open-access corpus of naturally-occurring,spoken English as a lingua franca (ELF) interactions, based on audio-recordings. You can access VOICE 3.0 through the web interface at https://voice3.acdh.oeaw.ac.at, and can bookmark and download your search results. The tutorial introduces the web interface, explains how to run search queries, apply filters for the creation of sub-corpora and set bookmarks. In addition, it provides short quizzes and links to short videos explaining the design and functions of the VOICE 3.0 interface. The new VOICE 3.0 is also explained in the recordings of the ACDH-CH Tool Gallery 8.1 on “Spoken corpora and open access: Usability and Technology of VOICE 3.0 Online” from April 2022.

Learning Outcomes

Upon completion of this course, students will be able to

  • recall the history and content of VOICE
  • navigate the new VOICE 3.0 web interface
  • run simple search queries in VOICE
  • use placeholders and Boolean operators to finetune search queries
  • create their own sub-corpus in VOICE

Introduction

What is VOICE 3.0 Online?

VOICE (Vienna-Oxford International Corpus of English) is a computerized open-access corpus capturing more than one million words of naturally-occurring, spoken English as a lingua franca (ELF) interactions. It is based on 151 audio-recordings involving 753 identified individuals from 49 different first language backgrounds using English as a common means of communication.

The VOICE corpus was created between 2005 and 2013 at the University of Vienna with funding from the Austrian Science Fund (FWF) to provide a source for linguistic research that does not concentrate on English as spoken and written by speakers of English as first language, but instead focuses on the use of ELF, the most-wide spread contemporary use of English throughout the world. Since its first release in 2009, VOICE texts are stored in TEI-based XML format and rendered accessible online through an online user interface. Between spring 2020 and autumn 2021, a new TEI-XML version of VOICE (VOICE 3.0 XML available in ARCHE) was created and a new open-access user interface, VOICE 3.0 Online, was developed with funding from CLARIAH-AT. This interface, released in autumn 2021 at the Austrian Centre for Digital Humanities and Cultural Heritage (ACDH-CH), offers search facilities, expanded filter and style options, an improved bookmarking tool and new download functions that will be explained in this chapter.

More detailed information on the compilation and history of the corpus can be found on the VOICE homepage or in the VOICE Corpus Header in VOICE 3.0 Online (click “Corpus Information” and select “VOICE Header”).

In addition, you can check out the recordings of the ACDH-CH Tool Gallery 8.1 on “Spoken corpora and open access: Usability and Technology of VOICE 3.0 Online” from April 2022. These provide further information on the compilation of the VOICE corpus, the pros and cons of open access corpora and detailed information on the Open Access technologies, like the local NoSketch Engine set up to run queries, its technology stacks and software packages.

Tool Gallery, Input 1: The case of VOICE

Accessing VOICE 3.0

To access VOICE 3.0 Online, go to https://voice3.acdh.oeaw.ac.at. If this is your first visit with a particular PC or particular internet browser, you will first be asked to accept – or decline – the use of tracking and cookies. In VOICE 3.0, cookies are used in an anonymous fashion only, without collecting data that can be tracked back to an individual. You can also opt out and use VOICE without cookies. Both settings can also be changed later on in the frontend as well.

Once you have selected your preferences for cookies, the content in the blue area of the landing page changes. It now gives you the option to explore VOICE, either by typing in a search query or by simply clicking ”Browse” - this takes you to the actual VOICE 3.0 Online interface.

VOICE 3.0 Web Interface

The standard design of the VOICE 3.0 web interface is made up of three main areas:

  • The area on the left-hand side contains the corpus tree. The first order of organization is domain. By activating the SPET (SPeech Event Type) shifter above the corpus tree, the second layer of organization according to speech event types is made available. By clicking on the small arrow next to a domain, a list with the speech events in this domain appears and displays the unique ID of each speech event. An audio symbol next to an ID indicates that a sound file is available for this event. When you click on a particular speech event, it will be opened on the right-hand side.
  • The middle area contains the search field and will display the search results once a query has been run.
  • On the right-hand side, users are initially greeted by a welcome text. As soon as you have started using the corpus, the entire transcripts or corpus information on the speech events you have selected, as well as metadata from TEI headers will be displayed here. Once a particular speech event has been opened, you can switch between different styles (VOICE, PLAIN, POS and XML). If a sound file is available, you can use the audio player at the bottom. Several speech events can be opened next to each other and can be navigated via separate tabs.

The buttons above the right-hand area are especially useful: the big button “Corpus information” gives you access to more extensive PDF manuals, like the search manual and the VOICE transcription conventions. The two symbols next to “Corpus information” allow you to adjust the display settings: with the left icon, you can merge colons, the right icon allows to adjust the display to a narrow screen (e.g. for a mobile phone). Clicking on the same icon again brings you back to the default view. The new VOICE 3.0 Online interface provides many integrated tool tips, pop-ups and links to more extensive PDFs with corpus documentation. The goal has been to design an interface that is easy and intuitive to navigate and immediately provides short explanations to the user, while also offering links to more extensive guidelines where useful or necessary.

The following clip offers an introductory tour of the VOICE 3.0 Online interface and explains its main areas and buttons.

Introduction to VOICE 3.0 Online Interface

Quiz: It’s your turn!

Test your knowledge of the VOICE 3.0 Interface

Searches in VOICE 3.0

Searches can be easily carried out with the help of the search field at the top left corner of the middle area. Once a search has been run, all search results will be displayed in this area. You can then adjust the display of your results by switching between the different styles offered (i.e. VOICE, PLAIN, POS, and XML). For VOICE, PLAIN and POS, you can additionally choose to display results in KWIC (KeyWord In Context) view. When you choose VOICE or POS style, further modifications are possible by using the options offered at the bottom. These allow you to selectively display - or hide - different mark-up categories according to your research needs or to change the representation of POS (part-of-speech) tags.

Simple Searches

Token search (word form)

In order to search for a word or word form (i.e. token queries), enter the word using lower-case characters, e.g. speak. Please note that all queries are case-sensitive and tokens are searched for with lower case characters, e.g. i speak french, as this is how they are represented in VOICE transcripts. You can, of course, search for phrases (i.e. token token) as well.

If you want to search for contracted forms, like wanna, gonna, don’t, etc., you need to insert a space before the contracted part in your query in VOICE 3.0 Online, i.e.: wan na, gon na, do n’t, it ‘s.

A lemma is the basic form of a word, which represents all declensions and inflected forms of a word, e.g. walk is the lemma of walk, walks, walking. To search for all tokens of a lemma, use the form “l:lemma”, e.g. l:walk.

POS, or Part-of Speech annotations, allow searching for the morphosyntactic categories of tokens. Each token in VOICE has been annotated with an individual POS tag for morphological form, and, in parentheses, for syntactic function. Often, these are identical, as in professional_JJ(JJ), but they may also diverge.

If a POS tag is searched for without further specification in VOICE 3.0 Online, both positions (i.e. form and function) are searched. If you want to search them separately, use p:POS for form position or f:POS for function position.

For POS searches, enter the POS tag in capital letters. For further details, please go to the POS tagging manual and consult the VOICE Tagset.

As an entirely novel feature of VOICE 3.0 Online, conversational mark-up can now be searched for and retrieved in different ways in the new interface. Users can:

  • search for tokenized mark-up, such as pauses (e.g.: 1, _2, etc.) or laughter (e.g.: @, @@). The numbers 1, 2, etc. or number of symbols indicate the length of pauses or laughter represented in the transcripts.
  • or search for POS tags indicating mark-up, such as PVC (pronunciation variations & coinages), ONO (onomatopoeic noises), etc.
  • In addition, VOICE 3.0 Online offers the possibility to search for words, POS and lemmas that occur within and between stretches of conversational mark-up in the corpus, such as stretches of speaking modes, non-English speech, or overlapping speech, by using pointed brackets, e.g. <soft/>, <L1ita/>, or <ol/>.
  • Furthermore, to search within mark-up, the search-words “within” or “containing” can be used to search for tokens, POS or lemma. For example, the search phrase really within <ol/> gives you all results of the word really within overlapping speech.

Detailed examples for mark-up searches are provided in section 6 of the VOICE 3.0 Online search manual. The VOICE tagging scheme has been said to be especially strong in displaying features typical of spoken language. This is possible because already during the early stages of the corpus compilation, it was decided to add additional tags to the PENN Treebank tagset to represent spoken features in the corpus. The following illustration shows some examples of spoken features that have been tagged and thus allow powerful searches in VOICE:

VOICE POS tagging - spoken features

Detailed examples for mark-up searches are provided in section 6 of the VOICE 3.0 Online search manual.

Quiz - It’s your turn!

Simple Searches in VOICE 3.0 Online

Fine-tuning your searches:

Placeholders

In order to adjust the search results to the needs of your research question, the following placeholders might be useful:

  • . Full stop: matches any single character. You can perceive this as a kind of universal joker. Example: Searching for hi. results in: him, his, hit, etc.
  • […] Character class: matches any character contained in the brackets, e.g. h[ai]t – hat, hit
  • [^…] Inverted character class: matches any character not contained in the bracket, e.g. h[^ai] – hot, hut
  • ? Question mark: the preceding element can appear 0 or 1 times, i.e. it is optional. Example: houses? – house, houses
  • + Plus: the preceding element must appear 1 or more times, i.e. it is not optional and might be repeated. Example: house.+ results in houses, household, housewives, i.e. all words that start with house plus at least one more character.
  • * Asterisk: particularly useful, since the preceding element can appear 0 or more times, i.e. it is optional and might be repeated.
  • (…) Brackets: these can be used to group characters (and even regular expressions) to form new elements. In addition, we can combine them with the quantifiers ?, +, and * and let them operate on specified groups. Example: (wo)?man - man, woman

To gain even more precise control over the number of allowed and necessary character repetitions, you can use curly brackets with min,max. Leaving the max empty means there is no upper limit (see section 3.2 of the search manual).

Boolean Operators in VOICE 3.0

  • AND is represented by a comma. Note that there is no space between the conditions. Thus, entering condition1,condition2 will yield results which matches both conditions. Any sequence of items before and after the comma is possible, e.g.: walk,NN - finds tokens of walk tagged as noun, as in “a five minute walk”.
  • OR is represented by a vertical line |. It finds any options to the left or the right of the vertical line. It can be used for any sequence of tokens, lemmas or POS tags before and after the line, and more than two options can be specified. For example: mean | say that - finds: mean that, say that.

More details on searches with wildcards and placeholders can be found in the search manual.

In the following video clip, VOICE project member Ruth Osimk-Teasdale demonstrates the combinations of tokens, lemma, and POS tags in a number of searches, and shows how to display your search results in the different style options (VOICE, plain, POS, XML, and KWIC) available in VOICE 3.0.

VOICE 3.0 Online -Searches

Quiz - It’s your turn!

Searches with placeholders in VOICE

Bookmarks and Filters: Creating your own subcorpus in VOICE 3.0

In VOICE 3.0 Online, users have the possibility to create their own sub-corpora by applying filters. In addition, they can bookmark their search results, which they can subsequently export and import.

In the following short clip, you will learn how to apply filters and bookmarks.

VOICE 3.0 Online - Filters and Bookmarks

In order to create your own corpus, first of all navigate to the tab ”Filter” in the left-hand area and turn on the filter options. You can then narrow down the corpus by applying criteria such as number of speakers or interactants, power relations, duration of speech events, or L1 language. After you have set your desired filters, navigate back to the corpus tree. It will now highlight in bold those speech events to which your filters apply. If you like, you can hide all other speech events by using the respective toggle above the tree.

Once you have set your filters, you can use the search field in the middle area and search your subcorpus. All speech events from your corpus which yield results for your search will then be highlighted in bold in the corpus tree. In addition, events which would also yield results for your query but are not part of your subcorpus will be marked in grey and bold, as can be seen in the following illustration:

Search results for corpus and subcorpus, with opened transcripts on the right-hand side

If you would like to add particular speech events to your subcorpus, tick the box next to the speech event. Please note that in order to do so, the function ”Manual selection”, which can be found in the ”Filter” tab, has to be turned on.

Setting bookmarks

Bookmarks can be easily set with the help of the third tab in the left-hand area. First of all, activate icons and local storage. Once you have done so, small icons appear next to the search results in the middle area. You now have the possibility to select a search result (i.e. a particular utterance) and create a bookmark for it. You can add a short description, and then save the bookmark (as URL, .txt or .xlsx). Saved bookmarks will appear on the left if you click on the tab ”Bookmarks“.

Working with bookmarks

Download Function

A new and very handy feature of VOICE 3.0 Online is the download function, because it gives users the possibility to store their online searches locally and further modify their results, e.g. for further statistical analyses or a more detailed coding of the results.

After you have carried out a search, the download button (i.e. arrow) can be found in the middle area on the right-hand side, next to different style options. Before you start the download, select the style you need, because the downloaded file mirrors what you see in the online interface. Thus, if you have chosen VOICE style, the downloaded file will display the results in this style. When you click on the download arrow, you can select between five different file format and choose the one that most suits your future needs.

Quiz - It’s your turn!

Filters and bookmark function in VOICE 3.0 Online

Conclusion - Advanced Searches

Due to its new filters and search functions, VOICE 3.0 Online allows for very powerful searches. As conclusion to this tutorial, we invite you to try out our advanced search quiz.

Tip: Before you start the quiz, it might be helpful to download the search manual and/or the POS tagging manual so that you can quickly look up any POS tag you might need to solve the quiz.

Advanced Quiz

Combing filters and searches

Cite as

Marie-Luise Pitzl, Stefanie Riegler and Ruth Osimk-Teasdale (2022). Tutorial for VOICE 3.0. Version 2.0.0. DARIAH-Campus. [Training module]. https://campus.dariah.eu/id/sO20jWyuEtce-Q4H0TDi7

Reuse conditions

Resources hosted on DARIAH-Campus are subjects to the DARIAH-Campus Training Materials Reuse Charter

Full metadata

Title:
Tutorial for VOICE 3.0
Authors:
Marie-Luise Pitzl, Stefanie Riegler, Ruth Osimk-Teasdale
Domain:
Social Sciences and Humanities
Language:
en
Published to DARIAH-Campus:
11/17/2022
Content type:
Training module
Licence:
CCBY 4.0
Sources:
DARIAH, ACDH-CH
Topics:
Lexicography, Scholarly publishing
Version:
2.0.0