» STIMMEN ГОЛОСА
This site relies heavily on Javascript. You should enable it if you want the full experience. Learn more.

STIMMEN ГОЛОСА

Watch on Vimeo

Russia and Germany. From Confrontation to Cooperation

We created the media installation for the exhibition “Russia and Germany. From Confrontation to Cooperation” which was on display in 2015 at Berlin’s Martin-Gropius-Bau and presented by the German-Russian Museum Berlin-Karlshorst in cooperation with the State Historical Museum of Moscow.

STIMMEN

STIMMEN was a participative installation that gave visitors a voice in the ongoing discussion around German-Russian relationships, both past and present. . It was developed for the exhibition “RUSSIA AND GERMANY. FROM CONFRONTATION TO COOPERATION” at the Martin-Gropius-Bau in Berlin.

In the installation, speech was analyzed and visualized in various information graphics to give visitors an overview of the diversity of opinions in the discussion around German-Russian relations. The spoken words were played back as an atmospheric soundscape, letting visitors engage with the subject and each other on a personal level.

Throughout the course of the exhibition, the visualized content grew into a broad catalog that was filled by the visitors themselves, thereby creating a new platform for discussion and exchange.

PROCESS

Visitors were given a spoken statement or answer to one of five questions about German-Russian relations in politics, sports, art and culture. The speech was then recognized and analyzed by an automated system.

The grammar and semantics of the words were identified by the system, using several analysis tools based on machine learning. The algorithms were customized to recognize special words and phrases relevant to the exhibition, enabling us to visualize the quantity and relationships between relevant politicians, organizations, places. This gave us new insights: Which verbs and adjectives are most commonly used to describe a given topic? Who are the most important actors and which properties are assigned to them? What are the overall tendencies of a certain question?

Additional information was gathered from the internet in real time and integrated into the visualizations to give context to the discussion. For example, all mentioned locations were placed on a map to place the relationships in a global context.

SETUP / TOOLS

The interface was built as a custom web app powered by modern HTML5 features and the speech recognition was realised using Google’s Web Speech API.

After being collected, the speech data was sent over the network to a VVVV application, which handled the database connection, stored and retrieved the data, and served as the central hub to integrate the different text analysis tools like Text Razor and Tree Tagger. All visualizations were generated in real time with VVVV.

GALLERY OF ENCOUNTERS

The entrance-installation welcomed visitors in the form of a large wall covered in photographs of iconic moments in German-Russian relations. A projection map highlights each photograph in a logical sequence.

Through this introduction, visitors were given a taste of the visual and audio exhibition that was to follow. The photographs in the entrance hall later became jumping off points for the discussions and topics they would dive into.

EXHIBITION

Media Concept / Design
schnellebuntebilder

Robert Pohle
Sebastian Huber
Johannes Timpernagel
Ann-Katrin Krenz
Michael Burk

Exhibition Design
büroberlin

Graphic Design
Little Adén, Hanna Adén

Light Planning
Michael Flegel

STIMMEN

Creative Direction
Johannes Timpernagel

Design + Programming
Ann-Katrin Krenz
Michael Burk

Tools
VVVV
Google Web Speech
Text Razor

GALLERY INSTALLATION

Creative Direction / Animation
Robert Pohle

Programming
Sebastian Huber

Design of Installation
Ann-Katrin Krenz

DOCUMENTATION

Music
Valentin von Lindenau
kling klang klong

Camera
Boas Schwarz

Editing
Michael Burk

  • 1

anonymous user login

Shoutbox

~15d ago

~18d ago

joreg: The Winter Season of vvvv workshops is now over but all recordings are still available for purchase: https://thenodeinstitute.org/ws23-vvvv-intermediates/

~24d ago

schlonzo: Love the new drag and drop functionality for links in latest previews!

~1mth ago

joreg: Workshop on 29 02: Create Sequencers and Precise Clock Based Tools. Signup here: https://thenodeinstitute.org/courses/ws23-vvvv-08-create-sequencers-and-precise-clock-based-tools-in-vvvv-gamma/

~1mth ago

joreg: Workshop on 22 02: Unlocking Shader Artistry: A Journey through ‘The Book of Shaders’ with FUSE. Signup here: https://thenodeinstitute.org/courses/ws23-vvvv-12-book-of-shaders/

~2mth ago

joreg: Talk and Workshop on February 15 & 16 in Frankfurt: https://visualprogramming.net/blog/vvvv-at-node-code-frankfurt/

~2mth ago

woei: @Joanie_AntiVJ: think so, looks doable