TwitterRadio

Every second thousands of multimedia elements are generated for the purpose of sharing life experiences and feelings with friends, and voicing personal opinions on trending topics. These data are traditionally explored through a visual approach, involving the use of pictures, videos and charts. In recent years, sonification has proved some potential for uncovering new insights on data representation. TwitterRadio explores the role of music as a medium for representing information. The idea behind this project is to access the musical domain to display information about the latest trends and news. The system automatically generates tonal music compositions that are supposed to match the emotional contents of the tweets, as well as their frequency. By operating a tuning knob, the users can tune the TwitterRadio on pre-set hashtags or add new themes they are interested in by typing the hashtags. The TwitterRadio collects all recent associated tweets and retrieves information about their emotional valence (positive vs. negative), their frequency and re-tweet frequency. These features are then mapped into music that match the detected mood and intensity. A hashtag with only a few mentions will result in a slow, flat melody, while a trending hashtag will result in intense sounds.

Role

  • Ideation - I conceptualised the idea behind the installation
  • UX research - I lead a series of design workshop with HCI experts, musicians, and sematic-web experts
  • SW engineering - I engineered the technical architecture of the installation
  • Design - I designed the radio and the GUI
  • Development - I developed the algorithmic composer using SuperCollider and the web interface used to display the radio stations
  • Evaluation - I conducted a series of evaluation during public events and with invited commentators. I performed qualitative and quantitative analysis of the results.

Collaborators

  • Aliaksei Miniukovich
  • Andrea Conci
  • Antonella De Angeli

Exhibitions

  • August 22nd, 2014 – MART (Museum of Contemporary Art) – Trento, Italy
  • April 26th, 2014 – CHI 2014 Interactivity – Toronto, Canada
  • September 17th, 2013 - CHITaly 2013 – Trento, Italy
  • Morreale, F., Miniukovich, A. & De Angeli, A.. TwitterRadio: Translating Tweets into Music. Proc. Extended Abstracts on Human Factors in Computing Systems - CHI, Toronto, Canada. 2014.