Prosthetic Memory

M Eifler has created a project called Prosthetic Memory after a serious brain injury which resulted in her losing the capabilities of her memory. Her long term memory is dramatically lowered and can only hold on to little information. Instead of being able to remember important memories of her life, she can only remember simple information such as her phone number or how to ride a bike.

Prosthetic memory has 3 components that work together to assist her in having access to her memory through this digital assistance.

  1. A custom machine learning algorithm that acts as a bridge between the physical world she interacts with and the virtual memories that make up her prosthetic( additional) memory.
  2. Handmade paper journals that include drawings, collages and writings are digitally registered into a database and work as triggers for memories.
  3. Video documentation, similar to vlogging, that capture events, emotions, reactions and feelings that occur during her every day life.

When a picture from the paper journals is exposed to the AI’s camera, the network recognizes the visual trigger and gives her access to all the documented files of the day the paper artwork was created. There are cameras places all around her house that monitor her actions and can offer access to similar memories depending on the tasks she is performing. Objects and tools around her house are also tracked by the AI and she can revisit memories related to the object she is using.

I believe that Interaction design has a lot to offer to people with disabilities and use technology in the most efficient way possible to assist people with special needs. The project “Prosthetic Memory” is very inspiring and fuels a lot of creativity towards that area.

Digital Prayer

Kristina Tica draws attention to the form, limitations and advantages of a medium regarding artistic expression. The interaction between the artist and the medium that is being used for the production of an artifact is a retrograding process. The artist influences the medium and the medium influencing the artists in a constant and uninterrupted fashion. For this art installation, Kristina Tica used visual coding and AI neural networks. She emphasized on the interest that arises from trying to get behind the invisible mechanism on which the user interface of a medium influences the interaction between the artist and the artwork. With this state of mind, she experiments with the boundaries and limitation of visual programming in an attempt to discover its boundaries.

Digital Prayer

Her team created an AI neural network that collected and analyzed more than 40 thousand pictures of traditional Christian Orthodox iconography and proceeded to generate religious depictions autonomously. Kristina believes that the chaotic world of numbers in a code and all the uncountable calculations done by the AI neural network take substance in the form of those pictures. In the same way a picture communicates silently many unspoken words, the neural network communicates with pictures all the invisible numbers that stand behind it. It is worth to be mentioned, that during the presentation of the installation in physical space, both the generated artifacts and the code behind each of them will be exposed to the audience.

In my opinion, and based on my cultural background, unifying religious artifacts with artificial intelligence is simultaneously fascinating and highly controversial.

As an individual I was caught off guard when I stumbled upon this project because it made me realize that religion is one aspect of life that has yet not been subjected to any substantial forms of digitalization. We live in a world where many of the aspects of our lives are heavily influenced by technology and digitalization and humanity is in the process of actively pursuing to digitalize even more areas of life. The matter of faith and religion proposes a huge topic of analysis and a challenging task when it becomes subjective to AI and technology.

As an interaction designer it is challenging thinking of the parameters and the approaches that should be considered, or even allowed, when attempting to build an effective hypothetical digitalized interaction between humans and their faith.

AI x Ecology

The panel AI x Ecology deals with the question how technology can influence our environment and ecology. I have often asked myself how sustainable technology, internet use and especially streaming is and how we can use technology to live more sustainable. In her talk „Computational Sustainability: Computing for a Better World and a Sustainable Future“ Carla P. Gomes gives an insight into her work and explains what sustainable development means. 

Performance and Interaction

Animate Architecture • Build Installations • Collaborate With Performers & Machines • Code With Interfaces • Create Sonic Environments • Choreograph Light • Use Advanced Manufacturing • Reimagine Robots • Augment Bodies • Construct Virtual Realities – these are not just simple buzzwords, but much more enables us to consider space, context, systems, objects and people as potential performers to recognize the wide scope for creativity. 

The Interactive Architecture Lab based at the Bartlett School of Architecture, University College London deals with exactly these topics and runs a Masters Programme in design for performance and interaction. Dr. Ruairi Glynn, the Director of this Lab, is trying to break the boundaries and to develop new kinds of practices within this Programme. The core of the Master is “the belief that the creation of spaces for performance and the creation of performance within them are symbiotic design activities”. He sees performance in interaction as a holistic design practice and gave a wide range of (student) projects at the Ars Eletronica 2020, which can also be seen as an impact and inspiration for today’s and future’s development of interaction design. 

Gustav Klimt – “The Kiss” as Gigapixel

The painting “The Kiss” is not only one of the most famous paintings in Austria, but also an iconic work of art history. Even before the painter finished its masterpiece, it was purchased by the Austrian state and has been in the Belvedere Museum in Vienna ever since. Every year thousands of visitors come to see the work of art.

u19 – create your world 2020

Creating your World to Change our Perspektive – Der Augenblick davor. Damit beschäftigte sich das diesjährige Ars Eletronica für alle u19 Teilnehmer. Bei diesem Vortrag wurden die GewinnerInnen vorgestellt, die im Folgendem aufgeführt sind. Sehr spannend ist dabei zu beobachten, dass sich viele Werke mit Themen beschäftigen, die charakteristische Züge zu der derzeitigen Covid-19 Situation aufzeigen, obwohl die Einreichung der Projekte vor der Pandemie stattgefunden hat. 

Bot Bop | Musical creation and innovation with AI | Concert & Talk | BOZAR x Ars Electronica

To gain more insights about AI in combination with music I’ve chosen the act of Bozar which was marked at the Ars Electronica festival program with a star. „Live coding expert and drummer Dago Sondervan and multi-instrumentalist Andrew Claes team up for an experimental exploration of artificial intelligence in music performance. Armed with an arsenal of specifically developed tools and applications, the duo will train a virtual agent towards musical autonomy and realtime interaction, becoming a trio along the way“ (Palais des beaux-arts de Bruxelles – Musical creation and innovation with AI, 2020)”.

The mixture of human act and AI agents was very interesting to me, because I’ve never seen a performance like that. Starting with the concert, the music sounded very abstract and technical to me, which made it very futuristic. After that the Dago Sondermann, Andrew Claes and Dr. Frederik de Bläser gave an interview about their performance. To create the sounds the artists use a patching software where they record them and programs them within shifts of random notes – that’s the moment where AI comes to play. It gets input with images, shifting notes and messages, which triggers the AI to give outputs. So this is called a combination of generative and adaptive systems and AI. At this point Dr. Frederik de Bläser explains that AI is assisting them and learning from them as a creative partner. The role of the actor is to playing a piece of music and then the intelligent assistant adds its input which creates a feedback loop and kind of a dialog between the artist and the AI. It’s very special kind of music, which cannot be defined as melodically in my opinion because it has many layers of sound and it’s very textured, but the aim of the artists is also to make the music sound like machines. Also the more complex the AI becomes the less it is to control. At this point the whole thing becomes very discussable wether there’s a limit for AI or not. There was also a little discussion with the interviewer and the artists about this, which I found interesting because I’ve never thought about the role of AI in the music sector. But it could be a black box: surprising but also uncontrollable, because due to Bazar it’s sometimes completely wrong what AI understands. It has to have more and more information, but hard to train. You can give it more context but that makes it more difficult to handle. 

In conclusion I can say that AI works good for live performances to show the functionality of it, even with the music sounds not melodic to me. I can imagine it to use it more commercial to make it more accessible to everyone, to create custom-made music and have a individual music experience like already mentioned in the interview. Although it can get hard to handle or expensive at the moment. But maybe this will change due to interests of some companies in the future, because AI is still associated as a scary and unfamiliar tool.

Sources:
Palais des beaux-arts de Bruxelles – Musical creation and innovation with AI. (2020, 13.September). Bot Bop: Musical creation and innovation with AI | Concert & Talk | BOZAR x Ars Electronica [Video]. YouTube. https://www.youtube.com/watch?v=8kOKv8DQ__U

#TOTAL. SUMMARIZED OF ALL LECTURES

LECTURE #01: Andrey Sudarikov – playdisplay

Andrey Sudarikov is a designer from Russia, founder and creative director of PlayDisplay company based in Moscow. In this lecture, he talked about four projects, creation processes, and the problems they encountered at the design stage.

Also, the message went through the entire presentation that in any project it is important how the team interacts with each other and with the customer. How important it is to take into account the human factor, the customer himself and his understanding of the project and especially for international projects – cultural characteristics.

LECTURE #3: Astrid Kury „Why Collaborate?”

Astrid Cury is the director and culturologist at the „Akademie Graz“. She told how important cooperation is and why creative people, especially designers, artists, etc. should cooperate as much as possible.

Astrid asks this question: „In which world do you want to live in? In an egoistic, competitive, isolated one or in one where we share our ideas to get to the best outcome?“

She says collaboration has many benefits:

  • unique ideas
  • perfect equation of form and content
  • increases social relevance and impact
  • includes work on democracy
  • to promote social cohesion and enable equal access

But in the beginning, the collaborative process is always very complicated. People should find a way of interaction that is comfortable for them and develop a clear structure so that it is easier for everyone to work.

LECTURE #4: Florian Doppel-Prix “is it art or can we toss it?”

During this lecture, I realized that, like in the previous lecture from Astrid Kury, you cannot work in isolation from other people. And it can be completely different people, professions and areas of activity. Everything can intersect even within the framework of one project. Especially if we are talking about creative specialties.

Almost all the projects that he showed are interactive and work to immerse the visitor of the exhibition in a certain atmosphere.

LECTURE #5: Burcin Cem Arabacioglu “sustainability from interior design perspective”

In this lecture, Professor at the University of Istanbul, where this city is also a city of design in Turkey, spoke about environmental friendliness, sustainability and conscious design in terms of architecture and interior design. This topic is very close and interesting to me, since I did this at my bachelor’s degree. But, to my great chagrin, it was extremely difficult to follow the lecture due to the low quality of the sound, which did not allow me to concentrate.

LECTURE #6: Sylwia ulicka “questioning material culture”

Despite the fact that Sylvia had amazing lecture material on the ideas of sustainability and eco-efficiency, it was a disappointment to see her reading all the articles from the sheet.

In this lecture, Sylvia casts doubt on the material culture, it refers to the fact that we as designers must strive to achieve sustainability in everything, and for this it is necessary to identify as many ways tools and techniques, as well as to understand what and are better.

“Sustainable development meets the needs of the present without compromising the ability of future generations to meet there own needs.”

In my opinion, this proposal very well summarizes the goal to which we must strive in society.

LECTURE #7: Ursula tischer “keynote at relating systems thinking and design symposium”

Despite the fact that this symposium and presentation by Ursula Tisher was recorded back in 2015, this topic is still very relevant. At this presentation, Tisher talked about the problems of social and environmental policy.

She sees that one of the variants to solve this problem is attracting and educating as many people as possible, giving them the opportunity to see or even participate in the process of creating the product. Also, she calls “entertainment” as an important factor that will attract people to this. As an example, she shows a trash can, which produces a variety of sounds, when a person throws something inside.

We trashing the planet, we crashing the planet and not even have fun!”

LECTURE #9: Wolfgang Schlag “radio work”

Wolfgang Hose is a journalist who shared his experience and spoke in his lecture about the advent of radio and its formation as a source of mass information. What was the radio at the dawn of its formation and what it is now.

I agree with his final conclusion – the radio will not leave. Rather, it is just beginning to regain popularity. Over the past couple of years, the number of people who began to listen to more radio in my environment has increased significantly. I myself began quite often to listen to various radio podcasts on topics of interest to me.

LECTURE #9: WOLFGANG SCHLAG “RADIO WORK”

Wolfgang Hose is a journalist who shared his experience and spoke in his lecture about the advent of radio and its formation as a source of mass information. What was the radio at the dawn of its formation and what it is now.

It was very interesting to know how the first broadcast was carried out. It was in Pittsburgh. And in the beginning, there were about 40,000 listeners, but over time, over the course of two years, that number grew to about 500,000, which showed great success and potential.

Modern radio was formed in 1967 and had two main channels – pop radio and cultural channel. 1967 was a turning point in the history of not only the radio, but also the music industry. A large-scale Woodstock festival took place, the Beatles were at the peak of popularity, jazz and other musical genres were gaining popularity. Of course, as the largest source of information, the radio did not stand aside.

Of course, later, the industry developed, topics no longer fit into the framework of this broadcaster. Radio channels began to be divided by genres and topics. And at the end, Wolfgang talks about what modern technology has achieved. Today, every person has the opportunity to record their own podcast without leaving home. All you need is a good microphone and laptop.

I agree with his final conclusion – the radio will not leave. Rather, it is just beginning to regain popularity. Over the past couple of years, the number of people who began to listen to more radio in my environment has increased significantly. I myself began quite often to listen to various radio podcasts on topics of interest to me.

LECTURE #7: URSULA TISCHER “KEYNOTE AT RELATING SYSTEMS THINKING AND DESIGN SYMPOSIUM”

Despite the fact that this symposium and presentation by Ursula Tisher was recorded back in 2015, this topic is still very relevant. At this presentation, Tisher talked about the problems of social and environmental policy.

I was stunned when she said that only 1% of what is produced and produced every day will still work fully and will retain its worthy appearance after 6 months! It’s really terrible, terrible to realize with what a waste of humanity belongs to the nature of the resource. And we are all responsible for this! Every designer today must think several times before to create something. We must ask ourselves: “What do I want to create? Is it necessary? Is that really a useful thing? How to make this thing more environmentally friendly, recyclable and long-lived?”

She sees that one of the variants to solve this problem is attracting and educating as many people as possible, giving them the opportunity to see or even participate in the process of creating the product. Also, she calls “entertainment” as an important factor that will attract people to this. As an example, she shows a trash can, which produces a variety of sounds, when a person throws something inside.

We trashing the planet, we crashing the planet and not even have fun!”