Online social networks produce a visuality that reflects the attention economy governing this space. What is seen becomes elevated into prominence by networked publics that ‘perform’ affective expressions within platform affordances. We mapped Twitter images of refugees in two language spaces - English and Arabic. Using automated analysis and qualitative visual analysis, we found similar images circulating both spaces. However, photographs generating higher retweet counts were distinct. This highlights the impact of affective affordances of Twitter — in this case retweeting — on regimes of visibility in disparate spheres. Representations of refugees in the English language space were characterized by personalized, positive imagery, emphasizing solidarity for refugees contributing to their host country or stipulating innocence. Resonating images in the Arabic space were less personalized and depicted a more localized visuality of life in refugee camps, with an emphasis on living conditions in refugee camps and the efforts of aid organizations.
Online social networks produce a visuality that reflects the attention economy governing this space. What is seen becomes elevated into prominence by networked publics that ‘perform’ affective expressions within platform affordances. We mapped Twitter images of refugees in two language spaces - English and Arabic. Using automated analysis and qualitative visual analysis, we found similar images circulating both spaces. However, photographs generating higher retweet counts were distinct. This highlights the impact of affective affordances of Twitter — in this case retweeting — on regimes of visibility in disparate spheres. Representations of refugees in the English language space were characterized by personalized, positive imagery, emphasizing solidarity for refugees contributing to their host country or stipulating innocence. Resonating images in the Arabic space were less personalized and depicted a more localized visuality of life in refugee camps, with an emphasis on living conditions in refugee camps and the efforts of aid organizations.
De maatschappelijke discussies over de invloed van AI op ons leven tieren welig. De terugkerende vraag is of AI-toepassingen – en dan vooral recommendersystemen – een dreiging of een redding zijn. De impact van het kiezen van een film voor vanavond, met behulp van Netflix' recommendersysteem, is nog beperkt. De impact van datingsites, navigatiesystemen en sociale media – allemaal systemen die met algoritmes informatie filteren of keuzes aanraden – is al groter. De impact van recommendersystemen in bijvoorbeeld de zorg, bij werving en selectie, fraudedetectie, en beoordelingen van hypotheekaanvragen is enorm, zowel op individueel als op maatschappelijk niveau. Het is daarom urgent dat juist recommendersystemen volgens de waarden van Responsible AI ontworpen worden: veilig, eerlijk, betrouwbaar, inclusief, transparant en controleerbaar.Om op een goede manier Responsible AI te ontwerpen moeten technische, contextuele én interactievraagstukken worden opgelost. Op het technische en maatschappelijke niveau is al veel vooruitgang geboekt, respectievelijk door onderzoek naar algoritmen die waarden als inclusiviteit in hun berekening meenemen, en door de ontwikkeling van wettelijke kaders. Over implementatie op interactieniveau bestaat daarentegen nog weinig concrete kennis. Bekend is dat gebruikers die interactiemogelijkheden hebben om een algoritme bij te sturen of aan te vullen, meer transparantie en betrouwbaarheid ervaren. Echter, slecht ontworpen interactiemogelijkheden, of een mismatch tussen interactie en context kosten juist tijd, veroorzaken mentale overbelasting, frustratie, en een gevoel van incompetentie. Ze verhullen eerder dan dat ze tot transparantie leiden.Het ontbreekt ontwerpers van interfaces (UX/UI designers) aan systematische concrete kennis over deze interactiemogelijkheden, hun toepasbaarheid, en de ethische grenzen. Dat beperkt hun mogelijkheid om op interactieniveau aan Responsible AI bij te dragen. Ze willen daarom graag een pattern library van interactiemogelijkheden, geannoteerd met onderzoek over de werking en inzetbaarheid. Dit bestaat nu niet en met dit project willen we een substantiële bijdrage leveren aan de ontwikkeling ervan.
Within TIND, Christian Roth studies the training of interactive narrative designers with the goal of developing teaching methods and learning tools for artists and designers to enable the creation of more effective artefacts. Interactive Narrative Design (IND) is a complex and challenging interdisciplinary field introducing new affordances in technique and user-experience. This requires practice-based research for further development of the educational format, demonstrating its potential while identifying and overcoming common learners’ challenges. This project aims to develop a framework for the design and evaluation of meaningful interactive narrative experiences that effectively stimulate a variety of cognitive and emotional responses such as reflection, insight, understanding, and potential behavior change. It provides tools, methods and activities to enable aspiring or practicing narrative designers through an interdisciplinary approach, including game design, immersive theatre, behavioral and cognitive psychology, and the learning sciences. HKU education means to prepare students for success in the creative industries and IND plays an important role for current and future jobs in education, arts and entertainment. IND has the potential to create an emotional impact and spark transformative change by offering agency, defined as the ability to influence narrative progression and outcomes in a meaningful way. This enables interactors to feel the weight of their own choices and their consequences, to explore different perspectives, and to more thoroughly understand complex multi-stakeholder issues, which could have significant impact on the success of emerging artistic, and learning applications. The research project is directly embedded in the curriculum of the HKU school Games & Interaction with annual educational offerings such as the Minor Interactive Narrative Design (MIND) and HKU wide broad seminars. Course evaluation and literature research will be used to create new and adjusted training for different HKU schools and the industry. Outcomes will be shared via an interactive website and events.
Postdoc research project Transformation through Interactive Narrative DesignMedia psychologist dr. Christian Roth's postdoc project Transformation through Interactive Narrative Design (TIND) is part of the Professorship Performative Creative Processes, the school Games & Interaction, and the Expertisecentrum Onderzoek, Innovatie en Internationalisering (OOI). Here, Christian interweaves education and practice-oriented research. He studies the artistic, pedagogical and academic perspectives regarding the power of transformation through applied Interactive Narrative Design (IND).Within the two-year postdoc research project TIND, Christian studies the training of interactive narrative designers with the goal of developing teaching methods and learning tools for artists and designers, such as game and interaction designers, to enable them to create more effective artefacts.Why interactive narrative design?IND offers agency, defined as the ability to influence narrative progression and outcomes in a meaningful way. As such, it carries the potential to create and emotional impact and spark transformative change. This enables interactors to explore different points of view and to feel the weight of their own choices and consequences. This, in turn, allows for a more thorough understanding of complex multi-stakeholder issues, which could have a significant impact on the success of emerging artistic, and learning applications.The TIND project will enable designers through an interdisciplinary approach, including applied game design, immersive theatre, behavioral and cognitive psychology, and the learning sciences.A good example for offering different perspectives on a complex topic is the narrative simulation Mission Zhobia: Winning the Peace, which is used for the training of peacekeepers. Or the news game, I am Mosul, which aims to raise awareness around the effects of war by bringing it close to home: choose your Dutch city and make choices on how to survive if the war was there. And the interactive story Adventures with Anxiety offers a new understanding by letting interactors play anxiety embodied within a wolf. IND is a complex and challenging interdisciplinary field in which design knowledge from other media can often not be directly transferred. As a new medium, it introduces new affordances in technique and user experience. This requires practice-based research for further development of the educational format, demonstrating its potential while identifying and overcoming common learners’ challenges. This project aims to develop a framework for the design and evaluation of meaningful interactive narrative experiences that effectively stimulate a variety of cognitive and emotional responses such as reflection, insight, understanding, and potential behavior change. It provides tools, methods and activities to enable aspiring or practicing narrative designers through an interdisciplinary approach, including game design, immersive theatre, behavioral and cognitive psychology, and the learning sciences.HKU education means to prepare students for success in the creative industries and IND plays an important role for current and future jobs in education, arts and entertainment. IND has the potential to create an emotional impact and spark transformative change by offering agency, defined as the ability to influence narrative progression and outcomes in a meaningful way. This enables interactors to feel the weight of their own choices and their consequences, to explore different perspectives, and to more thoroughly understand complex multi-stakeholder issues, which could have significant impact on the success of emerging artistic, and learning applications.The planned output is a collection of design tools and methods for interdisciplinary workshops and courses, which can be integrated into different curricula at the HKU, thereby enhancing existing programs while enabling the refinement of training methods. Once completed, this postdoc project delivers a training method with multiple applications designed to harness the power of interactive storytelling for transformative personal and societal impact.ColloborationsThe research project is directly embedded in the curriculum of the HKU schoolGames & Interaction with annual educational offerings such as the Minor Interactive Narrative Design (MIND) and HKU wide broad seminars. Course evaluation and literature research will be used to create new and adjusted training for different HKU schools and the industry.More informationAre you interested to learn more about the postdoc research project Transformation through Interactive Narrative Design? Get in touch with Christian Roth: christian.roth@hku.nl
