TWIFSY @ISEA2024

This site-specific thought experiment, the first in a series of acupunctural urban art interventions applying circular economics under the TWIFSY acronym (The world is fine, save yourself), was curated by Jonathan Parsons and funded by the Brisbane City Council City for ISEA2024–The 29th International Symposium of Electronic Art–from June 20 to July 14, 2024.

TWIFSY @ISEA2024 is a media art installation designed to stimulate thought about how urban life, which is increasingly mediated by opaque black boxes and artificial intelligence algorithms, may one day manifest in the future Smart City, where time and space have collapsed into a dystopian post-human virtual world. TWIFSY is concerned with the implications of the current sociotechnical paradigm of surveillance capitalism–the automatised monopolistic power and control over Big Data by Big Tech and the transformation of personal information, including human needs, mobility, beliefs, thoughts, and expressions into a capital commodity.

TWIFSY evolved as a thought experiment that speaks to the speculative cultures of science-fiction, futurism, literature, politics, and film. It offers citizens a space to free their imagination from the pragmatics and preoccupations of dayto-day reality. The work’s visual language stems from post-digital aesthetics of failure, where the detritus of digital technologies become raw material for a subcultural do-it-yourself approach typified by the maker and post-digital hacker movements.

A post-digital image object

TWIFSY ‘s site-specific installations use circular economics and in each instance manifest as new post-digital image objects made from the detritus and byproducts of previous experiments. For TWIFSY @ISEA2024, 122,000 components were assembled over 3 months. It recycled e-wasted computers, acrylic, resin, steel, glass, LEDs, ethernet, DMX512-A and Art-net software protocols were retrieved form an assemblage developed in the studio over four years.

Video documentation - the panels, the details inside the panels at proximity, and decoding the image-object using a mobile-phone. For best visual clarity, this video can be viewed at 2K or 4K resolution by changing settings using the cog icon. For best audio clarity, the use of headphones is recommended.

See 0:00–1:35 in the video file to view the external perspectives of the ambiguous image-object’s panels.
See 1:35-3:30 in the video file to view the simulations inside the image object at proximity. This imagery was recorded with a macro lens and a robotic motion control camera system.
See 3:30-5:20 which illustrates how the image object can be decoded through variable viewer positions, distances, and using a camera device to reduce the pseudo-pixels to a perceptible resolution.
TWIFSY was exhibited for ISEA2024 in the pedestrianised Queen Street Mall in the Brisbane City central business district from 20 June – 14 July 2024. The Queen Street Mall is approximately 500 metres long, with six major shopping centres and more than 700 retailers over 40,000 square metres of space.

Media

Above left: The installation commissioned by the Brisbane City Council for exhibition in the Queen Street Mall, Brisbane CBD.
Middle: ISEA2024 Instagram
Above right: Presenting TWIFSY @ISEA2024 and the associated paper Speculating Smart: An Ambiguous Image Object at ISEA2024's June 2024 Experimental Arts in Public Space panel discussion, which was facilitated by Experimenta.

The design proposal

These visualisations show TWIFSY’s panels distributed across the three windows at the southwestern end of the mall. The nature of the existing retail space, which required a treatment for dressing the window cavities to enhance the installation, used a reflected mise-en-abyme approach to give the work greater depth in the shallow spaces.

Above: This mock-up image shows the spacing of the panels over the three retail windows. The darker shading shows the position of the reflective black mirrors that face the viewer, and the grey shading represents the mirrored wall, ceiling, and floor surfaces.

Above: This mock-up image shows the panels arranged in two rows with mirrored walls, floors and ceilings designed to animate as the panels' colours and brightness shift.

Above: The work is set back from the window glass at approximately 50cm so that the viewer can register the tiny details inside the panels.

Above: This image shows a section of the installation and the panel heights, depths, and distances relative to the glass window facades and the viewer.

Visual detail of the box panels from variable distances

As one moves toward TWIFSY, the illusory image object surface collapses into a pseudo-architectural space an abstracted hyperreality that reveals hundreds of tiny model pseudo-citizens–made from medical resin 3D printed from computer-generated models–each with different postures, gestures, clothing, and accessories appearing in numerous scenarios and situations.

Above: This image illustrates eight of the twenty-four panels viewed from three metres. Each panel measures 590mm H x 520mm W x 200mm D. In this arrangement, the image resolves well at greater distances and disappears at proximity

Above: This image illustrates the detail in Panel #15 at a proximity of eighty centimetres. As the viewer moves toward the image object, the illusory image disappears, and a simulated architectural space emerges to reveal hundreds of tiny model ‘citizens’, which, encapsulated in transparent enclosures, are arranged in numerous fictitious scenarios and situations.

Above: This image shows sixteen of the twenty-four finished panels illuminated with white light. Captured from a three-meter birds-eye view, they cover an area of 240cm x 208cm. TWIFSY’s development in relief was monitored with numerous cameras, including an overhead view, progressively revealing pseudo-satellite imagery from three metres implies miniature built and virtual environments that can be explored at ground level as pseudo-street-views. From this process, a new aesthetic emerged, which evokes what Berry (2015) describes as the post-digital ‘asterism’ of digital material culture resembling ‘aerial photography of landscapes and cities’ providing a ‘distant reading of society and everyday life’ as an organised collective of 'functionally linked individuals’ that provides a ‘sense of cohesion in a fragmentary digital experience’ (Berry 2015, 51).

Close-up imagery of some of the many details and ‘scenarios’ simulated within TWIFSY

On close physical inspection, TWIFSY’s intricate details relate to and mimic the networked effects of Big Tech’s panoptic schema of concealed servers. The arrangement of these figures and the tens of thousands of peripheral objects embedded within TWIFSY reveal many narratives that imply social, anti-social, voyeuristic, and narcissistic behaviours in fictitious private and public spaces, where imagery and data streams form a constant flow of advertising, entertainment, and user-generated commentary.

**Associated process imagery 2019-2023–TWIFSY under construction**

This image shows the media facade under construction with the originnal JPG image virtually overlayed onto an image of its north-facing wall. This composite image and the grid structures represented were used to pre-visualise the scale and dimensions of the image object.

This image shows one of the 1,176 acrylic micro-grid structures used to support the 7 x 8-pixel arrays that form the image-based layer of TWIFSY. The pseudo-pixel colours are encoded in relation to the electronic pixels of the over-enlarged JPG image. The 72mm x 82mm micro-grid was placed against the computer screen to map the virtual pixel colours extracted from the over-enlarged jpeg image to the colours of acrylic pseudo-pixels, each measuring 8mm x 8mm

This image shows the vector graphic design used to laser-cut the scaffolding structures supporting the image base layer for TWIFSY’s twenty-four panels and 65,856 pseudo pixels. The 520mm x 590mm form contains forty-nine rectangular bays that each support a 72mm x 82mm microgrid that, in turn, each supports 56 pseudo pixels. The microgrids are colour-encoded to temporally sequence a cutting protocol for the Trotec Speedy 400 laser cutter, which cuts each colour consecutively. Each colour is spatially separated from the next so the heat from the focussed laser beam is not concentrated in any area during the cutting sequence and is evenly distributed throughout the material to prevent warping.

This image shows the pseudo-pixels, which were washed, tested, and categorised according to each material's colour, translucency, and opacity when backlit. The pseudo-pixels were then assigned a code that roughly corresponds to the digital pixels of the remnant digital JPG used to determine their x-y coordinate position in the microgrids.

The base-layer of the panels are assembled onto a light panel that is used to globally illuminate 49 micro-grids. Each panel is independently programmable using DMX addressing.

Detail from Panel #15, backlit with white light. The panel base layer consist of 49 micro-grids and 2,744 acrylic pseudo-pixels. The objects in relief include acrylic platforms, optical acrylic rods, and 3D printed figures made from medical resin. The panel is held rigid and supported using stainless steel threaded rods.

A vector design for a fictitious urban assemblage – perhaps a city plaza where citizens might congregate.

A plaza takes form in both vertical and horizontal orientations simultaneously.

Multiple layers of coloured acrylic are stacked and slightly offset to create a three-dimensional anaglyph effect. The viewer also experiences an illusory sense of depth as they move past the image object due to the parallax effects of the layers’ separation.

Prototyping the human figures involved experimenting with numerous materials. The eerly tests used ABS (acrylonitrile butadiene styrene), PLA (polylactic acid) and nylon. The final work used Biomed amber resin, which is used to make biocompatible prostheses. It was chosen for its optical qualities.

The first prototype for the media facade used recycled Apple I-Macs. The glitching screens were used to develop the aesthetics for a dystopic Smart City of the future and the world-building scenarios that emerged from their surfaces in relief.

Early exploration of the pseudo-architectural space that emerged from the screen surfaces reveals a sprawling and alienating matrix of detritus, emulating what Benjamin Bratton refers to as an ‘accidental megastructure’ of carbon and silicon-based molecules within a city of perplexing grids and ‘data archipelagos’ (Bratton 2015, 5-10).

This image shows the emergent details of Panel #12. The 72 x 82mm orange rectangular shape in the foreground forms one of the multiple layers recycled of backlit coloured acrylic. The 10mm figures arranged on the surface layer are early prototypes that were additively manufactured using a MakerBot 3D printer and recycled composite nylon.

Urban sprawl.

An experiment in arranging the panels vertically to emulate the construction of a skyscraper.

This image shows the emergence of a post-digital pseudo-media facade, which emerged parallel to the development of the work on the studio floor. It is made from timber, acrylic, and stainless steel and a composition of acrylic offcuts left over from the fabrication of the pseudo-pixels and microgrid components.

This image shows the gradual transformation of the pseudo-media facade with additional layers of e-wasted iMac screen components that were superimposed over the wasted pseudo-pixel off-cuts as the iMacs were gradually cannibalised.

The final panels being hung on the wall frame in a 6x4 array – 4.09m h x 2.09m w x 23cm d.

References

Berry, David M. 2015. "The Postdigital Constellation" In Postdigital aesthetics: art, computation and design, edited by David M. Berry and Michael Dieter, 44- 57. Vol. Book, Whole. Houndmills, Basingstoke, Hampshire;New York, NY;: Palgrave Macmillan.

Bleecker, Julian. 2022. "Design fiction: A short essay on design, science, fact, and fiction," in Machine Learning and the City: Applications in Architecture and Urban Design: 561-78.

boyd, danah, and Kate Crawford. 2012. "CRITICAL QUESTIONS FOR BIG DATA: Provocations for a cultural, technological, and scholarly phenomenon." Information, communication & society 15 (5): 662-79.

Bratton, Benjamin H., and ProQuest. 2015. The stack: on software and sovereignty. Vol. Book, Whole. Cambridge, Massachusetts: MIT Press.

Cascone, Kim. 2000. "The Aesthetics of Failure: "Post-Digital" Tendencies in Contemporary Computer Music." Computer Music Journal 24 (4): 12-18.

Cramer, Florian. 2015. "What Is ‘Post-digital’?" In Postdigital aesthetics: art, computation and design, edited by David M. Berry and Michael Dieter, 12-25. Vol. Book, Whole. Houndmills, Basingstoke, Hampshire;New York, NY;: Palgrave Macmillan.

de Waal, Martijn and de Lange, Michiel. 2019. "Introduction—The Hacker, the City and Their Institutions: From Grassroots Urbanism to Systemic Change.” In The Hackable City, edited by de Lange, Michiel, and Martijn de Waal, 1-17. Vol. Book, Whole. Singapore: Springer.

Debord, Guy, and Donald Nicholson-Smith. 2020. The Society of the Spectacle. Vol. Book, Whole: Zone Books.

Dunne, Anthony, Fiona Raby, and Inc Books24x. 2013. Speculative everything: design, fiction, and social dreaming. Vol. Book, Whole. London;Cambridge, Massachusetts;: The MIT Press.

Habermas, Jürgen, Thomas Burger, Frederick Lawrence, and Ebscohost. 1992. The structural transformation of the public sphere: an inquiry into a category of bourgeois society. Vol. Book, Whole. Cambridge, UK: Polity Press.

Harper, Tauel. 2017. "The big data public and its problems: Big data and the structural transformation of the public sphere." New media & society 19 (9): 1424-1439.

House of Commons Digital, Culture Media, and Committee Sport. 219. Disinformation and 'fake news': final report. Parliament of the United Kingdom.

Komninos, Nicos, and Ebooks ProQuest. 2020. Smart cities and connected intelligence: platforms, ecosystems and network effects. 1 ed. Vol. Book, Whole. Abingdon, Oxon;New York, NY;: Routledge.

Lanier, Jaron. 2013. Who owns the future? 1st Simon & Schuster hardcover ed. Vol. Book, Whole. New York: Simon & Schuster.

Snowden, Edward. 2019. Permanent Record. First edition ed. New York: Metropolitan Books.

Spaces, Project for Public. 2016. PLACEMAKING—What If We Built Our Cities around Places? : Placemaking Booklet.

Streitz, Norbert. 2017. "Reconciling Humans and Technology: The Role of Ambient Intelligence." In Ambient Intelligence, 1-16. Springer International Publishing : Cham.

Toft, Tanya. 2017. "Disobedience – What Urban Media Art Brings to Digital Placemaking.” In Media Architecture Compendium: Digital Placemaking, 95- 97, edited by Hespanhol, Luke, M Hank Haeusler, Martin Tomitsch, and Gernot Tscherteu. 2017. avedition.

Tufekci, Zeynep. 2014. "Engineering the public: Big data, surveillance and computational politics." First Monday 19 (7).

Vierkant, Artie. 2010. "The image object post-Internet." Retrieved March 1: 2017.

https://jstchillin.org/artie/pdf/The_Image_Object_Post-Internet_us.pdf.

Zuboff, Shoshana. 2019. The age of surveillance capitalism : the fight for a human future at the new frontier of power. First ed. Vol. Book, Whole. New York, NY:PublicAffairs.