Showing 1–7 of 7 results for author: Sola, M C

We Are The Clouds: Blending Interaction and Participation in Urban Media Art

Authors: Varvara Guljajeva, Mar Canet Sola

Abstract: Since the early 2000s, cultural institutions have been instrumental in reshaping public spaces, fostering community engagement, and nurturing artistic innovation. Central to these initiatives are audience interaction and participation concepts, yet their definitions and applications in urban media art remain nebulous. This article endeavours to demystify these terms, examining the distinct charact… ▽ More Since the early 2000s, cultural institutions have been instrumental in reshaping public spaces, fostering community engagement, and nurturing artistic innovation. Central to these initiatives are audience interaction and participation concepts, yet their definitions and applications in urban media art remain nebulous. This article endeavours to demystify these terms, examining the distinct characteristics and intersections of interactive and participatory art within urban contexts. A particular emphasis is placed on artworks that harmonise both elements, exploring the motivations and outcomes of this synthesis. The case study of We Are The Clouds serves as a focal point, exemplifying how strategic integration of interaction and participation can enhance community connection and reinvigorate public spaces. Through this analysis, the paper underscores the transformative power of urban media artworks in redefining neighbourhood experiences, empowering local voices, and revitalising the essence of public realms. △ Less

Submitted 19 June, 2024; originally announced June 2024.

ACM Class: H.5; J.5

Visions Of Destruction: Exploring Human Impact on Nature by Navigating the Latent Space of a Diffusion Model via Gaze

Authors: Mar Canet Sola, Varvara Guljajeva

Abstract: This paper discusses the artwork "Visions of Destruction", with a primary conceptual focus on the Anthropocene, which is communicated through audience interaction and generative AI as artistic research methods. Gaze-based interaction transitions the audience from mere observers to agents of landscape transformation, fostering a profound, on-the-edge engagement with pressing issues such as climate… ▽ More This paper discusses the artwork "Visions of Destruction", with a primary conceptual focus on the Anthropocene, which is communicated through audience interaction and generative AI as artistic research methods. Gaze-based interaction transitions the audience from mere observers to agents of landscape transformation, fostering a profound, on-the-edge engagement with pressing issues such as climate change and planetary destruction. The paper looks into early references of interactive art history that deploy eye-tracking as a method for audience interaction, and presents recent AI-aided artworks that demonstrate interactive latent space navigation. △ Less

Submitted 28 December, 2023; originally announced January 2024.

ACM Class: I.2; J.5

Artistic Strategies to Guide Neural Networks

Authors: Varvara Guljajeva, Mar Canet Sola, Isaac Joseph Clarke

Abstract: Artificial Intelligence is present in the generation and distribution of culture. How do artists exploit neural networks? What impact do these algorithms have on artistic practice? Through a practice-based research methodology, this paper explores the potentials and limits of current AI technology, more precisely deep neural networks, in the context of image, text, form and translation of semiotic… ▽ More Artificial Intelligence is present in the generation and distribution of culture. How do artists exploit neural networks? What impact do these algorithms have on artistic practice? Through a practice-based research methodology, this paper explores the potentials and limits of current AI technology, more precisely deep neural networks, in the context of image, text, form and translation of semiotic spaces. In a relatively short time, the generation of high-resolution images and 3D objects has been achieved. There are models, like CLIP and text2mesh, that do not need the same kind of media input as the output; we call them translation models. Such a twist contributes toward creativity arousal, which manifests itself in art practice and feeds back to the developers' pipeline. Yet again, we see how artworks act as catalysts for technology development. Those creative scenarios and processes are enabled not solely by AI models, but by the hard work behind implementing these new technologies. AI does not create a 'push-a-button' masterpiece but requires a deep understanding of the technology behind it, and a creative and critical mindset. Thus, AI opens new avenues for inspiration and offers novel tool sets, and yet again the question of authorship is asked. △ Less

Submitted 6 July, 2023; originally announced July 2023.

ACM Class: I.2.0; I.2.m

Explaining CLIP through Co-Creative Drawings and Interaction

Authors: Varvara Guljajeva, Mar Canet Solà, Isaac Joseph Clarke

Abstract: This paper analyses a visual archive of drawings produced by an interactive robotic art installation where audience members narrated their dreams into a system powered by CLIPdraw deep learning (DL) model that interpreted and transformed their dreams into images. The resulting archive of prompt-image pairs were examined and clustered based on concept representation accuracy. As a result of the ana… ▽ More This paper analyses a visual archive of drawings produced by an interactive robotic art installation where audience members narrated their dreams into a system powered by CLIPdraw deep learning (DL) model that interpreted and transformed their dreams into images. The resulting archive of prompt-image pairs were examined and clustered based on concept representation accuracy. As a result of the analysis, the paper proposes four groupings for describing and explaining CLIP-generated results: clear concept, text-to-text as image, indeterminacy and confusion, and lost in translation. This article offers a glimpse into a collection of dreams interpreted, mediated and given form by Artificial Intelligence (AI), showcasing oftentimes unexpected, visually compelling or, indeed, the dream-like output of the system, with the emphasis on processes and results of translations between languages, sign-systems and various modules of the installation. In the end, the paper argues that proposed clusters support better understanding of the neural model. △ Less

Submitted 12 June, 2023; originally announced June 2023.

ACM Class: I.2.0; I.2.m

Quantifying Collection Lag in European Modern and Contemporary Art Museums

Authors: Mar Canet Solà, Antonina Korepanova, Ksenia Mukhina, Maximilian Schich

Abstract: Museum collection strategies are governed by a variety of factors, including topical focus, acquisition funds, availability of works in the art market, donations and specific coincidental opportunities. Yet, it remains unclear if more fundamental collection patterns emerge, exist, and are shared between museums, which could for example allow an established artist to estimate when a contemporary ar… ▽ More Museum collection strategies are governed by a variety of factors, including topical focus, acquisition funds, availability of works in the art market, donations and specific coincidental opportunities. Yet, it remains unclear if more fundamental collection patterns emerge, exist, and are shared between museums, which could for example allow an established artist to estimate when a contemporary art museum would acquire their works. Here we collect and analyze data from 12 European contemporary art museums, taking into account artwork creation dates, collection acquisition dates, and the associated artist age at both points in time. From this simple quantitative construct we are able to reveal a striking gradient of museum profiles at the aggregate level. This lag can function to constitute a macroeconomic index of "mean museum collection lag", ranging from 3 years in the most dynamic cases (Kiasma) to 33 years in the most established institutions (Reina Sofia). Meanwhile, on the granular level, plotting artist age over collection year, and using artist-age vs artwork-collection matrices, a detailed picture becomes evident, where individual museums are characterized by shared patterns and a rich heterogeneity of ideographic details. Regularities include continuous acquisitions, systematic acquisition of older materials over time, and brief bursts, where whole oeuvres of individual artists join specific collections. Hence, we are able to shed light on the detailed collection history of museums, transcending the anecdotal nature of art historical storytelling via the provision of a quantitative context. Our approach of cultural data analysis combines expertise in art, art history, computational social science, and computer science. Our joint perspective builds a bridge between and serves an audience of museum professionals, art market actors, collectors, and individual artists alike. △ Less

Submitted 23 May, 2023; originally announced May 2023.

Comments: 13 pages, 6 figures

Collection Space Navigator: An Interactive Visualization Interface for Multidimensional Datasets

Authors: Tillmann Ohm, Mar Canet Solà, Andres Karjus, Maximilian Schich

Abstract: We introduce the Collection Space Navigator (CSN), a browser-based visualization tool to explore, research, and curate large collections of visual digital artifacts that are associated with multidimensional data, such as vector embeddings or tables of metadata. Media objects such as images are often encoded as numerical vectors, for e.g. based on metadata or using machine learning to embed image i… ▽ More We introduce the Collection Space Navigator (CSN), a browser-based visualization tool to explore, research, and curate large collections of visual digital artifacts that are associated with multidimensional data, such as vector embeddings or tables of metadata. Media objects such as images are often encoded as numerical vectors, for e.g. based on metadata or using machine learning to embed image information. Yet, while such procedures are widespread for a range of applications, it remains a challenge to explore, analyze, and understand the resulting multidimensional spaces in a more comprehensive manner. Dimensionality reduction techniques such as t-SNE or UMAP often serve to project high-dimensional data into low dimensional visualizations, yet require interpretation themselves as the remaining dimensions are typically abstract. Here, the Collection Space Navigator provides a customizable interface that combines two-dimensional projections with a set of configurable multidimensional filters. As a result, the user is able to view and investigate collections, by zooming and scaling, by transforming between projections, by filtering dimensions via range sliders, and advanced text filters. Insights that are gained during the interaction can be fed back into the original data via ad hoc exports of filtered metadata and projections. This paper comes with a functional showcase demo using a large digitized collection of classical Western art. The Collection Space Navigator is open source. Users can reconfigure the interface to fit their own data and research needs, including projections and filter controls. The CSN is ready to serve a broad community. △ Less

Submitted 11 May, 2023; originally announced May 2023.

Compression ensembles quantify aesthetic complexity and the evolution of visual art

Authors: Andres Karjus, Mar Canet Solà, Tillmann Ohm, Sebastian E. Ahnert, Maximilian Schich

Abstract: The quantification of visual aesthetics and complexity have a long history, the latter previously operationalized via the application of compression algorithms. Here we generalize and extend the compression approach beyond simple complexity measures to quantify algorithmic distance in historical and contemporary visual media. The proposed "ensemble" approach works by compressing a large number of… ▽ More The quantification of visual aesthetics and complexity have a long history, the latter previously operationalized via the application of compression algorithms. Here we generalize and extend the compression approach beyond simple complexity measures to quantify algorithmic distance in historical and contemporary visual media. The proposed "ensemble" approach works by compressing a large number of transformed versions of a given input image, resulting in a vector of associated compression ratios. This approach is more efficient than other compression-based algorithmic distances, and is particularly suited for the quantitative analysis of visual artifacts, because human creative processes can be understood as algorithms in the broadest sense. Unlike comparable image embedding methods using machine learning, our approach is fully explainable through the transformations. We demonstrate that the method is cognitively plausible and fit for purpose by evaluating it against human complexity judgments, and on automated detection tasks of authorship and style. We show how the approach can be used to reveal and quantify trends in art historical data, both on the scale of centuries and in rapidly evolving contemporary NFT art markets. We further quantify temporal resemblance to disambiguate artists outside the documented mainstream from those who are deeply embedded in Zeitgeist. Finally, we note that compression ensembles constitute a quantitative representation of the concept of visual family resemblance, as distinct sets of dimensions correspond to shared visual characteristics otherwise hard to pin down. Our approach provides a new perspective for the study of visual art, algorithmic image analysis, and quantitative aesthetics more generally. △ Less

Submitted 20 May, 2022; originally announced May 2022.