ABSTRACT

Two main types of human perception are seeing and hearing. They play a central role in everyday life, scientific research, and also fine arts. Especially in the visual arts, linking the auditory and the visual realms is not uncommon. However, when it comes to linking the visual domain with the audio domain, the possibilities there are less addressed. Therefore, in this paper, we conceptualize the so-called cruxes for sonification of the visual domain. These are hierarchically structured transformations of the main elements in both domains, starting at the physics level, then extending to the physiological level, and finally to the artistic level. They offer a strong basis for creative sonification efforts and are intended for computer-based (generative) art production. In brief, this paper shows that sonification has a strong potential for artistic sonic creations, where scientific basis can play an important role, when linking the visual, acoustic, and physiological domains.

摘要

人类感知的两种主要类型是视觉和听觉。它们在日常生活、科学研究和美术中都发挥着核心作用。特别是在视觉艺术中，将听觉和视觉领域联系起来的情况并不少见。然而，当谈到将视觉域与音频域联系起来时，这种可能性就没有得到解决。因此，在本文中，我们将视觉域声音化的所谓关键概念化。这是两个领域中主要元素的层次结构转换，从物理层面开始，然后延伸到生理层面，最后到艺术层面。它们为创造性的声波化工作提供了坚实的基础，旨在用于基于计算机的（生成）艺术制作。简单来说，