Donation Rewards
      show links     Share on Twitter     Online Exhibition: Lumière / Four Seasons    

Techno Synesthesia: Digital Art Experiment the Relation between Visual and Audio Senses / Algorithmic Composition
Timeline Drawing, Foxtails, Grasses, Withering Flowers
Show About 3D Timeline Drawing & Techno Synesthesia / 3Dドローイングについて
Hide About 3D Timeline Drawing Techno Synesthesia / 3Dライン・ドローイングについて を隠す

The algorithm created a music from the video image data and drew the 3D line drawing from the XY position and the Z timeline(every each second) where the music data was extracted. The 2D drawing was drawn from the front view, then 3D wireframe turned 360 degrees.

アルゴリズムでビデオのイメージデータから音楽を作っています。3Dライン・ラインドローイングはデータを採ったグリッドのXYポジション、タイムラインをZポジションに採って約1秒ごとに(または同感覚で)正面から描いています。2Dドローイング終了後、時間要素を加えられた3Dワイアーフレームは360度回転します。

The art project "Techno Synesthesia" has attempted to extract music from visual data by computer technology. This concept implies the evolution of sensory functions by science and technology.

The artist Kojima's mind feels audio and visual are no boundaries between them. However, he cannot listen to colors and cannot see to sounds. He is just an ordinary man but an artist. He thought he would rather realize it by computer technology. Because a computer reduces all sensory data to binary. And the binary can be converted to other sensory formats. Kojima has developed computer programming for this concept since 2007. In the early stages, the program converted RGB color values of a still image to musical notes and played them by midi instrumentals. Recently, the program picks out the musical points from moving images that can be made with the differences in light and shade from the transition of time. "Timeline Drawing, Foxtails, Grasses, Withering Flowers" series was shot in Central Park, New York City. The project is implied that is experimenting with the evolution of sensory organs for artworks.

Biologically a human being has evolved very slowly until the 21st-century. We have evolved to recognize the surrounding environment by sensory organs such as visual, auditory, tactile, and others, and recognized them as reality. However, we have not known that how we perceived our environment and boundaries of sensory information, and how we handled them and choose our actions. What were the differences between how human beings and deep-sea creatures have evolved distinguishing information from the outside world? A human being developed vision, hearing, taste, smell, and touch for our survival and the realization of our outside world. But many deep-sea creatures do not have eyes and ears for the realization of their outside world.

The science and technology of the 21st-century has made new tools for physical abilities and created the new way of evolution. Cyborg is not a science fiction. The idea of physical extensions is in actuality. We shall have the evolutions in science and technology are not only physical extensions that are tangible but also senses that are perceptible too. This abstract idea is still in an experimental art. It is a small step for expanding or merging of human sensitivity and aesthetics by computer technology. Technically it uses computer science, but it is not a science. It is the fundamental research aware of our surrounding or might be closer to an alchemy. Alchemy was in the medieval idea. However, it formed the foundation of modern chemistry.


Hide About 3D Timeline Drawing & Techno Synesthesia / 3Dライン・ドローイングについて を隠す


















    Manhattan, New York City


Show About Runners #3 / ランナーズ日本語概要
Hide About Runners #3 / 日本語概要を隠す

Techno Synesthesia explores an auditory sense in visual data with computer technology. The algorithm treats binary data as a basic art material like a pigment. Synesthesia is an old art concept but it is an emerging 21st-century art method and theme. The project "Techno Synesthesia" is not an interpretation of an artist feeling. The computer program that the artist Kenji Kojima developed takes out differences in shade and light of the parts of the video frames and converts the color data to musical notes and plays midi instruments. As a result of the artwork is a video with a music. However, it does not inherit the cultural and linguistic contexts.

The concept and the direction are more important. A cyborg a fictional person that extends human physical abilities is no longer science fiction since the radical development of science and technology in recent years. This is also as the evolution that radical advances in the 21st-century by the human being whose ancestor had gone up to land from marine life billions of years ago and have continued the biological evolution very slowly. However, a cyborg is the only evolution of the physical extensions. The ability of the external information to be felt simultaneously in multiple sensory does not include. It has been a field of research in the art and philosophy. In the beginning of the 20th-century, a painter Wassily Kandinsky and a composer Alexander Scriabin explored the common information of visual and auditory with the art of different expressions. They did not bridge the audio-visual sense with intuitions, but instead, they tried to logically connect visual and auditory in common data by their methods. Techno Synesthesia is an experimental art that inherits the predecessors of the 20th-century, and considers the fusion and compatibility of multiple sensory organs by computer technology as another new evolution in the 21st-century. Although the artist uses science and technology for the development of the project, the driving force of creation is the artistic untamed passion.

テクノ共感覚は、コンピュータ・テクノロジーで視覚データから音楽を抽出します。作品は、ビデオの時間軸の明暗差の大きな箇所をバイナリーで取り出し、音に変換してその瞬間映像と移動する時間差で、ランナーの肉体と精神の乖離を暗示させます。「Runners #3」は左右2ビデオを、壁面コーナーに同時投影したシミュレーションの3分ダイジェストです。その下にある「Runners 3: Angle 1」「Runners 3: Angle 1」は30分のシミュレーションを別ウインドウで開きます。

コンセプト:20世紀後半からの急激な科学技術の発展で、人間の身体能力を拡張するサイボーグは、もはやサイエンス・フィクションではありません。これは何十億年もかけて海洋生物から陸に上がり、生存のため生物学的な進化を緩やかに続けてきた人類が、21世紀に入って急速に推し進める進化とも位置付けられます。しかしサイボーグはすでに人間に備わっている機能の延長だけです。外界の情報が複数の感覚器官で同時に感じられる能力、つまり共感覚は科学の主流が追求する進化には含まれていません。20世紀始め、画家のカンディンスキーや音楽家のスクリャビンは、視覚と聴覚との共通した情報を異なる表現のアートで探りました。彼らは直感で視聴覚の橋渡しをするのではなく、論理的に視覚と聴覚を共通項で繋げようとしました。テクノ共感覚は、20世紀の先人を受け継ぎ、コンピュータ・テクノロジーによる複数の感覚器官の融合や互換を、21世紀のもうひとつの新しい進化と考える実験アートです。開発には科学技術を用いますが、創作の原動力は抑えきれない芸術的激情です。

Hide About Runners #3 / 日本語概要を隠す