Show Japanese | 日本語

「テクノ共感覚(Techno Synesthesia)」は、小島健治が2007年から進めている視覚と聴覚の境界を越えようとするアートのシリーズです。視覚と聴覚は私たちの感覚器官では別ですが、私にはどこかに繋がりがあるように感じられます。テクノ共感覚シリーズの始めは、静止画の色彩データをアルゴリズムで音階に変換して演奏し、その音楽データを再び画像にも戻せるアプリの「RGB MusicLab」が作り出すソフトウエア作品でした。このページのビデオ作品はその発展上にあり、ビデオ素材の膨大なデータをフレームのグリッドに分け、約1秒ごとの明暗の差上位3位の色彩データに整理して音楽を作りだしています。ある色を見るとある特定の音が聞こえる知覚を持っている人達がいるそうです。しかし真偽は不確かです。「テクノ共感覚」はコンピュータ・テクノロジーを使い、感覚によらない確かなデータの扱いで、視覚から聴覚に踏み込んでみようとするアートのささやかな試みです。19世紀末から20世紀初頭の作曲家アレクサンドル・スクリャービンが、交響曲「プロメテウス」の楽譜にLuce(イタリア語で光)のパートを書いた要因や、20世紀初期のマルセル・デュシャンの「網膜的でない絵画」は、21世紀にはテクノロジーに結びついて実現される方向に向かっています。「Techno Synesthesia」シリーズは、ニューヨーク市で撮影したビデオ動画に、その画像データから作られた音楽とビデオ撮影時に録音された環境音で構成した共感覚へのアプローチを、ビデオ媒体で表現した作品です。
シネステージア(共感覚)のアートについて 日本語で詳しく

Hide Japanese | 日本語を隠す



About "Techno Synesthesia" & Kenji Kojima's Biography
1. Dalehead Arch, West Dr.-64th Street 05:24
2. West 65th St. Transverse 05:11
3. 110th St. Bridge, North West of Central Park 04:30
4. Playmates Arch, Center Dr.-65th Street 05:00
5. Glade Arch, East 77th-78th Street 07:10
6. Willowdell Arch, East Dr.-67th Street 07:37
7. Greywacke Arch, East Dr.-81st Street 05:30
8. Glen Span Arch, West Dr.-Loch Walking Path 05:30
9. Winterdale Arch, 81st West Dr.-Bridle Path 05:05
10. West 77th Street Stone Arch 03:18
11. Huddlestone Arch - Loch Walking Path 04:40
12. Springbanks Arch Bridge 02:22
13. Riftstone - Bridle Path 02:10



September 2016
Dalehead Arch, West Dr.-64th Street
Web videos are 720p resolution. Available hi-resolution video for the purchase.
Go Top


September 2016
West 65th St. Transverse
Web videos are 720p resolution. Available hi-resolution video for the purchase.
Go Top


September 2016
110th St. Bridge, North West of Central Park
Web videos are 720p resolution. Available hi-resolution video for the purchase.
Go Top


August 2016
Playmates Arch, Center Dr.-65th Street
Web videos are 720p resolution. Available hi-resolution video for the purchase.
Go Top


August 2016
Glade Arch, East 77th-78th Street
Web videos are 720p resolution. Available hi-resolution video for the purchase.
Go Top


August 2016
Willowdell Arch, East Dr.-67th Street
Web videos are 720p resolution. Available hi-resolution video for the purchase.
Go Top


August 2016
Greywacke Arch, East Dr.-81st Street
Web videos are 720p resolution. Available hi-resolution video for the purchase.
Go Top


August 2016
Glen Span Arch, West Dr.-Loch Walking Path
Web videos are 720p resolution. Available hi-resolution video for the purchase.
Go Top


July 2016
Winterdale Arch, 81st West Dr.-Bridle Path
Web videos are 720p resolution. Available hi-resolution video for the purchase.
Go Top


July 2016
West 77th Street Stone Arch
Web videos are 720p resolution. Available hi-resolution video for the purchase.
Go Top


July 2016
Huddlestone Arch - Loch Walking Path
Web videos are 720p resolution. Available hi-resolution video for the purchase.
Go Top


July 2016
Springbanks Arch Bridge
Web videos are 720p resolution. Available hi-resolution video for the purchase.
Go Top


June 2016
Riftstone - Bridle Path
Web videos are 720p resolution. Available hi-resolution video for the purchase.
Go Top


Techno Synesthesia:

The video is one of “Project: The Sound of Archway" which are Kenji Kojima's Techno Synesthesia Art series. The project is experimenting with the relationship between sound and visual by computer technology using algorithmic composition of his programming. “Synesthesia” is the perception phenomenon that can feel a certain sense of other senses. Ordinary people cannot see sounds. We can only see a sight and listen a sound from our surroundings. He believes audio and visual are no boundaries between them. But our sensory organs catch them separately. The created music of the video is not a composer's impression, it is composed of certain visual data by the computer algorithm. Greywacke Arch is in the Central Park, New York City. There are many archways in the Park. Most of the archways are spots for street musicians. The programming might capture the sprites of music which dwelled under the arch.

A video frame contains a huge amount of visual data. The program can not convert all the data of the video images to musical notes. Our sensibilities select instinctively appropriate data from an enormous amount of information on passing the time. The visual data are suppressed and arranged by the algorithm. The project uses comparing the brightness on the timeline. The program reads RGB color data from divided 84 grids of a video frame and compares the brightness of each grid and chooses two largest different values than a second before, then converts the color values to musical notes. You can see the binary and the positions of musical notes in white line squares on the video. The program converts the color value 120 to the middle C of the scale. Higher value added note steps on a scale. The program can set some variations by parameters. Finally, it plays midi instruments. The technical methods of the project based on Kenji Kojima’s RGB MusicLab.

Contemporary visual art is not only visual matters. It uses methods of science and technology and going to more like an alchemy. The technical methods based on
Kenji Kojima’s RGB MusicLab. “PROJECT: The Sound of Fountain” was inspired by Marcel Duchamp’s “Fountain”. The edition "Public 1280x720" is under Creative Commons License (CC BY-NC-ND 4.0).


Kenji Kojima's Biography:
Kenji Kojima has been experimenting with the relationships between perception and cognition, technology, music and visual art since early 90’s. He was born in Japan. He moved to New York City in 1980. He painted egg tempera paintings that were medieval art materials and techniques for the first 10 years. His paintings were collected by Citibank, Hess Oil, and others. A personal computer was improved rapidly during the 80's. He felt more comfortable with the computer art than paintings. It was clean and less contaminated on the Earth. He switches his artwork to digital. His early digital works were archived in the New Museum - Rhizome, New York. He developed Techno Synesthesia computer software "RGB MusicLab" in 2007. It created an interdisciplinary work exploring the relation between images and music. His digital art series "Techno Synesthesia" has exhibited in New York, media art festivals worldwide, including Europe, Brazil, and the online exhibitions by ACM SIGGRAPH and FILE(Electronic Language International Festival). Kenji Kojima's Resume


Go Top