show links

Cipher Art:
Split/Merge AudioVisual. Audio and Visual files merged into an image.

     Show about Cipher Art: Split/Merge AudioVisual
    Hide about Cipher Art: Split/Merge AudioVisual

The original artwork is a computer application, not a video. Technical Note 1, 2, 3, Bitwise Operation(Japanese Note)/論理演算ノート(日本語)

Binaries in electronics is one of art materials in 21st century. Cave artists encountered earth as color pigments 40,000 years ago, and they created cave paintings. 20th century artists encountered binaries. They were aware art expressions would be beyond the boundaries of audio and visual senses by manipulating zeros and ones. Some artists in the modern art history like a painter Wassily Kandinsky, a composer Alexander Scriabin and others tried to go beyond the the boundaries of audios and visuals. The project "Split/Merge AudioVisual" has been on the extension of their works. It processes a bitwise XOR operation on data of a photograph, and makes two same length of data. This method is called one time pad. The two data are converted to a music and a color pixel files. The software "SplitAudiVisual" makes an audio and a visual files using the method of one time pad. It converts one of data to a music file by RGB color values, and another data to a mosaic pattern. The project player "MergeAudioVisual" downloads a music and a color pixel files from the artist's server, and performs merging audio and visual files into an original photograph. You can see and enjoy the art works anywhere on the earth through the internet.

Download Full Screen Player "MergeAudioVisual" MacOS Only
This application has only player function, does not split audio and visual of an image. (20140723)

The software splits a digital image to audio and visual files by a bitwise XOR operation (logical exclusive OR). The bitwise operation takes two bit patterns of equal length and performs exclusive OR on each pair of corresponding bits. The software makes random numbers. It is same numbers of pixels of the original image. A binary of the random number performs on a binary of the image by bitwise XOR. Bitwise XOR makes 0 and 0 to 0, 0 and 1 to 1, 1 and 1 to 0. But the position of the decimal does not change. If a binary of one pixel element is 10010011 and random number is 00100001, the result will be 10110010. See the example of 8 bits binary. It is same length of a color data element.

10010011 (original image)
00100001 (random number)

10110010 (the result)

Audio and Visual:
The software converted the random number data to musical notes by Kenji Kojima's RGB Music technology. RGB value 120 is converted to middle C. Each two step values increase or decrease a half tone. One pixel make three notes of harmony. 0,0,0 is no sounds. The note length is determined by the color value. The music is a twelve-tone music. The left sample MIDI file was created from the musical notes of the random numbers. You can listen it. The result of the image would be a new image which processed by bitwise XOR. The perception of human being could not recognize what the image was. We have 2 digital files as audio and visual. You can think that the audio is a key and the visual is a cipher image.

The software converts an audio key (music file) to musical notes then makes binary. The binary performs on the binary of cipher image (visual) by bitwise XOR. See the example.

10110010 (split image)
00100001 (split audio key)

10010011 (same binary of the original)

The audio and visual files merge into an original image.

Project File Creation Software:
Splitting Audio and Visual Files (left), Merging Files (right). This application is not distributed.

    Hide about Cipher Art: Split/Merge AudioVisual

     Go to Algorithmic Composition "CipherTune" 暗号音楽 「サイファチューン」

    Stuies of Split/Merge and Two Musics Merge into an Image:

    Cipher Tune Concert