The Synesthetic Imperative
The history of human expression is often categorised into distinct sensory silos: the visual arts, occupied with space, light, and static form; and music, the domain of time, rhythm, and invisible vibration. Yet, this segregation is a relatively modern bureaucratic convenience rather than an artistic reality. For millennia, artists, philosophers, and scientists have pursued a unified theory of perception—a “visual music” where the eye might hear, and the ear might see. This pursuit is not merely a stylistic experiment but a fundamental inquiry into the neurological and spiritual architecture of human consciousness.
From the ancient Greek conception of the Musica Universalis, which posited that the movements of celestial bodies generated an inaudible cosmic harmony, to the machine-learning algorithms of the twenty-first century that “hallucinate” architecture based on symphonic archives, the desire to bridge the sensory divide has been relentless. Plato famously ascribed a tone to each planetary orbit, suggesting that the universe itself was a grand, audiovisual composition.1 This ancient intuition laid the groundwork for a two-thousand-year struggle to find the mathematical isomorphism between the frequency of a sound wave and the wavelength of a light beam.
The urgency of this synthesis reached a fever pitch with the advent of Modernism. As the camera usurped the painter’s role in documenting physical reality, the visual arts faced an existential crisis. To survive, painting had to detach itself from the burden of representation. It looked to music—the only art form that was accepted as purely abstract, emotional, and non-representational—as its saviour. The Victorian critic Walter Pater crystallised this movement in 1877 with his famous dictum: “All art constantly aspires towards the condition of music”.2 Pater’s assertion was that art should appeal directly to the senses and emotions without the mediation of intellect or narrative, just as a melody does.
This report offers an exhaustive examination of the convergence of these two disciplines. We will traverse the neurological landscapes of synesthetes, who possess the biological capacity to see sound; explore the Enlightenment-era inventions that attempted to mechanise colour; analyse the modernist studios where Kandinsky and Klee codified the grammar of visual rhythm; and finally, immerse ourselves in the digital void where contemporary artists use artificial intelligence to transmute data into multisensory experiences. This is not a linear history of influence, but a mapping of a shared frequency—a resonance that vibrates through the canvas, the screen, and the concert hall alike.
The Physics and Physiology of “Joined Perception”
Before art could consciously emulate music, humanity first had to reckon with the biological and physical connections between sight and sound. The artistic impulse to merge these fields is deeply rooted in the neurological condition known as synesthesia and the scientific quest to map the colour spectrum to the musical scale.
Synesthesia: The Neurological Basis of Visual Music
Synesthesia, derived from the Greek syn (together) and aisthesis (perception), is a condition in which stimulation of one sensory or cognitive pathway leads to automatic, involuntary experiences in a second sensory or cognitive pathway.4 While there are over 60 reported types of synesthesia, the form most critical to the history of art is chromesthesia, or sound-to-colour synesthesia. For a chromesthete, auditory stimuli—whether music, voices, or environmental noise—trigger photisms, or experiences of colour and shape.
Research indicates that this is not a hallucination but a result of hyper-connectivity in the brain. The V4 colour-processing area of the visual cortex and the auditory cortex share direct neural pathways in synesthetes that are pruned in the neurotypical brain.4 This cross-activation suggests that the brain does not naturally segregate the senses as rigidly as once thought.
Historically, synesthesia was often viewed with suspicion or awe. In the 19th century, it was associated with the Romantic ideal of the sensitive genius or, conversely, with nervous pathology.5 However, by the turn of the 20th century, it became a badge of honour among the avant-garde. It provided a biological justification for abstract art: if a specific C-major chord objectively produced a vision of white for the artist, then abstract painting was not arbitrary decoration, but a faithful recording of a higher psychological reality.
Newton’s Mistake: The Spectrum and the Octave
The scientific attempt to link colour and sound predates modern neurology. In his seminal 1704 work Opticks, Sir Isaac Newton famously identified seven colours in the visible spectrum: Red, Orange, Yellow, Green, Blue, Indigo, and Violet. It is a matter of historical record that Newton’s inclusion of “Indigo”—a colour barely distinguishable from blue and violet for most observers—was not based on optical necessity but on mystical symmetry. Newton sought to align the spectrum with the seven notes of the Western diatonic musical scale (Dorian mode).1
Newton believed that the physical universe was governed by a unified harmonic law. Just as a vibrating string divided by ratios produces the musical scale, he hypothesised that light vibrations (though he did not fully understand the wave nature of light at the time) were governed by similar ratios. This “Colour-Music Analogy” established a persistent, if scientifically flawed, paradigm:
| Musical Note | Newton’s Colour | Theoretical Rationale |
| D | Red | The tonic/base frequency is the lowest energy. |
| E | Orange | Second interval. |
| F | Yellow | Third interval. |
| G | Green | Fourth interval. |
| A | Blue | Fifth interval. |
| B | Indigo | Sixth interval (Added to force the 7-step analogy). |
| C | Violet | Seventh interval; highest frequency before the octave loops. |
This table, while optically arbitrary, provided artists and inventors with a “scientific” framework to begin constructing instruments that could play with light.7 It legitimised the idea that colour harmony could be taught and composed with the same rigour as musical counterpoint.
The Machine in the Garden – The Era of Colour Organs
Long before the digital visualizer or the laser light show, Enlightenment inventors sought to build mechanical devices that could perform “visual music” in real-time. These devices, known collectively as “Colour Organs,” represent the technological lineage of the art form.
Louis Bertrand Castel and the Clavecin Oculaire
The father of the colour organ was the French Jesuit priest and mathematician Louis Bertrand Castel. In the 1720s, heavily influenced by Newton’s theories (though critical of Newton’s materialism), Castel proposed the clavecin oculaire (ocular harpsichord). His premise was philosophical as well as mechanical: “Sound is the object of the ear, as colour is of the eye”.8 If music could move the soul through the ear, a “music of colours” should be able to move the soul through the eye.
Castel’s design was an engineering marvel of its time. It consisted of a frame containing 60 small windows, each covered with colored glass or silk. Each window was connected via a system of pulleys and levers to a standard harpsichord keyboard. When a key was struck, a small shutter would open, allowing light (provided by hundreds of candles placed behind the instrument) to shine through the colored pane.9
The complexity of the instrument was immense. To achieve different levels of brightness (dynamics), Castel proposed a “chiaroscuro” scale, requiring not just different hues but different shades of light and dark, resulting in a proposed keyboard of 144 keys.10 Although Castel struggled to produce a fully functioning model that satisfied his critics—the mechanics were noisy, the candles smoky, and the light often too dim—his theoretical contribution was monumental. He decoupled colour from the depiction of objects, suggesting that colour in itself, arranged in time, was an art form.
Scriabin’s Prometheus and the Luce
The concept of the colour organ lay dormant until the late 19th century, when electricity made high-intensity lighting possible. The Russian composer Alexander Scriabin, a man deeply immersed in Theosophy and mysticism, revived the idea for his symphonic poem Prometheus: The Poem of Fire (Op. 60), premiered in 1911.11
Scriabin included a line in the musical score designated as Luce (Light). This was not a suggestion for stage lighting; it was a precise musical part written for a “tastiera per luce” (keyboard for lights). Unlike Newton, Scriabin’s colour system was based on the Circle of Fifths and his own synesthetic associations, which were spiritual rather than physical:
- C Major: Red (Will, Human)
- G Major: Orange (Creative Play)
- D Major: Yellow (Joy)
- A Major: Green (Matter)
- F# Major: Blue/Violet (The Spirit, Mysticism)
Scriabin envisioned the performance of Prometheus as a multimedia ritual. He wanted the audience bathed in changing floods of colored light that corresponded to the harmonic progression of the music. At the climax, the Luce part calls for the entire hall to be flooded with a blinding radiance as the music resolves into a colossal F-sharp major chord.12 While technical limitations in 1911 prevented the full realisation of his vision—projecting light onto a small screen was a disappointing compromise—Scriabin’s work remains the first major orchestral composition to treat light as a symphonic instrument equivalent to the violin or the trumpet.
The Aesthetic Movement – Painting as Atmosphere
While inventors tinkered with machines, painters in the late 19th century began to adopt musical terminology to redefine the purpose of their art. The Aesthetic Movement, with its slogan “art for art’s sake,” argued that painting should not serve moral, narrative, or educational purposes. It should simply be beautiful, like a nocturne or a symphony.
James McNeill Whistler: The Nocturne Controversy
The American expatriate James McNeill Whistler was the vanguard of this shift. He began titling his paintings using musical nomenclature: Symphony, Harmony, Arrangement, and most famously, Nocturne.13 This was a deliberate provocation. By calling a painting of the Thames River a Nocturne, Whistler was telling the viewer: “Do not look for the river; look for the mood, the tone, and the composition.”
His most controversial work, Nocturne in Black and Gold: The Falling Rocket (1875), depicts a fireworks display in London’s Cremorne Gardens.14 However, the painting is nearly abstract—a dark, atmospheric wash of blacks, greys, and muddy greens, punctuated by splashes of yellow gold. The critic John Ruskin famously attacked the painting, accusing Whistler of “flinging a pot of paint in the public’s face”.15
Whistler sued Ruskin for libel. The resulting trial was a pivotal moment in art history. Whistler argued that the painting was an “artistic arrangement,” analogous to music. The title Nocturne was suggested by his patron Frederick Leyland, a pianist devoted to Chopin.13 Just as Chopin’s nocturnes were moody, atmospheric piano pieces that evoked the night without “telling a story,” Whistler’s painting used colour and value to evoke the sensation of fog and fleeting light. The connection was structural: the “Chopin-esque” travelling bass chords found a visual equivalent in the dark, heavy bottom of the canvas, while the high, trilling melody of the right hand was visualised in the explosive, staccato sparks of the fireworks.16 Whistler won the case, legally validating the idea that painting could aspire to the condition of music.
The Spiritual Abstract – Wassily Kandinsky
If Whistler opened the door, Wassily Kandinsky blew the walls off. For Kandinsky, the connection between music and painting was not merely a metaphor; it was a spiritual imperative. A synesthete and a mystic, Kandinsky believed that humanity was moving toward a new spiritual epoch, and that abstract art—modelled on music—was the vehicle for this transcendence.
The Lohengrin Epiphany and the Schoenberg Connection
Kandinsky’s journey into abstraction was catalysed by two specific musical events. The first was a performance of Richard Wagner’s Lohengrin at the Bolshoi Theatre. Kandinsky described the experience as a violent synesthetic episode: “I saw all my colours in spirit, before my eyes. Wild, almost crazy lines were sketched in front of me”.17 He realised that painting could possess the same emotional power as Wagner’s music without relying on representational subjects.
The second event was a 1911 concert in Munich featuring the music of Arnold Schoenberg. Schoenberg was then pioneering atonality, dismantling the traditional Western harmonic system. Kandinsky was electrified. He saw a direct parallel: just as Schoenberg liberated music from the “tonal centre,” Kandinsky sought to liberate painting from the “object”.18
The two men began a prolific correspondence. Kandinsky’s painting Impression III (Concert) (1911) documents this concert. A large, aggressive deluge of yellow (representing the sound of the brass) floods the canvas, enveloping the black, coffin-like shape of the piano.18
Composition VIII and the Grammar of Shapes
In his theoretical treatise Concerning the Spiritual in Art (1911), Kandinsky codified his visual-musical lexicon. He believed that specific colours resonated with the soul like specific instruments 19:
| Color | Musical Instrument Equivalent | Emotional/Spiritual Character |
| Light Blue | Flute | Cool, distant, celestial. |
| Dark Blue | Cello | Deep, mournful, penetrating. |
| Deepest Blue | Double Bass / Organ | Profound, serious, meditative. |
| Yellow | Trumpet | Earthly, aggressive, eccentric, “fanfare.” |
| Green | Violin | Restful, middle-class, balanced (bourgeois). |
| Red | Tuba / Drum | Powerful, energetic, boiling inner tension. |
| Orange | Viola / Alto Bell | Radiant, healthy, energetic. |
| Violet | English Horn / Bassoon | Morbid, extinguished, sad. |
His 1923 masterpiece Composition VIII applies this grammar rigorously. The painting is a complex orchestration of geometric forms. The circles—some isolated, some in halos—act as sustained notes. The sharp, jagged lines function as staccato percussion or brass blasts. The background, largely white/cream, functions as silence. Kandinsky argued that “white” is a silence full of possibilities (like a pause in music), whereas “black” is a dead silence, a final conclusion.19 By navigating the canvas, the viewer’s eye “plays” the composition, experiencing a temporal unfolding of visual tensions and resolutions that mirrors a symphonic structure.
Section 5: The Polyphonic Image – Paul Klee
While Kandinsky focused on the emotional and timbral qualities of music, his colleague at the Bauhaus, Paul Klee, was interested in structure and syntax. Klee was a professional-level violinist, married to a pianist, and intimately familiar with the intricate counterpoint of Johann Sebastian Bach.20
Visualising the Fugue
Klee’s primary artistic struggle was the translation of polyphony (many voices sounding at once) into the static medium of painting. In music, a fugue consists of independent melodic lines that overlap and interweave, yet remain distinct. In painting, overlapping forms usually obscure one another. Klee sought a technique where visual “voices” could be transparent and simultaneous.
He developed a method of “polyphonic painting” using watercolour glazes and pointillism. By layering translucent sheets of colour, he created a visual depth where the “background” and “foreground” interacted like the bass and treble of a piano score.
Ad Parnassum: The Masterpiece of Counterpoint
Klee’s 1932 painting Ad Parnassum is the summit of this experimentation. The title explicitly references Gradus ad Parnassum, the 1725 counterpoint treatise by Johann Joseph Fux.22
- The Cantus Firmus: Klee draws bold, black lines to define a mountain and a gateway. In musical terms, this is the cantus firmus—the fixed, slow-moving melody that grounds the composition.
- The Counterpoint: Surrounding these lines is a shimmering field of thousands of hand-painted dots. These dots shift in hue and intensity, creating a vibrating, rhythmic texture that acts as the “accompaniment” or the rapid melodic ornamentation.
- Temporal Movement: The gradation of light—moving from deep blue/darkness at the bottom to a glowing orange sun at the top—forces the eye to travel upwards. This implies time and development, mirroring the “climb” to Parnassus (the home of the Muses).22
Klee did not just illustrate music; he appropriated its structural logic. He taught his Bauhaus students to visualise “rhythm” not as a repetition of identical forms (which is merely a pattern, like wallpaper), but as a dynamic variation of weight, measure, and interval—”taking a line for a walk”.20
The Syncopated Grid – Mondrian and American Jazz
While the European modernists looked to the classical structures of Bach and Wagner, the Dutch artist Piet Mondrian found his rhythm in the syncopated beat of American Jazz. Mondrian is the defining figure of De Stijl (The Style), a movement that reduced art to its absolute essentials: horizontal and vertical lines, and primary colours (red, yellow, blue).24
From Static Harmony to Boogie Woogie
In his European period, Mondrian’s famous grids were separated by thick, black lines. These paintings expressed a static, universal equilibrium—a silence. However, when Mondrian fled World War II and arrived in New York City in 1940, his work underwent a radical transformation. He fell in love with the city’s frantic energy and the “Boogie Woogie” piano music that dominated the radio.24
Boogie Woogie is a style of blues piano characterised by a driving, repetitive bass figure (ostinato) in the left hand and improvised, syncopated melodies in the right. It is music of high energy, mechanical precision, and rhythmic disruption.
Broadway Boogie Woogie: The City as Score
Mondrian’s final completed masterpiece, Broadway Boogie Woogie (1942-43), is a visual transcription of this sound.
- Destruction of the Black Line: For the first time, Mondrian eliminated the black grid entirely. The “lines” are formed by small, stuttering blocks of pure colour—red, yellow, blue, and grey.25
- Visual Rhythm: These small blocks create a pulsing, staccato rhythm. They mimic the “eight-to-the-bar” beat of the boogie-woogie bass line.
- Syncopation: Larger blocks of colour interrupt the small, rhythmic lines. These act as visual accents, off-beats, or the syncopated chords of the pianist’s right hand.26
The painting does not look like a picture of a jazz band; it feels like the music. It captures the “optical vibration” of New York City—the traffic lights, the gridiron streets, the neon—mediated through the structural logic of jazz. Jazz pianist Jason Moran has famously analysed the painting as a literal score, noting how the distribution of “weight” (colour blocks) corresponds to musical dynamics and phrasing.26
American Rhythms – Stuart Davis and Jackson Pollock
In the United States, the integration of jazz into painting became a way to assert a uniquely American modernist identity.
Stuart Davis: The Method of Jazz
Stuart Davis was arguably the most dedicated “jazz painter” in history. He viewed jazz as the sonic equivalent of Cubism—a breaking down and rearranging of reality into a new, energetic order. Davis famously declared, “I don’t paint jazz; I paint with the method of jazz”.27
His work Swing Landscape (1938) exemplifies this method. Commissioned for a housing project, the mural is a riot of colour and shape. Davis uses “visual polyrhythm”—clashing colours and disjointed geometric forms that pull the eye in multiple directions simultaneously.28 The forms seem to collide and bounce off one another, mimicking the call-and-response and improvisation of a swing band. For Davis, jazz was not just a subject; it was a model for democracy and vitality. The painting captures the “hot” energy of the 1930s swing era, translating the brassy, propulsive sound of Duke Ellington or Count Basie into oil paint.29
Jackson Pollock: Action Painting as Improvisation
Jackson Pollock is often linked to jazz, specifically the improvisational ethos of Bebop and Free Jazz. While Pollock denied illustrating music, his process of “Action Painting” shares a deep kinship with jazz performance.
- Improvisation: Like a jazz soloist, Pollock worked without a preliminary sketch. He improvised directly onto the canvas, reacting in real-time to the flow of paint. The “art” was the performance of painting itself; the canvas was merely the record of that event.30
- All-Over Composition: Just as Free Jazz (pioneered by Ornette Coleman) abandoned the hierarchy of a lead melody and accompaniment, Pollock’s “drip” paintings abandoned the hierarchy of a central focal point. Every square inch of the canvas is equally charged with energy, creating a visual “wall of sound.”
- The Coleman Connection: This affinity was recognised by the musicians themselves. Ornette Coleman used Pollock’s White Light as the cover art for his seminal 1960 album Free Jazz: A Collective Improvisation, cementing the link between Abstract Expressionism and the avant-garde sound.31
Moving Pictures – The Birth of Visual Music
While painters struggled to imply movement on a static canvas, the invention of film allowed artists to compose with light in time, fulfilling the dream of the colour organ without the mechanical limitations.
Oskar Fischinger: The Father of Visual Music
The German-American animator Oskar Fischinger is the towering figure of this genre. Fischinger believed that visual rhythm was subject to the same laws as auditory rhythm. In the 1920s and 30s, he created a series of “Studies” (Studie nr. 1-12) where abstract charcoal and wax forms danced in tight synchronisation with jazz and classical records.32
Fischinger’s most famous encounter with the mainstream was his work on Walt Disney’s Fantasia (1940). He was hired to design the sequence for Bach’s Toccata and Fugue in D Minor. However, Fischinger quit in frustration because Disney insisted on making the abstract shapes “representational” (e.g., making violin bows look like clouds). Fischinger famously stated, “Music is not a cloud!” He sought absolute abstraction.32
His masterpiece, Motion Painting No. 1 (1947), is a monument to the genre. Fischinger painted on a sheet of plexiglass, filming a single frame after every brushstroke. Over the course of 10 minutes, set to Bach’s Brandenburg Concerto No. 3, the painting builds itself up layer by layer. It is a visual fugue, demonstrating how complex visual textures can evolve in time just as musical textures do.34
The Cover as Canvas – Album Art History
With the rise of the vinyl LP in the mid-20th century, the “album cover” became the primary gallery for music-inspired art. This was a unique discipline where the image had to function as a visual signifier for the sound inside the sleeve.
Blue Note Records: The Typography of Hard Bop
Between 1956 and 1967, designer Reid Miles and photographer Francis Wolff created the definitive look of Jazz for Blue Note Records. Their aesthetic was synonymous with the “Hard Bop” sound: cool, intellectual, and rhythmic.36
Reid Miles was not a jazz fan (he preferred classical), but his genius lay in translating the percussive nature of the music into typography. He treated letters as visual shapes. He used massive, sans-serif fonts (like Franklin Gothic or Caslon 540) and cropped Wolff’s black-and-white photos of sweating musicians into asymmetrical layouts.37 The use of negative space (white space) in the design mirrored the use of silence and phrasing in the music. The text “swung” across the cover with the same syncopated rhythm as an Art Blakey drum solo.38
Hipgnosis and Pink Floyd: The Surrealist Soundscape
In the rock era, the design group Hipgnosis (led by Storm Thorgerson) revolutionised album art by rejecting photos of the band in favour of high-concept Surrealism. Their work for Pink Floyd is legendary.
- Dark Side of the Moon (1973): The prism refracting light is perhaps the most iconic music image in history. It represents the stage lighting, the lyrics (madness vs. clarity), and the “colour” of the sound. It is simple, geometric, and endlessly interpretable.39
- Wish You Were Here (1975): Influenced by René Magritte, Thorgerson created an image of a businessman burning while shaking hands. It captures the album’s themes of absence, the music industry’s cruelty, and the “disappearance” of Syd Barrett. The surreal imagery provided a visual parallel to Floyd’s expansive, psychedelic soundscapes.40
Peter Saville and Joy Division: Data as Art
Peter Saville’s cover for Joy Division’s Unknown Pleasures (1979) marks the transition to the digital age. The image—a series of white lines forming a jagged mountain landscape on black—was not drawn by an artist. It is a data visualisation of radio waves from the first pulsar ever discovered (CP 1919), taken from the Cambridge Encyclopedia of Astronomy.41
Saville recontextualised this raw scientific data as a symbol of the band’s ominous, pulsating, and energetic sound. It was a prophetic moment: art was no longer just “inspired” by invisible forces; it was using the data of those forces to generate the image.42
Cymatics – Sound Made Visible
While artists used metaphor, scientists sought physical proof of sound’s form. Cymatics is the study of visible sound vibration, a field that has inspired a new generation of contemporary artists.
From Chladni to Carsten Nicolai
In the 18th century, Ernst Chladni demonstrated that sand on a vibrating metal plate organises itself into complex geometric mandalas. The pattern depends on the frequency: higher pitches create more complex geometries. Swiss physician Hans Jenny later coined the term “Cymatics” and used fluids and powders to film these phenomena.43
Contemporary artist Carsten Nicolai (also known as the musician Alva Noto) creates installations that make these physics perceptible. His work Unicolour and his collaborations with Ryoji Ikeda use oscilloscopes and audio-reactive visuals to explore the “grid” of reality. Nicolai views his art as a scientific investigation: by visualising the error (glitch) and the frequency, he reveals the mathematical code that underpins both sight and sound.45
The Digital Synthesis – Generative Art and AI
In the 21st century, the computer has dissolved the boundary between the senses. Audio and video are now both just data—zeros and ones—allowing for direct, algorithmic transduction.
Ryoji Ikeda: The Mathematical Sublime
Ryoji Ikeda works at the limits of human perception. His data-verse trilogy uses massive datasets (from NASA, CERN, and the Human Genome Project) to create immersive audiovisual environments. In Ikeda’s software, a single line of code can trigger a pixel and a sound simultaneously. There is no translation; there is only data, expressed as light and noise. His work is the ultimate realisation of the Pythagorean ideal: math is music, music is math, and both can be seen.47
Refik Anadol: Machine Hallucinations
Refik Anadol represents the forefront of AI art. For WDCH Dreams (Walt Disney Concert Hall Dreams), Anadol collaborated with the LA Philharmonic and Google. They fed 45 terabytes of the orchestra’s archival history into a neural network.49 The AI then “dreamed” new visuals—hallucinatory, fluid architectures—that were projected onto the exterior of the concert hall. The building itself became a living organism, pulsing with the visual memory of a century of music. This moves beyond synesthesia into “machine consciousness,” where the AI acts as the synesthetic brain.50
Interactive Applications: Björk and Spotify
The synthesis of music and art has also entered the consumer realm.
- Björk’s Biophilia (2011): Björk released the first “app album.” Each song was accompanied by an interactive iPad app that allowed the user to manipulate the music’s structure visually. The user could “touch” the bassline or “draw” the melody, blurring the line between listener, viewer, and composer.52
- Spotify Canvas: This feature allows artists to upload 8-second vertical looping visuals for their tracks. While simple, it represents the mass democratisation of visual music. It acknowledges that in the streaming age, a static album cover is insufficient; music is now a fluid, screen-based experience.54
Virtual Reality and Future Synesthesia
The final frontier is Virtual Reality (VR). VR allows us to step inside the synesthetic experience. Artists and researchers are now building VR tools (like Tilt Brush) that allow users to paint in 3D space while the environment reacts to music. “Synesthesia in VR” projects attempt to simulate the specific cross-sensory experiences of synesthetes, allowing neurotypical people to “try on” a different brain architecture.55
As Brain-Computer Interfaces (BCIs) advance, we may soon be able to bypass the eyes and ears entirely, stimulating the visual and auditory cortices directly to create shared, hallucinated symphonies of light and sound.
Conclusion
The journey from the flickering candles of Castel’s Ocular Harpsichord to the AI-generated dreams of Refik Anadol reveals a singular, persistent human desire: to heal the fracture in our perception. We have always sensed that the beauty we hear and the beauty we see are derived from the same source—the fundamental vibration of the universe.
Kandinsky and Klee taught us the grammar of this vibration. Mondrian and Davis showed us its rhythm. Fischinger set it in motion. And now, the digital artist creates the world anew, turning code into a unified field of expression. We are no longer merely “inspired” by music; we have built the tools to inhabit it.
Disclaimer
This article is provided for educational and informational purposes only. The interpretations of artistic works and their connections to musical theory are based on established art historical scholarship but remain subject to critical debate. Descriptions of neurological conditions such as synesthesia are intended for context within the humanities and do not constitute medical definitions. The mention of specific software, apps, or commercial entities (e.g., Spotify, Google) does not imply endorsement.
Table 1: The Evolution of the Colour-Music Connection
| Era | Key Figure | Innovation/Concept | Mechanism/Method |
| Enlightenment | Louis Bertrand Castel | Ocular Harpsichord | Mechanical shutters, candles, colored glass. |
| Romanticism | Alexander Scriabin | Prometheus (Luce) | Orchestral score with a dedicated “light keyboard.” |
| Aestheticism | James McNeill Whistler | Nocturnes | Titling paintings as music to emphasise mood over narrative. |
| Modernism | Wassily Kandinsky | The Spiritual in Art | Theorised specific instrument-to-colour correspondences (Yellow=Trumpet). |
| Bauhaus | Paul Klee | Polyphonic Painting | Visual layering to mimic musical counterpoint (Ad Parnassum). |
| De Stijl | Piet Mondrian | Broadway Boogie Woogie | Destruction of the black grid to mimic jazz syncopation. |
| Visual Music | Oskar Fischinger | Motion Painting No. 1 | Frame-by-frame painting/filming to synchronise image and sound. |
| Post-Punk | Peter Saville | Unknown Pleasures | Using raw scientific data (pulsars) as graphic design. |
| Digital/AI | Refik Anadol | WDCH Dreams | Machine Learning algorithms hallucinate visuals from audio archives. |
Reference
- The Color of Sound: An Insight on Chromesthesia – Huskie Commons, accessed on January 19, 2026, https://huskiecommons.lib.niu.edu/cgi/viewcontent.cgi?article=2477&context=studentengagement-honorscapstones
- Improvision: Orphic Art in the Age of Jazz – University of Bristol Research Portal, accessed on January 19, 2026, https://research-information.bris.ac.uk/en/publications/improvision-orphic-art-in-the-age-of-jazz/
- Paintings and Music – John McDonald, accessed on January 19, 2026, https://www.johnmcdonald.net.au/2021/paintings-and-music/
- Synesthesia – Wikipedia, accessed on January 19, 2026, https://en.wikipedia.org/wiki/Synesthesia
- Synesthesia – Modern Art Terms and Concepts | TheArtStory, accessed on January 19, 2026, https://www.theartstory.org/definition/synesthesia/
- a historical perspective on the relationship between sound and colour – MARCO DE BIASI, accessed on January 19, 2026, https://www.marcodebiasi.info/en/a-historical-perspective-on-the-relationship-between-sound-and-colour/
- Coloured hearing, colour music, colour organs, and the search for perceptually meaningful correspondences between colour and sound – PMC – NIH, accessed on January 19, 2026, https://pmc.ncbi.nlm.nih.gov/articles/PMC9099070/
- Lessons at the ocular harpsichord (Chapter 1) – The Orchestral Revolution, accessed on January 19, 2026, https://www.cambridge.org/core/books/orchestral-revolution/lessons-at-the-ocular-harpsichord/0D394CAA1C92718FC967A93C30BD41B5
- Look at the Sound – KABK, accessed on January 19, 2026, http://kabk.github.io/govt-theses-15-ieva-valule-look-at-the-sound/instrumnets.html
- THE OCULAR HARPSICHORD OF LOUIS-BERTRAND CASTEL – TU Delft, accessed on January 19, 2026, https://filelist.tudelft.nl/TBM/Over%20faculteit/Afdelingen/Values%2C%20Technology%20and%20Innovation/People/Associate%20Professors/OcuHarpsCastel.pdf
- Prometheus: The Poem of Fire – Wikipedia, accessed on January 19, 2026, https://en.wikipedia.org/wiki/Prometheus:_The_Poem_of_Fire
- Prometheus, Poem of Fire, Op. 60, Alexander Scriabin – LA Phil, accessed on January 19, 2026, https://www.laphil.com/musicdb/pieces/2988/prometheus-poem-of-fire-op-60
- Nocturne | Cleveland Museum of Art, accessed on January 19, 2026, https://www.clevelandart.org/art/1941.89
- Nocturne in Black and Gold, the Falling Rocket | Detroit Institute of Arts Museum, accessed on January 19, 2026, https://dia.org/collection/nocturne-black-and-gold-falling-rocket-64931
- James Abbott McNeill Whistler, Nocturne in Black and Gold: The Falling Rocket – Smarthistory, accessed on January 19, 2026, https://smarthistory.org/whistler-nocturne-in-black-and-gold-the-falling-rocket/
- James McNeill Whistler and Chopin – Nocturne, accessed on January 19, 2026, http://humanities202final.blogspot.com/2011/12/james-mcneill-whistler-and-chopin.html
- Wassily Kandinsky’s Symphony of Colors | Denver Art Museum, accessed on January 19, 2026, https://www.denverartmuseum.org/en/blog/wassily-kandinskys-symphony-colors
- How Schoenberg and Kandinsky Inspired Each Other – Interlude.HK, accessed on January 19, 2026, https://interlude.hk/musicians-artists-schoenberg-kandinsky/
- Atonal Canvas: When Kandinsky met Schoenberg – AMS-SW Chapter, accessed on January 19, 2026, http://ams-sw.org/wp-content/uploads/2021/12/AMS-SW_V5Fall2016Kunyuan-paper.pdf
- Paul Klee, Vasily Kandinsky, and Piet Mondrian Artist Bios Modernism – ArtMasters The Game, accessed on January 19, 2026, https://artmastersthegame.com/artist-bios-modernism
- Paul Klee — Painting and Music – Interlude.HK, accessed on January 19, 2026, https://interlude.hk/paul-klee-painting-music/
- Paul Klee and Musical Polyphony – Robert Najlis, accessed on January 19, 2026, https://www.robertnajlis.com/blog/klee-music-polyphony/
- Ad Parnassum, Steven Stucky – Hollywood Bowl, accessed on January 19, 2026, https://www.hollywoodbowl.com/musicdb/pieces/169/ad-parnassum
- Exploring Piet Mondrian’s Broadway Boogie Woogie – Singulart, accessed on January 19, 2026, https://www.singulart.com/blog/en/2024/02/04/broadway-boogie-woogie-by-piet-mondrian/
- Piet Mondrian. Broadway Boogie Woogie. 1942–43 | MoMA, accessed on January 19, 2026, https://www.moma.org/collection/works/78682
- Jason Moran plays Piet Mondrian’s Broadway Boogie Woogie | Magazine – MoMA, accessed on January 19, 2026, https://www.moma.org/magazine/articles/150
- Study for “Swing Landscape” – Tetragrammaton, accessed on January 19, 2026, https://www.tetragrammaton.com/art/studyforswinglandscape
- American Paintings, 1900–1945: Study for “Swing Landscape”, 1937-1938, accessed on January 19, 2026, https://www.nga.gov/research/publications/online-editions/american-paintings-1900-1945-study-swing-landscape-1937-1938
- “Swing Landscape” – a poem by Kenneth Boyd – Jerry Jazz Musician, accessed on January 19, 2026, https://www.jerryjazzmusician.com/swing-landscape-a-poem-by-kenneth-boyd/
- Art in Focus with Helen Harrison: Jackson Pollock and Jazz (September 29, 2020) – YouTube, accessed on January 19, 2026, https://www.youtube.com/watch?v=oosmplV7D5A
- Portrait in Seven Shades: Pollock – MoMA, accessed on January 19, 2026, https://www.moma.org/explore/inside_out/2010/02/12/portrait-in-seven-shades-pollock/
- Oskar Fischinger: The Pioneer of Visual Music and Abstract Animation – Artsper Magazine, accessed on January 19, 2026, https://blog.artsper.com/en/a-closer-look/the-father-of-visual-music-oskar-fischingers-experimental-legacy/
- Visual Music – experimenta.l. – UT Dallas Research Labs, accessed on January 19, 2026, https://labs.utdallas.edu/experimental/category/visual-music/
- MOTION PAINTING N. 1 | Il Cinema Ritrovato Festival, accessed on January 19, 2026, https://festival.ilcinemaritrovato.it/en/film/motion-painting-n-1/
- Oskar Fischinger. Motion Painting no. 1. 1947 – MoMA, accessed on January 19, 2026, https://www.moma.org/collection/works/315486
- Blue Note: Where Jazz and Design Met | Domestika, accessed on January 19, 2026, https://www.domestika.org/en/blog/4893-blue-note-where-jazz-and-design-met
- 9 Fonts to Inspire Blue Note Typography – Unlimited Graphic Design Service – Penji, accessed on January 19, 2026, https://penji.co/fonts-to-inspire-blue-note-typography/
- Celebrating International Jazz Day with Reid Miles’ Blue Note Records typographic legacy, accessed on January 19, 2026, https://www.typeroom.eu/article/celebrating-international-jazz-day-reid-miles-blue-note-records-typographic-legacy
- accessed on January 19, 2026, https://www.soundoflife.com/blogs/design/storm-thogerson-album-covers-pink-floyd#:~:text=For%20Thorgerson%2C%20the%20refracting%20glass,in%20tune%20with%20the%20music.
- Album Art Tales: Behind Storm Thorgerson’s Art for Pink Floyd | Sound of Life, accessed on January 19, 2026, https://www.soundoflife.com/blogs/design/storm-thogerson-album-covers-pink-floyd
- Peter Saville on Capturing “Nowness” Through Design – Time Sensitive, accessed on January 19, 2026, https://timesensitive.fm/episode/peter-saville-on-capturing-nowness-through-design/
- The Peter Saville Effect – 10 Magazine, accessed on January 19, 2026, https://10magazine.com/the-peter-saville-effect/
- Cymatics in Art – By Fermin Fleites, accessed on January 19, 2026, https://ferminfleites.com/articles/cymatics-in-art/
- Cymatics: The Mathematic Art of Nature! – RidgeCrest Herbals, accessed on January 19, 2026, https://rcherbals.com/blogs/weird-wild-wondorous/cymatics-the-mathematic-art-of-nature
- Carsten Nicolai – Artist – SITE Santa Fe, accessed on January 19, 2026, https://www.sitesantafe.org/en/artists/carsten-nicolai/
- Carsten Nicolai – SOUNDINGS, accessed on January 19, 2026, https://www.moma.org/interactives/exhibitions/2013/soundings/artists/8/works/
- Ryoji Ikeda: Artist Overview – Almine Rech, accessed on January 19, 2026, https://www.alminerech.com/artists/411-ryoji-ikeda
- Ryoji Ikeda: data-verse – High Museum of Art, accessed on January 19, 2026, https://high.org/ryoji-ikeda-data-verse-brochure/
- WDCH Dreams: Relive the Full Epic Performance in HD! – YouTube, accessed on January 19, 2026, https://www.youtube.com/watch?v=FKfCrChDWpY
- WDCH Dreams | LA Phil, accessed on January 19, 2026, https://www.laphil.com/visit/when-youre-here/wdchdreams
- WDCH Dreams – Google Arts & Culture, accessed on January 19, 2026, https://artsandculture.google.com/story/wdch-dreams-laphil/WgUxh25RSGAtLg?hl=en
- Björk’s Biophilia app: a techie and a music fan write – The Guardian, accessed on January 19, 2026, https://www.theguardian.com/music/musicblog/2011/jul/20/bjork-biophilia-app
- On Bjork’s Biophilia: Music, Technology And Enchantment – brettworks, accessed on January 19, 2026, https://brettworks.com/2011/11/26/on-bjorks-biophilia-music-technology-and-enchantment/
- Canvas guidelines – Support – Spotify, accessed on January 19, 2026, https://support.spotify.com/us/artists/article/canvas-guidelines/
- Exploring Synesthetic Experience Through Virtual Reality Drawing – Psychology Today, accessed on January 19, 2026, https://www.psychologytoday.com/us/blog/mind-unseen/202508/exploring-synesthetic-experience-through-virtual-reality-drawing
- RMCAD Student Explores Synesthesia Through Virtual Reality, accessed on January 19, 2026, https://www.rmcad.edu/blog/rmcad-student-explores-synesthesia-through-virtual-reality/


