Whispers of Blossoms
Intro:
Intro:
The project combines video, audio, and 3D graphics to create a cherry blossom experience, using sound and video to shape 3D blocks and add depth, inspired by I.M. Pei's Miho Museum.
The project combines video, audio, and 3D graphics to create a cherry blossom experience, using sound and video to shape 3D blocks and add depth, inspired by I.M. Pei's Miho Museum.
The project combines video, audio, and 3D graphics to create a cherry blossom experience, using sound and video to shape 3D blocks and add depth, inspired by I.M. Pei's Miho Museum.
Time: 2024
Time: 2024
Duration: 3 weeks
Duration: 3 weeks
Sound visualization
Inspiration
A "breathing facade" refers to a concept where the building's exterior surface is perforated with a pattern of holes or voids to create light and shadow, facilitating natural ventilation. This can be achieved through the parametric design of brick facades. Inspired by the rhythmic patterns in facade design, I want to create a 3d visualization of sound. The rhythms will be generated by mapping audio data to alter the motion of cubes in a matrix.
The visualization will create stacks of cubes with oscillating motion using the WebGL renderer.
A "breathing facade" refers to a concept where the building's exterior surface is perforated with a pattern of holes or voids to create light and shadow, facilitating natural ventilation. This can be achieved through the parametric design of brick facades. Inspired by the rhythmic patterns in facade design, I want to create a 3d visualization of sound. The rhythms will be generated by mapping audio data to alter the motion of cubes in a matrix.
The visualization will create stacks of cubes with oscillating motion using the WebGL renderer.
Experimentation
Controlling the rotation angle of a cube based on the amplitude of the sound at each moment
Controlling the rotation angle of a cube based on the amplitude of the sound at each moment
Controlling the transparency of a cube based on the proportion of the maximum frequency in sound FFT analysis at each moment
Controlling the transparency of a cube based on the proportion of the maximum frequency in sound FFT analysis at each moment
Creating an offset angle
Creating an offset angle
Using the function perspective to set up an orthographic projection of the cube
Using the function perspective to set up an orthographic projection of the cube
Shifting perspectives
Shifting perspectives
Set up dimensional lighting to create different shading of each face
Set up dimensional lighting to create different shading of each face
Ideation
Cherry blossoms at Miho Museum
Cherry blossoms at Miho Museum
The project combines video, audio, and 3D graphics to create a visual experience of seeing cherry blossoms. Both the video and audio will influence 3d graphic outcomes. Audio amplitude affects the canvas scale, creating a visually dynamic effect synchronized with the music. Video frame pixel data is used to color the blocks on the canvas, creating a visually engaging effect driven by video pixels. I tested using a video of cherry blossoms to create the blocks. I want to capture the falling of petals through the dynamic changes in blocks. The layout changes from a 2D facade into a square matrix with a portal in the middle. This sets up a one-point perspective and increases the space depth on a 2D canvas. I was inspired by the Miho museum designed by I.M. Pei, where there is a tunnel at the entrance. It leads the journey to the museum and guides visitors to a view of the cherry garden. The experience of passing through the tunnel is surprising as you can see the glimpse of pink on the tunnel's surface.
The project combines video, audio, and 3D graphics to create a visual experience of seeing cherry blossoms. Both the video and audio will influence 3d graphic outcomes. Audio amplitude affects the canvas scale, creating a visually dynamic effect synchronized with the music. Video frame pixel data is used to color the blocks on the canvas, creating a visually engaging effect driven by video pixels. I tested using a video of cherry blossoms to create the blocks. I want to capture the falling of petals through the dynamic changes in blocks. The layout changes from a 2D facade into a square matrix with a portal in the middle. This sets up a one-point perspective and increases the space depth on a 2D canvas. I was inspired by the Miho museum designed by I.M. Pei, where there is a tunnel at the entrance. It leads the journey to the museum and guides visitors to a view of the cherry garden. The experience of passing through the tunnel is surprising as you can see the glimpse of pink on the tunnel's surface.
© Jinlan Huang 2024
© Jinlan Huang 2024
© Jinlan Huang 2024