Embedded Files
Mohamed Amin Hammami. Computer Department, Imam Abdulrahman Bin Faisal University. Dammam, KSA mahammami@iau.edu.sa
Christophe Claramunt. Naval Academy Research Institute. Brest Naval, 29240, France (website) christophe.claramunt@ecole-navale.fr
Production process (Figure 1):
For the success and efficiency of the experiment, the spatial directions of the 360 camera and the ambisonic recorder must be spatially calibrated and have a timecode for synchronization: Ambisonic sound / 360 video
The plugin O3A Flare screen applies a rectangular area which shows us a spherical surface spread over a surface with the specification of the actual directions (i.e., left, right, above, below, front, ba and ck for back) .
The peculiarity of these displays is that it shows us the direction of the sound but also its frequency as well as its amplitude.
The peculiarity of the 360 video and 3D ambisonic sound recording is that whatever the camera angle, the whole soundscape is recorded, then sound visualizations can be interactively navigated through. In fact, for each recording location a first angle of view is suggested according to the path of the recorder, but the strength of this method is the “freedom” to scale up in all directions in the 3D space (sounds, videos).
This plugin uses simple first order estimates of the predominant sound direction in a range of frequency bands. Note that some color coding has been implemented. The frequency color coding is as follows:
From red to magenta as 20 Hz to 20 KHz.
This method keeps the background grids and orientations visible during the video analysis, and by cross-comparing it with some acoustic camera (Figure 2)
Regarding the videos shown below the audio is converted in binaural format to let the users perceive the spatial sound in 2 channels.
Figure 1 : the production process
Figure 2 : O3A Flare with grids
Figure 3 : Analysis from Ambisonic Recording and 360 video - "La Fontaine"
Figure 3 : Analysis from Ambisonic Recording and 360 video - "La Fontaine"
Beginning of the day
Figure 4a : Analysis from Ambisonic Recording and 360 video - "Cafe Sidi Amor"
Figure 4a : Analysis from Ambisonic Recording and 360 video - "Cafe Sidi Amor"
End of the day
Figure 4b : Animated version - analysis from Ambisonic Recording and 360 video - "Cafe Sidi Amor"
Figure 4b : Animated version - analysis from Ambisonic Recording and 360 video - "Cafe Sidi Amor"
End of the day
Video 1 : 3D spatial soundscape
Video 1 : 3D spatial soundscape
Interactive navigation simulation from the user point of view
[to see the video better, set the quality of the youtube video to HD] (Best full screen)
3D Sound Analysis Demonstration
[to see the video better, set the quality of the youtube video to HD] (Best full screen)
For a best experience, please use headphones.
(the sound has been converted from ambisonic to binaural format to feel the spatiality of the sound)
Video 2 : Video 360 And Ambisonic Recording
Video 2 : Video 360 And Ambisonic Recording
Immersive Analysis
Immersive Analysis
Café Sidi Amor - Day
Video 3 : Video 360 And Ambisonic Recording
Video 3 : Video 360 And Ambisonic Recording
Panoramic Analysis
Panoramic Analysis
Café Sidi Amor - Day
[to see the video better, set the quality of the youtube video to HD] (Best full screen)
Video 4 :Video 360 And Ambisonic Recording
Video 4 :Video 360 And Ambisonic Recording
Immersive Analysis
Immersive Analysis
Between Cafe Sidi Amor and Cafe Chargui - by night
Video 5 :Video 360 And Ambisonic Recording
Video 5 :Video 360 And Ambisonic Recording
Panoramic Analysis
Panoramic Analysis
Between Cafe Sidi Amor and Cafe Chargui - by night
[to see the video better, set the quality of the youtube video to HD] (Best full screen)
Page updated
Google Sites
Report abuse