dylan604 3 days ago

I love the fact that TFA essentially re-created the functionality of an oscilloscope. Except, much more interesting to look at, and clearly shows an understanding of FFT math that I sometimes think I understand but then read stuff like this and remember I don't really.

Here's an example of using the O'scope: https://www.youtube.com/watch?v=19jv0HM92kw

akomtu 2 days ago

You can make an affordable sound visualizer out of a tea cup, used speaker, led light and duct tape. Attach the tea cup to the speaker, add some water, drop a submersible led light and turn on the speaker. The vibration will produce patterns on the water that will refract the light onto the ceiling. With a decent quality setup, you'll see a mesmerizing quality projection of a 3d shape. This trick is used by dolphins to encode visuals in sound, and I've seen a speculation that thoughts in your imagination have the same nature.

hprotagonist 3 days ago

I think i prefer spectrograms. Particularly for speech, where you can, after a while, almost read them.

  • jareklupinski 3 days ago

    I would love a small desktop spectrogram waterfall that shows the output from whatever I'm listening to at the time

    I did a few CTF challenges where I wouldn't have even thought to check the audio until I heard some uncharacteristic noise. Wonder what else people have buried...

peterhil 3 days ago

I have this exact same idea on my audio synthesis and DSP exploration project called Akasha, that I have developed on and off for more than 13 years. I have plans to open source at least parts of it, once I get to clean up the code. I was inspired by Julius O. Smith III's writings on DSP algorithms: https://ccrma.stanford.edu/~jos/

Unfortunately my web pages are not online, I have some video samples of Björk, Gotan Project and some classical and electronic music samples.

In the analytical audio signal, the musical intervals can sometimes be easily seen, and it is mesmerizing to look at.

On this video demo by OP, when the waveform appears stationary with loops, there are intervals in (at least close to) just intonation – meaning the frequencies have integer ratio relationships.

https://en.wikipedia.org/wiki/Just_intonation

khimaros 3 days ago

the code is open source. I did a but of work a few months back updating it and fixing compilation with rust stable toolchain: https://github.com/khimaros/audioscope

tbiehn 3 days ago

I wonder if the author had ever tried milkdrop before? Seems like the same type of thing. https://en.m.wikipedia.org/wiki/MilkDrop

  • creatonez 2 days ago

    Milkdrop is an open source reimplementation of the old-school WinAmp stuff, so it tends to have the same disappointing visualizations that don't match well.

    • IYasha 2 days ago

      Disappointing? What?? milkdrop is decades old, still works (while AVS crashes on startup) and has very good presets (altough editing is a world of wizardry).

      It's not really synesthetic, but, nonetheless, what DID you expect?

tobr 3 days ago

I found this mesmerizing. It conveys surprisingly many of the perceptual characteristics of the sound through visuals. Good demo music, too, but it makes me curious to see what it would do with vocals or acoustic music. Any other demos?

Not sure about the colors… they were hard to make sense of. And I wonder if it’s making use of stereo information at all.

  • Simran-B 3 days ago

    I'd also like to know how it visualizes other music. The song seems like it was crafted specifically for the demo, or at least I think that sometimes it's too good with the spirals sitting still - but it may as well just be the combination of this brilliant visualization and the sine waves of whatever signal.

smlacy 3 days ago

Interesting, and I'd love to see some more demos on "traditional" music (Symphonic/Orchestral, Jazz, Beatles, etc.). I'm sure the the highly synthetic and "pure" music used in the demo video sure leads to a fairly coherent visualization as compared to more natural/acoustic sources of sound.

Also, what about any stereo components? Capturing that in the visualization would also be nice.

drcongo 3 days ago

Possibly worth mentioning that this is from 2016.

asab 3 days ago
  • Jcowell 3 days ago

    Gives me the following error on an iPhone:

    “Sorry, there was an error: The request is not allowed by the user agent or the platform in the current context, possibly because the user denied permission.”

Acen 3 days ago

Ooh, intriguing.

I've been using Flux studio session analyser to visualise audio signals for mixing In-ear monitors for live audio[1] from my Cue mix.

Might write a quick dodgy thing to add this to my analysis stack. Could be cool.

[1] https://imgur.com/RFsV3d9

TomJansen 2 days ago

If one is interested in audio visualisations, you should check out Cycling74's Max MSP with Jitter. That program has huge capabilities in making these things!

greenbit 3 days ago

Would like to feed this voice samples, cat's meows, birdsongs, and laughter. Maybe the same voice in different emotional states. Looks fun to play around with.

bwestergard 3 days ago

Love this. Many hardware oscilloscopes can (and were) configured to do this in polar plotting mode.

  • atoav 3 days ago

    Not the same, although the resulting shspes might look similar, a Lissajous pattern displays both channels of a stereo signal as X/Y. That means independent of what is going on if you send it a mono signal, you will just see a 45 degree line — totally independent of the frequencies contained in the audio.

    This uses FFT to draw circles and makes the harmonics/frequencies visible.

IYasha 2 days ago

Need winamp plug-ins!