FPGA Central

I wonder why noone hasn't opened a thread for this incredible
breakthrough in DSP yet..




A guy from germany wrote an algorithm/software that is capable to
extract single notes (including the tone, e.g. the harmonic content)
from a multi-timbral recording and modify them in realtime.

In his software it is possible to alterate the pitch7volume of a single
tone even if multiple notes are playing at the same time.

If someone would have asked me two days ago if this could ever be
possible I would have said: NO, this is impossible.

This guy unscrambles scrambled eggs!

Listen/View it, and judge for yourself:

http://de.youtube.com/watch?v=jFCjv4_jqAY

Consider my pants shat! I'm sure I'm not the only one who can't beleave
this.

>I wonder why noone hasn't opened a thread for this incredible
>breakthrough in DSP yet..
>
>
>
>
>A guy from germany wrote an algorithm/software that is capable to
>extract single notes (including the tone, e.g. the harmonic content)
>from a multi-timbral recording and modify them in realtime.
>
>In his software it is possible to alterate the pitch7volume of a single
>tone even if multiple notes are playing at the same time.
>
>If someone would have asked me two days ago if this could ever be
>possible I would have said: NO, this is impossible.
>
>This guy unscrambles scrambled eggs!
>
>Listen/View it, and judge for yourself:
>
>http://de.youtube.com/watch?v=jFCjv4_jqAY
>
>Consider my pants shat! I'm sure I'm not the only one who can't beleave
>this.

Hi,

As impressive as it is, I wouldn't shit my pants.
In the 70s they separated Caruso from an orchestra.

The interface looks really convenient for what they are
doing. Anyway, It's an advertisement-clip on youtube .. so before
you have that thing in your own hands, I wouldn't draw
too many conclusions from that.

I don't want to diminish the work, nor the result of what
this guy has achieved. But segmentation in time and separation
of simultaneous events has been done before.
If we can trust the advertisement the quality and the
interface are really impressive.

It would be interesting to know the internals and
details of how the system does the separation and segmentation.
But since it isn't open-source, that might remain his secret for now.
So if you wonder why nobody has opened a thread about this,
what would you want to discuss about it, without knowing what
algorithms they use?

gr.
Bjoern

On Mar 14, 4:22 pm, Nils <n.pipenbri...@cubic.org> wrote:
....
> This guy unscrambles scrambled eggs!
>

the yolk may be separated into many little blobs of yellow, but they
are still distint from the white.

i seen of and heard of Melodyne. i think they were in EM magazine.
thought to myself that this might displace Serato and maybe a company
and product with which i had worked in the past. but i dunno.

i'm gonna try to run into them at the AES in October (i hope they'll
be there). i ain't making it to the European AES this spring.

r b-j

Hi,

> A guy from germany wrote an algorithm/software that is capable to extract
> single notes (including the tone, e.g. the harmonic content) from a
> multi-timbral recording and modify them in realtime.
> In his software it is possible to alterate the pitch7volume of a single
> tone even if multiple notes are playing at the same time.
>
> If someone would have asked me two days ago if this could ever be possible
> I would have said: NO, this is impossible.
>
> This guy unscrambles scrambled eggs!
>
> Listen/View it, and judge for yourself:
>
> http://de.youtube.com/watch?v=jFCjv4_jqAY
>
> Consider my pants shat! I'm sure I'm not the only one who can't beleave
> this.

Now people will think they can play anything randomly, then fix it with a
mouse afterwards! - Funny and sad at the same time.
Some questions / thoughts:-
That demo uses a simple straight playing of guitar notes, there's no
effects, bends, or vibrato etc.
If two instruments are playing the same note, can it separate them? Or for
that matter can it take a single voice out of a choir?
If a drum kit was playing with the guitar, could it pitch the guitar without
affecting the snare and toms etc?
I suspect there are also many dials and threshold tweaks the user has to do,
but I might be wrong. Anybody tried this software yet?

It's still an accomplished and world recognised piece of software, and I
wish the man and his beard all the success they deserve!! : )


VC

Nils wrote:

> http://de.youtube.com/watch?v=jFCjv4_jqAY

Don't get me wrong, but things don't happen because
they're on youtube...

I would wait some publication(s) and peer review(s)...

bye,

--

piergiorgio

>> http://de.youtube.com/watch?v=jFCjv4_jqAY
>
> Don't get me wrong, but things don't happen because
> they're on youtube...
>
> I would wait some publication(s) and peer review(s)...

Official site for video and info:-
http://www.celemony.com/cms/index.php?id=dna

VelociChicken wrote:

> Official site for video and info:-
> http://www.celemony.com/cms/index.php?id=dna

Have you tried the demo version?
I mean, it could be interesting to evaluate, if possible.

bye,

--

piergiorgio