
Figure 1
Illustration of Bleedless and Fullness metrics. Blue represents what disappeared from the predicted stem compared to the original: the more blue there is, the worse the Fullness metric. Red represents what appeared as extra compared to the original stem signal (bleed from the other stems): the more red there is, the lower the Bleedless value.
Table 1
Selected models and their SDR scores for instrumental and vocal separation on the Multisong MVSep dataset.
| Model and Description | SDR Instr. | SDR Vocal |
|---|---|---|
| Sami‑bytedance‑v.1.1, private model | 18.13 | 11.82 |
| Ensemble: SCNet XL + BS‑Roformer + MelBand Roformer | 17.92 | 11.62 |
| BS‑Roformer (by MVSep) | 17.62 | 11.31 |
| MelBand Roformer (by Bas Curtiz) | 17.55 | 11.24 |
| MelBand Roformer (by Kimberley Jensen) | 17.32 | 11.01 |
| BS‑Roformer (by viperx) | Overlap 2 | dim_t 1101 | 17.28 | 10.97 |
| SCNet XL | 17.27 | 10.96 |
| SCNet Large | 17.05 | 10.74 |
| SCNet Small | 16.56 | 10.25 |
| VitLarge23 | 16.09 | 9.78 |
| ZFTurbo algorithm from MDX23 competition | 15.82 | 9.56 |
| MDX‑Net (by Kimberley Jensen). Predict vocals part (FFT: 7680) | 15.70 | 9.36 |
| MDX: UVR‑MDX‑NET_Main_427 (by UVR team). Predict vocals part (FFT: 6144) | 15.61 | 9.32 |
| MDX: UVR‑MDX‑NET Inst HQ 2 (by UVR team). Predict instrumental part (FFT: 6144) | 15.22 | 9.11 |
| Demucs4 HT algorithm trained on 800 songs, fine‑tuned for each stem | 14.73 | 8.42 |
| Demucs3 algorithm trained on 800 songs | 14.54 | 8.24 |
| Demucs4 HT algorithm trained on 800 songs, tuned for average SDR for 4 stems | 14.49 | 8.18 |
| Demucs4 HT, 6 stems (additional piano and guitar) | 14.48 | 8.17 |
| Demucs3 Model B, winning algorithm from MDX21 competition | 14.44 | 8.13 |
| UVR vocal models, 0_HP2‑4BAND‑3090_4band_arch‑500m_1 | 13.59 | 7.28 |
Table 2
Selected models and their SDR metrics for bass, drums, and other separation on the Multisong MVSep dataset.
| Model and Description | SDR Bass | SDR Drums | SDR Other |
|---|---|---|---|
| Ensemble: SCNet XL + MelBand Roformer + BS‑Roformer | 14.14 | 13.57 | 8.10 |
| SCNet XL | 13.81 | 13.42 | 7.22 |
| Sami‑bytedance‑v.1.1, private model | 13.74 | 13.52 | 6.92 |
| SCNet Large | — | 13.01 | — |
| ZFTurbo algorithm from MDX23 competition | 12.50 | 11.70 | 6.63 |
| BS‑Roformer | 12.49 | 12.82 | — |
| MelBand Roformer | — | 12.53 | — |
| Demucs4 HT (fine‑tuned by MVSep) | 12.52 | 12.04 | — |
| Demucs4 HT algorithm trained on 800 songs, fine‑tuned for each stem (shifts = 10, overlap = 0.95) | 12.24 | 11.41 | 5.84 |
| Demucs4 HT algorithm, fine‑tuned for each stem; (shifts = 1, overlap = 0.95) 10 times faster than the previous | 12.24 | 11.40 | 5.84 |
| Demucs4 HT algorithm trained on 800 songs, tuned for average SDR for 4 stems | 11.74 | 10.90 | 5.57 |
| Demucs4 HT, 6 stems (additional piano and guitar) | 11.42 | 10.59 | — |
| Demucs3 algorithm trained on 800 songs | 11.25 | 10.76 | 5.50 |
| Demucs3 Model B, MDX21 competition winner | 10.69 | 10.27 | 5.35 |
Table 3
SDR performance (dB) of selected models trained on MUSDB18‑HQ (100 songs) and evaluated on the MUSDB18 test set and the Multisong MVSep benchmark.
| Model and Description | MUSDB18 Test | Multisong MVSep | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Avg | Bass | Drums | Vocals | Other | Avg | Bass | Drums | Vocals | Other | |
| MDX23C1 | 7.15 | 5.77 | 7.93 | 9.23 | 5.68 | 7.02 | 8.40 | 7.73 | 7.36 | 4.57 |
| SCNet Small (by starrytong)2 | 9.03 | 8.89 | 10.44 | 9.90 | 6.89 | 8.87 | 11.07 | 10.79 | 8.27 | 5.34 |
| SCNet Masked Small1 | 8.81 | 8.32 | 10.48 | 10.05 | 6.40 | 8.86 | 11.00 | 10.57 | 8.35 | 5.51 |
| SCNet Large1 | 9.32 | 8.63 | 10.89 | 10.69 | 7.06 | 9.19 | 11.15 | 11.04 | 8.94 | 5.62 |
| SCNet Large (by starrytong)2 | 9.70 | 9.38 | 11.15 | 10.94 | 7.31 | 9.28 | 11.27 | 11.23 | 9.05 | 5.57 |
| SCNet XL1 | 9.80 | 9.23 | 11.51 | 11.05 | 7.41 | 9.72 | 11.87 | 11.49 | 9.32 | 6.19 |
| SCNet XL IHF1 | 10.08 | 9.23 | 11.81 | 11.42 | 7.88 | 9.92 | 11.94 | 11.58 | 9.68 | 6.48 |
| SCNet Masked XL IHF1 | 9.82 | 8.91 | 11.62 | 11.06 | 7.70 | 9.67 | 11.57 | 11.38 | 9.43 | 6.30 |
| BS‑Roformer1 | 9.65 | 8.48 | 11.61 | 11.08 | 7.44 | 9.38 | 11.08 | 11.29 | 9.19 | 5.96 |
Table 4
Selected models and their SDR metrics on the Guitar MVSep dataset.
| Model and Description | SDR |
|---|---|
| Sami‑bytedance‑v.1.1, private model | 8.27 |
| Ensemble: BS‑Roformer + MelBand Roformer | 7.51 |
| Ensemble: MDX23C + MelBand Roformer | 7.18 |
| BS‑Roformer (by viperx) | 7.12 |
| MelBand Roformer (by MVSep) | 7.02 |
| MelBand Roformer (by viperx) | 6.85 |
| MDX23C | 6.34 |
| Demucs4 HT, 6 stems | 5.24 |
Table 5
Selected models and their performance metrics on the Piano MVSep dataset.
| Model and Description | SDR | L1Freq | AuraMRSTFT |
|---|---|---|---|
| Sami‑bytedance‑v.1.1, private model | 7.30 | 56.65 | 6.04 |
| Ensemble: SCNet + MelBand Roformer | 6.20 | 52.45 | 6.75 |
| SCNet Large | 5.89 | 51.56 | 6.66 |
| MelBand Roformer (by viperx) | 5.71 | 52.51 | 5.15 |
| MDX23C | 5.59 | 51.90 | 6.81 |
| Demucs4 HT, 6 stems | 2.23 | 41.21 | 3.69 |
Table 6
Selected models and their performance metrics on the Bowed Strings MVSep dataset.
| Model and Description | SDR | L1Freq | AuraMRSTFT |
|---|---|---|---|
| Sami‑bytedance‑v.1.1, private model | 4.25 | 44.62 | 5.32 |
| MDX23C | 3.84 | 42.79 | 6.18 |
| UVR Online Strings model (based on MelBand Roformer) | 2.86 | 39.98 | 4.12 |
Table 7
Selected models and their performance metrics on the Wind MVSep benchmark.
| Model and Description | SDR | L1Freq | AuraMRSTFT |
|---|---|---|---|
| Sami‑bytedance‑v.1.1, private model | 7.54 | 55.28 | 5.77 |
| SCNet Large | 6.76 | 51.95 | 6.31 |
| MelBand Roformer (by MVSep) | 6.73 | 52.95 | 5.32 |
| X‑Minus Wind (MelBand Roformer) | 2.51 | 41.78 | 3.62 |
Table 8
Selected models and their SDR metrics for drum components separation.
| Model and Description | SDR | |||||
|---|---|---|---|---|---|---|
| Kick | Snare | Toms | hh | Cymbals | hh‑Cymbals | |
| SCNet XL, 5 stems (by MVSep) | 17.89 | 12.56 | 14.14 | 3.63 | 6.15 | 7.38 |
| SCNet XL, 6 stems (by MVSep) | 17.74 | 12.43 | 14.24 | 3.39 | 5.91 | 7.19 |
| SCNet XL, 4 stems (by MVSep) | 17.61 | 12.37 | 13.40 | — | — | 7.48 |
| MelBand Roformer, 6 stems (by MVSep) | 17.46 | 12.64 | 13.69 | 5.05 | 7.06 | 7.91 |
| MelBand Roformer, 4 stems (by MVSep) | 16.85 | 12.49 | 13.55 | — | — | 8.47 |
| MDX23C, 5 stems (high fullness version) | 16.50 | 11.40 | 12.07 | 3.93 | 6.27 | — |
| MDX23C, 6 stems (by aufr33 and jarredou) | 14.54 | 9.79 | 10.63 | 3.19 | 6.08 | 6.76 |
| Demucs4 H, 4 stems (by inagoy) | 10.52 | 6.05 | 4.68 | — | — | 5.03 |
Table 9
Vocals and instrumental separation performance on the Multisong MVSep dataset, reporting Fullness, Bleedless, and SDR metrics. The Tune column indicates whether the model was tuned to favor the instrumental or vocal stem; ‘—’ denotes balanced models or unknown tuning.
| Model Name | Arch. | Tune | Vocals | Instrumental | ||||
|---|---|---|---|---|---|---|---|---|
| Fullness | Bleedless | SDR | Fullness | Bleedless | SDR | |||
| Kimberley Jensen1 | MelBand | — | 16.66 | 36.51 | 11.01 | 27.71 | 46.72 | 17.32 |
| Bas Curtiz edition | MelBand | — | 16.30 | 38.94 | 11.18 | 27.49 | 47.00 | 17.49 |
| MVSep (ver. 2024.10) | MelBand | — | 16.92 | 37.78 | 11.28 | 27.71 | 47.29 | 17.59 |
| Unwa v1e2 | MelBand | instr. | 14.67 | 26.83 | 10.06 | 38.85 | 35.68 | 16.37 |
| Unwa big beta v5e3 | MelBand | voc. | 20.78 | 32.02 | 10.59 | 25.65 | 45.90 | 16.90 |
| Becruily instrum4 | MelBand | instr. | 15.76 | 30.15 | 10.16 | 33.93 | 40.55 | 16.47 |
| Becruily vocals5 | MelBand | voc. | 20.72 | 31.25 | 10.55 | 28.28 | 40.85 | 16.86 |
| Gabox v10 flowers6 | MelBand | instr. | 15.85 | 25.36 | 10.66 | 37.69 | 36.34 | 16.97 |
| Becruily deux7 | MelBand | — | 22.81 | 29.78 | 11.35 | 33.41 | 42.11 | 17.51 |
| Unwa high instrum fullness8 | BS‑Roformer | instr. | 15.85 | 24.29 | 10.94 | 34.72 | 40.43 | 17.25 |
| Unwa HyperACE v2 instr9 | BS‑Roformer | instr. | 14.81 | 33.02 | 11.09 | 37.95 | 37.97 | 17.40 |
| Unwa HyperACE v2 vocals9 | BS‑Roformer | voc. | 19.07 | 34.12 | 11.39 | 27.31 | 45.48 | 17.70 |
| MVSep (ver. 2025.07) | BS‑Roformer | — | 17.23 | 38.24 | 11.89 | 27.82 | 49.12 | 18.20 |
| MVSep SCNet XL | SCNet | — | 17.96 | 26.95 | 10.96 | 28.74 | 39.42 | 17.27 |
| MVSep SCNet XL (high fullness) | SCNet | — | 23.50 | 25.30 | 10.40 | 34.04 | 35.15 | 16.60 |
| MVSep SCNet XL IHF | SCNet | — | 17.98 | 28.31 | 11.11 | 28.87 | 40.37 | 17.41 |
| Becruily SCNet XL IHF | SCNet | instr. | 22.70 | 25.48 | 10.89 | 32.31 | 38.15 | 17.20 |
Model sources:
1https://github.com/KimberleyJensen/Mel-Band-Roformer-Vocal-Model
2https://huggingface.co/pcunwa/Mel-Band-Roformer-Inst
3https://huggingface.co/pcunwa/Mel-Band-Roformer-big
4https://huggingface.co/becruily/mel-band-roformer-instrumental
5https://huggingface.co/becruily/mel-band-roformer-vocals
6https://huggingface.co/GaboxR67/MelBandRoformers/tree/main/melbandroformers/instrumental
7https://huggingface.co/becruily/mel-band-roformer-deux
Table 10
Spearman correlation between objective metric differences and collective listener preference, by stem ( pairs per stem).
| Listening Question | Metric | Vocals: [95% CI] | Instrumental: [95% CI] |
|---|---|---|---|
| Which separation is better overall? | SDR | [, ] | [, ] |
| L1Freq | [, ] | [, ] | |
| Bleedless | [, ] | [, ] | |
| Fullness | [, ] | [, ] | |
| Which has fuller stem? | Bleedless | [, ] | [, ] |
| Fullness | [, ] | [, ] | |
| Which has less bleed from the other stem? | Bleedless | [, ] | [, ] |
| Fullness | [, ] | [, ] | |
| Which has fewer artifacts? | SDR | [, ] | [, ] |
| L1Freq | [, ] | [, ] | |
| Bleedless | [, ] | [, ] | |
| Fullness | [, +0.33] | +0.03 [, +0.49] |