IEEE : HV-MOTS Matching
Introduction
Audio datasets
- MuscleFish
- Freesound
Statistical significance
Classification results
- General results
- Features combinations
Features analysis
- Summary
- Details
Robustness tests

IEEE : HV-MOTS Matching

This is the supporting webpage on MOTS matching :

Esling Philippe, Agon Carlos "Multiobjective time series matching for audio classification and retrieval", IEEE Transactions on Speech Audio and Language Processing 2012 (in review).

We provide in this page detailed informations about the results of MultiObjective Time Series (MOTS) matching. More informations about the MOTS paradigm can be found in the article and on a related page which presents the MultiObjective Time Series approach. Another page of this website also presents more information about the sound sample database application along with a demonstration of an iPad interface which implements the approaches explained in the article.

Introduction

Audio datasets : Both datasets used in our study are available for download so that our experiments are fully reproducible. These datasets are available either as sound files and Matlab (.MAT) files. The MAT files contains an organized structure of the results from our spectral descriptors analysis.

Statistical significance : This section provides extended results of statistical significance tests over both datasets. We separate the evaluation depending on the best and mean classification accuracies. The statistical tests are performed through a Tukey-Kramer HSD based on the results of Friedman's ANOVA.

Classification results : This section provides extended classification results for our approach. General results exhibit the various classification accuracies for different sets and features combinations provide an extended list of best features set for each level of analysis.

Features analysis provide an extended list of feature-by-feature discriminative power. We have only listed here the features which were selected after bi-objective combinations, ie. the feature which were used from three to more objectives classification (half of the complete feature set).

Robustness tests provides more detailed results of each algorithm for various distortion classes. First the table for increasing objectives gives classification accuracies for each distortion. Then, complete figures gives an overview of the robustness for each method.

Audio datasets

This section contains the downloadable archives of both datasets used in the paper. For each dataset, two archives are available. The first contains the original sound files. The second contains the results of the spectral analysis module in Matlab (.MAT) format. The features file contains a structure named data which contains the name, class, sampleID and features structure. The features structure contains every descriptor listed in the paper in matrix format (nbDimensions x nbTimePoints). The corresponding descriptor are the raw values obtained from IRCAMDescriptor.

MuscleFish

Sound files (5.5Mb) - Contains the original dataset of 409 Sun/Next (.au) files divided in 16 classes.
Spectral features (121Mb) - Results of the spectral analysis of IRCAM descriptor for the entire dataset

This dataset was originally assembled for the following paper : E. Wold, T. Blum, D. Keislar, and J. Wheaten, “Content-based classification, search, and retrieval of audio,” Multimedia, IEEE, vol. 3, no. 3, pp. 27–36, 1996. All rights for thee sounds belong to the MuscleFish company.

We would like to express our thanks to Erling Wold and Thom Blum for their kind help on retrieving these sounds and allowing us to upload the dataset on this supporting webpage.

Freesound

Sound files (Warning : 1.3Gb) - Contains the dataset of 2193 sound files divided in 54 classes collected specifically for our study.
Feature files (Warning : 645.9Mb) - Spectral analysis files of the Freesound dataset

Most of the sounds in this dataset were retrieved from the Freesound project and, therefore, respective credits should be given to different users :

applause : HQ Applause (by Recordinghopkins), Applause (by Rhumphries) and Polite applause (by Joedeshon).
birds : Bird (by Hardpcm) and Bird sounds (by Tigersound)
cat : Animals (by Noisecollector), BL_Cat (by Department64) and Siamese cat (by Freemaster2)
crash : HQ-Cymbals (by Ltibbits) and Sabian percussions (by Robinhood76)
dog : Animals (by Noisecollector) and Dogs (by Robinhood76)
drum-loops : Amen breaks (by Vexst) and Music loops (by Yewbic)
female : Phone (by Noisecollector) and Woodio (by Corsica-s)
footsteps : Footsteps (by Soundmary), Footsteps (by Ragamuffin), Footsteps (by Corsica-s), Footsteps (by Rutgermuller)
glockenspiel : Glockenspiel (by Angstrom)
guitar-distorted : Distorted (by Speedy) and Distorted guitars (by Koen)
gunshot : Gunshot (by Cyberkineticfilms), Layered gunshots (by Xenonn) and War and battles (by Robinhood76)
hi-hats : HQ-Cymbals (by Ltibbits), Hi-hats (by Walter-odington), Real hi-hats (by Sandyrb) and Sabian percussion (by Robinhood76)
indian-santoor : Indian santoor (by Batchku)
indian-tabla : Tabla & Baya (by Loofa)
indian-tambura : Indian tambura (by Loofa)
indian-thumb-piano : Indonesian thumb piano (by Madjad)
kick : Kick drums (by Walter-odington), Hybrid kicks (by Sandyrb) and Derek murphy kicks (by Robbiesurp)
laughter : Laughter (by Hanstimm) and Funny voices (by Robinhood76)
male : Web design (by Robinhood76) and Voices (by Alphahog)
musicbox : Toy record (by Tombola)
paper : Paper book (by Koops)
reese : Access virus C (by Harha), Tearing neurofunk (by Hardwareshaba) and CyanVdist-Reese (by Tenchu)
robotic : Strange talk (by Puniho)
scratching : Turntablism (by Junggle)
screams : Screams and pain (by Thanvannispen) and Weird male screams (by Plagasul)
singing-bowls : Singing bowls (by Hanstimm)
siren : Sirens and alarms (by guitarguy1985) and Siren synth (by Radian)
snare : 909 Snares (by Crispydinner)and Derek Murphy Snares (by Robbiesurp)
subway : London underground (by Wim) and Trains & Subways (by Rhumphries)
sword : Sword (by Lostchocolatelab)
tb303 : Acid (by Djgriffin), 303 me (by Sleep), x0xb0x (by Laban), TB-303 loops (by Kara) and TB-303 Bass (by Pitmusic)
telephone : Telephone (by Soundplusdesign)
thunder : Thunder storm (by Speedy), Nature (by Erdie) and 24-bit Thunder (by Nednedberd)
toms : Processed toms (by Sandyrb)
tone-drum : Tone drum (by Patchen)
vocoder : 100 most common words (by Harri), Vocoder (by Hanstimm)
water : Water (by Robinhood76), Water splash (by Agfx) and Water (by Anton)
whistle : Sheepdog (by Benboncan) and Slide whistle (by Joedeshon)
wobble : Dubstep (by Mikobuntu), Wobble basses (by Dirtyjewbs) and B8 Wobbly Bass (by Ongitak)
zipper : Zipper-anechoic (by Anton)

All the instrumental sounds are part of IRCAM's Studio On Line (SOL) sound database.

Statistical significance

This section provides extended results of statistical significance tests over both datasets. We separate the evaluation depending on the mean classification accuracies. The statistical tests are performed through three different procedures for each level (number of features involved in the classification). First, a Tukey-Kramer HSD based on the results of Friedman's ANOVA allows to see the mean column rank of each method. The second provides the statistical mean accuracy for each method depending on the current number of dimensions involved. Finally, the critical difference graphs allows to discriminate the methods and group them into equivalent clique if their results are statistically equivalent.

Classification results

General results

Global results


	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____	______	7_____	______	8_____	______	9_____
1-NN	20.91	76.53	36.88	85.64	54.02	89.53	72.38	90.51	83.75	90.95	87.02	89.98	87.79	90.22	88.48	90.22	88.53	89.98
5-NN	22.83	72.86	37.59	85.33	52.92	86.31	70.06	87.04	80.17	88.26	82.31	85.58	82.76	85.09	82.94	84.60	82.93	84.60
MOTS	20.91	76.53	41.87	85.09	57.85	83.37	66.22	81.91	71.63	81.66	74.65	78.73	73.11	76.53	71.67	72.86	71.54	72.86
HV-MOTS	20.91	76.53	43.77	90.22	63.36	92.91	80.07	93.64	86.80	94.38	91.62	93.64	91.97	93.89	92.15	92.91	92.10	92.91

Category results

Mixed


	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____	______	7_____	______	8_____	______	9_____
1-NN	20.70	76.53	36.30	85.64	53.24	89.53	72.43	90.51	83.77	90.95	87.03	89.98	87.79	90.22	88.48	90.22	89.00	89.00
5-NN	22.83	72.86	36.64	85.33	51.99	86.31	70.03	87.04	80.19	88.26	82.31	85.58	82.76	85.09	82.94	84.60	82.88	82.88
MOTS	20.91	76.53	41.80	84.60	57.69	83.37	66.51	81.91	71.64	81.66	74.68	78.73	73.11	76.53	71.67	72.86	70.42	70.42
HV-MOTS	20.61	76.53	43.59	90.22	63.04	92.91	80.47	93.64	86.82	94.38	91.65	93.64	91.97	93.89	92.15	92.91	91.69	91.69

Temporal


	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____	______	7_____	______	8_____	______	9_____
1-NN	30.13	76.53	36.82	85.64	53.72	89.53	66.49	90.51	71.69	90.95	74.89	89.98	73.63	90.22	73.64	90.22	81.05	89.00
5-NN	30.74	72.86	36.95	85.33	52.44	86.31	69.88	87.04	80.15	88.26	82.31	85.58	82.76	85.09	82.94	84.60	82.88	82.88
MOTS	30.17	76.53	41.55	85.09	57.36	83.37	66.49	81.91	71.69	81.66	74.68	78.73	73.11	76.53	71.67	72.86	70.42	70.42
HV-MOTS	30.08	76.53	41.55	90.22	57.36	92.91	72.33	93.64	83.75	94.38	87.03	93.64	87.79	93.89	88.48	92.91	89.00	91.69

Static


	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____
1-NN	22.22	72.62	37.83	84.35	57.30	86.80	72.57	87.29	82.82	86.55	86.31	86.31
5-NN	25.89	68.46	40.00	81.17	57.42	82.40	70.79	86.31	79.37	84.60	82.15	82.15
MOTS	22.60	72.62	43.47	83.37	59.73	80.93	64.73	79.22	70.42	76.28	72.37	72.37
HV-MOTS	22.04	72.62	45.08	85.33	65.24	89.00	78.06	91.44	85.65	90.22	89.00	89.00

Mean


	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____
1-NN	24.01	72.62	36.99	82.88	57.06	84.11	69.29	83.86	82.88	82.88
5-NN	27.75	68.46	38.95	78.00	56.47	78.73	66.54	79.71	76.77	76.77
MOTS	24.52	72.62	42.48	78.97	60.29	80.44	64.16	76.04	71.39	71.39
HV-MOTS	23.85	72.62	43.86	85.09	66.18	88.26	76.67	89.73	82.15	82.15

Deviation


	______	1_____	______	2_____	______	3_____	______	4_____
1-NN	20.43	67.73	37.72	74.33	56.14	79.46	73.70	81.91
5-NN	24.04	67.73	39.95	75.55	56.85	78.00	72.61	80.44
MOTS	20.68	67.73	43.58	73.35	57.76	75.55	66.17	72.62
HV-MOTS	20.22	67.73	45.28	76.53	61.94	79.95	76.09	82.15

Features combinations

1 features


__	1-NN _____________________________________________________________________________________________________________________	Score
1	MFCC	76.53
2	MFCCMean	75.55
3	BandRoughness	74.82
4	DMFCCMean	69.93
5	BandFluctuationStrength	69.19


__	5-NN _____________________________________________________________________________________________________________________	Score
1	MFCC	72.86
2	MFCCMean	68.46
3	BandRoughness	68.22
4	BandFluctuationStrength	67.73
5	DMFCCMean	66.75


__	MOTS ____________________________________________________________________________________________________________________	Score
1	MFCC	76.53
2	MFCCMean	75.55
3	BandRoughness	74.82
4	DMFCCMean	69.93
5	BandFluctuationStrength	69.19


__	HV-MOTS .________________________________________________________________________________________________________________	Score
1	MFCC	76.53
2	MFCCMean	75.55
3	BandRoughness	74.82
4	DMFCCMean	69.93
5	BandFluctuationStrength	69.19

2 features


__	1-NN _____________________________________________________________________________________________________________________	Score
1	MFCC - duration	85.46
2	MFCC - MFCCStdDev	85.09
3	MFCC - DMFCCStdDev	83.37
4	MFCC - BandRoughness	81.91
5	MFCC - EnergyEnvelopeTString	81.66


__	5-NN _____________________________________________________________________________________________________________________	Score
1	MFCC, duration	85.33
2	MFCC, MFCCStdDev	84.11
3	MFCC, BandRoughness	82.15
4	MFCC, LoudnessTString	81.66
5	MFCC, SignalAutoCorrelationStdDev	81.66


__	MOTS ____________________________________________________________________________________________________________________	Score
1	MFCC, BandRoughness	85.09
2	MFCCMean, BandRoughness	84.60
3	MFCCMean, MFCCStdDev	83.37
4	BandRoughness, RelativeSpecificLoudnessStdDev	83.13
5	MFCC, MFCCMean	82.64


__	HV-MOTS .________________________________________________________________________________________________________________	Score
1	MFCCMean, BandRoughness	90.22
2	MFCC, BandRoughness	89.73
3	MFCC, DDMFCCStdDev	89.73
4	MFCC, duration	89.49
5	MFCC, DMFCCStdDev	88.51

3 features


__	1-NN _____________________________________________________________________________________________________________________	Score
1	MFCC - BandRoughness - duration	89.53
2	MFCC - duration - HarmonicTristimulusStdDev	89.00
3	MFCC - BandRoughness - MFCCStdDev	88.26
4	MFCC - DMFCCStdDev - duration	88.26
5	MFCC - duration - PerceptualTristimulusStdDev	88.26


__	5-NN _____________________________________________________________________________________________________________________	Score
1	MFCC, MFCCStdDev, duration	86.31
2	MFCC, DMFCCStdDev, duration	86.31
3	MFCC, DDMFCCStdDev, duration	86.31
4	MFCC, duration, MFCCMean	86.31
5	MFCC, RelativeSpecificLoudnessStdDev, duration	85.82


__	MOTS ____________________________________________________________________________________________________________________	Score
1	MFCC, MFCCMean, BandRoughness	83.37
2	MFCC, BandRoughness, BandFluctuationStrength	82.88
3	MFCC, RelativeSpecificLoudnessMean, PerceptualTristimulus	82.88
4	MFCC, BandFluctuationStrength, MFCCStdDev	82.64
5	BandRoughness, RelativeSpecificLoudnessMean, DMFCCMean	82.40


__	HV-MOTS .________________________________________________________________________________________________________________	Score
1	MFCC, BandRoughness, duration	92.91
2	MFCC, MFCCMean, BandRoughness	92.42
3	MFCCMean, BandRoughness, duration	92.42
4	MFCC, BandRoughness, PerceptualSpectralVariationMean	92.18
5	MFCC, BandRoughness, SpectralFlatnessStdDev	91.93

4 features


__	1-NN _____________________________________________________________________________________________________________________	Score
1	MFCC - BandRoughness - SpectralFlatnessMean - duration	90.51
2	MFCC - BandRoughness - SpectralFlatness - duration	90.22
3	MFCC - BandRoughness - BandFluctuationStrength - duration	89.98
4	MFCC - BandRoughness - SpectralFlatnessStdDev - duration	89.98
5	MFCC - BandRoughness - RelativeSpecificLoudnessStdDev - duration	89.98


__	5-NN _____________________________________________________________________________________________________________________	Score
1	MFCC, BandRoughness, MFCCStdDev, duration	87.04
2	MFCC, MFCCStdDev, duration, SignalAutoCorrelationStdDev	87.04
3	BandRoughness, BandFluctuationStrength, SpectralFlatness, DDMFCCStdDev	87.04
4	MFCC, BandFluctuationStrength, duration, MFCCMean	86.80
5	MFCC, MFCCStdDev, duration, SignalAutoCorrelationMean	86.80


__	MOTS ____________________________________________________________________________________________________________________	Score
1	MFCC, BandRoughness, SpectralFlatnessStdDev, MFCCStdDev	81.91
2	MFCC, BandRoughness, MFCCMean, PerceptualTristimulus	81.42
3	MFCC, BandRoughness, DMFCCMean, MFCCStdDev	81.42
4	MFCC, MFCCMean, RelativeSpecificLoudnessMean, PerceptualTristimulus	81.42
5	BandRoughness, RelativeSpecificLoudnessMean, RelativeSpecificLoudness, DMFCCMean	81.42


__	HV-MOTS .________________________________________________________________________________________________________________	Score
1	MFCC, BandRoughness, DMFCCStdDev, duration	93.64
2	MFCC, BandRoughness, SpectralFlatnessMean, DDMFCCStdDev	93.40
3	MFCC, BandRoughness, MFCCMean, SpectralFlatnessStdDev	93.15
4	MFCC, BandRoughness, MFCCMean, duration	93.15
5	MFCC, BandRoughness, DMFCCMean, duration	93.15

5 features


__	1-NN _____________________________________________________________________________________________________________________	Score
1	BandRoughness - MFCC - SpectralFlatnessMean - duration - SpectralVariationMean	90.95
2	BandRoughness - MFCC - SpectralFlatness - SpectralFlatnessMean - duration	90.95
3	BandRoughness - MFCC - DMFCCMean - SpectralFlatnessMean - duration	90.95
4	BandRoughness - MFCC - SpectralFlatnessStdDev - SpectralFlatnessMean - duration	90.95
5	BandRoughness - MFCC - duration - DMFCCStdDev - SpectralVariationMean	90.51


__	5-NN _____________________________________________________________________________________________________________________	Score
1	BandRoughness, SpectralFlatnessMean, duration, DMFCCStdDev, SpectralVariationMean	88.26
2	BandRoughness, SpectralFlatnessStdDev, RelativeSpecificLoudnessStdDev, SpectralFlatnessMean, duration	88.26
3	BandRoughness, SpectralFlatness, SpectralFlatnessMean, duration, SpectralVariationMean	88.02
4	BandRoughness, SpectralFlatnessMean, duration, RelativeSpecificLoudnessMean, DMFCCStdDev	87.78
5	BandRoughness, SpectralFlatness, duration, RelativeSpecificLoudnessMean, DMFCCStdDev	87.78


__	MOTS ____________________________________________________________________________________________________________________	Score
1	MFCC, MFCCMean, RelativeSpecificLoudness, RelativeSpecificLoudnessMean, PerceptualTristimulus	81.66
2	MFCC, MFCCMean, RelativeSpecificLoudnessStdDev, RelativeSpecificLoudness, PerceptualTristimulus	80.69
3	BandRoughness, MFCC, DMFCCMean, RelativeSpecificLoudness, RelativeSpecificLoudnessMean	80.20
4	BandRoughness, MFCC, MFCCMean, SpectralFlatness, MFCCStdDev	80.20
5	BandRoughness, MFCC, MFCCMean, SpectralFlatnessStdDev, MFCCStdDev	80.20


__	HV-MOTS .________________________________________________________________________________________________________________	Score
1	BandRoughness, MFCC, duration, DMFCCStdDev, SpectralVariationMean	94.38
2	BandRoughness, MFCC, SpectralFlatnessMean, MFCCStdDev, duration	94.13
3	BandRoughness, MFCCMean, duration, DMFCCStdDev, SpectralVariationMean	93.89
4	BandRoughness, MFCC, SpectralFlatnessMean, duration, SpectralVariationMean	93.89
5	BandRoughness, MFCC, SpectralFlatnessMean, MFCCStdDev, DMFCCStdDev	93.89

6 features


__	1-NN _____________________________________________________________________________________________________________________	Score
1	BandRoughness - MFCC - RelativeSpecificLoudnessStdDev - MFCCStdDev - SpectralFlatnessMean - DMFCCMean	89.98
2	BandRoughness - MFCC - SpectralFlatnessStdDev - MFCCStdDev - SpectralFlatnessMean - DMFCCMean	89.98
3	BandRoughness - MFCC - SpectralFlatnessStdDev - RelativeSpecificLoudnessStdDev - MFCCStdDev - DMFCCMean	89.98
4	BandRoughness - MFCC - SpectralFlatnessStdDev - RelativeSpecificLoudnessStdDev - MFCCStdDev - SpectralFlatnessMean	89.98
5	BandRoughness - BandFluctuationStrength - MFCC - MFCCStdDev - SpectralFlatnessMean - DMFCCMean	89.98


__	5-NN _____________________________________________________________________________________________________________________	Score
1	BandRoughness, BandFluctuationStrength, SpectralFlatnessStdDev, RelativeSpecificLoudnessStdDev, SpectralFlatnessMean, DMFCCMean	85.58
2	BandRoughness, MFCC, SpectralFlatnessStdDev, RelativeSpecificLoudnessStdDev, MFCCStdDev, DMFCCMean	85.33
3	BandRoughness, BandFluctuationStrength, MFCC, RelativeSpecificLoudnessStdDev, MFCCStdDev, DMFCCMean	85.33
4	BandRoughness, BandFluctuationStrength, MFCC, SpectralFlatnessStdDev, MFCCStdDev, DMFCCMean	85.09
5	BandRoughness, BandFluctuationStrength, MFCC, SpectralFlatnessStdDev, RelativeSpecificLoudnessStdDev, MFCCStdDev	85.09


__	MOTS ____________________________________________________________________________________________________________________	Score
1	BandRoughness, BandFluctuationStrength, MFCC, MFCCMean, RelativeSpecificLoudnessStdDev, DMFCCMean	78.73
2	BandRoughness, MFCC, MFCCMean, SpectralFlatnessStdDev, MFCCStdDev, SpectralFlatnessMean	78.48
3	BandRoughness, MFCC, MFCCMean, RelativeSpecificLoudnessStdDev, MFCCStdDev, DMFCCMean	78.24
4	BandFluctuationStrength, MFCC, MFCCMean, RelativeSpecificLoudnessStdDev, MFCCStdDev, DMFCCMean	78.00
5	BandRoughness, BandFluctuationStrength, MFCC, MFCCMean, RelativeSpecificLoudnessStdDev, MFCCStdDev	77.26


__	HV-MOTS .________________________________________________________________________________________________________________	Score
1	BandRoughness, BandFluctuationStrength, MFCC, MFCCMean, SpectralFlatnessStdDev, DMFCCMean	93.64
2	BandRoughness, BandFluctuationStrength, MFCC, MFCCMean, RelativeSpecificLoudnessStdDev, DMFCCMean	93.40
3	BandRoughness, BandFluctuationStrength, MFCC, MFCCMean, RelativeSpecificLoudnessStdDev, SpectralFlatnessMean	93.15
4	BandRoughness, BandFluctuationStrength, MFCC, MFCCMean, SpectralFlatnessStdDev, MFCCStdDev	93.15
5	BandRoughness, MFCC, MFCCMean, SpectralFlatnessStdDev, MFCCStdDev, DMFCCMean	92.91

Features analysis

Summary

Best classification accuracies


	__ 1 __	__ 2 __	__ 3 __	__ 4 __	__ 5 __	__ 6 __	__ 7 __	__ 8 __	__ 9 __
TotalEnergy (M)	33.01	84.35	88.02	89.98
TotalEnergy (D)	20.78	85.58	89.24
TotalEnergy	44.01	79.95	86.80	89.73
HarmonicEnergy (M)	31.79	84.11	88.02	90.46
HarmonicEnergy (D)	18.83	86.55	89.24
HarmonicEnergy	45.23	80.20	86.80
NoiseEnergy (M)	25.43	85.09	90.22	93.15
NoiseEnergy (D)	25.67	85.82	91.20
NoiseEnergy	40.83	77.75	84.35
EnergyEnvelope (M)	26.41	83.62	89.00	90.71
EnergyEnvelope (D)	21.27	84.60	88.75
EnergyEnvelope	44.01	83.13	88.75	91.20
BandFluctuationStrength	69.19	88.51	91.44	92.66	93.40	93.64	93.89	92.91	91.69
BandRoughness	74.82	90.22	92.91	93.64	94.38	93.64	93.89	92.91	91.69
HarmonicTristimulus (M)	32.27	80.69	88.51
HarmonicTristimulus (D)	28.61	78.24	86.80
HarmonicTristimulus	37.16	75.06	85.82
HarmonicSpectralSpread	32.76	72.37	82.15
HarmonicSpectralVariation	27.87	70.42	80.20
NoiseSpectralDecrease (M)	21.03	83.86	90.22
PerceptualTristimulus (M)	46.94	85.33	91.44	92.91
PerceptualTristimulus (D)	42.05	86.80	90.71	92.18
PerceptualTristimulus	37.16	75.55	85.09
PerceptualTristimulus	68.95	83.13	90.22	92.42	93.15
PerceptualSpectralCentroid	34.47	70.91	81.42
PerceptualSpectralSlope	34.47	70.91	81.42
PerceptualSpectralVariation (M)	27.87	86.80	92.18
PerceptualSpectralVariation (D)	21.27	85.82	89.73
Loudness (M)	31.79	83.37	88.75	92.18
Loudness	47.92	82.40	87.53	89.98
RelativeSpecificLoudness (M)	66.75	82.40	89.49	91.44	92.91
RelativeSpecificLoudness (D)	67.24	86.80	90.95	92.66	93.15	93.40	93.40	92.91	91.69
RelativeSpecificLoudness	41.57	62.84	76.28
RelativeSpecificLoudness	68.46	86.31	88.51	90.95	91.44
Sharpness (D)	23.72	87.04	90.46
Sharpness	42.79	75.55	84.84
Spread (M)	22.25	86.31	91.20
SpectralFlatness (M)	54.77	84.84	91.69	93.40	94.13	93.15	93.40	92.91	91.69
SpectralFlatness (D)	53.30	87.04	91.93	93.15	93.64	93.64	93.89	92.66	91.69
SpectralFlatness	59.17	83.86	90.46	92.66	93.15
SpectralFlatness (M)	24.69	83.86	89.98
SpectralCrest (M)	38.63	82.15	87.78
SpectralCrest (D)	33.01	82.88	88.26
SpectralCrest	41.32	79.46	88.26	90.46
MFCCBands (M)	75.55	90.22	92.42	93.15	93.89	93.64	93.89	92.91	91.69
MFCCBands (D)	67.73	88.02	91.69	92.91	94.13	93.15	93.89	92.91	91.69
MFCCBands	76.53	89.73	92.91	93.64	94.38	93.64	93.89	92.91	91.69
MFCC (M)	28.61	84.35	89.98	92.66
MFCC (D)	22.25	85.09	90.71
MFCC	43.03	74.33	83.37
DMFCCBands (M)	69.93	87.53	91.69	93.15	93.64	93.64	93.89	92.91	91.69
DMFCCBands (D)	55.01	88.51	91.93	93.64	94.38
DMFCC	23.72	78.24	87.53
DMFCC (M)	33.98	86.31	90.71	92.66
DDMFCC (M)	42.54	86.31	90.95
DDMFCC (D)	45.72	89.73	91.69	93.40
DDMFCC (M)	26.16	85.09	90.71
SpectralCentroid	33.25	74.08	85.58
SpectralSpread	36.19	67.97	81.17
SpectralSlope	33.25	74.08	85.58
SpectralVariation (M)	28.61	88.26	91.69	92.91	94.38
SpectralVariation (D)	25.92	85.58	89.98	91.69
SpectralVariation	31.54	75.55	83.13
SignalAutoCorrelation (M)	40.10	82.15	89.98	92.18
SignalAutoCorrelation (D)	39.36	82.40	88.26	90.71
SignalAutoCorrelation	52.32	82.88	89.98	91.69	93.15
Duration (M)	33.98	89.49	92.91	93.64	94.38

Mean classification accuracies


	__ 1 __	__ 2 __	__ 3 __	__ 4 __	__ 5 __	__ 6 __	__ 7 __	__ 8 __	__ 9 __
TotalEnergy (M)	33.01	47.02	63.86	78.13
TotalEnergy (D)	20.78	41.63	60.96
TotalEnergy	44.01	51.95	63.14	76.97
HarmonicEnergy (M)	31.79	47.14	63.91	78.12
HarmonicEnergy (D)	18.83	41.72	61.02
HarmonicEnergy	45.23	52.21	63.04
NoiseEnergy (M)	25.43	44.03	62.69	78.99
NoiseEnergy (D)	25.67	43.47	61.78
NoiseEnergy	40.83	50.14	62.41
EnergyEnvelope (M)	26.41	45.75	63.64	78.20
EnergyEnvelope (D)	21.27	41.46	60.96
EnergyEnvelope	44.01	52.72	64.66	78.41
BandFluctuationStrength	69.19	69.11	75.92	84.23	88.89	91.63	91.96	92.15	91.69
BandRoughness	74.82	73.19	78.47	85.94	89.43	92.06	92.22	92.24	91.69
HarmonicTristimulus (M)	32.27	44.45	60.40
HarmonicTristimulus (D)	28.61	42.45	59.65
HarmonicTristimulus	37.16	45.26	59.42
HarmonicSpectralSpread	32.76	41.57	54.77
HarmonicSpectralVariation	27.87	41.53	55.00
NoiseSpectralDecrease (M)	21.03	41.61	61.26
PerceptualTristimulus (M)	46.94	47.55	62.20	77.31
PerceptualTristimulus (D)	42.05	48.39	63.47	78.34
PerceptualTristimulus	37.16	44.38	57.51
PerceptualTristimulus	68.95	56.29	65.01	78.74	85.53
PerceptualSpectralCentroid	34.47	41.94	54.88
PerceptualSpectralSlope	34.47	41.94	54.88
PerceptualSpectralVariation (M)	27.87	42.55	61.29
PerceptualSpectralVariation (D)	21.27	42.85	61.69
Loudness (M)	31.79	47.98	64.67	78.89
Loudness	47.92	54.09	64.49	78.43
RelativeSpecificLoudness (M)	66.75	67.45	73.12	80.56	84.79
RelativeSpecificLoudness (D)	67.24	66.63	72.95	82.15	86.86	91.40	91.84	92.12	91.69
RelativeSpecificLoudness	41.57	46.28	55.35
RelativeSpecificLoudness	68.46	68.27	73.29	81.01	84.72
Sharpness (D)	23.72	42.54	61.52
Sharpness	42.79	47.02	58.76
Spread (M)	22.25	42.40	61.57
SpectralFlatness (M)	54.77	59.93	69.26	80.96	86.23	91.46	91.84	92.08	91.69
SpectralFlatness (D)	53.30	61.97	71.96	82.79	88.00	91.47	91.83	92.05	91.69
SpectralFlatness	59.17	62.37	70.45	81.34	86.00
SpectralFlatness (M)	24.69	43.58	61.82
SpectralCrest (M)	38.63	46.18	61.14
SpectralCrest (D)	33.01	44.36	60.48
SpectralCrest	41.32	50.28	63.15	77.76
MFCCBands (M)	75.55	76.39	78.72	84.68	87.67	91.78	92.08	92.18	91.69
MFCCBands (D)	67.73	57.63	65.62	79.49	86.18	91.46	91.91	92.15	91.69
MFCC	48.17	52.86	60.74
MFCC	76.53	79.09	80.19	85.67	87.94	91.78	92.09	92.21	91.69
MFCC (M)	28.61	47.00	64.14	79.03
MFCC (D)	22.25	41.59	60.17
MFCC	43.03	47.74	58.17
DMFCC (M)	69.93	61.71	68.46	80.53	86.59	91.54	91.98	92.18	91.69
DMFCC (D)	55.01	53.25	64.56	79.30	86.52
DMFCC	23.72	43.34	59.67
DMFCC (M)	33.98	46.75	62.92	78.61
DDMFCC (M)	42.54	46.09	61.23
DDMFCC (D)	45.72	50.45	63.80	79.17
DDMFCC (M)	26.16	39.92	59.06
SpectralCentroid	33.25	41.43	55.38
SpectralSpread	36.19	42.53	54.85
SpectralSlope	33.25	41.43	55.38
SpectralVariation (M)	28.61	47.05	63.84	79.69	86.71
SpectralVariation (D)	25.92	46.53	64.10	79.70
SpectralVariation	31.54	44.98	59.04
SignalAutoCorrelation (M)	40.10	52.57	66.52	79.32
SignalAutoCorrelation (D)	39.36	51.21	65.42	78.65
SignalAutoCorrelation	52.32	59.17	69.26	80.42	86.38
Duration (M)	33.98	49.09	65.47	80.71	87.11

Details

BandFluctuationStrength


Temporal	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____	______	7_____	______	8_____	______	9_____
1-NN	69.19	69.19	49.79	81.66	57.24	88.26	72.07	89.98	83.08	90.51	86.82	89.98	87.65	89.98	88.45	90.22	89.00	89.00
5-NN	67.73	67.73	50.24	79.95	56.29	85.58	69.87	87.04	79.66	87.29	82.16	85.58	82.74	85.09	82.98	84.60	82.88	82.88
MOTS	69.19	69.19	63.23	82.15	66.17	82.88	68.92	81.17	72.45	79.71	74.62	78.73	73.06	76.53	71.64	72.86	70.42	70.42
HV-MOTS	69.19	69.19	69.11	88.51	75.92	91.44	84.23	92.66	88.89	93.40	91.63	93.64	91.96	93.89	92.15	92.91	91.69	91.69


Mean	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	19.07	19.07	34.79	82.88
5-NN	28.85	28.85	36.85	78.73
MOTS	19.07	19.07	38.24	70.17
HV-MOTS	19.07	19.07	41.01	85.58

BandRoughness


Temporal	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____	______	7_____	______	8_____	______	9_____
1-NN	74.82	74.82	61.22	81.91	67.51	89.53	79.55	90.51	86.35	90.95	87.40	89.98	88.04	90.22	88.57	90.22	89.00	89.00
5-NN	68.22	68.22	59.99	82.15	65.35	85.58	76.67	87.04	82.45	88.26	82.61	85.58	82.96	85.09	83.01	84.60	82.88	82.88
MOTS	74.82	74.82	68.24	85.09	68.84	83.37	70.23	81.91	73.58	80.20	74.95	78.73	73.29	76.53	71.67	72.86	70.42	70.42
HV-MOTS	74.82	74.82	73.19	90.22	78.47	92.91	85.94	93.64	89.43	94.38	92.06	93.64	92.22	93.89	92.24	92.91	91.69	91.69


Mean	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	18.58	18.58	34.64	83.13
5-NN	20.78	20.78	36.13	78.97
MOTS	18.58	18.58	36.52	73.84
HV-MOTS	18.58	18.58	39.15	85.82

RelativeSpecificLoudness


Deviation	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____	______	7_____	______	8_____	______	9_____
1-NN	67.24	67.24	48.95	83.37	56.66	85.64	71.49	89.53	82.74	90.51	86.75	89.98	87.62	90.22	88.42	90.22	89.00	89.00
5-NN	67.73	67.73	49.00	78.97	55.47	85.82	69.20	86.31	79.29	88.26	82.13	85.58	82.71	85.09	82.95	84.60	82.88	82.88
MOTS	67.24	67.24	59.30	83.13	63.07	81.42	66.90	80.44	71.69	80.69	74.41	78.73	72.90	76.53	71.52	72.62	70.42	70.42
HV-MOTS	67.24	67.24	66.63	86.80	72.95	90.95	82.15	92.66	86.86	93.15	91.40	93.40	91.84	93.40	92.12	92.91	91.69	91.69


Mean	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	66.75	66.75	51.28	82.64	59.23	89.24	72.97	90.46	82.79	90.71
5-NN	63.81	63.81	50.06	80.69	57.42	85.09	70.44	86.55	79.35	87.78
MOTS	66.75	66.75	58.17	80.20	62.74	82.88	66.90	81.42	71.81	81.66
HV-MOTS	66.75	66.75	67.45	82.40	73.12	89.49	80.56	91.44	84.79	92.91

SpectralFlatness


Mean	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____	______	7_____	______	8_____	______	9_____
1-NN	54.77	54.77	49.20	81.66	59.20	88.26	73.98	90.51	83.51	90.95	86.91	89.98	87.76	90.22	88.48	90.22	89.00	89.00
5-NN	60.15	60.15	49.64	79.46	57.61	85.09	71.35	86.55	79.90	88.26	82.09	85.58	82.64	84.84	82.92	84.60	82.88	82.88
MOTS	54.77	54.77	55.13	79.95	61.98	82.15	67.69	80.44	71.96	79.95	74.34	78.48	72.99	76.28	71.67	72.86	70.42	70.42
HV-MOTS	54.77	54.77	59.93	84.84	69.26	91.69	80.96	93.40	86.23	94.13	91.46	93.15	91.84	93.40	92.08	92.91	91.69	91.69


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	53.30	53.30	47.19	83.62	57.71	89.00	72.93	89.98	83.32	90.95	86.85	89.98	87.71	90.22	88.42	90.22	89.00	89.00
5-NN	59.17	59.17	48.45	80.93	56.89	85.09	70.67	86.55	79.81	88.26	82.17	85.58	82.72	85.09	82.98	84.60	82.88	82.88
MOTS	53.30	53.30	57.34	79.95	64.13	82.15	68.49	81.91	71.84	80.20	74.26	78.48	72.87	76.28	71.55	72.86	70.42	70.42
HV-MOTS	53.30	53.30	61.97	87.04	71.96	91.93	82.79	93.15	88.00	93.64	91.47	93.64	91.83	93.89	92.05	92.66	91.69	91.69

MFCCBands


Mean	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____	______	7_____	______	8_____	______	9_____
1-NN	75.55	75.55	76.26	81.66	79.42	88.26	83.20	89.98	85.16	90.51	86.57	88.75	87.43	89.00	88.26	89.00	89.00	89.00
5-NN	68.46	68.46	72.51	81.17	75.56	83.86	78.54	85.82	80.20	85.82	81.80	83.62	82.41	83.86	82.73	83.86	82.88	82.88
MOTS	75.55	75.55	67.06	84.60	66.48	83.37	68.44	81.42	72.74	81.66	74.86	78.73	73.26	76.53	71.76	72.86	70.42	70.42
HV-MOTS	75.55	75.55	76.39	90.22	78.72	92.42	84.68	93.15	87.67	93.89	91.78	93.64	92.08	93.89	92.18	92.91	91.69	91.69


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	67.73	67.73	61.33	81.66	68.54	87.78	78.77	89.98	84.50	90.22	87.66	89.98	88.37	90.22	88.84	90.22	89.00	89.00
5-NN	66.75	66.75	60.58	84.11	66.93	86.31	76.43	87.04	81.64	87.53	83.06	85.33	83.25	85.09	83.16	84.60	82.88	82.88
MOTS	67.73	67.73	61.79	83.37	64.79	82.64	68.36	81.91	72.02	80.20	74.75	78.48	73.16	76.53	71.70	72.86	70.42	70.42
HV-MOTS	67.73	67.73	57.63	88.02	65.62	91.69	79.49	92.91	86.18	94.13	91.46	93.15	91.91	93.89	92.15	92.91	91.69	91.69

MFCC


Temporal	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____	______	7_____	______	8_____	______	9_____
1-NN	76.53	76.53	78.04	85.46	80.88	89.53	84.65	90.51	86.90	90.95	87.38	89.98	87.85	90.22	88.45	90.22	89.00	89.00
5-NN	78.73	72.86	74.41	85.33	77.19	86.31	80.84	87.04	82.46	87.53	82.56	85.33	82.70	85.09	82.82	84.60	82.88	82.88
MOTS	76.53	76.53	68.97	85.09	67.49	83.37	69.37	81.91	73.12	81.66	75.18	78.73	73.50	76.53	71.85	72.86	70.42	70.42
HV-MOTS	76.53	76.53	79.09	89.73	80.19	92.91	85.67	93.64	87.94	94.38	91.78	93.64	92.09	93.89	92.21	92.91	91.69	91.69


Mean	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	28.61	28.61	41.04	83.13	56.00	89.49	72.61	89.98
5-NN	33.50	33.50	42.17	80.20	55.32	86.31	70.53	86.80
MOTS	28.61	28.61	44.42	70.91	58.03	76.77	64.45	76.04
HV-MOTS	28.61	28.61	47.00	84.35	64.14	89.98	79.03	92.66


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	22.25	22.25	37.92	82.88	54.09	89.24
5-NN	27.63	27.63	39.60	79.71	53.62	85.33
MOTS	22.25	22.25	41.55	72.13	56.92	75.80
HV-MOTS	22.25	22.25	41.59	85.09	60.17	90.71

DMFCCBands


Mean	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____	______	7_____	______	8_____	______	9_____
1-NN	69.93	69.93	51.01	83.86	58.40	88.26	72.53	89.98	83.18	90.95	86.83	89.98	87.67	90.22	88.45	90.22	89.00	89.00
5-NN	68.22	68.22	50.27	78.73	57.00	85.09	70.28	86.31	79.72	87.78	82.20	85.58	82.68	85.09	82.92	84.60	82.88	82.88
MOTS	69.93	69.93	62.25	80.44	64.64	82.40	68.59	81.42	71.55	80.20	74.50	78.73	72.98	76.53	71.64	72.86	70.42	70.42
HV-MOTS	69.93	69.93	61.71	87.53	68.46	91.69	80.53	93.15	86.59	93.64	91.54	93.64	91.98	93.89	92.18	92.91	91.69	91.69


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	55.01	55.01	49.33	86.31	59.47	88.26	73.83	89.98	83.83	90.51
5-NN	55.75	55.75	49.82	81.42	58.58	86.31	71.69	86.80	80.51	88.26
MOTS	55.01	55.01	55.98	79.22	62.68	80.44	66.58	78.97	70.62	77.26
HV-MOTS	55.01	55.01	53.25	88.51	64.56	91.93	79.30	93.64	86.52	94.38

PerceptualTristimulus


Temporal	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____
1-NN	68.95	68.95	50.74	83.13	57.80	86.31	71.94	87.04	82.45	90.22
5-NN	66.50	66.50	49.23	80.69	55.86	84.84	69.26	86.06	78.92	87.29
MOTS	68.95	68.95	60.22	81.17	62.96	82.88	67.65	81.42	71.77	81.66
HV-MOTS	68.95	68.95	56.29	83.13	65.01	90.22	78.74	92.42	85.53	93.15

RelativeSpecificLoudness


Temporal	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____
1-NN	68.46	68.46	51.60	83.62	59.26	88.26	72.99	88.26	82.73	89.98
5-NN	64.55	64.55	50.24	81.17	57.47	84.84	70.39	86.31	79.27	87.53
MOTS	68.46	68.46	57.94	81.66	61.91	81.91	66.64	81.42	71.57	81.66
HV-MOTS	68.46	68.46	68.27	86.31	73.29	88.51	81.01	90.95	84.72	91.44

SpectralFlatness


Temporal	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____
1-NN	59.17	59.17	49.92	81.66	59.12	88.26	73.72	90.22	83.23	90.95
5-NN	57.70	57.70	48.97	80.20	57.17	85.58	71.02	87.04	79.66	88.02
MOTS	59.17	59.17	55.41	78.24	61.32	80.20	67.49	81.17	72.00	80.20
HV-MOTS	59.17	59.17	62.37	83.86	70.45	90.46	81.34	92.66	86.00	93.15


Mean	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	24.69	24.69	37.69	83.13	53.19	89.49
5-NN	33.01	33.01	39.57	78.97	52.74	85.58
MOTS	24.69	24.69	41.00	71.39	56.05	76.53
HV-MOTS	24.69	24.69	43.58	83.86	61.82	89.98

SpectralVariation


Mean	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____
1-NN	28.61	28.61	40.02	83.37	54.75	88.26	71.86	89.98	83.27	90.95
5-NN	36.19	36.19	42.21	79.95	54.37	85.33	69.87	86.31	79.81	88.26
MOTS	28.61	28.61	46.64	72.13	59.34	77.75	65.93	77.26	69.48	75.80
HV-MOTS	28.61	28.61	47.05	88.26	63.84	91.69	79.69	92.91	86.71	94.38


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	25.92	25.92	38.95	81.66	53.92	86.31	71.21	89.98
5-NN	35.45	35.45	41.13	79.22	53.68	85.33	69.28	86.31
MOTS	25.92	25.92	44.40	71.88	58.32	76.04	65.02	75.31
HV-MOTS	25.92	25.92	46.53	85.58	64.10	89.98	79.70	91.69


Temporal	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	31.54	31.54	39.34	80.44	49.19	87.04
5-NN	33.01	33.01	38.94	76.77	48.08	83.86
MOTS	29.58	29.58	42.92	64.06	52.66	68.70
HV-MOTS	31.54	31.54	44.98	75.55	59.04	83.13

SignalAutoCorrelation


Temporal	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____
1-NN	52.32	52.32	50.91	81.66	60.02	88.26	71.85	89.98	81.32	90.46
5-NN	50.37	50.37	49.45	80.69	58.04	85.33	69.29	86.31	78.17	87.53
MOTS	52.32	52.32	51.17	77.51	59.29	78.00	65.55	78.24	69.65	77.51
HV-MOTS	52.32	52.32	59.17	82.88	69.26	89.98	80.42	91.69	86.38	93.15


Mean	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	24.45	24.45	31.49	79.46
5-NN	27.14	27.14	32.09	75.80
MOTS	24.45	24.45	35.86	61.86
HV-MOTS	24.45	24.45	38.74	74.08

Duration


	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____
1-NN	33.98	33.98	46.87	85.46	61.41	89.53	76.44	90.51	85.45	90.95
5-NN	41.57	41.57	48.63	85.33	60.20	86.31	74.10	87.04	82.08	88.26
MOTS	33.98	33.98	50.57	76.53	61.43	78.97	66.93	78.73	69.79	78.00
HV-MOTS	33.98	33.98	49.09	89.49	65.47	92.91	80.71	93.64	87.11	94.38

TotalEnergy


Mean	______	1_____	______	2_____	______	3_____	______	4_____
1-NN	33.01	33.01	37.66	81.66	51.54	88.26	69.35	89.98
5-NN	36.19	36.19	39.38	78.73	51.14	85.33	67.43	86.31
MOTS	33.01	33.01	47.15	72.13	58.94	76.28	64.75	75.06
HV-MOTS	33.01	33.01	47.02	84.35	63.86	88.02	78.13	89.98


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	20.78	20.78	35.20	81.66	51.01	86.31
5-NN	23.96	23.96	37.02	78.73	50.66	85.33
MOTS	20.78	20.78	40.41	72.86	56.10	75.31
HV-MOTS	20.78	20.78	41.63	85.58	60.96	89.24


Temporal	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	44.01	44.01	46.94	81.66	55.85	88.26	67.67	89.73
5-NN	44.99	44.99	46.68	79.71	54.63	84.11	65.63	86.55
MOTS	44.74	44.74	49.26	68.46	56.81	74.57	63.47	75.06
HV-MOTS	44.01	44.01	51.95	79.95	63.14	86.80	76.97	89.73

HarmonicEnergy


Mean	______	1_____	______	2_____	______	3_____	______	4_____
1-NN	31.79	31.79	37.62	81.66	51.53	88.26	69.35	89.98/td>
5-NN	39.12	39.12	39.55	78.73	51.14	85.33	67.43	86.31
MOTS	31.79	31.79	46.70	72.37	58.84	76.28	64.81	75.80
HV-MOTS	31.79	31.79	47.14	84.11	63.91	88.02	78.12	90.46


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	18.83	18.83	35.23	81.42	51.01	88.26
5-NN	23.23	23.23	37.02	78.73	50.67	85.33
MOTS	18.83	18.83	40.02	72.37	56.25	74.08
HV-MOTS	18.83	18.83	41.72	86.55	61.02	89.24


Temporal	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	45.23	45.23	47.01	81.66	55.71	88.02
5-NN	46.21	46.21	46.94	80.93	54.66	83.37
MOTS	45.23	45.23	49.52	68.46	56.88	73.11
HV-MOTS	45.23	45.23	52.21	80.20	63.04	86.80

NoiseEnergy


Mean	______	1_____	______	2_____	______	3_____	______	4_____
1-NN	25.43	25.43	35.58	81.02	50.91	86.31	69.23	88.26
5-NN	27.38	27.38	36.88	78.73	50.53	85.33	67.32	86.31
MOTS	25.43	25.43	43.16	71.15	58.12	77.02	64.40	75.80
HV-MOTS	25.43	25.43	44.03	85.09	62.69	90.22	78.99	93.15


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	25.67	25.67	34.95	75.80	50.83	81.66
5-NN	31.54	31.54	36.54	78.73	50.48	85.33
MOTS	25.67	25.67	42.16	73.59	56.82	78.24
HV-MOTS	25.67	25.67	43.47	85.82	61.78	91.20


Temporal	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	40.83	40.83	44.82	81.66	54.23	88.26
5-NN	41.81	41.81	44.81	78.73	53.14	85.82
MOTS	39.85	39.85	47.60	69.68	55.35	72.62
HV-MOTS	40.83	40.83	50.14	77.75	62.41	84.35

EnergyEnvelope


Mean	______	1_____	______	2_____	______	3_____	______	4_____
1-NN	26.41	26.41	37.36	81.66	51.53	88.26	69.35	89.98
5-NN	32.27	32.27	39.13	78.73	51.13	85.33	67.43	86.31
MOTS	26.41	26.41	44.68	68.70	58.46	76.77	64.35	77.26
HV-MOTS	26.41	26.41	45.75	83.62	63.64	89.00	78.20	90.71


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	21.27	21.27	35.17	76.53	50.98	81.66
5-NN	22.00	22.00	36.77	78.73	50.61	85.33
MOTS	21.27	21.27	39.83	72.62	55.97	75.80
HV-MOTS	21.27	21.27	41.46	84.60	60.96	88.75


Temporal	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	44.01	44.01	47.16	81.66	56.46	88.02	68.42	89.73
5-NN	44.99	44.99	46.67	80.69	55.09	83.86	66.25	85.82
MOTS	44.50	44.50	49.21	71.64	56.79	74.82	63.90	74.57
HV-MOTS	44.01	44.01	52.72	83.13	64.66	88.75	78.41	91.20

PerceptualTristimulusBands


Mean	______	1_____	______	2_____	______	3_____	______	4_____
1-NN	46.94	46.94	44.11	81.66	55.51	86.31	71.06	87.04
5-NN	46.94	46.94	43.81	78.97	54.01	85.09	68.55	85.58
MOTS	46.94	46.94	50.96	74.33	59.97	78.00	65.73	77.51
HV-MOTS	46.94	46.94	47.55	85.33	62.20	91.44	77.31	92.91


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	42.05	42.05	42.62	81.66	55.10	88.26	71.29	86.80
5-NN	45.72	45.72	43.32	79.71	54.48	85.58	69.37	86.80
MOTS	42.05	42.05	48.59	76.28	59.09	79.22	65.25	78.00
HV-MOTS	42.05	42.05	48.39	86.80	63.47	90.71	78.34	92.18

Loudness


Mean	______	1_____	______	2_____	______	3_____	______	4_____
1-NN	31.79	31.79	42.29	81.66	56.59	88.26	72.90	89.98
5-NN	34.96	34.96	42.59	78.48	55.41	84.60	70.58	86.06
MOTS	31.79	31.79	46.68	71.15	58.21	76.77	64.55	76.53
HV-MOTS	31.79	31.79	47.98	83.37	64.67	88.75	78.89	92.18


Temporal	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	47.92	47.92	50.01	81.66	58.15	88.26	70.15	89.49
5-NN	46.45	46.45	48.50	81.66	56.14	84.35	67.20	85.82
MOTS	49.14	49.14	51.30	69.19	57.28	73.35	63.76	74.82
HV-MOTS	47.92	47.92	54.09	82.40	64.49	87.53	78.43	89.98

SpectralCrest


Temporal	______	1_____	______	2_____	______	3_____	______	4_____
1-NN	41.32	41.32	43.11	76.28	51.61	83.86	62.09	86.55
5-NN	41.81	41.81	43.82	75.06	51.75	79.46	61.35	81.91
MOTS	41.32	41.32	46.97	71.15	58.16	78.97	65.79	79.22
HV-MOTS	41.32	41.32	50.28	79.46	63.15	88.26	77.76	90.46


Mean	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	22.00	22.00	32.23	81.66
5-NN	23.96	23.96	32.89	78.97
MOTS	22.00	22.00	36.50	66.99
HV-MOTS	22.00	22.00	38.79	81.91


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	20.78	20.78	30.98	81.66
5-NN	21.76	21.76	32.51	79.71
MOTS	20.78	20.78	35.20	73.84
HV-MOTS	20.78	20.78	36.50	82.64

DMFCC


Temporal	______	1_____	______	2_____	______	3_____
1-NN	23.72	23.72	33.53	81.66	48.98	88.26
5-NN	20.29	20.29	32.77	76.53	47.71	84.35
MOTS	23.72	23.72	37.63	65.04	51.74	69.93
HV-MOTS	23.72	23.72	43.34	78.24	59.67	87.53


Mean	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	33.98	33.98	38.09	81.66	51.91	86.31	69.48	87.04
5-NN	37.41	37.41	39.32	78.73	51.48	85.33	67.55	86.31
MOTS	33.98	33.98	46.27	72.86	58.63	78.97	65.09	77.26
HV-MOTS	33.98	33.98	46.75	86.31	62.92	90.71	78.61	92.66


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	19.56	19.56	35.38	81.66
5-NN	23.72	23.72	37.09	78.73
MOTS	19.56	19.56	38.19	69.68
HV-MOTS	19.56	19.56	39.22	84.84

DDMFCCBands


Mean	______	1_____	______	2_____	______	3_____
1-NN	42.54	42.54	38.61	81.66	51.96	87.78
5-NN	46.45	46.45	39.77	78.73	51.51	85.33
MOTS	42.54	42.54	47.30	72.86	57.41	77.51
HV-MOTS	42.54	42.54	46.09	86.31	61.23	90.95


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	45.72	45.72	45.16	83.37	56.86	88.26	72.41	90.51
5-NN	48.66	48.66	46.22	80.20	56.02	86.31	70.19	87.04
MOTS	45.72	45.72	53.01	78.48	61.33	80.69	65.67	78.24
HV-MOTS	45.72	45.72	50.45	89.73	63.80	91.69	79.17	93.40

SignalAutoCorrelationBands


Mean	______	1_____	______	2_____	______	3_____	______	4_____
1-NN	40.10	40.10	45.25	81.66	56.28	87.78	68.71	89.24
5-NN	40.59	40.59	44.88	80.93	55.10	84.60	66.54	86.80
MOTS	40.10	40.10	47.35	74.08	58.95	78.24	65.75	78.24
HV-MOTS	40.10	40.10	52.57	82.15	66.52	89.98	79.32	92.18


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	39.36	39.36	42.11	85.09	55.04	89.49	71.01	90.71
5-NN	42.05	42.05	42.70	81.66	54.39	85.33	69.44	87.04
MOTS	39.36	39.36	45.82	76.04	57.55	78.24	63.97	78.48
HV-MOTS	39.36	39.36	51.21	82.40	65.42	88.26	78.65	90.71

HarmonicTristimulusBands


Mean	______	1_____	______	2_____	______	3_____
1-NN	32.27	32.27	37.21	81.66	50.26	86.31
5-NN	32.52	32.52	37.50	77.26	49.84	85.09
MOTS	32.27	32.27	40.94	72.62	55.51	79.71
HV-MOTS	32.27	32.27	44.45	80.69	60.40	88.51


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	28.61	28.61	35.68	80.44	50.56	89.00
5-NN	32.27	32.27	37.05	78.48	50.33	84.84
MOTS	28.61	28.61	40.33	70.66	55.57	77.51
HV-MOTS	28.61	28.61	42.45	78.24	59.65	86.80

HarmonicTristimulus


Temporal	______	1_____	______	2_____	______	3_____
1-NN	37.16	37.16	39.28	80.44	51.46	88.26
5-NN	34.72	34.72	38.43	77.75	50.37	84.84
MOTS	37.16	37.16	41.75	70.42	54.36	78.00
HV-MOTS	37.16	37.16	45.26	75.06	59.42	85.82


Mean	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	13.45	13.45	32.00	80.44
5-NN	31.54	31.54	34.02	78.73
MOTS	24.94	24.94	43.08	71.15
HV-MOTS	13.45	13.45	32.69	82.40

HarmonicSpectralSpread


Mean	______	1_____	______	2_____
1-NN	19.07	19.07	22.83	41.81
5-NN	21.76	21.76	25.31	44.74
MOTS	19.07	19.07	36.10	68.95
HV-MOTS	19.07	19.07	39.38	86.31


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	22.98	22.98	26.67	49.88
5-NN	21.76	21.76	25.91	48.17
MOTS	22.98	22.98	37.48	70.17
HV-MOTS	22.98	22.98	40.31	86.06


Temporal	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	32.76	32.76	35.49	78.00	45.24	86.31
5-NN	35.21	35.21	36.07	75.31	44.28	82.40
MOTS	32.52	32.52	39.84	67.97	51.02	72.37
HV-MOTS	32.76	32.76	41.57	72.37	54.77	82.15

HarmonicSpectralVariation


Mean	______	1_____	______	2_____
1-NN	20.05	20.05	34.34	84.35
5-NN	22.00	22.00	35.24	78.48
MOTS	20.05	20.05	36.21	67.48
HV-MOTS	20.05	20.05	39.47	81.66


Temporal	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	27.87	27.87	35.44	81.91	45.32	88.26
5-NN	33.01	33.01	37.81	77.02	46.08	82.64
MOTS	27.63	27.63	40.99	63.81	52.06	69.44
HV-MOTS	27.87	27.87	41.53	70.42	55.00	80.20

NoiseSpectralDecrease


Mean	______	1_____	______	2_____	______	3_____
1-NN	21.03	21.03	35.14	80.44	51.49	86.31
5-NN	24.94	24.94	37.15	78.73	51.13	85.33
MOTS	21.03	21.03	39.70	73.35	56.56	75.55
HV-MOTS	21.03	21.03	41.61	83.86	61.26	90.22


Temporal	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	26.41	26.41	31.62	80.69
5-NN	28.61	28.61	32.53	78.24
MOTS	26.65	26.65	36.25	65.04
HV-MOTS	26.41	26.41	37.48	69.93

PerceptualSpectralSlope


Mean	______	1_____	______	2_____
1-NN	19.56	19.56	32.07	80.44
5-NN	24.45	24.45	34.00	78.73
MOTS	19.56	19.56	37.19	69.19
HV-MOTS	19.56	19.56	40.80	84.60


Temporal	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	34.47	34.47	36.27	80.93	45.28	87.04
5-NN	35.70	35.70	36.49	77.51	44.54	83.62
MOTS	34.47	34.47	39.84	69.19	52.53	74.33
HV-MOTS	34.47	34.47	41.94	70.91	54.88	81.42

PerceptualSpectralVariation


Mean	______	1_____	______	2_____	______	3_____
1-NN	27.87	27.87	37.84	80.44	53.31	85.82
5-NN	31.30	31.30	39.23	79.22	52.54	85.58
MOTS	27.87	27.87	41.51	72.86	56.54	78.00
HV-MOTS	27.87	27.87	42.55	86.80	61.29	92.18


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	21.27	21.27	36.66	80.44	53.13	85.82
5-NN	26.16	26.16	38.36	78.97	52.58	85.33
MOTS	21.27	21.27	39.77	71.64	55.84	75.31
HV-MOTS	21.27	21.27	42.85	85.82	61.69	89.73


Temporal	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	22.00	22.00	29.77	77.51
5-NN	21.52	21.52	28.34	72.62
MOTS	23.23	23.23	32.00	59.66
HV-MOTS	22.00	22.00	35.31	69.68

Sharpness


Deviation	______	1_____	______	2_____	______	3_____
1-NN	23.72	23.72	36.98	80.44/td>	52.82	85.82
5-NN	24.45	24.45	38.23	79.22	52.36	85.33
MOTS	23.72	23.72	40.07	71.15	55.30	78.73
HV-MOTS	23.72	23.72	42.54	87.04	61.52	90.46


Temporal	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	42.79	42.79	42.27	80.69	50.57	85.82
5-NN	39.12	39.12	39.75	78.24	47.85	81.42
MOTS	43.52	43.52	43.15	67.97	52.50	72.13
HV-MOTS	42.79	42.79	47.02	75.55	58.76	84.84

Spread


Mean	______	1_____	______	2_____	______	3_____
1-NN	22.25	22.25	36.58	80.42	52.67	86.31
5-NN	27.14	27.14	38.03	79.22	52.18	85.58
MOTS	22.25	22.25	39.20	73.11	56.43	77.51
HV-MOTS	22.25	22.25	42.40	86.31	61.57	91.20


Temporal	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	23.47	23.47	29.47	79.71
5-NN	24.94	24.94	30.47	76.28
MOTS	23.23	23.23	35.27	66.26
HV-MOTS	23.47	23.47	34.99	68.70

SpectralCrestBands


Mean	______	1_____	______	2_____	______	3_____
1-NN	38.63	38.63	40.68	78.00	49.44	82.64
5-NN	36.43	36.43	40.20	74.33	48.22	77.75
MOTS	38.63	38.63	44.66	74.08	57.92	79.22
HV-MOTS	38.63	38.63	46.18	82.15	61.14	87.78


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	33.01	33.01	36.68	80.93	47.75	85.33
5-NN	33.74	33.74	37.80	79.22	47.99	81.91
MOTS	33.01	33.01	42.29	71.64	56.54	77.26
HV-MOTS	33.01	33.01	44.36	82.88	60.48	88.26

DDMFCC


Mean	______	1_____	______	2_____	______	3_____
1-NN	26.16	26.16	34.23	78.73	50.79	86.31
5-NN	33.01	33.01	35.88	78.73	50.44	85.33
MOTS	26.16	26.16	41.30	70.17	55.65	74.82
HV-MOTS	26.16	26.16	39.92	85.09	59.06	90.71


Deviation	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______	______
1-NN	21.03	21.03	35.05	80.44
5-NN	25.43	25.43	37.07	78.73
MOTS	21.03	21.03	38.98	71.88
HV-MOTS	21.03	21.03	39.80	84.60

SpectralCentroid


Temporal	______	1_____	______	2_____	______	3_____
1-NN	33.25	33.25	36.05	80.44	45.57	86.31
5-NN	33.50	33.50	35.81	77.51	44.37	81.91
MOTS	33.50	33.50	39.71	67.97	52.58	73.59
HV-MOTS	33.25	33.25	41.43	74.08	55.38	85.58

SpectralSpread


Temporal	______	1_____	______	2_____	______	3_____
1-NN	36.19	36.19	37.75	78.97	46.43	86.80
5-NN	35.70	35.70	37.56	78.00	45.59	84.60
MOTS	35.94	35.94	41.54	68.70	52.35	72.37
HV-MOTS	36.19	36.19	42.53	67.97	54.85	81.17

SpectralSlope


Temporal	______	1_____	______	2_____	______	3_____
1-NN	33.25	33.25	36.05	81.66	45.57	88.26
5-NN	33.50	33.50	35.81	77.51	44.37	81.91
MOTS	33.50	33.50	39.71	67.97	52.58	73.59
HV-MOTS	33.25	33.25	41.43	74.08	55.38	85.58

Robustness tests

Pitch conversion


- 20 %	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____
1-NN	40.62	63.32	49.76	74.82	54.07	80.20	68.19	82.64	70.17	84.11	71.74	84.84
5-NN	42.47	63.32	49.62	73.84	53.03	77.75	67.60	81.66	69.26	83.13	70.98	83.62
MOTS	40.55	63.32	51.32	72.86	55.54	75.06	64.47	73.84	61.97	73.11	58.41	70.42
HV-MOTS	40.63	63.32	55.18	78.24	62.42	83.37	77.75	86.80	80.98	89.00	83.20	89.00


- 10 %	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____
1-NN	45.24	76.28	54.99	87.04	59.41	89.00	79.90	89.49	82.09	90.22	82.87	90.46
5-NN	46.56	71.88	54.16	82.88	57.57	85.58	77.31	86.55	79.21	87.78	80.06	87.78
MOTS	45.21	76.28	55.93	80.69	59.43	83.13	71.47	81.17	69.22	79.95	65.82	76.28
HV-MOTS	45.22	76.28	60.38	87.53	67.21	91.20	85.53	92.66	87.73	93.64	88.71	93.89


+ 10 %	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____
1-NN	46.09	76.28	55.32	88.02	59.54	88.75	81.30	89.49	83.47	90.22	84.13	90.46
5-NN	46.89	71.88	54.18	83.62	57.52	85.33	78.11	86.06	79.96	87.04	80.58	88.26
MOTS	46.05	76.28	55.87	84.35	58.73	83.37	72.55	82.15	70.33	80.69	67.00	76.28
HV-MOTS	46.11	76.28	59.96	88.02	66.28	90.22	85.30	92.18	87.34	91.93	88.20	92.18


+ 20 %	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____
1-NN	41.92	74.33	51.11	82.15	55.32	83.62	73.58	85.09	75.97	86.06	76.63	86.06
5-NN	43.44	71.88	50.65	78.24	54.04	80.44	71.50	82.88	73.70	84.11	74.49	83.62
MOTS	41.91	74.33	51.71	78.24	55.25	78.48	67.82	78.24	65.62	76.04	61.86	75.06
HV-MOTS	41.93	74.33	55.10	82.88	61.46	86.06	79.12	87.04	81.68	89.00	82.84	88.75

Random cropping


5 %	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____
1-NN	45.79	76.28	55.25	88.02	59.71	89.98	81.51	89.98	83.89	90.22	84.49	90.46
5-NN	47.30	71.88	54.19	85.09	57.73	86.06	78.02	86.80	80.13	87.53	80.77	87.53
MOTS	45.76	76.28	56.24	82.64	59.08	81.66	69.98	80.44	67.20	79.22	63.47	74.33
HV-MOTS	45.78	76.28	59.85	88.51	66.33	90.71	84.72	92.18	87.24	93.15	88.16	93.40


10 %	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____
1-NN	44.54	74.33	54.27	88.02	58.88	89.00	80.62	89.24	83.10	89.49	83.72	90.22
5-NN	45.76	71.15	53.37	83.37	57.11	85.33	77.32	86.06	79.56	87.04	80.13	87.04
MOTS	44.59	74.33	54.79	82.64	57.63	82.15	68.69	81.17	65.77	78.73	61.86	73.11
HV-MOTS	44.56	74.33	58.56	88.26	65.32	90.46	84.25	92.18	86.75	92.91	87.58	92.91


15 %	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____
1-NN	44.40	73.11	53.91	86.55	58.36	87.04	79.94	88.51	82.56	89.98	83.22	89.98
5-NN	45.46	66.99	53.00	83.62	56.59	85.09	76.92	86.55	79.31	87.04	80.00	86.80
MOTS	44.43	73.11	54.46	82.64	57.06	82.64	68.63	81.17	65.80	78.48	62.09	73.59
HV-MOTS	44.44	73.11	58.19	87.29	64.62	90.22	83.73	91.20	86.32	91.93	87.17	92.91

Additive noise (SNR)


10 dB	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____
1-NN	28.72	50.86	35.08	64.55	39.36	71.88	42.33	71.39	44.93	71.88	43.53	73.11
5-NN	30.60	51.34	35.79	66.75	39.77	73.84	43.91	67.97	46.46	69.68	45.20	70.91
MOTS	28.73	50.86	36.45	60.88	41.47	62.59	44.93	60.39	44.68	58.92	42.48	53.30
HV-MOTS	28.68	50.86	37.50	67.48	42.38	72.13	44.41	72.13	46.90	72.86	47.77	73.11


20 dB	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____
1-NN	28.72	50.86	35.08	64.55	39.36	71.88	42.33	71.39	44.93	71.88	43.53	73.84
5-NN	30.60	51.34	35.79	66.75	39.77	66.75	43.91	67.97	46.46	70.91	45.20	75.06
MOTS	28.73	50.86	36.45	60.88	41.47	62.59	44.93	60.39	44.68	58.92	42.48	53.30
HV-MOTS	28.68	50.86	37.50	67.48	42.38	72.13	44.41	72.13	46.90	72.86	47.77	75.06


30 dB	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____
1-NN	35.47	71.15	44.39	78.73	49.53	81.17	63.99	82.40	67.48	83.37	67.10	83.37
5-NN	36.97	66.99	44.19	74.33	48.48	78.00	62.96	81.17	65.78	82.40	65.68	83.37
MOTS	35.38	71.15	45.22	70.42	49.36	70.91	55.59	68.22	52.97	66.26	48.91	60.64
HV-MOTS	35.46	71.15	47.71	77.51	54.10	80.69	65.80	81.42	69.23	83.37	70.06	83.37

Telephone filtering


	______	1_____	______	2_____	______	3_____	______	4_____	______	5_____	______	6_____
1-NN	44.43	76.49	53.93	85.29	58.38	88.51	80.00	89.98	82.64	90.95	83.30	89.98
5-NN	45.48	72.51	53.01	83.86	56.60	85.33	76.96	86.80	79.36	87.04	80.05	87.04
MOTS	44.46	76.49	54.47	82.88	57.07	82.64	68.64	81.17	65.80	78.48	62.09	73.59
HV-MOTS	44.46	76.49	58.20	87.29	64.64	90.22	83.78	91.20	86.37	91.93	87.21	93.15