Skip to content.

Find topic


Search text

WS06 topics

Members' area

Tools

Help!

-- KarenLivescu - 15 Dec 2005

WS06 > FeatureTranscriptionAnalysis > FeatureTranscriptionAnalysisAgreementWS06

ALL SVB

Percent Agreement (1st_pass.pp)

feature timeInAgreement timeNotInAgreement obsAgreement expAgreement Kappa
dg1 184.4 24.9 0.881 0.318 0.826
dg2 198.9 10.4 0.950 0.496 0.902
glo 195.3 13.9 0.933 0.490 0.869
nas 200.4 8.9 0.958 0.887 0.626
pl1 184.7 24.6 0.883 0.309 0.830
pl2 198.9 10.3 0.951 0.497 0.902
rd 197.6 11.7 0.944 0.831 0.670
vow 178.7 30.6 0.854 0.513 0.700
TOTAL 1538.8 135.2 0.919 0.543 0.823

Levenshtein Distance (1st_pass.pp)

feature sed obsAgreement expAgreement kappa
dg1 0.1593 0.8407 0.1979 0.8014
dg2 0.1168 0.8832 0.3985 0.8059
glo 0.1967 0.8033 0.3227 0.7095
nas 0.0933 0.9067 0.4739 0.8227
pl1 0.1429 0.8571 0.1736 0.8271
pl2 0.1000 0.9000 0.4048 0.8320
rd 0.3026 0.6581 0.3078 0.5061
vow 0.2750 0.7209 0.1874 0.6565
total 0.1874 0.8084 0.2483 0.7452

Percent Agreement (2nd_pass)

feature timeInAgreement timeNotInAgreement obsAgreement expAgreement Kappa
dg1 186.2 23.1 0.890 0.317 0.839
dg2 198.5 10.8 0.949 0.496 0.898
glo 198.5 10.7 0.949 0.487 0.900
nas 201.5 7.7 0.963 0.880 0.692
pl1 186.4 22.8 0.891 0.309 0.842
pl2 198.5 10.8 0.949 0.496 0.898
rd 197.5 11.8 0.944 0.821 0.685
vow 185.1 24.2 0.885 0.515 0.762
TOTAL 1552.2 121.9 0.927 0.540 0.842

Levenshtein Distance (2nd_pass)

feature sed obsAgreement expAgreement kappa
dg1 0.1411 0.8589 0.1993 0.8238
dg2 0.1952 0.8048 0.3819 0.6842
glo 0.1705 0.8327 0.3238 0.7526
nas 0.0535 0.9465 0.4943 0.8942
pl1 0.1232 0.8768 0.1738 0.8508
pl2 0.1728 0.8272 0.3980 0.7129
rd 0.2231 0.7748 0.3950 0.6278
vow 0.2096 0.7897 0.2033 0.7361
total 0.1599 0.8402 0.2575 0.7848

Percent Agreement (3rd_pass)

feature timeInAgreement timeNotInAgreement obsAgreement expAgreement Kappa
dg1 186.6 22.6 0.892 0.318 0.842
dg2 198.1 11.1 0.947 0.496 0.895
glo 199.6 9.7 0.954 0.487 0.910
nas 201.7 7.6 0.964 0.878 0.702
pl1 187.1 22.1 0.894 0.310 0.847
pl2 198.1 11.2 0.947 0.496 0.894
rd 199.0 10.2 0.951 0.818 0.732
vow 185.7 23.6 0.887 0.516 0.767
TOTAL 1556.0 118.1 0.929 0.540 0.847

Levenshtein Distance (3rd_pass)

feature sed obsAgreement expAgreement kappa
dg1 0.1346 0.8654 0.1996 0.8319
dg2 0.1957 0.8043 0.3875 0.6804
glo 0.1609 0.8442 0.3275 0.7683
nas 0.0272 0.9728 0.5079 0.9448
pl1 0.1189 0.8811 0.1746 0.8560
pl2 0.1883 0.8117 0.3927 0.6900
rd 0.1634 0.8366 0.4320 0.7124
vow 0.1950 0.8043 0.2072 0.7532
total 0.1483 0.8522 0.2615 0.7998

Percent Agreement (final)

feature timeInAgreement timeNotInAgreement obsAgreement expAgreement Kappa
dg1 186.7 22.6 0.892 0.318 0.842
dg2 198.2 11.1 0.947 0.496 0.895
glo 199.6 9.7 0.954 0.487 0.910
nas 202.0 7.3 0.965 0.879 0.710
pl1 187.1 22.2 0.894 0.310 0.847
pl2 198.1 11.1 0.947 0.496 0.895
rd 199.5 9.7 0.953 0.820 0.741
vow 185.7 23.5 0.888 0.516 0.767
TOTAL 1556.9 117.2 0.930 0.540 0.848

Levenshtein Distance (final)

feature sed obsAgreement expAgreement kappa
dg1 0.1358 0.8642 0.1995 0.8303
dg2 0.1908 0.8092 0.3912 0.6867
glo 0.1622 0.8429 0.3270 0.7666
nas 0.0219 0.9781 0.5118 0.9552
pl1 0.1196 0.8804 0.1744 0.8552
pl2 0.1832 0.8168 0.3966 0.6963
rd 0.1571 0.8429 0.4367 0.7211
vow 0.1921 0.8079 0.2090 0.7572
total 0.1471 0.8535 0.2624 0.8014

STP all-feature

Percent Agreement (1st_pass.pp)

feature timeInAgreement timeNotInAgreement obsAgreement expAgreement Kappa
dg1 9.2 4.2 0.685 0.247 0.581
dg2 6.9 6.5 0.516 0.433 0.147
glo 9.6 3.7 0.721 0.333 0.582
nas 10.9 2.4 0.818 0.649 0.480
pl1 9.4 4.0 0.703 0.228 0.616
pl2 7.4 6.0 0.552 0.463 0.166
rd 9.3 4.0 0.700 0.577 0.289
vow 8.8 4.4 0.666 0.216 0.575
TOTAL 71.4 35.2 0.670 0.393 0.456

feature sed obsAgreement expAgreement kappa
dg1 0.3125 0.6812 0.1770 0.6127
dg2 0.7391 0.2609 0.0766 0.1996
glo 0.3036 0.6518 0.1953 0.5673
nas 0.1591 0.7273 0.3017 0.6095
pl1 0.2812 0.7109 0.1480 0.6607
pl2 0.7209 0.2791 0.0817 0.2150
rd 0.2941 0.5588 0.2353 0.4231
vow 0.2296 0.7333 0.1530 0.6852
total 0.3319 0.6368 0.1682 0.5633

Percent Agreement (3rd_pass)

feature timeInAgreement timeNotInAgreement obsAgreement expAgreement Kappa
dg1 12.1 1.2 0.911 0.277 0.876
dg2 13.2 0.1 0.989 0.745 0.957
glo 12.0 1.3 0.906 0.420 0.837
nas 12.6 0.7 0.946 0.797 0.733
pl1 12.2 1.1 0.920 0.248 0.894
pl2 13.2 0.1 0.989 0.745 0.958
rd 12.6 0.7 0.946 0.825 0.693
vow 11.1 2.2 0.831 0.299 0.759
TOTAL 99.0 7.5 0.930 0.544 0.846

feature sed obsAgreement expAgreement kappa
dg1 0.1364 0.8636 0.2070 0.8280
dg2 0.2692 0.7308 0.2648 0.6338
glo 0.1753 0.8247 0.2658 0.7613
nas 0.1538 0.8462 0.3879 0.7487
pl1 0.1343 0.8657 0.1617 0.8398
pl2 0.2692 0.7308 0.2648 0.6338
rd 0.3429 0.6571 0.3012 0.5093
vow 0.2174 0.7826 0.1797 0.7350
total 0.1818 0.8182 0.2212 0.7665

Percent Agreement (final)

feature timeInAgreement timeNotInAgreement obsAgreement expAgreement Kappa
dg1 12.1 1.2 0.911 0.277 0.876
dg2 13.2 0.1 0.989 0.745 0.957
glo 12.0 1.3 0.906 0.420 0.837
nas 12.6 0.7 0.946 0.797 0.733
pl1 12.2 1.1 0.920 0.248 0.894
pl2 13.2 0.1 0.989 0.745 0.958
rd 12.6 0.7 0.946 0.825 0.693
vow 11.1 2.2 0.831 0.299 0.759
TOTAL 99.0 7.5 0.930 0.544 0.846

feature sed obsAgreement expAgreement kappa
dg1 0.1364 0.8636 0.2070 0.8280
dg2 0.2692 0.7308 0.2648 0.6338
glo 0.1753 0.8247 0.2658 0.7613
nas 0.1538 0.8462 0.3879 0.7487
pl1 0.1343 0.8657 0.1617 0.8398
pl2 0.2692 0.7308 0.2648 0.6338
rd 0.3429 0.6571 0.3012 0.5093
vow 0.2174 0.7826 0.1797 0.7350
total 0.1818 0.8182 0.2212 0.7665

STP hybrid

Percent Agreement (1st_pass.pp)

feature timeInAgreement timeNotInAgreement obsAgreement expAgreement Kappa
dg1 8.0 4.3 0.647 0.183 0.568
dg2 9.0 3.3 0.730 0.514 0.444
glo 8.8 3.5 0.718 0.389 0.537
nas 9.1 3.2 0.742 0.684 0.183
pl1 8.1 4.2 0.661 0.169 0.591
pl2 9.0 3.3 0.730 0.515 0.443
rd 8.2 4.1 0.667 0.517 0.311
vow 8.0 4.3 0.653 0.251 0.538
TOTAL 68.2 30.1 0.693 0.403 0.487

feature sed obsAgreement expAgreement kappa
dg1 0.2147 0.7853 0.1777 0.7389
dg2 0.3214 0.6786 0.2806 0.5532
glo 0.2931 0.7069 0.2970 0.5831
nas 0.1613 0.8387 0.3871 0.7368
pl1 0.2185 0.7815 0.1655 0.7381
pl2 0.2692 0.7308 0.3092 0.6103
rd 0.2586 0.5345 0.2396 0.3878
vow 0.2481 0.7143 0.1927 0.6461
total 0.2377 0.7361 0.2139 0.6643

Percent Agreement (3rd_pass)

feature timeInAgreement timeNotInAgreement obsAgreement expAgreement Kappa
dg1 11.1 1.2 0.899 0.249 0.866
dg2 12.0 0.3 0.978 0.680 0.932
glo 11.7 0.6 0.954 0.518 0.904
nas 12.1 0.2 0.982 0.910 0.798
pl1 11.2 1.1 0.909 0.236 0.881
pl2 12.0 0.3 0.979 0.680 0.934
rd 11.6 0.7 0.945 0.742 0.789
vow 10.6 1.7 0.859 0.335 0.789
TOTAL 92.2 6.1 0.938 0.544 0.865

feature sed obsAgreement expAgreement kappa
dg1 0.0848 0.9152 0.1965 0.8944
dg2 0.2414 0.7586 0.2818 0.6639
glo 0.0862 0.9224 0.3537 0.8799
nas 0.0714 0.9286 0.4745 0.8641
pl1 0.0724 0.9276 0.1927 0.9104
pl2 0.2143 0.7857 0.3010 0.6934
rd 0.1364 0.8636 0.4360 0.7582
vow 0.1756 0.8244 0.2388 0.7693
total 0.1165 0.8843 0.2560 0.8444

Percent Agreement (final)

feature timeInAgreement timeNotInAgreement obsAgreement expAgreement Kappa
dg1 11.1 1.2 0.899 0.249 0.866
dg2 12.0 0.3 0.978 0.680 0.932
glo 11.7 0.6 0.954 0.518 0.904
nas 12.1 0.2 0.982 0.910 0.798
pl1 11.2 1.1 0.909 0.236 0.881
pl2 12.0 0.3 0.979 0.680 0.934
rd 11.6 0.7 0.945 0.742 0.789
vow 10.6 1.7 0.859 0.335 0.789
TOTAL 92.2 6.1 0.938 0.544 0.865

feature sed obsAgreement expAgreement kappa
dg1 0.0848 0.9152 0.1965 0.8944
dg2 0.2414 0.7586 0.2818 0.6639
glo 0.0862 0.9224 0.3537 0.8799
nas 0.0714 0.9286 0.4745 0.8641
pl1 0.0724 0.9276 0.1927 0.9104
pl2 0.2143 0.7857 0.3010 0.6934
rd 0.1364 0.8636 0.4360 0.7582
vow 0.1756 0.8244 0.2388 0.7693
total 0.1165 0.8843 0.2560 0.8444

| Edit  | Attach | Printable | More...
Revised: r1.5 - 24 Jul 2006 - 15:28 - NashBorges
 
Referrers to this page | View raw text |  Revision history | r1.5 | > | r1.4 | > | r1.3
You are logged in as: TWikiGuest