Composite Computer Rankings and Correlations

3 April 2019

My initial analysis of the computer ratings included nine rankings. With the input compiled by Dr. Massey on April 3nd we now have 12 input rankings. This directly affects the Bucklin Majority composite: instead of the 5th-best rank for each team it selects the 7th-best.
∑Dist ISRKLKMASDIIFMGMGSRTSAGDOKMORNOLRPI
26766BMaj101410281184131114151966218123562965331239694065
26823Cond10119871135125514602055216023592980332839734120
27525Borda119512151345139315512234202824292966322338704076
27851Mcomp124512851364144016002280203524623004324038164080

Having ordered the composite rankings in terms of increasing cumulative number of discordant pairs vis a vis the computer rankings, we plot the percentage of concordant pairs for each computer ranking against each composite.

3 Apr updated corr to composite
1-ISR 2-KLK 3-MAS 4-DII 5-FMG 6-MGS 7-RT 8-SAG 9-DOK 10-MOR 11-NOL 12-RPI
The first five and next three ratings seem to relate to the composites in about the same way and it looks like there are two or three more groups. When we compare the ratings to each other we can order them by their average correlation to the others, and for each we can order the others by most-like to least-like the rating.
CondBordaMcompISRKLKMASDIIFMGMGSRTSAGDOKMORNOLRPI
BMaj989898629846974397409705967696539529948194429305922790799057
Cond 99089893976197669733970696609526950394589319924190969062
Borda  9975972997249695968496499495954294529331927391289082
Mcomp   972097119693967696409488954394479325927291439083
ISR    96819711959295529561933995259159907790319104
KLK     9624962296089505940393799292917489859013
MAS      959494929469938494979148908691128986
DII       95269401934693679426921489488989
FMG        9516942892369304925989438901
MGS         918492389109907388518879
RT          91619226932891348933
SAG           8933883789519119
DOK            940386998659
MOR             88328546
NOL              8735
And here we show the computer ranking order based upon that table, from most-like to least-like.
Best%Avg%Worst%RatingMost
like
Least
like
97.1193.9490.31ISRMASKLKDIIMGSFMGSAGRTDOKRPIMORNOL
96.8193.8989.59KLKISRMASDIIFMGMGSRTSAGDOKMORRPINOL
97.1193.7389.86MASISRKLKDIISAGFMGMGSRTDOKNOLMORRPI
96.2293.6689.48DIIKLKMASISRFMGDOKMGSSAGRTMORRPINOL
96.0893.4289.01FMGKLKISRDIIMGSMASRTDOKMORSAGNOLRPI
94.2892.6189.33RTFMGKLKMASDIIISRMORDOKMGSSAGNOLRPI
95.6192.5388.51MGSISRFMGKLKMASDIISAGRTDOKMORRPINOL
95.2592.0488.37SAGISRMASKLKDIIMGSFMGRTRPINOLDOKMOR
94.2691.2386.59DOKDIIMORFMGKLKRTISRMASMGSSAGNOLRPI
94.0390.7585.46MORDOKRTFMGDIIKLKMASISRMGSSAGNOLRPI
91.3489.2986.99NOLRTMASISRKLKSAGDIIFMGMGSMORRPIDOK
91.1988.9785.46RPISAGISRKLKDIIMASRTFMGMGSNOLDOKMOR
The "other" ratings that are more like the given rating than its average "like-ness" are highlighted.

Other rank-correlations

Above I used the cumulative total distance (number of discordant pairs) over all the computer rankings for the initial ranking order, and the percentage of concordant pairs for the measure of "like-ness." There are other correlations based upon the notion of concordant and discordant pairs and here are two that I also calculate.
Kendall's τ (tau)
τ = #Concordant pairs − #Discordant pairs

½ × #Ranked × (#Ranked−1)

Goodman and Kruskal's γ (gamma)
γ = #Concordant pairs − #Discordant pairs

#Concordant pairs + #Discordant pairs
These give -1 ≤ { τ, γ } ≤ 1 with |τ| ≤ |γ|. Both will be -1 if the teams are in exactly reverse order, 0 if the relationship is perfectly random (whatever that means!) and +1 if the rankings are identical. The τ and γ are the same if there are no ties (but notice that ties in the Majority Consensus rank are to be expected, in which case τ will be closer to zero than γ.)
Average tau-correlation to computers
We see that had I used average tau instead of cumulative distance to order the rankings we'd have had the Condorcet consensus ahead of the Bucklin majority and RT ahead of MGS.
Computer ranking tau correlations
1-ISR 2-KLK 3-MAS 4-DII 5-FMG 6-MGS 7-RT 8-SAG 9-DOK 10-MOR 11-NOL 12-RPI
The same changes result from the gamma correlation.
Average gamma-correlation to computers
Computer ranking gamma correlations
1-ISR 2-KLK 3-MAS 4-DII 5-FMG 6-MGS 7-RT 8-SAG 9-DOK 10-MOR 11-NOL 12-RPI

I report the extra "composite" rankings as Computer Ranking Composites including a table of distances between pairs of ranking after the report by team.

© Copyright 2019 Paul Kislanko