Three Concepts: Probability, The Projects

Round 3: Results

The Contestants

Here are the participating teams with their scientists:

Team   Scientist
Team 3CP-A   TiedeUrpo
Team 3CP-B   Prophets
Team 3CP-C   OmaScientist8
Team 3CP-D   Hehkutus
Team 3CP-E   M15
Team 3CP-F   NeuralScientist
Team 3CP-G   Gargamel

The Trial

Each scientist was tested against a set of fifteen distributions. Each distribution was tried eleven times independently with different random seeds. Identical seeds were used with all the competitors.

The Results

Here are the results. Listed are the medians of the runs and corresponding standard deviations in the parenthesis. Columns are the distributions having not so evident, yet not arbitrary names. Now, drums please!

TiedeUrpo Prophets OmaScientist8 Hehkutus M15 NeuralScientist Gargamel
Data1 1363 (936.0) 1275 (419.2) 1447 (6844.5) 1196 (7615.2) 1345 (402459.0) 1070 (521945.3) 2358 (13120.8)
Data2 371 (208.3) 627 (279.0) 480 (193.6) 441 (5356.5) 393 (181.6) 414 (404356.1) 917 (813.5)
Data3 449 (355.1) 1131 (290.6) 2076 (1073.8) 964 (564.4) 968 (1437.2) 584 (930.7) 2024 (5512.0)
Data4 239 (73.1) 293 (97.1) 192 (73.7) 239 (136.8) 260 (90.5) 215 (61.7) 526 (153.8)
Data5 291 (362.4) 545 (231.1) 327 (210.1) 175 (479.9) 294 (209.0) 353 (271.8) 516 (793.8)
Data6 300 (362.1) 1049 (871.4) 428 (250.3) 523 (506.5) 502 (15487.5) 406 (191.1) 4186 (15316.4)
Data7 3484 (2496.3) 7099 (2150.2) 1000000 (0.0) 79418 (3775.9) 1000000 (0.0) 3745 (19840.3) 1000000 (0.0)
Data8 687 (904.9) 834 (417.6) 755 (3065.0) 6471 (8067.8) 526 (404306.1) 678 (504282.6) 1056 (4545.0)
Data9 1819 (1005.7) 2439 (1028.6) 2065 (1143.0) 2324 (3167.3) 5422 (138617.0) 1160 (466462.3) 6245 (11002.4)
Data10 50 (7.8) 60 (3.6) 46 (18.0) 53 (11.3) 54 (14.5) 36 (6.7) 45 (9.5)
Data11 1119 (559.5) 2641 (1721.9) 1590 (801.4) 3261 (51416.6) 1207 (300884.7) 1032 (509.1) 9315 (8152.5)
Data12 225 (72.0) 383 (217.0) 296 (331.8) 252 (121.3) 261 (168.2) 270 (133.0) 839 (1405.9)
Data13 280 (155.0) 370 (68.1) 903 (300343.0) 405 (1998.4) 549 (404297.6) 468 (466885.0) 690 (1192.7)
Data14 341 (143493.8) 670 (273.1) 543 (3570.2) 507 (1107.4) 450 (301370.1) 585 (466846.2) 598 (10323.5)
Data15 227 (572.1) 187 (36.3) 166 (10809.6) 249 (1499.2) 637 (522084.4) 123 (404471.6) 487 (1981.4)

Round 3: Hall of Fame

Here's the ranking after round 3. We ordered the scientists per every distribution by the medians shown above and took the average position over the distributions as the final rank. As an interesting sidenote, lines of code and averaged guessing speed are reported for each scientist.

Avr. Ranking    Scientist LoC  Guesses/second
2.1 TiedeUrpo 702 7500
2.4 NeuralScientist 162 27000
3.8 Hehkutus 209 1900
4.0 M15 114 13500
4.2 OmaScientist8  173 21900
5.1 Prophets 265 4400
5.8 Gargamel 432 18900

 

 Three Concepts: Probability
2006