Team Tag Mean nDCG@5 CI95 Low CI95 High
Elrond ElrondKRun 0.720 0.654 0.782
Pippin Took seupd2021-rck-stop-kstem-doShingle-false-shingle-size-0-Dirichlet-mu-2000.0-topics-2021 0.705 0.635 0.771
Pippin Took seupd2021-rck-stop-kstem-doShingle-false-shingle-size-0-Dirichlet-mu-1500.0-topics-2021 0.702 0.636 0.768
Pippin Took seupd2021-rck-stop-kstem-doShingle-false-shingle-size-0-Dirichlet-mu-1800.0-topics-2021 0.701 0.628 0.769
Robin Hood robinhood_combined 0.691 0.627 0.759
Pippin Took seupd2021-rck-stop-kstem-doShingle-false-shingle-size-0-Dirichlet-mu-2000.0-expanded-topics-2021 0.688 0.615 0.760
Pippin Took seupd2021-rck-stop-kstem-doShingle-false-shingle-size-0-Dirichlet-mu-1800.0-expanded-topics-2021 0.683 0.607 0.761
Asterix run2021_Mixed_1.625_1.0_250 0.681 0.622 0.747
Dread Pirate Roberts dreadpirateroberts_lambdamart_small_features 0.678 0.607 0.746
Asterix run2021_Mixed_1.375_1.0_250 0.676 0.616 0.737
Elrond ElrondOpenNlpRun 0.674 0.594 0.749
Asterix run2021_Mixed_1.5_1.0_250 0.674 0.610 0.734
Elrond ElrondSimpleRun 0.674 0.610 0.737
Robin Hood robinhood_use 0.672 0.609 0.730
Skeletor bm25-0.7semantic 0.667 0.597 0.736
Skeletor manifold-c10 0.666 0.591 0.735
Skeletor manifold 0.666 0.590 0.739
Asterix run2021_Jolly_10.0_0.0_0.3_0.0__1.5_1.0_300 0.663 0.599 0.725
Luke Skywalker luke-skywalker 0.662 0.593 0.727
Skeletor bm25 0.661 0.587 0.736
Shanks re-rank2 0.658 0.596 0.716
Heimdall argrank_r1_c10.0_q5.0 0.648 0.574 0.721
Dread Pirate Roberts dreadpirateroberts_lambdamart_medium_features 0.647 0.573 0.714
Robin Hood robinhood_baseline 0.641 0.573 0.710
Heimdall argrank_r1_c10.0_q10.0 0.639 0.572 0.708
Shanks re-rank1 0.639 0.575 0.701
Shanks LMDSimilarity 0.639 0.571 0.706
Athos uh-t1-athos-lucenetfidf 0.637 0.566 0.712
Heimdall argrank_r1_c5.0_q10.0 0.637 0.563 0.705
Goemon Ishikawa goemon2021-dirichlet-lucenetoken-atirestop-nostem 0.635 0.565 0.704
Jean Pierre Polnareff seupd-jpp-dirichlet 0.633 0.558 0.703
Goemon Ishikawa goemon2021-dirichlet-opennlptoken-terrierstop-nostem 0.630 0.565 0.694
Baseline Dirichlet dirichlet_multi_field 0.626 0.550 0.691
Dread Pirate Roberts dreadpirateroberts_dirichlet_filtered 0.626 0.557 0.696
Goemon Ishikawa goemon2021-dirichlet-lucenetoken-terrierstop-nostem-queryexp 0.625 0.557 0.694
Yeagerists run_4_chocolate-sweep-50 0.625 0.550 0.690
Yeagerists run_2_lunar-sweep-201 0.624 0.555 0.696
Hua Mulan args_naiveexpansion_0 0.620 0.549 0.685
Hua Mulan args_gpt2expansion_0 0.620 0.545 0.685
Goemon Ishikawa goemon2021-dirichlet-lucenetoken-lucenestop-nostem 0.620 0.545 0.687
Elrond ElrondTaskBodyRun 0.614 0.545 0.681
Robin Hood robinhood_rm3 0.611 0.532 0.691
Macbeth macbethPretrainedBaseline 0.611 0.529 0.690
Yeagerists run_3_lunar-sweep-58 0.610 0.542 0.684
Yeagerists run_1_lucene_pure_rev 0.609 0.541 0.675
Macbeth macbethBM25CrossEncoder 0.608 0.533 0.684
Macbeth macbethBM25BiEncoderCrossEncoder 0.607 0.527 0.679
Baseline Api ARGSME 0.607 0.536 0.679
Goemon Ishikawa goemon2021-dirichlet-lucenetoken-lucenestop-nostem-queryexp 0.607 0.536 0.681
Blade bladeGroupBM25Method1 0.601 0.528 0.676
Shanks multi-1 0.592 0.518 0.659
Shanks multi-2 0.590 0.519 0.660
Blade bladeGroupLMDirichlet 0.588 0.519 0.664
Dread Pirate Roberts dreadpirateroberts_run_mlm 0.577 0.497 0.646
Skeletor semantic 0.570 0.512 0.630
Asterix run2021_Baseline_BM25 0.566 0.508 0.623
Dread Pirate Roberts dreadpirateroberts_universal-sentence-encoder-qa 0.557 0.498 0.615
Deadpool uh-t1-deadpool 0.557 0.483 0.636
Macbeth macbethBM25AugmentedBiEncoderCrossEncoder 0.554 0.484 0.627
Yeagerists run_5_good-sweep-85 0.536 0.457 0.617
Blade bladeGroupBM25Method2 0.528 0.440 0.609
Batman DE_RE_Analyzer_4r100 0.528 0.465 0.598
Little Foot whoosh 0.521 0.444 0.600
Hua Mulan args_t5expansion_0 0.518 0.446 0.588
Macbeth macbethBiEncoderCrossEncoder 0.507 0.432 0.577
Gandalf BM25F-gandalf 0.486 0.416 0.555
Palpatine run 0.401 0.326 0.474
Batman ER_v1 0.397 0.313 0.491
Heimdall argrank_r0_c0.1_q5.0 0.004 0.000 0.013
Heimdall argrank_r0_c0.01_q5.0 0.000 0.000 0.000
Batman ER_Analyzer_5 0.000 0.000 0.000