Complete results: relevance

Team Tag Mean nDCG@5 CI95 Low CI95 High
Porthos scl_dlm_bqnc_acl_nsp 0.742 0.670 0.807
Daario Naharis INTSEG-Letter-no_stoplist-Krovetz-Icoef-Evidence-Par 0.683 0.609 0.755
Daario Naharis INTSEG-Run-Whitespace-Krovetz-Stoplist-Pos-Evidence-icoeff-Sep 0.676 0.587 0.762
Daario Naharis INTSEG-Run-letter-english-2-20-no_stoplist-pos-evidence-icoef-An 0.670 0.589 0.751
Bruce Banner Bruce-Banner_pyserinin_sparse_v3 0.651 0.573 0.720
D Artagnan seupd2122-6musk-kstem-stop-shingle3 0.642 0.575 0.705
Bruce Banner Bruce-Banner_pyserinin_sparse_v1 0.641 0.575 0.705
Daario Naharis INTSEG-Whitespace-Stoplist-Krovetz-Icoef-Sep 0.629 0.549 0.706
Gamora seupd2122-javacafe-gamoraHeuristicsOnlyQueryReductionDoubleIndex 0.616 0.551 0.687
D Artagnan seupd2122-6musk-stop-wordnet-kstem-dirichlet 0.608 0.542 0.682
D Artagnan seupd2122-6musk-stop-kstem-concsearch 0.591 0.514 0.667
Hit Girl Io 0.588 0.515 0.657
Gamora seupd2122-javacafe-gamoraStandardDoubleIndex 0.588 0.518 0.655
Bruce Banner Bruce-Banner_pyserinin_sparse_v4 0.586 0.509 0.658
D Artagnan seupd2122-6musk-word2vec-sentences-kstem 0.585 0.506 0.661
Gamora seupd2122-javacafe-gamoraHeuristicsDoubleIndex 0.584 0.512 0.656
Hit Girl Ganymede 0.583 0.513 0.650
Bruce Banner Bruce-Banner_pyserinin_sparse_v2 0.580 0.507 0.654
Hit Girl Jupiter 0.560 0.484 0.631
Hit Girl Europa 0.546 0.477 0.615
Gamora seupd2122-javacafe-gamora_tfidf_kstemstopengpos_multi_YYY 0.516 0.446 0.581
Gamora seupd2122-javacafe-gamora_sbert_kstemstopengpos_multi_YYY 0.497 0.407 0.586
Pearl PearlBlocklist_WeightedRelevance 0.481 0.399 0.560
Pearl PearlArgRank8040_WeightedRelevance 0.479 0.403 0.556
Pearl PearlArgRank7530 0.470 0.391 0.547
Pearl PearlBlocklist 0.466 0.380 0.549
Pearl PearlArgRank8040 0.465 0.389 0.551
Gorgon GorgonA2Bm25 0.408 0.354 0.461
Daario Naharis INTSEG-Run-Whitespace-Porter-Wordnet-Pos-no_stoplist-tfidf-An 0.406 0.305 0.510
General Grievous seupd2122-lgtm_QE_NRR 0.403 0.335 0.471
General Grievous seupd2122-lgtm_NQE_NRR 0.402 0.335 0.476
Gorgon GorgonA1Bm25 0.396 0.350 0.442
Gorgon GorgonBasicBM25 0.387 0.330 0.439
General Grievous seupd2122-lgtm_NQE_NRR_ONLY_TITLE 0.386 0.314 0.451
General Grievous seupd2122-lgtm_QE_NRR_ONLY_TITLE 0.386 0.317 0.450
Gorgon GorgonKEBM25 0.378 0.329 0.428
Swordsman baseline_swordsman 0.356 0.296 0.412
Gorgon GorgonBasicLMD 0.315 0.269 0.362
D Artagnan seupd2122-6musk-stop-kstem-basic 0.300 0.229 0.369
Korg korg9000 0.252 0.187 0.318
Porthos scl_dlm_bqnc_acl_nsp_100_test 0.244 0.215 0.275