All software was submitted to TIRA.
Place one arguments.tsv
from the dataset in a directory input
. For example:
mkdir input
wget https://zenodo.org/record/7550385/files/arguments-test.tsv -O input/arguments.tsv
Then run the software as described below to produce results in the directory output
(requires Docker). Commands are given for UNIX-like systems and have to be adapted for Windows.
aristotle
adam-smith
augustine-of-hippo
confucius
johann-friedrich-herbart
mao-zedong
niccolo-machiavelli
seyyed-hossein-nasr
t-m-scanlon
aristotle
See generic instructions above
1-baseline
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:aristotle-touche-human-value-detection-1-baseline-1-0-0-tira-docker-software-id-brilliant-ice -c 'python3 /1-baseline.py --inputDataset /tira-data/input --outputDataset /tira-data/output'
BERT cuda
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:aristotle-touche-human-value-detection-bert-1-0-1-cuda11-3-tira-docker-software-id-vicious-coverage -c 'python3 /app/predict.py --inputDataset /tira-data/input --outputDir /tira-data/output'
BERT nocuda
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:aristotle-touche-human-value-detection-bert-1-0-1-nocuda-tira-docker-software-id-savory-ton -c 'python3 /app/predict.py --inputDataset /tira-data/input --outputDir /tira-data/output'
Random baseline
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:aristotle-touche-human-value-detection-random-baseline-1-0-0-tira-docker-software-id-muted-banner -c 'python3 /random-baseline.py --inputDataset /tira-data/input --outputDataset /tira-data/output'
SVM
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:aristotle-touche-human-value-detection-svm-1-0-2-tira-docker-software-id-quick-magnitude -c 'python3 /app/predict.py --inputDataset /tira-data/input --outputDir /tira-data/output'
adam-smith
See generic instructions above
EN-219-Thres-LoD
[demo] [repository]
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh ghcr.io/webis-de/valueeval23-adam-smith-12:1.0.0-cpu -c 'python3 /app/predict.py --inputDataset /tira-data/input --outputDir /tira-data/output'
augustine-of-hippo
See generic instructions above [repository]
augustine
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:augustine-of-hippo-augustine-of-hippo-0-0-5-tira-docker-software-id-glad-directory -c 'python3 /augustine_of_hippo.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'
mixture-augustine
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:augustine-of-hippo-mixture-augustine-of-hippo-0-0-13-tira-docker-software-id-exothermic-generator -c 'python3 /mixture_augustine_of_hippo.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'
superaske-augustine
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:augustine-of-hippo-superaske-0-0-1-tira-docker-software-id-icy-berry -c 'python3 /augustine_of_hippo.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'
superaske-augustine_2
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:augustine-of-hippo-superaske-0-0-22-tira-docker-software-id-buoyant-procedure -c 'python3 /augustine_of_hippo.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'
confucius
See generic instructions above
chill-beagle
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-confucius-my-software-0-0-7-tira-docker-software-id-timid-list -c 'python /workspace/predict.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'
greedy-column
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-confucius-my-software-0-0-3-tira-docker-software-id-sparse-tab -c 'python /workspace/predict.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'
swift-recipe
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-confucius-my-software-0-0-4-tira-docker-software-id-worn-angel -c 'python /workspace/predict.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'
johann-friedrich-herbart
See generic instructions above
creative-suv
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-johann-friedrich-herbart-johann-friedrich-herbart-0-0-1-tira-docker-software-id-free-edge -c 'python /jf_herbart/script.py --test /tira-data/input/arguments.tsv --checkpoint /jf_herbart/checkpoint.ckpt --out_predictions /tira-data/output/predictions.tsv'
wooden-taping
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-johann-friedrich-herbart-johann-friedrich-herbart-0-0-1-tira-docker-software-id-warm-tree -c 'python script.py --test /tira-data/input/arguments.tsv --checkpoint checkpoint.ckpt --out_predictions /tira-data/output/predictions.tsv'
mao-zedong
See generic instructions above
gold-developer
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-mao-zedong-my-software-0-0-5-tira-docker-software-id-concurrent-legend -c 'python /workspace/predict.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'
hot-outpost
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-mao-zedong-my-software-0-0-6-tira-docker-software-id-tender-support -c 'python /workspace/predict.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'
natural-frequency
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-mao-zedong-my-software-0-0-4-tira-docker-software-id-round-terry -c 'python /workspace/predict.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'
niccolo-machiavelli
See generic instructions above
adjacent-app
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-niccolo-machiavellie-submission-0-2-tira-docker-software-id-convex-sniffer -c '/T4_inference.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'
pointed-vertex
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-niccolo-machiavellie-submission-0-1-tira-docker-software-id-coped-tub -c '/T4_inference.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'
seyyed-hossein-nasr
See generic instructions above
genteel-hair
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-seyyed-hossein-nasr-bert-att-0-0-2-tira-docker-software-id-taxonomic-terrier -c 'python3 /code/app/main.py --inputDataset /tira-data/input --outputDataset /tira-data/output'
t-m-scanlon
See generic instructions above
diachronic-suffix
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-t-m-scanlon-roberta-base-0-0-2-tira-docker-software-id-obsolete-score -c 'python plm/software.py --input /tira-data/input --output /tira-data/output --model_path /home/LanguageModels/roberta-base'
matte-vehicle
docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-t-m-scanlon-roberta-base-0-0-2-tira-docker-software-id-mean-eel -c 'python plm/software.py --input /tira-data/input --output /tira-data/output --model_path /ckp/roberta-base-valid --device cpu'