Dockerized Software for ValueEval’23

All software was submitted to TIRA.

Place one arguments.tsv from the dataset in a directory input. For example:

mkdir input
wget https://zenodo.org/record/7550385/files/arguments-test.tsv -O input/arguments.tsv

Then run the software as described below to produce results in the directory output (requires Docker). Commands are given for UNIX-like systems and have to be adapted for Windows.

List of software

Team aristotle

See generic instructions above

Software 1-baseline

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:aristotle-touche-human-value-detection-1-baseline-1-0-0-tira-docker-software-id-brilliant-ice -c 'python3 /1-baseline.py --inputDataset /tira-data/input --outputDataset /tira-data/output'

Software BERT cuda

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:aristotle-touche-human-value-detection-bert-1-0-1-cuda11-3-tira-docker-software-id-vicious-coverage -c 'python3 /app/predict.py --inputDataset /tira-data/input --outputDir /tira-data/output'

Software BERT nocuda

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:aristotle-touche-human-value-detection-bert-1-0-1-nocuda-tira-docker-software-id-savory-ton -c 'python3 /app/predict.py --inputDataset /tira-data/input --outputDir /tira-data/output'

Software Random baseline

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:aristotle-touche-human-value-detection-random-baseline-1-0-0-tira-docker-software-id-muted-banner -c 'python3 /random-baseline.py --inputDataset /tira-data/input --outputDataset /tira-data/output'

Software SVM

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:aristotle-touche-human-value-detection-svm-1-0-2-tira-docker-software-id-quick-magnitude -c 'python3 /app/predict.py --inputDataset /tira-data/input --outputDir /tira-data/output'

Team adam-smith

See generic instructions above

Software EN-219-Thres-LoD

[demo] [repository]

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh ghcr.io/webis-de/valueeval23-adam-smith-12:1.0.0-cpu -c 'python3 /app/predict.py --inputDataset /tira-data/input --outputDir /tira-data/output'

Team augustine-of-hippo

See generic instructions above [repository]

Software augustine

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:augustine-of-hippo-augustine-of-hippo-0-0-5-tira-docker-software-id-glad-directory -c 'python3 /augustine_of_hippo.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'

Software mixture-augustine

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:augustine-of-hippo-mixture-augustine-of-hippo-0-0-13-tira-docker-software-id-exothermic-generator -c 'python3 /mixture_augustine_of_hippo.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'

Software superaske-augustine

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:augustine-of-hippo-superaske-0-0-1-tira-docker-software-id-icy-berry -c 'python3 /augustine_of_hippo.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'

Software superaske-augustine_2

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:augustine-of-hippo-superaske-0-0-22-tira-docker-software-id-buoyant-procedure -c 'python3 /augustine_of_hippo.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'

Team confucius

See generic instructions above

Software chill-beagle

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-confucius-my-software-0-0-7-tira-docker-software-id-timid-list -c 'python /workspace/predict.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'

Software greedy-column

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-confucius-my-software-0-0-3-tira-docker-software-id-sparse-tab -c 'python /workspace/predict.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'

Software swift-recipe

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-confucius-my-software-0-0-4-tira-docker-software-id-worn-angel -c 'python /workspace/predict.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'

Team johann-friedrich-herbart

See generic instructions above

Software creative-suv

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-johann-friedrich-herbart-johann-friedrich-herbart-0-0-1-tira-docker-software-id-free-edge -c 'python /jf_herbart/script.py --test /tira-data/input/arguments.tsv --checkpoint /jf_herbart/checkpoint.ckpt --out_predictions /tira-data/output/predictions.tsv'

Software wooden-taping

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-johann-friedrich-herbart-johann-friedrich-herbart-0-0-1-tira-docker-software-id-warm-tree -c 'python script.py --test /tira-data/input/arguments.tsv --checkpoint checkpoint.ckpt --out_predictions /tira-data/output/predictions.tsv'

Team mao-zedong

See generic instructions above

Software gold-developer

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-mao-zedong-my-software-0-0-5-tira-docker-software-id-concurrent-legend -c 'python /workspace/predict.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'

Software hot-outpost

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-mao-zedong-my-software-0-0-6-tira-docker-software-id-tender-support -c 'python /workspace/predict.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'

Software natural-frequency

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-mao-zedong-my-software-0-0-4-tira-docker-software-id-round-terry -c 'python /workspace/predict.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'

Team niccolo-machiavelli

See generic instructions above

Software adjacent-app

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-niccolo-machiavellie-submission-0-2-tira-docker-software-id-convex-sniffer -c '/T4_inference.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'

Software pointed-vertex

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-niccolo-machiavellie-submission-0-1-tira-docker-software-id-coped-tub -c '/T4_inference.py --input /tira-data/input/arguments.tsv --output /tira-data/output/predictions.tsv'

Team seyyed-hossein-nasr

See generic instructions above

Software genteel-hair

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-seyyed-hossein-nasr-bert-att-0-0-2-tira-docker-software-id-taxonomic-terrier -c 'python3 /code/app/main.py --inputDataset /tira-data/input --outputDataset /tira-data/output'

Team t-m-scanlon

See generic instructions above

Software diachronic-suffix

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-t-m-scanlon-roberta-base-0-0-2-tira-docker-software-id-obsolete-score -c 'python plm/software.py --input /tira-data/input --output /tira-data/output --model_path /home/LanguageModels/roberta-base'

Software matte-vehicle

docker run --rm -ti -v $PWD/input:/tira-data/input:ro -v $PWD/output:/tira-data/output:rw --entrypoint sh docker.io/webis/valueeval-at-semeval-2023-human-value-detection-submissions:touche23-t-m-scanlon-roberta-base-0-0-2-tira-docker-software-id-mean-eel -c 'python plm/software.py --input /tira-data/input --output /tira-data/output --model_path /ckp/roberta-base-valid --device cpu'