TextDetox Multilingual Toxicity Dataset (All Languages)
A TextDetox 2024/2025 shared task (15 languages) dataset of 71,374 posts across 15 languages with binary toxicity labels, collected by Dementieva et al. for PAN/CLEF TextDetox 2024. Each record contains post text, binary toxicity label (0=non-toxic, 1=toxic), language. Combined multilingual toxicity benchmark covering 15 languages including low-resource languages (Amharic, Tatar, Hindglish) — 71,374 balanced samples total. Suitable for multilingual toxicity detection, cross-lingual transfer learning, low-resource NLP, content moderation benchmarking.
Cite this dataset at
textdetox-all.echo.directory
Analytics
Topic 0
Topic 1
Topic 2
Topic 3
Topic 4
Topic 5
Topic 6
Topic 7
Topic 8
Topic 9
Topic 10
Topic 11
Show all 16 topics
Topic 12
Topic 13
Topic 14
Topic 15
Computed over the full corpus.
Record
- Catalog key
textdetox-all- Authors
- Dementieva, Daryna; Moskovskiy, Daniil; Logacheva, Varvara; Dale, David; Ustalov, Dmitry; Panchenko, Alexander
- Year
- 2024
- Source paper
- Overview of the Multilingual Text Detoxification Task at PAN 2024
- DOI / arXiv
- 10.1007/978-3-031-71908-0_11
- License
- OpenRAIL++ (Hugging Face card) (LicenseRef-OpenRAIL-plus-plus)
- Records
- 71,374
- Languages
- am, ar, de, en, es, fr, he, hi, hin, it, ja, ru, tt, uk, zh
- Collected
- 2024 (2020s)
- Tasks
- Toxicity detection (binary;
is_toxic) inferred
Provenance
- Originally published at
- https://huggingface.co/datasets/textdetox/multilingual_toxicity_dataset link checked
- Hosted copy
- Mirrored on echo.directory on 2026-10-02, 6.5 MB across 15 files. Checksums in MANIFEST.json.
Citations
Overview of PAN 2024: Multi-author Writing Style Analysis, Multilingual Text Detoxification, Oppositional Thinking Analysis, and Generative AI Authorship Verification Condensed Lab Overview
A. Ayele, N. Babakov, Janek Bevendorff, Xavier Bonet Casals, Berta Chulvi
Journal Article · Conference and Labs of the Evaluation Forum · 2024
Cited by
- Overview of PAN 2025: Voight-Kampff Generative AI Detection, Multilingual Text Detoxification, Multi-author Writing Style Analysis, and Generative Plagiarism Detection
Janek Bevendorff, Daryna Dementieva et al. · Conference and Labs of the Evaluation Forum · 2025 · cited 54× - Overview of the "Voight-Kampff" Generative AI Authorship Verification Task at PAN and ELOQUENT 2025
Janek Bevendorff, Yu-Xia Wang et al. · Conference and Labs of the Evaluation Forum · 2025 · cited 43× - Diversity Boosts AI-Generated Text Detection
Advik Raj Basani, Pin-Yu Chen · Trans. Mach. Learn. Res. · 2025 · cited 9× - Generative AI Authorship Verification Based on Contrastive-Enhanced Dual-Model Decision System
Jun-Lang Liu, Lei-Lei Kong et al. · Conference and Labs of the Evaluation Forum · 2025 · cited 8× - elfen: A Python Package for Efficient Linguistic Feature Extraction for Natural Language Datasets
Maximilian Maurer · Conference of the European Chapter of the Association for Computational Linguistics · 2026 · cited 7×
Show all 10
- AIDBench: A benchmark for evaluating the authorship identification capability of large language models
Zichen Wen, Dadi Guo et al. · arXiv.org · 2024 · cited 6× - LOG-AID: Logit-Based Statistical Features for AI Text Detection
Sophie Titze, Oren Halvani · Conference and Labs of the Evaluation Forum · 2025 · cited 5× - Style Change Detection Using Graph and Structural Linguistic Features for Multi-Author Writing Analysis
Ioana-Roxana Boriceanu, Andra Băltoiu · Conference and Labs of the Evaluation Forum · 2025 · cited 5× - Unibuc - NLP at "Voight-Kampff" Generative AI Detection PAN 2025
Teodor-George Marchitan, Claudiu Creanga et al. · Conference and Labs of the Evaluation Forum · 2025 · cited 5× - Literal Re-translation as a Method for AI Text Disguise and Detection Evasion
Poojan Vachharajani · Conference and Labs of the Evaluation Forum · 2025 · cited 4×
Citation data from Semantic Scholar, retrieved 2026-10-19.
How to cite
BibTeX
@misc{echo2026,
title = {ECHO: Exploratory Compendium of Humanity Online},
author = {Switzer, Braden and Zafarani, Reza},
year = {2026},
url = {https://echo.directory},
note = {Syracuse University}
}
@inproceedings{dementieva2024overview,
title = {Overview of the Multilingual Text Detoxification Task at PAN 2024},
author = {Dementieva, Daryna and others},
booktitle = {CLEF 2024 Working Notes},
year = {2024}
} APA
Switzer, B., & Zafarani, R. (2026). ECHO: Exploratory Compendium of Humanity Online [Data repository]. Syracuse University. https://echo.directory
Dementieva, D., Moskovskiy, D., Logacheva, V., Dale, D., Ustalov, D., & Panchenko, A. (2024). TextDetox Multilingual Toxicity Dataset (All Languages) [Data set]. https://doi.org/10.1007/978-3-031-71908-0_11
MLA
Switzer, Braden, and Reza Zafarani. ECHO: Exploratory Compendium of Humanity Online. Syracuse University, 2026, echo.directory.
Dementieva, Daryna, et al. TextDetox Multilingual Toxicity Dataset (All Languages). 2024, doi.org/10.1007/978-3-031-71908-0_11.