HPLT/OpenLID-v3
Viewer • Updated • 137M • 370
AI & ML interests
Web as a corpus, Large Language Models, Machine Translation, Language Technologies, Natural Language Processing, Internet Archive, CommonCrawl
Recent Activity
View all activity
Papers
OpenLID-v3: Improving the Precision of Closely Related Language Identification -- An Experience Report
DHPLT: large-scale multilingual diachronic corpora and word representations for semantic change modelling
HPLT/HPLT2.0_cleaned
Updated • 28.5k • 43
HPLT/HPLT3.0
Updated • 75 • 20
HPLT/hplt_monolingual_v1_2
Updated • 57 • 21
HPLT/DocHPLT
Viewer • Updated • 124M • 31.1k • 20
HPLT/2508-datasets-evals
Viewer • Updated • 96k • 66
HPLT/2508-wds-evals
Viewer • Updated • 10.7k • 19
HPLT/2505-deduplication-evals
Viewer • Updated • 56.3k • 32
HPLT/ua-squad
Viewer • Updated • 7.73k • 43