Corpora

Text-Fabric corpora are usually stored on GitHub/GitLab and Text-Fabric knows how to download a corpus from GitHub/GitLab if you specify the org/repo.

Most corpora are configured by metadata in a directory app in the repo.

You can load a corpus into a Python datastructure by

from tf.app import use
A = use("org/repo")

And you can get it in the Text-Fabric browser by saying this on a command prompt:

text-fabric org/repo

Here is a list of corpora that can be loaded this way. Since everybody can put a Text-Fabric corpus on GitHub/GitLab, the list may not be complete!

annotation/banks

modern english Iain M. Banks, 1984 - 1987, 99 words from the SF novel Consider Phlebas, Dirk Roorda

Cambridge Semitics Lab

CambridgeSemiticsLab/nena_tf

Aramaic North Eastern Neo-Aramaic Corpus, 2000, Nena Cambridge, Cody Kingham

CenterBLC Andrews University

CenterBLC/LXX

Greek Septuagint, 300 - 100 BCE, LXX Rahlf's edition 1935 plus additional features by CenterBLC; earliest extant Greek translation of Hebrew Bible books; Oliver Glanz, Adrian Negrea

CenterBLC/NA

Greek New Testament, 100 - 400, GNT Nestle-Aland edition 1904 with new features by CentrBLC, converted from biblicalhumanities/Nestle1904 contributed by Ulrik Sandborg Petersen, Jonathan Robie; Oliver Glanz

CenterBLC/SBLGNT

Greek New Testament, 100 - 400, converted from James Tauber's morphgnt/sblgnt with additional features by CenterBLC; Adrian Negrea, Clacir Virmes, Oliver Glanz, Krysten Thomas

CLARIAH

CLARIAH/wp6-missieven

Dutch General Missives, 1600 - 1800, General Missives, Dutch East-Indian Company, Jesse van der Does, Sophie Arnoult, Dirk Roorda

CLARIAH/wp6-daghregisters

Dutch Dagh Registers Batavia, 1640 - 1641, Daily events at Batavia, Indonesia, historical source for the operation of the Dutch East-Indian Company, Lodewijk Petram, Dirk Roorda. work in progress, currently only volume 4

Cody Kingham

codykingham/tischendorf_tf

Greek New Testament, 50 - 450, Tischendorf 8th Edition, Cody Kingham, Dirk Roorda

Eep Talstra Centre for Bible and Computer

etcbc/bhsa

Hebrew Bible (Old Testament), 1000 BCE - 900 AD, Biblia Hebraica Stuttgartensia (Amstelodamensis), ETCBC + Dirk Roorda

etcbc/dhammapada

Pāli and Latin Ancient Buddhist verses, 300 BCE and 1855 AD, Transcription with Latin translations based on Viggo Fausbøll's book, Bee Scherer, Yvonne Mataar, Dirk Roorda

etcbc/dss

Hebrew Dead Sea Scrolls, 300 BCE - 100 AD, Transcriptions with morphology based on Martin Abegg's data files, Martijn Naaijer, Jarod Jacobs, Dirk Roorda

etcbc/peshitta

Syriac Peshitta (Old Testament), 1000 BCE - 900 AD, Vetus Testamentum Syriace, Hannes Vlaardingerbroek, Dirk Roorda

etcbc/syrnt

Syriac New Testament, 0 - 1000, Novum Testamentum Syriace, Hannes Vlaardingerbroek, Dirk Roorda

NINO Cuneiform

Nino-cunei/ninmed

Akkadian / cuneiform Medical Encyclopedia from Nineveh, ca. 800 BCE, Medical documents with lemma annotations, Cale Johnson, Dirk Roorda

Nino-cunei/oldassyrian

Akkadian / cuneiform Old Assyrian documents, 2000 - 1600 BCE, Documents from Ashur Cale Johnson, Alba de Ridder, Martijn Kokken, Dirk Roorda

Nino-cunei/oldbabylonian

Akkadian / cuneiform Old Babylonian letters, 1900 - 1600 BCE, Altbabylonische Briefe in Umschrift und Übersetzung, Cale Johnson, Dirk Roorda

Nino-cunei/uruk

proto-cuneiform Uruk, 4000 - 3100 BCE, Archaic tablets from Uruk, Cale Johnson, Dirk Roorda

Protestant Theological University

Greek Literature

Greek Literature, -400 - +400, Perseus Digital Library and Open Greek and Latin Project The result of a massive conversion effort by Ernst Boogert.

pthu/athenaeus

Greek Works of Athenaeus, 80 - 170, Deipnosophistae, Ernst Boogert

Quran

q-ran/quran

Arabic Quran, 600 - 900, Quranic Arabic Corpus, Cornelis van Lit, Dirk Roorda

KNAW/Huygens

tt/paranoia

Dutch W.F. Hermans, Paranoia, 1953, Collected stories, Bram Oostveen, Dirk Roorda

Not publicly accessible, the book is under copyright.

University of Utrecht: Cornelis van Lit

among/fusus

Arabic Fusus Al Hikam, 1165- 2000, editions (Lakhnawi and Afifi) of Ibn Arabi's Fusus plus commentaries in the centuries thereafter, Cornelis van Lit, Dirk Roorda

Intentions

oldroyal

Akkadian-Sumerian cuneiform Bilingual royal inscriptions, 2000 - 1600, more info to come, Martijn Kokken, Dirk Roorda

Get corpora

Automatically

Text-Fabric downloads corpus data and apps from GitHub/GitLab on demand.

See tf.about.use.

Data ends up in a logical place under your ~/text-fabric-data/.

The TF data is fairly compact.

Manually

TF data of corpora reside in a backend repo. You can manually clone such a data repository and point Text-Fabric to that data.

First, take care that your clone ends up in github/orgName or gitlab/orgName (relative your home directory) where orgName is the organization or person or group on GitHub/GitLab under which you have found the repo.

Then, when you invoke the app, pass the specifier :clone. This instructs Text-Fabric to look in your local GitHub/GitLab clone, rather than online or in your local text-fabric-data, where downloaded data is stored.

use('org/repo:clone', checkout="clone")

text-fabric org/repo:clone --checkout=clone

In this way, you can work with data that is under your control.

Extra data

Researchers are continually adding new insights in the form of new feature data. TF apps make it easy to use that data alongside the main data source. Read more about the data life cycle in tf.about.datasharing.

"""
.. include:: ../docs/about/corpora.md
"""