For some time now we are working on the new generation of our language technologies for the three main western South Slavic languages — Slovene, Croatian and Serbian. Recently we have released a new API currently covering the inflectional lexicon, segmenter, morphosyntactic tagger, lemmatiser, parser and named entity recogniser on both the web GUI and the API side, while the diacritic restorer and non-standard text normaliser are available through the API only. You can register and use the web GUI at http://clarin.si/services/web/ and go through the API documentation at http://www.clarin.si/info/k-centre/web-services-documentation/.
API for our language technologies
We have recently finished developing the first version of our API enabling you to use our language technologies (tokenizer, sentence splitter, morphosyntactic tagger, lemmatizer, named entity recognizer, dependency parser) and a web-based GUI enabling you to use the API without programming skills. You can find the GUI as well as basic documentation how to use the API on http://faust.ffzg.hr/nlpws/gui/.
Web corpora of Bosnian, Croatian and Serbian top-level domain published
We have just finished a new version of the Croatian top-level-domain web corpus hrWaC v2.0 and the first versions of the Bosnian and Serbian TLD web corpora bsWaC v1.0 and srWaC v1.0.The corpora are 1.9 billion, 429 million and 894 million tokens in size. They are annotated with lemmas and morphosyntactic descriptions while the dependency syntax layer will follow shortly (40 server-grade cores melting). Additionally, they contain document-level metadata that discriminate between the three similar languages and assess the text quality on the lexical and syntactic level. The corpora are published under the CC-BY-SA license. Please contact Nikola for a download link to the corpora.
Crowdsourcing speakers of Croatian for improving basic language tools
If you happen to speak Croatian, feel free to join our crowdsourcing efforts through which we try to produce more annotated data and improve our existing models for basic language tools for Croatian.
The prepared dataset is compiled from the dump of the Croatian Wikipedia. The worker tasks consist of tokens, their assumed morphosyntactic description and context for which the HunPos and the TreeTagger tools, both trained on the same dataset, do not agree on. With crowdsourcing we hope to eliminate the correctly annotated tokens from the final checkup of the tagger disagreements which will be performed by a language professional.
You will need a Google account to register with the tool.
The result of the crowdsourcing efforts will be freely available under the CC-BY-SA license as all our other data.
Abu-MaTran project publishes the first milestone — an English-Croatian translator
The Abu-MaTran project consortium, inside which Nikola is the local coordinator, published recently it’s first milestone — an English-Croatian translator on http://translator.abumatran.eu. This is the baseline system on top of which the consortium will make advances in the next 3.5 years of the project.
The SETimes.HR corpus published
We have just published the SETimes.HR multi-level annotated corpus of Croatian consisting of ~ 8.000 sentences. It contains ~ 4 000 sentences manually lemmatized and morphosyntactically tagged, ~ 2 500 sentences annotated for syntactic dependencies and the entire corpus annotated with three ENAMEX classes of named entities. The corpus is published under the permissive CC-BY-SA-3.0 license.