Language Detection - Language Detection Library in Java

•    Java

---

This is a language detection library implemented in plain Java. It detects language of a text using naive Bayesian filter. It is 99% over precision for 53 languages.

language-identification language-detection natural-language-processing nlp

jChardet - Charset detection algorithm in Java

•    Java

---

jchardet is a java port of the source from mozilla's automatic charset detection algorithm.

language-identification language-detection text-catagorization internationalization charset charset-detection

TextCat - Perl Program helps to identify natural language

•    Perl

---

TextCat written in Perl helps to identify 69 natural langauge.

language-identification language-detection text-catagorization

juniversalchardet - Java port of universalchardet, that is the encoding detector library of Mozilla.

•    Java

---

juniversalchardet is a Java port of "universalchardet", that is the encoding detector library of Mozilla.

charset charset-detection encoding language-identification language-detection

tensorflow_fasttext - Simple embedding based text classifier inspired by fastText, implemented in tensorflow

•    Python

---

This project is based on the ideas in Facebook's FastText but implemented in Tensorflow. However, it is not an exact replica of fastText. Classification is done by embedding each word, taking the mean embedding over the full text and classifying that using a linear classifier. The embedding is trained with the classifier. You can also specify to use 2+ character ngrams. These ngrams get hashed then embedded in a similar manner to the orginal words. Note, ngrams make training much slower but only make marginal improvements in performance, at least in English.

fasttext tensorflow language-identification text-classifier

witch-language - Easy language identification of 380 languages

•    Python

---

Massively multilingual, easy language identification. It currently works on 380 languages. You can add the --help command-line flag to see more options. Using Python3 gives much better performance than Python2 for this task.

language-identification bad-pun

lingua - The most accurate natural language detection library for Java and other JVM languages, suitable for long and short text alike

•    Kotlin

---

Lingua is a language detection library for Java and other JVM languages, suitable for long and short text alike. Its task is simple: It tells you which language some provided textual data is written in. This is very useful as a preprocessing step for linguistic data in natural language processing applications such as text classification and spell checking. Other use cases, for instance, might include routing e-mails to the right geographically located customer service department, based on the e-mails' languages.

language-detection language-model language-modeling language-processing languages kotlin kotlin-library java-library nlp-library nlp nlp-machine-learning natural-language natural-language-processing language-detection-library android android-library language-identification language-classification language-recognition