21 best open source language detection projects.

We have collection of more than 1 Million open source products ranging from Enterprise product to small libraries in all platforms. We aggregate information from all open source repositories. Search and find the best for your needs. Check out projects section.

Displaying 1 to 20 from 21 results

franc - Natural language detection

Javascript

Detect the language of text.† - Based on the UDHR, the most translated document in the world.

natural-language language-detection nlp natural language detection detect

Language Detection - Language Detection Library in Java

Java

This is a language detection library implemented in plain Java. It detects language of a text using naive Bayesian filter. It is 99% over precision for 53 languages.

language-identification language-detection natural-language-processing nlp

jChardet - Charset detection algorithm in Java

Java

jchardet is a java port of the source from mozilla's automatic charset detection algorithm.

language-identification language-detection text-catagorization internationalization charset charset-detection

TextCat - Perl Program helps to identify natural language

Perl

TextCat written in Perl helps to identify 69 natural langauge.

language-identification language-detection text-catagorization

juniversalchardet - Java port of universalchardet, that is the encoding detector library of Mozilla.

Java

juniversalchardet is a Java port of "universalchardet", that is the encoding detector library of Mozilla.

charset charset-detection encoding language-identification language-detection

node-cld - Language detection for Javascript (Node)

Language detection for Javascript. Based on the CLD2 (Compact Language Detector) library from Google. Highly optimized for space and speed. Runs about 10x faster than other libraries. Detects over 160 languages. Full test coverage. Runs on Linux, OS X, and Windows.

language detect language-detection cld cld2

paasaa - Natural language detection for Elixir

Elixir

After you are done, run mix deps.get in your shell to fetch and compile Paasaa. Paasaa is a derivative work from Franc (JavaScript, MIT) by Titus Wormer.

elixir language language-detection detect-language nlp

language-detection - Language detection library for Android

Java

Language detection for Android: Given a string of text, identify what language the text is written in. This project is a fork of an excellent Java language detection library (language-detection) written by Nakatani Shuyo. The original git version control history and commit messages are retained in this project.

language-detection android

Keywords - Language and keyword detection

Javascript

Term extraction and language detection module

term-extraction keyword tag auto-tag language-detection

Command-line-translator - Command-line access to google translate and some other features

Shell

Google translate shell, Google translate command-line, command-line translator Google Translate, Linux, easy to use, fast and comfortable. Command-line google translate, quick translate, very simple scripts, scripts for assess Google Translate, Google Translate CLI.

google-translate urban-dictionary language-detection language-translation command-line

language-detection-fastText

Jupyter

Also, check out this link to download the final .bin model and the preprocessed dataset.

fasttext language-detection word-embeddings text-classification

react-native-languages - 🌍 Get the user preferred languages and use the library of your choice to translate your app

Java

React Native properties and methods related to the language of the device

react-native globalization internationalization i18n language-detection ios android

enry - A faster file programming language detector

File programming language detector and toolbox to ignore binary or vendored files. enry, started as a port to Go of the original linguist Ruby library, that has an improved 2x performance. this will generate a binary in the project's root directory called enry. You can then move this binary to anywhere in your PATH.

linguist language-detection cli

padatious - A neural network intent parser

Python

Padatious also works in Python 2 if you are unable to upgrade.

intent-classification text-analysis language-processing intent text-processing language-detection

linguist - Detect programming language used in git repository. Go port of github linguist.

Go port of github linguist. Many thanks to @petermattis for his initial work in laying the groundwork of creating this project, and especially for suggesting the use of naive Bayesian classification.

linguist github-linguist language-detection bayes-classifier

go-lang-detector - A small library in golang, that detects the language of a text

This golang library provides functionality to analyze and recognize language based on text. A language profile is a map[string] intthat maps n-gram tokens to its occurrency-rank. So for the most frequent token 'X' of the analyzed text, map['X'] will be 1.

language-detection language-categorization unicode-range language-profile human-language offline-language-detection

language_detection - Ruby bindings for Chromium Compact Language Detector

Ruby bindings for Chromium Compact Language Detector (source). This gem is using source codes from chromium-compact-language-detector port.

ruby-bindings language-detection

whatlang-py - Simple bindings to the whatlang Rust package

Rust

bindings by Cathal Garvey, Copyright 2017, released under MIT license. This simply wraps the Whatlang-rs library by Sergey Potapov, exposing a single function to Python which returns a tuple of (language code, script code).

nlp language language-detection language-detector

guess-language

Emacs

Emacs minor mode that detects the language of what you’re typing. Automatically switches the spell checker and typo-mode (if present). I write a lot of text in multiple languages and was getting tired of constantly having to switch the dictionary of my spell-checker. In true Emacs spirit, I decided to dust off my grandpa’s parentheses and wrote some code to address this problem. The result is guess-language-mode, a minor mode for Emacs that guesses the language of the current paragraph and then changes the dictionary of ispell and the language settings of typo-mode (if present). It also reruns Flyspell on the current paragraph, but only on that paragraph because I want to leave paragraphs in other languages untouched. Language guessing is triggered when Flyspell detects an unknown word, but only if the paragraph has enough material to allow for robust detection of the language (~ 35 characters).

emacs emacs-lisp language-detection language language-statistics spellcheck

L10n-swift - Localization of the application with ability to change language "on the fly" and support for plural form in any language

Swift

L10n-swift is a simple framework that improves localization in swift app, providing cleaner syntax and in-app language switching. Import L10n_swift at the top of each Swift file that will use framework.