We have collection of more than 1 Million open source products ranging from Enterprise product to small libraries in all platforms. We aggregate information from all open source repositories. Search and find the best for your needs. Check out projects section.
gensim - Topic Modelling for Humans
Gensim is a Python library for topic modelling, document indexing and similarity retrieval with large corpora. Target audience is the natural language processing (NLP) and information retrieval (IR) community. If this feature list left you scratching your head, you can first read more about the Vector Space Model and unsupervised document analysis on Wikipedia.
gensim topic-modeling information-retrieval machine-learning natural-language-processing nlp data-science data-mining word2vec word-embeddings text-summarization neural-network document-similarity word-similarity fasttextLemur - Search Engine
The Lemur Project develops search engines, browser toolbars, text analysis tools, and data resources that support research and development of information retrieval and text mining software. The project is best known for its Indri search engine, Lemur Toolbar, and ClueWeb09 dataset.
searchengine search-engine full-text-search lucene-alternative search information-retrievalTerrier - Information Retrieval Platform
Terrier is a highly flexible, efficient, and effective open source search engine, readily deployable on large-scale collections of documents. Terrier implements state-of-the-art indexing and retrieval functionalities, and provides an ideal platform for the rapid development and evaluation of large-scale retrieval applications. Terrier can index large corpora of documents, and provides multiple indexing strategies, such as multi-pass, single-pass and large-scale MapReduce indexing.
searchengine search-engine full-text-search lucene-alternative search information-retrievalresin - 32-bit vector space search engine
A full-text search engine with HTTP API and programmable read/write pipelines. To provide full-text search words and phrases are extracted from documents and mapped to a 2 billion dimensional vector-space that form clusters of syntactically similar "bag-of-chars". In this language model, each character (glyph) is encoded as a 32-bit word (an int), and each word or phrase alike encoded as a 32-bit wide (but sparse) array.
information-retrieval search-engine dotnet-core vector-space-model lsm-treeRankyMcRankFace - Hardened Fork of Ranklib learning to rank library
This project is OpenSource Connections API-compatible fork of Ranklib, deployed on Maven, with various improvements making it easier to integrate with the Elasticsearch Learning to Rank Plugin.It is under the com.o19s:RankyMcRankFace Maven namespace.
machine-learning search information-retrievalBM25Transformer - (Python) transform a document-term matrix to an Okapi/BM25 representation
This library transforms a document-term matrix to a Okapi/BM25 representation. API of this library inherits from sklearn.feature_extraction.text.TfidfTransformer.
machine-learning information-retrieval scikit-learn natural-language-processingawesome-hungarian-nlp - A curated list of NLP resources for Hungarian
A curated list of NLP resources for Hungarian
nlp natural-language-processing text-mining information-retrieval information-extraction hungarian hungarian-language awesome awesome-list nlu natural-language-understanding opinion-mining named-entity-recognition tagger dataset nlp-resources parser corpus-linguistics computational-linguistics corpustika-similarity - Tika-Similarity uses the Tika-Python package (Python port of Apache Tika) to compute file similarity based on Metadata features
This project demonstrates using the Tika-Python package (Python port of Apache Tika) to compute file similarity based on Metadata features. The script can iterate over all files in the current directory or given files by command line and derives their metadata features, then computes the union of all features. The union of all features become the "golden feature set" that all document features are compared to via intersect. The length of that intersect per file divided by the length of the unioned set becomes the similarity score.
similarity-score machine-learning clustering information-retrieval cosine-similarity cosine-distance tika jaccard-similarity tika-similarity metadata-features tika-pythoncuNVSM - Neural Vector Space Models
⚠️ You need a CUDA-compatible GPU (compute capability 5.2+) to use this software. cuNVSM is a C++/CUDA implementation of state-of-the-art NVSM and LSE representation learning algorithms.
vector-space-model information-retrieval machine-learning neural-networks representation-learningpyndri - pyndri is a Python interface to the Indri search engine.
pyndri is a Python interface to the Indri search engine (http://www.lemurproject.org/indri/). During development, we use Python 3.5. Some of the examples require numpy.
indri-search-engine research information-retrievalpytrec_eval - pytrec_eval is an Information Retrieval evaluation tool for Python, based on the popular trec_eval
pytrec_eval is a Python interface to TREC's evaluation tool, trec_eval. It is an attempt to stop the cultivation of custom implementations of Information Retrieval evaluation measures for the Python programming language. The module was developed using Python 3.5. You need a Python distribution that comes with development headers. In addition to the default Python modules, numpy and scipy are required.
information-retrieval evaluationSERT - Semantic Entity Retrieval Toolkit
The Semantic Entity Retrieval Toolkit (SERT) is a collection of neural entity retrieval algorithms. SERT requires Python 3.5 and assorted modules. The trec_eval utility is required for evaluation and the end-to-end scripts. If you wish to train your models on GPGPUs, you will need a GPU compatible with Theano.
representation-learning deeplearning neural-network information-retrievalpke - Python Keyphrase Extraction module
pke is an open source python-based keyphrase extraction toolkit. It provides an end-to-end keyphrase extraction pipeline in which each component can be easily modified or extented to develop new approaches. pke also allows for easy benchmarking of state-of-the-art keyphrase extraction approaches, and ships with supervised models trained on the SemEval-2010 dataset. pke works only for Python 2.x at the moment.
keyphrase-extraction natural-language-processing information-retrieval computational-linguistics semeval-2010 topicrank tf-idf kea wingnusindonesian-nlp-playground - Repositori personal terkait penelitian linguistik bahasa Indonesia
Sesuai namanya, ini adalah repositori personal terkait penelitian linguistik bahasa Indonesia. Semua yang ada di repositori ini sifatnya eksperimental dan sewaktu-waktu dapat berubah menurut petunjuk rumput yang bergoyang atau menurut menu makan siang di restoran Mbah Jingkrak.
natural-language-processing information-retrievalMimir - OSINT Threat Intel Interface
OSINT Threat Intel Interface - Named after the old Norse God of knowledge. Mimir functions as a CLI to HoneyDB which in short is an OSINT aggregative threat intel pool. Starting the program brings you to a menu the options for which are as follows.
osint threatintel intel honeypot honeydb cli interface information-retrieval ioc nmap scan-toolhorus-ner - HORUS: A framework to boost NLP tasks
HORUS is meta and multi-level framework designed to provide a set of features at word-level to boost natural language frameworks. It's architecure is based on image processing and text classification clustering algorithms and shows to be helpful especially to noisy data, such as microblogs. We are currently investigating Named Entity Recognition (NER) as use case. This version supports the identification of classical named-entity types (LOC, PER, ORG).
ner named-entity-recognition microblog twitter noise information-retrieval machine-learning computer-vision text-mining horuserrorlookup - Simple tool for retrieving information about Windows errors codes.
Portable open source tool which can help by translating error codes into a more meaningful text description. The interface is simple - just a box to type your code, and another which displays the details - so there doesn’t seem much to learn. The program also supports a wide range of codes: regular Windows errors, DirectX, NTSTATUS errors, Windows Internet errors, STOP codes, And we think it can probably be configured to read more (Settings > System modules), although there’s no documentation to confirm that and we didn’t test it.
error-messages information-retrievalPwnBack - Burp Extender plugin that generates a sitemap of a website using Wayback Machine
The plugin has several settings that a user can define depending on their hardware setup.
security-tools burp burpsuite burp-extensions information-retrieval osinttutorial-kb4ir - Resources for the Tutorial on "Utilizing Knowledge Bases in Text-centric Information Retrieval"
Resources for the Tutorial on "Utilizing Knowledge Bases in Text-centric Information Retrieval"
knowledge-graph information-retrieval tutorialtutorial-utilizing-kg - Resources for Tutorial on "Utilizing Knowledge Graphs in Text-centric Information Retrieval"
This tutorial was presented at the following venues.
tutorial knowledge-graph knowledge-base information-retrieval entity entity-links
We have large collection of open source products. Follow the tags from
Tag Cloud >>
Open source products are scattered around the web. Please provide information
about the open source projects you own / you use.
Add Projects.
