We have collection of more than 1 Million open source products ranging from Enterprise product to small libraries in all platforms. We aggregate information from all open source repositories. Search and find the best for your needs. Check out projects section.
attention-transfer - Improving Convolutional Networks via Attention Transfer (ICLR 2017)
The code uses PyTorch https://pytorch.org. Note that the original experiments were done using torch-autograd, we have so far validated that CIFAR-10 experiments are exactly reproducible in PyTorch, and are in process of doing so for ImageNet (results are very slightly worse in PyTorch, due to hyperparameters). This section describes how to get the results in the table 1 of the paper.
pytorch knowledge-distillation attention deep-learningtf-rnn-attention - Tensorflow implementation of attention mechanism for text classification tasks.
Tensorflow implementation of attention mechanism for text classification tasks. Inspired by "Hierarchical Attention Networks for Document Classification", Zichao Yang et al. (http://www.aclweb.org/anthology/N16-1174).
attention tensorflow rnn text-classification sentiment-analysisspatial-transformer-network - A Tensorflow Implementation of Spatial Transformer Networks
This is a Tensorflow implementation of Spatial Transformer Networks by Max Jaderberg, Karen Simonyan, Andrew Zisserman and Koray Kavukcuoglu, accompanying by two-part blog tutorial series. Spatial Transformer Networks (STN) is a differentiable module that can be inserted anywhere in ConvNet architecture to increase its geometric invariance. It effectively gives the network the ability to spatially transform feature maps at no extra data or supervision cost.
spatial-transformer-network tensorflow stn attention affine-transformation convnetpointer-networks-experiments - Sorting numbers with pointer networks
Code for genereting data, training and testing. There are two tasks: ordering single numbers, or sums or numbers (the _sums suffix). The training scripts save model weights each epoch. When started, they attempt to load appropriate weights - corresponding to the hidden size and the chosen number of steps in a sequence.
pointer-networks seq2seq attention lstmdoc-han-att - Hierarchical Attention Networks for Chinese Sentiment Classification
This is HAN version of sentiment classification, with pre-trained character-level embedding, and used RAN instead of GRU.
deep-learning rnn tensorflow attention document chinese nlptf-rda-cell - Recurrent Discounted Attention unit (RDA) for Tensorflow
This is a implementation of Recurrent Discounted Attention unit that extends Tensorflow's RNNCell, RDA is builds on the RWA by additionally allowing the discounting of the past.
tensorflow attention rnn machine-learning deep-learningai_law - all kinds of baseline models for long text classificaiton( text categorization)
Update: Joint Model for law cases prediction is released. run python HAN_train.py to train the model for predict accusation, relevant articles and term of imprisonment.
ai law accusation relevant-articles hierarchical-attention-network crime fasttext attention text-categorization textcnn text-classificationrecurrent-visual-attention - A PyTorch Implementation of "Recurrent Models of Visual Attention"
This is a PyTorch implementation of Recurrent Models of Visual Attention by Volodymyr Mnih, Nicolas Heess, Alex Graves and Koray Kavukcuoglu. The Recurrent Attention Model (RAM) is a recurrent neural network that processes inputs sequentially, attending to different locations within the image one at a time, and incrementally combining information from these fixations to build up a dynamic internal representation of the image.
pytorch attention recurrent-attention-model recurrent-models ramattend_infer_repeat - A Tensorfflow implementation of Attend, Infer, Repeat
This is an unofficial Tensorflow implementation of Attend, Infear, Repeat (AIR), as presented in the following paper: S. M. Ali Eslami et. al., Attend, Infer, Repeat: Fast Scene Understanding with Generative Models. I describe the implementation and the issues I run into while working on it in this blog post.
tensorflow vae neural-networks attention-mechanism generative-model computer-vision computer-graphics rnn attention attend-infer-repeatram_modified - "Recurrent Models of Visual Attention" in TensorFlow
This project is modified version of https://github.com/jlindsey15/RAM. The critical problem of last implemetnation is that the location network cannot learn because of tf.stop_gradient implementation so that they got just '94% accuracy'. It seems relatively bad compared to the result of paper. If 'tf.stop_gradient' was commented, the classification result was very bad. The reason I think is that the problem is originated from sharing the gradient flow through location, core, glimpse network. Through gradient sharing, gradients of classification part are corrupted by gradients of reinforcement part so that classification result become very bad. (If someone want to share gradient, the weighted loss should be needed. please refer https://arxiv.org/pdf/1412.7755.pdf) According to their post research, 'Multiple Object Recognition with Visual Attention' (https://arxiv.org/pdf/1412.7755.pdf) they softly separate location network and others through multi-layer RNN. From this, I assume that sharing the gradient through whole network is not a good idea so separate them, and finally got a good result. In summary, the learning stretegy is as follow. location network, baseline network : learn with gradients of reinforcement learning only.
deep-learning ram attention reinforcement-learning recurrent-neural-networksVAD - Voice activity detection (VAD) toolkit including DNN, bDNN, LSTM and ACAM based VAD
This toolkit provides the voice activity detection (VAD) code and our recorded dataset. J. Kim and M. Hahn, "Voice Activity Detection Using an Adaptive Context Attention Model," in IEEE Signal Processing Letters, vol. PP, no. 99, pp. 1-1.
vad dnn lstm bdnn acam attention speech data voice-detection speech-recognitionIm2LaTeX - An implementation of the Show, Attend and Tell paper in Tensorflow, for the OpenAI Im2LaTeX suggested problem
An implementation of the Show, Attend and Tell (Xu, Kelvin et. al., 2016) paper in TensorFlow, for the OpenAI Im2LaTeX suggested problem. The crux of the model is contained in cnn_enc_gru_dec_attn.py that uses the embedding attention decoder from TensorFlow to attend on the output of the CNN.
deep-learning attention-mechanism attention show-and-tell show-attend-and-tell tensorflowDeepLearningReading - Deep Learning and Machine Learning mini-projects
Currently working on replicating the Deep Attentive Reader in Keras. This model has been designed in the same way as described in the paper Teaching Machines to Read and Comprehend. So far, the results are consistantly improving - once 10% Accuracy has been achieved I intend to move over to an AWS instance to reduce the training time.
deep-learning keras nlp-machine-learning nlp embeddings attentionban-vqa - Bilinear attention networks for visual question answering
This repository is the implementation of Bilinear Attention Networks for the visual question answering task. Our single model achieved 70.35 and an ensemble of 15 models achieved 71.84 (Test-standard, VQA 2.0). For the detail, please refer to our technical report. This repository is based on and inspired by @hengyuan-hu's work. We sincerely thank for their sharing of the codes.
visual-question-answering attention bilinear-pooling pytorch-implmentionjeelizGlanceTracker - JavaScript/WebGL lib: detect if the user is looking at the screen or not from the webcam video feed
This JavaScript/WebGL library detects if the user is looking at the screen or not. It is very robust to all lighting conditions and lightweight (only 150KB gzipped for the main script and the neural network JSON model). It is great for playing a video only if the user is watching it. In the paths /integrationDemo*, there are several integration examples. You can host them through a static HTTPS server.
face detection attention webgl deep-learning glance watching webcam video face-tracking face-detection real-time library lightweighttext-classification-keras - π Text Classification Library with Keras
A high-level text classification library implementing various well-established models. With a clean and extendable interface to implement custom architectures. The [full] will additionally install TensorFlow, Spacy, and Deep Plots. Choose this if you want to get started right away.
text-classification sentiment-analysis deep-learning nlp keras keras-tensorflow nlp-machine-learning framework library cnn-text-classification lstm attention stacked-lstm sentence-classification document-classificationattention-dialog-embedding - Attention based dialog embedding for dialog breakdown detection (in DSTC6 task 3)
Despite the recent advent of dialog systems, still many challenges are unresolved and the system often generates responses causing a breakdown in the interaction between a user and the system. The dialog breakdown significantly damages user experience, and thus detecting such failure is significant. We propose a model to detect dialog breakdown using the recurrent neural network and attention layer to embed a previous dialog context. This model determines the probability of breakdown using the extracted dialog context vector and the target sentence's representation vector. We submitted this study to the Dialog Breakdown Detection Challenge 3 of Dialog System Technology Challenge 6, and the results showed that it significantly outperforms the most of other models in estimating breakdown probability. You can find more detailes in our workshop paper.
dialog rnn pytorch dstc6 dbdc3 attention
We have large collection of open source products. Follow the tags from
Tag Cloud >>
Open source products are scattered around the web. Please provide information
about the open source projects you own / you use.
Add Projects.
