This paper tries to utilize the diversity of word meaning to train the Deep Neural Network. In the language modeling (prediction of the word sequence), we want to express the diversity of word meaning. For example, when predicting the word next to "Banana is delicious ___", the answer is "fruit", but "sweets", "food" is also ok. But ordinary one-hot vector teaching is not suitable to achieve it. Because any similar words ignored, but the exact answer word.