language generation in keras

https://machinelearningmastery.com/how-to-develop-a-word-level-neural-language-model-in-keras/

Language to language translation

https://medium.com/@ageitgey/machine-learning-is-fun-part-5-language-translation-with-deep-learning-and-the-magic-of-sequences-2ace0acca0aa

Word2vec visualization

link
https://labsblog.f-secure.com/2018/01/30/nlp-analysis-of-tweets-using-word2vec-and-t-sne/

Better one for skip-gram
http://mccormickml.com/2016/04/19/word2vec-tutorial-the-skip-gram-model/

Clustering Evaluating Methodologies

Purity

Normalized Mutual Information
Rand
Jaccard coefficient
Fowlkes and Mallows index
Dunn index
Silhouette Coefficient
Adjusted Rand index
Mutual Information based scores
Calinski-Harabaz Index
Homogeneity, completeness and V-measure
Fowlkes-Mallows scores

Clustering Evaluation

https://nlp.stanford.edu/IR-book/html/htmledition/evaluation-of-clustering-1.html

Python NLTK Resource 'tokenizers/punkt/english.pickle' not found

import nltk

nltk.download('punkt')

jupyter 500 internal error

Solution
sudo pip install --upgrade "ipython[all]"