Generating tokens code

Hi,

Thanks for sharing very nice tutorials.

I am following your tutorial https://www.programcreek.com/2017/07/build-an-ai-programmer-using-recurrent-neural-network-2/.

You have placed tokens file such as "jdk-tokens.txt" for experiments. But, can you please share the source code of generating java tokens from source files in python? This will help me to perform experiments on different type of projects written in java.