Hi, this tutorial is based on a Python package provided by https://github.com/VietHoang1512.

The author uses regex and ner model (trained using scikit-learn) to do word tokenization.