Intelligent Korean Morpheme Analyzer in Python

Ng Wai Foong
5 min readJul 19, 2023

Utilizing “kiwipiepy” for Korean natural language processing

Photo by Tsuyuri Hara on Unsplash

By reading this article, you will learn to perform natural language processing tasks for the Korean language in Python.

Previously, I have covered an article on Korean Natural Language Processing in Python using konlpy module. This article is based on a different Python package called kiwipiepy. For your information, the kiwipiepy module is an intelligent korean morpheme analyzer. Compared to konlpy module, the kiwipiepy package has the following advantages:

  • the installation step is a lot simpler
  • comparable performance on tokenization and part-of-speech tagging tasks
  • faster inference time
  • the package is actively maintained by the developer (as of June 2023)

However, it suffers from the following problems:

  • the documentations are written in Korean
  • different tag system for part-of-speech tagging task

Let’s proceed to the next section and start installing all the necessary modules.

Setup

It is highly recommended to create a new virtual environment before you continue with the installation process.

--

--

Ng Wai Foong
Ng Wai Foong

Written by Ng Wai Foong

Senior AI Engineer@Yoozoo | Content Writer #NLP #datascience #programming #machinelearning | Linkedin: https://www.linkedin.com/in/wai-foong-ng-694619185/