Skip to main navigation Skip to search Skip to main content

Thai word segmentation with hidden markov model and decision tree

  • Queensland University of Technology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

9 Citations (Scopus)

Abstract

The Thai written language is one of the languages that does not have word boundaries. In order to discover the meaning of the document, all texts must be separated into syllables, words, sentences, and paragraphs. This paper develops a novel method to segment the Thai text by combining a nondictionary based technique with a dictionary-based technique. This method first applies the Thai language grammar rules to the text for identifying syllables. The hidden Markov model is then used for merging possible syllables into words. The identified words are verified with a lexical dictionary and a decision tree is employed to discover the words unidentified by the lexical dictionary. Documents used in the litigation process of Thai court proceedings have been used in experiments. The results which are segmented words, obtained by the proposed method outperform the results obtained by other existing methods.

Original languageEnglish
Title of host publicationAdvances in Knowledge Discovery and Data Mining - 13th Pacific-Asia Conference, PAKDD 2009, Proceedings
PublisherSpringer Verlag
Pages74-85
Number of pages12
ISBN (Print)3642013066, 9783642013065
DOIs
Publication statusPublished - 2009
Externally publishedYes
Event13th Pacific-Asia Conference on Knowledge Discovery and Data Mining, PAKDD 2009 - Bangkok, Thailand
Duration: 27 Apr 2009 → 30 Apr 2009

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5476 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference13th Pacific-Asia Conference on Knowledge Discovery and Data Mining, PAKDD 2009
Country/TerritoryThailand
CityBangkok
Period27/04/09 → 30/04/09

Keywords

  • Decision tree
  • Hidden markov model
  • Thai word segmentation

Fingerprint

Dive into the research topics of 'Thai word segmentation with hidden markov model and decision tree'. Together they form a unique fingerprint.

Cite this