ISO 24614-2:2011 - $185.00   BUY NOW

Language resource management - Word segmentation of written texts - Part 2: Word segmentation for Chinese, Japanese and Korean

ISO 24614-2:2011 Publication Description:

The basic concepts and general principles of word segmentation as defined in ISO 24614-1 apply to Chinese, Japanese and Korean. Text needs to be segmented into tokens, words, phrases or some other types of smaller textual units in order to perform certain computational applications on language resources, such as natural language processing, information retrieval and machine translation. ISO 24614-2:2011 is restricted to the segmentation of a text into words or other word segmentation units (WSUs). This task is distinct from morphological or syntactic analysis per se, although it greatly depends on morphosyntactic analysis. It is also different from the task of laying out a framework for constructing a lexicon and identifying its lexical entries, namely lemmas and lexemes. The frameworks for the latter tasks are provided by ISO 24611, ISO 24613 and ISO 24615.

ISO 24614-2:2011 specifies rules for delineating WSUs for Chinese, Japanese and Korean. Some rules are common to all three languages, though each language also has its own distinct rules for identifying WSUs. The common features are discussed, then the distinct rules are laid out for Chinese, for Japanese and for Korean.

International Classification for Standards (ICS)

ICS Classification Field ICS Field Sub-Group and Number
ICS-01-Generalities ICS Writing/Transliteration (01.140.10)

ICS Related Standards

Cart Document Number Document Title
$103.00 ISO 11940:1998 Information and documentation -- Transliteration of Thai
$68.00 ISO 11940-2:2007 Information and documentation - Transliteration of Thai characters into Latin characters - Part 2: Simplified transcription of Thai language
$162.00 ISO 15919:2001 Information and documentation - Transliteration of Devanagari and related Indic scripts into Latin characters
$68.00 ISO 15924:2004 Information and documentation - Codes for the representation of names of scripts
$68.00 ISO 233:1984 Documentation -- Transliteration of Arabic characters into Latin characters
$45.00 ISO 233-2:1993 Information and documentation -- Transliteration of Arabic characters into Latin characters -- Part 2: Arabic language -- Simplified transliteration
$68.00 ISO 233-3:1999 Information and documentation -- Transliteration of Arabic characters into Latin characters -- Part 3: Persian language -- Simplified transliteration
$103.00 ISO 24614-1:2010 Language resource management - Word segmentation of written texts - Part 1: Basic concepts and general principles
$162.00 ISO 24624:2016 Language resource management - Transcription of spoken language
$68.00 ISO 259:1984 Documentation -- Transliteration of Hebrew characters into Latin characters
$68.00 ISO 259-2:1994 Information and documentation -- Transliteration of Hebrew characters into Latin characters -- Part 2: Simplified transliteration
$45.00 ISO 3602:1989 Documentation -- Romanization of Japanese (kana script)
$138.00 ISO 7098:2015 Information and documentation - Romanization of Chinese
$51.00 ISO 7098:1991 Information and documentation -- Romanization of Chinese
$68.00 ISO 843:1997 Information and documentation -- Conversion of Greek characters into Latin characters
$103.00 ISO 9:1995 Information and documentation -- Transliteration of Cyrillic characters into Latin characters -- Slavic and non-Slavic languages
$68.00 ISO 9984:1996 Information and documentation -- Transliteration of Georgian characters into Latin characters
$68.00 ISO 9985:1996 Information and documentation -- Transliteration of Armenian characters into Latin characters