Encoding Schemes.ppt

Encoding Schemes Encoding methods: a method of encoding at binary level to ensure identification and the use of a mixture of different character sets compatibility consideration and usually should be compatible with ASCII save space and multiple codesets to be used on the same system Clear whether the codeset is for internal code/exchange code /processing code High-bit on scheme The most significant bit of the first byte of the character is set to 1 to indicate the beginning of a Chinese character Examples: GB, Big5 GuoBiao (國標) :GB Series PRC standard (also used in Singapore) G0: GB2312-80, 6,763 Han char. G1: GB12345-90, traditional counterpart GBK: Extension to G0 to support Unicode characters GB2312-80 is the most commonly used codeset Represents simplified characters (i.e. has representation ambiguities with some internal codes of traditional characters e.g. Big5) Code table: has 94 rows x 94 column, Total 8,836 code-points (code space) Code range shown in code table: 0x21\21-0x7E\7E In high－bit on scheme in most systems(8 byte encoding), the code range is 0xA1\A1 - 0xFE\FE Character subsets(rows): 1: Special symbols (math, etc. e.g. ?, 【】 ) 2: Paragraph numbers (e.g. 15. (16). ) 3: ASCII full characters(全角 ) characters - ASCII equivalent characters (e.g. A..Z) 4: Hiragana, 5: Katakana 6: Greek (48), 7: Cyrillic( Russian) 8: Pinyin (Romanized Pinyin vows and Zhuyin symbols) 9: Graphic for box and table drawing 16-55: Level 1 (0xb0-0xd7) 3,755 Hanzi characters (ordered by pinyin) 56- 87: Level 2 (0xd8-0xf7) 3,008 Hanzi characters (ordered by radical, stroke number) 88- 94:Not defined areas: For future extension(103 characters were later defined in rows 88-89, and 161 graphic symbols from row 90 and on ) User defined area Full-width characters vs. half-width characters Why are there some undefined codepoints(not like in ASCII which is completed full)? GBK Big5 (大五) De facto standard in Taiwan and HK (commonly for PC) High-bit on sche