GB/T 36452-2018 in English
VALIDSpecification on Tibetan segmentation for information processing
- Issued on:2018-06-07
- Implemented on:2019-01-01
- File Format:PDF
- Delivery:Via email within 1~3 business days
$243.00
| Standard No: | GB/T 36452-2018 |
| Document status: | VALID |
| Title in English: | Specification on Tibetan segmentation for information processing |
| Title in Chinese: | 信息处理用藏文分词规范 |
| Language: | English |
| File Format: | Electronic (PDF) |
| Delivery: | Via email within 1~3 business days |
| Issued on: | 2018-06-07 |
| Implemented on: | 2019-01-01 |
| ICS Classification: | 35.240.01-Applications of information technology in general |
| Chinese Classification: | L70-Information processing technology in general |
| Professional Classification: | GB-National Standard |
| Related Keywords: | core word segmentation rules compound word processing
tibetan segmentation morphological analysis special processing case auxiliary word agglutination processing international language processing word segmentation granularity tibetan case grammar sanskrit transcription processing |
| Related Topics: | information office
GBT36452 GB/T 36452-2018 Tibetan Information detection and processing |
《GB/T 36452-2018信息处理用藏文分词规范》由TC28（全国信息技术标准化技术委员会）归口，主管部门为国家标准化管理委员会。
Introduction
Analysis of the Standard Technical Framework
| Dimensions | Standardized Features of Tibetan | Comparison with Chinese Word Segmentation | Differences in International Language Processing |
|---|---|---|---|
| Word Segmentation Granularity | 1-5 syllable compound words are segmented as a whole | 2-4 word words are the main ones | Agglutinative languages require morphological analysis |
| Special Processing | Case Auxiliary Word Agglutination Processing (4.25-4.29) | Function Words are Segmented Independently | Inflectional Languages Require Stem Extraction |
| Tag system | GB/T 36337 part-of-speech tags | ICTCLAS system | Universal POS tags |
Detailed explanation of core word segmentation rules
Compound word processing (Clause 4.2)
Tibetan noun compound words adopt the "overall segmentation" principle:
- Monosyllabic noun + adjective → 1 participle unit
- Disyllabic noun + adjective → 1 participle unit
- The word-forming suffix "」" is not segmented separately
Proper noun processing (Clause 4.3-4.7)
Typical case: "གངས་རིན་པོ་ཆེ" (Kang Rinpoche) as a whole word segmentation unit reflects the word formation characteristics of Tibetan place names
Technical Evolution Analysis
This standard innovatively introduces:
- Case particle combination markers (4.24-4.29): solve the agglutinative characteristics of Tibetan case grammar
- Sanskrit transcription processing (4.36): retain the ability to process religious documents
- Cross-language symbols (4.35): compatible with multi-language mixed texts
Implementation Suggestions
System Development Specifications
- Use "/" as the word boundary character
- Establish a mapping table between Tibetan word classes and general tag sets
- Special character processing module needs to support Unicode Tibetan segment
Corpus Construction
The recommended annotation system includes:
| Basic layer | Syllable boundary annotation |
| Syntactic layer | Case particle attachment marker |
| Semantic layer | Proper noun entity classification |
Loading PDF document...
Error loading PDF. Please make sure the file is valid and try again.
We also recommend
-
GB/Z 222-2026 in English
Artificial intelligence—Model as a service (MaaS) performance specification
2026-08-27 -
GB/T 20299.3-2024 in English
Digital technique application of building and residence community—Part 3:Property management
2024-09-29 -
GB/T 47177.1-2026 in English
Quantum computing service platform—Part 1 : Architecture and functional requirements
2026-02-27 -
GB/T 41396-2022 in English
Tourism card system of digital city—Application technology requirements
2022-04-15 -
GB/T 45346-2025 in English
Information technology—Technical requirements for graph database management system
2025-02-28 -
GB/Z 38623-2020 in English
Intelligent manufacturing—Human-computer interaction system—Technological requirements of semantic library
2020-04-28 -
GB/T 44120-2024 in English
Smart city—Guidelines for public information terminal services
2024-05-28 -
GB/Z 42759-2023 in English
Smart city—Classification guide for application scenarios of artificial intelligence technology
2023-05-23
