GB/T 36345-2018 in English

GB/T 36345—2018: In-depth analysis of the general data import interface standard

1. Background and significance of the standard

GB/T 36345—2018 "General Data Import Interface for Information Technology" is a standard proposed and coordinated by the National Information Technology Standardization Technical Committee, which aims to standardize the data import interface in big data systems. The standard was jointly drafted by ZTE Corporation, Huawei Technologies Co., Ltd. and other leading technology companies, and has broad industry representativeness and authority.

2. Standard Framework and Core Contents

3. Analysis of key technical requirements

3.1 File import interface for static data

File import interface is mainly used to transfer static data from the data source to the big data system. The standard defines two operation modes:

1. Mode 1 (FTP protocol): The client explicitly logs in to the server and uploads and downloads files one by one.
2. Mode 2 (Big Data Transfer Protocol): Scan local files based on rules and transfer multiple files in batches.

4. Implementation suggestions and application cases

4.1 Interface selection suggestions

Enterprises should choose the appropriate interface mode according to their own needs:

• Batch processing first: It is recommended to use the file import interface.
• High real-time requirements: It is recommended to use the message import interface.

4.2 Implementation precautions

During the implementation process, the following points should be noted:

1. Ensure the security, reliability and integrity of data transmission.
2. The interface design should be compatible with different big data system versions.
3. Choose the compression and verification mode based on the specific scenario.