数据抽取（Data extraction）.docVIP

数据抽取（Data extraction） Data extraction catalog Definition Data extraction method uses relational database for data source Data source non relational database Expansion definition Data extraction method uses relational database for data source Data source non relational database Edit the paragraph definition data extraction is the process of extracting data from the data source. Edit this paragraph data extraction way, data source using relational database In practical application, the relational database is used for more data sources. Extracting data from the database generally has the following ways. (1) the amount of extraction total extraction similar to the data transfer or copy the data, it will be a table or view in the data source data from the database of the wholly intact extracted and converted into their own ETL tools can identify the format. Total volume extraction is relatively simple. (2) incremental extraction incremental extraction only extracts new, modified and deleted data from the tables to be extracted from the database since the last extraction. In the process of using ETL. Incremental extraction is more widely used than total amount extraction. How to capture the changing data is the key to incremental extraction. Generally, there are two requirements for capture method: accuracy, accurate capture of change data in the business system; performance, minimize the pressure on the business system, affect the existing business. The current method of capturing change data used in incremental data extraction: A. trigger: to establish triggers in the selected table, to establish a general insert, modify and delete three triggers, when source data in the table is changed, the corresponding trigger will change the data into a temporary table. Data extraction thread from the temporary table extraction. The advantage of flip flop is the high performance of data extraction. The disadvantage is that the trigger is required to be set up in the business databa