并行导出clob大表_exclude="constraint,grant,index,statistics-程序员宅基地

技术标签: oracle  

脚本参考:

SQL> desc MEDICAL_CHECK_SYSINFO_H
 Name                                               Null?    Type
 ----------------------------------------------------------------------------------------- -------- ------------------------------------------------------------
 ID                                               NOT NULL NUMBER(10)
 REGISTER_NO                                           NOT NULL VARCHAR2(50 CHAR)
 PATIENT_ID                                           NOT NULL NUMBER(10)
 ORG_CODE                                           NOT NULL VARCHAR2(50 CHAR)
 MICODE                                            NOT NULL VARCHAR2(50 CHAR)
 ICNO                                               NOT NULL VARCHAR2(50 CHAR)
 SERVER_DATE                                           NOT NULL TIMESTAMP(9)
 ALLOW_QUERY_FLAG                                       NOT NULL NUMBER(10)
 SIGNINFO                                           NOT NULL VARCHAR2(50 CHAR)
 RAW_DATA                                                CLOB
 

查看导出job:

SET lines 200 
COL owner_name FORMAT a10;
COL job_name FORMAT a20;
COL state FORMAT a12;
COL operation LIKE state;
COL job_mode LIKE state;
COL owner.object for a50;
 
-- locate Data Pump jobs: 
SELECT owner_name, job_name, rtrim(operation) "OPERATION", 
    rtrim(job_mode) "JOB_MODE", state, attached_sessions
FROM dba_datapump_jobs
 WHERE job_name NOT LIKE 'BIN$%'
 ORDER BY 1,2; 

SELECT o.status, o.object_id, o.object_type, 
       o.owner||'.'||object_name "OWNER.OBJECT" 
  FROM dba_objects o, dba_datapump_jobs j 
 WHERE o.owner=j.owner_name AND o.object_name=j.job_name 
   AND j.job_name NOT LIKE 'BIN$%' ORDER BY 4,2;

异常终止expdp处理:

expdp xxx/xxx@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:\"where mod\(dbms_rowid.rowid_block_number\(rowid\), 10\) = 7\" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_7.dmp logfile=log_test_7.log 

SQL> SET lines 200 
COL owner_name FORMAT a10;
COL job_name FORMAT a20;
COL state FORMAT a12;
COL operation LIKE state;
COL job_mode LIKE state;
COL owner.object for a50;

SQL> SELECT o.status, o.object_id, o.object_type, 
       o.owner||'.'||object_name "OWNER.OBJECT" 
  FROM dba_objects o, dba_datapump_jobs j 
 WHERE o.owner=j.owner_name AND o.object_name=j.job_name 
   AND j.job_name NOT LIKE 'BIN$%' ORDER BY 4,2;  2    3    4    5  

STATUS	 OBJECT_ID OBJECT_TYPE
------- ---------- -----------------------
OWNER.OBJECT
--------------------------------------------------------------------------------
VALID	     94147 TABLE
xxx.SYS_EXPORT_TABLE_10

SQL> -- locate Data Pump jobs: 
SQL>SELECT owner_name, job_name, rtrim(operation) "OPERATION", 
    rtrim(job_mode) "JOB_MODE", state, attached_sessions
FROM dba_datapump_jobs
 WHERE job_name NOT LIKE 'BIN$%';

OWNER_NAME JOB_NAME		OPERATION    JOB_MODE	  STATE        ATTACHED_SESSIONS
---------- -------------------- ------------ ------------ ------------ -----------------
xxx	   SYS_EXPORT_TABLE_10	EXPORT	     TABLE	  STOP PENDING		       0

SQL> /

OWNER_NAME JOB_NAME		OPERATION    JOB_MODE	  STATE        ATTACHED_SESSIONS
---------- -------------------- ------------ ------------ ------------ -----------------
xxx	   SYS_EXPORT_TABLE_10	EXPORT	     TABLE	  STOP PENDING		       0

SQL> /

OWNER_NAME JOB_NAME		OPERATION    JOB_MODE	  STATE        ATTACHED_SESSIONS
---------- -------------------- ------------ ------------ ------------ -----------------
xxx	   SYS_EXPORT_TABLE_10	EXPORT	     TABLE	  STOPPING		       0

SQL> /

no rows selected

SQL> SELECT o.status, o.object_id, o.object_type, 
       o.owner||'.'||object_name "OWNER.OBJECT" 
  FROM dba_objects o, dba_datapump_jobs j 
 WHERE o.owner=j.owner_name AND o.object_name=j.job_name 
   AND j.job_name NOT LIKE 'BIN$%' ORDER BY 4,2;   2    3    4    5  

no rows selected



[oracle@rac1 dmp]$ expdp xxx/xxx@xxxdb attach=SYS_EXPORT_TABLE_10

Export: Release 19.0.0.0.0 - Production on Sat Jun 19 13:11:41 2021
Version 19.11.0.0.0

Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Job: SYS_EXPORT_TABLE_10
  Owner: xxx                            
  Operation: EXPORT                         
  Creator Privs: TRUE                           
  GUID: C5186FACCC327C75E053820AA8C04187
  Start Time: Saturday, 19 June, 2021 13:08:53
  Mode: TABLE                          
  Instance: xxx1
  Max Parallelism: 1
  Timezone: +00:00
  Timezone version: 32
  Endianness: LITTLE
  NLS character set: ZHS16GBK
  NLS NCHAR character set: AL16UTF16
  EXPORT Job Parameters:
  Parameter Name      Parameter Value:
     CLIENT_COMMAND        xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 7" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_7.dmp logfile=log_test_7.log 
     TRACE                 0
  State: STOP PENDING                   
  Bytes Processed: 0
  Current Parallelism: 1
  Job Error Count: 0
  Job heartbeat: 112
  Dump File: /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_7.dmp
    bytes written: 32,768
  
Worker 1 Status:
  Instance ID: 1
  Instance name: xxx1
  Host name: rac1
  Object start time: Saturday, 19 June, 2021 13:09:17
  Object status at: Saturday, 19 June, 2021 13:09:17
  Process Name: DW03
  State: EXECUTING                      
  Object Schema: xxx
  Object Name: MEDICAL_CHECK_SYSINFO_H
  Object Type: TABLE_EXPORT/TABLE/TABLE_DATA
  Completed Objects: 1
  Total Objects: 1
  Completed Rows: 163,321
  Worker Parallelism: 1

Export> kill_job
Are you sure you wish to stop this job ([yes]/no): yes

查看lob表大小:

select a.owner,a.table_name,a.column_name,b.segment_name,ROUND(b.BYTES / 1024 / 1024)
  from dba_lobs a, dba_segments b
 where a.segment_name = b.segment_name
   and a.owner = 'XXX'
   and a.table_name = 'MEDICAL_CHECK_SYSINFO_H'
union all
select a.owner,a.table_name,a.column_name,b.segment_name,ROUND(b.BYTES / 1024 / 1024)
  from dba_lobs a, dba_segments b
 where a.index_name = b.segment_name
   and a.owner = 'XXX'
   and a.table_name = 'MEDICAL_CHECK_SYSINFO_H'
union all
select a.owner,'','',a.segment_name,ROUND(sum(a.BYTES) / 1024 / 1024)
  from dba_segments a
 where a.owner = 'XXX'
   and a.segment_name = 'MEDICAL_CHECK_SYSINFO_H' group by a.owner,a.segment_name;

1.sh内容:注意i必须从0开始

导出:
#!/bin/bash
chunk=10
for ((i=0;i<=9;i++));
do
expdp xxx/xxx@xxxTABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:\"where mod\(dbms_rowid.rowid_block_number\(rowid\)\, ${chunk}\) = ${i}\" directory=DMP cluster=N exclude=statistics dumpfile=MEDICAL_CHECK_SYSINFO_H_${i}.dmp logfile=log_test_${i}.log &
echo $i
sleep 2  #不加延迟2秒,将导致输出太快报错ORA-31626: job does not exist
done

导入:需要先导入元表结构并排除索引exclude=index,constraint,trigger,statistics,然后执行下面脚本导入content=data_only最后导入include=index,constraint,trigger,statistics

#!/bin/bash
chunk=10
for ((i=0;i<=9;i++));
do
impdp xxx/xxx@xxx  directory=DMP REMAP_TABLE=MEDICAL_CHECK_SYSINFO_H:MEDICAL_CHECK_SYSINFO_H  remap_schema=xxx:target dumpfile=MEDICAL_CHECK_SYSINFO_H_${i}.dmp logfile=TABLE_imp_log_test_${i}.log  DATA_OPTIONS=DISABLE_APPEND_HINT CONTENT=DATA_ONLY cluster=N exclude=statistics &
sleep 2
done

DISABLE_APPEND_HINT — Specifies that you do not want the import operation to use the APPEND hint while loading the data object. Disabling the APPEND hint can be useful if there is a small set of data objects to load that already exist in the database and some other application may be concurrently accessing one or more of the data objects. 

https://docs.oracle.com/en/database/oracle/oracle-database/12.2/sutil/datapump-import-utility.html#GUID-5FFA128D-B7F5-41D0-A72C-EB2CE384765D

并行导出操作记录参考:13分钟,120GB大小

查看job任务:


select owner_name, job_name, operation, job_mode, state, attached_sessions 
from dba_datapump_jobs 
where job_name not like 'BIN$%' 
order by 1, 2;

执行窗口:

[oracle@rac1 dmp]$ chmod +x 1.sh
[oracle@rac1 dmp]$ ./1.sh
0
1
2
3
4
5
6
7
8
9
[oracle@rac1 dmp]$ 
Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Version 19.11.0.0.0

Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.


Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Version 19.11.0.0.0
Version 19.11.0.0.0


Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.

Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Version 19.11.0.0.0



Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
Version 19.11.0.0.0
Version 19.11.0.0.0



Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
Version 19.11.0.0.0


Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
Version 19.11.0.0.0

Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.


Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Version 19.11.0.0.0
Version 19.11.0.0.0


Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
ORA-31626: job does not exist
ORA-31633: unable to create master table "xxx.SYS_EXPORT_TABLE_07"
ORA-06512: at "SYS.DBMS_SYS_ERROR", line 95
ORA-06512: at "SYS.KUPV$FT", line 1163
ORA-00955: name is already used by an existing object
ORA-06512: at "SYS.KUPV$FT", line 1056
ORA-06512: at "SYS.KUPV$FT", line 1044


ORA-31626: job does not exist
ORA-31633: unable to create master table "xxx.SYS_EXPORT_TABLE_08"
ORA-06512: at "SYS.DBMS_SYS_ERROR", line 95
ORA-06512: at "SYS.KUPV$FT", line 1163
ORA-00955: name is already used by an existing object
ORA-06512: at "SYS.KUPV$FT", line 1056
ORA-06512: at "SYS.KUPV$FT", line 1044


Starting "xxx"."SYS_EXPORT_TABLE_01":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 1" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_1.dmp logfile=log_test_1.log 
Starting "xxx"."SYS_EXPORT_TABLE_02":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 0" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_0.dmp logfile=log_test_0.log 
Starting "xxx"."SYS_EXPORT_TABLE_08":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 4" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_4.dmp logfile=log_test_4.log 
Starting "xxx"."SYS_EXPORT_TABLE_07":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 6" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_6.dmp logfile=log_test_6.log 
Starting "xxx"."SYS_EXPORT_TABLE_04":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 2" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_2.dmp logfile=log_test_2.log 
Starting "xxx"."SYS_EXPORT_TABLE_03":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 3" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_3.dmp logfile=log_test_3.log 
Starting "xxx"."SYS_EXPORT_TABLE_05":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 9" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_9.dmp logfile=log_test_9.log 
Starting "xxx"."SYS_EXPORT_TABLE_06":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 5" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_5.dmp logfile=log_test_5.log 
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.80 GB  313975 rows
Master table "xxx"."SYS_EXPORT_TABLE_08" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_08 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_4.dmp
Job "xxx"."SYS_EXPORT_TABLE_08" successfully completed at Fri Jun 18 16:35:26 2021 elapsed 0 00:11:08

. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.88 GB  314981 rows
Master table "xxx"."SYS_EXPORT_TABLE_05" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_05 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_9.dmp
Job "xxx"."SYS_EXPORT_TABLE_05" successfully completed at Fri Jun 18 16:35:34 2021 elapsed 0 00:11:18

. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.85 GB  313992 rows
Master table "xxx"."SYS_EXPORT_TABLE_01" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_01 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_1.dmp
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.78 GB  314160 rows
Job "xxx"."SYS_EXPORT_TABLE_01" successfully completed at Fri Jun 18 16:35:39 2021 elapsed 0 00:11:24

. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.85 GB  314894 rows
Master table "xxx"."SYS_EXPORT_TABLE_06" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_06 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_5.dmp
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.91 GB  316471 rows
Master table "xxx"."SYS_EXPORT_TABLE_03" successfully loaded/unloaded
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.97 GB  317177 rows
Job "xxx"."SYS_EXPORT_TABLE_06" successfully completed at Fri Jun 18 16:35:42 2021 elapsed 0 00:11:26

******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_03 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_3.dmp
Master table "xxx"."SYS_EXPORT_TABLE_07" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_07 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_6.dmp
Job "xxx"."SYS_EXPORT_TABLE_03" successfully completed at Fri Jun 18 16:35:44 2021 elapsed 0 00:11:29

Master table "xxx"."SYS_EXPORT_TABLE_04" successfully loaded/unloaded
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.91 GB  316566 rows
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_04 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_2.dmp
Job "xxx"."SYS_EXPORT_TABLE_07" successfully completed at Fri Jun 18 16:35:45 2021 elapsed 0 00:11:27

Job "xxx"."SYS_EXPORT_TABLE_04" successfully completed at Fri Jun 18 16:35:46 2021 elapsed 0 00:11:30

Master table "xxx"."SYS_EXPORT_TABLE_02" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_02 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_0.dmp
Job "xxx"."SYS_EXPORT_TABLE_02" successfully completed at Fri Jun 18 16:35:47 2021 elapsed 0 00:11:33

另一窗口记录:

SQL> col state for a10
SQL> 
 select owner_name, job_name, operation, job_mode, state, attached_sessions
 from dba_datapump_jobs
 where job_name not like 'BIN$%'
 order by 1, 2

OWNER_NAME JOB_NAME			  OPERAT JOB_MO STATE	   ATTACHED_SESSIONS
---------- ------------------------------ ------ ------ ---------- -----------------
xxx	   SYS_EXPORT_TABLE_01		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_02		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_03		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_04		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_05		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_06		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_07		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_08		  EXPORT TABLE	EXECUTING		   1

8 rows selected.

SQL> exit
Disconnected from Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.11.0.0.0
[oracle@rac1 ~]$ cd /oracle/dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_0.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_1.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_2.dmp
8.0G	MEDICAL_CHECK_SYSINFO_H_3.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_4.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_5.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_6.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_0.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_1.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_2.dmp
8.0G	MEDICAL_CHECK_SYSINFO_H_3.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_4.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_5.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_6.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
16G	MEDICAL_CHECK_SYSINFO_H_0.dmp
16G	MEDICAL_CHECK_SYSINFO_H_1.dmp
16G	MEDICAL_CHECK_SYSINFO_H_2.dmp
16G	MEDICAL_CHECK_SYSINFO_H_3.dmp
16G	MEDICAL_CHECK_SYSINFO_H_4.dmp
16G	MEDICAL_CHECK_SYSINFO_H_5.dmp
16G	MEDICAL_CHECK_SYSINFO_H_6.dmp
16G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
16G	MEDICAL_CHECK_SYSINFO_H_0.dmp
16G	MEDICAL_CHECK_SYSINFO_H_1.dmp
16G	MEDICAL_CHECK_SYSINFO_H_2.dmp
16G	MEDICAL_CHECK_SYSINFO_H_3.dmp
16G	MEDICAL_CHECK_SYSINFO_H_4.dmp
16G	MEDICAL_CHECK_SYSINFO_H_5.dmp
16G	MEDICAL_CHECK_SYSINFO_H_6.dmp
16G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
16G	MEDICAL_CHECK_SYSINFO_H_0.dmp
16G	MEDICAL_CHECK_SYSINFO_H_1.dmp
16G	MEDICAL_CHECK_SYSINFO_H_2.dmp
16G	MEDICAL_CHECK_SYSINFO_H_3.dmp
16G	MEDICAL_CHECK_SYSINFO_H_4.dmp
16G	MEDICAL_CHECK_SYSINFO_H_5.dmp
16G	MEDICAL_CHECK_SYSINFO_H_6.dmp
16G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ sar 1 10
Linux 5.4.17-2011.6.2.el7uek.x86_64 (rac1) 	06/18/2021 	_x86_64_	(64 CPU)

04:31:35 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
04:31:36 PM     all      3.41      0.00      2.59      3.39      0.00     90.62
04:31:37 PM     all      3.40      0.00      2.25      3.22      0.00     91.13
04:31:38 PM     all      3.33      0.00      2.21      2.95      0.00     91.52
04:31:39 PM     all      3.31      0.00      2.16      3.70      0.00     90.83
04:31:40 PM     all      3.28      0.00      2.11      4.65      0.00     89.96
04:31:41 PM     all      3.21      0.00      2.38      5.04      0.00     89.36
04:31:42 PM     all      3.15      0.00      1.97      4.43      0.00     90.44
04:31:43 PM     all      3.21      0.00      1.86      3.72      0.00     91.21
04:31:44 PM     all      3.06      0.00      2.02      4.56      0.00     90.37
04:31:45 PM     all      3.15      0.00      1.92      4.47      0.00     90.46
Average:        all      3.25      0.00      2.15      4.01      0.00     90.59
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
12G	MEDICAL_CHECK_SYSINFO_H_0.dmp
12G	MEDICAL_CHECK_SYSINFO_H_1.dmp
12G	MEDICAL_CHECK_SYSINFO_H_2.dmp
12G	MEDICAL_CHECK_SYSINFO_H_3.dmp
12G	MEDICAL_CHECK_SYSINFO_H_4.dmp
12G	MEDICAL_CHECK_SYSINFO_H_5.dmp
12G	MEDICAL_CHECK_SYSINFO_H_6.dmp
12G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
12G	MEDICAL_CHECK_SYSINFO_H_0.dmp
12G	MEDICAL_CHECK_SYSINFO_H_1.dmp
12G	MEDICAL_CHECK_SYSINFO_H_2.dmp
12G	MEDICAL_CHECK_SYSINFO_H_3.dmp
12G	MEDICAL_CHECK_SYSINFO_H_4.dmp
12G	MEDICAL_CHECK_SYSINFO_H_5.dmp
12G	MEDICAL_CHECK_SYSINFO_H_6.dmp
12G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
12G	MEDICAL_CHECK_SYSINFO_H_0.dmp
12G	MEDICAL_CHECK_SYSINFO_H_1.dmp
12G	MEDICAL_CHECK_SYSINFO_H_2.dmp
12G	MEDICAL_CHECK_SYSINFO_H_3.dmp
12G	MEDICAL_CHECK_SYSINFO_H_4.dmp
12G	MEDICAL_CHECK_SYSINFO_H_5.dmp
12G	MEDICAL_CHECK_SYSINFO_H_6.dmp
12G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ ls -lt|more
total 239233592
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_0.log
-rw-r----- 1 oracle asmadmin 12790267904 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_0.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_2.log
-rw-r----- 1 oracle asmadmin 12857425920 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_2.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_6.log
-rw-r----- 1 oracle asmadmin 12797472768 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_6.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_3.log
-rw-r----- 1 oracle asmadmin 12729819136 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_3.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_5.log
-rw-r----- 1 oracle asmadmin 12649000960 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_5.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_1.log
-rw-r----- 1 oracle asmadmin 12726243328 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_1.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_9.log
-rw-r----- 1 oracle asmadmin 12764639232 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_9.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_4.log
-rw-r----- 1 oracle asmadmin 12672323584 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_4.dmp
-rwxr-xr-x 1 oracle oinstall         304 Jun 18 16:23 1.sh

[oracle@rac1 dmp]$ more log_test_4.log
;;; 
Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Version 19.11.0.0.0

Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
;;; 
Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Starting "xxx"."SYS_EXPORT_TABLE_08":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(ro
wid), 10) = 4" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_4.dmp logfile=log_test_4.log 
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.80 GB  313975 rows
Master table "xxx"."SYS_EXPORT_TABLE_08" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_08 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_4.dmp
Job "xxx"."SYS_EXPORT_TABLE_08" successfully completed at Fri Jun 18 16:35:26 2021 elapsed 0 00:11:08
[oracle@rac1 dmp]$ sqlplus xxx/xxx123890@xxxdb

SQL*Plus: Release 19.0.0.0.0 - Production on Fri Jun 18 16:37:44 2021
Version 19.11.0.0.0

Copyright (c) 1982, 2020, Oracle.  All rights reserved.

Last Successful login time: Fri Jun 18 2021 16:26:59 +08:00

Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.11.0.0.0

SQL> select count(*) from dba_datapump_jobs;        

  COUNT(*)
----------
	 0

非并行普通导出,消耗34分钟,大小120G,比并行慢接近3倍。

[oracle@rac1 dmp]$ expdp xxx/xxx@xxx TABLES=MEDICAL_CHECK_SYSINFO_H directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H.dmp logfile=log_test.log

Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:48:00 2021
Version 19.11.0.0.0

Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Starting "xxx"."SYS_EXPORT_TABLE_01":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H.dmp logfile=log_test.log 
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             118.6 GB 3152056 rows
Master table "xxx"."SYS_EXPORT_TABLE_01" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_01 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H.dmp
Job "xxx"."SYS_EXPORT_TABLE_01" successfully completed at Fri Jun 18 17:22:54 2021 elapsed 0 00:34:53

[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO_H.dmp 
119G	MEDICAL_CHECK_SYSINFO_H.dmp

 

参考:https://www.linkedin.com/pulse/optimising-lob-export-import-performance-via-oracle-datapump-arya/

版权声明:本文为博主原创文章,遵循 CC 4.0 BY-SA 版权协议,转载请附上原文出处链接和本声明。
本文链接:https://blog.csdn.net/jycjyc/article/details/118029262

智能推荐

Java Robot类使用指南-程序员宅基地

文章浏览阅读4.3w次,点赞74次,收藏299次。Robot类用于为测试自动化、自运行演示程序和其他需要控制鼠标和键盘的应用程序生成本机系统输入事件。Robot 的主要目的是便于 Java 平台实现自动测试。_robot类

[ app.json 文件内容错误] app.json: 在项目根目录未找到 app.json_[ app.json 文件内容错误] app.json: 在项目根目录未找到 app.json (e-程序员宅基地

文章浏览阅读2.9w次,点赞31次,收藏134次。[ app.json 文件内容错误] app.json: 在项目根目录未找到 app.json_[ app.json 文件内容错误] app.json: 在项目根目录未找到 app.json (env: windows

Python+Vue计算机毕业设计晴川校园失物招领系统k95lf(源码+程序+LW+部署)-程序员宅基地

文章浏览阅读28次。Python3.7.7+Django+Mysql5.7+pip list+HBuilderX(Vscode也行)+Vue+Pychram社区版。2. 前端:vue+css+javascript+jQuery+easyUI+highcharts。2.IDE环境:Python和Python 社区版都可以。Django + Vue +Python+Mysql 等等组成,B/S模式等等。该项目含有源码、文档、程序、数据库、配套开发软件、软件安装教程。1. 后端:Python、Vue、Django、Mysql。

Spring Boot + MyBatis + MySQL 实现读写分离!-程序员宅基地

文章浏览阅读109次。作者:废物大师兄来源:https://www.cnblogs.com/cjsblog/p/9712457.html1、引言读写分离要做的事情就是对于一条SQL该选择哪个数据库去执行,至于谁..._springboot实现读写分离mysql

Vue路由(二)_this.$router.push 最上级路径-程序员宅基地

文章浏览阅读799次。使用nginx部署项目web服务器:TOMCAT java htmlAPache PHP html javaIIS asp 和 asp.netundowtow javanodejs 它可以部署web服务器nginx html php 部署前端,比较流行的一个web服务器启动 CD到nginx目录 执行 nginx 或者 start nginx 或者 直接运行nginx.exe关闭 nginx -s stop 或 任务管理器 ctrl+alt+esclocation / {root_this.$router.push 最上级路径

2021年各大互联网大厂年终奖一览表~新年干劲十足_年终奖bg-程序员宅基地

文章浏览阅读5.8k次。2021年各大互联网大厂年终奖一览表~新年干劲十足_年终奖bg

随便推点

排序算法之计数排序-程序员宅基地

文章浏览阅读499次,点赞8次,收藏6次。计数排序的时间复杂度为O(n+k),其中n是需要排序的元素数量,k是数组中的最大值与最小值的差值。这是因为计数排序需要遍历整个数组来统计元素出现的次数,然后还需要执行一次线性复制操作来将排序后的元素复制回原始数组。

Java基于网页的车辆检测站登录软件(开题+源码)_网页设计在机动车检测中的应用-程序员宅基地

文章浏览阅读920次,点赞24次,收藏21次。通过实现驾驶员、驾驶证、行驶证、通知公告、检测员、检测预约、检测接单、检测结果等系统功能,该软件系统将全面改善车辆检测的流程和效果。在当前的车辆检测市场中,大多数检测站都采用传统的纸质文档管理和人工检测方式,这不仅增加了检测成本,还可能因为人为错误或疏忽导致安全隐患。因此,开发一款基于网页的车辆检测站登录软件,有助于实现信息化管理和自动化检测,从而降低事故风险,提高道路安全。通过实现以上功能,本研究旨在提高车辆检测的效率和质量,降低道路事故风险,为社会的安全稳定做出贡献。第五阶段:撰写论文(3周)_网页设计在机动车检测中的应用

跨域问题解决方案--Nginx代理转发_nginx使用了代理转发就不会有跨域问题吗-程序员宅基地

文章浏览阅读1.3k次。文章目录问题描述解决方案问题描述有这么一个html页面,具体代码如下:Nginx_CORS.html<!DOCTYPE html><html lang="en"><head> <meta charset="UTF-8"> <meta name="viewport" content="width=device-wid..._nginx使用了代理转发就不会有跨域问题吗

java对集合遍历的四种方式_java集合遍历-程序员宅基地

文章浏览阅读3.6k次,点赞5次,收藏37次。java遍历集合的四种方式:普通for循环迭代器加强for循环(foreach)list.forEach_java集合遍历

安装Java (JDK16)_java16.02安装-程序员宅基地

文章浏览阅读291次。本文将在win10的环境下安装jdk16、配置环境变量。1.下载JDK(1)打开官网下载最新的JDK(Java SE Development Kit, JDK)(2)选择对应的版本(3)双击下载的exe进行安装在安装过程中可以改变安装位置也可以不改变,但是安装的位置一定要记住!!!!这关系到后面设置环境变量。然后安装过程中其它的选项就next~(4)配置环境变量一共需要配置3个系统环境变量。此电脑–属性–高级系统设置–环境变量—新建系统变量一定注意是系统变量!!!!别搞错了!!!!_java16.02安装

2023年MathorCup数学建模C题思路 - 电商物流网络包裹应急调运与结构优化问题_数学建模物流配网络问题-程序员宅基地

文章浏览阅读720次。1 赛题C 题 电商物流网络包裹应急调运与结构优化问题电商物流网络由物流场地(接货仓、分拣中心、营业部等)和物流场地之间的运输线路组成,如图 1 所示。受节假日和“双十一”、“618”等促销活动的影响,电商用户的下单量会发生显著波动,而疫情、地震等突发事件导致物流场地临时或永久停用时,其处理的包裹将会紧急分流到其他物流场地,这些因素均会影响到各条线路运输的包裹数量,以及各个物流场地处理的包裹数量。_数学建模物流配网络问题