• Admin-Scout-small-Banner
           
    CURSOR Admin-Scout
    get the ultimate tool for Informix
    pfeil  
invispix 10x10
invispix 10x10
Latest versionsfixlist
14.10.xC8 FixList
12.10.xC15.X5 FixList
11.70.xC9.XB FixList
11.50.xC9.X2 FixList
11.10.xC3.W5 FixList
Have problems? - contact us.
Register for free anmeldung-x26
Contact form kontakt-x26

Informix - Problem description

Problem IT35674 Status: Closed

DBIMPORT OF TABLE WITH TEXT/BYTE COLUMN USES A LOT OF SYSTEM TIME DUE TO
LOCATING THE BLOB VARIABLE IN FILE

product:
INFORMIX SERVER / 5725A3900 / E10 - 
Problem description:
If you strace the dbimport process while it's working on a table
with a text/byte column you can see it repeat the following
pattern of system calls, per row inserted into the table:


20:33:42.726326 open("/tmp/dbx21339_5",
O_WRONLY|O_CREAT|O_TRUNC, 0666) = 12 
20:33:42.734611 fstat(12, {st_mode=S_IFREG|0664, st_size=0,
...}) = 0 
20:33:42.734733 mmap(NULL, 4096, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc16119d000 
20:33:42.734834 write(12, "XXXXXXXXXXXXXXXXXXXXXXX "..., 304) =
304 
20:33:42.734915 close(12)               = 0 
20:33:42.735082 munmap(0x7fc16119d000, 4096) = 0 
20:33:42.735190 getuid()                = 1500 
20:33:42.735252 getgid()                = 1500 
20:33:42.735314 geteuid()               = 1500 
20:33:42.735386 open("/tmp/dbx21339_5", O_RDONLY) = 12

20:33:42.735475 fcntl(12, F_SETFD, FD_CLOEXEC) = 0 
20:33:42.735556 sendto(10,
"421o010M=263TSXZ000047404430724"...,
124, 0, NULL, 0) = 124 
20:33:42.735696 read(12, "XXXXXXXXXXXXXXXXX "..., 304) = 304

20:33:42.735770 read(12, "", 0)         = 0 
20:33:42.735829 close(12)               = 0 
20:33:42.735890 sendto(10, "'010XXXXXXXXXXXXXXX"..., 314, 0,
NULL, 0) = 314 
20:33:42.735970 recvfrom(10,
"^117201
"..., 4096, 0, NULL, NULL) = 48 

I then did the following performance test using 2 different
versions of an esql/c client, and dbimport to load a single 2
column table, an integer and text field.  The timings were with
the table created as raw (so no logging) and ~115 million rows.

esql/c version 1: 4 hours
esql/c version 2: 4 hours 40 minutes
dbimport : 17 hours 30 minutes

Esql/c version 1 generated all the data in memory (so didn't
read from an .unl file and located the text field using
LOCMEMORY.  Esql/c version 2 read from a dbexport .unl file and
parsed the 2 fields for host variables but then located the blob
host variable also using LOCMEMORY.  Dbimport technically uses
LOCUSER but it appears we've set that up to essentially behave
as if LOCFILE was used.
Problem Summary:
****************************************************************
* USERS AFFECTED:                                              *
* Users of Informix Server prior to 14.10.xC7.                 *
****************************************************************
* PROBLEM DESCRIPTION:                                         *
* See Error Description                                        *
****************************************************************
* RECOMMENDATION:                                              *
* Upgrade to Informix Server 14.10.xC7.                        *
****************************************************************
Local Fix:
Solution
Workaround
****************************************************************
* USERS AFFECTED:                                              *
* Users of Informix Server prior to 14.10.xC7.                 *
****************************************************************
* PROBLEM DESCRIPTION:                                         *
* See Error Description                                        *
****************************************************************
* RECOMMENDATION:                                              *
* Upgrade to Informix Server 14.10.xC7.                        *
****************************************************************
Comment
Fixed in Informix Server 14.10.xC7.
Timestamps
Date  - problem reported    :
Date  - problem closed      :
Date  - last modified       :
22.01.2021
01.11.2021
01.11.2021
Problem solved at the following versions (IBM BugInfos)
Problem solved according to the fixlist(s) of the following version(s)
invispix 10x10
invispix 10x10
invispix 10x10
Technical InfoTechnical Info

Technical Info

DocumentationDocumentation

Documentation

IBM NewsletterIBM Newsletter

IBM Newsletter

Current BugsCurrent Bugs

Current Bugs

Bug ResearchBug Research

Bug Research

Bug FixlistsBug Fixlists

Bug Fixlists

Release NotesRelease Notes

Release Notes

Machine NotesMachine Notes

Machine Notes

Release NewsRelease News

Release News

Product LifecycleProduct Lifecycle

Lifecycle

Media DownloadMedia Download

Media Download

invispix 10x10
Service und SupportService und Support

Service and Support

Informix MonitoringInformix Monitoring

Informix Monitoring

Admin-Scout for InformixAdmin-Scout for Informix

Admin-Scout for Informix

Informix News & InfosInformix News & Infos

Informix News & Infos