suche 36x36
  • Admin-Scout-small-Banner
           

    CURSOR Admin-Scout

    get the ultimate tool for Informix

    pfeil  
Latest versionsfixlist
14.10.xC10 FixList
12.10.xC16.X5 FixList
11.70.xC9.XB FixList
11.50.xC9.X2 FixList
11.10.xC3.W5 FixList
Have problems? - contact us.
Register for free anmeldung-x26
Contact form kontakt-x26

Informix - Problem description

Problem IT35674 Status: Closed

DBIMPORT OF TABLE WITH TEXT/BYTE COLUMN USES A LOT OF SYSTEM TIME DUE TO
LOCATING THE BLOB VARIABLE IN FILE

product:
INFORMIX SERVER / 5725A3900 / E10 - 
Problem description:
If you strace the dbimport process while it's working on a table
with a text/byte column you can see it repeat the following
pattern of system calls, per row inserted into the table:


20:33:42.726326 open("/tmp/dbx21339_5",
O_WRONLY|O_CREAT|O_TRUNC, 0666) = 12 
20:33:42.734611 fstat(12, {st_mode=S_IFREG|0664, st_size=0,
...}) = 0 
20:33:42.734733 mmap(NULL, 4096, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fc16119d000 
20:33:42.734834 write(12, "XXXXXXXXXXXXXXXXXXXXXXX "..., 304) =
304 
20:33:42.734915 close(12)               = 0 
20:33:42.735082 munmap(0x7fc16119d000, 4096) = 0 
20:33:42.735190 getuid()                = 1500 
20:33:42.735252 getgid()                = 1500 
20:33:42.735314 geteuid()               = 1500 
20:33:42.735386 open("/tmp/dbx21339_5", O_RDONLY) = 12

20:33:42.735475 fcntl(12, F_SETFD, FD_CLOEXEC) = 0 
20:33:42.735556 sendto(10,
"421o010M=263TSXZ000047404430724"...,
124, 0, NULL, 0) = 124 
20:33:42.735696 read(12, "XXXXXXXXXXXXXXXXX "..., 304) = 304

20:33:42.735770 read(12, "", 0)         = 0 
20:33:42.735829 close(12)               = 0 
20:33:42.735890 sendto(10, "'010XXXXXXXXXXXXXXX"..., 314, 0,
NULL, 0) = 314 
20:33:42.735970 recvfrom(10,
"^117201
"..., 4096, 0, NULL, NULL) = 48 

I then did the following performance test using 2 different
versions of an esql/c client, and dbimport to load a single 2
column table, an integer and text field.  The timings were with
the table created as raw (so no logging) and ~115 million rows.

esql/c version 1: 4 hours
esql/c version 2: 4 hours 40 minutes
dbimport : 17 hours 30 minutes

Esql/c version 1 generated all the data in memory (so didn't
read from an .unl file and located the text field using
LOCMEMORY.  Esql/c version 2 read from a dbexport .unl file and
parsed the 2 fields for host variables but then located the blob
host variable also using LOCMEMORY.  Dbimport technically uses
LOCUSER but it appears we've set that up to essentially behave
as if LOCFILE was used.
Problem Summary:
****************************************************************
* USERS AFFECTED:                                              *
* Users of Informix Server prior to 14.10.xC7.                 *
****************************************************************
* PROBLEM DESCRIPTION:                                         *
* See Error Description                                        *
****************************************************************
* RECOMMENDATION:                                              *
* Upgrade to Informix Server 14.10.xC7.                        *
****************************************************************
Local Fix:
Solution
Workaround
****************************************************************
* USERS AFFECTED:                                              *
* Users of Informix Server prior to 14.10.xC7.                 *
****************************************************************
* PROBLEM DESCRIPTION:                                         *
* See Error Description                                        *
****************************************************************
* RECOMMENDATION:                                              *
* Upgrade to Informix Server 14.10.xC7.                        *
****************************************************************
Comment
Fixed in Informix Server 14.10.xC7.
Timestamps
Date  - problem reported    :
Date  - problem closed      :
Date  - last modified       :
22.01.2021
01.11.2021
01.11.2021
Problem solved at the following versions (IBM BugInfos)
Problem solved according to the fixlist(s) of the following version(s)
Informix EditionsInformix Editions
Informix Editions
DocumentationDocumentation
Documentation
IBM NewsletterIBM Newsletter
IBM Newsletter
Current BugsCurrent Bugs
Current Bugs
Bug ResearchBug Research
Bug Research
Bug FixlistsBug Fixlists
Bug Fixlists
Release NotesRelease Notes
Release Notes
Machine NotesMachine Notes
Machine Notes
Release NewsRelease News
Release News
Product LifecycleProduct Lifecycle
Lifecycle
Media DownloadMedia Download
Media Download