1. Forum
  2. Usenet
  3. COMP.DATABASES.INGRES

  • [Info-ingres] Error from auditdb

    From Martin Bowes@21:1/5 to All on Wed May 5 08:39:02 2021
    Hi All,

    So I needed to run auditdb on a database...

    Wed May 5 09:36:30 2021 E_DM1206_ATP_TOO_MANY_TX Too many simultaneous transactions.
    ...
    Lots and lots of these, and no transaction details whatsoever.

    Never seen that one before!

    I tried to restrict it to a specific table of interest, but got the same result.

    Ideas?

    Marty


    <html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
    <head>
    <meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
    <meta name="Generator" content="Microsoft Word 15 (filtered medium)"> <style><!--
    /* Font Definitions */
    @font-face
    {font-family:"Cambria Math";
    panose-1:2 4 5 3 5 4 6 3 2 4;}
    @font-face
    {font-family:Calibri;
    panose-1:2 15 5 2 2 2 4 3 2 4;}
    @font-face
    {font-family:"Lucida Console";
    panose-1:2 11 6 9 4 5 4 2 2 4;}
    /* Style Definitions */
    p.MsoNormal, li.MsoNormal, div.MsoNormal
    {margin:0cm;
    margin-bottom:.0001pt;
    font-size:11.0pt;
    font-family:"Calibri",sans-serif;
    mso-fareast-language:EN-US;}
    a:link, span.MsoHyperlink
    {mso-style-priority:99;
    color:#0563C1;
    text-decoration:underline;}
    a:visited, span.MsoHyperlinkFollowed
    {mso-style-priority:99;
    color:#954F72;
    text-decoration:underline;}
    span.EmailStyle17
    {mso-style-type:personal-compose;
    font-family:"Calibri",sans-serif;
    color:windowtext;}
    .MsoChpDefault
    {mso-style-type:export-only;
    font-family:"Calibri",sans-serif;
    mso-fareast-language:EN-US;}
    @page WordSection1
    {size:612.0pt 792.0pt;
    margin:72.0pt 72.0pt 72.0pt 72.0pt;}
    div.WordSection1
    {page:WordSection1;}
    </style><!--[if gte mso 9]><xml>
    <o:shapedefaults v:ext="edit" spidmax="1026" />
    </xml><![endif]--><!--[if gte mso 9]><xml>
    <o:shapelayout v:ext="edit">
    <o:idmap v:ext="edit" data="1" />
    </o:shapelayout></xml><![endif]-->
    </head>
    <body lang="EN-GB" link="#0563C1" vlink="#954F72">
    <div class="WordSection1">
    <p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;font-family:&quot;Lucida Console&quot;">Hi All,<o:p></o:p></span></p>
    <p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;font-family:&quot;Lucida Console&quot;"><o:p>&nbsp;</o:p></span></p>
    <p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;font-family:&quot;Lucida Console&quot;">So I needed to run auditdb on a database&#8230;<o:p></o:p></span></p>
    <p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;font-family:&quot;Lucida Console&quot;"><o:p>&nbsp;</o:p></span></p>
    <p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;font-family:&quot;Lucida Console&quot;">Wed May&nbsp; 5 09:36:30 2021 E_DM1206_ATP_TOO_MANY_TX&nbsp;&nbsp; Too many simultaneous transactions.<o:p></o:p></span></p>
    <p class="MsoNormal">&#8230;<o:p></o:p></p>
    <p class="MsoNormal">Lots and lots of these, and no transaction details whatsoever.<o:p></o:p></p>
    <p class="MsoNormal"><o:p>&nbsp;</o:p></p>
    <p class="MsoNormal">Never seen that one before!<o:p></o:p></p>
    <p class="MsoNormal"><o:p>&nbsp;</o:p></p>
    <p class="MsoNormal">I tried to restrict it to a specific table of interest, but got the same result.<o:p></o:p></p>
    <p class="MsoNormal"><o:p>&nbsp;</o:p></p>
    <p class="MsoNormal">Ideas?<o:p></o:p></p>
    <p class="MsoNormal"><o:p>&nbsp;</o:p></p>
    <p class="MsoNormal">Marty<o:p></o:p></p>
    <p class="MsoNormal"><o:p>&nbsp;</o:p></p>
    </div>
    </body>
    </html>

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Martin Bowes@21:1/5 to All on Wed May 5 09:06:57 2021
    Hi All,

    Some very narrow -b and -e restrictions managed to crack the nut.

    Marty

    From: Martin Bowes
    Sent: 05 May 2021 09:39
    To: info-ingres@lists.planetingres.org
    Subject: Error from auditdb

    Hi All,

    So I needed to run auditdb on a database...

    Wed May 5 09:36:30 2021 E_DM1206_ATP_TOO_MANY_TX Too many simultaneous transactions.
    ...
    Lots and lots of these, and no transaction details whatsoever.

    Never seen that one before!

    I tried to restrict it to a specific table of interest, but got the same result.

    Ideas?

    Marty


    <html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
    <head>
    <meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
    <meta name="Generator" content="Microsoft Word 15 (filtered medium)"> <style><!--
    /* Font Definitions */
    @font-face
    {font-family:"Cambria Math";
    panose-1:2 4 5 3 5 4 6 3 2 4;}
    @font-face
    {font-family:Calibri;
    panose-1:2 15 5 2 2 2 4 3 2 4;}
    @font-face
    {font-family:"Lucida Console";
    panose-1:2 11 6 9 4 5 4 2 2 4;}
    /* Style Definitions */
    p.MsoNormal, li.MsoNormal, div.MsoNormal
    {margin:0cm;
    margin-bottom:.0001pt;
    font-size:11.0pt;
    font-family:"Calibri",sans-serif;
    mso-fareast-language:EN-US;}
    a:link, span.MsoHyperlink
    {mso-style-priority:99;
    color:#0563C1;
    text-decoration:underline;}
    a:visited, span.MsoHyperlinkFollowed
    {mso-style-priority:99;
    color:#954F72;
    text-decoration:underline;}
    p.msonormal0, li.msonormal0, div.msonormal0
    {mso-style-name:msonormal;
    mso-margin-top-alt:auto;
    margin-right:0cm;
    mso-margin-bottom-alt:auto;
    margin-left:0cm;
    font-size:12.0pt;
    font-family:"Times New Roman",serif;}
    span.EmailStyle18
    {mso-style-type:personal;
    font-family:"Calibri",sans-serif;
    color:windowtext;}
    span.EmailStyle19
    {mso-style-type:personal-reply;
    font-family:"Calibri",sans-serif;
    color:#1F497D;}
    .MsoChpDefault
    {mso-style-type:export-only;
    font-size:10.0pt;}
    @page WordSection1
    {size:612.0pt 792.0pt;
    margin:72.0pt 72.0pt 72.0pt 72.0pt;}
    div.WordSection1
    {page:WordSection1;}
    </style><!--[if gte mso 9]><xml>
    <o:shapedefaults v:ext="edit" spidmax="1026" />
    </xml><![endif]--><!--[if gte mso 9]><xml>
    <o:shapelayout v:ext="edit">
    <o:idmap v:ext="edit" data="1" />
    </o:shapelayout></xml><![endif]-->
    </head>
    <body lang="EN-GB" link="#0563C1" vlink="#954F72">
    <div class="WordSection1">
    <p class="MsoNormal"><span style="color:#1F497D">Hi All,<o:p></o:p></span></p> <p class="MsoNormal"><span style="color:#1F497D"><o:p>&nbsp;</o:p></span></p> <p class="MsoNormal"><span style="color:#1F497D">Some very narrow &#8211;b and &#8211;e restrictions managed to crack the nut.<o:p></o:p></span></p>
    <p class="MsoNormal"><span style="color:#1F497D"><o:p>&nbsp;</o:p></span></p> <p class="MsoNormal"><span style="color:#1F497D">Marty<o:p></o:p></span></p>
    <p class="MsoNormal"><span style="color:#1F497D"><o:p>&nbsp;</o:p></span></p> <div>
    <div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
    <p class="MsoNormal"><b><span lang="EN-US" style="mso-fareast-language:EN-GB">From:</span></b><span lang="EN-US" style="mso-fareast-language:EN-GB"> Martin Bowes

    <b>Sent:</b> 05 May 2021 09:39<br>
    <b>To:</b> info-ingres@lists.planetingres.org<br>
    <b>Subject:</b> Error from auditdb<o:p></o:p></span></p>
    </div>
    </div>
    <p class="MsoNormal"><o:p>&nbsp;</o:p></p>
    <p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;font-family:&quot;Lucida Console&quot;">Hi All,<o:p></o:p></span></p>
    <p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;font-family:&quot;Lucida Console&quot;"><o:p>&nbsp;</o:p></span></p>
    <p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;font-family:&quot;Lucida Console&quot;">So I needed to run auditdb on a database&#8230;<o:p></o:p></span></p>
    <p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;font-family:&quot;Lucida Console&quot;"><o:p>&nbsp;</o:p></span></p>
    <p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;font-family:&quot;Lucida Console&quot;">Wed May&nbsp; 5 09:36:30 2021 E_DM1206_ATP_TOO_MANY_TX&nbsp;&nbsp; Too many simultaneous transactions.<o:p></o:p></span></p>
    <p class="MsoNormal">&#8230;<o:p></o:p></p>
    <p class="MsoNormal">Lots and lots of these, and no transaction details whatsoever.<o:p></o:p></p>
    <p class="MsoNormal"><o:p>&nbsp;</o:p></p>
    <p class="MsoNormal">Never seen that one before!<o:p></o:p></p>
    <p class="MsoNormal"><o:p>&nbsp;</o:p></p>
    <p class="MsoNormal">I tried to restrict it to a specific table of interest, but got the same result.<o:p></o:p></p>
    <p class="MsoNormal"><o:p>&nbsp;</o:p></p>
    <p class="MsoNormal">Ideas?<o:p></o:p></p>
    <p class="MsoNormal"><o:p>&nbsp;</o:p></p>
    <p class="MsoNormal">Marty<o:p></o:p></p>
    <p class="MsoNormal"><o:p>&nbsp;</o:p></p>
    </div>
    </body>
    </html>

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Paul White@21:1/5 to Martin Bowes on Wed May 5 19:16:58 2021
    This is a multi-part message in MIME format.
    Hi Marty,

    it is a new feature.  I generated the situation accidentally by messing
    with journals involved DR syncronisation to another server.

    Level 2 support mentioned there is a hard coded maximum number of open transactions.


    Try using -b -e ?

    Paul


    On 5/05/2021 6:39 pm, Martin Bowes wrote:

    Hi All,

    So I needed to run auditdb on a database…

    Wed May  5 09:36:30 2021 E_DM1206_ATP_TOO_MANY_TX   Too many
    simultaneous transactions.

    …

    Lots and lots of these, and no transaction details whatsoever.

    Never seen that one before!

    I tried to restrict it to a specific table of interest, but got the
    same result.

    Ideas?

    Marty


    _______________________________________________
    Info-ingres mailing list
    Info-ingres@lists.planetingres.org https://lists.planetingres.org/mailman/listinfo/info-ingres

    <html>
    <head>
    <meta http-equiv="Content-Type" content="text/html;
    charset=windows-1252">
    </head>
    <body>
    <p>Hi Marty,</p>
    <p>it is a new feature.  I generated the situation accidentally by
    messing with journals involved DR syncronisation to another
    server.</p>
    <p>Level 2 support mentioned there is a hard coded maximum number of
    open transactions.</p>
    <p><br>
    </p>
    <p>Try using -b -e ?</p>
    <p>Paul<br>
    </p>
    <p><br>
    </p>
    <div class="moz-cite-prefix">On 5/05/2021 6:39 pm, Martin Bowes
    wrote:<br>
    </div>
    <blockquote type="cite"
    cite="mid:517bc3e3cd814863b31d454a52d862c9@ndph.ox.ac.uk">
    <meta http-equiv="Content-Type" content="text/html;
    charset=windows-1252">
    <meta name="Generator" content="Microsoft Word 15 (filtered
    medium)">
    <style>@font-face
    {font-family:"Cambria Math";
    panose-1:2 4 5 3 5 4 6 3 2 4;}@font-face
    {font-family:Calibri;
    panose-1:2 15 5 2 2 2 4 3 2 4;}@font-face
    {font-family:"Lucida Console";
    panose-1:2 11 6 9 4 5 4 2 2 4;}p.MsoNormal, li.MsoNormal, div.MsoNormal
    {margin:0cm;
    margin-bottom:.0001pt;
    font-size:11.0pt;
    font-family:"Calibri",sans-serif;
    mso-fareast-language:EN-US;}a:link, span.MsoHyperlink
    {mso-style-priority:99;
    color:#0563C1;
    text-decoration:underline;}a:visited, span.MsoHyperlinkFollowed
    {mso-style-priority:99;
    color:#954F72;
    text-decoration:underline;}span.EmailStyle17
    {mso-style-type:personal-compose;
    font-family:"Calibri",sans-serif;
    color:windowtext;}.MsoChpDefault
    {mso-style-type:export-only;
    font-family:"Calibri",sans-serif;
    mso-fareast-language:EN-US;}div.WordSection1
    {page:WordSection1;}</style><!--[if gte mso 9]><xml>
    <o:shapedefaults v:ext="edit" spidmax="1026" />
    </xml><![endif]--><!--[if gte mso 9]><xml>
    <o:shapelayout v:ext="edit">
    <o:idmap v:ext="edit" data="1" />
    </o:shapelayout></xml><![endif]-->
    <div class="WordSection1">
    <p class="MsoNormal" style="text-autospace:none"><span
    style="font-size:10.0pt;font-family:&quot;Lucida
    Console&quot;">Hi All,<o:p></o:p></span></p>
    <p class="MsoNormal" style="text-autospace:none"><span
    style="font-size:10.0pt;font-family:&quot;Lucida
    Console&quot;"><o:p> </o:p></span></p>
    <p class="MsoNormal" style="text-autospace:none"><span
    style="font-size:10.0pt;font-family:&quot;Lucida
    Console&quot;">So I needed to run auditdb on a database…<o:p></o:p></span></p>
    <p class="MsoNormal" style="text-autospace:none"><span
    style="font-size:10.0pt;font-family:&quot;Lucida
    Console&quot;"><o:p> </o:p></span></p>
    <p class="MsoNormal" style="text-autospace:none"><span
    style="font-size:10.0pt;font-family:&quot;Lucida
    Console&quot;">Wed May  5 09:36:30 2021
    E_DM1206_ATP_TOO_MANY_TX   Too many simultaneous
    transactions.<o:p></o:p></span></p>
    <p class="MsoNormal">…<o:p></o:p></p>
    <p class="MsoNormal">Lots and lots of these, and no transaction
    details whatsoever.<o:p></o:p></p>
    <p class="MsoNormal"><o:p> </o:p></p>
    <p class="MsoNormal">Never seen that one before!<o:p></o:p></p>
    <p class="MsoNormal"><o:p> </o:p></p>
    <p class="MsoNormal">I tried to restrict it to a specific table
    of interest, but got the same result.<o:p></o:p></p>
    <p class="MsoNormal"><o:p> </o:p></p>
    <p class="MsoNormal">Ideas?<o:p></o:p></p>
    <p class="MsoNormal"><o:p> </o:p></p>
    <p class="MsoNormal">Marty<o:p></o:p></p>
    <p class="MsoNormal"><o:p> </o:p></p>
    </div>
    <br>
    <fieldset class="mimeAttachmentHeader"></fieldset>
    <pre class="moz-quote-pre" wrap="">_______________________________________________
    Info-ingres mailing list
    <a class="moz-txt-link-abbreviated" href="mailto:Info-ingres@lists.planetingres.org">Info-ingres@lists.planetingres.org</a>
    <a class="moz-txt-link-freetext" href="https://lists.planetingres.org/mailman/listinfo/info-ingres">https://lists.planetingres.org/mailman/listinfo/info-ingres</a>
    </pre>
    </blockquote>
    </body>
    </html>

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Martin Bowes@21:1/5 to " on Wed May 5 10:00:36 2021
    To: info-ingres@lists.planetingres.org (info-ingres@lists.planetingres.org)

    Those messages all ended up in my errlog as well.

    This is a web server so I suspect there are lots of little transactions going on. Nonetheless, given a 254 inbound connection limit and a tx_limit of 2379, I'm hard pressed to see how that could possibly generate a shit storm of transactions at any
    instant.

    I too would be interested to hear what the transaction limit was!

    Marty

    -----Original Message-----
    From: Roy Hann <specially@processed.almost.meat>
    Sent: 05 May 2021 10:45
    To: info-ingres@lists.planetingres.org
    Subject: Re: [Info-ingres] Error from auditdb

    Paul White wrote:

    it is a new feature.  I generated the situation accidentally by
    messing with journals involved DR syncronisation to another server.

    Level 2 support mentioned there is a hard coded maximum number of open transactions.

    Did they mention what the limit is?

    It sounds odd since there really can't be many more simultaneous transactions than sessions (even including internal sessions). In the 21st century surely we'd have to be talking absolutely bazillions to be 'too many'.

    Or does the word "simultaneous" have special and surprising meaning in this context...?

    Roy
    _______________________________________________
    Info-ingres mailing list
    Info-ingres@lists.planetingres.org https://lists.planetingres.org/mailman/listinfo/info-ingres

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Roy Hann@21:1/5 to Paul White on Wed May 5 09:44:49 2021
    Paul White wrote:

    it is a new feature.  I generated the situation accidentally by messing
    with journals involved DR syncronisation to another server.

    Level 2 support mentioned there is a hard coded maximum number of open transactions.

    Did they mention what the limit is?

    It sounds odd since there really can't be many more simultaneous
    transactions than sessions (even including internal sessions). In the
    21st century surely we'd have to be talking absolutely bazillions to
    be 'too many'.

    Or does the word "simultaneous" have special and surprising meaning in
    this context...?

    Roy

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Paul White@21:1/5 to Ingres and related product discussi on Wed May 5 21:57:25 2021
    Ps no hint

    On Wed, 5 May 2021, 9:56 pm Paul White, <paul.white@shift7solutions.com.au> wrote:

    I would be interested in seeing results from:
    egrep 'End : |Begin :' auditfile | awk '{print $5}' | sort | uniq
    -c | sort | more
    It should have all the open transactions at the top if i did this right
    on my phone.




    On Wed, 5 May 2021, 9:13 pm Martin Bowes, <martin.bowes@ndph.ox.ac.uk>
    wrote:

    Thanks Paul, that’s very interesting intel.



    2048 seems a low number in this day and age. Did they hint that this may
    be bumped or configurable in a later release?



    Marty



    *From:* Paul White <paul.white@shift7solutions.com.au>
    *Sent:* 05 May 2021 12:06
    *To:* info-ingres@lists.planetingres.org
    *Subject:* Re: [Info-ingres] Error from auditdb



    From case 1176237

    *Actually, it is not strictly "simultaneous" transactions in terms of
    transactions that were running at the same time and not committed (as I
    initially thought and tried to build with a test case). The 2048 limitation >> is rather transactions to be processed in one auditdb run which is also why >> the message disappears when using -e/-b limiting the data to be processed.* >>


    I too would be interested to hear what the transaction limit was!



    Marty





    Did they mention what the limit is?





    Roy



    The comment doesnt make sense because my daily auditdb sometimes records
    over 100k transactions.

    I haven't returned to the implications of the comment because in my case
    the problem started on the DR server running incremental rollforward on
    journals I had collected from two different instances. It was SIGSEGV
    TUPLE_MISMATCH and all sorts of errors, errlog filled the disk yada yada.
    At the root of the problem was a table which was originally created
    unjournalled and was not replicating properly.

    As part of the issue, I found auditdb had stopped recording the Begin of
    transactions. I think it is in the middle of sysmod.

    Begin : Transaction Id 00005ea5138c69af 13-Feb-2021 02:52:13.75 Username ingres

    Fcreate : Transaction Id 00005ea5138c69af File /data/ingresII/ingres/data/default/ctrust_docs_2021/ rtf6x1.m00

    Modify : Transaction Id 00005ea5138c69af Id (225,0) Table [ii_vqtables ,$ingres ]

    Update/Replace : Transaction Id 00005ea5138c69af Id (1,0) Table [iirelation,$ingres]

    Old: <225|0|8|0|2|11|2445317|0|0|5|1|1|0|1611125819|1612538207|1612538207|104786|100000|0|0|0|80|80|70|0|0|8192|0|0|0|0|3|4|1

    6|0|70|1|0|84|84|84|84|68|0|0|0|0|||^A|$ingres|ii_vqtables> >>
    New: <225|0|8|0|2|11|2445317|2048|0|5|1|1|0|1611125819|1613145133|1613145133|771094|100000|0|0|0|80|80|70|0|0|8192|0|0|0|0|3|

    4|16|0|70|1|0|84|84|84|84|68|0|0|0|0|||^A|$ingres|ii_vqtables>

    Frename : Transaction Id 00005ea5138c69af File /data/ingresII/ingres/data/default/ctrust_docs_2021/ aaaaaaob.t00 to

    rtf6zr.d00

    Frename : Transaction Id 00005ea5138c69af File /data/ingresII/ingres/data/default/ctrust_docs_2021/ rtf6x1.m00 to

    aaaaaaob.t00

    End : Transaction Id 00005ea5138c69af 13-Feb-2021 02:52:13.78

    Begin : Transaction Id 00005ea5138c69b3 13-Feb-2021 02:52:13.79 Username ingres

    Fcreate : Transaction Id 00005ea5138c69b3 File /data/ingresII/ingres/data/default/ctrust_docs_2021/ rtf61h.m00

    Modify : Transaction Id 00005ea5138c69b3 Id (219,0) Table [ii_stored_nstrings ,$ingres ]

    Update/Replace : Transaction Id 00005ea5138c69b3 Id (1,0) Table [iirelation,$ingres]

    Old: <219|0|4|0|2|11|2379781|0|0|5|1|1|0|1611125817|1612538207|1612538207|158487|100000|0|0|0|80|80|70|0|0|8192|0|0|0|0|3|4|1

    6|0|70|1|0|1800|1800|1800|1800|41|0|0|0|0|||^A|$ingres|ii_stored_nstrings>

    New: <219|0|4|0|2|11|2379781|2048|0|5|1|1|0|1611125817|1613145133|1613145133|836549|100000|0|0|0|80|80|70|0|0|8192|0|0|0|0|3|

    4|16|0|70|1|0|1800|1800|1800|1800|41|0|0|0|0|||^A|$ingres|ii_stored_nstrings>

    Frename : Transaction Id 00005ea5138c69b3 File /data/ingresII/ingres/data/default/ctrust_docs_2021/ aaaaaanl.t00 to

    rtf628.d00

    Frename : Transaction Id 00005ea5138c69b3 File /data/ingresII/ingres/data/default/ctrust_docs_2021/ rtf61h.m00 to

    aaaaaanl.t00

    End : Transaction Id 00005ea5138c69b3 13-Feb-2021 02:52:13.85

    Update/Replace : Transaction Id 00005ea51393a887 Id (1,0) Table [iirelation,$ingres]

    Old: <247|0|2|0|1|11|3215364|67110914|4172|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0

    |0|0|1730560|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021>

    New: <247|0|2|0|1|11|3215364|67110914|4172|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0

    |0|0|1731584|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021>

    End Mini: Transaction Id 00005ea51393a887

    Update/Replace : Transaction Id 00005ea51393b6de Id (1,0) Table [iirelation,$ingres]

    Old: <247|0|2|0|1|11|3215364|67110914|4173|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0

    |0|0|1731584|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021>

    New: <247|0|2|0|1|11|3215364|67110914|4173|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0

    |0|0|1732608|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021>

    End Mini: Transaction Id 00005ea51393b6de

    Update/Replace : Transaction Id 00005ea51393bebc Id (1,0) Table [iirelation,$ingres]

    Old: <247|0|2|0|1|11|3215364|67110914|4174|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0

    |0|0|1732608|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021>

    New: <247|0|2|0|1|11|3215364|67110914|4174|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0

    |0|0|1733632|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021>

    End Mini: Transaction Id 00005ea51393bebc

    (goes on for several hundred mini transactions)

    Paul




    _______________________________________________
    Info-ingres mailing list
    Info-ingres@lists.planetingres.org
    https://lists.planetingres.org/mailman/listinfo/info-ingres



    <div dir="auto">Ps no hint</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, 5 May 2021, 9:56 pm Paul White, &lt;<a href="mailto:paul.white@shift7solutions.com.au">paul.white@shift7solutions.com.au</a>&gt; wrote:<br></div><
    blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="auto"><div>I would be interested in seeing results from:<div dir="auto"> egrep &#39;End     : |Begin   :&#39; auditfile | awk &#39;{
    print $5}&#39; | sort | uniq -c | sort | more</div><div dir="auto"> It should have all the open transactions at the top if i did this right on my phone.</div><div dir="auto"><br><div dir="auto"><br style="font-family:sans-serif"></div></div><br><br><
    div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, 5 May 2021, 9:13 pm Martin Bowes, &lt;<a href="mailto:martin.bowes@ndph.ox.ac.uk" target="_blank" rel="noreferrer">martin.bowes@ndph.ox.ac.uk</a>&gt; wrote:<br></div><blockquote class="
    gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">





    <div lang="EN-GB" link="#0563C1" vlink="#954F72">
    <div>
    <p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1f497d">Thanks Paul, that’s very interesting intel.<u></u><u></u></span></p>
    <p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1f497d"><u></u> <u></u></span></p>
    <p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1f497d">2048 seems a low number in this day and age. Did they hint that this may be bumped or configurable in a later release?<u></u><u></u></span></p>
    <p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1f497d"><u></u> <u></u></span></p>
    <p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1f497d">Marty<u></u><u></u></span></p>
    <p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1f497d"><u></u> <u></u></span></p>
    <div>
    <div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
    <p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif"> Paul White &lt;<a href="mailto:paul.
    white@shift7solutions.com.au" rel="noreferrer noreferrer" target="_blank">paul.white@shift7solutions.com.au</a>&gt;

    <b>Sent:</b> 05 May 2021 12:06<br>
    <b>To:</b> <a href="mailto:info-ingres@lists.planetingres.org" rel="noreferrer noreferrer" target="_blank">info-ingres@lists.planetingres.org</a><br>
    <b>Subject:</b> Re: [Info-ingres] Error from auditdb<u></u><u></u></span></p> </div>
    </div>
    <p class="MsoNormal"><u></u> <u></u></p>
    <p>From case 1176237<u></u><u></u></p>
    <blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
    <p><span><i>Actually, it is not strictly &quot;simultaneous&quot; transactions in terms of transactions that were running at the same time and not committed (as I initially thought and tried to build with a test case). The 2048 limitation is rather
    transactions
    to be processed in one auditdb run which is also why the message disappears when using -e/-b limiting the data to be processed.</i></span><u></u><u></u></p>
    </blockquote>
    <p class="MsoNormal"><br>

    <u></u><u></u></p>
    <blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
    <pre>I too would be interested to hear what the transaction limit was!<u></u><u></u></pre>
    <pre><u></u> <u></u></pre>
    <pre>Marty<u></u><u></u></pre>
    <pre><u></u> <u></u></pre>
    <pre><u></u> <u></u></pre>
    <pre>Did they mention what the limit is? <u></u><u></u></pre> <pre><u></u> <u></u></pre>
    <pre><u></u> <u></u></pre>
    <pre>Roy<u></u><u></u></pre>
    </blockquote>
    <p><u></u> <u></u></p>
    <p><span>The comment doesnt make sense because my daily auditdb sometimes records over 100k transactions.  
    </span><u></u><u></u></p>
    <p><span>I haven&#39;t returned to the implications of the comment because in my case the problem started on the DR server running incremental rollforward on journals I had collected from two different instances. It was SIGSEGV TUPLE_MISMATCH and all
    sorts of errors, errlog filled the disk yada yada.  At the root of the problem was a table which was originally created unjournalled and was not replicating properly. 
    </span><u></u><u></u></p>
    <p><span>As part of the issue, I found auditdb had stopped recording the Begin of transactions.  I think it is in the middle of sysmod.</span><u></u><u></u></p>
    <pre><span>Begin   : Transaction Id 00005ea5138c69af 13-Feb-2021 02:52:13.75                       Username ingres<u></u><u></u></span></pre>
    <pre><span>  Fcreate : Transaction Id 00005ea5138c69af  File /data/ingresII/ingres/data/default/ctrust_docs_2021/              rtf6x1.m00<u></u><u></u></span></pre>
    <pre><span>  Modify  : Transaction Id 00005ea5138c69af Id (225,0) Table [ii_vqtables                     ,$ingres                         ]<u></u><u></u></span></pre>
    <pre><span>  Update/Replace : Transaction Id 00005ea5138c69af Id (1,0)                             Table [iirelation,$ingres]<u></u><u></u></span></pre>
    <pre><span>    Old:    &lt;225|0|8|0|2|11|2445317|0|0|5|1|1|0|1611125819|1612538207|1612538207|104786|100000|0|0|0|80|80|70|0|0|8192|0|0|0|0|3|4|1<u></u><u></u></span></pre>
    <pre><span>                6|0|70|1|0|84|84|84|84|68|0|0|0|0|||^A|$ingres|ii_vqtables&gt;<u></u><u></u></span></pre>
    <pre><span>    New:    &lt;225|0|8|0|2|11|2445317|2048|0|5|1|1|0|1611125819|1613145133|1613145133|771094|100000|0|0|0|80|80|70|0|0|8192|0|0|0|0|3|<u></u><u></u></span></pre>
    <pre><span>                4|16|0|70|1|0|84|84|84|84|68|0|0|0|0|||^A|$ingres|ii_vqtables&gt;<u></u><u></u></span></pre>
    <pre><span>  Frename : Transaction Id 00005ea5138c69af  File /data/ingresII/ingres/data/default/ctrust_docs_2021/            aaaaaaob.t00 to<u></u><u></u></span></pre>
    <pre><span>                            rtf6zr.d00<u></u><u></u></span></pre>
    <pre><span>  Frename : Transaction Id 00005ea5138c69af  File /data/ingresII/ingres/data/default/ctrust_docs_2021/              rtf6x1.m00 to<u></u><u></u></span></pre>
    <pre><span>                          aaaaaaob.t00<u></u><u></u></span></pre>
    <pre><span>End     : Transaction Id 00005ea5138c69af 13-Feb-2021 02:52:13.78<u></u><u></u></span></pre>
    <pre><span>Begin   : Transaction Id 00005ea5138c69b3 13-Feb-2021 02:52:13.79                       Username ingres<u></u><u></u></span></pre>
    <pre><span>  Fcreate : Transaction Id 00005ea5138c69b3  File /data/ingresII/ingres/data/default/ctrust_docs_2021/              rtf61h.m00<u></u><u></u></span></pre>
    <pre><span>  Modify  : Transaction Id 00005ea5138c69b3 Id (219,0) Table [ii_stored_nstrings              ,$ingres                         ]<u></u><u></u></span></pre>
    <pre><span>  Update/Replace : Transaction Id 00005ea5138c69b3 Id (1,0)                             Table [iirelation,$ingres]<u></u><u></u></span></pre>
    <pre><span>    Old:    &lt;219|0|4|0|2|11|2379781|0|0|5|1|1|0|1611125817|1612538207|1612538207|158487|100000|0|0|0|80|80|70|0|0|8192|0|0|0|0|3|4|1<u></u><u></u></span></pre>
    <pre><span>                6|0|70|1|0|1800|1800|1800|1800|41|0|0|0|0|||^A|$ingres|ii_stored_nstrings&gt;<u></u><u></u></span></pre>
    <pre><span>    New:    &lt;219|0|4|0|2|11|2379781|2048|0|5|1|1|0|1611125817|1613145133|1613145133|836549|100000|0|0|0|80|80|70|0|0|8192|0|0|0|0|3|<u></u><u></u></span></pre>
    <pre><span>                4|16|0|70|1|0|1800|1800|1800|1800|41|0|0|0|0|||^A|$ingres|ii_stored_nstrings&gt;<u></u><u></u></span></pre>
    <pre><span>  Frename : Transaction Id 00005ea5138c69b3  File /data/ingresII/ingres/data/default/ctrust_docs_2021/            aaaaaanl.t00 to<u></u><u></u></span></pre>
    <pre><span>                            rtf628.d00<u></u><u></u></span></pre>
    <pre><span>  Frename : Transaction Id 00005ea5138c69b3  File /data/ingresII/ingres/data/default/ctrust_docs_2021/              rtf61h.m00 to<u></u><u></u></span></pre>
    <pre><span>                          aaaaaanl.t00<u></u><u></u></span></pre>
    <pre><span>End     : Transaction Id 00005ea5138c69b3 13-Feb-2021 02:52:13.85<u></u><u></u></span></pre>
    <pre><span>  Update/Replace : Transaction Id 00005ea51393a887 Id (1,0)                             Table [iirelation,$ingres]<u></u><u></u></span></pre>
    <pre><span>    Old:    &lt;247|0|2|0|1|11|3215364|67110914|4172|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0<u></u><u></u></span></pre>
    <pre><span>                |0|0|1730560|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021&gt;<u></u><u></u></span></pre>
    <pre><span>    New:    &lt;247|0|2|0|1|11|3215364|67110914|4172|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0<u></u><u></u></span></pre>
    <pre><span>                |0|0|1731584|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021&gt;<u></u><u></u></span></pre>
    <pre><span>End Mini: Transaction Id 00005ea51393a887<u></u><u></u></span></pre> <pre><span>  Update/Replace : Transaction Id 00005ea51393b6de Id (1,0)                             Table [iirelation,$ingres]<u></u><u></u></span></pre>
    <pre><span>    Old:    &lt;247|0|2|0|1|11|3215364|67110914|4173|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0<u></u><u></u></span></pre>
    <pre><span>                |0|0|1731584|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021&gt;<u></u><u></u></span></pre>
    <pre><span>    New:    &lt;247|0|2|0|1|11|3215364|67110914|4173|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0<u></u><u></u></span></pre>
    <pre><span>                |0|0|1732608|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021&gt;<u></u><u></u></span></pre>
    <pre><span>End Mini: Transaction Id 00005ea51393b6de<u></u><u></u></span></pre> <pre><span>  Update/Replace : Transaction Id 00005ea51393bebc Id (1,0)                             Table [iirelation,$ingres]<u></u><u></u></span></pre>
    <pre><span>    Old:    &lt;247|0|2|0|1|11|3215364|67110914|4174|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0<u></u><u></u></span></pre>
    <pre><span>                |0|0|1732608|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021&gt;<u></u><u></u></span></pre>
    <pre><span>    New:    &lt;247|0|2|0|1|11|3215364|67110914|4174|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0<u></u><u></u></span></pre>
    <pre><span>                |0|0|1733632|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021&gt;<u></u><u></u></span></pre>
    <pre><span>End Mini: Transaction Id 00005ea51393bebc</span><u></u><u></u></pre> <p><span>(goes on for several hundred mini transactions)</span><u></u><u></u></p>
    <p><span>Paul</span><u></u><u></u></p>
    <p><u></u> <u></u></p>
    <p class="MsoNormal"><u></u> <u></u></p>
    </div>
    </div>

    _______________________________________________<br>
    Info-ingres mailing list<br>
    <a href="mailto:Info-ingres@lists.planetingres.org" rel="noreferrer noreferrer" target="_blank">Info-ingres@lists.planetingres.org</a><br>
    <a href="https://lists.planetingres.org/mailman/listinfo/info-ingres" rel="noreferrer noreferrer noreferrer" target="_blank">https://lists.planetingres.org/mailman/listinfo/info-ingres</a><br>
    </blockquote></div></div></div>
    </blockquote></div>

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Paul White@21:1/5 to Martin Bowes on Wed May 5 21:56:14 2021
    Copy: info-ingres@lists.planetingres.org (Ingres and related product discussion forum)

    I would be interested in seeing results from:
    egrep 'End : |Begin :' auditfile | awk '{print $5}' | sort | uniq -c
    | sort | more
    It should have all the open transactions at the top if i did this right on
    my phone.




    On Wed, 5 May 2021, 9:13 pm Martin Bowes, <martin.bowes@ndph.ox.ac.uk>
    wrote:

    Thanks Paul, that’s very interesting intel.



    2048 seems a low number in this day and age. Did they hint that this may
    be bumped or configurable in a later release?



    Marty



    *From:* Paul White <paul.white@shift7solutions.com.au>
    *Sent:* 05 May 2021 12:06
    *To:* info-ingres@lists.planetingres.org
    *Subject:* Re: [Info-ingres] Error from auditdb



    From case 1176237

    *Actually, it is not strictly "simultaneous" transactions in terms of transactions that were running at the same time and not committed (as I initially thought and tried to build with a test case). The 2048 limitation is rather transactions to be processed in one auditdb run which is also why the message disappears when using -e/-b limiting the data to be processed.*



    I too would be interested to hear what the transaction limit was!



    Marty





    Did they mention what the limit is?





    Roy



    The comment doesnt make sense because my daily auditdb sometimes records
    over 100k transactions.

    I haven't returned to the implications of the comment because in my case
    the problem started on the DR server running incremental rollforward on journals I had collected from two different instances. It was SIGSEGV TUPLE_MISMATCH and all sorts of errors, errlog filled the disk yada yada.
    At the root of the problem was a table which was originally created unjournalled and was not replicating properly.

    As part of the issue, I found auditdb had stopped recording the Begin of transactions. I think it is in the middle of sysmod.

    Begin : Transaction Id 00005ea5138c69af 13-Feb-2021 02:52:13.75 Username ingres

    Fcreate : Transaction Id 00005ea5138c69af File /data/ingresII/ingres/data/default/ctrust_docs_2021/ rtf6x1.m00

    Modify : Transaction Id 00005ea5138c69af Id (225,0) Table [ii_vqtables ,$ingres ]

    Update/Replace : Transaction Id 00005ea5138c69af Id (1,0) Table [iirelation,$ingres]

    Old: <225|0|8|0|2|11|2445317|0|0|5|1|1|0|1611125819|1612538207|1612538207|104786|100000|0|0|0|80|80|70|0|0|8192|0|0|0|0|3|4|1

    6|0|70|1|0|84|84|84|84|68|0|0|0|0|||^A|$ingres|ii_vqtables>

    New: <225|0|8|0|2|11|2445317|2048|0|5|1|1|0|1611125819|1613145133|1613145133|771094|100000|0|0|0|80|80|70|0|0|8192|0|0|0|0|3|

    4|16|0|70|1|0|84|84|84|84|68|0|0|0|0|||^A|$ingres|ii_vqtables>

    Frename : Transaction Id 00005ea5138c69af File /data/ingresII/ingres/data/default/ctrust_docs_2021/ aaaaaaob.t00 to

    rtf6zr.d00

    Frename : Transaction Id 00005ea5138c69af File /data/ingresII/ingres/data/default/ctrust_docs_2021/ rtf6x1.m00 to

    aaaaaaob.t00

    End : Transaction Id 00005ea5138c69af 13-Feb-2021 02:52:13.78

    Begin : Transaction Id 00005ea5138c69b3 13-Feb-2021 02:52:13.79 Username ingres

    Fcreate : Transaction Id 00005ea5138c69b3 File /data/ingresII/ingres/data/default/ctrust_docs_2021/ rtf61h.m00

    Modify : Transaction Id 00005ea5138c69b3 Id (219,0) Table [ii_stored_nstrings ,$ingres ]

    Update/Replace : Transaction Id 00005ea5138c69b3 Id (1,0) Table [iirelation,$ingres]

    Old: <219|0|4|0|2|11|2379781|0|0|5|1|1|0|1611125817|1612538207|1612538207|158487|100000|0|0|0|80|80|70|0|0|8192|0|0|0|0|3|4|1

    6|0|70|1|0|1800|1800|1800|1800|41|0|0|0|0|||^A|$ingres|ii_stored_nstrings>

    New: <219|0|4|0|2|11|2379781|2048|0|5|1|1|0|1611125817|1613145133|1613145133|836549|100000|0|0|0|80|80|70|0|0|8192|0|0|0|0|3|

    4|16|0|70|1|0|1800|1800|1800|1800|41|0|0|0|0|||^A|$ingres|ii_stored_nstrings>

    Frename : Transaction Id 00005ea5138c69b3 File /data/ingresII/ingres/data/default/ctrust_docs_2021/ aaaaaanl.t00 to

    rtf628.d00

    Frename : Transaction Id 00005ea5138c69b3 File /data/ingresII/ingres/data/default/ctrust_docs_2021/ rtf61h.m00 to

    aaaaaanl.t00

    End : Transaction Id 00005ea5138c69b3 13-Feb-2021 02:52:13.85

    Update/Replace : Transaction Id 00005ea51393a887 Id (1,0) Table [iirelation,$ingres]

    Old: <247|0|2|0|1|11|3215364|67110914|4172|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0

    |0|0|1730560|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021>

    New: <247|0|2|0|1|11|3215364|67110914|4172|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0

    |0|0|1731584|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021>

    End Mini: Transaction Id 00005ea51393a887

    Update/Replace : Transaction Id 00005ea51393b6de Id (1,0) Table [iirelation,$ingres]

    Old: <247|0|2|0|1|11|3215364|67110914|4173|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0

    |0|0|1731584|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021>

    New: <247|0|2|0|1|11|3215364|67110914|4173|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0

    |0|0|1732608|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021>

    End Mini: Transaction Id 00005ea51393b6de

    Update/Replace : Transaction Id 00005ea51393bebc Id (1,0) Table [iirelation,$ingres]

    Old: <247|0|2|0|1|11|3215364|67110914|4174|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0

    |0|0|1732608|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021>

    New: <247|0|2|0|1|11|3215364|67110914|4174|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0

    |0|0|1733632|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021>

    End Mini: Transaction Id 00005ea51393bebc

    (goes on for several hundred mini transactions)

    Paul




    _______________________________________________
    Info-ingres mailing list
    Info-ingres@lists.planetingres.org https://lists.planetingres.org/mailman/listinfo/info-ingres


    <div dir="auto"><div>I would be interested in seeing results from:<div dir="auto"> egrep &#39;End     : |Begin   :&#39; auditfile | awk &#39;{print $5}&#39; | sort | uniq -c | sort | more</div><div dir="auto"> It should have all the open
    transactions at the top if i did this right on my phone.</div><div dir="auto"><br><div dir="auto"><br style="font-family:sans-serif"></div></div><br><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, 5 May 2021, 9:13 pm Martin Bowes,
    &lt;<a href="mailto:martin.bowes@ndph.ox.ac.uk">martin.bowes@ndph.ox.ac.uk</a>&gt; wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">





    <div lang="EN-GB" link="#0563C1" vlink="#954F72">
    <div class="m_7267909865363537385WordSection1">
    <p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1f497d">Thanks Paul, that’s very interesting intel.<u></u><u></u></span></p>
    <p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1f497d"><u></u> <u></u></span></p>
    <p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1f497d">2048 seems a low number in this day and age. Did they hint that this may be bumped or configurable in a later release?<u></u><u></u></span></p>
    <p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1f497d"><u></u> <u></u></span></p>
    <p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1f497d">Marty<u></u><u></u></span></p>
    <p class="MsoNormal"><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1f497d"><u></u> <u></u></span></p>
    <div>
    <div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
    <p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif"> Paul White &lt;<a href="mailto:paul.
    white@shift7solutions.com.au" target="_blank" rel="noreferrer">paul.white@shift7solutions.com.au</a>&gt;

    <b>Sent:</b> 05 May 2021 12:06<br>
    <b>To:</b> <a href="mailto:info-ingres@lists.planetingres.org" target="_blank" rel="noreferrer">info-ingres@lists.planetingres.org</a><br>
    <b>Subject:</b> Re: [Info-ingres] Error from auditdb<u></u><u></u></span></p> </div>
    </div>
    <p class="MsoNormal"><u></u> <u></u></p>
    <p>From case 1176237<u></u><u></u></p>
    <blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
    <p><span class="m_7267909865363537385text"><i>Actually, it is not strictly &quot;simultaneous&quot; transactions in terms of transactions that were running at the same time and not committed (as I initially thought and tried to build with a test case).
    The 2048 limitation is rather transactions
    to be processed in one auditdb run which is also why the message disappears when using -e/-b limiting the data to be processed.</i></span><u></u><u></u></p>
    </blockquote>
    <p class="MsoNormal"><br>

    <u></u><u></u></p>
    <blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
    <pre>I too would be interested to hear what the transaction limit was!<u></u><u></u></pre>
    <pre><u></u> <u></u></pre>
    <pre>Marty<u></u><u></u></pre>
    <pre><u></u> <u></u></pre>
    <pre><u></u> <u></u></pre>
    <pre>Did they mention what the limit is? <u></u><u></u></pre> <pre><u></u> <u></u></pre>
    <pre><u></u> <u></u></pre>
    <pre>Roy<u></u><u></u></pre>
    </blockquote>
    <p><u></u> <u></u></p>
    <p><span class="m_7267909865363537385text">The comment doesnt make sense because my daily auditdb sometimes records over 100k transactions.  
    </span><u></u><u></u></p>
    <p><span class="m_7267909865363537385text">I haven&#39;t returned to the implications of the comment because in my case the problem started on the DR server running incremental rollforward on journals I had collected from two different instances. It was
    SIGSEGV TUPLE_MISMATCH and all
    sorts of errors, errlog filled the disk yada yada.  At the root of the problem was a table which was originally created unjournalled and was not replicating properly. 
    </span><u></u><u></u></p>
    <p><span class="m_7267909865363537385text">As part of the issue, I found auditdb had stopped recording the Begin of transactions.  I think it is in the middle of sysmod.</span><u></u><u></u></p>
    <pre><span class="m_7267909865363537385text">Begin   : Transaction Id 00005ea5138c69af 13-Feb-2021 02:52:13.75                       Username ingres<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">  Fcreate : Transaction Id 00005ea5138c69af  File /data/ingresII/ingres/data/default/ctrust_docs_2021/              rtf6x1.m00<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">  Modify  : Transaction Id 00005ea5138c69af Id (225,0) Table [ii_vqtables                     ,$ingres                         ]<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">  Update/Replace : Transaction Id 00005ea5138c69af Id (1,0)                             Table [iirelation,$ingres]<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">    Old:    &lt;225|0|8|0|2|11|2445317|0|0|5|1|1|0|1611125819|1612538207|1612538207|104786|100000|0|0|0|80|80|70|0|0|8192|0|0|0|0|3|4|1<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">                6|0|70|1|0|84|84|84|84|68|0|0|0|0|||^A|$ingres|ii_vqtables&gt;<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">    New:    &lt;225|0|8|0|2|11|2445317|2048|0|5|1|1|0|1611125819|1613145133|1613145133|771094|100000|0|0|0|80|80|70|0|0|8192|0|0|0|0|3|<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">                4|16|0|70|1|0|84|84|84|84|68|0|0|0|0|||^A|$ingres|ii_vqtables&gt;<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">  Frename : Transaction Id 00005ea5138c69af  File /data/ingresII/ingres/data/default/ctrust_docs_2021/            aaaaaaob.t00 to<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">                            rtf6zr.d00<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">  Frename : Transaction Id 00005ea5138c69af  File /data/ingresII/ingres/data/default/ctrust_docs_2021/              rtf6x1.m00 to<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">                          aaaaaaob.t00<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">End     : Transaction Id 00005ea5138c69af 13-Feb-2021 02:52:13.78<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">Begin   : Transaction Id 00005ea5138c69b3 13-Feb-2021 02:52:13.79                       Username ingres<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">  Fcreate : Transaction Id 00005ea5138c69b3  File /data/ingresII/ingres/data/default/ctrust_docs_2021/              rtf61h.m00<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">  Modify  : Transaction Id 00005ea5138c69b3 Id (219,0) Table [ii_stored_nstrings              ,$ingres                         ]<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">  Update/Replace : Transaction Id 00005ea5138c69b3 Id (1,0)                             Table [iirelation,$ingres]<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">    Old:    &lt;219|0|4|0|2|11|2379781|0|0|5|1|1|0|1611125817|1612538207|1612538207|158487|100000|0|0|0|80|80|70|0|0|8192|0|0|0|0|3|4|1<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">                6|0|70|1|0|1800|1800|1800|1800|41|0|0|0|0|||^A|$ingres|ii_stored_nstrings&gt;<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">    New:    &lt;219|0|4|0|2|11|2379781|2048|0|5|1|1|0|1611125817|1613145133|1613145133|836549|100000|0|0|0|80|80|70|0|0|8192|0|0|0|0|3|<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">                4|16|0|70|1|0|1800|1800|1800|1800|41|0|0|0|0|||^A|$ingres|ii_stored_nstrings&gt;<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">  Frename : Transaction Id 00005ea5138c69b3  File /data/ingresII/ingres/data/default/ctrust_docs_2021/            aaaaaanl.t00 to<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">                            rtf628.d00<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">  Frename : Transaction Id 00005ea5138c69b3  File /data/ingresII/ingres/data/default/ctrust_docs_2021/              rtf61h.m00 to<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">                          aaaaaanl.t00<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">End     : Transaction Id 00005ea5138c69b3 13-Feb-2021 02:52:13.85<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">  Update/Replace : Transaction Id 00005ea51393a887 Id (1,0)                             Table [iirelation,$ingres]<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">    Old:    &lt;247|0|2|0|1|11|3215364|67110914|4172|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">                |0|0|1730560|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021&gt;<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">    New:    &lt;247|0|2|0|1|11|3215364|67110914|4172|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">                |0|0|1731584|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021&gt;<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">End Mini: Transaction Id 00005ea51393a887<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">  Update/Replace : Transaction Id 00005ea51393b6de Id (1,0)                             Table [iirelation,$ingres]<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">    Old:    &lt;247|0|2|0|1|11|3215364|67110914|4173|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">                |0|0|1731584|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021&gt;<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">    New:    &lt;247|0|2|0|1|11|3215364|67110914|4173|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">                |0|0|1732608|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021&gt;<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">End Mini: Transaction Id 00005ea51393b6de<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">  Update/Replace : Transaction Id 00005ea51393bebc Id (1,0)                             Table [iirelation,$ingres]<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">    Old:    &lt;247|0|2|0|1|11|3215364|67110914|4174|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">                |0|0|1732608|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021&gt;<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">    New:    &lt;247|0|2|0|1|11|3215364|67110914|4174|38|1|1|0|1611319122|1613142939|1613143751|441340|100000|0|0|0|80|80|70|0|0|16384|0<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">                |0|0|1733632|36|4|16|0|70|1|0|37|37|37|37|27|0|0|0|0|||^A|ingres|crm_doc2021&gt;<u></u><u></u></span></pre>
    <pre><span class="m_7267909865363537385text">End Mini: Transaction Id 00005ea51393bebc</span><u></u><u></u></pre>
    <p><span class="m_7267909865363537385text">(goes on for several hundred mini transactions)</span><u></u><u></u></p>
    <p><span class="m_7267909865363537385text">Paul</span><u></u><u></u></p> <p><u></u> <u></u></p>
    <p class="MsoNormal"><u></u> <u></u></p>
    </div>
    </div>

    _______________________________________________<br>
    Info-ingres mailing list<br>
    <a href="mailto:Info-ingres@lists.planetingres.org" target="_blank" rel="noreferrer">Info-ingres@lists.planetingres.org</a><br>
    <a href="https://lists.planetingres.org/mailman/listinfo/info-ingres" rel="noreferrer noreferrer" target="_blank">https://lists.planetingres.org/mailman/listinfo/info-ingres</a><br>
    </blockquote></div></div></div>

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Paul White@21:1/5 to Marty on Thu May 6 19:08:46 2021
    This is a multi-part message in MIME format.
    I reckon it happens when there is a usermod or sysmod on a table with a long byte field right?

    Marty writes

    The alteration to iirelation affects only the rellow_logkeyfield. Anyone
    know what that refers to?

    Here is what I found looking up rellow_logkey and "end mini"

    https://github.com/fosslc/Ingres/blob/master/src/dbutil/duf/duve/duvechk.sc <https://github.com/fosslc/Ingres/blob/master/src/dbutil/duf/duve/duvechk.sc>

    https://communities.actian.com/s/article/Tracing-Use-of-Transaction-Log-File <https://communities.actian.com/s/article/Tracing-Use-of-Transaction-Log-File>

    https://docs.actian.com/actianx/11.1/index.html#page/CommandRef/verifylob_Command--Analyze_Long_Data_Types.htm
    <https://docs.actian.com/actianx/11.1/index.html#page/CommandRef/verifylob_Command--Analyze_Long_Data_Types.htm>


    verifylob Command--Analyze Long Data Types

    The verifylob utility analyzes errors in long data types (blobs and clobs).  It scans the specified blob table and examines the blob coupons and etab tables for errors. Rows with errors are dumped with error indicators.

    Verifylob detects four types of errors:

    •(D) Duplicate keys

    •(L) Non matching lengths

    •(O) Orphaned rows

    •(R) Invalid iirelation rellow_logkey, rellow_logkey pair

    Next step, I plan to track the entries going to the transaction log to see if both BM (Begin Mini) and EM (End Mini) are being written.
    My hunch is the BM is not being written to the journals because I am sure I reached the transaction limit error in the rollforwarddb.

    Paul


    <html>
    <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
    </head>
    <body>
    <pre>I reckon it happens when there is a usermod or sysmod on a table with a long byte field right?</pre>
    <pre>
    Marty writes
    </pre>
    <pre>&gt; <span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D;mso-fareast-language:EN-US">The alteration to iirelation affects only the </span><span style="font-size:10.0pt;font-family:&quot;Lucida Console&quot;">
    rellow_logkey</span><span style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color:#1F497D;mso-fareast-language:EN-US"> field. Anyone know what that refers to?

    </span></pre>
    <pre>Here is what I found looking up rellow_logkey and "end mini"</pre>
    <p><a moz-do-not-send="true" href="https://github.com/fosslc/Ingres/blob/master/src/dbutil/duf/duve/duvechk.sc">https://github.com/fosslc/Ingres/blob/master/src/dbutil/duf/duve/duvechk.sc</a></p>
    <p><a moz-do-not-send="true" href="https://communities.actian.com/s/article/Tracing-Use-of-Transaction-Log-File">https://communities.actian.com/s/article/Tracing-Use-of-Transaction-Log-File</a><br>
    </p>
    <p><a moz-do-not-send="true" href="https://docs.actian.com/actianx/11.1/index.html#page/CommandRef/verifylob_Command--Analyze_Long_Data_Types.htm">https://docs.actian.com/actianx/11.1/index.html#page/CommandRef/verifylob_Command--Analyze_Long_Data_Types.htm</a></p>
    <br>
    <pre>verifylob Command--Analyze Long Data Types</pre>
    <div id="ww99645" class="body" style="color: rgb(0, 0, 0);
    direction: ltr; font-family: Arial, sans-serif; font-size: medium;
    font-style: normal; font-variant: normal; font-weight: 400;
    margin: 9pt 0pt 0pt; text-align: left; text-indent: 0px;
    text-transform: none; vertical-align: baseline; letter-spacing:
    normal; orphans: 2; white-space: normal; widows: 2; word-spacing:
    0px; -webkit-text-stroke-width: 0px; text-decoration-thickness:
    initial; text-decoration-style: initial; text-decoration-color:
    initial;">
    <pre>The verifylob utility analyzes errors in long data types (blobs and clobs).  It scans the specified blob table and examines the blob coupons and etab tables for errors. Rows with errors are dumped with error indicators.</pre>
    </div>
    <div id="ww99646" class="body" style="color: rgb(0, 0, 0);
    direction: ltr; font-family: Arial, sans-serif; font-size: medium;
    font-style: normal; font-variant: normal; font-weight: 400;
    margin: 9pt 0pt 0pt; text-align: left; text-indent: 0px;
    text-transform: none; vertical-align: baseline; letter-spacing:
    normal; orphans: 2; white-space: normal; widows: 2; word-spacing:
    0px; -webkit-text-stroke-width: 0px; text-decoration-thickness:
    initial; text-decoration-style: initial; text-decoration-color:
    initial;">
    <pre>Verifylob detects four types of errors:</pre>
    </div>
    <div id="ww99647" class="list_bul" style="color: rgb(0, 0, 0);
    direction: ltr; font-family: Arial, sans-serif; font-size: medium;
    font-style: normal; font-variant: normal; font-weight: 400;
    margin: 6pt 0pt 0pt 18pt; text-align: left; text-indent: -18pt;
    text-transform: none; vertical-align: baseline; letter-spacing:
    normal; orphans: 2; white-space: normal; widows: 2; word-spacing:
    0px; -webkit-text-stroke-width: 0px; text-decoration-thickness:
    initial; text-decoration-style: initial; text-decoration-color:
    initial;">
    <pre><span class="WebWorks_Number" style="display: inline-block; margin: 0px; padding: 0px; text-indent: 0px; width: 18pt;"><span>•</span></span>(D) Duplicate keys</pre>
    </div>
    <div id="ww99648" class="list_bul" style="color: rgb(0, 0, 0);
    direction: ltr; font-family: Arial, sans-serif; font-size: medium;
    font-style: normal; font-variant: normal; font-weight: 400;
    margin: 6pt 0pt 0pt 18pt; text-align: left; text-indent: -18pt;
    text-transform: none; vertical-align: baseline; letter-spacing:
    normal; orphans: 2; white-space: normal; widows: 2; word-spacing:
    0px; -webkit-text-stroke-width: 0px; text-decoration-thickness:
    initial; text-decoration-style: initial; text-decoration-color:
    initial;">
    <pre><span class="WebWorks_Number" style="display: inline-block; margin: 0px; padding: 0px; text-indent: 0px; width: 18pt;"><span>•</span></span>(L) Non matching lengths</pre>
    </div>
    <div id="ww99649" class="list_bul" style="color: rgb(0, 0, 0);
    direction: ltr; font-family: Arial, sans-serif; font-size: medium;
    font-style: normal; font-variant: normal; font-weight: 400;
    margin: 6pt 0pt 0pt 18pt; text-align: left; text-indent: -18pt;
    text-transform: none; vertical-align: baseline; letter-spacing:
    normal; orphans: 2; white-space: normal; widows: 2; word-spacing:
    0px; -webkit-text-stroke-width: 0px; text-decoration-thickness:
    initial; text-decoration-style: initial; text-decoration-color:
    initial;">
    <pre><span class="WebWorks_Number" style="display: inline-block; margin: 0px; padding: 0px; text-indent: 0px; width: 18pt;"><span>•</span></span>(O) Orphaned rows</pre>
    </div>
    <div id="ww99650" class="list_bul" style="color: rgb(0, 0, 0);
    direction: ltr; font-family: Arial, sans-serif; font-size: medium;
    font-style: normal; font-variant: normal; font-weight: 400;
    margin: 6pt 0pt 0pt 18pt; text-align: left; text-indent: -18pt;
    text-transform: none; vertical-align: baseline; letter-spacing:
    normal; orphans: 2; white-space: normal; widows: 2; word-spacing:
    0px; -webkit-text-stroke-width: 0px; text-decoration-thickness:
    initial; text-decoration-style: initial; text-decoration-color:
    initial;">
    <pre><span class="WebWorks_Number" style="display: inline-block; margin: 0px; padding: 0px; text-indent: 0px; width: 18pt;"><span>•</span></span>(R) Invalid iirelation rellow_logkey, rellow_logkey pair</pre>
    </div>
    <pre>
    Next step, I plan to track the entries going to the transaction log to see if both BM (Begin Mini) and EM (End Mini) are being written. 
    My hunch is the BM is not being written to the journals because I am sure I reached the transaction limit error in the rollforwarddb.</pre>
    <pre>Paul</pre>
    </body>
    </html>

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)