Tignor, Tom ttignor at akamai.com
Fri Sep 13 05:57:49 PDT 2019
                Hello Slony community,
                Our service has a DML-heavy task (thousands of rows moved between tables) occurring at the top of each hour. We are seeing changelog processing virtually stop on one or more subscribers for several minutes right after this occurs. (Log samples included below.) Breaking the DML into batches (multiple transactions) does not seem to have helped. What switches (sync groups?) should we be trying out with slony 2.2.6?
                Thanks in advance,


2019-09-13 10:00:00 UTC [6943] INFO   remoteWorkerThread_2: SYNC 5000198654 done in 0.737 seconds

2019-09-13 10:00:01 UTC [6943] INFO   remoteWorkerThread_1: SYNC 5000073045 done in 1.776 seconds

2019-09-13 10:00:01 UTC [6943] INFO   remoteWorkerThread_1: syncing set 2 with 5 table(s) from provider 1

2019-09-13 10:00:01 UTC [6943] INFO   remoteWorkerThread_1: syncing set 1 with 17 table(s) from provider 1

2019-09-13 10:00:02 UTC [6943] INFO   remoteWorkerThread_5: SYNC 5000198596 done in 0.594 seconds

2019-09-13 10:00:02 UTC [6943] INFO   remoteWorkerThread_1: SYNC 5000073046 done in 1.055 seconds

2019-09-13 10:00:08 UTC [6943] INFO   remoteWorkerThread_1: syncing set 2 with 5 table(s) from provider 1

2019-09-13 10:00:08 UTC [6943] INFO   remoteWorkerThread_1: syncing set 1 with 17 table(s) from provider 1

2019-09-13 10:00:09 UTC [6943] INFO   remoteWorkerThread_1: SYNC 5000073048 done in 1.229 seconds

2019-09-13 10:00:09 UTC [6943] INFO   remoteWorkerThread_1: syncing set 2 with 5 table(s) from provider 1

2019-09-13 10:00:09 UTC [6943] INFO   remoteWorkerThread_1: syncing set 1 with 17 table(s) from provider 1

2019-09-13 10:00:11 UTC [6943] INFO   remoteWorkerThread_2: SYNC 5000198655 done in 0.737 seconds

2019-09-13 10:00:13 UTC [6943] INFO   remoteWorkerThread_5: SYNC 5000198597 done in 0.737 seconds

2019-09-13 10:00:20 UTC [6943] INFO   remoteWorkerThread_2: SYNC 5000198656 done in 0.737 seconds

2019-09-13 10:00:26 UTC [6943] INFO   remoteWorkerThread_5: SYNC 5000198598 done in 0.693 seconds

2019-09-13 10:00:37 UTC [6943] INFO   remoteWorkerThread_2: SYNC 5000198657 done in 0.737 seconds

2019-09-13 10:00:37 UTC [6943] INFO   remoteWorkerThread_5: SYNC 5000198599 done in 0.737 seconds

2019-09-13 10:00:47 UTC [6943] INFO   remoteWorkerThread_2: SYNC 5000198658 done in 0.650 seconds

2019-09-13 10:00:47 UTC [6943] INFO   remoteWorkerThread_5: SYNC 5000198600 done in 0.692 seconds

2019-09-13 10:00:53 UTC [6943] INFO   remoteWorkerThread_5: SYNC 5000198601 done in 0.594 seconds
…

2019-09-13 10:03:03 UTC [6943] INFO   remoteWorkerThread_2: SYNC 5000198672 done in 0.737 seconds

2019-09-13 10:03:05 UTC [6943] INFO   remoteWorkerThread_5: SYNC 5000198614 done in 0.692 seconds

2019-09-13 10:03:10 UTC [6943] INFO   remoteWorkerThread_1: SYNC 5000073049 done in 181.070 seconds
…

2019-09-13 10:59:54 UTC [6943] INFO   remoteWorkerThread_1: syncing set 2 with 5 table(s) from provider 1

2019-09-13 10:59:54 UTC [6943] INFO   remoteWorkerThread_1: syncing set 1 with 17 table(s) from provider 1

2019-09-13 10:59:54 UTC [6943] INFO   remoteWorkerThread_5: SYNC 5000198955 done in 0.594 seconds

2019-09-13 10:59:55 UTC [6943] INFO   remoteWorkerThread_1: SYNC 5000074842 done in 1.726 seconds

2019-09-13 11:00:00 UTC [6943] INFO   remoteWorkerThread_1: syncing set 2 with 5 table(s) from provider 1

2019-09-13 11:00:00 UTC [6943] INFO   remoteWorkerThread_1: syncing set 1 with 17 table(s) from provider 1

2019-09-13 11:00:01 UTC [6943] INFO   remoteWorkerThread_5: SYNC 5000198956 done in 0.693 seconds

2019-09-13 11:00:01 UTC [6943] INFO   remoteWorkerThread_1: SYNC 5000074845 done in 1.023 seconds

2019-09-13 11:00:05 UTC [6943] INFO   remoteWorkerThread_2: SYNC 5000199014 done in 0.737 seconds

2019-09-13 11:00:07 UTC [6943] INFO   remoteWorkerThread_1: syncing set 2 with 5 table(s) from provider 1

2019-09-13 11:00:07 UTC [6943] INFO   remoteWorkerThread_1: syncing set 1 with 17 table(s) from provider 1

2019-09-13 11:00:07 UTC [6943] INFO   remoteWorkerThread_1: SYNC 5000074848 done in 1.062 seconds

Fri Sep 13 11:00:07 UTC 2019 : SyncRateUpdate: 5000074848 2

2019-09-13 11:00:09 UTC [6943] INFO   remoteWorkerThread_1: syncing set 2 with 5 table(s) from provider 1

2019-09-13 11:00:09 UTC [6943] INFO   remoteWorkerThread_1: syncing set 1 with 17 table(s) from provider 1

2019-09-13 11:00:09 UTC [6943] INFO   remoteWorkerThread_5: SYNC 5000198957 done in 0.693 seconds

2019-09-13 11:00:12 UTC [6943] INFO   remoteWorkerThread_2: SYNC 5000199015 done in 0.650 seconds

2019-09-13 11:00:24 UTC [6943] INFO   remoteWorkerThread_5: SYNC 5000198958 done in 0.736 seconds

2019-09-13 11:00:24 UTC [6943] INFO   remoteWorkerThread_2: SYNC 5000199016 done in 0.738 seconds

2019-09-13 11:00:31 UTC [6943] INFO   remoteWorkerThread_5: SYNC 5000198959 done in 0.693 seconds

2019-09-13 11:00:37 UTC [6943] INFO   remoteWorkerThread_2: SYNC 5000199017 done in 0.736 seconds

2019-09-13 11:00:40 UTC [6943] INFO   remoteWorkerThread_2: SYNC 5000199018 done in 0.736 seconds
…

2019-09-13 11:04:21 UTC [6943] INFO   remoteWorkerThread_5: SYNC 5000198982 done in 0.693 seconds

2019-09-13 11:04:33 UTC [6943] INFO   remoteWorkerThread_2: SYNC 5000199041 done in 0.736 seconds

2019-09-13 11:04:33 UTC [6943] INFO   remoteWorkerThread_5: SYNC 5000198983 done in 0.736 seconds

2019-09-13 11:04:38 UTC [6943] INFO   remoteWorkerThread_1: SYNC 5000074850 done in 269.239 seconds


                Tom    ☺

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.slony.info/pipermail/slony1-general/attachments/20190913/c88d68e4/attachment-0001.htm 


More information about the Slony1-general mailing list