Fri Sep 13 05:57:49 PDT 2019
- Previous message: [Slony1-general] Slony 2.2.6 and Postgres 10
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Hello Slony community, Our service has a DML-heavy task (thousands of rows moved between tables) occurring at the top of each hour. We are seeing changelog processing virtually stop on one or more subscribers for several minutes right after this occurs. (Log samples included below.) Breaking the DML into batches (multiple transactions) does not seem to have helped. What switches (sync groups?) should we be trying out with slony 2.2.6? Thanks in advance, 2019-09-13 10:00:00 UTC [6943] INFO remoteWorkerThread_2: SYNC 5000198654 done in 0.737 seconds 2019-09-13 10:00:01 UTC [6943] INFO remoteWorkerThread_1: SYNC 5000073045 done in 1.776 seconds 2019-09-13 10:00:01 UTC [6943] INFO remoteWorkerThread_1: syncing set 2 with 5 table(s) from provider 1 2019-09-13 10:00:01 UTC [6943] INFO remoteWorkerThread_1: syncing set 1 with 17 table(s) from provider 1 2019-09-13 10:00:02 UTC [6943] INFO remoteWorkerThread_5: SYNC 5000198596 done in 0.594 seconds 2019-09-13 10:00:02 UTC [6943] INFO remoteWorkerThread_1: SYNC 5000073046 done in 1.055 seconds 2019-09-13 10:00:08 UTC [6943] INFO remoteWorkerThread_1: syncing set 2 with 5 table(s) from provider 1 2019-09-13 10:00:08 UTC [6943] INFO remoteWorkerThread_1: syncing set 1 with 17 table(s) from provider 1 2019-09-13 10:00:09 UTC [6943] INFO remoteWorkerThread_1: SYNC 5000073048 done in 1.229 seconds 2019-09-13 10:00:09 UTC [6943] INFO remoteWorkerThread_1: syncing set 2 with 5 table(s) from provider 1 2019-09-13 10:00:09 UTC [6943] INFO remoteWorkerThread_1: syncing set 1 with 17 table(s) from provider 1 2019-09-13 10:00:11 UTC [6943] INFO remoteWorkerThread_2: SYNC 5000198655 done in 0.737 seconds 2019-09-13 10:00:13 UTC [6943] INFO remoteWorkerThread_5: SYNC 5000198597 done in 0.737 seconds 2019-09-13 10:00:20 UTC [6943] INFO remoteWorkerThread_2: SYNC 5000198656 done in 0.737 seconds 2019-09-13 10:00:26 UTC [6943] INFO remoteWorkerThread_5: SYNC 5000198598 done in 0.693 seconds 2019-09-13 10:00:37 UTC [6943] INFO remoteWorkerThread_2: SYNC 5000198657 done in 0.737 seconds 2019-09-13 10:00:37 UTC [6943] INFO remoteWorkerThread_5: SYNC 5000198599 done in 0.737 seconds 2019-09-13 10:00:47 UTC [6943] INFO remoteWorkerThread_2: SYNC 5000198658 done in 0.650 seconds 2019-09-13 10:00:47 UTC [6943] INFO remoteWorkerThread_5: SYNC 5000198600 done in 0.692 seconds 2019-09-13 10:00:53 UTC [6943] INFO remoteWorkerThread_5: SYNC 5000198601 done in 0.594 seconds … 2019-09-13 10:03:03 UTC [6943] INFO remoteWorkerThread_2: SYNC 5000198672 done in 0.737 seconds 2019-09-13 10:03:05 UTC [6943] INFO remoteWorkerThread_5: SYNC 5000198614 done in 0.692 seconds 2019-09-13 10:03:10 UTC [6943] INFO remoteWorkerThread_1: SYNC 5000073049 done in 181.070 seconds … 2019-09-13 10:59:54 UTC [6943] INFO remoteWorkerThread_1: syncing set 2 with 5 table(s) from provider 1 2019-09-13 10:59:54 UTC [6943] INFO remoteWorkerThread_1: syncing set 1 with 17 table(s) from provider 1 2019-09-13 10:59:54 UTC [6943] INFO remoteWorkerThread_5: SYNC 5000198955 done in 0.594 seconds 2019-09-13 10:59:55 UTC [6943] INFO remoteWorkerThread_1: SYNC 5000074842 done in 1.726 seconds 2019-09-13 11:00:00 UTC [6943] INFO remoteWorkerThread_1: syncing set 2 with 5 table(s) from provider 1 2019-09-13 11:00:00 UTC [6943] INFO remoteWorkerThread_1: syncing set 1 with 17 table(s) from provider 1 2019-09-13 11:00:01 UTC [6943] INFO remoteWorkerThread_5: SYNC 5000198956 done in 0.693 seconds 2019-09-13 11:00:01 UTC [6943] INFO remoteWorkerThread_1: SYNC 5000074845 done in 1.023 seconds 2019-09-13 11:00:05 UTC [6943] INFO remoteWorkerThread_2: SYNC 5000199014 done in 0.737 seconds 2019-09-13 11:00:07 UTC [6943] INFO remoteWorkerThread_1: syncing set 2 with 5 table(s) from provider 1 2019-09-13 11:00:07 UTC [6943] INFO remoteWorkerThread_1: syncing set 1 with 17 table(s) from provider 1 2019-09-13 11:00:07 UTC [6943] INFO remoteWorkerThread_1: SYNC 5000074848 done in 1.062 seconds Fri Sep 13 11:00:07 UTC 2019 : SyncRateUpdate: 5000074848 2 2019-09-13 11:00:09 UTC [6943] INFO remoteWorkerThread_1: syncing set 2 with 5 table(s) from provider 1 2019-09-13 11:00:09 UTC [6943] INFO remoteWorkerThread_1: syncing set 1 with 17 table(s) from provider 1 2019-09-13 11:00:09 UTC [6943] INFO remoteWorkerThread_5: SYNC 5000198957 done in 0.693 seconds 2019-09-13 11:00:12 UTC [6943] INFO remoteWorkerThread_2: SYNC 5000199015 done in 0.650 seconds 2019-09-13 11:00:24 UTC [6943] INFO remoteWorkerThread_5: SYNC 5000198958 done in 0.736 seconds 2019-09-13 11:00:24 UTC [6943] INFO remoteWorkerThread_2: SYNC 5000199016 done in 0.738 seconds 2019-09-13 11:00:31 UTC [6943] INFO remoteWorkerThread_5: SYNC 5000198959 done in 0.693 seconds 2019-09-13 11:00:37 UTC [6943] INFO remoteWorkerThread_2: SYNC 5000199017 done in 0.736 seconds 2019-09-13 11:00:40 UTC [6943] INFO remoteWorkerThread_2: SYNC 5000199018 done in 0.736 seconds … 2019-09-13 11:04:21 UTC [6943] INFO remoteWorkerThread_5: SYNC 5000198982 done in 0.693 seconds 2019-09-13 11:04:33 UTC [6943] INFO remoteWorkerThread_2: SYNC 5000199041 done in 0.736 seconds 2019-09-13 11:04:33 UTC [6943] INFO remoteWorkerThread_5: SYNC 5000198983 done in 0.736 seconds 2019-09-13 11:04:38 UTC [6943] INFO remoteWorkerThread_1: SYNC 5000074850 done in 269.239 seconds Tom ☺ -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.slony.info/pipermail/slony1-general/attachments/20190913/c88d68e4/attachment-0001.htm
- Previous message: [Slony1-general] Slony 2.2.6 and Postgres 10
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
More information about the Slony1-general mailing list