Thu Nov 15 07:42:38 PST 2007
- Previous message: [Slony1-general] 2 problems
- Next message: [Slony1-general] Slony & High Volume Updates
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Hey folks, I'm running slony 1.2.9 and in general it is working
fantastic (THANKS!!)
I'm noticing in my pgfouine reports and by watching the db often the
slony queries are taking up a lot of time. This may be due to the
high update volume of some of the replicated tables (One table in
paticular gets about 6k-8k updates every 5 minutes. I suppose you
could say 1k updates a minute).
I've run some of the queries that show up in explain, which seem to
be coming out sane. I'm just wondering if there is something I
should be looking into about speeding it up, or if I should
investigate something like log shipping. (I've got a master and 3
slaves. 2 of the slaves can lag a bit, 1 of the slaves should be
about <=1s )
Examples (times in seconds):
3,556.72s
DELETE FROM "_replication".sl_log_1 WHERE log_origin = '2' AND
log_xid < '4074411134'; DELETE FROM "_replication".sl_log_2 WHERE
log_origin = '2' AND log_xid < '4074411134'; DELETE FROM
"_replication".sl_seqlog WHERE seql_origin = '2' AND seql_ev_seqno <
'1296696'; SELECT "_replication".logswitch_finish();
57.73s | notify "_replication_Event"; notify "_replication_Confirm";
INSERT INTO "_replication".sl_event (ev_origin, ev_seqno,
ev_timestamp, ev_minxid, ev_maxxid, ev_xip, ev_type ) VALUES ('4',
'2049054', '2007-11-14 04:50:10.063141', '59155951', '59156428',
'''59156426'',''59155951''', 'SYNC'); INSERT INTO
"_replication".sl_confirm (con_origin, con_received, con_seqno,
con_timestamp) VALUES (4, 3, '2049054', now()); COMMIT transaction;
57.72s | notify "_replication_Event"; notify "_replication_Confirm";
INSERT INTO "_replication".sl_event (ev_origin, ev_seqno,
ev_timestamp, ev_minxid, ev_maxxid, ev_xip, ev_type ) VALUES ('4',
'2049054', '2007-11-14 04:50:10.063141', '59155951', '59156428',
'''59156426'',''59155951''', 'SYNC'); INSERT INTO
"_replication".sl_confirm (con_origin, con_received, con_seqno,
con_timestamp) VALUES (4, 1, '2049054', now()); COMMIT transaction;
34.33s | notify "_replication_Event"; notify "_replication_Confirm";
INSERT INTO "_replication".sl_event (ev_origin, ev_seqno,
ev_timestamp, ev_minxid, ev_maxxid, ev_xip, ev_type ) VALUES ('4',
'2040322', '2007-11-14 02:21:41.311908', '58935882', '58935883', '',
'SYNC'); INSERT INTO "_replication".sl_confirm (con_origin,
con_received, con_seqno, con_timestamp) VALUES (4, 3, '2040322', now
()); COMMIT transaction;
105.57s | fetch 100 FROM LOG;
102.80s | fetch 100 FROM LOG;
80.58s | fetch 100 FROM LOG;
I'm going to turn on duration logging for all queries tonight to make
sure I get a more accurate picture of where time is being spent.
But like I said, I suppose this could be the nature of the beast with
that crazy update table.
Should I look into perhaps seeing if those slow notify... queries
were trying to run at the same time as that log switch?
thanks!
--
Jeff Trout <jeff at jefftrout.com>
http://www.dellsmartexitin.com/
http://www.stuarthamm.net/
- Previous message: [Slony1-general] 2 problems
- Next message: [Slony1-general] Slony & High Volume Updates
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
More information about the Slony1-general mailing list