Jan Wieck JanWieck at Yahoo.com
Fri Sep 7 12:00:19 PDT 2007
On 9/6/2007 11:17 PM, Richard Yen wrote:
> On Sep 6, 2007, at 4:00 PM, Andrew Hammond wrote:
> 
>> What slonik script did you run. How did you run it. What was the  
>> output of slonik.
>>
> 
> I ran a shell script (from command line) that passes conninfo and  
> such to slonik:
> 
>> #!/bin/sh
>>
>> ${SLONIK} <<EOF
>>
>> # ----
>> # This defines which namespace the replication system uses
>> # ----
>> cluster name = $CLUSTER_NAME;
>>
>> # ----
>> # Admin conninfo's are used by the slonik program to connect
>> # to the node databases.  So therse are the PQconnectdb arguments
>> # that connect from the administrators workstation (where
>> # slonik is executed).
>> # ----
>> node $MASTER_NODE_ID admin conninfo = '$MASTER_CONNINFO';
>> node $SLAVE1_NODE_ID admin conninfo = '$SLAVE1_CONNINFO';
>> node $SLAVE2_NODE_ID admin conninfo = '$SLAVE2_CONNINFO';
>>
>> # ----
>> # Switch provider from db3 to db1
>> # ----
>>
>> failover( id=$MASTER_NODE_ID, backup node = $SLAVE1_NODE_ID);
>> EOF
>>
>> echo "slonik is done"
> 
> The output was the following:
> NOTICE:  failedNode: set 1 has other direct receivers - change  
> providers only
> NOTICE:  failedNode: set 1 has other direct receivers - change  
> providers only
> slonik is done
> 
> The logs on the new master (tii-db2) show the following (tii-db1g is  
> the failed node):
> Sep  5 19:17:23 tii-db2.local.myip.com postgres[3012]: [3-1]  
> 2007-09-05 19:17:23.178 PDT [user=slony,db=tii 192.168.1.42(33459)  
> PID:3012 XID:210896798]NOTICE:  failedNode: set 1 has other
> Sep  5 19:17:23 tii-db2.local.myip.com postgres[3012]: [3-2]  direct  
> receivers - change providers only
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31603]: [6100-1]  
> 2007-09-05 19:17:23 PDT INFO   localListenThread: got restart  
> notification
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31603]: [6101-1]  
> 2007-09-05 19:17:23 PDT DEBUG2 slon_restart() from pid=31603
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31602]: [5-1] 2007-09-05  
> 19:17:23 PDT DEBUG1 slon: restart requested
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31602]: [6-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 slon: notify worker process to shutdown
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31603]: [6102-1]  
> 2007-09-05 19:17:23 PDT DEBUG1 remoteListenThread_1: thread done
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31603]: [6103-1]  
> 2007-09-05 19:17:23 PDT DEBUG1 cleanupThread: thread done
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31603]: [6104-1]  
> 2007-09-05 19:17:23 PDT DEBUG1 syncThread: thread done
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31603]: [6105-1]  
> 2007-09-05 19:17:23 PDT INFO   remoteListenThread_3: disconnecting  
> from 'dbname=tii host=tii-db3g.local.myip.com
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31603]: [6105-2]   
> user=slony password=3l3phant'
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31603]: [6106-1]  
> 2007-09-05 19:17:23 PDT DEBUG1 remoteListenThread_3: thread done
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31603]: [6107-1]  
> 2007-09-05 19:17:23 PDT DEBUG1 main: scheduler mainloop returned
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31603]: [6108-1]  
> 2007-09-05 19:17:23 PDT DEBUG2 main: wait for remote threads
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31603]: [6109-1]  
> 2007-09-05 19:17:23 PDT DEBUG2 sched_wakeup_node(): no_id=1 (0  
> threads + worker signaled)
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31603]: [6110-1]  
> 2007-09-05 19:17:23 PDT DEBUG4 remoteWorkerThread_1: update provider  
> configuration
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31603]: [6111-1]  
> 2007-09-05 19:17:23 PDT DEBUG1 remoteWorkerThread_1: helper thread  
> for provider 1 terminated
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31603]: [6112-1]  
> 2007-09-05 19:17:23 PDT DEBUG1 remoteWorkerThread_1: thread done
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31603]: [6113-1]  
> 2007-09-05 19:17:23 PDT DEBUG2 sched_wakeup_node(): no_id=3 (0  
> threads + worker signaled)
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31603]: [6114-1]  
> 2007-09-05 19:17:23 PDT DEBUG4 remoteWorkerThread_3: update provider  
> configuration
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31603]: [6115-1]  
> 2007-09-05 19:17:23 PDT DEBUG1 remoteWorkerThread_3: thread done
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31603]: [6116-1]  
> 2007-09-05 19:17:23 PDT DEBUG1 main: done
> Sep  5 19:17:23 tii-db2.local.myip.com postgres[31607]: [5-1]  
> 2007-09-05 19:17:23.319 PDT [user=slony,db=tii 192.168.3.42(51836)  
> PID:31607 XID:210896805]LOG:  unexpected EOF on client
> Sep  5 19:17:23 tii-db2.local.myip.com postgres[31607]: [5-2]   
> connection
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31602]: [7-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 slon: child terminated status: 0; pid: 31603,  
> current worker pid: 31603
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31602]: [1-1] 2007-09-05  
> 19:17:23 PDT CONFIG main: slon version 1.2.9 starting up
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31602]: [2-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 slon: watchdog process started
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31602]: [3-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 slon: watchdog ready - pid = 31602
> Sep  5 19:17:23 tii-db2.local.myip.com slon[31602]: [4-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 slon: worker process created - pid = 3013
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [4-1] 2007-09-05  
> 19:17:23 PDT CONFIG main: local node id = 2
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [5-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 main: main process started
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [6-1] 2007-09-05  
> 19:17:23 PDT CONFIG main: launching sched_start_mainloop
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [7-1] 2007-09-05  
> 19:17:23 PDT CONFIG main: loading current cluster configuration
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [8-1] 2007-09-05  
> 19:17:23 PDT CONFIG storeNode: no_id=1 no_comment='Master node'
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [9-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 setNodeLastEvent: no_id=1 event_seq=5748563
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [10-1] 2007-09-05  
> 19:17:23 PDT CONFIG storeNode: no_id=3 no_comment='second slave node'
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [11-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 setNodeLastEvent: no_id=3 event_seq=1319203
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [12-1] 2007-09-05  
> 19:17:23 PDT CONFIG storePath: pa_server=1 pa_client=2  
> pa_conninfo="dbname=tii host=tii-db1g.local.myip.com
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [12-2]  user=slony  
> password=3l3phant" pa_connretry=10
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [13-1] 2007-09-05  
> 19:17:23 PDT CONFIG storePath: pa_server=3 pa_client=2  
> pa_conninfo="dbname=tii host=tii-db3g.local.myip.com
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [13-2]  user=slony  
> password=3l3phant" pa_connretry=10
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [14-1] 2007-09-05  
> 19:17:23 PDT CONFIG storeListen: li_origin=1 li_receiver=2 li_provider=1
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [15-1] 2007-09-05  
> 19:17:23 PDT CONFIG storeListen: li_origin=3 li_receiver=2 li_provider=1
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [16-1] 2007-09-05  
> 19:17:23 PDT CONFIG storeListen: li_origin=3 li_receiver=2 li_provider=3
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [17-1] 2007-09-05  
> 19:17:23 PDT CONFIG storeListen: li_origin=1 li_receiver=2 li_provider=3
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [18-1] 2007-09-05  
> 19:17:23 PDT CONFIG storeSet: set_id=1 set_origin=1 set_comment='all  
> tables'
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [19-1] 2007-09-05  
> 19:17:23 PDT WARN   remoteWorker_wakeup: node 1 - no worker thread
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [20-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 sched_wakeup_node(): no_id=1 (0 threads + worker  
> signaled)
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [21-1] 2007-09-05  
> 19:17:23 PDT CONFIG storeSubscribe: sub_set=1 sub_provider=0  
> sub_forward='t'
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [22-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteWorker_wakeup: unknown node 0
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [23-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 sched_wakeup_node(): no_id=0 (0 threads + worker  
> signaled)
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [24-1] 2007-09-05  
> 19:17:23 PDT CONFIG enableSubscription: sub_set=1
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [25-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 main: last local event sequence = 1312811
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [26-1] 2007-09-05  
> 19:17:23 PDT CONFIG main: configuration complete - starting threads
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [27-1] 2007-09-05  
> 19:17:23 PDT DEBUG1 localListenThread: thread starts
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [28-1] 2007-09-05  
> 19:17:23 PDT DEBUG4 version for "dbname=tii host=tii- 
> db2g.local.myip.com user=slony password=3l3phant" is
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [28-2]  80204
> Sep  5 19:17:23 tii-db2.local.myip.com postgres[3018]: [3-1]  
> 2007-09-05 19:17:23.390 PDT [user=slony,db=tii 192.168.3.42(50883)  
> PID:3018 XID:210896821]NOTICE:  Slony-I: cleanup stale
> Sep  5 19:17:23 tii-db2.local.myip.com postgres[3018]: [3-2]   
> sl_nodelock entry for pid=31582
> Sep  5 19:17:23 tii-db2.local.myip.com postgres[3018]: [4-1]  
> 2007-09-05 19:17:23.392 PDT [user=slony,db=tii 192.168.3.42(50883)  
> PID:3018 XID:210896821]NOTICE:  Slony-I: cleanup stale
> Sep  5 19:17:23 tii-db2.local.myip.com postgres[3018]: [4-2]   
> sl_nodelock entry for pid=31607
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [29-1] 2007-09-05  
> 19:17:23 PDT CONFIG enableNode: no_id=1
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [30-1] 2007-09-05  
> 19:17:23 PDT CONFIG enableNode: no_id=3
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [31-1] 2007-09-05  
> 19:17:23 PDT DEBUG1 remoteWorkerThread_1: thread starts
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [32-1] 2007-09-05  
> 19:17:23 PDT DEBUG1 remoteListenThread_1: thread starts
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [33-1] 2007-09-05  
> 19:17:23 PDT DEBUG1 remoteWorkerThread_3: thread starts
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [34-1] 2007-09-05  
> 19:17:23 PDT DEBUG1 remoteListenThread_3: thread starts
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [35-1] 2007-09-05  
> 19:17:23 PDT DEBUG1 main: running scheduler mainloop
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [36-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteListenThread_1: start listening for event  
> origin 1
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [37-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteListenThread_1: start listening for event  
> origin 3
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [38-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteListenThread_3: start listening for event  
> origin 3
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [39-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteListenThread_3: start listening for event  
> origin 1
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [40-1] 2007-09-05  
> 19:17:23 PDT DEBUG1 cleanupThread: thread starts
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [41-1] 2007-09-05  
> 19:17:23 PDT DEBUG4 cleanupThread: bias = 35383
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [42-1] 2007-09-05  
> 19:17:23 PDT DEBUG1 syncThread: thread starts
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [43-1] 2007-09-05  
> 19:17:23 PDT ERROR  slon_connectdb: PQconnectdb("dbname=tii host=tii- 
> db1g.local.myip.com user=slony
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [43-2]   
> password=3l3phant") failed - could not connect to server: Connection  
> refused
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [43-3]       Is  
> the server running on host "tii-db1g.local.myip.com" and accepting
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [43-4]       TCP/ 
> IP connections on port 5432?
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [44-1] 2007-09-05  
> 19:17:23 PDT WARN   remoteListenThread_1: DB connection failed -  
> sleep 10 seconds
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [45-1] 2007-09-05  
> 19:17:23 PDT DEBUG4 version for "dbname=tii host=tii- 
> db3g.local.myip.com user=slony password=3l3phant" is
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [45-2]  80204
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [46-1] 2007-09-05  
> 19:17:23 PDT DEBUG4 version for "dbname=tii host=tii- 
> db2g.local.myip.com user=slony password=3l3phant" is
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [46-2]  80204
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [47-1] 2007-09-05  
> 19:17:23 PDT DEBUG1 remoteListenThread_3: connected to 'dbname=tii  
> host=tii-db3g.local.myip.com user=slony
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [47-2]   
> password=3l3phant'
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [48-1] 2007-09-05  
> 19:17:23 PDT DEBUG4 version for "dbname=tii host=tii- 
> db2g.local.myip.com user=slony password=3l3phant" is
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [48-2]  80204
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [49-1] 2007-09-05  
> 19:17:23 PDT DEBUG4 remoteWorkerThread_3: update provider configuration
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [50-1] 2007-09-05  
> 19:17:23 PDT DEBUG4 version for "dbname=tii host=tii- 
> db2g.local.myip.com user=slony password=3l3phant" is
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [50-2]  80204
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [51-1] 2007-09-05  
> 19:17:23 PDT DEBUG4 remoteWorkerThread_1: update provider configuration
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [52-1] 2007-09-05  
> 19:17:23 PDT DEBUG1 remoteWorkerThread_1: helper thread for provider  
> 0 created
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [53-1] 2007-09-05  
> 19:17:23 PDT DEBUG4 remoteWorkerThread_1: added active set 1 to  
> provider 0
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [54-1] 2007-09-05  
> 19:17:23 PDT DEBUG4 remoteHelperThread_1_0: waiting for work
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [55-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteListenThread_3: queue event 1,5748564 SYNC
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [56-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteListenThread_3: queue event 1,5748565 SYNC
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [57-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteWorkerThread_1: Received event 1,5748564 SYNC
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [58-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteListenThread_3: queue event 1,5748566 SYNC
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [59-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteListenThread_3: queue event 1,5748567 SYNC
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [60-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteWorkerThread_1: SYNC 5748564 processing
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [61-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteListenThread_3: queue event 1,5748568 SYNC
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [62-1] 2007-09-05  
> 19:17:23 PDT ERROR  remoteWorkerThread_1: No pa_conninfo for data  
> provider 0
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [63-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteListenThread_3: queue event 1,5748569 SYNC
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [64-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteListenThread_3: queue event 1,5748570 SYNC
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [65-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteListenThread_3: queue event 1,5748571 SYNC
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [66-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteListenThread_3: queue event 1,5748572 SYNC
> [...]
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [726-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteListenThread_3: queue event 1,5749231 SYNC
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [727-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteListenThread_3: queue event 1,5749232 SYNC
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [728-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteListenThread_3: queue event 1,5749233 SYNC
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [729-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteWorkerThread_3: forward confirm 1,5749233  
> received by 3
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [730-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteWorkerThread_3: forward confirm 2,1312302  
> received by 1
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [731-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteWorkerThread_3: forward confirm 3,1318662  
> received by 1
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [732-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 remoteWorkerThread_3: forward confirm 2,1312811  
> received by 3
> Sep  5 19:17:23 tii-db2.local.myip.com slon[3013]: [733-1] 2007-09-05  
> 19:17:23 PDT DEBUG2 syncThread: new sl_action_seq 1 - SYNC 1312812
> Sep  5 19:17:24 tii-db2.local.myip.com slon[3013]: [734-1] 2007-09-05  
> 19:17:24 PDT DEBUG2 localListenThread: Received event 2,1312812 SYNC
> Sep  5 19:17:25 tii-db2.local.myip.com slon[3013]: [735-1] 2007-09-05  
> 19:17:25 PDT DEBUG2 remoteListenThread_3: queue event 1,5749234  
> FAILOVER_SET
> Sep  5 19:17:25 tii-db2.local.myip.com slon[3013]: [736-1] 2007-09-05  
> 19:17:25 PDT DEBUG2 remoteWorkerThread_3: forward confirm 1,5749234  
> received by 3
> Sep  5 19:17:26 tii-db2.local.myip.com slon[3013]: [737-1] 2007-09-05  
> 19:17:26 PDT DEBUG2 syncThread: new sl_action_seq 1 - SYNC 1312813
> Sep  5 19:17:27 tii-db2.local.myip.com slon[3013]: [738-1] 2007-09-05  
> 19:17:27 PDT DEBUG2 remoteListenThread_3: queue event 3,1319204 SYNC
> Sep  5 19:17:27 tii-db2.local.myip.com slon[3013]: [739-1] 2007-09-05  
> 19:17:27 PDT DEBUG2 remoteWorkerThread_3: Received event 3,1319204 SYNC
> Sep  5 19:17:27 tii-db2.local.myip.com slon[3013]: [740-1] 2007-09-05  
> 19:17:27 PDT DEBUG3 calc sync size - last time: 1 last length: 4113  
> ideal: 100 proposed size: 3
> Sep  5 19:17:27 tii-db2.local.myip.com slon[3013]: [741-1] 2007-09-05  
> 19:17:27 PDT DEBUG2 remoteWorkerThread_3: SYNC 1319204 processing
> Sep  5 19:17:27 tii-db2.local.myip.com slon[3013]: [742-1] 2007-09-05  
> 19:17:27 PDT DEBUG2 remoteWorkerThread_3: no sets need syncing for  
> this event
> Sep  5 19:17:27 tii-db2.local.myip.com slon[3013]: [743-1] 2007-09-05  
> 19:17:27 PDT DEBUG2 remoteWorkerThread_3: forward confirm 2,1312813  
> received by 3
> Sep  5 19:17:27 tii-db2.local.myip.com slon[3013]: [744-1] 2007-09-05  
> 19:17:27 PDT DEBUG2 localListenThread: Received event 2,1312813 SYNC
> Sep  5 19:17:29 tii-db2.local.myip.com slon[3013]: [745-1] 2007-09-05  
> 19:17:29 PDT DEBUG2 remoteListenThread_3: LISTEN
> Sep  5 19:17:29 tii-db2.local.myip.com slon[3013]: [746-1] 2007-09-05  
> 19:17:29 PDT DEBUG2 syncThread: new sl_action_seq 1 - SYNC 1312814
> Sep  5 19:17:29 tii-db2.local.myip.com slon[3013]: [747-1] 2007-09-05  
> 19:17:29 PDT DEBUG2 remoteWorkerThread_3: forward confirm 2,1312814  
> received by 3
> Sep  5 19:17:30 tii-db2.local.myip.com slon[3013]: [748-1] 2007-09-05  
> 19:17:30 PDT DEBUG2 remoteListenThread_3: queue event 3,1319205 SYNC
> Sep  5 19:17:30 tii-db2.local.myip.com slon[3013]: [749-1] 2007-09-05  
> 19:17:30 PDT DEBUG2 remoteListenThread_3: UNLISTEN
> Sep  5 19:17:30 tii-db2.local.myip.com slon[3013]: [750-1] 2007-09-05  
> 19:17:30 PDT DEBUG2 remoteWorkerThread_3: Received event 3,1319205 SYNC
> Sep  5 19:17:30 tii-db2.local.myip.com slon[3013]: [751-1] 2007-09-05  
> 19:17:30 PDT DEBUG3 calc sync size - last time: 1 last length: 2518  
> ideal: 100 proposed size: 3
> Sep  5 19:17:30 tii-db2.local.myip.com slon[3013]: [752-1] 2007-09-05  
> 19:17:30 PDT DEBUG2 remoteWorkerThread_3: SYNC 1319205 processing
> Sep  5 19:17:30 tii-db2.local.myip.com slon[3013]: [753-1] 2007-09-05  
> 19:17:30 PDT DEBUG2 remoteWorkerThread_3: no sets need syncing for  
> this event
> Sep  5 19:17:30 tii-db2.local.myip.com slon[3013]: [754-1] 2007-09-05  
> 19:17:30 PDT DEBUG2 localListenThread: Received event 2,1312814 SYNC
> Sep  5 19:17:32 tii-db2.local.myip.com slon[3013]: [755-1] 2007-09-05  
> 19:17:32 PDT DEBUG2 remoteListenThread_3: LISTEN
> Sep  5 19:17:32 tii-db2.local.myip.com slon[3013]: [756-1] 2007-09-05  
> 19:17:32 PDT DEBUG2 syncThread: new sl_action_seq 1 - SYNC 1312815
> Sep  5 19:17:32 tii-db2.local.myip.com slon[3013]: [757-1] 2007-09-05  
> 19:17:32 PDT DEBUG2 remoteWorkerThread_3: forward confirm 2,1312815  
> received by 3
> Sep  5 19:17:33 tii-db2.local.myip.com slon[3013]: [758-1] 2007-09-05  
> 19:17:33 PDT DEBUG2 remoteListenThread_3: queue event 3,1319206 SYNC
> Sep  5 19:17:33 tii-db2.local.myip.com slon[3013]: [759-1] 2007-09-05  
> 19:17:33 PDT DEBUG2 remoteListenThread_3: UNLISTEN
> Sep  5 19:17:33 tii-db2.local.myip.com slon[3013]: [760-1] 2007-09-05  
> 19:17:33 PDT DEBUG2 remoteWorkerThread_3: Received event 3,1319206 SYNC
> Sep  5 19:17:33 tii-db2.local.myip.com slon[3013]: [761-1] 2007-09-05  
> 19:17:33 PDT DEBUG3 calc sync size - last time: 1 last length: 3002  
> ideal: 100 proposed size: 3
> Sep  5 19:17:33 tii-db2.local.myip.com slon[3013]: [762-1] 2007-09-05  
> 19:17:33 PDT DEBUG2 remoteWorkerThread_3: SYNC 1319206 processing
> Sep  5 19:17:33 tii-db2.local.myip.com slon[3013]: [763-1] 2007-09-05  
> 19:17:33 PDT DEBUG2 remoteWorkerThread_3: no sets need syncing for  
> this event
> Sep  5 19:17:33 tii-db2.local.myip.com slon[3013]: [764-1] 2007-09-05  
> 19:17:33 PDT ERROR  slon_connectdb: PQconnectdb("dbname=tii host=tii- 
> db1g.local.myip.com user=slony
> Sep  5 19:17:33 tii-db2.local.myip.com slon[3013]: [764-2]   
> password=3l3phant") failed - could not connect to server: Connection  
> refused
> Sep  5 19:17:33 tii-db2.local.myip.com slon[3013]: [764-3]      Is  
> the server running on host "tii-db1g.local.myip.com" and accepting
> Sep  5 19:17:33 tii-db2.local.myip.com slon[3013]: [764-4]      TCP/ 
> IP connections on port 5432?
> Sep  5 19:17:33 tii-db2.local.myip.com slon[3013]: [765-1] 2007-09-05  
> 19:17:33 PDT WARN   remoteListenThread_1: DB connection failed -  
> sleep 10 seconds
> Sep  5 19:17:33 tii-db2.local.myip.com slon[3013]: [766-1] 2007-09-05  
> 19:17:33 PDT DEBUG2 remoteWorkerThread_1: SYNC 5748564 processing
> Sep  5 19:17:33 tii-db2.local.myip.com slon[3013]: [767-1] 2007-09-05  
> 19:17:33 PDT ERROR  remoteWorkerThread_1: No pa_conninfo for data  
> provider 0
> Sep  5 19:17:33 tii-db2.local.myip.com slon[3013]: [768-1] 2007-09-05  
> 19:17:33 PDT DEBUG2 localListenThread: Received event 2,1312815 SYNC
> Sep  5 19:17:35 tii-db2.local.myip.com slon[3013]: [769-1] 2007-09-05  
> 19:17:35 PDT DEBUG2 remoteListenThread_3: LISTEN
> Sep  5 19:17:35 tii-db2.local.myip.com slon[3013]: [770-1] 2007-09-05  
> 19:17:35 PDT DEBUG2 syncThread: new sl_action_seq 1 - SYNC 1312816
> Sep  5 19:17:35 tii-db2.local.myip.com slon[3013]: [771-1] 2007-09-05  
> 19:17:35 PDT DEBUG2 remoteWorkerThread_3: forward confirm 2,1312816  
> received by 3
> Sep  5 19:17:36 tii-db2.local.myip.com slon[3013]: [772-1] 2007-09-05  
> 19:17:36 PDT DEBUG2 remoteListenThread_3: queue event 3,1319207 SYNC
> Sep  5 19:17:36 tii-db2.local.myip.com slon[3013]: [773-1] 2007-09-05  
> 19:17:36 PDT DEBUG2 remoteListenThread_3: UNLISTEN
> Sep  5 19:17:36 tii-db2.local.myip.com slon[3013]: [774-1] 2007-09-05  
> 19:17:36 PDT DEBUG2 remoteWorkerThread_3: Received event 3,1319207 SYNC
> Sep  5 19:17:36 tii-db2.local.myip.com slon[3013]: [775-1] 2007-09-05  
> 19:17:36 PDT DEBUG3 calc sync size - last time: 1 last length: 3009  
> ideal: 100 proposed size: 3

Are you sure that those environment variables were set when you ran that 
script? Because the script doesn't set them and for some reason, the 
subscription points to a node 0 as data provider. There are also error 
messages that there is no conninfo for node 0 and that one DB server is 
refusing connections.

It would help to see the content of the sl_node, sl_path, sl_subscribe 
tables of all nodes.


Jan

-- 
#======================================================================#
# It's easier to get forgiveness for being wrong than for being right. #
# Let's break this rule - forgive me.                                  #
#================================================== JanWieck at Yahoo.com #


More information about the Slony1-general mailing list