<div dir="ltr"><br><div class="gmail_extra"><br><br><div class="gmail_quote">On Fri, Jan 3, 2014 at 5:03 PM, Scott Marlowe <span dir="ltr"><<a href="mailto:scott.marlowe@gmail.com" target="_blank">scott.marlowe@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">On Thu, Jan 2, 2014 at 12:35 PM, Tory M Blue <<a href="mailto:tmblue@gmail.com">tmblue@gmail.com</a>> wrote:<br>
><br>
> Wondering what settings I need to speed this up. To do a rebuild of a db it<br>
> takes a long time, 6 hours for a singe table. No I/O issues, no load, just<br>
> slon postgres taking their sweet old time. I would like to use the resources<br>
> available to speed this up.<br>
<br>
1: How fast can you scp a file between these two boxes?<br>
2: How far apart are they / is there a lot of latency between them?<br>
3: How fast can you create a good sized file on the slave? (dd<br>
if=/etc/zero of=bigfile bs=1000000 count=1000)<br>
<br>
If they are far apart then make sure your slon daemon is running on<br>
the slave not the master. This can make a huge difference.<br>
<br>
> #sync_max_rowsize=8192<br>
<br>
Try turning this up to 32768 as well.<br></blockquote><div><br></div><div>1) Very quick , Accessing an iscsi volume I can scp the bigfile across at roughly 45MB/s, so plenty. </div><div>2) Again same segment, nothing in the way</div>
</div>3) ISCSI volume (ISCSI device is running at roughly 6GB network speed) </div><div class="gmail_extra"> [user@idb02 tmp]# time dd if=/dev/zero of=bigfile bs=1000000 count=1000</div><div class="gmail_extra">1000+0 records in</div>
<div class="gmail_extra">1000+0 records out</div><div class="gmail_extra">1000000000 bytes (1.0 GB) copied, 1.52658 s, 655 MB/s</div><div class="gmail_extra"><br></div><div class="gmail_extra">real<span class="" style="white-space:pre"> </span>0m1.529s</div>
<div class="gmail_extra">user<span class="" style="white-space:pre"> </span>0m0.002s</div><div class="gmail_extra">sys<span class="" style="white-space:pre"> </span>0m1.526s</div><div class="gmail_extra"><br></div><div class="gmail_extra">
"Slon daemon is running on the slave not the master", ummm I'm running the slon daemon on all of my DB's (master/Slave, QuerySlave1, QuerySlave2)</div><div class="gmail_extra"><br></div><div class="gmail_extra">
slon $CLS_CLUSTER -f /data/pgsql/slon.conf "dbname=$ADMCLSDB user=$SUPERUSER host=$SLAVEHOST" 2>&1 > /data/logs/slon.log &<br></div><div class="gmail_extra"><br></div><div class="gmail_extra">I'll give the sync_max_rowsize a check as well</div>
<div class="gmail_extra"><br></div><div class="gmail_extra">Thanks again</div><div class="gmail_extra"><br></div><div class="gmail_extra">Tory</div></div>