**** BEGIN LOGGING AT Wed May 21 02:59:56 2008
May 21 06:44:02 * rwhitby has perltgd and toppyweb running on the qnap ts-209 ...
May 21 06:49:45 <peteru> rwhitby: Have you had a chance to test the performance of the qnap boxes?
May 21 06:50:30 <rwhitby> I've finished the copy from my external usb disk to the internal raid, so I can do some experiments now.
May 21 06:50:55 <rwhitby> do you want iozone3 or bonnie++ or something else?
May 21 06:52:12 <rwhitby> or hdparm?
May 21 06:53:25 <rwhitby> [/share/MD0_DATA] # hdparm -t -T /dev/md0
May 21 06:53:25 <rwhitby> /dev/md0:
May 21 06:53:25 <rwhitby>  Timing cached reads:   288 MB in  2.01 seconds = 143.53 MB/sec
May 21 06:53:27 <rwhitby>  Timing buffered disk reads:   98 MB in  3.03 seconds =  32.29 MB/sec
May 21 06:53:42 <rwhitby> that's with some slow old 120GB disks
May 21 06:53:44 <rwhitby> raid1
May 21 06:53:58 <rwhitby> (on the ts409)
May 21 06:54:04 <rwhitby> on the ts209 it's better:
May 21 06:54:05 <rwhitby> [/opt/lib] # hdparm -tT /dev/md0
May 21 06:54:06 <rwhitby> /dev/md0:
May 21 06:54:06 <rwhitby>  Timing cached reads:   280 MB in  2.00 seconds = 140.00 MB/sec
May 21 06:54:06 <rwhitby>  Timing buffered disk reads:  136 MB in  3.05 seconds =  44.59 MB/sec
May 21 06:54:29 <rwhitby> that's with two WD 750GB GreenPower disks in a RAID1 configuration
May 21 07:31:09 <peteru> OK, the disk io is going to be fine I guess. It's not fast, but it doesn't suck completely.
May 21 07:31:49 <rwhitby> Note that the guy at MSY said the GreenPower disks are only 5400RPM ...
May 21 07:32:01 <rwhitby> (I bought them for quietness and low power, not for speed)
May 21 07:33:32 <peteru> The cached speeds are only about 1/8 of my desktop (no idea how they compare to the slug), but the buffered disk reads are good at about 1/2 speed of a desktop machine.
May 21 07:34:14 <peteru> I am really interested in SMB speeds (reads and writes of large files) as well as NFS performance and rsync performance.
May 21 07:35:16 <peteru> I'm interested in configuring one of these as the NIS/NFS/SMB server for "shared" data and as a rsync backup server for the rest of my data.
May 21 07:36:36 <peteru> I found that the slug just can not handle 3 or more users trying to pull video, music and data at the same time.
May 21 07:38:11 <peteru> I had to move to a dual P3 @ 600MHz with 1GB RAM, because that's the only other unused system I had. But, with 8 * 15k UltraSCSI drives, it's very hot and noisy.
May 21 07:39:01 <peteru> I'd much rather have something like a 4 or 5 bay NAS box with WD 1TB green power drives.
May 21 07:40:52 <peteru> rwhitby: No need to run any sophisticated benchmarks. See what kind of data rates you get when transferring a few GB worth of recordings in each direction. Then, if you can, see how well it deals with 5+ concurrent transfers from a few different machines.
May 21 07:41:26 <peteru> SMB is most likely to be the slowest, but if you can get a mix of SMB and NFS tests, that would be great.
May 21 13:26:32 <peteru> It would be handy if we could get prl onto #openwiz, so that troubleshooting can become a bit more interactive.
May 21 13:26:44 <Yuv422> :)
May 21 13:26:51 <tonymy01> yes
May 21 13:27:04 <tonymy01> i pm'd him today to suggest he join
May 21 13:27:34 <tonymy01> I am editing my posts on that thread, hang on and don't post
May 21 13:27:49 <tonymy01> I am going to combine into a whopping single post
May 21 13:28:22 <tonymy01> oops, too late
May 21 13:29:03 * Yuv422 is adding MAC addresses into his DHCP server
May 21 13:29:12 <Yuv422> I'm sick of them sliding around
May 21 13:29:39 <tonymy01> yeah, added dnsmasq on my slug so i can control dhcp ip addresses a bit better
May 21 13:29:54 <tonymy01> my asus router didn't let me assign fixed dhcp
May 21 13:33:10 <peteru> Too late ;-) I was busy banging out the details of what's going on.
May 21 13:35:08 <tonymy01> that is ok, i will just zero out my 2nd post
May 21 13:37:49 <tonymy01> peter, you didn't mod or change linux.bin.gz in that trial run did you?
May 21 13:39:28 <peteru> Nope, no changes at all. A straight unpack followed by pack followed by pack again.
May 21 13:39:40 <peteru> Second pack fails
May 21 13:40:03 <tonymy01> ahh, you use -g, I do not.
May 21 13:40:25 <tonymy01> also you use subdirectories, i will have to test that now
May 21 13:41:20 <peteru> I noticed that the repack is reporting that it is smaller than the original BWiz release .wrp file
May 21 13:41:56 <tonymy01> maybe gzip is giving different behaviour to the internal zip
May 21 13:42:35 <peteru> wrp_hdrs.pl DPP1_Firmware_08May2008_ver_01.05.235.wrp gives fsSize: 8024560, spaceRemaining: 35840
May 21 13:43:16 <peteru> wrp_hdrs.pl 01.05.235_repack.wrp gives fsSize: 8012656, spaceRemaining: 48128
May 21 13:43:47 <peteru> So, my repack should be "safer" in terms of overrunning the available space.
May 21 13:43:51 <tonymy01> did you do the maths to work that out?
May 21 13:44:20 <tonymy01> yeah, the "spare" space I have been mistaking for "free space"
May 21 13:45:05 <tonymy01> I think spare space is just some zeroed out space in the original linux.bin.gz that he merges the zipped rootfs into
May 21 13:45:20 <tonymy01> so he doesn't create a linux.bin.gz from scratch
May 21 13:45:43 <tonymy01> I should read the documentation again :-)
May 21 13:46:45 <tonymy01> ok, my version of wrp_hdrs.pl does not give the spare space... we have some version control issues here
May 21 13:47:26 <tonymy01> sorry, I should be 100% accurate "spaceRemaining".
May 21 13:48:36 <tonymy01> At revision 6.
May 21 13:48:43 <tonymy01> (svn up bwfwtools)
May 21 13:49:02 <tonymy01> svn up wizfwtools
May 21 13:49:02 <tonymy01> At revision 14.
May 21 13:49:15 <tonymy01> so now this is huh huh?
May 21 13:51:36 <Yuv422> I'm off now
May 21 13:51:38 <Yuv422> cya
May 21 13:53:37 <peteru> I just edited my post with more details
May 21 13:53:43 <tonymy01> okies
May 21 13:53:55 <peteru> It's all done against DP-P1 firmware
May 21 13:53:58 <tonymy01> would be nice if the perl tools reported a version with -v
May 21 13:54:09 <tonymy01> yes, mine is done against a P1 for the purposes of that last post
May 21 13:54:18 <peteru> It'll be interesting to compare your results
May 21 13:54:52 <tonymy01> Peter, did you manually calculate "spaceRemaining"?
May 21 13:54:58 <tonymy01> I am not getting that at all?
May 21 13:55:30 <peteru> Nope, I use the svn versions and they print all that info.
May 21 13:55:43 <tonymy01> so am i... well, i thought I was
May 21 13:55:59 <peteru> Don't forget to "make install"
May 21 13:56:05 <tonymy01> unless i am missing something obvious?
May 21 13:56:09 <tonymy01> i did do a make install
May 21 13:56:21 <tonymy01> puts all the scripts into usr/local/bin
May 21 13:56:51 <peteru> $ which wrp_hdrs.pl
May 21 13:56:51 <peteru> /usr/local/bin/wrp_hdrs.pl
May 21 13:57:11 <tonymy01> yep, same
May 21 13:57:41 <tonymy01> so perhaps svn up hasn't quite behaved as i expected it should?
May 21 13:57:50 <peteru> $ svn info bwfwtools
May 21 13:57:50 <peteru> Path: bwfwtools
May 21 13:57:50 <peteru> URL: https://svn.openwiz.org/svnroot/bwfwtools/trunk
May 21 13:57:50 <peteru> Repository Root: https://svn.openwiz.org/svnroot/bwfwtools
May 21 13:57:50 <peteru> Repository UUID: 5cc84b85-4ba4-46ca-96ab-ff460a2395ad
May 21 13:57:51 <peteru> Revision: 6
May 21 13:57:53 <peteru> Node Kind: directory
May 21 13:57:55 <peteru> Schedule: normal
May 21 13:57:57 <peteru> Last Changed Author: rwhitby
May 21 13:57:59 <peteru> Last Changed Rev: 5
May 21 13:58:01 <peteru> Last Changed Date: 2008-03-21 18:52:29 +1100 (Fri, 21 Mar 2008)
May 21 13:58:29 <peteru> Just do "svn up bwfwtools" to make sure you have latest version.
May 21 13:58:38 <tonymy01> see above
May 21 13:58:43 <tonymy01> i did, i have
May 21 13:59:16 <tonymy01> maybe i overwrote them with an older version by typing make install?
May 21 13:59:27 <peteru> OK, then try:
May 21 13:59:46 <tonymy01> aha, there appears to be 2 direcories in my working folder
May 21 14:00:03 <tonymy01> wizfwtools, and bwfwtools
May 21 14:00:24 <peteru> make uninstall && make install
May 21 14:00:42 <tonymy01> the wizfwtools is as clean as a whistle.... I don't believe a make has been run from that directory
May 21 14:01:20 <tonymy01> i have been fiddling in the bwfwtools directorie (including doing a make install from there)
May 21 14:01:26 <tonymy01> the name must have changed at some point
May 21 14:01:39 <peteru> Two different things. bwfwtools are prl's perl hacks. wizfwtools are Eric's C programs.
May 21 14:01:54 <tonymy01> hmm, you are right
May 21 14:01:56 <tonymy01> make install
May 21 14:01:56 <tonymy01> cp wiz_unpack wiz_pack wiz_genromfs wiz_svctool /usr/local/bin
May 21 14:02:02 <tonymy01> (in wizfwtools)
May 21 14:02:10 <tonymy01> so nothing really do to in there
May 21 14:02:11 <peteru> The perl code relies on Eric's tools being installed.
May 21 14:02:43 <tonymy01> it was already done on the 17/05...
May 21 14:02:47 <tonymy01> confused then.
May 21 14:03:58 <peteru> Well, f'me sideways. I'm looking at the source code from svn and I can not see any references to "spaceRemaining"
May 21 14:04:20 <tonymy01> grep spaceRemaining *
May 21 14:04:23 <tonymy01> gives nothing
May 21 14:04:33 <peteru> Maybe I am running the version I downloaded from beyonwizsoftware.net, when I followed the original instructions from prl.
May 21 14:04:41 <tonymy01> hehe..
May 21 14:04:54 <tonymy01> so you are using the newer version
May 21 14:04:59 <tonymy01> i am using the svn version
May 21 14:05:13 <tonymy01> phew, i thought I was going nuts
May 21 14:05:31 <tonymy01> i didn't think i screwed up the svn install
May 21 14:05:33 <peteru> I hate it when people don't keep the SVN repos up to date. It is easier to do than to upload files.
May 21 14:05:57 <peteru> OK, I'll try reinstalling the svn versions and see what I get...
May 21 14:06:14 <tonymy01> eek... the newer version was meant to be better :-)
May 21 14:07:13 <tonymy01> up until very recently, peter was mainly a procrastinator, wanting to pick apart things to understant how they worked, worked on them and that was that.   I am not sure he actually tested the results in his wiz
May 21 14:08:03 <tonymy01> but noticing he gave quite detailed instructions on including telnet, and of course he would have done it once with 235 now.
May 21 14:23:34 <peteru> Well, the svn version dies with a simple repack:
May 21 14:23:49 <tonymy01> strange
May 21 14:23:54 <peteru> /tmp/flash17757 is too big to fit in BW flash memory: 15205376 > 8060928
May 21 14:24:11 <tonymy01> ahh, i got that once
May 21 14:24:17 <tonymy01> do it again
May 21 14:24:42 <tonymy01> maybe without the -g flag?
May 21 14:26:29 <tonymy01> that is the error that I got with no explanation, i thought i had a temp file in the rootfs by accident as it conveniently is almost twice the size
May 21 14:27:33 <tonymy01> i then ran the same command line again (up arror carriage return) as I didn't believe what it was telling me because i had only made a small change and i couldn't see any extra files, and the second time i ran it the result was as i expected
May 21 16:43:05 <CIA-6> openwiz: prl * r7 bwfwtools/trunk/ (18 files in 4 dirs): Updated to BWFWTools 0.1.3
May 21 17:05:49 <CIA-6> openwiz: prl bwfwtools-0.1.3 * r8 bwfwtools/: Tagging release 0.1.3
**** ENDING LOGGING AT Thu May 22 02:59:57 2008