====== benches http ======
* [[http://faban.sunsource.net/|faban]]
* [[http://blog.planet-work.com/2009/03/bien-mesurer-les-performances-dun-serveur/|Bien mesurer les performances d’un serveur]]
* [[reserve:bibcmi#juin_08_pb_perfs_acces_web|tests pour bibcmi]]
====== HPC Challenge ======
* [[http://www.cs.utk.edu/~luszczek/pubs/hpcc-challenge-intro.pdf|HPCC Benchmark Suite]]
* [[http://browalle.ujf-grenoble.fr:8080/Cluster/tests/hpcc?set_language=fr&cl=fr|Installation et tests du cluster avec hpcc]]
sur nemo:
> pwd
/local/apps/src/hpcc-1.3.1
> diff hpl/setup/Make.Sun hpl/Make.solaris_amd64
170,171c170,171
< CCNOOPT = -xarch=v9b
< CCFLAGS = -fast -xarch=v9b
---
> CCNOOPT = $(HPL_DEFS) -xtarget=opteron -m64
> CCFLAGS = $(HPL_DEFS) -fast -xtarget=opteron -m64
177c177
< LINKFLAGS = -fast -xarch=v9b
---
> LINKFLAGS = -fast -xtarget=opteron -m64
> make arch=solaris_amd64 | & tee MAKE.LOG
> file hpcc
hpcc: ELF 64-bit LSB executable AMD64 Version 1 [SSE2 SSE FXSR AMD_3DNow CMOV FPU], dynamically linked, not stripped
====== I/O disque ======
mais à travers le réseau (montage NFS)
===== sur le compte 2530 =====
/usr/bin/time -p dd if=/dev/zero of=temp.txt bs=1024k count=128
128+0 records in
128+0 records out
real 13,75
user 0,00
sys 0,90
===== sur le compte snap =====
/usr/bin/time -p dd if=/dev/zero of=temp.dat bs=1024k count=128
scrold-henry% /usr/bin/time -p dd if=/dev/zero of=/snap_server/adminreseau/henry/temp.dat bs=1024k count=128
128+0 records in
128+0 records out
real 11,96
user 0,00
sys 1,08
===== Lecture sur le montage du 2530 =====
/usr/bin/time -p dd if=temp.dat of=/dev/null bs=1024k count=128
scrold-henry% /usr/bin/time -p dd if=temp.txt of=/dev/null bs=1024k count=128
128+0 records in
128+0 records out
real 13,20
user 0,00
sys 1,52
===== sur le snap =====
scrold-henry% /usr/bin/time -p dd if=temp.txt of=/dev/null bs=1024k count=128
128+0 records in
128+0 records out
real 11,46
user 0,00
sys 1,40
====== benches zfs ======
déplace un répertoire d'une partition zfs sur une partition zfs.
\\
Valeur max:
capacity operations bandwidth
pool used avail read write read write
------------ ----- ----- ----- ----- ----- -----
data 36,9G 9,39G 0 216 292 2,42M
mirror 36,9G 9,39G 0 216 292 2,42M
c0t0d0s5 - - 0 74 12,2K 2,43M
c0t1d0s5 - - 0 74 0 2,43M
------------ ----- ----- ----- ----- ----- -----
Les données sont tarrées et compressés (bzip2) puis envoyées sur la partiton zfs par nfs.
\\
Valeur max
capacity operations bandwidth
pool used avail read write read write
---------- ----- ----- ----- ----- ----- -----
donnees 253G 287G 0 25 0 406K
c3t1d0 253G 287G 0 25 0 406K
---------- ----- ----- ----- ----- ----- -----
====== benches openssl ======
* [[http://milek.blogspot.com/2007/09/software-crypto-performance.html|Software Crypto Performance]]
résultats:
[[reserve:calypso]]
calypso-henry% /usr/sfw/bin/openssl speed rsa1024 -engine pkcs11 -multi 8
...
OpenSSL 0.9.7d 17 Mar 2004 (+ security patches to 2006-09-29)
built on: date not available
options:bn(64,32) md2(int) rc4(ptr,char) des(ptr,risc1,16,long) aes(partial) blowfish(ptr)
compiler: information not available
available timing options: TIMES TIMEB HZ=100 [sysconf value]
timing function used:
sign verify sign/s verify/s
rsa 1024 bits 0.0016s 0.0003s 637.1 3320.3
[[reserve:t2000]]
t2000-root% /usr/sfw/bin/openssl speed rsa1024 -engine pkcs11 -multi 8
...
OpenSSL 0.9.7d 17 Mar 2004 (+ security patches to 2006-09-29)
built on: date not available
options:bn(64,32) md2(int) rc4(ptr,char) des(ptr,risc1,16,long) aes(partial) blowfish(ptr)
compiler: information not available
available timing options: TIMES TIMEB HZ=100 [sysconf value]
timing function used:
sign verify sign/s verify/s
rsa 1024 bits 0.0002s 0.0001s 6497.5 15292.9
[[reserve:nemo]]
nemo-henry% /usr/sfw/bin/openssl speed rsa1024 -engine pkcs11 -multi 8
...
OpenSSL 0.9.7d 17 Mar 2004
built on: date not available
options:bn(64,32) md2(int) rc4(ptr,char) des(ptr,cisc,16,long) aes(partial) blowfish(ptr)
compiler: information not available
available timing options: TIMES TIMEB HZ=100 [sysconf value]
timing function used:
sign verify sign/s verify/s
rsa 1024 bits 0.0006s 0.0000s 1664.8 22637.2
====== amélioration transfert entre les t2000 ======
* [[http://blogs.sun.com/janp/entry/speeding_up_ssh_data_transfer|Speeding up SSH data transfer on Niagara machines]]
\\
Transfert de 54Mo:
sans réglage
real 37,70
user 32,62
sys 2,16
\\
avec Cipher blowfish, idem
\\
avec :
ndd -set /dev/tcp tcp_xmit_hiwat 131072
ndd -set /dev/tcp tcp_recv_hiwat 131072
(anciennes valeurs: 49152)
real 32,87
user 32,78
sys 1,81
====== Anciennes notes ======
17 avril 07 transfert mails entre v120 et t2000
gyptis-root% df -hF ufs
Filesystem size used avail capacity Mounted on
/dev/md/dsk/d4 18G 11G 7.1G 60% /var/mail
/usr/bin/time -p /opt/csw/bin/rsync -az -e ssh --rsync-path=/usr/pkg/bin/rsync /var/mail/ fury:/local/mail
real 7993.81
user 5077.12
sys 550.11
alors qu'avec rcp:
gyptis-root% /usr/bin/time -p rcp -rp * root@t2000:/zones/mail
rcp: unknown host
real 1247.44
user 0.06
sys 223.47
16 mar 07 transfert scr snap, par nfsd
scr-root% du -sh ~ghenry
441M /home/ghenry
scr-root% /usr/bin/time -p rsync -az ~ghenry/ /net/snap/SHARE1/ghenry
real 142.14
user 105.78
sys 51.18
scr-root% mount snap:/shares /mnt
nfs mount: snap:/shares: Permission denied
scr-root% mount snap:/shares/SHARE1 /mnt
nfs mount: snap:/shares/SHARE1: Permission denied
scr-root% /usr/bin/time -p rsync -az ~henry/ /net/snap/SHARE1/henry
rsync: recv_generator: failed to stat "/net/snap/SHARE1/henry/projects/tests/petsc/petsc/ksp/SCCS/p.ex1.c": Permission denied (13)
rsync: recv_generator: failed to stat "/net/snap/SHARE1/henry/projects/tests/petsc/petsc/ksp/SCCS/p.ex23.c": Permission denied (13)
rsync: recv_generator: failed to stat "/net/snap/SHARE1/henry/projects/tests/petsc/petsc/ksp/SCCS/s.ex1.c": Permission denied (13)
rsync: recv_generator: failed to stat "/net/snap/SHARE1/henry/projects/tests/petsc/petsc/ksp/SCCS/s.ex23.c": Permission denied (13)
rsync error: some files could not be transferred (code 23) at main.c(977) [sender=2.6.9]
real 1284.12
user 735.81
sys 415.47
9 feb 07 entre gyptis et fury
real 19194.35
user 7290.95
sys 760.67
pour 17Go environ!
5 feb 07 bench reseau entre fury et t2000
fury-henry% ./test.sh t2000
Bytes Real s CPU s Real-MBit/s CPU-MBit/s Calls Real-C/s CPU-C/s
l 8388608 0.24 0.07 282.4756 911.0378 2059 8666.77 27952.0
1 8388608 0.24 0.23 281.8895 288.4108 2048 8602.58 8801.6
l 8388608 0.18 0.06 378.4790 1171.6342 2048 11550.26 35755.4
1 8388608 0.18 0.07 375.5435 985.0698 2415 13514.42 35449.0
t2000-henry% ./test.sh fury
Bytes Real s CPU s Real-MBit/s CPU-MBit/s Calls Real-C/s CPU-C/s
l 8388608 0.18 0.07 375.4132 979.1768 2407 13464.98 35120.2
1 8388608 0.18 0.06 376.0527 1151.5300 2048 11476.22 35141.9
l 8388608 0.24 0.24 282.7470 285.0323 2048 8628.75 8698.5
1 8388608 0.24 0.07 282.7732 947.5040 2053 8650.62 28986.1
bench reseau entre slatp et shrek a travers le switchHP
shrek:~/projects/nttcp-1.47> sh /home/henry/scripts/test-netperf.sh slatp
10:111.30
100:940.03
300:938.91
500:940.66
700:940.38
900:870.92
1100:527.94
1300:543.03
1400:544.21
slatp:~/projects/nttcp-1.47> sh /home/henry/scripts/test-netperf.sh shrek
10:81.17
100:546.21
300:545.03
500:546.09
700:859.94
900:940.98
1100:940.54
1300:940.77
1400:941.35
4 feb 06 rsync entre 2 t2000!
sent 1495246542 bytes received 2923894 bytes 513511.72 bytes/sec
total size is 3425260550 speedup is 2.29
500ko/s!!! bizarre...
un autre essai plus tard:
sent 4732928152 bytes received 2256576 bytes 1278915.52 bytes/sec
total size is 6216110754 speedup is 1.31
real 3703.74
user 3958.66
sys 224.80
26 jan 06 transfert disques pc shrek
shrek:~# time rsync -az /tmp/old/local/ /local
real 40m28.464s
user 27m18.083s
sys 2m2.769s
pour 17Go
5 jan 06 liens de benches
sun liste des benchmarks ici:
Free, Fair, & Open Benchmarking
http://www.opensolaris.org/jive/thread.jspa?messageID=71017
iozone
http://blogs.sun.com/dom/entry/filesystem_benchmarks_iozone
A ne pas faire:
http://www.unixadmintalk.com/f35/raid-5-svm-performance-1837/
16 juin 03 blast (bioinfo) sur serengheti et sur un pc linux
archive adaboost.tar.gz
sur serengheti:
cd /local/users/henry
mkdir adaboost
tar xzf ../adaboost.tar.gz
make clean
make correction_dom
make proteome_apprent_ce
make proteome_valid_ce
make buildquery
make profil0
Temps mis pour l'execution de la derniere commande: 1h40mn environ
real 5340.69 user 4142.3 sys 712.53
Attention:
dans adaboost.tar.gz, il manque formatdb et blastpgp
le fichier makefie utilise dans les 2 cas est makefile_serengheti
dans le makefile, il faut faire mkdir -p au lieu de mkdir
il manque un mkdir dans ???