benches

benches http

HPC Challenge

sur nemo:

> pwd
/local/apps/src/hpcc-1.3.1
> diff hpl/setup/Make.Sun hpl/Make.solaris_amd64 
170,171c170,171
< CCNOOPT      = -xarch=v9b
< CCFLAGS      = -fast -xarch=v9b
---
> CCNOOPT      = $(HPL_DEFS) -xtarget=opteron -m64
> CCFLAGS      = $(HPL_DEFS) -fast -xtarget=opteron -m64
177c177
< LINKFLAGS    = -fast -xarch=v9b
---
> LINKFLAGS    = -fast -xtarget=opteron -m64
> make arch=solaris_amd64 | & tee MAKE.LOG
> file hpcc
hpcc:           ELF 64-bit LSB executable AMD64 Version 1 [SSE2 SSE FXSR AMD_3DNow CMOV FPU], dynamically linked, not stripped

I/O disque

mais à travers le réseau (montage NFS)

/usr/bin/time -p dd if=/dev/zero of=temp.txt bs=1024k count=128
128+0 records in
128+0 records out

real 13,75
user 0,00
sys 0,90
/usr/bin/time -p dd if=/dev/zero of=temp.dat bs=1024k count=128
scrold-henry% /usr/bin/time -p dd if=/dev/zero of=/snap_server/adminreseau/henry/temp.dat bs=1024k count=128
128+0 records in
128+0 records out

real 11,96
user 0,00
sys 1,08
/usr/bin/time -p dd if=temp.dat of=/dev/null bs=1024k count=128
scrold-henry% /usr/bin/time -p dd if=temp.txt of=/dev/null bs=1024k count=128
128+0 records in
128+0 records out

real 13,20
user 0,00
sys 1,52
scrold-henry% /usr/bin/time -p dd if=temp.txt of=/dev/null bs=1024k count=128
128+0 records in
128+0 records out

real 11,46
user 0,00
sys 1,40

benches zfs

déplace un répertoire d'une partition zfs sur une partition zfs.
Valeur max:

                 capacity     operations    bandwidth
pool           used  avail   read  write   read  write
------------  -----  -----  -----  -----  -----  -----
data          36,9G  9,39G      0    216    292  2,42M
  mirror      36,9G  9,39G      0    216    292  2,42M
    c0t0d0s5      -      -      0     74  12,2K  2,43M
    c0t1d0s5      -      -      0     74      0  2,43M
------------  -----  -----  -----  -----  -----  -----

Les données sont tarrées et compressés (bzip2) puis envoyées sur la partiton zfs par nfs.
Valeur max

               capacity     operations    bandwidth
pool         used  avail   read  write   read  write
----------  -----  -----  -----  -----  -----  -----
donnees      253G   287G      0     25      0   406K
  c3t1d0     253G   287G      0     25      0   406K
----------  -----  -----  -----  -----  -----  -----

benches openssl

résultats: calypso

calypso-henry% /usr/sfw/bin/openssl speed rsa1024 -engine pkcs11 -multi 8
...
OpenSSL 0.9.7d 17 Mar 2004 (+ security patches to 2006-09-29)
built on: date not available
options:bn(64,32) md2(int) rc4(ptr,char) des(ptr,risc1,16,long) aes(partial) blowfish(ptr)
compiler: information not available
available timing options: TIMES TIMEB HZ=100 [sysconf value]
timing function used:
                  sign    verify    sign/s verify/s
rsa 1024 bits   0.0016s   0.0003s    637.1   3320.3

t2000

t2000-root% /usr/sfw/bin/openssl speed rsa1024 -engine pkcs11 -multi 8
...
OpenSSL 0.9.7d 17 Mar 2004 (+ security patches to 2006-09-29)
built on: date not available
options:bn(64,32) md2(int) rc4(ptr,char) des(ptr,risc1,16,long) aes(partial) blowfish(ptr)
compiler: information not available
available timing options: TIMES TIMEB HZ=100 [sysconf value]
timing function used:
                  sign    verify    sign/s verify/s
rsa 1024 bits   0.0002s   0.0001s   6497.5  15292.9

nemo

nemo-henry% /usr/sfw/bin/openssl speed rsa1024 -engine pkcs11 -multi 8
...
OpenSSL 0.9.7d 17 Mar 2004
built on: date not available
options:bn(64,32) md2(int) rc4(ptr,char) des(ptr,cisc,16,long) aes(partial) blowfish(ptr)
compiler: information not available
available timing options: TIMES TIMEB HZ=100 [sysconf value]
timing function used:
                  sign    verify    sign/s verify/s
rsa 1024 bits   0.0006s   0.0000s   1664.8  22637.2

amélioration transfert entre les t2000


Transfert de 54Mo: sans réglage real 37,70 user 32,62 sys 2,16
avec Cipher blowfish, idem
avec :

ndd -set /dev/tcp tcp_xmit_hiwat 131072
ndd -set /dev/tcp tcp_recv_hiwat 131072

(anciennes valeurs: 49152) real 32,87 user 32,78 sys 1,81

Anciennes notes

17 avril 07 transfert mails entre v120 et t2000
gyptis-root% df -hF ufs
Filesystem             size   used  avail capacity  Mounted on
/dev/md/dsk/d4          18G    11G   7.1G    60%    /var/mail

/usr/bin/time -p /opt/csw/bin/rsync -az -e ssh --rsync-path=/usr/pkg/bin/rsync /var/mail/ fury:/local/mail
real 7993.81
user 5077.12
sys 550.11

alors qu'avec rcp:
gyptis-root% /usr/bin/time -p rcp -rp * root@t2000:/zones/mail
rcp: unknown host

real 1247.44
user 0.06
sys 223.47


16 mar 07 transfert scr snap, par nfsd
scr-root% du -sh ~ghenry
 441M   /home/ghenry
scr-root% /usr/bin/time -p  rsync -az ~ghenry/ /net/snap/SHARE1/ghenry

real 142.14
user 105.78
sys 51.18

scr-root% mount snap:/shares /mnt
nfs mount: snap:/shares: Permission denied
scr-root% mount snap:/shares/SHARE1 /mnt
nfs mount: snap:/shares/SHARE1: Permission denied
scr-root% /usr/bin/time -p  rsync -az ~henry/ /net/snap/SHARE1/henry
rsync: recv_generator: failed to stat "/net/snap/SHARE1/henry/projects/tests/petsc/petsc/ksp/SCCS/p.ex1.c": Permission denied (13)
rsync: recv_generator: failed to stat "/net/snap/SHARE1/henry/projects/tests/petsc/petsc/ksp/SCCS/p.ex23.c": Permission denied (13)
rsync: recv_generator: failed to stat "/net/snap/SHARE1/henry/projects/tests/petsc/petsc/ksp/SCCS/s.ex1.c": Permission denied (13)
rsync: recv_generator: failed to stat "/net/snap/SHARE1/henry/projects/tests/petsc/petsc/ksp/SCCS/s.ex23.c": Permission denied (13)

rsync error: some files could not be transferred (code 23) at main.c(977) [sender=2.6.9]

real 1284.12
user 735.81
sys 415.47


9 feb 07 entre gyptis et fury
real 19194.35
user 7290.95
sys 760.67

pour 17Go environ!

5 feb 07 bench reseau entre fury et t2000
fury-henry% ./test.sh t2000
     Bytes  Real s   CPU s Real-MBit/s  CPU-MBit/s   Calls  Real-C/s   CPU-C/s
l  8388608    0.24    0.07    282.4756    911.0378    2059   8666.77   27952.0
1  8388608    0.24    0.23    281.8895    288.4108    2048   8602.58    8801.6
l  8388608    0.18    0.06    378.4790   1171.6342    2048  11550.26   35755.4
1  8388608    0.18    0.07    375.5435    985.0698    2415  13514.42   35449.0

t2000-henry% ./test.sh fury
     Bytes  Real s   CPU s Real-MBit/s  CPU-MBit/s   Calls  Real-C/s   CPU-C/s
l  8388608    0.18    0.07    375.4132    979.1768    2407  13464.98   35120.2
1  8388608    0.18    0.06    376.0527   1151.5300    2048  11476.22   35141.9
l  8388608    0.24    0.24    282.7470    285.0323    2048   8628.75    8698.5
1  8388608    0.24    0.07    282.7732    947.5040    2053   8650.62   28986.1

bench reseau entre slatp et shrek a travers le switchHP
shrek:~/projects/nttcp-1.47> sh /home/henry/scripts/test-netperf.sh slatp
10:111.30
100:940.03
300:938.91
500:940.66
700:940.38
900:870.92
1100:527.94
1300:543.03
1400:544.21

slatp:~/projects/nttcp-1.47> sh /home/henry/scripts/test-netperf.sh shrek
10:81.17
100:546.21
300:545.03
500:546.09
700:859.94
900:940.98
1100:940.54
1300:940.77
1400:941.35

4 feb 06 rsync entre 2 t2000!
sent 1495246542 bytes  received 2923894 bytes  513511.72 bytes/sec
total size is 3425260550  speedup is 2.29

500ko/s!!! bizarre...

un autre essai plus tard:
sent 4732928152 bytes  received 2256576 bytes  1278915.52 bytes/sec
total size is 6216110754  speedup is 1.31

real 3703.74

user 3958.66
sys 224.80

26 jan 06 transfert disques pc shrek
shrek:~# time rsync -az /tmp/old/local/ /local

real    40m28.464s
user    27m18.083s
sys     2m2.769s
pour 17Go

5 jan 06 liens de benches
sun liste des benchmarks ici:
Free, Fair, & Open Benchmarking
http://www.opensolaris.org/jive/thread.jspa?messageID=71017
iozone
http://blogs.sun.com/dom/entry/filesystem_benchmarks_iozone
A ne pas faire:
http://www.unixadmintalk.com/f35/raid-5-svm-performance-1837/


16 juin 03 blast (bioinfo) sur serengheti et sur un pc linux
archive adaboost.tar.gz
sur serengheti:
cd /local/users/henry
mkdir adaboost
tar xzf ../adaboost.tar.gz
make clean
make correction_dom
make proteome_apprent_ce
make proteome_valid_ce
make buildquery
make profil0
Temps mis pour l'execution de la derniere commande: 1h40mn environ
real 5340.69 user 4142.3 sys 712.53

Attention:
dans adaboost.tar.gz, il manque formatdb et blastpgp
le fichier makefie utilise dans les 2 cas est makefile_serengheti
dans le makefile, il faut faire mkdir -p au lieu de mkdir
il manque un mkdir dans ???
  • benches.txt
  • Dernière modification: 2017/08/25 09:56
  • (modification externe)