Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Tip of master, commit 3ea6a5ea256d9047e76a4c52cec1fc1d1f81540d, built on top of libfabric commit 6ef7800daa62d5574f2d04b552e06a06c2e7af6d.

All tests run with ofi+psm2, ib0.

...

IOR, 40GB pool, data verification enabled

Code Block
linenumberstrue
collapsetrue
[sdwillso@boro-4 ~]$ orterun -x FI_PSM2_DISCONNECT=1 -N 1 --hostfile ~/hostlists/daos_client_hostlist --mca mtl ^psm2,ofi  --ompi-server file:~/scripts/uri.txt ior -v -W -i 5 -a DAOS -w -o `uuidgen` -b 5g -t 1m -- -p 651917e5-a133-4cfd-bdef-246ec2538cca -v 1 -r 1m -s 1m -c 1024 -a 16 -o LARGE
ior WARNING: assuming POSIX-based backend for DAOS statfs call.
ior WARNING: assuming POSIX-based backend for DAOS mkdir call.
ior WARNING: assuming POSIX-based backend for DAOS rmdir call.
ior WARNING: assuming POSIX-based backend for DAOS access call.
ior WARNING: assuming POSIX-based backend for DAOS stat call.
ior WARNING: assuming POSIX-based backend for DAOS statfs call.
ior WARNING: assuming POSIX-based backend for DAOS mkdir call.
ior WARNING: assuming POSIX-based backend for DAOS rmdir call.
ior WARNING: assuming POSIX-based backend for DAOS access call.
ior WARNING: assuming POSIX-based backend for DAOS stat call.
IOR-3.1.0: MPI Coordinated Test of Parallel I/O
Began               : Wed Dec 12 17:36:27 2018
Command line        : ior -v -W -i 5 -a DAOS -w -o b63b11db-1a33-4e65-9947-df60c6c3b9e3 -b 5g -t 1m -- -p 651917e5-a133-4cfd-bdef-246ec2538cca -v 1 -r 1m -s 1m -c 1024 -a 16 -o LARGE
Machine             : Linux boro-12.boro.hpdd.intel.com
Start time skew across all tasks: 2012574.16 sec
TestID              : 0
StartTime           : Wed Dec 12 17:36:27 2018
Path                : /home/sdwillso
FS                  : 3.8 TiB   Used FS: 21.4%   Inodes: 250.0 Mi   Used Inodes: 3.3%
Participating tasks: 2
[0] WARNING: USING daosStripeMax CAUSES READS TO RETURN INVALID DATA

Options: 
api                 : DAOS
apiVersion          : DAOS
test filename       : b63b11db-1a33-4e65-9947-df60c6c3b9e3
access              : single-shared-file
type                : independent
segments            : 1
ordering in a file  : sequential
ordering inter file : no tasks offsets
tasks               : 2
clients per node    : 1
repetitions         : 5
xfersize            : 1 MiB
blocksize           : 5 GiB
aggregate filesize  : 10 GiB

Results: 

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   total(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   --------   ----
Commencing write performance test: Wed Dec 12 17:36:28 2018
write     4462       5242880    1024.00    0.025802   2.25       0.020950   2.30       0   
Verifying contents of the file(s) just written.
Wed Dec 12 17:36:30 2018

remove    -          -          -          -          -          -          0.044125   0   
Commencing write performance test: Wed Dec 12 17:36:36 2018
write     4580       5242880    1024.00    0.024041   2.19       0.021696   2.24       1   
Verifying contents of the file(s) just written.
Wed Dec 12 17:36:39 2018

remove    -          -          -          -          -          -          0.043616   1   
Commencing write performance test: Wed Dec 12 17:36:45 2018
write     4634       5242880    1024.00    0.024201   2.16       0.021513   2.21       2   
Verifying contents of the file(s) just written.
Wed Dec 12 17:36:48 2018

remove    -          -          -          -          -          -          0.043672   2   
Commencing write performance test: Wed Dec 12 17:36:54 2018
write     4610       5242880    1024.00    0.024570   2.17       0.021707   2.22       3   
Verifying contents of the file(s) just written.
Wed Dec 12 17:36:56 2018

remove    -          -          -          -          -          -          0.043920   3   
Commencing write performance test: Wed Dec 12 17:37:02 2018
write     4521       5242880    1024.00    0.030705   2.18       0.054256   2.27       4   
Verifying contents of the file(s) just written.
Wed Dec 12 17:37:05 2018

remove    -          -          -          -          -          -          0.043630   4   
Max Write: 4633.54 MiB/sec (4858.62 MB/sec)

Summary of all tests:
Operation   Max(MiB)   Min(MiB)  Mean(MiB)     StdDev   Max(OPs)   Min(OPs)  Mean(OPs)     StdDev    Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt   blksiz    xsize aggs(MiB)   API RefNum
write        4633.54    4461.51    4561.31      62.59    4633.54    4461.51    4561.31      62.59    2.24539     0      2   1    5   0     0        1         0    0      1 5368709120  1048576   10240.0 DAOS      0
Finished            : Wed Dec 12 17:37:12 2018

daos_bench

kv-idx-update

kv-dkey-update

...