...
Run with 4 DAOS ranks server, rank-rebuild with dfuse_io and mpirun_ior
...
Environment variables setup
| Code Block | ||
|---|---|---|
| ||
export SERVER_NODES=node-1,node-2,node-3,node-4
export ADMIN_NODE=node-5
export CLIENT_NODE=node-5
export ALL_NODES=$SERVER_NODES,$CLIENT_NODE |
| No Format |
|---|
# After DAOS servers and DAOS admin and client RPMs loaded
$ dmg storage format
Format Summary:
Hosts SCM Devices NVMe Devices
----- ----------- ------------
boro-[8,35,52-53] 1 0
$ dmg system query --verbose
Rank UUID Control Address Fault Domain State Reason
---- ---- --------------- ------------ ----- ------
0 739347b0-7db0-49a3-998f-acad65ff4615 10.7.1.8:10001 /boro-8.boro.hpdd.intel.com Joined
1 7273aded-e590-4028-8e85-9ea1ab42d411 10.7.1.52:10001 /boro-52.boro.hpdd.intel.com Joined
2 d7ea954a-34e4-4671-bcde-047b26626fb4 10.7.1.53:10001 /boro-53.boro.hpdd.intel.com Joined
3 e2772010-c587-4d33-b5a7-8b5edbc36011 10.7.1.35:10001 /boro-35.boro.hpdd.intel.com Joined
$ dmg pool create --size=5G
Creating DAOS pool with automatic storage allocation: 5.0 GB NVMe + 6.00% SCM
Pool created with 100.00% SCM/NVMe ratio
-----------------------------------------
UUID : 733bee7b-c2af-499e-99dd-313b1ef092a9
Service Ranks : [1-3]
Storage Ranks : [0-3]
Total Size : 5.0 GB
SCM : 5.0 GB (1.3 GB / rank)
NVMe : 0 B (0 B / rank)
$ dmg pool list
Pool UUID Svc Replicas
--------- ------------
733bee7b-c2af-499e-99dd-313b1ef092a9 [1-3]
$ daos cont create --pool=$DAOS_POOL --type=POSIX --oclass=RP_3G1 --properties=rf:2
Successfully created container 2649aa0f-3ad7-4943-abf5-4343205a637b
$ daos pool list-cont --pool=$DAOS_POOL
2649aa0f-3ad7-4943-abf5-4343205a637b
$ dmg pool query --pool=733bee7b-c2af-499e-99dd-313b1ef092a9
Pool 733bee7b-c2af-499e-99dd-313b1ef092a9, ntarget=32, disabled=0, leader=2, version=1
Pool space info:
- Target(VOS) count:32
- SCM:
Total size: 5.0 GB
Free: 5.0 GB, min:156 MB, max:156 MB, mean:156 MB
- NVMe:
Total size: 0 B
Free: 0 B, min:0 B, max:0 B, mean:0 B
Rebuild idle, 0 objs, 0 recs
|
...