Introduction

...

ior and mdtest along with some examples of how to move data between a POSIX file system and daos containers (and vise versa) and finally cleaning up your daos setup.

Requirements

The quick start requires a minimum of 2 servers each with PMEM and SSDs connected via infiniband storage network and 2 client nodes without pmem/ssd but on the infiniband storage network.  All nodes have a base openSUSE or SLES 15.2 installed.

Requirements

Set environment variables for list of servers, clients and admin node.

...

...

• sudo access configured
• password-less ssh configured
• pdsh installed (or some other means of running multiple remote commands in parallel)

In addition the server nodes should also have:

• an InfiniBand network adapter configured
• one or more NVMe devices
• IOMMU is enabled https://daos-stack.github.io/admin/predeployment_check/#enable-iommu-optional

For the use of the commands outlined on this page the following shell variables will need to be defined:

• ADMIN_NODE
• CLIENT_NODES
• SERVER_NODES
• ALL_NODES

For example, if one wanted to use node-1 as their admin node, node-2 and node-3 as client nodes, and node-[4-6] as their server nodes then these variables would be defined as:

ADMIN_NODE=node-1
export SERVERCLIENT_NODES=node-2,node-3
export CLIENTSERVER_NODES=node-4,node-5,node-6
export ALL_NODES=$ADMIN_NODE,$SERVER$CLIENT_NODES,$CLIENT$SERVER_NODES

All nodes have openSUSE/SLES 15.2  installed

Set password less ssh  all nodes

Make sure to have sudo privileges on all nodes

Enable IOMMU

If using nvme, enable IOMMU on server nodes: https://daos-stack.github.io/admin/predeployment_check/#enable-iommu-optional

Install pdsh on admin node

Set-Up

Please refer here for initial set up which consists of rpm installation, generate and set up certificates, setting up config files, starting servers and agents.

...