Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Verify performance of libpil4dfs

Description

Need to verify the performance of ,

PR

This can be done on Frontera by running the performance suite and comparing DFS vs libpil4dfs

Attachments

3

Activity

Show:

Dalton Bohning June 7, 2023 at 5:13 PM

Reviewed in Performance WG 2023-06-07. Results are acceptable.

LEI HUANG June 6, 2023 at 3:58 PM

Understood. A few percent performance drop are reasonable to me. They are comparable to the noise level of the measurements.

Dalton Bohning June 6, 2023 at 3:47 PM
Edited

The tests run with a stonewall of 60s. E.g. IOR Write for 60s, then IOR Read the same amount of data. And we can’t run for more than 60s on Frontera due to space constraints

LEI HUANG June 6, 2023 at 3:44 PM
Edited

How long your tests normally run? It is common to see a few percent performance drop if the time of tests is less than one minute. daos_init() is called at the first time to access files/dirs on DFS in IL. This call is expensive. The effect of calling daos_init() should be ignorable if running time is much longer than one minute.

Dalton Bohning June 6, 2023 at 3:33 PM
Edited

To be reviewed in the next Performance WG

NOTE: Individual tests on Frontera often have up to a 10% “regression”. I usually re-run these tests, but did NOT for these. There are probably outliers in the results.

Test Case

Performance

IOR Easy - rf0

Some scales 5-10% lower than DFS

Most scales less than 5% lower than DFS

IOR Hard- rf0

Some scales 7% lower than DFS

Most read 2-5% lower than DFS

MDTest Easy - rf0

Few scales 5-10% lower than DFS

Most scales similar to DFS

MDTest Hard - rf0

Most scales similar to DFS

IOR Easy - EC

Few read 5-10% lower than DFS

Most scales similar to DFS

IOR Hard- EC

All scales similar to DFS

MDTest Easy - EC

All scales similar to DFS

MDTest Hard - EC

All scales similar to DFS

 

Done

Details

Assignee

Reporter

Priority

Affects versions

Required for Version

Fix versions

Labels

Components

Story Points

Created April 28, 2023 at 3:34 PM
Updated March 6, 2024 at 11:49 PM
Resolved June 7, 2023 at 5:13 PM