/
DAOS-6820 -1.2 Verbs Automated testing status

DAOS-6820 -1.2 Verbs Automated testing status

Mar 18, 2021

TestFolder 

Count

 

Result

Defect

Logs

Notes

TestFolder 

Count

 

Result

Defect

Logs

Notes

object

22

object/obj_fetch_bad_param.py:                     

PASS

 

/scratch/samirrav/verbs_Logs/object/job-2021-02-25T00.58-bd87a06-object-obj_fetch_bad_param

 

object/array_obj_test.py:                          

PASS

 

/scratch/samirrav/verbs_Logs/object/job-2021-02-25T01.12-78980dd-object-array_obj_test

 

object/obj_open_bad_param.py:                      

PASS

 

/scratch/samirrav/verbs_Logs/object/job-2021-02-25T01.08-5a3eb97-object-obj_open_bad_param

 

object/obj_update_bad_param.py:                    

PASS

 

/scratch/samirrav/verbs_Logs/object/job-2021-02-25T01.04-86e5ac7-object-obj_update_bad_param

 

object/create_many_dkeys.py:                       

PASS

 

/scratch/samirrav/verbs_Logs/object/job-2021-02-25T01.28-ed955fe-object-create_many_dkeys

Test issue. SCM size needs to be increased to the avoided space issue. Increase the size and test passed

object/object_integrity.py:                        

PASS

 

/scratch/samirrav/verbs_Logs/object/job-2021-02-25T00.39-fb0482e-object-object_integrity

 

object/same_key_different_value.py:                

PASS

 

/scratch/samirrav/verbs_Logs/object/job-2021-02-25T01.52-06b6b04-object-same_key_different_value/

Test issue. SCM size needs to be increased to the avoided space issue. Increase the size and test passed

object/punch_test.py:                              

PASS

 

/scratch/samirrav/verbs_Logs/object/job-2021-02-25T01.00-338838a-object-punch_test

 

daos_racer

1

daos_racer/daos_racer.py:                          

PASS

 

/scratch/samirrav/verbs_Logs/daos_racer/job-2021-03-13T03.34-58e3fd1-daos_racer-daos_racer/

 

NVMe

18

nvme/nvme_io_stats.py:                             

PASS

 

/scratch/samirrav/verbs_Logs/nvme/job-2021-03-02T00.00-9c46097-nvme-nvme_io_stats

 

nvme/nvme_pool_exclude.py:                         

Skipped

 

 

 

nvme/nvme_fragmentation.py:                        

PASS

 

/scratch/samirrav/verbs_Logs/nvme/job-2021-03-02T00.03-436ba66-nvme-nvme_fragmentation

 

nvme/nvme_pool_extend.py:                          

Skipped

 

 

 

nvme/nvme_object.py:                               

FAIL

 

/scratch/samirrav/verbs_Logs/nvme/job-2021-03-04T23.57-6cdf0a0-nvme-nvme_object

Single pool works fine but multiple pools fail with NO SPACE issue. looks like test issue 

to container 42B8B01A-DBCF-4328-96B1-4F0275885CE3: Object update returned non-zero. RC: -1007

nvme/nvme_health.py:                               

PASS

 

 

Used PR-4832 for fixing some regression locally

nvme/enospace.py:                                  

FAIL

 

 

Test issue and skipped in the test for PR-4832 but nothing looks from verbs side

nvme/nvme_io.py:                                   

FAIL

DAOS-7021

 

The issue with S1 object type so open new defect.

nvme/nvme_pool_capacity.py:                        

PASS

 

 

 

nvme/nvme_fault.py:                                

PASS

 

/scratch/samirrav/verbs_Logs/nvme/job-2021-03-16T20.30-5ccc5f3-nvme-nvme_fault/

With PR fixes.

server

6

server/daos_server_restart.py:                     

PASS

 

/scratch/samirrav/verbs_Logs/server/job-2021-03-04T22.55-63ef643-server-daos_server_restart

 

server/cpu_usage.py:                               

PASS

DAOS-6944

/scratch/samirrav/verbs_Logs/server/job-2021-03-11T19.11-718b938-server-cpu_usage

/scratch/samirrav/verbs_Logs/server/job-2021-03-04T21.07-c8285fd-server-cpu_usage/ 

Tried again multiple times and test passed

Looks like DAOS side issue and created new ticket

2021-03-04 21:09:29,185 cpu_usage        L0062 INFO | CPU Usage = 140.0 2021-03-04 21:09:31,187 stacktrace       L0039 ERROR| 2021-03-04 21:09:31,187 stacktrace       L0042 ERROR| Reproduced traceback from: /usr/lib/python2.7/site-packages/avocado/core/test.py:596 2021-03-04 21:09:31,212 stacktrace       L0045 ERROR| Traceback (most recent call last): 2021-03-04 21:09:31,212 stacktrace       L0045 ERROR|   File "/usr/lib/daos/TESTING/ftest/server/cpu_usage.py", line 70, in test_cpu_usage 2021-03-04 21:09:31,212 stacktrace       L0045 ERROR|     float(usage) < 100, "CPU usage is above 100%: {}%".format(usage)) 2021-03-04 21:09:31,212 stacktrace       L0045 ERROR|   File "/usr/lib64/python2.7/unittest/case.py", line 462, in assertTrue 2021-03-04 21:09:31,212 stacktrace       L0045 ERROR|     raise self.failureException(msg) 2021-03-04 21:09:31,213 stacktrace       L0045 ERROR| AssertionError: CPU usage is above 100%: 140.0%

server/metadata.py:                                

FAIL

 

/scratch/samirrav/verbs_Logs/server/job-2021-03-04T22.08-1c8c468-server-metadata

Looks like some test issue where IOR failed to write 

[stderr] [1,0]<stderr>:Failed to lookup parent dir
[stderr] [1,0]<stderr>:application called MPI_Abort(MPI_COMM_WORLD, -1) - process 0
[stderr] [1,0]<stderr>:[unset]: write_line error; fd=-1 buf=:cmd=abort exitcode=-1
[stderr] [1,0]<stderr>::
[stderr] [1,0]<stderr>:system msg for write_line failure : Bad file descriptor

server/dynamic_start_stop.py:                      

FAIL

 

/scratch/samirrav/verbs_Logs/server/job-2021-03-04T22.45-95c1519-server-dynamic_start_stop

Looks like test issue 

Command '/usr/bin/dmg -o /etc/daos/daos_control.yml -j system query --verbose' finished with 0 after 0.219604969025s
system_query data: {}
<SERVER> Verifying server states: group=daos_server, hosts=wolf-[118-119]
  Unable to obtain current server state.  Undefined expected server states due to a failure starting the servers.
Writing yaml configuration file /var/tmp/daos_testing/test_daos_server_dmg.yaml
Copying /var/tmp/daos_testing/test_daos_server_dmg.yaml yaml configuration file to /etc/daos/daos_control.yml on ['wolf-79']
Command environment vars:
  None
Running '/usr/bin/dmg -o /etc/daos/daos_control.yml -j system query --verbose'
[stdout] {
[stderr] ERROR: dmg: unable to contact the DAOS Management Service
[stdout]   "response": {
[stdout]     "members": null
[stdout]   },
[stdout]   "error": "unable to contact the DAOS Management Service",
[stdout]   "status": -1025
[stdout] }
Command '/usr/bin/dmg -o /etc/daos/daos_control.yml -j system query --verbose' finished with 1 after 0.1741938591s
Error occurred running '/usr/bin/dmg -o /etc/daos/daos_control.yml -j system query --verbose': Command '/usr/bin/dmg -o /etc/daos/daos_control.yml -j system query --verbose' failed (rc=1)

server/daos_server_config.py:                      

PASS

 

/scratch/samirrav/verbs_Logs/server/job-2021-03-04T21.36-a059137-server-daos_server_config/

 

datamover

8

datamover/dm_posix_subsets.py                    

PASS

 

/scratch/samirrav/verbs_Logs/datamover/job-2021-02-26T21.58-79d47c3-datamover-dm_posix_subsets/

 

datamover/copy_procs.py:                           

PASS

 

/scratch/samirrav/verbs_Logs/datamover/job-2021-02-26T22.01-2ec4685-datamover-copy_procs/

 

datamover/copy_negative.py:                        

FAIL

DAOS-6871

/home/samirrav/avocado/job-results/job-2021-02-26T22.07-ae336da-datamover-copy_negative

Looks like existing failure and Dalton is aware of this failure

datamover/dm_large_dir.py                       

PASS

 

/scratch/samirrav/verbs_Logs/datamover/job-2021-02-26T22.28-c6c4896-datamover-dm_large_file/

 

datamover/dm_large_file.py                 

PASS

 

/scratch/samirrav/verbs_Logs/datamover/job-2021-02-26T22.42-3c32f26-datamover-dm_large_dir

 

container

24

container/container_async.py:                      

PASS

 

/scratch/samirrav/verbs_Logs/container/job-2021-03-01T22.24-d0197f8-container-container_async

 

container/simple_create_delete_test.py:            

PASS

 

/scratch/samirrav/verbs_Logs/container/job-2021-03-01T22.27-dcc6dbe-container-simple_create_delete_test

 

container/container_check.py:                      

PASS

 

/scratch/samirrav/verbs_Logs/container/job-2021-03-01T21.55-14a152d-container-container_check/

 

 

 

container/create.py:                               

PASS

 

/scratch/samirrav/verbs_Logs/container/job-2021-03-01T22.34-46f77e9-container-create

 

container/basic_snapshot.py:        

PASS

 

/scratch/samirrav/verbs_Logs/container/job-2021-03-01T21.58-28968fb-container-basic_snapshot/

 

container/basic_tx_test.py:                        

PASS

 

/scratch/samirrav/verbs_Logs/container/job-2021-03-01T23.19-cc64c8c-container-basic_tx_test

 

container/open_close.py:                           

PASS

 

/scratch/samirrav/verbs_Logs/container/job-2021-03-01T23.17-82728b7-container-open_close

 

container/delete.py:                               

PASS

 

/scratch/samirrav/verbs_Logs/container/job-2021-03-01T22.37-3858acc-container-delete

 

container/open.py:                                 

PASS

 

/scratch/samirrav/verbs_Logs/container/job-2021-03-01T22.48-8462ad4-container-open

 

container/global_handle.py:                        

PASS

 

/scratch/samirrav/verbs_Logs/container/job-2021-03-01T22.33-779d30a-container-global_handle

 

container/full_pool_container_create.py:           

Skip

 

 

 

container/root_container_test.py:                  

PASS

 

/scratch/samirrav/verbs_Logs/container/job-2021-03-01T22.51-33ded5c-container-root_container_test

 

container/snapshot.py:                             

FAIL

DAOS-6893

/scratch/samirrav/verbs_Logs/container/job-2021-03-11T19.27-add1508-container-snapshot/

Existing issue open

Reproduced traceback from: /usr/lib/python2.7/site-packages/avocado/core/test.py:596 Traceback (most recent call last):   File "/usr/lib/daos/TESTING/ftest/container/snapshot.py", line 453, in test_snapshots     "the original data written.", ss_number) Exception: ('##(5.2)Snapshot #%s, test data Mis-matchesthe original data written.', 1)

container/multiple_container_delete.py:            

FAIL

 

/scratch/samirrav/verbs_Logs/container/job-2021-03-01T23.41-a1f4393-container-multiple_container_delete/

Test issue

Traceback (most recent call last):

  File "/usr/lib/python2.7/site-packages/avocado/core/test.py", line 667, in _run_avocado
    raise test_exception

TypeError: create_cont() takes exactly 2 arguments (1 given)

container/list_containers.py:                      

PASS

 

/scratch/samirrav/verbs_Logs/container/job-2021-03-01T23.45-16812a3-container-list_containers/

 

container/query_attribute.py:                      

PASS

 

/scratch/samirrav/verbs_Logs/container/job-2021-03-01T23.43-5c50f5f-container-query_attribute/

 

container/attribute.py:                            

PASS

 

/scratch/samirrav/verbs_Logs/container/job-2021-03-01T23.03-7e13913-container-attribute/

 

container/snapshot_aggregation.py:                 

PASS

 

/scratch/samirrav/verbs_Logs/container/job-2021-03-01T23.31-ce3d95a-container-snapshot_aggregation

 

aggregation

7

aggregation/aggregation_io_small.py:               

PASS

 

/scratch/samirrav/verbs_Logs/aggregation/job-2021-02-26T23.21-42236ee-aggregation-aggregation_io_small/

 

aggregation/aggregation_basic.py:                  

PASS

 

/scratch/samirrav/verbs_Logs/aggregation/job-2021-02-26T23.45-fd92726-aggregation-aggregation_basic

 

aggregation/aggregation_punching.py:               

PASS

 

/scratch/samirrav/verbs_Logs/aggregation/job-2021-02-26T23.27-21a327a-aggregation-aggregation_punching/

 

aggregation/aggregation_checksum.py:               

PASS

 

/scratch/samirrav/verbs_Logs/aggregation/job-2021-02-26T23.30-c5770ba-aggregation-aggregation_checksum/

 

aggregation/dfuse_space_check.py:                  

FAIL

 

/scratch/samirrav/verbs_Logs/aggregation/job-2021-02-26T23.30-c5770ba-aggregation-aggregation_checksum/

Test Issue 

TypeError: create_cont() takes exactly 2 arguments (1 given)

aggregation/aggregation_throttling.py:             

FAIL

DAOS-6897

/scratch/samirrav/Defect_logs/DAOS-6879/job-2021-02-27T00.00-aa0e5d7-aggregation-aggregation_throttling/

Looks like a test issue but could be daos issue too so open new defect

2021-02-26 23:44:36,524 aggregation_thro L0126 INFO | Max perf diff 52.0413757813 < 30.0 2021-02-26 23:44:36,524 stacktrace       L0039 ERROR| 2021-02-26 23:44:36,524 stacktrace       L0042 ERROR| Reproduced traceback from: /usr/lib/python2.7/site-packages/avocado/core/test.py:596 2021-02-26 23:44:36,545 stacktrace       L0045 ERROR| Traceback (most recent call last): 2021-02-26 23:44:36,545 stacktrace       L0045 ERROR|   File "/usr/lib/daos/TESTING/ftest/aggregation/aggregation_throttling.py", line 84, in test_aggregation_throttling 2021-02-26 23:44:36,546 stacktrace       L0045 ERROR|     expected_perf_diff) 2021-02-26 23:44:36,546 stacktrace       L0045 ERROR|   File "/usr/lib/daos/TESTING/ftest/aggregation/aggregation_throttling.py", line 127, in verify_performance 2021-02-26 23:44:36,546 stacktrace       L0045 ERROR|     self.assertTrue(max_perf_diff < expected_perf_diff) 2021-02-26 23:44:36,546 stacktrace       L0045 ERROR|   File "/usr/lib64/python2.7/unittest/case.py", line 462, in assertTrue 2021-02-26 23:44:36,546 stacktrace       L0045 ERROR|     raise self.failureException(msg) 2021-02-26 23:44:36,546 stacktrace       L0045 ERROR| AssertionError: False is not true

control

22

control/dmg_storage_query.py:                      

PASS

 

/scratch/samirrav/verbs_Logs/control/job-2021-02-27T00.47-5d9010a-control-dmg_storage_query

 

control/dmg_system_reformat.py:                    

Skipped

 

 

 

control/daos_agent_config.py:                      

PASS

 

/scratch/samirrav/verbs_Logs/control/job-2021-02-27T00.36-c2e0b52-control-daos_agent_config

 

control/dmg_storage_scan_scm.py:                   

PASS

 

/scratch/samirrav/verbs_Logs/control/job-2021-02-27T00.55-4a5c8ca-control-dmg_storage_scan_scm

 

control/super_block_versioning.py:                 

PASS

 

/scratch/samirrav/verbs_Logs/control/job-2021-02-27T00.34-8c21687-control-super_block_versioning/

 

control/daos_control_config.py:                    

PASS

 

/scratch/samirrav/verbs_Logs/control/job-2021-02-27T00.42-2ada17a-control-daos_control_config

 

control/dmg_network_scan.py:                       

FAIL

 

/scratch/samirrav/verbs_Logs/control/job-2021-02-27T00.32-a4dbc32-control-dmg_network_scan

Test issue Server is trying to start on client

"Failed to start servers before format: Error occurred running 'sudo -n systemctl enable daos_server.service' on wolf-79",