Test Scenarios for Layers - Create and List Functionality & Layer Detection

[bhanvimenghani]

Create Layer

Positive Scenarios

1. Create Layer with bounded tunables, categorical tunables & mixed tunables (both bounded and categorical)
2. Create layer with presence='always'
3. Create layer with queries
4. Create layer with label
5. Create layer with minimum required fields

Negative Scenarios
A. Mandatory fields Missing/NULL/Empty

1. Missing metadata
2. Null metadata.name
3. Empty metadata.name
4. Missing layer_name
5. Null layer_name
6. Empty layer_name
7. Missing layer_presence
8. Null layer_presence
9. Missing tunables
10. Null tunables
11. Empty tunables array

B. Negative / Duplicate

12. Negative layer_level
13. Invalid data type for layer_level
14. Duplicate tunable names
15. Duplicate Layer name (same layer name for 2 layers)

C. Wrong Combination Case

16. Empty layer_presence (no type specified)
17. Both presence AND queries specified
18. Both presence AND label specified
19. Both queries AND label specified
20. All three types specified (presence, queries, label)

D. Tunable NULL/ZERO/NEGATIVE

21. Tunable with null upper_bound
22. Tunable with null lower_bound
23. Tunable with non-numeric bounds
24. Tunable with null step
25. Tunable with zero step
26. Tunable with negative step
27. Tunable with negative upper_bound
28. Tunable with negative lower_bound
29. Tunable where lower_bound >= upper_bound
30. Tunable where step > (upper_bound - lower_bound)
31. Categorical tunable with null choices
32. Categorical tunable with empty choices array

List Layer

Positive Scenarios

1. List all layers when no layer name is added
2. List all layers when multiple layers are present
3. List specific layer queried by name
4. Validated all fields of all layer jsons are present or not and also correct or not

Negative Scenarios

1. List specific layer by name (doesn't exist)
2. List layers with invalid query parameter
3. Layer with special characters in name

Layer Detection

no tests for now

[bhanvimenghani]

quay.io/bmenghan/layer-detection-test
Image to test with demos