Goose Attack Report

Users: 7

Target Host: http://trustify:8080/

goose v0.18.0

Plan overview

Action Started Stopped Elapsed Users
Increasing26-03-09 02:27:0126-03-09 02:27:0800:00:070 → 7
Maintaining26-03-09 02:27:0826-03-09 02:32:0900:05:017
Decreasing26-03-09 02:32:0926-03-09 02:33:3500:01:260 ← 7

Request Metrics

Method Name # Requests # Fails Average (ms) Min (ms) Max (ms) RPS Failures/s
DELETE delete_sbom_from_pool_sequential[100 SBOMs] 1 (0) 1 300001.00 (+0.00) 300001 (0) 300001 (0) 0.00 (+0.00) 0.00 (+0.00)
GET get_analysis_latest_cpe 5 (0) 0 10.80 (-3.40) 9 (-1) 14 (-4) 0.02 (+0.00) 0.00 (+0.00)
GET get_analysis_status 5 (0) 0 5.80 (-7.60) 3 (0) 11 (-33) 0.02 (+0.00) 0.00 (+0.00)
GET get_sbom[sha256:a3442b37…3040057f79c70669] 5 (0) 0 1233.00 (+15.80) 913 (+37) 1695 (+277) 0.02 (+0.00) 0.00 (+0.00)
GET get_sbom_advisories[sha256:a3442b37…3040057f79c70669] 5 (0) 1 248612.41 (-17496.00) 233838 (-23875) 300001 (+31214) 0.02 (+0.00) 0.00 (+0.00)
GET get_sbom_packages[019c4a3e-715c-7…8ba-3cc0260ef778] 4 4 144.00 1 565 0.01 0.01
GET get_sbom_related[019c4a3e-715c-7…8ba-3cc0260ef778] 4 4 15.75 1 60 0.01 0.01
GET get_vulnerability[CVE-2023-39325] 4 0 116581.00 114845 118228 0.01 0.00
GET list_advisory_labels 5 (0) 0 13933.20 (-4270.20) 13407 (-1875) 14772 (-13330) 0.02 (+0.00) 0.00 (+0.00)
GET list_importer 1 0 2.00 2 2 0.00 0.00
GET list_packages 1 0 403.00 403 403 0.00 0.00
GET list_packages_paginated 1 (0) 0 288.00 (+108.00) 288 (+108) 288 (+108) 0.00 (+0.00) 0.00 (+0.00)
GET list_products 1 (-4) 0 20.00 (-0.20) 20 (+1) 20 (-1) 0.00 (-0.01) 0.00 (+0.00)
GET list_sboms 5 (0) 0 20147.00 (+1089.00) 16548 (-2506) 34530 (+15469) 0.02 (+0.00) 0.00 (+0.00)
GET list_sboms_paginated 5 (0) 0 574.80 (+13.40) 194 (-331) 672 (+99) 0.02 (+0.00) 0.00 (+0.00)
GET list_vulnerabilities 1 0 321.00 321 321 0.00 0.00
GET list_vulnerabilities_paginated 1 0 347.00 347 347 0.00 0.00
GET search_advisory 1 0 787.00 787 787 0.00 0.00
GET search_exact_purl 1 (-4) 0 748.00 (+512.20) 748 (+514) 748 (+510) 0.00 (-0.01) 0.00 (+0.00)
GET search_licenses 8 (-7) 0 117.88 (+50.01) 65 (+59) 194 (+18) 0.03 (-0.02) 0.00 (+0.00)
GET search_purls 1 (-4) 0 10426.00 (-19768.40) 10426 (-16075) 10426 (-21585) 0.00 (-0.01) 0.00 (+0.00)
GET search_purls_by_license 9 (-7) 0 38004.89 (+18283.64) 16984 (+11677) 72773 (+10894) 0.03 (-0.02) 0.00 (+0.00)
GET search_sboms_by_license 8 (-7) 0 239.25 (+176.38) 44 (+35) 1016 (+818) 0.03 (-0.02) 0.00 (+0.00)
Aggregated 82 (-16) 10 31070.63 (+7643.96) 1 (-2) 300001 (0) 0.27 (-0.05) 0.03 (+0.03)

Response Time Metrics

Method Name 50%ile (ms) 60%ile (ms) 70%ile (ms) 80%ile (ms) 90%ile (ms) 95%ile (ms) 99%ile (ms) 100%ile (ms)
DELETE delete_sbom_from_pool_sequential[100 SBOMs] 300,001 (0) 300,001 (0) 300,001 (0) 300,001 (0) 300,001 (0) 300,001 (0) 300,001 (0) 300,001 (0)
GET get_analysis_latest_cpe 10 (-4) 10 (-4) 12 (-4) 12 (-4) 14 (-4) 14 (-4) 14 (-4) 14 (-4)
GET get_analysis_status 5 (-2) 5 (-2) 6 (-2) 6 (-2) 11 (-33) 11 (-33) 11 (-33) 11 (-33)
GET get_sbom[sha256:a3442b37…3040057f79c70669] 1,000 (0) 1,000 (0) 1,000 (0) 1,000 (0) 1,695 (+695) 1,695 (+695) 1,695 (+695) 1,695 (+695)
GET get_sbom_advisories[sha256:a3442b37…3040057f79c70669] 236,000 (-32,000) 236,000 (-32,000) 238,000 (-30,000) 238,000 (-30,000) 300,000 (+31,213) 300,000 (+31,213) 300,000 (+31,213) 300,000 (+31,213)
GET get_sbom_packages[019c4a3e-715c-7…8ba-3cc0260ef778] 4 4 6 6 565 565 565 565
GET get_sbom_related[019c4a3e-715c-7…8ba-3cc0260ef778] 1 1 1 1 60 60 60 60
GET get_vulnerability[CVE-2023-39325] 116,000 116,000 118,000 118,000 118,000 118,000 118,000 118,000
GET list_advisory_labels 14,000 (-2,000) 14,000 (-2,000) 14,000 (-2,000) 14,000 (-2,000) 14,772 (-13,228) 14,772 (-13,228) 14,772 (-13,228) 14,772 (-13,228)
GET list_importer 2 2 2 2 2 2 2 2
GET list_packages 403 403 403 403 403 403 403 403
GET list_packages_paginated 288 (+108) 288 (+108) 288 (+108) 288 (+108) 288 (+108) 288 (+108) 288 (+108) 288 (+108)
GET list_products 20 (-1) 20 (-1) 20 (-1) 20 (-1) 20 (-1) 20 (-1) 20 (-1) 20 (-1)
GET list_sboms 17,000 (-2,054) 17,000 (-2,054) 17,000 (-2,054) 17,000 (-2,054) 34,530 (+15,476) 34,530 (+15,476) 34,530 (+15,476) 34,530 (+15,476)
GET list_sboms_paginated 672 (+99) 672 (+99) 672 (+99) 672 (+99) 672 (+99) 672 (+99) 672 (+99) 672 (+99)
GET list_vulnerabilities 321 321 321 321 321 321 321 321
GET list_vulnerabilities_paginated 347 347 347 347 347 347 347 347
GET search_advisory 787 787 787 787 787 787 787 787
GET search_exact_purl 748 (+510) 748 (+510) 748 (+510) 748 (+510) 748 (+510) 748 (+510) 748 (+510) 748 (+510)
GET search_licenses 100 (+36) 110 (+34) 110 (+24) 110 (+14) 180 (+4) 190 (+14) 190 (+14) 190 (+14)
GET search_purls 10,426 (-20,574) 10,426 (-20,574) 10,426 (-21,574) 10,426 (-21,574) 10,426 (-21,574) 10,426 (-21,574) 10,426 (-21,574) 10,426 (-21,574)
GET search_purls_by_license 29,000 (+7,000) 29,000 (+6,000) 29,000 (+6,000) 56,000 (+32,000) 58,000 (+33,000) 72,773 (+46,773) 72,773 (+10,894) 72,773 (+10,894)
GET search_sboms_by_license 120 (+83) 160 (+91) 160 (+78) 160 (+76) 220 (+50) 1,000 (+830) 1,000 (+802) 1,000 (+802)
Aggregated 700 (+460) 1,000 (0) 14,000 (-2,000) 28,000 (+6,000) 116,000 (+86,000) 235,000 (-23,000) 300,000 (+31,000) 300,000 (0)

Status Code Metrics

Method Name Status Codes
DELETE delete_sbom_from_pool_sequential[100 SBOMs] 1 [0]
GET get_analysis_latest_cpe 5 [200]
GET get_analysis_status 5 [200]
GET get_sbom[sha256:a3442b37…3040057f79c70669] 5 [200]
GET get_sbom_advisories[sha256:a3442b37…3040057f79c70669] 1 [0], 4 [200]
GET get_sbom_packages[019c4a3e-715c-7…8ba-3cc0260ef778] 4 [400]
GET get_sbom_related[019c4a3e-715c-7…8ba-3cc0260ef778] 4 [400]
GET get_vulnerability[CVE-2023-39325] 4 [200]
GET list_advisory_labels 5 [200]
GET list_importer 1 [200]
GET list_packages 1 [200]
GET list_packages_paginated 1 [200]
GET list_products 1 [200]
GET list_sboms 5 [200]
GET list_sboms_paginated 5 [200]
GET list_vulnerabilities 1 [200]
GET list_vulnerabilities_paginated 1 [200]
GET search_advisory 1 [200]
GET search_exact_purl 1 [200]
GET search_licenses 8 [200]
GET search_purls 1 [200]
GET search_purls_by_license 9 [200]
GET search_sboms_by_license 8 [200]
Aggregated 72 [200], 2 [0], 8 [400]

Transaction Metrics

Transaction # Times Run # Fails Average (ms) Min (ms) Max (ms) RPS Failures/s
WebsiteUser
0.0 logon 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.1 website_index 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.2 website_openapi 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.3 website_sboms 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.4 website_packages 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.5 website_advisories 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.6 website_importers 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
RestAPIUser
1.0 logon 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.1 list_organizations 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.2 list_advisory 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.3 list_advisory_paginated 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.4 get_advisory_by_doc_id 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.5 search_advisory 1 (+1) 0 (0) 787.00 (+787.00) 787 (+787) 787 (+787) 0.00 (+0.00) 0.00 (+0.00)
1.6 list_vulnerabilities 1 (+1) 0 (0) 321.00 (+321.00) 321 (+321) 321 (+321) 0.00 (+0.00) 0.00 (+0.00)
1.7 list_vulnerabilities_paginated 1 (+1) 0 (0) 347.00 (+347.00) 347 (+347) 347 (+347) 0.00 (+0.00) 0.00 (+0.00)
1.8 list_importer 1 (+1) 0 (0) 2.00 (+2.00) 2 (+2) 2 (+2) 0.00 (+0.00) 0.00 (+0.00)
1.9 list_packages 1 (+1) 0 (0) 403.00 (+403.00) 403 (+403) 403 (+403) 0.00 (+0.00) 0.00 (+0.00)
1.10 list_packages_paginated 1 (0) 0 (0) 288.00 (+108.00) 288 (+108) 288 (+108) 0.00 (+0.00) 0.00 (+0.00)
1.11 search_purls 1 (-4) 0 (0) 10426.00 (-19768.40) 10426 (-16075) 10426 (-21585) 0.00 (-0.01) 0.00 (+0.00)
1.12 search_exact_purl 1 (-4) 0 (0) 748.00 (+512.20) 748 (+514) 748 (+510) 0.00 (-0.01) 0.00 (+0.00)
1.13 list_products 1 (-4) 0 (0) 20.00 (-0.20) 20 (+1) 20 (-1) 0.00 (-0.01) 0.00 (+0.00)
1.14 list_sboms 5 (0) 0 (0) 20147.00 (+1088.80) 16548 (-2506) 34530 (+15469) 0.02 (+0.00) 0.00 (+0.00)
1.15 list_sboms_paginated 5 (0) 0 (0) 574.80 (+13.40) 194 (-331) 672 (+99) 0.02 (+0.00) 0.00 (+0.00)
1.16 get_analysis_status 5 (0) 0 (0) 5.80 (-7.80) 3 (0) 11 (-33) 0.02 (+0.00) 0.00 (+0.00)
1.17 get_analysis_latest_cpe 5 (0) 0 (0) 10.80 (-3.60) 9 (-2) 14 (-4) 0.02 (+0.00) 0.00 (+0.00)
1.18 list_advisory_labels 5 (0) 0 (0) 13933.20 (-4270.40) 13407 (-1875) 14772 (-13330) 0.02 (+0.00) 0.00 (+0.00)
1.19 get_sbom[sha256:a3442b37…3040057f79c70669] 5 (0) 0 (0) 1233.20 (+15.80) 914 (+38) 1695 (+277) 0.02 (+0.00) 0.00 (+0.00)
1.20 get_sbom_advisories[sha256:a3442b37…3040057f79c70669] 5 (0) 0 (0) 248612.41 (-17496.00) 233838 (-23875) 300001 (+31214) 0.02 (+0.00) 0.00 (+0.00)
1.21 get_sbom_packages[019c4a3e-715c-7…8ba-3cc0260ef778] 4 (+4) 0 (0) 144.00 (+144.00) 1 (+1) 565 (+565) 0.01 (+0.01) 0.00 (+0.00)
1.22 get_sbom_related[019c4a3e-715c-7…8ba-3cc0260ef778] 4 (+4) 0 (0) 15.75 (+15.75) 1 (+1) 60 (+60) 0.01 (+0.01) 0.00 (+0.00)
1.23 get_vulnerability[CVE-2023-39325] 4 (+4) 0 (0) 116581.00 (+116581.00) 114845 (+114845) 118228 (+118228) 0.01 (+0.01) 0.00 (+0.00)
1.24 sbom_by_package[pkg:oci/web-ter…-bundle&tag=1.11] 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.25 get_sbom_license_ids[urn:uuid:019c4a…8ba-3cc0260ef778] 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.26 post_vulnerability_analyze[pkg:rpm/redhat/squid] 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.27 get_purl_details[0000054a-a69b-5…520-80752db183e6] 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.28 get_recommendations[pkg:maven/io.ne…8.1.redhat-00033] 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.29 download_advisory[5b25cdef-428a-4…29e-fbb3415c22ab] 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.30 get_advisory[5b25cdef-428a-4…29e-fbb3415c22ab] 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
RestAPIUserSlow
2.0 logon 8 (-7) 0 (0) 13.25 (+2.05) 7 (0) 18 (+2) 0.03 (-0.02) 0.00 (+0.00)
2.1 search_licenses 8 (-7) 0 (0) 118.38 (+50.24) 65 (+58) 195 (+18) 0.03 (-0.02) 0.00 (+0.00)
2.2 search_sboms_by_license 8 (-7) 0 (0) 239.25 (+176.38) 44 (+35) 1016 (+818) 0.03 (-0.02) 0.00 (+0.00)
2.3 search_purls_by_license 9 (-7) 0 (0) 38005.22 (+18283.85) 16984 (+11677) 72774 (+10895) 0.03 (-0.02) 0.00 (+0.00)
RestAPIUserDelete
3.0 logon 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
3.1 delete_sbom_from_pool_sequential[100 SBOMs] 1 (0) 0 (0) 300001.00 (+0.00) 300001 (0) 300001 (0) 0.00 (+0.00) 0.00 (+0.00)
RestAdvisoryLableUser
4.0 logon 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
Aggregated 90 (-23) 0 (0) 28308.80 (+7991.86) 1 (-2) 300001 (0) 0.30 (-0.08) 0.00 (+0.00)

Scenario Metrics

Scenario # Users # Times Run Average (ms) Min (ms) Max (ms) Scenarios/s Iterations
WebsiteUser 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
RestAPIUser 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
RestAPIUserSlow 1 (0) 8 (-7) 35991.62 (+16548.76) 17018 (+11677) 72928 (+10952) 0.03 (-0.02) 8.00 (-7.00)
RestAPIUserDelete 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
RestAdvisoryLableUser 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
Aggregated 1 (0) 8 (-7) 35991.62 (+16548.76) 17018 (+11677) 72928 (+10952) 0.03 (-0.02) 8.00 (-7.00)

User Metrics

Errors

# Error
4 400 Bad Request: get_sbom_packages[019c4a3e-715c-7…8ba-3cc0260ef778]
4 400 Bad Request: get_sbom_related[019c4a3e-715c-7…8ba-3cc0260ef778]
1 (0) error sending request delete_sbom_from_pool_sequential[100 SBOMs]: operation timed out
1 error sending request get_sbom_advisories[sha256:a3442b37…3040057f79c70669]: operation timed out