Goose Attack Report

Users: 7

Target Host: http://trustify:8080/

goose v0.18.0

Plan overview

Action Started Stopped Elapsed Users
Increasing26-03-12 02:26:4426-03-12 02:26:5200:00:080 → 7
Maintaining26-03-12 02:26:5226-03-12 02:31:5200:05:007
Decreasing26-03-12 02:31:5226-03-12 02:36:3100:04:390 ← 7

Request Metrics

Method Name # Requests # Fails Average (ms) Min (ms) Max (ms) RPS Failures/s
DELETE delete_sbom_from_pool_sequential[100 SBOMs] 2 (0) 1 266416.00 (+97168.00) 232831 (+70668) 300001 (+123668) 0.01 (+0.00) 0.00 (+0.00)
GET get_analysis_latest_cpe 5 (0) 0 10.60 (+2.60) 9 (+1) 13 (+5) 0.02 (+0.00) 0.00 (+0.00)
GET get_analysis_status 5 (0) 0 7.80 (+2.40) 4 (0) 10 (+3) 0.02 (+0.00) 0.00 (+0.00)
GET get_sbom[sha256:a3442b37…3040057f79c70669] 5 (0) 5 507.40 (+460.40) 86 (+81) 1960 (+1885) 0.02 (+0.00) 0.02 (+0.00)
GET get_sbom_advisories[sha256:a3442b37…3040057f79c70669] 5 (0) 5 88.00 (+66.00) 37 (+19) 107 (+74) 0.02 (+0.00) 0.02 (+0.00)
GET get_sbom_packages[019c4a3e-715c-7…8ba-3cc0260ef778] 5 (0) 5 0.20 (-0.60) 1 (0) 1 (-1) 0.02 (+0.00) 0.02 (+0.00)
GET get_sbom_related[019c4a3e-715c-7…8ba-3cc0260ef778] 5 (0) 5 1.20 (-0.20) 1 (0) 2 (-1) 0.02 (+0.00) 0.02 (+0.00)
GET get_vulnerability[CVE-2023-39325] 5 (0) 5 300000.41 (+178970.00) 300000 (+184762) 300001 (+175690) 0.02 (+0.00) 0.02 (+0.02)
GET list_advisory_labels 5 (0) 0 21652.40 (+2175.40) 18190 (+2498) 34596 (+268) 0.02 (+0.00) 0.00 (+0.00)
GET list_packages 1 0 191.00 191 191 0.00 0.00
GET list_packages_paginated 1 (0) 0 207.00 (-40.00) 207 (-40) 207 (-40) 0.00 (+0.00) 0.00 (+0.00)
GET list_products 5 (0) 0 16.20 (+2.60) 9 (+4) 21 (+3) 0.02 (+0.00) 0.00 (+0.00)
GET list_sboms 5 (0) 0 232808.41 (+55089.20) 232802 (+55103) 232812 (+55086) 0.02 (+0.00) 0.00 (+0.00)
GET list_sboms_paginated 5 (0) 0 1472.00 (+1005.60) 1467 (+1002) 1474 (+1006) 0.02 (+0.00) 0.00 (+0.00)
GET search_exact_purl 5 (0) 0 15.80 (-216.20) 11 (-6) 21 (-278) 0.02 (+0.00) 0.00 (+0.00)
GET search_licenses 25 (+9) 0 26.56 (-35.32) 5 (-2) 88 (-207) 0.08 (+0.03) 0.00 (+0.00)
GET search_purls 5 (0) 0 12309.60 (+8552.80) 8556 (+8277) 14153 (+8659) 0.02 (+0.00) 0.00 (+0.00)
GET search_purls_by_license 26 (+9) 0 12801.12 (-6145.88) 5033 (-1286) 93141 (+14368) 0.09 (+0.03) 0.00 (+0.00)
GET search_sboms_by_license 25 (+9) 0 25.16 (-39.90) 8 (-1) 90 (-101) 0.08 (+0.03) 0.00 (+0.00)
Aggregated 145 (+28) 26 25598.63 (+6139.04) 1 (0) 300001 (+122275) 0.48 (+0.09) 0.09 (+0.02)

Response Time Metrics

Method Name 50%ile (ms) 60%ile (ms) 70%ile (ms) 80%ile (ms) 90%ile (ms) 95%ile (ms) 99%ile (ms) 100%ile (ms)
DELETE delete_sbom_from_pool_sequential[100 SBOMs] 233,000 (+70,837) 233,000 (+70,837) 233,000 (+70,837) 300,000 (+124,000) 300,000 (+124,000) 300,000 (+124,000) 300,000 (+124,000) 300,000 (+124,000)
GET get_analysis_latest_cpe 10 (+2) 10 (+2) 11 (+3) 11 (+3) 13 (+5) 13 (+5) 13 (+5) 13 (+5)
GET get_analysis_status 8 (+3) 8 (+3) 9 (+3) 9 (+3) 10 (+3) 10 (+3) 10 (+3) 10 (+3)
GET get_sbom[sha256:a3442b37…3040057f79c70669] 110 (+46) 110 (+46) 280 (+211) 280 (+211) 1,960 (+1,885) 1,960 (+1,885) 1,960 (+1,885) 1,960 (+1,885)
GET get_sbom_advisories[sha256:a3442b37…3040057f79c70669] 100 (+82) 100 (+82) 100 (+77) 100 (+77) 107 (+74) 107 (+74) 107 (+74) 107 (+74)
GET get_sbom_packages[019c4a3e-715c-7…8ba-3cc0260ef778] 1 (0) 1 (0) 1 (0) 1 (0) 1 (-1) 1 (-1) 1 (-1) 1 (-1)
GET get_sbom_related[019c4a3e-715c-7…8ba-3cc0260ef778] 1 (0) 1 (0) 1 (0) 1 (0) 2 (-1) 2 (-1) 2 (-1) 2 (-1)
GET get_vulnerability[CVE-2023-39325] 300,000 (+178,000) 300,000 (+178,000) 300,000 (+178,000) 300,000 (+178,000) 300,000 (+176,000) 300,000 (+176,000) 300,000 (+176,000) 300,000 (+176,000)
GET list_advisory_labels 19,000 (+3,000) 19,000 (+3,000) 19,000 (+3,000) 19,000 (+3,000) 34,596 (+596) 34,596 (+596) 34,596 (+596) 34,596 (+596)
GET list_packages 191 191 191 191 191 191 191 191
GET list_packages_paginated 207 (-40) 207 (-40) 207 (-40) 207 (-40) 207 (-40) 207 (-40) 207 (-40) 207 (-40)
GET list_products 15 (0) 15 (0) 21 (+5) 21 (+5) 21 (+3) 21 (+3) 21 (+3) 21 (+3)
GET list_sboms 232,812 (+55,086) 232,812 (+55,086) 232,812 (+55,086) 232,812 (+55,086) 232,812 (+55,086) 232,812 (+55,086) 232,812 (+55,086) 232,812 (+55,086)
GET list_sboms_paginated 1,467 (+999) 1,467 (+999) 1,467 (+999) 1,467 (+999) 1,467 (+999) 1,467 (+999) 1,467 (+999) 1,467 (+999)
GET search_exact_purl 16 (-264) 16 (-264) 19 (-271) 19 (-271) 21 (-278) 21 (-278) 21 (-278) 21 (-278)
GET search_licenses 8 (-30) 16 (-40) 36 (-37) 54 (-43) 71 (-29) 86 (-14) 88 (-207) 88 (-207)
GET search_purls 13,000 (+9,000) 13,000 (+9,000) 14,000 (+9,000) 14,000 (+9,000) 14,000 (+9,000) 14,000 (+9,000) 14,000 (+9,000) 14,000 (+9,000)
GET search_purls_by_license 8,000 (-6,000) 11,000 (-3,000) 12,000 (-4,000) 13,000 (-5,000) 14,000 (-13,000) 20,000 (-10,000) 93,000 (+14,227) 93,000 (+14,227)
GET search_sboms_by_license 19 (-5) 19 (-55) 26 (-57) 34 (-96) 45 (-115) 77 (-83) 90 (-100) 90 (-100)
Aggregated 46 (-37) 110 (-170) 5,000 (0) 12,000 (-3,000) 20,000 (-59,000) 233,000 (+71,000) 300,000 (+122,274) 300,000 (+122,274)

Status Code Metrics

Method Name Status Codes
DELETE delete_sbom_from_pool_sequential[100 SBOMs] 1 [200], 1 [0]
GET get_analysis_latest_cpe 5 [200]
GET get_analysis_status 5 [200]
GET get_sbom[sha256:a3442b37…3040057f79c70669] 5 [404]
GET get_sbom_advisories[sha256:a3442b37…3040057f79c70669] 5 [404]
GET get_sbom_packages[019c4a3e-715c-7…8ba-3cc0260ef778] 5 [400]
GET get_sbom_related[019c4a3e-715c-7…8ba-3cc0260ef778] 5 [400]
GET get_vulnerability[CVE-2023-39325] 5 [0]
GET list_advisory_labels 5 [200]
GET list_packages 1 [200]
GET list_packages_paginated 1 [200]
GET list_products 5 [200]
GET list_sboms 5 [200]
GET list_sboms_paginated 5 [200]
GET search_exact_purl 5 [200]
GET search_licenses 25 [200]
GET search_purls 5 [200]
GET search_purls_by_license 26 [200]
GET search_sboms_by_license 25 [200]
Aggregated 10 [404], 119 [200], 10 [400], 6 [0]

Transaction Metrics

Transaction # Times Run # Fails Average (ms) Min (ms) Max (ms) RPS Failures/s
WebsiteUser
0.0 logon 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.1 website_index 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.2 website_openapi 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.3 website_sboms 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.4 website_packages 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.5 website_advisories 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.6 website_importers 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
RestAPIUser
1.0 logon 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.1 list_organizations 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.2 list_advisory 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.3 list_advisory_paginated 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.4 get_advisory_by_doc_id 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.5 search_advisory 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.6 list_vulnerabilities 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.7 list_vulnerabilities_paginated 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.8 list_importer 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.9 list_packages 1 (+1) 0 (0) 191.00 (+191.00) 191 (+191) 191 (+191) 0.00 (+0.00) 0.00 (+0.00)
1.10 list_packages_paginated 1 (0) 0 (0) 207.00 (-41.00) 207 (-41) 207 (-41) 0.00 (+0.00) 0.00 (+0.00)
1.11 search_purls 5 (0) 0 (0) 12309.60 (+8552.80) 8556 (+8277) 14153 (+8659) 0.02 (+0.00) 0.00 (+0.00)
1.12 search_exact_purl 5 (0) 0 (0) 15.80 (-216.40) 11 (-6) 21 (-278) 0.02 (+0.00) 0.00 (+0.00)
1.13 list_products 5 (0) 0 (0) 16.20 (+2.60) 9 (+4) 21 (+3) 0.02 (+0.00) 0.00 (+0.00)
1.14 list_sboms 5 (0) 0 (0) 232808.59 (+55088.80) 232802 (+55103) 232812 (+55086) 0.02 (+0.00) 0.00 (+0.00)
1.15 list_sboms_paginated 5 (0) 0 (0) 1472.00 (+1005.60) 1467 (+1002) 1474 (+1006) 0.02 (+0.00) 0.00 (+0.00)
1.16 get_analysis_status 5 (0) 0 (0) 7.80 (+2.40) 4 (0) 10 (+3) 0.02 (+0.00) 0.00 (+0.00)
1.17 get_analysis_latest_cpe 5 (0) 0 (0) 10.60 (+2.40) 9 (+1) 13 (+4) 0.02 (+0.00) 0.00 (+0.00)
1.18 list_advisory_labels 5 (0) 0 (0) 21652.40 (+2175.40) 18190 (+2498) 34596 (+268) 0.02 (+0.00) 0.00 (+0.00)
1.19 get_sbom[sha256:a3442b37…3040057f79c70669] 5 (0) 0 (0) 507.60 (+460.60) 86 (+81) 1961 (+1886) 0.02 (+0.00) 0.00 (+0.00)
1.20 get_sbom_advisories[sha256:a3442b37…3040057f79c70669] 5 (0) 0 (0) 88.00 (+66.00) 37 (+19) 107 (+74) 0.02 (+0.00) 0.00 (+0.00)
1.21 get_sbom_packages[019c4a3e-715c-7…8ba-3cc0260ef778] 5 (0) 0 (0) 0.20 (-0.60) 0 (0) 1 (-1) 0.02 (+0.00) 0.00 (+0.00)
1.22 get_sbom_related[019c4a3e-715c-7…8ba-3cc0260ef778] 5 (0) 0 (0) 1.20 (-0.20) 1 (0) 2 (-1) 0.02 (+0.00) 0.00 (+0.00)
1.23 get_vulnerability[CVE-2023-39325] 5 (0) 0 (0) 300000.81 (+178970.22) 300000 (+184761) 300002 (+175691) 0.02 (+0.00) 0.00 (+0.00)
1.24 sbom_by_package[pkg:oci/web-ter…-bundle&tag=1.11] 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.25 get_sbom_license_ids[urn:uuid:019c4a…8ba-3cc0260ef778] 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.26 post_vulnerability_analyze[pkg:rpm/redhat/squid] 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.27 get_purl_details[0000054a-a69b-5…520-80752db183e6] 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.28 get_recommendations[pkg:maven/io.ne…8.1.redhat-00033] 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.29 download_advisory[5b25cdef-428a-4…29e-fbb3415c22ab] 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
1.30 get_advisory[5b25cdef-428a-4…29e-fbb3415c22ab] 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
RestAPIUserSlow
2.0 logon 25 (+9) 0 (0) 10.36 (-0.77) 6 (0) 14 (0) 0.08 (+0.03) 0.00 (+0.00)
2.1 search_licenses 25 (+9) 0 (0) 26.72 (-35.40) 5 (-2) 88 (-207) 0.08 (+0.03) 0.00 (+0.00)
2.2 search_sboms_by_license 25 (+9) 0 (0) 25.20 (-39.86) 8 (-1) 90 (-101) 0.08 (+0.03) 0.00 (+0.00)
2.3 search_purls_by_license 26 (+9) 0 (0) 12801.12 (-6145.94) 5033 (-1286) 93141 (+14368) 0.09 (+0.03) 0.00 (+0.00)
RestAPIUserDelete
3.0 logon 1 (0) 0 (0) 10.00 (-10.00) 10 (-10) 10 (-10) 0.00 (+0.00) 0.00 (+0.00)
3.1 delete_sbom_from_pool_sequential[100 SBOMs] 2 (0) 0 (0) 266416.00 (+97168.00) 232831 (+70668) 300001 (+123668) 0.01 (+0.00) 0.00 (+0.00)
RestAdvisoryLableUser
4.0 logon 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
Aggregated 171 (+37) 0 (0) 21706.45 (+4715.60) 1 (0) 300002 (+122276) 0.57 (+0.12) 0.00 (+0.00)

Scenario Metrics

Scenario # Users # Times Run Average (ms) Min (ms) Max (ms) Scenarios/s Iterations
WebsiteUser 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
RestAPIUser 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
RestAPIUserSlow 1 (0) 25 (+9) 9650.88 (-8726.50) 5075 (-1283) 20492 (-58501) 0.08 (+0.03) 25.00 (+9.00)
RestAPIUserDelete 1 (0) 1 (0) 238982.00 (+55306.00) 238982 (+55306) 238982 (+55306) 0.00 (+0.00) 1.00 (+0.00)
RestAdvisoryLableUser 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
Aggregated 2 (0) 26 (+9) 18471.31 (-9629.52) 5075 (-1283) 238982 (+55306) 0.09 (+0.03) 26.00 (+9.00)

User Metrics

Errors

# Error
5 (0) 400 Bad Request: get_sbom_packages[019c4a3e-715c-7…8ba-3cc0260ef778]
5 (0) 400 Bad Request: get_sbom_related[019c4a3e-715c-7…8ba-3cc0260ef778]
5 (0) 404 Not Found: get_sbom[sha256:a3442b37…3040057f79c70669]
5 (0) 404 Not Found: get_sbom_advisories[sha256:a3442b37…3040057f79c70669]
1 error sending request delete_sbom_from_pool_sequential[100 SBOMs]: operation timed out
5 error sending request get_vulnerability[CVE-2023-39325]: operation timed out