Goose Attack Report

Users: 7

Target Host: http://trustify:8080/

goose v0.18.0

Plan overview

Action Started Stopped Elapsed Users
Increasing26-03-12 11:52:1626-03-12 11:52:2300:00:070 → 7
Maintaining26-03-12 11:52:2326-03-12 12:22:2400:30:017
Decreasing26-03-12 12:22:2426-03-12 12:23:3500:01:110 ← 7

Request Metrics

Method Name # Requests # Fails Average (ms) Min (ms) Max (ms) RPS Failures/s
GET download_advisory[5b25cdef-428a-4…29e-fbb3415c22ab] 5 0 550.00 381 635 0.00 0.00
GET get_advisory[5b25cdef-428a-4…29e-fbb3415c22ab] 5 0 452.00 285 610 0.00 0.00
GET get_advisory_by_doc_id 5 0 68.60 14 188 0.00 0.00
GET get_analysis_latest_cpe 10 (+5) 0 61.50 (+50.90) 6 (-3) 363 (+350) 0.01 (-0.01) 0.00 (+0.00)
GET get_analysis_status 10 (+5) 0 33.30 (+25.50) 2 (-2) 104 (+94) 0.01 (-0.01) 0.00 (+0.00)
GET get_purl_details[0000054a-a69b-5…520-80752db183e6] 5 0 1705.80 503 2797 0.00 0.00
GET get_sbom[sha256:a3442b37…3040057f79c70669] 10 (+5) 1 32189.20 (+31681.80) 566 (+480) 300001 (+298041) 0.01 (-0.01) 0.00 (-0.02)
GET get_sbom_advisories[sha256:a3442b37…3040057f79c70669] 10 (+5) 6 271322.19 (+271234.19) 220398 (+220361) 300002 (+299895) 0.01 (-0.01) 0.00 (-0.01)
GET get_sbom_license_ids[urn:uuid:019c4a…8ba-3cc0260ef778] 5 0 89.00 6 195 0.00 0.00
GET get_sbom_packages[019c4a3e-715c-7…8ba-3cc0260ef778] 9 (+4) 9 76.22 (+76.02) 1 (0) 668 (+667) 0.00 (-0.01) 0.00 (-0.01)
GET get_sbom_related[019c4a3e-715c-7…8ba-3cc0260ef778] 9 (+4) 9 1.44 (+0.24) 1 (0) 2 (0) 0.00 (-0.01) 0.00 (-0.01)
GET get_vulnerability[CVE-2023-39325] 9 (+4) 9 300001.12 (+0.72) 300000 (0) 300003 (+2) 0.00 (-0.01) 0.00 (-0.01)
GET list_advisory 5 0 4742.60 4584 4918 0.00 0.00
GET list_advisory_labels 10 (+5) 0 31035.70 (+9383.30) 15822 (-2368) 46656 (+12060) 0.01 (-0.01) 0.00 (+0.00)
GET list_advisory_paginated 5 0 5021.60 4003 7699 0.00 0.00
GET list_importer 5 0 46.60 1 166 0.00 0.00
GET list_organizations 5 0 1265.60 786 1484 0.00 0.00
GET list_packages 5 (+4) 0 1313.00 (+1122.00) 787 (+596) 2363 (+2172) 0.00 (-0.00) 0.00 (+0.00)
GET list_packages_paginated 6 (+5) 0 988.50 (+781.50) 130 (-77) 2369 (+2162) 0.00 (+0.00) 0.00 (+0.00)
GET list_products 10 (+5) 0 26.80 (+10.60) 8 (-1) 164 (+143) 0.01 (-0.01) 0.00 (+0.00)
GET list_sboms 10 (+5) 5 241528.70 (+8720.30) 183053 (-49749) 300002 (+67190) 0.01 (-0.01) 0.00 (+0.00)
GET list_sboms_paginated 10 (+5) 0 3341.80 (+1869.80) 1236 (-231) 6440 (+4966) 0.01 (-0.01) 0.00 (+0.00)
GET list_vulnerabilities 5 0 4032.40 1700 4912 0.00 0.00
GET list_vulnerabilities_paginated 5 0 2956.80 2221 3412 0.00 0.00
GET sbom_by_package[pkg:oci/web-ter…-bundle&tag=1.11] 5 0 834.20 596 1224 0.00 0.00
GET search_advisory 5 0 7455.00 4841 8780 0.00 0.00
GET search_exact_purl 10 (+5) 0 154.70 (+138.90) 104 (+93) 375 (+354) 0.01 (-0.01) 0.00 (+0.00)
GET search_licenses 64 (+39) 0 86.62 (+60.07) 4 (-1) 676 (+588) 0.04 (-0.05) 0.00 (+0.00)
GET search_purls 10 (+5) 0 49371.50 (+37061.90) 9998 (+1442) 95024 (+80871) 0.01 (-0.01) 0.00 (+0.00)
GET search_purls_by_license 65 (+39) 0 27927.54 (+15126.42) 3959 (-1074) 108709 (+15568) 0.04 (-0.05) 0.00 (+0.00)
GET search_sboms_by_license 64 (+39) 0 96.69 (+71.53) 3 (-5) 465 (+375) 0.04 (-0.05) 0.00 (+0.00)
POST get_recommendations[pkg:maven/io.ne…8.1.redhat-00033] 5 0 4147.40 2337 5206 0.00 0.00
POST post_vulnerability_analyze[pkg:rpm/redhat/squid] 5 0 30.60 6 75 0.00 0.00
Aggregated 406 (+261) 39 27088.36 (+1489.72) 1 (0) 300003 (+2) 0.23 (-0.26) 0.02 (-0.06)

Response Time Metrics

Method Name 50%ile (ms) 60%ile (ms) 70%ile (ms) 80%ile (ms) 90%ile (ms) 95%ile (ms) 99%ile (ms) 100%ile (ms)
GET download_advisory[5b25cdef-428a-4…29e-fbb3415c22ab] 600 600 600 600 600 600 600 600
GET get_advisory[5b25cdef-428a-4…29e-fbb3415c22ab] 390 390 600 600 600 600 600 600
GET get_advisory_by_doc_id 52 52 67 67 188 188 188 188
GET get_analysis_latest_cpe 9 (-1) 18 (+8) 31 (+20) 48 (+37) 120 (+107) 360 (+347) 360 (+347) 360 (+347)
GET get_analysis_status 16 (+8) 45 (+37) 45 (+36) 48 (+39) 57 (+47) 100 (+90) 100 (+90) 100 (+90)
GET get_purl_details[0000054a-a69b-5…520-80752db183e6] 2,000 2,000 2,000 2,000 2,797 2,797 2,797 2,797
GET get_sbom[sha256:a3442b37…3040057f79c70669] 1,000 (+890) 1,000 (+890) 4,000 (+3,720) 5,000 (+4,720) 6,000 (+4,040) 300,000 (+298,040) 300,000 (+298,040) 300,000 (+298,040)
GET get_sbom_advisories[sha256:a3442b37…3040057f79c70669] 300,000 (+299,900) 300,000 (+299,900) 300,000 (+299,900) 300,000 (+299,900) 300,000 (+299,893) 300,000 (+299,893) 300,000 (+299,893) 300,000 (+299,893)
GET get_sbom_license_ids[urn:uuid:019c4a…8ba-3cc0260ef778] 110 110 130 130 195 195 195 195
GET get_sbom_packages[019c4a3e-715c-7…8ba-3cc0260ef778] 2 (+1) 2 (+1) 3 (+2) 4 (+3) 5 (+4) 668 (+667) 668 (+667) 668 (+667)
GET get_sbom_related[019c4a3e-715c-7…8ba-3cc0260ef778] 1 (0) 1 (0) 2 (+1) 2 (+1) 2 (0) 2 (0) 2 (0) 2 (0)
GET get_vulnerability[CVE-2023-39325] 300,000 (0) 300,000 (0) 300,000 (0) 300,000 (0) 300,000 (0) 300,000 (0) 300,000 (0) 300,000 (0)
GET list_advisory 4,918 4,918 4,918 4,918 4,918 4,918 4,918 4,918
GET list_advisory_labels 29,000 (+10,000) 38,000 (+19,000) 41,000 (+22,000) 45,000 (+26,000) 46,000 (+11,404) 46,656 (+12,060) 46,656 (+12,060) 46,656 (+12,060)
GET list_advisory_paginated 4,003 4,003 5,000 5,000 7,699 7,699 7,699 7,699
GET list_importer 8 8 56 56 166 166 166 166
GET list_organizations 1,000 1,000 1,000 1,000 1,000 1,000 1,000 1,000
GET list_packages 1,000 (+809) 1,000 (+809) 1,000 (+809) 1,000 (+809) 2,000 (+1,809) 2,000 (+1,809) 2,000 (+1,809) 2,000 (+1,809)
GET list_packages_paginated 900 (+693) 900 (+693) 900 (+693) 1,000 (+793) 1,000 (+793) 2,000 (+1,793) 2,000 (+1,793) 2,000 (+1,793)
GET list_products 12 (-3) 12 (-3) 12 (-9) 14 (-7) 15 (-6) 160 (+139) 160 (+139) 160 (+139)
GET list_sboms 183,053 (-49,759) 300,000 (+67,188) 300,000 (+67,188) 300,000 (+67,188) 300,000 (+67,188) 300,000 (+67,188) 300,000 (+67,188) 300,000 (+67,188)
GET list_sboms_paginated 1,236 (-231) 3,000 (+1,533) 6,000 (+4,533) 6,000 (+4,533) 6,000 (+4,533) 6,000 (+4,533) 6,000 (+4,533) 6,000 (+4,533)
GET list_vulnerabilities 4,912 4,912 4,912 4,912 4,912 4,912 4,912 4,912
GET list_vulnerabilities_paginated 3,000 3,000 3,000 3,000 3,000 3,000 3,000 3,000
GET sbom_by_package[pkg:oci/web-ter…-bundle&tag=1.11] 700 700 900 900 1,000 1,000 1,000 1,000
GET search_advisory 8,780 8,780 8,780 8,780 8,780 8,780 8,780 8,780
GET search_exact_purl 110 (+94) 110 (+94) 110 (+91) 110 (+91) 320 (+299) 375 (+354) 375 (+354) 375 (+354)
GET search_licenses 60 (+52) 80 (+64) 89 (+53) 150 (+96) 200 (+129) 250 (+164) 290 (+202) 676 (+588)
GET search_purls 15,000 (+2,000) 70,000 (+57,000) 74,000 (+60,000) 92,000 (+78,000) 95,000 (+81,000) 95,000 (+81,000) 95,000 (+81,000) 95,000 (+81,000)
GET search_purls_by_license 21,000 (+13,000) 26,000 (+15,000) 34,000 (+22,000) 44,000 (+31,000) 61,000 (+47,000) 72,000 (+52,000) 79,000 (-14,000) 108,709 (+15,709)
GET search_sboms_by_license 57 (+38) 79 (+60) 120 (+94) 190 (+156) 210 (+165) 290 (+213) 420 (+330) 465 (+375)
POST get_recommendations[pkg:maven/io.ne…8.1.redhat-00033] 5,000 5,000 5,000 5,000 5,000 5,000 5,000 5,000
POST post_vulnerability_analyze[pkg:rpm/redhat/squid] 10 10 55 55 75 75 75 75
Aggregated 380 (+334) 1,000 (+890) 5,000 (0) 16,000 (+4,000) 61,000 (+41,000) 300,000 (+67,000) 300,000 (0) 300,000 (0)

Status Code Metrics

Method Name Status Codes
GET download_advisory[5b25cdef-428a-4…29e-fbb3415c22ab] 5 [200]
GET get_advisory[5b25cdef-428a-4…29e-fbb3415c22ab] 5 [200]
GET get_advisory_by_doc_id 5 [200]
GET get_analysis_latest_cpe 10 [200]
GET get_analysis_status 10 [200]
GET get_purl_details[0000054a-a69b-5…520-80752db183e6] 5 [200]
GET get_sbom[sha256:a3442b37…3040057f79c70669] 9 [200], 1 [0]
GET get_sbom_advisories[sha256:a3442b37…3040057f79c70669] 4 [200], 6 [0]
GET get_sbom_license_ids[urn:uuid:019c4a…8ba-3cc0260ef778] 5 [200]
GET get_sbom_packages[019c4a3e-715c-7…8ba-3cc0260ef778] 9 [400]
GET get_sbom_related[019c4a3e-715c-7…8ba-3cc0260ef778] 9 [400]
GET get_vulnerability[CVE-2023-39325] 9 [0]
GET list_advisory 5 [200]
GET list_advisory_labels 10 [200]
GET list_advisory_paginated 5 [200]
GET list_importer 5 [200]
GET list_organizations 5 [200]
GET list_packages 5 [200]
GET list_packages_paginated 6 [200]
GET list_products 10 [200]
GET list_sboms 5 [200], 5 [0]
GET list_sboms_paginated 10 [200]
GET list_vulnerabilities 5 [200]
GET list_vulnerabilities_paginated 5 [200]
GET sbom_by_package[pkg:oci/web-ter…-bundle&tag=1.11] 5 [200]
GET search_advisory 5 [200]
GET search_exact_purl 10 [200]
GET search_licenses 64 [200]
GET search_purls 10 [200]
GET search_purls_by_license 65 [200]
GET search_sboms_by_license 64 [200]
POST get_recommendations[pkg:maven/io.ne…8.1.redhat-00033] 5 [200]
POST post_vulnerability_analyze[pkg:rpm/redhat/squid] 5 [200]
Aggregated 21 [0], 18 [400], 367 [200]

Transaction Metrics

Transaction # Times Run # Fails Average (ms) Min (ms) Max (ms) RPS Failures/s
WebsiteUser
0.0 logon 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.1 website_index 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.2 website_openapi 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.3 website_sboms 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.4 website_packages 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.5 website_advisories 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.6 website_importers 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
RestAPIUser
1.0 logon 5 (+5) 0 (0) 13.60 (+13.60) 11 (+11) 17 (+17) 0.00 (+0.00) 0.00 (+0.00)
1.1 list_organizations 5 (+5) 0 (0) 1265.80 (+1265.80) 786 (+786) 1484 (+1484) 0.00 (+0.00) 0.00 (+0.00)
1.2 list_advisory 5 (+5) 0 (0) 4742.60 (+4742.60) 4584 (+4584) 4918 (+4918) 0.00 (+0.00) 0.00 (+0.00)
1.3 list_advisory_paginated 5 (+5) 0 (0) 5021.60 (+5021.60) 4003 (+4003) 7699 (+7699) 0.00 (+0.00) 0.00 (+0.00)
1.4 get_advisory_by_doc_id 5 (+5) 0 (0) 68.60 (+68.60) 14 (+14) 188 (+188) 0.00 (+0.00) 0.00 (+0.00)
1.5 search_advisory 5 (+5) 0 (0) 7455.20 (+7455.20) 4841 (+4841) 8780 (+8780) 0.00 (+0.00) 0.00 (+0.00)
1.6 list_vulnerabilities 5 (+5) 0 (0) 4032.40 (+4032.40) 1700 (+1700) 4912 (+4912) 0.00 (+0.00) 0.00 (+0.00)
1.7 list_vulnerabilities_paginated 5 (+5) 0 (0) 2956.80 (+2956.80) 2221 (+2221) 3412 (+3412) 0.00 (+0.00) 0.00 (+0.00)
1.8 list_importer 5 (+5) 0 (0) 46.60 (+46.60) 1 (+1) 166 (+166) 0.00 (+0.00) 0.00 (+0.00)
1.9 list_packages 5 (+4) 0 (0) 1313.40 (+1122.40) 787 (+596) 2365 (+2174) 0.00 (-0.00) 0.00 (+0.00)
1.10 list_packages_paginated 6 (+5) 0 (0) 988.50 (+781.50) 130 (-77) 2369 (+2162) 0.00 (+0.00) 0.00 (+0.00)
1.11 search_purls 10 (+5) 0 (0) 49371.50 (+37061.90) 9998 (+1442) 95024 (+80871) 0.01 (-0.01) 0.00 (+0.00)
1.12 search_exact_purl 10 (+5) 0 (0) 154.90 (+139.10) 104 (+93) 376 (+355) 0.01 (-0.01) 0.00 (+0.00)
1.13 list_products 10 (+5) 0 (0) 26.80 (+10.60) 8 (-1) 164 (+143) 0.01 (-0.01) 0.00 (+0.00)
1.14 list_sboms 10 (+5) 0 (0) 241528.80 (+8720.20) 183053 (-49749) 300002 (+67190) 0.01 (-0.01) 0.00 (+0.00)
1.15 list_sboms_paginated 10 (+5) 0 (0) 3342.00 (+1870.00) 1236 (-231) 6441 (+4967) 0.01 (-0.01) 0.00 (+0.00)
1.16 get_analysis_status 10 (+5) 0 (0) 33.30 (+25.50) 2 (-2) 104 (+94) 0.01 (-0.01) 0.00 (+0.00)
1.17 get_analysis_latest_cpe 10 (+5) 0 (0) 61.50 (+50.90) 6 (-3) 363 (+350) 0.01 (-0.01) 0.00 (+0.00)
1.18 list_advisory_labels 10 (+5) 0 (0) 31035.70 (+9383.30) 15822 (-2368) 46656 (+12060) 0.01 (-0.01) 0.00 (+0.00)
1.19 get_sbom[sha256:a3442b37…3040057f79c70669] 10 (+5) 0 (0) 32189.20 (+31681.60) 566 (+480) 300001 (+298040) 0.01 (-0.01) 0.00 (+0.00)
1.20 get_sbom_advisories[sha256:a3442b37…3040057f79c70669] 10 (+5) 0 (0) 271322.59 (+271234.59) 220398 (+220361) 300002 (+299895) 0.01 (-0.01) 0.00 (+0.00)
1.21 get_sbom_packages[019c4a3e-715c-7…8ba-3cc0260ef778] 9 (+4) 0 (0) 76.56 (+76.36) 1 (+1) 668 (+667) 0.00 (-0.01) 0.00 (+0.00)
1.22 get_sbom_related[019c4a3e-715c-7…8ba-3cc0260ef778] 9 (+4) 0 (0) 1.56 (+0.36) 1 (0) 2 (0) 0.00 (-0.01) 0.00 (+0.00)
1.23 get_vulnerability[CVE-2023-39325] 9 (+4) 0 (0) 300001.12 (+0.31) 300000 (0) 300003 (+1) 0.00 (-0.01) 0.00 (+0.00)
1.24 sbom_by_package[pkg:oci/web-ter…-bundle&tag=1.11] 5 (+5) 0 (0) 834.80 (+834.80) 596 (+596) 1225 (+1225) 0.00 (+0.00) 0.00 (+0.00)
1.25 get_sbom_license_ids[urn:uuid:019c4a…8ba-3cc0260ef778] 5 (+5) 0 (0) 89.20 (+89.20) 6 (+6) 195 (+195) 0.00 (+0.00) 0.00 (+0.00)
1.26 post_vulnerability_analyze[pkg:rpm/redhat/squid] 5 (+5) 0 (0) 31.00 (+31.00) 6 (+6) 77 (+77) 0.00 (+0.00) 0.00 (+0.00)
1.27 get_purl_details[0000054a-a69b-5…520-80752db183e6] 5 (+5) 0 (0) 1705.80 (+1705.80) 503 (+503) 2797 (+2797) 0.00 (+0.00) 0.00 (+0.00)
1.28 get_recommendations[pkg:maven/io.ne…8.1.redhat-00033] 5 (+5) 0 (0) 4147.40 (+4147.40) 2337 (+2337) 5206 (+5206) 0.00 (+0.00) 0.00 (+0.00)
1.29 download_advisory[5b25cdef-428a-4…29e-fbb3415c22ab] 5 (+5) 0 (0) 550.00 (+550.00) 381 (+381) 635 (+635) 0.00 (+0.00) 0.00 (+0.00)
1.30 get_advisory[5b25cdef-428a-4…29e-fbb3415c22ab] 5 (+5) 0 (0) 452.00 (+452.00) 285 (+285) 610 (+610) 0.00 (+0.00) 0.00 (+0.00)
RestAPIUserSlow
2.0 logon 64 (+39) 0 (0) 12.72 (+2.36) 6 (0) 30 (+16) 0.04 (-0.05) 0.00 (+0.00)
2.1 search_licenses 64 (+39) 0 (0) 86.78 (+60.06) 5 (0) 676 (+588) 0.04 (-0.05) 0.00 (+0.00)
2.2 search_sboms_by_license 64 (+39) 0 (0) 96.77 (+71.57) 3 (-5) 465 (+375) 0.04 (-0.05) 0.00 (+0.00)
2.3 search_purls_by_license 65 (+39) 0 (0) 27927.57 (+15126.45) 3959 (-1074) 108709 (+15568) 0.04 (-0.05) 0.00 (+0.00)
RestAPIUserDelete
3.0 logon 517 (+516) 0 (0) 11.89 (+1.89) 6 (-4) 56 (+46) 0.29 (+0.28) 0.00 (+0.00)
RestAdvisoryLableUser
4.0 logon 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
Aggregated 992 (+821) 0 (0) 11086.56 (-10619.88) 1 (0) 300003 (+1) 0.55 (-0.02) 0.00 (+0.00)

Scenario Metrics

Scenario # Users # Times Run Average (ms) Min (ms) Max (ms) Scenarios/s Iterations
WebsiteUser 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
RestAPIUser 5 (+5) 5 (+5) 770363.81 (+770363.81) 746515 (+746515) 818691 (+818691) 0.00 (+0.00) 1.00 (+1.00)
RestAPIUserSlow 1 (0) 64 (+39) 27429.27 (+17778.39) 3992 (-1083) 108871 (+88379) 0.04 (-0.05) 64.00 (+39.00)
RestAPIUserDelete 1 (0) 517 (+516) 3482.23 (-235499.78) 3022 (-235960) 4014 (-234968) 0.29 (+0.28) 517.00 (+516.00)
RestAdvisoryLableUser 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
Aggregated 7 (+5) 586 (+560) 12640.96 (-5830.35) 3022 (-2053) 818691 (+579709) 0.33 (+0.24) 582.00 (+556.00)

User Metrics

Errors

# Error
9 (+4) 400 Bad Request: get_sbom_packages[019c4a3e-715c-7…8ba-3cc0260ef778]
9 (+4) 400 Bad Request: get_sbom_related[019c4a3e-715c-7…8ba-3cc0260ef778]
1 error sending request get_sbom[sha256:a3442b37…3040057f79c70669]: operation timed out
6 error sending request get_sbom_advisories[sha256:a3442b37…3040057f79c70669]: operation timed out
9 (+4) error sending request get_vulnerability[CVE-2023-39325]: operation timed out
5 error sending request list_sboms: operation timed out