Goose Attack Report

Users: 7

Target Host: http://trustify:8080/

goose v0.18.0

Plan overview

Action Started Stopped Elapsed Users
Increasing26-01-20 02:17:5926-01-20 02:18:0600:00:070 → 7
Maintaining26-01-20 02:18:0626-01-20 02:23:0600:05:007
Decreasing26-01-20 02:23:0626-01-20 02:23:5200:00:460 ← 7

Request Metrics

Method Name # Requests # Fails Average (ms) Min (ms) Max (ms) RPS Failures/s
DELETE delete_sbom_from_pool_sequential[100 SBOMs] 37 (-1) 0 1090.81 (+62.23) 119 (-78) 3949 (+1069) 0.12 (-0.00) 0.00 (+0.00)
GET download_advisory[24ae57c3-4b57-4…2c1-83ae26059a89] 10 (0) 10 15.60 (+6.40) 2 (+1) 49 (+8) 0.03 (+0.00) 0.03 (+0.00)
GET get_advisory[24ae57c3-4b57-4…2c1-83ae26059a89] 10 (0) 10 36.70 (+29.00) 1 (0) 104 (+62) 0.03 (+0.00) 0.03 (+0.00)
GET get_advisory_by_doc_id 10 (0) 0 14.20 (-5.10) 3 (-1) 70 (+9) 0.03 (+0.00) 0.00 (+0.00)
GET get_analysis_latest_cpe 15 (0) 0 206.93 (+72.07) 100 (+3) 279 (-2) 0.05 (+0.00) 0.00 (+0.00)
GET get_analysis_status 15 (0) 0 15.93 (+12.00) 2 (+1) 61 (+49) 0.05 (+0.00) 0.00 (+0.00)
GET get_purl_details[b00df2ca-df21-5…874-304e9c54e2bd] 10 (0) 0 695.10 (-129.50) 176 (-80) 1208 (-429) 0.03 (+0.00) 0.00 (+0.00)
GET get_sbom[sha256:720e4451…a939656247164447] 15 (0) 0 2191.67 (+69.07) 523 (-88) 5017 (+90) 0.05 (+0.00) 0.00 (+0.00)
GET get_sbom_advisories[sha256:87fd06bc…9d7b8304c0d2d9b2] 14 (-1) 0 58825.93 (+416.60) 47233 (-6426) 65545 (-186) 0.05 (-0.00) 0.00 (+0.00)
GET get_sbom_license_ids[urn:uuid:019731…104-331632a21144] 10 (0) 0 8632.90 (+1264.20) 6567 (+1164) 11435 (+542) 0.03 (+0.00) 0.00 (+0.00)
GET list_advisory 10 (0) 0 997.30 (-327.20) 311 (+19) 1374 (-1187) 0.03 (+0.00) 0.00 (+0.00)
GET list_advisory_labels 15 (0) 0 15747.60 (+445.47) 13198 (+1721) 20364 (-1138) 0.05 (+0.00) 0.00 (+0.00)
GET list_advisory_paginated 10 (0) 0 436.10 (-227.50) 187 (-215) 595 (-481) 0.03 (+0.00) 0.00 (+0.00)
GET list_importer 11 (+1) 0 7.91 (+4.91) 2 (+1) 57 (+47) 0.04 (+0.00) 0.00 (+0.00)
GET list_organizations 10 (0) 0 19.50 (+3.00) 2 (0) 46 (+2) 0.03 (+0.00) 0.00 (+0.00)
GET list_packages 11 (0) 0 391.82 (-131.18) 188 (+13) 600 (-400) 0.04 (+0.00) 0.00 (+0.00)
GET list_packages_paginated 11 (0) 0 324.73 (+20.82) 140 (0) 513 (-44) 0.04 (+0.00) 0.00 (+0.00)
GET list_products 15 (0) 0 15.20 (+6.33) 3 (-1) 52 (+35) 0.05 (+0.00) 0.00 (+0.00)
GET list_sboms 15 (0) 0 1298.27 (+143.47) 916 (+224) 2172 (-1234) 0.05 (+0.00) 0.00 (+0.00)
GET list_sboms_paginated 15 (0) 0 2381.80 (+503.40) 594 (-70) 3791 (+517) 0.05 (+0.00) 0.00 (+0.00)
GET list_vulnerabilities 11 (+1) 0 337.36 (-38.94) 85 (-3) 595 (-97) 0.04 (+0.00) 0.00 (+0.00)
GET list_vulnerabilities_paginated 11 (+1) 0 200.36 (-10.14) 78 (+43) 312 (+11) 0.04 (+0.00) 0.00 (+0.00)
GET sbom_by_package[pkg:maven/io.qu…dhat.com%2fga%2f] 10 (0) 0 68.40 (+11.60) 7 (0) 206 (+34) 0.03 (+0.00) 0.00 (+0.00)
GET search_advisory 10 (0) 0 1318.30 (-400.50) 452 (-42) 2106 (-641) 0.03 (+0.00) 0.00 (+0.00)
GET search_exact_purl 15 (0) 0 53.27 (+41.33) 5 (0) 83 (+62) 0.05 (+0.00) 0.00 (+0.00)
GET search_licenses 2 (0) 0 75014.50 (+12783.50) 66610 (+25662) 83419 (-95) 0.01 (+0.00) 0.00 (+0.00)
GET search_purls 15 (0) 0 27597.20 (+11188.93) 16194 (+6827) 34641 (+11307) 0.05 (+0.00) 0.00 (+0.00)
GET search_purls_by_license 1 (0) 0 133119.00 (-10512.00) 133119 (-10512) 133119 (-10512) 0.00 (+0.00) 0.00 (+0.00)
GET search_sboms_by_license 1 (0) 0 60335.00 (-13449.00) 60335 (-13449) 60335 (-13449) 0.00 (+0.00) 0.00 (+0.00)
POST get_recommendations[pkg:rpm/redhat/…e-metrics@2.13.8] 10 (0) 0 88.00 (+50.50) 9 (+5) 188 (+80) 0.03 (+0.00) 0.00 (+0.00)
POST post_vulnerability_analyze[pkg:rpm/redhat/…h=noarch&epoch=1] 10 (0) 0 477.30 (-103.50) 117 (-23) 1087 (-528) 0.03 (+0.00) 0.00 (+0.00)
Aggregated 365 (+1) 20 5731.24 (+363.75) 1 (0) 133119 (-10512) 1.22 (+0.00) 0.07 (+0.00)

Response Time Metrics

Method Name 50%ile (ms) 60%ile (ms) 70%ile (ms) 80%ile (ms) 90%ile (ms) 95%ile (ms) 99%ile (ms) 100%ile (ms)
DELETE delete_sbom_from_pool_sequential[100 SBOMs] 900 (+100) 1,000 (0) 1,000 (0) 1,000 (0) 2,000 (0) 3,000 (+120) 3,949 (+1,069) 3,949 (+1,069)
GET download_advisory[24ae57c3-4b57-4…2c1-83ae26059a89] 7 (+3) 8 (+2) 10 (+2) 18 (+8) 46 (+32) 49 (+8) 49 (+8) 49 (+8)
GET get_advisory[24ae57c3-4b57-4…2c1-83ae26059a89] 15 (+13) 16 (+14) 54 (+52) 72 (+66) 98 (+80) 100 (+58) 100 (+58) 100 (+58)
GET get_advisory_by_doc_id 8 (-3) 10 (-1) 12 (-1) 12 (-8) 13 (-41) 70 (+9) 70 (+9) 70 (+9)
GET get_analysis_latest_cpe 230 (+120) 230 (+120) 230 (+110) 230 (+110) 270 (-10) 270 (-10) 279 (-1) 279 (-1)
GET get_analysis_status 7 (+4) 7 (+4) 9 (+5) 13 (+7) 55 (+47) 55 (+47) 61 (+49) 61 (+49)
GET get_purl_details[b00df2ca-df21-5…874-304e9c54e2bd] 500 (0) 900 (+300) 1,000 (0) 1,000 (-637) 1,000 (-637) 1,000 (-637) 1,000 (-637) 1,000 (-637)
GET get_sbom[sha256:720e4451…a939656247164447] 2,000 (0) 2,000 (0) 3,000 (0) 3,000 (0) 5,000 (+1,000) 5,000 (+1,000) 5,000 (+73) 5,000 (+73)
GET get_sbom_advisories[sha256:87fd06bc…9d7b8304c0d2d9b2] 60,000 (+1,000) 60,000 (+1,000) 62,000 (+3,000) 65,000 (+5,000) 65,000 (0) 65,000 (0) 65,545 (-186) 65,545 (-186)
GET get_sbom_license_ids[urn:uuid:019731…104-331632a21144] 7,000 (0) 8,000 (+1,000) 11,000 (+4,000) 11,000 (+3,000) 11,000 (+2,000) 11,000 (+107) 11,000 (+107) 11,000 (+107)
GET list_advisory 1,000 (+200) 1,000 (-1,000) 1,000 (-1,000) 1,000 (-1,000) 1,000 (-1,000) 1,000 (-1,561) 1,000 (-1,561) 1,000 (-1,561)
GET list_advisory_labels 14,000 (+1,000) 15,000 (+1,000) 19,000 (+1,000) 19,000 (0) 20,000 (-1,000) 20,000 (-1,000) 20,000 (-1,502) 20,000 (-1,502)
GET list_advisory_paginated 480 (-120) 490 (-110) 595 (-205) 595 (-205) 595 (-305) 595 (-405) 595 (-405) 595 (-405)
GET list_importer 3 (+1) 3 (+1) 4 (+1) 4 (0) 6 (+2) 6 (-4) 57 (+47) 57 (+47)
GET list_organizations 9 (+4) 9 (0) 37 (+24) 37 (-5) 42 (-1) 46 (+2) 46 (+2) 46 (+2)
GET list_packages 490 (+80) 500 (-100) 500 (-100) 500 (-400) 500 (-400) 500 (-400) 600 (-400) 600 (-400)
GET list_packages_paginated 330 (+60) 380 (+70) 410 (+90) 410 (+30) 490 (+10) 490 (+10) 500 (-57) 500 (-57)
GET list_products 11 (+3) 12 (+3) 13 (+3) 14 (+4) 50 (+35) 50 (+35) 52 (+35) 52 (+35)
GET list_sboms 1,000 (+200) 1,000 (+100) 1,000 (0) 2,000 (+1,000) 2,000 (-1,000) 2,000 (-1,000) 2,000 (-1,000) 2,000 (-1,000)
GET list_sboms_paginated 2,000 (+1,000) 3,000 (+2,000) 3,000 (0) 3,791 (+791) 3,791 (+791) 3,791 (+791) 3,791 (+791) 3,791 (+791)
GET list_vulnerabilities 470 (+250) 490 (+70) 490 (-110) 595 (-5) 595 (-97) 595 (-97) 595 (-97) 595 (-97)
GET list_vulnerabilities_paginated 250 (+60) 290 (+10) 290 (0) 310 (+20) 310 (+10) 310 (+10) 310 (+10) 310 (+10)
GET sbom_by_package[pkg:maven/io.qu…dhat.com%2fga%2f] 51 (-3) 53 (-4) 63 (+5) 79 (+21) 120 (+10) 206 (+36) 206 (+36) 206 (+36)
GET search_advisory 1,000 (0) 1,000 (-1,000) 1,000 (-1,000) 2,000 (0) 2,000 (-747) 2,000 (-747) 2,000 (-747) 2,000 (-747)
GET search_exact_purl 50 (+41) 57 (+47) 81 (+62) 82 (+62) 83 (+62) 83 (+62) 83 (+62) 83 (+62)
GET search_licenses 67,000 (+26,000) 67,000 (+26,000) 67,000 (+26,000) 83,000 (-514) 83,000 (-514) 83,000 (-514) 83,000 (-514) 83,000 (-514)
GET search_purls 29,000 (+11,000) 29,000 (+10,000) 32,000 (+12,000) 32,000 (+10,000) 34,641 (+11,641) 34,641 (+11,641) 34,641 (+11,641) 34,641 (+11,641)
GET search_purls_by_license 133,119 (-10,512) 133,119 (-10,512) 133,119 (-10,512) 133,119 (-10,512) 133,119 (-10,512) 133,119 (-10,512) 133,119 (-10,512) 133,119 (-10,512)
GET search_sboms_by_license 60,335 (-13,449) 60,335 (-13,449) 60,335 (-13,449) 60,335 (-13,449) 60,335 (-13,449) 60,335 (-13,449) 60,335 (-13,449) 60,335 (-13,449)
POST get_recommendations[pkg:rpm/redhat/…e-metrics@2.13.8] 20 (+9) 130 (+90) 130 (+81) 180 (+119) 180 (+100) 188 (+80) 188 (+80) 188 (+80)
POST post_vulnerability_analyze[pkg:rpm/redhat/…h=noarch&epoch=1] 280 (-20) 280 (-40) 600 (+230) 900 (+100) 900 (-715) 1,000 (-615) 1,000 (-615) 1,000 (-615)
Aggregated 410 (-10) 800 (0) 1,000 (0) 3,000 (0) 19,000 (+6,000) 35,000 (-6,000) 65,000 (0) 133,000 (-10,631)

Status Code Metrics

Method Name Status Codes
DELETE delete_sbom_from_pool_sequential[100 SBOMs] 37 [200]
GET download_advisory[24ae57c3-4b57-4…2c1-83ae26059a89] 10 [404]
GET get_advisory[24ae57c3-4b57-4…2c1-83ae26059a89] 10 [404]
GET get_advisory_by_doc_id 10 [200]
GET get_analysis_latest_cpe 15 [200]
GET get_analysis_status 15 [200]
GET get_purl_details[b00df2ca-df21-5…874-304e9c54e2bd] 10 [200]
GET get_sbom[sha256:720e4451…a939656247164447] 15 [200]
GET get_sbom_advisories[sha256:87fd06bc…9d7b8304c0d2d9b2] 14 [200]
GET get_sbom_license_ids[urn:uuid:019731…104-331632a21144] 10 [200]
GET list_advisory 10 [200]
GET list_advisory_labels 15 [200]
GET list_advisory_paginated 10 [200]
GET list_importer 11 [200]
GET list_organizations 10 [200]
GET list_packages 11 [200]
GET list_packages_paginated 11 [200]
GET list_products 15 [200]
GET list_sboms 15 [200]
GET list_sboms_paginated 15 [200]
GET list_vulnerabilities 11 [200]
GET list_vulnerabilities_paginated 11 [200]
GET sbom_by_package[pkg:maven/io.qu…dhat.com%2fga%2f] 10 [200]
GET search_advisory 10 [200]
GET search_exact_purl 15 [200]
GET search_licenses 2 [200]
GET search_purls 15 [200]
GET search_purls_by_license 1 [200]
GET search_sboms_by_license 1 [200]
POST get_recommendations[pkg:rpm/redhat/…e-metrics@2.13.8] 10 [200]
POST post_vulnerability_analyze[pkg:rpm/redhat/…h=noarch&epoch=1] 10 [200]
Aggregated 345 [200], 20 [404]

Transaction Metrics

Transaction # Times Run # Fails Average (ms) Min (ms) Max (ms) RPS Failures/s
WebsiteUser
0.0 logon 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.1 website_index 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.2 website_openapi 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.3 website_sboms 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.4 website_packages 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.5 website_advisories 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.6 website_importers 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
RestAPIUser
1.0 logon 10 (0) 0 (0) 13.10 (+0.20) 8 (-1) 18 (+2) 0.03 (+0.00) 0.00 (+0.00)
1.1 list_organizations 10 (0) 0 (0) 19.50 (+2.90) 2 (0) 46 (+2) 0.03 (+0.00) 0.00 (+0.00)
1.2 list_advisory 10 (0) 0 (0) 997.30 (-327.30) 311 (+19) 1374 (-1187) 0.03 (+0.00) 0.00 (+0.00)
1.3 list_advisory_paginated 10 (0) 0 (0) 436.10 (-227.60) 187 (-215) 595 (-481) 0.03 (+0.00) 0.00 (+0.00)
1.4 get_advisory_by_doc_id 10 (0) 0 (0) 14.20 (-5.10) 3 (-1) 70 (+9) 0.03 (+0.00) 0.00 (+0.00)
1.5 search_advisory 10 (0) 0 (0) 1318.30 (-400.60) 452 (-42) 2106 (-641) 0.03 (+0.00) 0.00 (+0.00)
1.6 list_vulnerabilities 11 (+1) 0 (0) 337.45 (-38.85) 85 (-3) 595 (-97) 0.04 (+0.00) 0.00 (+0.00)
1.7 list_vulnerabilities_paginated 11 (+1) 0 (0) 200.45 (-10.15) 78 (+43) 312 (+11) 0.04 (+0.00) 0.00 (+0.00)
1.8 list_importer 11 (+1) 0 (0) 7.91 (+4.81) 2 (+1) 57 (+47) 0.04 (+0.00) 0.00 (+0.00)
1.9 list_packages 11 (0) 0 (0) 391.91 (-131.09) 189 (+14) 600 (-400) 0.04 (+0.00) 0.00 (+0.00)
1.10 list_packages_paginated 11 (0) 0 (0) 324.73 (+20.73) 140 (0) 513 (-44) 0.04 (+0.00) 0.00 (+0.00)
1.11 search_purls 15 (0) 0 (0) 27597.27 (+11188.93) 16194 (+6827) 34641 (+11307) 0.05 (+0.00) 0.00 (+0.00)
1.12 search_exact_purl 15 (0) 0 (0) 53.33 (+41.40) 5 (0) 83 (+62) 0.05 (+0.00) 0.00 (+0.00)
1.13 list_products 15 (0) 0 (0) 15.20 (+6.20) 3 (-1) 52 (+35) 0.05 (+0.00) 0.00 (+0.00)
1.14 list_sboms 15 (0) 0 (0) 1298.33 (+143.47) 916 (+224) 2172 (-1234) 0.05 (+0.00) 0.00 (+0.00)
1.15 list_sboms_paginated 15 (0) 0 (0) 2381.80 (+503.27) 594 (-70) 3791 (+517) 0.05 (+0.00) 0.00 (+0.00)
1.16 get_analysis_status 15 (0) 0 (0) 16.00 (+12.07) 2 (+1) 61 (+49) 0.05 (+0.00) 0.00 (+0.00)
1.17 get_analysis_latest_cpe 15 (0) 0 (0) 207.00 (+72.13) 100 (+3) 279 (-2) 0.05 (+0.00) 0.00 (+0.00)
1.18 list_advisory_labels 15 (0) 0 (0) 15747.60 (+445.40) 13198 (+1721) 20364 (-1138) 0.05 (+0.00) 0.00 (+0.00)
1.19 get_sbom[sha256:720e4451…a939656247164447] 15 (0) 0 (0) 2191.67 (+68.73) 523 (-88) 5017 (+90) 0.05 (+0.00) 0.00 (+0.00)
1.20 get_sbom_advisories[sha256:87fd06bc…9d7b8304c0d2d9b2] 14 (-1) 0 (0) 58825.93 (+416.60) 47233 (-6426) 65545 (-186) 0.05 (-0.00) 0.00 (+0.00)
1.21 sbom_by_package[pkg:maven/io.qu…dhat.com%2fga%2f] 10 (0) 0 (0) 68.50 (+11.60) 7 (0) 206 (+34) 0.03 (+0.00) 0.00 (+0.00)
1.22 get_sbom_license_ids[urn:uuid:019731…104-331632a21144] 10 (0) 0 (0) 8632.90 (+1264.20) 6567 (+1164) 11435 (+542) 0.03 (+0.00) 0.00 (+0.00)
1.23 post_vulnerability_analyze[pkg:rpm/redhat/…h=noarch&epoch=1] 10 (0) 0 (0) 477.40 (-103.70) 117 (-23) 1087 (-529) 0.03 (+0.00) 0.00 (+0.00)
1.24 get_purl_details[b00df2ca-df21-5…874-304e9c54e2bd] 10 (0) 0 (0) 695.20 (-129.50) 176 (-80) 1208 (-429) 0.03 (+0.00) 0.00 (+0.00)
1.25 get_recommendations[pkg:rpm/redhat/…e-metrics@2.13.8] 10 (0) 0 (0) 88.00 (+50.50) 9 (+5) 188 (+80) 0.03 (+0.00) 0.00 (+0.00)
1.26 download_advisory[24ae57c3-4b57-4…2c1-83ae26059a89] 10 (0) 0 (0) 15.60 (+6.30) 2 (0) 49 (+8) 0.03 (+0.00) 0.00 (+0.00)
1.27 get_advisory[24ae57c3-4b57-4…2c1-83ae26059a89] 10 (0) 0 (0) 36.70 (+29.00) 1 (0) 104 (+62) 0.03 (+0.00) 0.00 (+0.00)
RestAPIUserSlow
2.0 logon 1 (0) 0 (0) 8.00 (-6.00) 8 (-6) 8 (-6) 0.00 (+0.00) 0.00 (+0.00)
2.1 search_licenses 2 (0) 0 (0) 75014.50 (+12783.50) 66610 (+25662) 83419 (-95) 0.01 (+0.00) 0.00 (+0.00)
2.2 search_sboms_by_license 1 (0) 0 (0) 60335.00 (-13449.00) 60335 (-13449) 60335 (-13449) 0.00 (+0.00) 0.00 (+0.00)
2.3 search_purls_by_license 1 (0) 0 (0) 133119.00 (-10512.00) 133119 (-10512) 133119 (-10512) 0.00 (+0.00) 0.00 (+0.00)
RestAPIUserDelete
3.0 logon 37 (0) 0 (0) 10.41 (+0.65) 6 (0) 19 (-1) 0.12 (+0.00) 0.00 (+0.00)
3.1 delete_sbom_from_pool_sequential[100 SBOMs] 37 (-1) 0 (0) 1091.14 (+62.45) 119 (-78) 3949 (+1069) 0.12 (-0.00) 0.00 (+0.00)
Aggregated 413 (+1) 0 (0) 5065.14 (+322.99) 1 (0) 133119 (-10512) 1.38 (+0.00) 0.00 (+0.00)

Scenario Metrics

Scenario # Users # Times Run Average (ms) Min (ms) Max (ms) Scenarios/s Iterations
WebsiteUser 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
RestAPIUser 5 (0) 10 (0) 123838.70 (+18621.20) 111247 (+11731) 137582 (+26714) 0.03 (+0.00) 2.00 (+0.00)
RestAPIUserSlow 1 (0) 1 (0) 260075.00 (-40865.00) 260075 (-40865) 260075 (-40865) 0.00 (+0.00) 1.00 (+0.00)
RestAPIUserDelete 1 (0) 37 (0) 8168.41 (+110.32) 7141 (+676) 10878 (+1086) 0.12 (+0.00) 37.00 (+0.00)
Aggregated 7 (0) 48 (0) 37514.44 (+3113.11) 7141 (+676) 260075 (-40865) 0.16 (+0.00) 40.00 (+0.00)

User Metrics

Errors

# Error
10 (0) 404 Not Found: download_advisory[24ae57c3-4b57-4…2c1-83ae26059a89]
10 (0) 404 Not Found: get_advisory[24ae57c3-4b57-4…2c1-83ae26059a89]