Goose Attack Report

Users: 7

Target Host: http://trustify:8080/

goose v0.18.0

Plan overview

Action Started Stopped Elapsed Users
Increasing26-01-19 02:16:3426-01-19 02:16:4100:00:070 → 7
Maintaining26-01-19 02:16:4126-01-19 02:21:4200:05:017
Decreasing26-01-19 02:21:4226-01-19 02:22:2100:00:390 ← 7

Request Metrics

Method Name # Requests # Fails Average (ms) Min (ms) Max (ms) RPS Failures/s
DELETE delete_sbom_from_pool_sequential[100 SBOMs] 38 (+1) 0 1028.58 (-95.48) 197 (+50) 2880 (-1879) 0.13 (+0.00) 0.00 (+0.00)
GET download_advisory[24ae57c3-4b57-4…2c1-83ae26059a89] 10 (0) 10 9.20 (-10.00) 1 (0) 41 (-16) 0.03 (+0.00) 0.03 (+0.00)
GET get_advisory[24ae57c3-4b57-4…2c1-83ae26059a89] 10 (0) 10 7.70 (+1.90) 1 (0) 42 (+22) 0.03 (+0.00) 0.03 (+0.00)
GET get_advisory_by_doc_id 10 (0) 0 19.30 (+0.70) 4 (+1) 61 (+5) 0.03 (+0.00) 0.00 (+0.00)
GET get_analysis_latest_cpe 15 (0) 0 134.87 (-49.13) 97 (0) 281 (-28) 0.05 (+0.00) 0.00 (+0.00)
GET get_analysis_status 15 (0) 0 3.93 (-0.27) 1 (0) 12 (+4) 0.05 (+0.00) 0.00 (+0.00)
GET get_purl_details[b00df2ca-df21-5…874-304e9c54e2bd] 10 (0) 0 824.60 (+82.60) 256 (+175) 1637 (+347) 0.03 (+0.00) 0.00 (+0.00)
GET get_sbom[sha256:720e4451…a939656247164447] 15 (0) 0 2122.60 (+537.67) 611 (+371) 4927 (+1339) 0.05 (+0.00) 0.00 (+0.00)
GET get_sbom_advisories[sha256:87fd06bc…9d7b8304c0d2d9b2] 15 (0) 0 58409.33 (-336.00) 53659 (+2441) 65731 (+244) 0.05 (+0.00) 0.00 (+0.00)
GET get_sbom_license_ids[urn:uuid:019731…104-331632a21144] 10 (-5) 0 7368.70 (-1093.37) 5403 (-663) 10893 (-996) 0.03 (-0.02) 0.00 (+0.00)
GET list_advisory 10 (0) 0 1324.50 (+225.80) 292 (-183) 2561 (+686) 0.03 (+0.00) 0.00 (+0.00)
GET list_advisory_labels 15 (0) 0 15302.13 (+845.67) 11477 (+1484) 21502 (+1145) 0.05 (+0.00) 0.00 (+0.00)
GET list_advisory_paginated 10 (0) 0 663.60 (+117.30) 402 (+215) 1076 (+220) 0.03 (+0.00) 0.00 (+0.00)
GET list_importer 10 (-1) 0 3.00 (-0.55) 1 (0) 10 (0) 0.03 (-0.00) 0.00 (+0.00)
GET list_organizations 10 (0) 0 16.50 (-1.50) 2 (0) 44 (-23) 0.03 (+0.00) 0.00 (+0.00)
GET list_packages 11 (0) 0 523.00 (+69.27) 175 (-14) 1000 (+351) 0.04 (+0.00) 0.00 (+0.00)
GET list_packages_paginated 11 (0) 0 303.91 (-75.73) 140 (-48) 557 (-40) 0.04 (+0.00) 0.00 (+0.00)
GET list_products 15 (0) 0 8.87 (-0.87) 4 (+2) 17 (-38) 0.05 (+0.00) 0.00 (+0.00)
GET list_sboms 15 (0) 0 1154.80 (+226.47) 692 (+162) 3406 (+899) 0.05 (+0.00) 0.00 (+0.00)
GET list_sboms_paginated 15 (0) 0 1878.40 (-2001.93) 664 (-334) 3274 (-7731) 0.05 (+0.00) 0.00 (+0.00)
GET list_vulnerabilities 10 (-1) 0 376.30 (+29.03) 88 (-19) 692 (+114) 0.03 (-0.00) 0.00 (+0.00)
GET list_vulnerabilities_paginated 10 (-1) 0 210.50 (+3.41) 35 (-52) 301 (-5) 0.03 (-0.00) 0.00 (+0.00)
GET sbom_by_package[pkg:maven/io.qu…dhat.com%2fga%2f] 10 (-5) 0 56.80 (+0.27) 7 (-3) 172 (-65) 0.03 (-0.02) 0.00 (+0.00)
GET search_advisory 10 (0) 0 1718.80 (+605.20) 494 (+215) 2747 (+1043) 0.03 (+0.00) 0.00 (+0.00)
GET search_exact_purl 15 (0) 0 11.93 (-3.33) 5 (+3) 21 (-43) 0.05 (+0.00) 0.00 (+0.00)
GET search_licenses 2 (+1) 0 62231.00 (-37725.00) 40948 (-59008) 83514 (-16442) 0.01 (+0.00) 0.00 (+0.00)
GET search_purls 15 (0) 0 16408.27 (+6047.47) 9367 (+5175) 23334 (+11442) 0.05 (+0.00) 0.00 (+0.00)
GET search_purls_by_license 1 (0) 0 143631.00 (-18214.00) 143631 (-18214) 143631 (-18214) 0.00 (+0.00) 0.00 (+0.00)
GET search_sboms_by_license 1 (0) 0 73784.00 (+11160.00) 73784 (+11160) 73784 (+11160) 0.00 (+0.00) 0.00 (+0.00)
POST get_recommendations[pkg:rpm/redhat/…e-metrics@2.13.8] 10 (0) 0 37.50 (-70.90) 4 (-1) 108 (-101) 0.03 (+0.00) 0.00 (+0.00)
POST post_vulnerability_analyze[pkg:rpm/redhat/…h=noarch&epoch=1] 10 (0) 0 580.80 (+130.20) 140 (+101) 1615 (+606) 0.03 (+0.00) 0.00 (+0.00)
Aggregated 364 (-11) 20 5367.48 (+293.21) 1 (0) 143631 (-18214) 1.21 (-0.04) 0.07 (+0.00)

Response Time Metrics

Method Name 50%ile (ms) 60%ile (ms) 70%ile (ms) 80%ile (ms) 90%ile (ms) 95%ile (ms) 99%ile (ms) 100%ile (ms)
DELETE delete_sbom_from_pool_sequential[100 SBOMs] 800 (-100) 1,000 (0) 1,000 (0) 1,000 (-1,000) 2,000 (0) 2,880 (+880) 2,880 (-1,879) 2,880 (-1,879)
GET download_advisory[24ae57c3-4b57-4…2c1-83ae26059a89] 4 (-3) 6 (-2) 8 (-3) 10 (-36) 14 (-39) 41 (-16) 41 (-16) 41 (-16)
GET get_advisory[24ae57c3-4b57-4…2c1-83ae26059a89] 2 (-1) 2 (-1) 2 (-2) 6 (0) 18 (+2) 42 (+22) 42 (+22) 42 (+22)
GET get_advisory_by_doc_id 11 (+2) 11 (-4) 13 (-2) 20 (+4) 54 (-2) 61 (+5) 61 (+5) 61 (+5)
GET get_analysis_latest_cpe 110 (-70) 110 (-70) 120 (-80) 120 (-80) 280 (+70) 280 (+70) 280 (-29) 280 (-29)
GET get_analysis_status 3 (-1) 3 (-1) 4 (-1) 6 (+1) 8 (+1) 8 (+1) 12 (+4) 12 (+4)
GET get_purl_details[b00df2ca-df21-5…874-304e9c54e2bd] 500 (-400) 600 (-400) 1,000 (0) 1,637 (+637) 1,637 (+637) 1,637 (+637) 1,637 (+637) 1,637 (+637)
GET get_sbom[sha256:720e4451…a939656247164447] 2,000 (+1,000) 2,000 (+1,000) 3,000 (+1,000) 3,000 (0) 4,000 (+1,000) 4,000 (+1,000) 4,927 (+1,339) 4,927 (+1,339)
GET get_sbom_advisories[sha256:87fd06bc…9d7b8304c0d2d9b2] 59,000 (0) 59,000 (0) 59,000 (0) 60,000 (-4,000) 65,000 (0) 65,000 (0) 65,731 (+731) 65,731 (+731)
GET get_sbom_license_ids[urn:uuid:019731…104-331632a21144] 7,000 (0) 7,000 (0) 7,000 (-2,000) 8,000 (-3,000) 9,000 (-2,889) 10,893 (-996) 10,893 (-996) 10,893 (-996)
GET list_advisory 800 (-100) 2,000 (+1,000) 2,000 (+1,000) 2,000 (+125) 2,000 (+125) 2,561 (+686) 2,561 (+686) 2,561 (+686)
GET list_advisory_labels 13,000 (0) 14,000 (0) 18,000 (+1,000) 19,000 (+2,000) 21,000 (+1,000) 21,000 (+1,000) 21,502 (+1,502) 21,502 (+1,502)
GET list_advisory_paginated 600 (+100) 600 (+100) 800 (+200) 800 (+100) 900 (+200) 1,000 (+144) 1,000 (+144) 1,000 (+144)
GET list_importer 2 (-1) 2 (-1) 3 (-1) 4 (-1) 4 (-2) 10 (+4) 10 (0) 10 (0)
GET list_organizations 5 (+1) 9 (+2) 13 (+4) 42 (+4) 43 (-1) 44 (-23) 44 (-23) 44 (-23)
GET list_packages 410 (-90) 600 (+100) 600 (0) 900 (+300) 900 (+300) 900 (+300) 1,000 (+400) 1,000 (+400)
GET list_packages_paginated 270 (-120) 310 (-90) 320 (-160) 380 (-100) 480 (-10) 480 (-10) 557 (-40) 557 (-40)
GET list_products 8 (+1) 9 (+1) 10 (+1) 10 (+1) 15 (+4) 15 (+4) 17 (-38) 17 (-38)
GET list_sboms 800 (+100) 900 (+200) 1,000 (+100) 1,000 (0) 3,000 (+1,000) 3,000 (+1,000) 3,000 (+493) 3,000 (+493)
GET list_sboms_paginated 1,000 (-1,000) 1,000 (-2,000) 3,000 (-2,000) 3,000 (-3,000) 3,000 (-7,000) 3,000 (-7,000) 3,000 (-8,000) 3,000 (-8,000)
GET list_vulnerabilities 220 (-100) 420 (+20) 600 (+100) 600 (+100) 692 (+192) 692 (+192) 692 (+114) 692 (+114)
GET list_vulnerabilities_paginated 190 (-40) 280 (+50) 290 (+30) 290 (+30) 300 (+40) 300 (+40) 300 (-6) 300 (-6)
GET sbom_by_package[pkg:maven/io.qu…dhat.com%2fga%2f] 54 (+4) 57 (+6) 58 (+5) 58 (-4) 110 (-50) 170 (+10) 170 (-67) 170 (-67)
GET search_advisory 1,000 (0) 2,000 (+1,000) 2,000 (+1,000) 2,000 (+1,000) 2,747 (+1,043) 2,747 (+1,043) 2,747 (+1,043) 2,747 (+1,043)
GET search_exact_purl 9 (+4) 10 (+4) 19 (+10) 20 (+7) 21 (-31) 21 (-31) 21 (-43) 21 (-43)
GET search_licenses 41,000 (-58,956) 41,000 (-58,956) 41,000 (-58,956) 83,514 (-16,442) 83,514 (-16,442) 83,514 (-16,442) 83,514 (-16,442) 83,514 (-16,442)
GET search_purls 18,000 (+7,000) 19,000 (+8,000) 20,000 (+9,000) 22,000 (+10,108) 23,000 (+11,108) 23,000 (+11,108) 23,000 (+11,108) 23,000 (+11,108)
GET search_purls_by_license 143,631 (-18,214) 143,631 (-18,214) 143,631 (-18,214) 143,631 (-18,214) 143,631 (-18,214) 143,631 (-18,214) 143,631 (-18,214) 143,631 (-18,214)
GET search_sboms_by_license 73,784 (+11,160) 73,784 (+11,160) 73,784 (+11,160) 73,784 (+11,160) 73,784 (+11,160) 73,784 (+11,160) 73,784 (+11,160) 73,784 (+11,160)
POST get_recommendations[pkg:rpm/redhat/…e-metrics@2.13.8] 11 (-129) 40 (-100) 49 (-111) 61 (-109) 80 (-90) 108 (-101) 108 (-101) 108 (-101)
POST post_vulnerability_analyze[pkg:rpm/redhat/…h=noarch&epoch=1] 300 (+100) 320 (-280) 370 (-330) 800 (+100) 1,615 (+715) 1,615 (+615) 1,615 (+615) 1,615 (+615)
Aggregated 420 (-50) 800 (+100) 1,000 (0) 3,000 (0) 13,000 (+2,000) 41,000 (+21,000) 65,000 (+1,000) 143,631 (-18,214)

Status Code Metrics

Method Name Status Codes
DELETE delete_sbom_from_pool_sequential[100 SBOMs] 38 [200]
GET download_advisory[24ae57c3-4b57-4…2c1-83ae26059a89] 10 [404]
GET get_advisory[24ae57c3-4b57-4…2c1-83ae26059a89] 10 [404]
GET get_advisory_by_doc_id 10 [200]
GET get_analysis_latest_cpe 15 [200]
GET get_analysis_status 15 [200]
GET get_purl_details[b00df2ca-df21-5…874-304e9c54e2bd] 10 [200]
GET get_sbom[sha256:720e4451…a939656247164447] 15 [200]
GET get_sbom_advisories[sha256:87fd06bc…9d7b8304c0d2d9b2] 15 [200]
GET get_sbom_license_ids[urn:uuid:019731…104-331632a21144] 10 [200]
GET list_advisory 10 [200]
GET list_advisory_labels 15 [200]
GET list_advisory_paginated 10 [200]
GET list_importer 10 [200]
GET list_organizations 10 [200]
GET list_packages 11 [200]
GET list_packages_paginated 11 [200]
GET list_products 15 [200]
GET list_sboms 15 [200]
GET list_sboms_paginated 15 [200]
GET list_vulnerabilities 10 [200]
GET list_vulnerabilities_paginated 10 [200]
GET sbom_by_package[pkg:maven/io.qu…dhat.com%2fga%2f] 10 [200]
GET search_advisory 10 [200]
GET search_exact_purl 15 [200]
GET search_licenses 2 [200]
GET search_purls 15 [200]
GET search_purls_by_license 1 [200]
GET search_sboms_by_license 1 [200]
POST get_recommendations[pkg:rpm/redhat/…e-metrics@2.13.8] 10 [200]
POST post_vulnerability_analyze[pkg:rpm/redhat/…h=noarch&epoch=1] 10 [200]
Aggregated 344 [200], 20 [404]

Transaction Metrics

Transaction # Times Run # Fails Average (ms) Min (ms) Max (ms) RPS Failures/s
WebsiteUser
0.0 logon 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.1 website_index 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.2 website_openapi 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.3 website_sboms 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.4 website_packages 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.5 website_advisories 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
0.6 website_importers 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
RestAPIUser
1.0 logon 10 (0) 0 (0) 12.90 (-1.50) 9 (+1) 16 (-3) 0.03 (+0.00) 0.00 (+0.00)
1.1 list_organizations 10 (0) 0 (0) 16.60 (-1.60) 2 (0) 44 (-24) 0.03 (+0.00) 0.00 (+0.00)
1.2 list_advisory 10 (0) 0 (0) 1324.60 (+225.80) 292 (-183) 2561 (+686) 0.03 (+0.00) 0.00 (+0.00)
1.3 list_advisory_paginated 10 (0) 0 (0) 663.70 (+117.40) 402 (+215) 1076 (+220) 0.03 (+0.00) 0.00 (+0.00)
1.4 get_advisory_by_doc_id 10 (0) 0 (0) 19.30 (+0.60) 4 (+1) 61 (+5) 0.03 (+0.00) 0.00 (+0.00)
1.5 search_advisory 10 (0) 0 (0) 1718.90 (+605.30) 494 (+215) 2747 (+1043) 0.03 (+0.00) 0.00 (+0.00)
1.6 list_vulnerabilities 10 (-1) 0 (0) 376.30 (+29.03) 88 (-19) 692 (+114) 0.03 (-0.00) 0.00 (+0.00)
1.7 list_vulnerabilities_paginated 10 (-1) 0 (0) 210.60 (+3.51) 35 (-52) 301 (-5) 0.03 (-0.00) 0.00 (+0.00)
1.8 list_importer 10 (-1) 0 (0) 3.10 (-0.54) 1 (0) 10 (0) 0.03 (-0.00) 0.00 (+0.00)
1.9 list_packages 11 (0) 0 (0) 523.00 (+69.27) 175 (-14) 1000 (+351) 0.04 (+0.00) 0.00 (+0.00)
1.10 list_packages_paginated 11 (0) 0 (0) 304.00 (-75.64) 140 (-48) 557 (-40) 0.04 (+0.00) 0.00 (+0.00)
1.11 search_purls 15 (0) 0 (0) 16408.33 (+6047.33) 9367 (+5174) 23334 (+11442) 0.05 (+0.00) 0.00 (+0.00)
1.12 search_exact_purl 15 (0) 0 (0) 11.93 (-3.47) 5 (+3) 21 (-43) 0.05 (+0.00) 0.00 (+0.00)
1.13 list_products 15 (0) 0 (0) 9.00 (-0.73) 4 (+2) 17 (-38) 0.05 (+0.00) 0.00 (+0.00)
1.14 list_sboms 15 (0) 0 (0) 1154.87 (+226.47) 692 (+161) 3406 (+899) 0.05 (+0.00) 0.00 (+0.00)
1.15 list_sboms_paginated 15 (0) 0 (0) 1878.53 (-2001.80) 664 (-334) 3274 (-7731) 0.05 (+0.00) 0.00 (+0.00)
1.16 get_analysis_status 15 (0) 0 (0) 3.93 (-0.40) 1 (-1) 12 (+4) 0.05 (+0.00) 0.00 (+0.00)
1.17 get_analysis_latest_cpe 15 (0) 0 (0) 134.87 (-49.13) 97 (0) 281 (-28) 0.05 (+0.00) 0.00 (+0.00)
1.18 list_advisory_labels 15 (0) 0 (0) 15302.20 (+845.60) 11477 (+1484) 21502 (+1145) 0.05 (+0.00) 0.00 (+0.00)
1.19 get_sbom[sha256:720e4451…a939656247164447] 15 (0) 0 (0) 2122.93 (+537.80) 611 (+371) 4927 (+1339) 0.05 (+0.00) 0.00 (+0.00)
1.20 get_sbom_advisories[sha256:87fd06bc…9d7b8304c0d2d9b2] 15 (0) 0 (0) 58409.33 (-336.00) 53659 (+2441) 65731 (+244) 0.05 (+0.00) 0.00 (+0.00)
1.21 sbom_by_package[pkg:maven/io.qu…dhat.com%2fga%2f] 10 (-5) 0 (0) 56.90 (+0.37) 7 (-3) 172 (-65) 0.03 (-0.02) 0.00 (+0.00)
1.22 get_sbom_license_ids[urn:uuid:019731…104-331632a21144] 10 (-5) 0 (0) 7368.70 (-1093.43) 5403 (-663) 10893 (-996) 0.03 (-0.02) 0.00 (+0.00)
1.23 post_vulnerability_analyze[pkg:rpm/redhat/…h=noarch&epoch=1] 10 (0) 0 (0) 581.10 (+130.50) 140 (+101) 1616 (+607) 0.03 (+0.00) 0.00 (+0.00)
1.24 get_purl_details[b00df2ca-df21-5…874-304e9c54e2bd] 10 (0) 0 (0) 824.70 (+82.60) 256 (+175) 1637 (+346) 0.03 (+0.00) 0.00 (+0.00)
1.25 get_recommendations[pkg:rpm/redhat/…e-metrics@2.13.8] 10 (0) 0 (0) 37.50 (-71.00) 4 (-1) 108 (-101) 0.03 (+0.00) 0.00 (+0.00)
1.26 download_advisory[24ae57c3-4b57-4…2c1-83ae26059a89] 10 (0) 0 (0) 9.30 (-10.10) 2 (0) 41 (-16) 0.03 (+0.00) 0.00 (+0.00)
1.27 get_advisory[24ae57c3-4b57-4…2c1-83ae26059a89] 10 (0) 0 (0) 7.70 (+1.90) 1 (0) 42 (+22) 0.03 (+0.00) 0.00 (+0.00)
RestAPIUserSlow
2.0 logon 1 (+1) 0 (0) 14.00 (+14.00) 14 (+14) 14 (+14) 0.00 (+0.00) 0.00 (+0.00)
2.1 search_licenses 2 (+1) 0 (0) 62231.00 (-37725.00) 40948 (-59008) 83514 (-16442) 0.01 (+0.00) 0.00 (+0.00)
2.2 search_sboms_by_license 1 (0) 0 (0) 73784.00 (+11160.00) 73784 (+11160) 73784 (+11160) 0.00 (+0.00) 0.00 (+0.00)
2.3 search_purls_by_license 1 (0) 0 (0) 143631.00 (-18214.00) 143631 (-18214) 143631 (-18214) 0.00 (+0.00) 0.00 (+0.00)
RestAPIUserDelete
3.0 logon 37 (0) 0 (0) 9.76 (-0.41) 6 (0) 20 (+1) 0.12 (+0.00) 0.00 (+0.00)
3.1 delete_sbom_from_pool_sequential[100 SBOMs] 38 (+1) 0 (0) 1028.68 (-95.53) 197 (+50) 2880 (-1880) 0.13 (+0.00) 0.00 (+0.00)
Aggregated 412 (-10) 0 (0) 4742.15 (+233.02) 1 (0) 143631 (-18214) 1.37 (-0.03) 0.00 (+0.00)

Scenario Metrics

Scenario # Users # Times Run Average (ms) Min (ms) Max (ms) Scenarios/s Iterations
WebsiteUser 0 (0) 0 (0) 0.00 (+0.00) 0 (0) 0 (0) 0.00 (+0.00) 0.00 (+0.00)
RestAPIUser 5 (0) 10 (0) 105217.50 (+7222.10) 99516 (+5296) 110868 (+9071) 0.03 (+0.00) 2.00 (+0.00)
RestAPIUserSlow 1 (+1) 1 (+1) 300940.00 (+300940.00) 300940 (+300940) 300940 (+300940) 0.00 (+0.00) 1.00 (+1.00)
RestAPIUserDelete 1 (0) 37 (0) 8058.08 (-81.76) 6465 (+60) 9792 (-2273) 0.12 (+0.00) 37.00 (+0.00)
Aggregated 7 (+1) 48 (+1) 34401.33 (+7143.29) 6465 (+60) 300940 (+199143) 0.16 (+0.00) 40.00 (+1.00)

User Metrics

Errors

# Error
10 (0) 404 Not Found: download_advisory[24ae57c3-4b57-4…2c1-83ae26059a89]
10 (0) 404 Not Found: get_advisory[24ae57c3-4b57-4…2c1-83ae26059a89]