Date: | 2014-11-12 14:19:49 |
---|
Abstract
Simply testing a default static page Bench result of ConfDBScaling.test_view_paper: No test description
Table of contents
The test ConfDBScaling.test_view_paper contains:
The bench contains:
The number of Successful Tests Per Second (STPS) over Concurrent Users (CUs).
![]()
CUs STPS TOTAL SUCCESS ERROR 1 0.300 6 6 0.00% 5 1.100 22 22 0.00% 10 1.750 35 35 0.00% 50 2.350 47 47 0.00% 100 4.650 93 93 0.00% 150 6.700 134 134 0.00% 200 5.850 117 117 0.00%
The number of Successful Pages Per Second (SPPS) over Concurrent Users (CUs). Note that an XML RPC call count like a page.
![]()
![]()
CUs Apdex* Rating SPPS maxSPPS TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 2.650 4.000 53 53 0.00% 0.144 0.241 1.137 0.146 0.159 0.689 0.724 5 0.975 Excellent 9.900 17.000 198 198 0.00% 0.144 0.369 2.428 0.148 0.243 0.951 1.537 10 0.964 Excellent 16.550 29.000 331 331 0.00% 0.144 0.459 4.045 0.147 0.182 0.976 2.156 50 0.825 FAIR 23.850 59.000 477 477 0.00% 0.145 2.222 19.309 0.157 0.327 7.471 16.170 100 0.819 FAIR 40.650 99.000 813 813 0.00% 0.146 2.815 25.770 0.170 0.424 13.879 20.379 150 0.848 FAIR 62.250 115.000 1245 1245 0.00% 0.145 3.281 36.883 0.189 0.487 17.720 25.038 200 0.747 FAIR 48.200 85.000 964 964 0.00% 0.377 3.518 31.474 0.682 1.303 17.170 21.950 * Apdex 1.5
The number of Requests Per Second (RPS) successful or not over Concurrent Users (CUs).
![]()
![]()
CUs Apdex* Rating* RPS maxRPS TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 2.650 4.000 53 53 0.00% 0.144 0.241 1.137 0.146 0.159 0.689 0.724 5 0.975 Excellent 9.900 17.000 198 198 0.00% 0.144 0.369 2.428 0.148 0.243 0.951 1.537 10 0.964 Excellent 16.550 29.000 331 331 0.00% 0.144 0.459 4.045 0.147 0.182 0.976 2.156 50 0.825 FAIR 23.850 59.000 477 477 0.00% 0.145 2.222 19.309 0.157 0.327 7.471 16.170 100 0.819 FAIR 40.650 99.000 813 813 0.00% 0.146 2.815 25.770 0.170 0.424 13.879 20.379 150 0.848 FAIR 62.250 115.000 1245 1245 0.00% 0.145 3.281 36.883 0.189 0.487 17.720 25.038 200 0.747 FAIR 48.200 85.000 964 964 0.00% 0.377 3.518 31.474 0.682 1.303 17.170 21.950 * Apdex 1.5
The 5 slowest average response time during the best cycle with 10 CUs:
Req: 001, get, url /index
![]()
CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 6 6 0.00% 0.144 0.147 0.155 0.144 0.146 0.155 0.155 5 1.000 Excellent 22 22 0.00% 0.144 0.202 0.332 0.145 0.166 0.276 0.322 10 1.000 Excellent 35 35 0.00% 0.144 0.174 0.327 0.145 0.156 0.221 0.261 50 1.000 Excellent 46 46 0.00% 0.145 0.272 0.690 0.146 0.188 0.468 0.473 100 1.000 Excellent 86 86 0.00% 0.146 0.260 0.658 0.154 0.238 0.411 0.460 150 1.000 Excellent 134 134 0.00% 0.145 0.219 0.444 0.165 0.210 0.289 0.307 200 1.000 Excellent 118 118 0.00% 0.377 0.919 1.438 0.536 0.958 1.289 1.356 * Apdex 1.5
Req: 002, get, url /accounts/login/?next=/index
![]()
CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 5 5 0.00% 0.145 0.147 0.148 0.145 0.147 0.148 0.148 5 1.000 Excellent 22 22 0.00% 0.146 0.188 0.283 0.146 0.162 0.261 0.279 10 1.000 Excellent 35 35 0.00% 0.147 0.178 0.358 0.147 0.158 0.241 0.318 50 1.000 Excellent 45 45 0.00% 0.148 0.264 0.717 0.150 0.176 0.488 0.556 100 1.000 Excellent 77 77 0.00% 0.149 0.294 0.694 0.159 0.234 0.527 0.594 150 1.000 Excellent 132 132 0.00% 0.154 0.240 0.522 0.178 0.231 0.307 0.354 200 1.000 Excellent 116 116 0.00% 0.413 0.951 1.496 0.597 0.997 1.296 1.382 * Apdex 1.5
Req: 001, post, url /accounts/login/?next=/index
![]()
CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 6 6 0.00% 0.283 0.285 0.287 0.283 0.286 0.287 0.287 5 1.000 Excellent 21 21 0.00% 0.281 0.403 0.714 0.283 0.396 0.508 0.522 10 1.000 Excellent 38 38 0.00% 0.284 0.441 0.903 0.288 0.358 0.861 0.901 50 0.796 FAIR 49 49 0.00% 0.287 1.490 3.447 0.399 1.069 3.105 3.221 100 0.800 FAIR 70 70 0.00% 0.325 1.648 5.095 0.450 1.306 3.513 3.724 150 0.677 POOR 116 116 0.00% 0.564 1.808 3.137 0.845 1.953 2.621 2.752 200 0.500 POOR 110 110 0.00% 2.071 3.129 4.275 2.380 3.222 3.751 3.972 * Apdex 1.5
Req: 002, get, url /index
![]()
CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 6 6 0.00% 0.689 0.782 1.137 0.689 0.724 1.137 1.137 5 0.762 FAIR 21 21 0.00% 0.909 1.476 2.428 0.964 1.468 2.383 2.385 10 0.667 POOR 36 36 0.00% 0.934 2.221 4.045 1.001 2.058 3.756 4.035 50 0.113 UNACCEPTABLE 62 62 0.00% 0.999 12.892 19.309 3.996 15.793 18.080 18.543 100 0.011 UNACCEPTABLE 94 94 0.00% 3.550 18.519 25.770 12.964 19.113 23.600 24.450 150 0.013 UNACCEPTABLE 151 151 0.00% 3.875 22.723 36.883 15.962 23.472 28.802 30.565 200 0.000 UNACCEPTABLE 98 98 0.00% 16.741 21.929 31.474 19.284 21.950 24.692 25.970 * Apdex 1.5
Req: 001, get, url /paper?id=1
![]()
CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 6 6 0.00% 0.158 0.159 0.160 0.158 0.159 0.160 0.160 5 1.000 Excellent 22 22 0.00% 0.157 0.217 0.385 0.159 0.181 0.333 0.343 10 1.000 Excellent 37 37 0.00% 0.158 0.295 0.806 0.159 0.193 0.594 0.766 50 0.869 Good 61 61 0.00% 0.159 0.973 4.284 0.164 0.333 2.654 3.513 100 0.833 FAIR 96 96 0.00% 0.167 1.418 4.990 0.307 1.145 3.358 4.201 150 0.990 Excellent 145 145 0.00% 0.250 0.905 1.652 0.578 0.897 1.245 1.423 200 0.578 POOR 96 96 0.00% 1.118 1.776 2.301 1.367 1.804 2.148 2.227 * Apdex 1.5
Req: 001, get, url /accounts/logout/
![]()
CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 6 6 0.00% 0.160 0.163 0.172 0.160 0.162 0.172 0.172 5 1.000 Excellent 22 22 0.00% 0.160 0.255 0.483 0.162 0.207 0.453 0.478 10 1.000 Excellent 39 39 0.00% 0.160 0.256 0.680 0.161 0.181 0.526 0.560 50 0.886 Good 57 57 0.00% 0.162 0.821 3.074 0.166 0.282 2.516 2.633 100 0.914 Good 99 99 0.00% 0.165 0.959 3.159 0.208 0.723 2.189 2.672 150 0.997 Excellent 144 144 0.00% 0.202 0.683 1.597 0.449 0.653 0.982 1.149 200 0.742 FAIR 97 97 0.00% 0.853 1.482 2.021 1.126 1.506 1.799 1.868 * Apdex 1.5
Req: 002, get, url /accounts/login/
![]()
CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 6 6 0.00% 0.147 0.153 0.159 0.147 0.158 0.159 0.159 5 1.000 Excellent 22 22 0.00% 0.146 0.210 0.333 0.147 0.181 0.304 0.307 10 1.000 Excellent 38 38 0.00% 0.146 0.165 0.255 0.146 0.152 0.212 0.224 50 1.000 Excellent 56 56 0.00% 0.147 0.223 0.590 0.152 0.168 0.380 0.404 100 1.000 Excellent 100 100 0.00% 0.149 0.264 0.565 0.162 0.249 0.416 0.508 150 1.000 Excellent 144 144 0.00% 0.150 0.226 0.534 0.168 0.215 0.299 0.320 200 0.990 Excellent 98 98 0.00% 0.404 1.021 1.545 0.646 1.082 1.265 1.407 * Apdex 1.5
Req: 001, get, url /accounts/logout/
![]()
CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 6 6 0.00% 0.159 0.163 0.173 0.159 0.161 0.173 0.173 5 1.000 Excellent 23 23 0.00% 0.159 0.244 0.426 0.159 0.217 0.359 0.425 10 1.000 Excellent 37 37 0.00% 0.158 0.262 0.540 0.160 0.207 0.429 0.532 50 0.922 Good 51 51 0.00% 0.159 0.660 2.285 0.166 0.323 1.559 1.887 100 0.839 FAIR 96 96 0.00% 0.163 1.087 3.203 0.253 0.920 2.247 2.347 150 0.996 Excellent 141 141 0.00% 0.218 0.628 1.553 0.349 0.621 0.898 1.019 200 0.794 FAIR 114 114 0.00% 0.881 1.388 1.880 0.992 1.380 1.747 1.815 * Apdex 1.5
Req: 002, get, url /accounts/login/
![]()
CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 6 6 0.00% 0.148 0.155 0.169 0.148 0.148 0.169 0.169 5 1.000 Excellent 23 23 0.00% 0.146 0.192 0.299 0.147 0.174 0.269 0.273 10 1.000 Excellent 36 36 0.00% 0.145 0.165 0.250 0.147 0.157 0.208 0.222 50 1.000 Excellent 50 50 0.00% 0.147 0.217 0.678 0.148 0.161 0.346 0.399 100 1.000 Excellent 95 95 0.00% 0.147 0.266 0.495 0.162 0.258 0.382 0.430 150 1.000 Excellent 138 138 0.00% 0.149 0.237 0.517 0.169 0.228 0.308 0.364 200 0.996 Excellent 117 117 0.00% 0.478 0.910 1.522 0.581 0.888 1.298 1.354 * Apdex 1.5
CUs: Concurrent users or number of concurrent threads executing tests.
Request: a single GET/POST/redirect/xmlrpc request.
Page: a request with redirects and resource links (image, css, js) for an html page.
STPS: Successful tests per second.
SPPS: Successful pages per second.
RPS: Requests per second, successful or not.
maxSPPS: Maximum SPPS during the cycle.
maxRPS: Maximum RPS during the cycle.
MIN: Minimum response time for a page or request.
AVG: Average response time for a page or request.
MAX: Maximmum response time for a page or request.
P10: 10th percentile, response time where 10 percent of pages or requests are delivered.
MED: Median or 50th percentile, response time where half of pages or requests are delivered.
P90: 90th percentile, response time where 90 percent of pages or requests are delivered.
P95: 95th percentile, response time where 95 percent of pages or requests are delivered.
Apdex T: Application Performance Index, this is a numerical measure of user satisfaction, it is based on three zones of application responsiveness:
Satisfied: The user is fully productive. This represents the time value (T seconds) below which users are not impeded by application response time.
Tolerating: The user notices performance lagging within responses greater than T, but continues the process.
Frustrated: Performance with a response time greater than 4*T seconds is unacceptable, and users may abandon the process.
By default T is set to 1.5s this means that response time between 0 and 1.5s the user is fully productive, between 1.5 and 6s the responsivness is tolerating and above 6s the user is frustrated.
The Apdex score converts many measurements into one number on a uniform scale of 0-to-1 (0 = no users satisfied, 1 = all users satisfied).
Visit http://www.apdex.org/ for more information.
Rating: To ease interpretation the Apdex score is also represented as a rating:
Report generated with FunkLoad 1.16.1, more information available on the FunkLoad site.