FunkLoad bench report
| Date: | 2014-11-12 14:34:44 |
|---|
Abstract
Simply testing a default static page Bench result of ConfDBScaling.test_view_paper: No test description
Table of contents
1 Bench configuration
- Launched: 2014-11-12 14:34:44
- From: leiteite
- Test: test_ConfDBScaling.py ConfDBScaling.test_view_paper
- Target server: http://54.148.81.226
- Cycles of concurrent users: [1, 5, 10, 50, 100, 150, 200]
- Cycle duration: 50s
- Sleeptime between request: from 0.0s to 0.5s
- Sleeptime between test case: 0.01s
- Startup delay between thread: 1.0s
- Apdex: 1.5
- FunkLoad version: 1.16.1
2 Bench content
The test ConfDBScaling.test_view_paper contains:
- 5 page(s)
- 4 redirect(s)
- 0 link(s)
- 0 image(s)
- 0 XML RPC call(s)
The bench contains:
- 1086 tests
- 9665 pages
- 9665 requests
3 Test stats
The number of Successful Tests Per Second (STPS) over Concurrent Users (CUs).
CUs STPS TOTAL SUCCESS ERROR 1 0.260 13 13 0.00% 5 1.180 59 59 0.00% 10 1.820 91 91 0.00% 50 3.020 151 151 0.00% 100 4.480 224 224 0.00% 150 5.740 287 287 0.00% 200 5.220 261 261 0.00%
4 Page stats
The number of Successful Pages Per Second (SPPS) over Concurrent Users (CUs). Note that an XML RPC call count like a page.
CUs Apdex* Rating SPPS maxSPPS TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 2.380 5.000 119 119 0.00% 0.144 0.262 0.970 0.147 0.160 0.897 0.913 5 0.975 Excellent 10.580 19.000 529 529 0.00% 0.143 0.331 2.614 0.146 0.162 0.921 1.457 10 0.966 Excellent 16.580 33.000 829 829 0.00% 0.144 0.461 4.639 0.148 0.183 1.044 1.985 50 0.858 Good 26.860 131.000 1343 1343 0.00% 0.144 1.806 20.777 0.158 0.276 5.063 11.298 100 0.811 FAIR 40.640 82.000 2032 2032 0.00% 0.145 2.521 26.741 0.167 0.400 5.005 18.952 150 0.849 FAIR 51.220 106.000 2561 2561 0.00% 0.148 3.083 33.489 0.190 0.429 13.333 25.367 200 0.728 FAIR 45.040 99.000 2252 2252 0.00% 0.322 4.182 35.700 0.552 1.347 18.300 28.389 * Apdex 1.5
5 Request stats
The number of Requests Per Second (RPS) successful or not over Concurrent Users (CUs).
CUs Apdex* Rating* RPS maxRPS TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 2.380 5.000 119 119 0.00% 0.144 0.262 0.970 0.147 0.160 0.897 0.913 5 0.975 Excellent 10.580 19.000 529 529 0.00% 0.143 0.331 2.614 0.146 0.162 0.921 1.457 10 0.966 Excellent 16.580 33.000 829 829 0.00% 0.144 0.461 4.639 0.148 0.183 1.044 1.985 50 0.858 Good 26.860 131.000 1343 1343 0.00% 0.144 1.806 20.777 0.158 0.276 5.063 11.298 100 0.811 FAIR 40.640 82.000 2032 2032 0.00% 0.145 2.521 26.741 0.167 0.400 5.005 18.952 150 0.849 FAIR 51.220 106.000 2561 2561 0.00% 0.148 3.083 33.489 0.190 0.429 13.333 25.367 200 0.728 FAIR 45.040 99.000 2252 2252 0.00% 0.322 4.182 35.700 0.552 1.347 18.300 28.389 * Apdex 1.5
6 Slowest requests
The 5 slowest average response time during the best cycle with 50 CUs:
- In page 002, Apdex rating: UNACCEPTABLE, avg response time: 10.85s, get: /index ``
- In page 002, Apdex rating: FAIR, avg response time: 2.30s, post: /accounts/login/?next=/index Post /accounts/login/
- In page 005, Apdex rating: Good, avg response time: 0.76s, get: /accounts/logout/ Get /accounts/logout/
- In page 003, Apdex rating: Excellent, avg response time: 0.65s, get: /paper?id=1 Get paper
- In page 004, Apdex rating: Excellent, avg response time: 0.55s, get: /accounts/logout/ Get /accounts/logout/
7 Page detail stats
7.1 PAGE 001: Get index
Req: 001, get, url /index
CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 13 13 0.00% 0.144 0.154 0.166 0.144 0.146 0.166 0.166 5 1.000 Excellent 59 59 0.00% 0.143 0.154 0.230 0.144 0.146 0.176 0.178 10 1.000 Excellent 91 91 0.00% 0.144 0.176 0.303 0.145 0.162 0.246 0.263 50 1.000 Excellent 151 151 0.00% 0.144 0.326 0.894 0.148 0.214 0.652 0.795 100 1.000 Excellent 221 221 0.00% 0.145 0.280 0.882 0.155 0.257 0.444 0.490 150 1.000 Excellent 285 285 0.00% 0.149 0.222 0.443 0.167 0.212 0.281 0.297 200 0.920 Good 257 257 0.00% 0.326 1.002 3.069 0.462 0.748 1.944 2.522 * Apdex 1.5
Req: 002, get, url /accounts/login/?next=/index
CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 13 13 0.00% 0.147 0.149 0.167 0.147 0.147 0.157 0.167 5 1.000 Excellent 58 58 0.00% 0.145 0.157 0.208 0.146 0.147 0.188 0.199 10 1.000 Excellent 92 92 0.00% 0.146 0.179 0.335 0.147 0.163 0.233 0.262 50 1.000 Excellent 148 148 0.00% 0.146 0.353 1.433 0.152 0.239 0.731 0.757 100 1.000 Excellent 215 215 0.00% 0.147 0.290 1.097 0.160 0.254 0.464 0.528 150 1.000 Excellent 280 280 0.00% 0.151 0.235 0.554 0.180 0.226 0.303 0.333 200 0.932 Good 249 249 0.00% 0.345 0.994 3.768 0.496 0.827 1.666 2.000 * Apdex 1.5
7.2 PAGE 002: Post /accounts/login/
Req: 001, post, url /accounts/login/?next=/index
CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 13 13 0.00% 0.283 0.292 0.314 0.283 0.285 0.301 0.314 5 1.000 Excellent 59 59 0.00% 0.282 0.339 0.535 0.283 0.314 0.445 0.459 10 1.000 Excellent 93 93 0.00% 0.282 0.429 1.162 0.286 0.339 0.684 0.901 50 0.743 FAIR 140 140 0.00% 0.286 2.303 5.793 0.328 1.873 5.041 5.305 100 0.698 POOR 210 210 0.00% 0.316 1.869 5.029 0.481 1.753 3.683 3.893 150 0.668 POOR 268 268 0.00% 0.617 1.906 3.310 0.904 1.946 2.877 3.023 200 0.544 POOR 226 226 0.00% 0.794 2.700 6.584 1.502 2.555 4.052 4.378 * Apdex 1.5
Req: 002, get, url /index
CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 14 14 0.00% 0.896 0.921 0.970 0.896 0.902 0.965 0.970 5 0.776 FAIR 58 58 0.00% 0.902 1.466 2.614 0.921 1.395 2.139 2.374 10 0.700 FAIR 95 95 0.00% 0.921 2.168 4.639 0.995 1.934 4.137 4.439 50 0.149 UNACCEPTABLE 151 151 0.00% 0.939 10.847 20.777 1.985 10.159 19.548 20.021 100 0.090 UNACCEPTABLE 233 233 0.00% 1.189 15.917 26.741 2.859 18.125 23.902 24.905 150 0.005 UNACCEPTABLE 283 283 0.00% 4.674 22.919 33.489 13.434 24.192 30.656 31.545 200 0.000 UNACCEPTABLE 251 251 0.00% 15.971 25.921 35.700 18.300 26.607 32.931 33.642 * Apdex 1.5
7.3 PAGE 003: Get paper
Req: 001, get, url /paper?id=1
CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 14 14 0.00% 0.157 0.162 0.178 0.158 0.159 0.178 0.178 5 1.000 Excellent 59 59 0.00% 0.156 0.188 0.574 0.157 0.160 0.257 0.367 10 1.000 Excellent 91 91 0.00% 0.156 0.290 0.828 0.159 0.192 0.596 0.735 50 0.953 Excellent 150 150 0.00% 0.159 0.653 7.272 0.177 0.272 1.470 2.613 100 0.814 FAIR 234 234 0.00% 0.163 1.331 4.943 0.218 0.987 3.072 3.596 150 0.958 Excellent 286 286 0.00% 0.171 0.917 2.329 0.456 0.865 1.473 1.687 200 0.662 POOR 250 250 0.00% 0.808 1.881 4.751 1.225 1.702 2.821 3.615 * Apdex 1.5
7.4 PAGE 004: Get /accounts/logout/
Req: 001, get, url /accounts/logout/
CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 13 13 0.00% 0.159 0.169 0.181 0.159 0.171 0.181 0.181 5 1.000 Excellent 59 59 0.00% 0.158 0.187 0.429 0.159 0.165 0.270 0.341 10 1.000 Excellent 90 90 0.00% 0.158 0.259 0.788 0.160 0.188 0.516 0.606 50 0.960 Excellent 150 150 0.00% 0.161 0.554 5.001 0.166 0.224 1.213 3.348 100 0.855 Good 234 234 0.00% 0.164 1.027 3.870 0.199 0.721 2.392 2.749 150 0.991 Excellent 287 287 0.00% 0.210 0.670 1.773 0.358 0.640 1.007 1.154 200 0.811 FAIR 243 243 0.00% 0.803 1.522 4.437 0.935 1.371 2.300 3.068 * Apdex 1.5
Req: 002, get, url /accounts/login/
CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 13 13 0.00% 0.146 0.154 0.168 0.146 0.158 0.159 0.168 5 1.000 Excellent 59 59 0.00% 0.145 0.156 0.183 0.146 0.150 0.169 0.175 10 1.000 Excellent 92 92 0.00% 0.146 0.172 0.310 0.147 0.160 0.201 0.263 50 1.000 Excellent 151 151 0.00% 0.145 0.215 0.720 0.149 0.168 0.340 0.595 100 1.000 Excellent 233 233 0.00% 0.147 0.258 0.598 0.153 0.225 0.420 0.468 150 1.000 Excellent 292 292 0.00% 0.154 0.233 0.784 0.171 0.222 0.296 0.350 200 0.920 Good 249 249 0.00% 0.340 1.035 3.765 0.446 0.779 1.755 3.058 * Apdex 1.5
7.5 PAGE 005: Get /accounts/logout/
Req: 001, get, url /accounts/logout/
CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 13 13 0.00% 0.157 0.163 0.178 0.158 0.160 0.171 0.178 5 1.000 Excellent 59 59 0.00% 0.156 0.197 0.403 0.158 0.169 0.305 0.338 10 1.000 Excellent 93 93 0.00% 0.155 0.244 0.904 0.159 0.176 0.439 0.653 50 0.914 Good 151 151 0.00% 0.158 0.761 4.784 0.170 0.269 2.823 3.546 100 0.863 Good 227 227 0.00% 0.163 0.999 3.471 0.204 0.813 2.094 2.374 150 0.997 Excellent 291 291 0.00% 0.199 0.621 1.864 0.348 0.571 0.943 1.109 200 0.825 FAIR 265 265 0.00% 0.706 1.573 4.215 0.885 1.277 3.182 3.650 * Apdex 1.5
Req: 002, get, url /accounts/login/
CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95 1 1.000 Excellent 13 13 0.00% 0.146 0.154 0.168 0.147 0.148 0.167 0.168 5 1.000 Excellent 59 59 0.00% 0.146 0.153 0.211 0.146 0.148 0.166 0.173 10 1.000 Excellent 92 92 0.00% 0.144 0.168 0.258 0.146 0.159 0.219 0.232 50 1.000 Excellent 151 151 0.00% 0.145 0.236 0.913 0.149 0.169 0.459 0.612 100 1.000 Excellent 225 225 0.00% 0.146 0.263 0.611 0.157 0.249 0.391 0.430 150 1.000 Excellent 289 289 0.00% 0.148 0.230 0.425 0.176 0.218 0.307 0.341 200 0.910 Good 262 262 0.00% 0.322 1.079 3.995 0.471 0.777 2.359 2.904 * Apdex 1.5
8 Definitions
CUs: Concurrent users or number of concurrent threads executing tests.
Request: a single GET/POST/redirect/xmlrpc request.
Page: a request with redirects and resource links (image, css, js) for an html page.
STPS: Successful tests per second.
SPPS: Successful pages per second.
RPS: Requests per second, successful or not.
maxSPPS: Maximum SPPS during the cycle.
maxRPS: Maximum RPS during the cycle.
MIN: Minimum response time for a page or request.
AVG: Average response time for a page or request.
MAX: Maximmum response time for a page or request.
P10: 10th percentile, response time where 10 percent of pages or requests are delivered.
MED: Median or 50th percentile, response time where half of pages or requests are delivered.
P90: 90th percentile, response time where 90 percent of pages or requests are delivered.
P95: 95th percentile, response time where 95 percent of pages or requests are delivered.
Apdex T: Application Performance Index, this is a numerical measure of user satisfaction, it is based on three zones of application responsiveness:
Satisfied: The user is fully productive. This represents the time value (T seconds) below which users are not impeded by application response time.
Tolerating: The user notices performance lagging within responses greater than T, but continues the process.
Frustrated: Performance with a response time greater than 4*T seconds is unacceptable, and users may abandon the process.
By default T is set to 1.5s this means that response time between 0 and 1.5s the user is fully productive, between 1.5 and 6s the responsivness is tolerating and above 6s the user is frustrated.
The Apdex score converts many measurements into one number on a uniform scale of 0-to-1 (0 = no users satisfied, 1 = all users satisfied).
Visit http://www.apdex.org/ for more information.
Rating: To ease interpretation the Apdex score is also represented as a rating:
- U for UNACCEPTABLE represented in gray for a score between 0 and 0.5
- P for POOR represented in red for a score between 0.5 and 0.7
- F for FAIR represented in yellow for a score between 0.7 and 0.85
- G for Good represented in green for a score between 0.85 and 0.94
- E for Excellent represented in blue for a score between 0.94 and 1.
Report generated with FunkLoad 1.16.1, more information available on the FunkLoad site.