FunkLoad bench report

Date: 2014-11-13 11:48:29

Abstract

Simply testing a default static page Bench result of ConfDBScaling.test_view_paper: No test description

Table of contents

1   Bench configuration

2   Bench content

The test ConfDBScaling.test_view_paper contains:

The bench contains:

3   Test stats

The number of Successful Tests Per Second (STPS) over Concurrent Users (CUs).

tests.png
CUs STPS TOTAL SUCCESS ERROR
8 2.780 139 139 0.00%
16 5.420 271 271 0.00%
32 8.820 441 441 0.00%
64 14.140 707 707 0.00%
128 18.920 946 946 0.00%
256 22.320 1116 1116 0.00%
516 21.900 1095 1095 0.00%
1024 20.160 1024 1008 1.56%

4   Page stats

The number of Successful Pages Per Second (SPPS) over Concurrent Users (CUs). Note that an XML RPC call count like a page.

pages_spps.png pages.png
CUs Apdex* Rating SPPS maxSPPS TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
8 1.000 Excellent 25.740 33.000 1287 1287 0.00% 0.143 0.174 1.141 0.144 0.147 0.266 0.282
16 1.000 Excellent 50.160 61.000 2508 2508 0.00% 0.142 0.179 0.732 0.144 0.152 0.271 0.310
32 1.000 Excellent 81.280 105.000 4064 4064 0.00% 0.143 0.251 1.448 0.146 0.179 0.429 0.576
64 0.999 Excellent 131.060 188.000 6553 6553 0.00% 0.142 0.349 2.059 0.151 0.253 0.708 0.872
128 0.972 Excellent 178.700 234.000 8935 8935 0.00% 0.144 0.567 3.177 0.189 0.417 1.186 1.562
256 0.936 Good 205.620 343.000 10281 10281 0.00% 0.147 0.927 5.941 0.335 0.651 2.021 3.182
516 0.810 FAIR 195.220 533.000 9761 9761 0.00% 0.148 1.551 10.236 0.385 1.101 3.405 4.505
1024 0.669 POOR 198.680 731.000 9986 9934 0.52% 0.147 2.756 38.778 0.514 1.790 5.834 7.885

* Apdex 1.5

5   Request stats

The number of Requests Per Second (RPS) successful or not over Concurrent Users (CUs).

requests_rps.png requests.png
CUs Apdex* Rating* RPS maxRPS TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
8 1.000 Excellent 25.740 33.000 1287 1287 0.00% 0.143 0.174 1.141 0.144 0.147 0.266 0.282
16 1.000 Excellent 50.160 61.000 2508 2508 0.00% 0.142 0.179 0.732 0.144 0.152 0.271 0.310
32 1.000 Excellent 81.280 105.000 4064 4064 0.00% 0.143 0.251 1.448 0.146 0.179 0.429 0.576
64 0.999 Excellent 131.060 188.000 6553 6553 0.00% 0.142 0.349 2.059 0.151 0.253 0.708 0.872
128 0.972 Excellent 178.700 234.000 8935 8935 0.00% 0.144 0.567 3.177 0.189 0.417 1.186 1.562
256 0.936 Good 205.620 343.000 10281 10281 0.00% 0.147 0.927 5.941 0.335 0.651 2.021 3.182
516 0.810 FAIR 195.220 533.000 9761 9761 0.00% 0.148 1.551 10.236 0.385 1.101 3.405 4.505
1024 0.669 POOR 199.720 731.000 9986 9934 0.52% 0.000 2.766 38.778 0.512 1.784 5.832 7.867

* Apdex 1.5

6   Slowest requests

The 5 slowest average response time during the best cycle with 256 CUs:

7   Page detail stats

7.1   PAGE 001: Get index

  • Req: 001, get, url /index

    request_001.001.png
    CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
    8 1.000 Excellent 147 147 0.00% 0.143 0.194 1.039 0.143 0.144 0.177 0.951
    16 1.000 Excellent 279 279 0.00% 0.143 0.154 0.423 0.143 0.144 0.167 0.198
    32 1.000 Excellent 451 451 0.00% 0.143 0.229 0.820 0.144 0.166 0.393 0.517
    64 1.000 Excellent 722 722 0.00% 0.142 0.326 1.278 0.145 0.247 0.614 0.707
    128 0.984 Excellent 988 988 0.00% 0.144 0.439 2.170 0.172 0.348 0.722 1.136
    256 0.981 Excellent 1129 1129 0.00% 0.162 0.619 3.745 0.293 0.511 1.020 1.235
    516 0.879 Good 1096 1096 0.00% 0.148 1.164 6.264 0.303 0.849 2.485 3.255
    1024 0.691 POOR 1088 1088 0.00% 0.160 2.791 35.668 0.527 1.613 5.308 8.242

    * Apdex 1.5

  • Req: 002, get, url /accounts/login/?next=/index

    request_001.002.png
    CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
    8 1.000 Excellent 147 147 0.00% 0.144 0.160 0.334 0.145 0.146 0.175 0.227
    16 1.000 Excellent 282 282 0.00% 0.144 0.167 0.482 0.145 0.147 0.217 0.245
    32 1.000 Excellent 456 456 0.00% 0.144 0.232 1.219 0.146 0.169 0.429 0.531
    64 0.995 Excellent 724 724 0.00% 0.144 0.335 2.059 0.149 0.242 0.622 0.812
    128 0.982 Excellent 1011 1011 0.00% 0.145 0.491 3.002 0.198 0.398 0.760 0.949
    256 0.979 Excellent 1121 1121 0.00% 0.150 0.757 4.124 0.342 0.627 1.107 1.383
    516 0.818 FAIR 1064 1064 0.00% 0.160 1.411 10.232 0.394 1.021 2.771 3.688
    1024 0.717 FAIR 1176 1176 0.00% 0.175 2.514 38.261 0.385 1.500 5.495 7.216

    * Apdex 1.5

7.2   PAGE 002: Post /accounts/login/

  • Req: 001, post, url /accounts/login/?next=/index

    request_002.001.png
    CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
    8 1.000 Excellent 143 143 0.00% 0.264 0.286 0.536 0.265 0.273 0.314 0.357
    16 1.000 Excellent 281 281 0.00% 0.265 0.328 0.732 0.267 0.294 0.450 0.519
    32 1.000 Excellent 462 462 0.00% 0.266 0.519 1.448 0.286 0.433 0.909 1.064
    64 0.999 Excellent 749 749 0.00% 0.267 0.656 2.052 0.314 0.639 1.031 1.177
    128 0.904 Good 1021 1021 0.00% 0.290 1.094 3.177 0.472 0.976 1.793 2.363
    256 0.598 POOR 1156 1156 0.00% 0.440 2.632 5.941 1.152 2.861 3.764 4.034
    516 0.579 POOR 1082 1082 0.00% 0.374 3.154 10.236 0.971 3.053 5.540 6.158
    1024 0.403 UNACCEPTABLE 1169 1154 1.28% 0.413 5.177 38.727 1.381 5.024 8.360 9.908

    * Apdex 1.5

7.3   PAGE 003: Get paper

  • Req: 001, get, url /paper?id=0fcKOflDJSAyUrT1BaKOMBfFVQ1Oi57p

    request_003.001.png
    CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
    8 1.000 Excellent 143 143 0.00% 0.143 0.147 0.201 0.144 0.144 0.163 0.165
    16 1.000 Excellent 280 280 0.00% 0.142 0.153 0.310 0.143 0.144 0.170 0.198
    32 1.000 Excellent 456 456 0.00% 0.143 0.203 1.276 0.144 0.165 0.310 0.346
    64 1.000 Excellent 746 746 0.00% 0.143 0.237 0.706 0.145 0.204 0.394 0.469
    128 0.989 Excellent 1016 1016 0.00% 0.144 0.380 2.351 0.163 0.295 0.614 0.911
    256 0.990 Excellent 1155 1155 0.00% 0.156 0.551 2.607 0.289 0.502 0.796 0.919
    516 0.921 Good 1076 1076 0.00% 0.150 1.011 9.887 0.344 0.783 2.054 2.546
    1024 0.718 FAIR 1142 1120 1.93% 0.000 2.565 38.342 0.441 1.444 5.154 7.629

    * Apdex 1.5

  • Req: 002, get, url /accounts/login/?next=/paper%3Fid%3D0fcKOflDJSAyUrT1BaKOMBfFVQ1Oi57p

    request_003.002.png
    CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
    8 1.000 Excellent 143 143 0.00% 0.144 0.150 0.215 0.145 0.146 0.165 0.167
    16 1.000 Excellent 278 278 0.00% 0.144 0.159 0.341 0.145 0.147 0.193 0.216
    32 1.000 Excellent 456 456 0.00% 0.144 0.208 1.028 0.146 0.167 0.309 0.377
    64 0.999 Excellent 741 741 0.00% 0.144 0.274 1.777 0.148 0.232 0.478 0.570
    128 0.985 Excellent 1015 1015 0.00% 0.145 0.437 3.017 0.185 0.352 0.647 0.897
    256 0.993 Excellent 1144 1144 0.00% 0.149 0.628 3.848 0.313 0.579 0.921 1.094
    516 0.893 Good 1069 1069 0.00% 0.183 1.090 10.088 0.381 0.709 2.372 2.904
    1024 0.722 FAIR 1153 1139 1.21% 0.156 2.318 35.643 0.448 1.470 5.219 6.632

    * Apdex 1.5

7.4   PAGE 004: Get /accounts/logout/

  • Req: 001, get, url /accounts/logout/

    request_004.001.png
    CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
    8 1.000 Excellent 143 143 0.00% 0.150 0.157 0.259 0.151 0.151 0.172 0.178
    16 1.000 Excellent 278 278 0.00% 0.149 0.165 0.404 0.151 0.153 0.187 0.233
    32 1.000 Excellent 452 452 0.00% 0.150 0.242 1.289 0.152 0.176 0.385 0.543
    64 1.000 Excellent 728 728 0.00% 0.150 0.364 1.231 0.156 0.258 0.746 0.878
    128 0.978 Excellent 994 994 0.00% 0.152 0.654 2.684 0.218 0.523 1.243 1.449
    256 0.974 Excellent 1154 1154 0.00% 0.159 0.813 3.845 0.397 0.738 1.254 1.520
    516 0.779 FAIR 1070 1070 0.00% 0.181 1.709 10.193 0.471 1.324 3.431 4.752
    1024 0.695 POOR 1089 1089 0.00% 0.191 2.292 38.778 0.589 1.638 4.469 5.623

    * Apdex 1.5

  • Req: 002, get, url /accounts/login/

    request_004.002.png
    CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
    8 1.000 Excellent 143 143 0.00% 0.144 0.157 1.141 0.145 0.146 0.161 0.167
    16 1.000 Excellent 277 277 0.00% 0.144 0.157 0.371 0.145 0.147 0.178 0.210
    32 1.000 Excellent 446 446 0.00% 0.144 0.192 0.547 0.146 0.167 0.285 0.316
    64 1.000 Excellent 724 724 0.00% 0.144 0.257 0.878 0.149 0.217 0.440 0.534
    128 0.983 Excellent 988 988 0.00% 0.145 0.429 2.665 0.172 0.352 0.616 0.785
    256 0.986 Excellent 1162 1162 0.00% 0.147 0.678 3.959 0.303 0.580 1.004 1.127
    516 0.816 FAIR 1061 1061 0.00% 0.186 1.534 10.151 0.417 1.049 2.913 4.397
    1024 0.737 FAIR 1079 1079 0.00% 0.179 2.262 38.345 0.461 1.378 5.349 6.320

    * Apdex 1.5

7.5   PAGE 005: Get /accounts/logout/

  • Req: 001, get, url /accounts/logout/

    request_005.001.png
    CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
    8 1.000 Excellent 139 139 0.00% 0.153 0.161 0.239 0.154 0.156 0.175 0.191
    16 1.000 Excellent 277 277 0.00% 0.153 0.170 0.346 0.155 0.158 0.206 0.239
    32 1.000 Excellent 444 444 0.00% 0.154 0.233 1.316 0.156 0.180 0.348 0.444
    64 1.000 Excellent 710 710 0.00% 0.154 0.434 1.307 0.161 0.337 0.865 0.944
    128 0.963 Excellent 953 953 0.00% 0.157 0.750 2.707 0.224 0.654 1.391 1.663
    256 0.933 Good 1140 1140 0.00% 0.185 1.009 4.011 0.483 0.905 1.585 1.996
    516 0.728 FAIR 1117 1117 0.00% 0.196 1.749 10.172 0.474 1.588 3.181 3.792
    1024 0.632 POOR 1059 1058 0.09% 0.005 2.520 31.717 0.649 1.997 4.492 6.873

    * Apdex 1.5

  • Req: 002, get, url /accounts/login/

    request_005.002.png
    CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
    8 1.000 Excellent 139 139 0.00% 0.144 0.149 0.233 0.145 0.146 0.156 0.165
    16 1.000 Excellent 276 276 0.00% 0.144 0.155 0.374 0.145 0.147 0.167 0.197
    32 1.000 Excellent 441 441 0.00% 0.144 0.192 0.498 0.146 0.165 0.283 0.315
    64 1.000 Excellent 709 709 0.00% 0.144 0.251 0.917 0.151 0.218 0.397 0.469
    128 0.982 Excellent 949 949 0.00% 0.145 0.427 2.509 0.173 0.357 0.613 0.757
    256 0.990 Excellent 1120 1120 0.00% 0.149 0.634 4.508 0.314 0.560 0.933 1.057
    516 0.879 Good 1126 1126 0.00% 0.150 1.140 9.969 0.344 0.795 2.475 3.079
    1024 0.715 FAIR 1031 1031 0.00% 0.181 2.298 17.333 0.454 1.556 5.547 6.354

    * Apdex 1.5

8   Failures and Errors

8.1   Failures

  • 14 time(s), code: 200:

    No traceback.
    
  • 21 time(s), code: 302:

    No traceback.
    

8.2   Errors

  • 17 time(s), code: -1:

    Traceback (most recent call last):
    
    File "/usr/local/lib/python2.7/dist-packages/funkload-1.16.1-py2.7.egg/funkload/FunkLoadTestCase.py", line 202, in _connect
    cert_file=self._certfile_path, method=rtype)
    
    File "/usr/local/lib/python2.7/dist-packages/funkload-1.16.1-py2.7.egg/funkload/PatchWebunit.py", line 385, in WF_fetch
    errcode, errmsg, headers = h.getreply()
    
    File "/usr/lib/python2.7/httplib.py", line 1117, in getreply
    response = self._conn.getresponse()
    
    File "/usr/lib/python2.7/httplib.py", line 1045, in getresponse
    response.begin()
    
    File "/usr/lib/python2.7/httplib.py", line 409, in begin
    version, status, reason = self._read_status()
    
    File "/usr/lib/python2.7/httplib.py", line 365, in _read_status
    line = self.fp.readline(_MAXLINE + 1)
    
    File "/usr/lib/python2.7/socket.py", line 476, in readline
    data = self._sock.recv(self._rbufsize)
    

System Message: WARNING/2 (/home/jeanyang/code/jeeves/test/web/conf/dbscaling/report/papers-withpolicies/test_view_paper-20141113T114829/index.rst, line 364)

Bullet list ends without a blank line; unexpected unindent.
error: [Errno 104] Connection reset by peer

9   Definitions

Report generated with FunkLoad 1.16.1, more information available on the FunkLoad site.