FunkLoad bench report

Date: 2014-11-13 12:07:08

Abstract

Simply testing a default static page Bench result of ConfDBScaling.test_view_paper: No test description

Table of contents

1   Bench configuration

2   Bench content

The test ConfDBScaling.test_view_paper contains:

The bench contains:

3   Test stats

The number of Successful Tests Per Second (STPS) over Concurrent Users (CUs).

tests.png
CUs STPS TOTAL SUCCESS ERROR
100 16.440 822 822 0.00%
200 20.460 1023 1023 0.00%
300 23.700 1185 1185 0.00%
400 21.420 1071 1071 0.00%
500 20.640 1032 1032 0.00%
600 20.340 1017 1017 0.00%
700 21.220 1061 1061 0.00%
800 22.480 1134 1124 0.88%
900 21.980 1099 1099 0.00%
1000 22.240 1135 1112 2.03%

4   Page stats

The number of Successful Pages Per Second (SPPS) over Concurrent Users (CUs). Note that an XML RPC call count like a page.

pages_spps.png pages.png
CUs Apdex* Rating SPPS maxSPPS TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
100 0.980 Excellent 154.780 202.000 7739 7739 0.00% 0.143 0.508 3.563 0.175 0.368 1.030 1.387
200 0.947 Excellent 190.120 288.000 9506 9506 0.00% 0.148 0.784 5.970 0.280 0.533 1.574 2.674
300 0.929 Good 219.480 444.000 10974 10974 0.00% 0.147 1.005 5.994 0.324 0.789 1.970 2.973
400 0.866 Good 195.780 440.000 9789 9789 0.00% 0.149 1.268 5.576 0.447 1.015 2.541 3.290
500 0.813 FAIR 190.640 597.000 9532 9532 0.00% 0.150 1.547 9.054 0.445 1.144 3.258 4.367
600 0.739 FAIR 199.140 669.000 9957 9957 0.00% 0.149 1.852 11.972 0.433 1.490 3.846 4.793
700 0.687 POOR 196.300 783.000 9815 9815 0.00% 0.159 2.208 18.052 0.525 1.821 4.672 5.495
800 0.663 POOR 205.800 783.000 10323 10290 0.32% 0.149 2.555 11.061 0.516 1.974 5.334 7.127
900 0.821 FAIR 211.600 446.000 10580 10580 0.00% 0.156 1.530 18.168 0.410 1.052 3.182 4.622
1000 0.653 POOR 210.480 832.000 10593 10524 0.65% 0.157 2.594 10.691 0.464 1.887 6.011 7.315

* Apdex 1.5

5   Request stats

The number of Requests Per Second (RPS) successful or not over Concurrent Users (CUs).

requests_rps.png requests.png
CUs Apdex* Rating* RPS maxRPS TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
100 0.980 Excellent 154.780 202.000 7739 7739 0.00% 0.143 0.508 3.563 0.175 0.368 1.030 1.387
200 0.947 Excellent 190.120 288.000 9506 9506 0.00% 0.148 0.784 5.970 0.280 0.533 1.574 2.674
300 0.929 Good 219.480 444.000 10974 10974 0.00% 0.147 1.005 5.994 0.324 0.789 1.970 2.973
400 0.866 Good 195.780 440.000 9789 9789 0.00% 0.149 1.268 5.576 0.447 1.015 2.541 3.290
500 0.813 FAIR 190.640 597.000 9532 9532 0.00% 0.150 1.547 9.054 0.445 1.144 3.258 4.367
600 0.739 FAIR 199.140 669.000 9957 9957 0.00% 0.149 1.852 11.972 0.433 1.490 3.846 4.793
700 0.687 POOR 196.300 783.000 9815 9815 0.00% 0.159 2.208 18.052 0.525 1.821 4.672 5.495
800 0.663 POOR 206.460 784.000 10323 10290 0.32% 0.149 2.561 11.061 0.515 1.973 5.329 7.112
900 0.821 FAIR 211.600 446.000 10580 10580 0.00% 0.156 1.530 18.168 0.410 1.052 3.182 4.622
1000 0.653 POOR 211.860 841.000 10593 10524 0.65% 0.157 2.606 10.691 0.463 1.883 5.999 7.305

* Apdex 1.5

6   Slowest requests

The 5 slowest average response time during the best cycle with 300 CUs:

7   Page detail stats

7.1   PAGE 001: Get index

  • Req: 001, get, url /index

    request_001.001.png
    CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
    100 0.986 Excellent 866 866 0.00% 0.143 0.448 2.213 0.161 0.329 0.838 1.083
    200 0.975 Excellent 1054 1054 0.00% 0.148 0.495 2.369 0.230 0.403 0.739 1.498
    300 0.975 Excellent 1200 1200 0.00% 0.150 0.695 3.741 0.305 0.611 1.011 1.551
    400 0.913 Good 1103 1103 0.00% 0.170 1.071 4.281 0.395 0.905 2.156 2.707
    500 0.802 FAIR 1060 1060 0.00% 0.181 1.578 7.926 0.388 1.113 3.508 4.332
    600 0.771 FAIR 1095 1095 0.00% 0.150 1.745 9.383 0.417 1.359 3.669 4.237
    700 0.731 FAIR 1129 1129 0.00% 0.180 1.933 8.985 0.581 1.547 4.015 4.535
    800 0.687 POOR 1059 1059 0.00% 0.158 2.301 11.061 0.607 1.781 4.778 5.973
    900 0.921 Good 1122 1122 0.00% 0.158 1.015 15.648 0.306 0.671 2.085 2.725
    1000 0.705 FAIR 1117 1117 0.00% 0.157 2.326 9.707 0.369 1.671 5.219 6.366

    * Apdex 1.5

  • Req: 002, get, url /accounts/login/?next=/index

    request_001.002.png
    CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
    100 0.974 Excellent 872 872 0.00% 0.144 0.489 2.523 0.168 0.366 0.804 1.677
    200 0.963 Excellent 1087 1087 0.00% 0.153 0.674 3.282 0.270 0.507 1.010 2.408
    300 0.977 Excellent 1181 1181 0.00% 0.155 0.785 4.926 0.304 0.697 1.227 1.453
    400 0.902 Good 1108 1108 0.00% 0.164 1.121 3.941 0.424 1.026 1.862 2.354
    500 0.848 FAIR 1056 1056 0.00% 0.163 1.312 5.293 0.459 0.995 2.557 3.461
    600 0.799 FAIR 1085 1085 0.00% 0.156 1.462 6.595 0.403 1.181 2.901 3.884
    700 0.754 FAIR 1116 1116 0.00% 0.163 1.695 7.647 0.383 1.467 3.298 4.290
    800 0.724 FAIR 1147 1147 0.00% 0.149 2.206 10.449 0.435 1.640 4.340 5.420
    900 0.855 Good 1232 1232 0.00% 0.156 1.410 15.787 0.418 0.876 2.663 4.318
    1000 0.736 FAIR 1150 1150 0.00% 0.159 2.130 10.538 0.462 1.455 4.701 5.827

    * Apdex 1.5

7.2   PAGE 002: Post /accounts/login/

  • Req: 001, post, url /accounts/login/?next=/index

    request_002.001.png
    CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
    100 0.954 Excellent 893 893 0.00% 0.266 0.918 3.563 0.417 0.821 1.479 1.797
    200 0.682 POOR 1051 1051 0.00% 0.376 2.231 5.970 0.850 2.189 3.691 4.267
    300 0.614 POOR 1227 1227 0.00% 0.313 2.511 5.994 1.134 2.574 3.828 4.422
    400 0.607 POOR 1104 1104 0.00% 0.333 2.567 5.576 1.038 2.514 4.086 4.435
    500 0.536 POOR 1055 1055 0.00% 0.314 3.352 9.054 1.091 3.246 5.881 6.827
    600 0.505 POOR 1194 1194 0.00% 0.322 3.631 11.972 1.208 3.382 6.558 7.278
    700 0.480 UNACCEPTABLE 1136 1136 0.00% 0.320 4.069 13.142 1.533 4.160 6.162 6.693
    800 0.438 UNACCEPTABLE 1132 1121 0.97% 0.400 4.379 10.700 1.415 4.108 7.780 9.538
    900 0.560 POOR 1203 1203 0.00% 0.381 3.017 17.510 1.076 2.507 5.501 6.153
    1000 0.402 UNACCEPTABLE 1194 1171 1.93% 0.328 4.550 10.691 1.197 4.427 8.259 8.867

    * Apdex 1.5

7.3   PAGE 003: Get paper

  • Req: 001, get, url /paper?id=0fcKOflDJSAyUrT1BaKOMBfFVQ1Oi57p

    request_003.001.png
    CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
    100 0.991 Excellent 879 879 0.00% 0.143 0.361 2.176 0.166 0.265 0.636 0.995
    200 0.990 Excellent 1059 1059 0.00% 0.153 0.457 2.682 0.245 0.397 0.667 0.742
    300 0.987 Excellent 1224 1224 0.00% 0.151 0.616 3.537 0.269 0.539 0.945 1.077
    400 0.952 Excellent 1085 1085 0.00% 0.174 0.888 3.583 0.376 0.714 1.463 2.355
    500 0.855 Good 1086 1086 0.00% 0.187 1.360 7.682 0.464 1.117 2.522 3.482
    600 0.809 FAIR 1186 1186 0.00% 0.172 1.574 10.075 0.377 1.317 3.067 4.175
    700 0.731 FAIR 1104 1104 0.00% 0.203 1.826 7.702 0.481 1.573 3.460 4.364
    800 0.771 FAIR 1115 1104 0.99% 0.164 1.881 10.018 0.371 1.186 4.259 6.942
    900 0.906 Good 1213 1213 0.00% 0.157 1.082 15.850 0.362 0.729 2.155 2.916
    1000 0.672 POOR 1206 1183 1.91% 0.168 2.351 10.111 0.454 1.872 4.666 6.245

    * Apdex 1.5

  • Req: 002, get, url /accounts/login/?next=/paper%3Fid%3D0fcKOflDJSAyUrT1BaKOMBfFVQ1Oi57p

    request_003.002.png
    CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
    100 0.984 Excellent 870 870 0.00% 0.144 0.396 2.445 0.163 0.299 0.612 0.988
    200 0.993 Excellent 1068 1068 0.00% 0.152 0.568 3.312 0.273 0.494 0.881 1.027
    300 0.984 Excellent 1216 1216 0.00% 0.147 0.671 4.725 0.271 0.572 1.053 1.230
    400 0.928 Good 1064 1064 0.00% 0.149 1.012 4.700 0.406 0.821 1.639 2.260
    500 0.893 Good 1066 1066 0.00% 0.154 1.146 7.923 0.386 0.908 2.106 2.714
    600 0.825 FAIR 1163 1163 0.00% 0.152 1.381 9.474 0.357 1.051 2.817 3.738
    700 0.711 FAIR 1024 1024 0.00% 0.172 1.993 7.336 0.415 1.690 4.451 5.057
    800 0.711 FAIR 1057 1046 1.04% 0.157 2.202 10.156 0.476 1.641 4.439 5.930
    900 0.880 Good 1195 1195 0.00% 0.182 1.229 9.598 0.388 0.825 2.339 3.716
    1000 0.749 FAIR 1258 1235 1.83% 0.185 2.019 9.832 0.406 1.243 5.530 6.464

    * Apdex 1.5

7.4   PAGE 004: Get /accounts/logout/

  • Req: 001, get, url /accounts/logout/

    request_004.001.png
    CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
    100 0.987 Excellent 853 853 0.00% 0.152 0.548 2.242 0.189 0.419 1.045 1.303
    200 0.982 Excellent 1064 1064 0.00% 0.177 0.701 2.699 0.351 0.621 1.141 1.325
    300 0.947 Excellent 1244 1244 0.00% 0.164 1.061 3.834 0.475 1.004 1.523 2.469
    400 0.825 FAIR 1102 1102 0.00% 0.203 1.355 4.269 0.566 1.249 2.279 2.910
    500 0.808 FAIR 1064 1064 0.00% 0.161 1.456 7.730 0.451 1.290 2.586 3.258
    600 0.703 FAIR 1148 1148 0.00% 0.165 1.806 10.883 0.496 1.659 3.041 4.004
    700 0.681 POOR 1093 1093 0.00% 0.163 2.157 18.052 0.704 1.889 3.771 5.018
    800 0.637 POOR 1138 1138 0.00% 0.180 2.594 10.451 0.661 2.195 4.924 6.891
    900 0.806 FAIR 1162 1162 0.00% 0.163 1.557 18.168 0.489 1.269 2.748 3.904
    1000 0.626 POOR 1182 1182 0.00% 0.173 2.585 9.998 0.484 2.036 5.635 6.717

    * Apdex 1.5

  • Req: 002, get, url /accounts/login/

    request_004.002.png
    CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
    100 0.987 Excellent 844 844 0.00% 0.144 0.382 2.531 0.167 0.323 0.554 0.729
    200 0.998 Excellent 1056 1056 0.00% 0.148 0.505 2.973 0.274 0.449 0.793 0.899
    300 0.978 Excellent 1244 1244 0.00% 0.150 0.813 4.734 0.323 0.747 1.230 1.438
    400 0.943 Excellent 1079 1079 0.00% 0.162 0.952 4.296 0.406 0.823 1.590 1.930
    500 0.911 Good 1056 1056 0.00% 0.150 1.061 7.727 0.399 0.937 1.794 2.308
    600 0.779 FAIR 1050 1050 0.00% 0.152 1.469 7.506 0.424 1.270 2.696 3.404
    700 0.729 FAIR 1054 1054 0.00% 0.162 1.886 7.450 0.520 1.565 3.713 4.836
    800 0.689 POOR 1243 1243 0.00% 0.161 2.499 10.454 0.481 1.859 5.206 8.651
    900 0.839 FAIR 1188 1188 0.00% 0.193 1.454 16.164 0.417 1.035 2.898 4.046
    1000 0.714 FAIR 1174 1174 0.00% 0.225 2.219 9.820 0.451 1.483 5.614 6.491

    * Apdex 1.5

7.5   PAGE 005: Get /accounts/logout/

  • Req: 001, get, url /accounts/logout/

    request_005.001.png
    CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
    100 0.976 Excellent 835 835 0.00% 0.157 0.637 2.195 0.198 0.533 1.157 1.486
    200 0.958 Excellent 1042 1042 0.00% 0.215 0.877 3.127 0.394 0.780 1.461 1.726
    300 0.914 Good 1234 1234 0.00% 0.176 1.143 3.498 0.555 1.108 1.684 1.965
    400 0.766 FAIR 1069 1069 0.00% 0.198 1.521 4.410 0.596 1.427 2.588 3.071
    500 0.752 FAIR 1052 1052 0.00% 0.209 1.630 7.758 0.565 1.474 2.802 3.635
    600 0.679 POOR 1031 1031 0.00% 0.165 1.944 11.968 0.704 1.778 3.373 4.217
    700 0.627 POOR 1093 1093 0.00% 0.163 2.458 17.991 0.886 2.204 4.546 5.301
    800 0.586 POOR 1221 1221 0.00% 0.177 2.726 10.476 0.944 2.333 4.630 6.134
    900 0.756 FAIR 1143 1143 0.00% 0.204 1.650 16.117 0.538 1.451 2.835 3.505
    1000 0.567 POOR 1143 1143 0.00% 0.193 2.956 10.506 0.559 2.398 6.054 7.806

    * Apdex 1.5

  • Req: 002, get, url /accounts/login/

    request_005.002.png
    CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95
    100 0.983 Excellent 827 827 0.00% 0.145 0.379 2.168 0.170 0.311 0.556 0.746
    200 0.986 Excellent 1025 1025 0.00% 0.158 0.560 3.366 0.278 0.464 0.772 0.930
    300 0.988 Excellent 1204 1204 0.00% 0.148 0.727 3.999 0.299 0.667 1.159 1.298
    400 0.963 Excellent 1075 1075 0.00% 0.166 0.902 4.533 0.409 0.810 1.391 1.622
    500 0.906 Good 1037 1037 0.00% 0.160 1.029 5.566 0.379 0.867 1.877 2.425
    600 0.793 FAIR 1005 1005 0.00% 0.149 1.504 7.456 0.400 1.122 3.148 4.465
    700 0.747 FAIR 1066 1066 0.00% 0.159 1.773 8.104 0.427 1.486 3.498 4.833
    800 0.731 FAIR 1211 1211 0.00% 0.152 2.234 10.271 0.421 1.385 4.885 7.158
    900 0.874 Good 1122 1122 0.00% 0.176 1.315 16.238 0.415 0.909 2.644 3.804
    1000 0.704 FAIR 1169 1169 0.00% 0.194 2.315 9.799 0.437 1.548 5.613 6.236

    * Apdex 1.5

8   Failures and Errors

8.1   Failures

  • 34 time(s), code: 200:

    No traceback.
    
  • 34 time(s), code: 302:

    No traceback.
    

8.2   Errors

  • 34 time(s), code: -1:

    Traceback (most recent call last):
    
    File "/usr/local/lib/python2.7/dist-packages/funkload-1.16.1-py2.7.egg/funkload/FunkLoadTestCase.py", line 202, in _connect
    cert_file=self._certfile_path, method=rtype)
    
    File "/usr/local/lib/python2.7/dist-packages/funkload-1.16.1-py2.7.egg/funkload/PatchWebunit.py", line 385, in WF_fetch
    errcode, errmsg, headers = h.getreply()
    
    File "/usr/lib/python2.7/httplib.py", line 1117, in getreply
    response = self._conn.getresponse()
    
    File "/usr/lib/python2.7/httplib.py", line 1045, in getresponse
    response.begin()
    
    File "/usr/lib/python2.7/httplib.py", line 409, in begin
    version, status, reason = self._read_status()
    
    File "/usr/lib/python2.7/httplib.py", line 365, in _read_status
    line = self.fp.readline(_MAXLINE + 1)
    
    File "/usr/lib/python2.7/socket.py", line 476, in readline
    data = self._sock.recv(self._rbufsize)
    

System Message: WARNING/2 (/home/jeanyang/code/jeeves/test/web/conf/dbscaling/report/papers-withpolicies/test_view_paper-20141113T120708/index.rst, line 388)

Bullet list ends without a blank line; unexpected unindent.
error: [Errno 104] Connection reset by peer

9   Definitions

Report generated with FunkLoad 1.16.1, more information available on the FunkLoad site.