EcoSystem TermAppISO - 2020/12/16 NFT

From Code Magus Public Wiki
Jump to navigation Jump to search
Public / * Code Magus Limited

Code Magus Limited. Reg. no. 4024745 (England)


ABOUT SSL CERTIFICATES


Contents

Contributors

Nolo (talk) 14:53, 17 December 2020 (UTC) [1]


Summary

  • The following test(s) were included in this test session.
|LABEL                 |Description                           |Start               |End                 |
|:---------------------|:-------------------------------------|:-------------------|:-------------------|
|TermAppISONFT_IR      |TermAppISO Integrator Routing Changes |2020-12-16 10:00:00 |2020-12-16 11:21:00 |
|TermAppISO_IR_40Thrds |TermAppISO with 40 provider threads   |2020-12-16 14:24:00 |2020-12-16 15:45:00 |
|TermAppISO_IR_80Thrds |TermAppISO with 80 provider threads   |2020-12-16 16:04:00 |2020-12-16 17:25:00 |
  • For test TermAppISO Integrator Routing Changes/TermAppISONFT_IR (test 1, from 2020-12-16 10:00:00 to 2020-12-16 11:21:00) and for outcome disconnect, the following function(s) had response time(s) in excess of 1 second during the portion of the test where the load did not exceed the current production observed/projected peak.
|   |Basename                   |Outcome    | Count| Percent|  Resp| StdDev|
|:--|:--------------------------|:----------|-----:|-------:|-----:|------:|
|1  |authorisation_request_1100 |disconnect |     3|   0.015| 4.318|  0.124|
  • For test TermAppISO Integrator Routing Changes/TermAppISONFT_IR (test 1, from 2020-12-16 10:00:00 to 2020-12-16 11:21:00) and for outcome OK, the following function(s) had a success rate of less than 100% during the portion of the test where the load did not exceed the current production/projected peak.
|   |Basename                         |Outcome | Count| Percent|  Resp| StdDev|
|:--|:--------------------------------|:-------|-----:|-------:|-----:|------:|
|4  |transaction_advice_response_1230 |OK      | 19299|  99.855| 0.600|  0.426|
|2  |authorisation_request_1100       |OK      | 19400|  99.954| 4.531|  7.550|
  • For test TermAppISO Integrator Routing Changes/TermAppISONFT_IR (test 1, from 2020-12-16 10:00:00 to 2020-12-16 11:21:00) and for outcome OK, the following function(s) had response time(s) in excess of 1 second during the portion of the test where the load did not exceed the current production observed/projected peak.
|   |Basename                   |Outcome | Count| Percent|  Resp| StdDev|
|:--|:--------------------------|:-------|-----:|-------:|-----:|------:|
|2  |authorisation_request_1100 |OK      | 19400|  99.954| 4.531|   7.55|
  • For test TermAppISO Integrator Routing Changes/TermAppISONFT_IR (test 1, from 2020-12-16 10:00:00 to 2020-12-16 11:21:00) and for outcome timeout, the following function(s) had response time(s) in excess of 1 second during the portion of the test where the load did not exceed the current production observed/projected peak.
|   |Basename                         |Outcome | Count| Percent|   Resp| StdDev|
|:--|:--------------------------------|:-------|-----:|-------:|------:|------:|
|3  |authorisation_request_1100       |timeout |     6|   0.031| 99.999|      0|
|5  |transaction_advice_response_1230 |timeout |    28|   0.145| 99.999|      0|
  • For test TermAppISO with 40 provider threads/TermAppISO_IR_40Thrds (test 2, from 2020-12-16 14:24:00 to 2020-12-16 15:45:00) and for outcome disconnect, the following function(s) had response time(s) in excess of 1 second during the portion of the test where the load did not exceed the current production observed/projected peak.
|   |Basename                   |Outcome    | Count| Percent|  Resp| StdDev|
|:--|:--------------------------|:----------|-----:|-------:|-----:|------:|
|1  |authorisation_request_1100 |disconnect |     2|    0.01| 4.258|   0.06|
  • For test TermAppISO with 40 provider threads/TermAppISO_IR_40Thrds (test 2, from 2020-12-16 14:24:00 to 2020-12-16 15:45:00) and for outcome OK, the following function(s) had a success rate of less than 100% during the portion of the test where the load did not exceed the current production/projected peak.
|   |Basename                         |Outcome | Count| Percent|  Resp| StdDev|
|:--|:--------------------------------|:-------|-----:|-------:|-----:|------:|
|4  |transaction_advice_response_1230 |OK      | 19503|  99.918| 0.602|  0.428|
|2  |authorisation_request_1100       |OK      | 19591|  99.974| 4.483|  7.560|
  • For test TermAppISO with 40 provider threads/TermAppISO_IR_40Thrds (test 2, from 2020-12-16 14:24:00 to 2020-12-16 15:45:00) and for outcome OK, the following function(s) had response time(s) in excess of 1 second during the portion of the test where the load did not exceed the current production observed/projected peak.
|   |Basename                   |Outcome | Count| Percent|  Resp| StdDev|
|:--|:--------------------------|:-------|-----:|-------:|-----:|------:|
|2  |authorisation_request_1100 |OK      | 19591|  99.974| 4.483|   7.56|
  • For test TermAppISO with 40 provider threads/TermAppISO_IR_40Thrds (test 2, from 2020-12-16 14:24:00 to 2020-12-16 15:45:00) and for outcome timeout, the following function(s) had response time(s) in excess of 1 second during the portion of the test where the load did not exceed the current production observed/projected peak.
|   |Basename                         |Outcome | Count| Percent|   Resp| StdDev|
|:--|:--------------------------------|:-------|-----:|-------:|------:|------:|
|3  |authorisation_request_1100       |timeout |     3|   0.015| 99.999|      0|
|5  |transaction_advice_response_1230 |timeout |    16|   0.082| 99.999|      0|
  • For test TermAppISO with 80 provider threads/TermAppISO_IR_80Thrds (test 3, from 2020-12-16 16:04:00 to 2020-12-16 17:25:00) and for outcome disconnect, the following function(s) had response time(s) in excess of 1 second during the portion of the test where the load did not exceed the current production observed/projected peak.
|   |Basename                   |Outcome    | Count| Percent|  Resp| StdDev|
|:--|:--------------------------|:----------|-----:|-------:|-----:|------:|
|1  |authorisation_request_1100 |disconnect |     5|   0.026| 4.191|  0.021|
  • For test TermAppISO with 80 provider threads/TermAppISO_IR_80Thrds (test 3, from 2020-12-16 16:04:00 to 2020-12-16 17:25:00) and for outcome OK, the following function(s) had a success rate of less than 100% during the portion of the test where the load did not exceed the current production/projected peak.
|   |Basename                         |Outcome | Count| Percent|  Resp| StdDev|
|:--|:--------------------------------|:-------|-----:|-------:|-----:|------:|
|4  |transaction_advice_response_1230 |OK      | 19227|  99.704| 0.653|  0.493|
|2  |authorisation_request_1100       |OK      | 19369|  99.943| 5.214|  8.069|
  • For test TermAppISO with 80 provider threads/TermAppISO_IR_80Thrds (test 3, from 2020-12-16 16:04:00 to 2020-12-16 17:25:00) and for outcome OK, the following function(s) had response time(s) in excess of 1 second during the portion of the test where the load did not exceed the current production observed/projected peak.
|   |Basename                   |Outcome | Count| Percent|  Resp| StdDev|
|:--|:--------------------------|:-------|-----:|-------:|-----:|------:|
|2  |authorisation_request_1100 |OK      | 19369|  99.943| 5.214|  8.069|
  • For test TermAppISO with 80 provider threads/TermAppISO_IR_80Thrds (test 3, from 2020-12-16 16:04:00 to 2020-12-16 17:25:00) and for outcome timeout, the following function(s) had response time(s) in excess of 1 second during the portion of the test where the load did not exceed the current production observed/projected peak.
|   |Basename                         |Outcome | Count| Percent|   Resp| StdDev|
|:--|:--------------------------------|:-------|-----:|-------:|------:|------:|
|5  |transaction_advice_response_1230 |timeout |    57|   0.296| 99.999|      0|
|3  |authorisation_request_1100       |timeout |     6|   0.031| 99.999|      0|

D20201217 T144639 THREADS INSTANCES.png

D20201217 T144639 SUMMARY RATE.png

  • In the above graph, the items labelled Include and Exclude indicate, respectively, the intervals that should be included or excluded in the resource analysis. The resource analysis applies a linear regression of the resources consumed per server classification onto the total request arrival rate for that interval. Note that the analysis regresses to the arrival rate for the interval, but the determination of the outcome relates to the departures for that interval. The intervals should be long enough so that these numbers are reasonably close to each other.
  • The following table shows the full set of interval summary records obtained during the test. The Interval timestamp is the start time of the interval over which the metrics are summarised for that interval. A portion of the first metric record collected for each interval may relate to the previous interval. Long intervals or many intervals at the same load make this effect negligible.
  • The table of summary records provides the value of the load against which resource measurements are correlated. The correlation is determined using the least-squares linear module regressing the interval resource measurement onto the interval test loads.
  • Response time (Resp) in the table is the mean response time that an INSTANCE (device, customer, client, etc.) takes to complete a full cycle. A cycle is the set of states/actions that an INSTANCE undergoes from awakening from the idle state to the next time the same INSTANCE awakens from the idle state). The time for a cycle includes the idle time, the sum of all the individual response times of the functions/actions performed during the cycle of activity, and the think-times between the functions/actions performed during the cycle.
  • The Rate column shows the rate at which the INSTANCES exit the idle state, and hence, is the customer arrival rate measure in arrivals per second.
  • The summary table (or possibly a cut-down version of the summary table) is used to join against the corresponding resource usage tables, and over which the respective resource linear models are determined. The linear models include coefficients of the intercept (which is interpreted as resource usage unrelated to the applied test load) and the slope of the line (which is interpreted as the increment in the resource usage for each unit increment of the test load. This slope coefficient, therefore, gives us a measure of the resource usage for each additional customer arrival per second.
|    |Interval            |   Rate|    Resp|Analysis |
|:---|:-------------------|------:|-------:|:--------|
|1   |2020-12-16 10:00:00 |  0.017|  94.841|Include  |
|2   |2020-12-16 10:01:00 |  0.850|  29.430|Include  |
|3   |2020-12-16 10:02:00 |  0.850|  57.233|Include  |
|4   |2020-12-16 10:03:00 |  1.600|  65.736|Exclude  |
|5   |2020-12-16 10:04:00 |  1.750|  82.569|Exclude  |
|6   |2020-12-16 10:05:00 |  2.267|  71.892|Exclude  |
|7   |2020-12-16 10:06:00 |  2.500|  92.201|Include  |
|8   |2020-12-16 10:07:00 |  3.117|  83.209|Include  |
|9   |2020-12-16 10:08:00 |  3.333|  93.362|Include  |
|10  |2020-12-16 10:09:00 |  4.100|  97.154|Include  |
|11  |2020-12-16 10:10:00 |  4.317|  96.214|Include  |
|12  |2020-12-16 10:11:00 |  5.017|  97.720|Include  |
|13  |2020-12-16 10:12:00 |  4.783|  94.082|Include  |
|14  |2020-12-16 10:13:00 |  5.783|  92.443|Include  |
|15  |2020-12-16 10:14:00 |  5.933| 110.636|Include  |
|16  |2020-12-16 10:15:00 |  6.983|  96.418|Include  |
|17  |2020-12-16 10:16:00 |  6.583| 102.725|Include  |
|18  |2020-12-16 10:17:00 |  8.000|  95.972|Include  |
|19  |2020-12-16 10:18:00 |  8.183| 104.028|Include  |
|20  |2020-12-16 10:19:00 |  8.850|  97.559|Include  |
|21  |2020-12-16 10:20:00 |  8.633|  99.379|Include  |
|22  |2020-12-16 10:21:00 |  9.583|  98.776|Include  |
|23  |2020-12-16 10:22:00 |  9.383| 103.356|Include  |
|24  |2020-12-16 10:23:00 |  9.783|  96.617|Include  |
|25  |2020-12-16 10:24:00 | 10.083| 108.575|Include  |
|26  |2020-12-16 10:25:00 | 10.817| 105.079|Include  |
|27  |2020-12-16 10:26:00 | 11.283| 103.948|Include  |
|28  |2020-12-16 10:27:00 | 11.867| 103.333|Include  |
|29  |2020-12-16 10:28:00 | 12.300| 109.067|Include  |
|30  |2020-12-16 10:29:00 | 12.450| 100.395|Include  |
|31  |2020-12-16 10:30:00 | 12.050| 107.058|Include  |
|32  |2020-12-16 10:31:00 | 13.517| 105.194|Include  |
|33  |2020-12-16 10:32:00 | 12.883| 107.312|Include  |
|34  |2020-12-16 10:33:00 | 13.500| 107.434|Include  |
|35  |2020-12-16 10:34:00 | 13.517| 107.748|Include  |
|36  |2020-12-16 10:35:00 | 14.083| 114.661|Include  |
|37  |2020-12-16 10:36:00 | 13.217| 105.098|Include  |
|38  |2020-12-16 10:37:00 | 15.083| 108.026|Include  |
|39  |2020-12-16 10:38:00 | 14.933| 105.846|Include  |
|40  |2020-12-16 10:39:00 | 14.100| 105.674|Include  |
|41  |2020-12-16 10:40:00 | 15.033| 109.405|Include  |
|42  |2020-12-16 10:41:00 | 15.267| 106.817|Include  |
|43  |2020-12-16 10:42:00 | 15.833| 108.862|Include  |
|44  |2020-12-16 10:43:00 | 16.050| 104.720|Include  |
|45  |2020-12-16 10:44:00 | 15.700| 111.209|Include  |
|46  |2020-12-16 10:45:00 | 16.400| 100.088|Include  |
|47  |2020-12-16 10:46:00 | 17.067| 107.383|Include  |
|48  |2020-12-16 10:47:00 | 17.283| 105.995|Include  |
|49  |2020-12-16 10:48:00 | 17.617| 106.028|Include  |
|50  |2020-12-16 10:49:00 | 17.917| 103.376|Include  |
|51  |2020-12-16 10:50:00 | 18.167| 114.333|Include  |
|52  |2020-12-16 10:51:00 | 19.183| 105.040|Include  |
|53  |2020-12-16 10:52:00 | 18.867| 111.227|Include  |
|54  |2020-12-16 10:53:00 | 20.933| 106.195|Include  |
|55  |2020-12-16 10:54:00 | 20.867| 106.423|Include  |
|56  |2020-12-16 10:55:00 | 22.100| 104.614|Include  |
|57  |2020-12-16 10:56:00 | 19.683| 104.759|Include  |
|58  |2020-12-16 10:57:00 | 22.000| 105.947|Include  |
|59  |2020-12-16 10:58:00 | 21.733| 104.236|Include  |
|60  |2020-12-16 10:59:00 | 21.300| 108.107|Include  |
|61  |2020-12-16 11:00:00 | 23.800| 107.555|Include  |
|62  |2020-12-16 11:01:00 | 23.733| 102.289|Include  |
|63  |2020-12-16 11:02:00 | 22.467| 109.142|Include  |
|64  |2020-12-16 11:03:00 | 24.567| 108.240|Include  |
|65  |2020-12-16 11:04:00 | 24.917| 106.996|Include  |
|66  |2020-12-16 11:05:00 | 24.517| 108.048|Include  |
|67  |2020-12-16 11:06:00 | 24.783| 107.223|Include  |
|68  |2020-12-16 11:07:00 | 25.617| 106.866|Include  |
|69  |2020-12-16 11:08:00 | 24.750| 107.008|Include  |
|70  |2020-12-16 11:09:00 | 25.783| 107.481|Include  |
|71  |2020-12-16 11:10:00 | 26.300| 108.519|Include  |
|72  |2020-12-16 11:11:00 | 27.733| 106.017|Include  |
|73  |2020-12-16 11:12:00 | 27.517| 105.101|Include  |
|74  |2020-12-16 11:13:00 | 28.950| 108.013|Include  |
|75  |2020-12-16 11:14:00 | 28.133| 103.464|Include  |
|76  |2020-12-16 11:15:00 | 28.033| 105.412|Include  |
|77  |2020-12-16 11:16:00 | 28.200| 106.360|Include  |
|78  |2020-12-16 11:17:00 | 29.750| 101.032|Include  |
|79  |2020-12-16 11:18:00 | 29.000| 110.398|Include  |
|80  |2020-12-16 11:19:00 | 29.933| 110.535|Include  |
|81  |2020-12-16 11:20:00 | 30.267| 107.297|Include  |
|82  |2020-12-16 11:21:00 | 30.767| 108.064|Include  |
|83  |2020-12-16 11:22:00 | 30.483| 105.915|Include  |
|84  |2020-12-16 14:23:00 |  0.150| 139.255|Include  |
|85  |2020-12-16 14:24:00 |  0.017|  82.249|Include  |
|86  |2020-12-16 14:25:00 |  0.583|  30.961|Include  |
|87  |2020-12-16 14:26:00 |  1.167|  60.729|Include  |
|88  |2020-12-16 14:27:00 |  1.533|  62.166|Include  |
|89  |2020-12-16 14:28:00 |  1.750|  83.469|Include  |
|90  |2020-12-16 14:29:00 |  2.417|  69.584|Exclude  |
|91  |2020-12-16 14:30:00 |  2.550|  84.025|Include  |
|92  |2020-12-16 14:31:00 |  3.517|  87.020|Include  |
|93  |2020-12-16 14:32:00 |  3.517|  91.404|Include  |
|94  |2020-12-16 14:33:00 |  4.483|  85.009|Include  |
|95  |2020-12-16 14:34:00 |  4.550|  97.051|Include  |
|96  |2020-12-16 14:35:00 |  5.317|  82.784|Include  |
|97  |2020-12-16 14:36:00 |  5.350|  99.134|Include  |
|98  |2020-12-16 14:37:00 |  5.883|  90.364|Include  |
|99  |2020-12-16 14:38:00 |  6.217| 100.255|Include  |
|100 |2020-12-16 14:39:00 |  6.633|  88.613|Include  |
|101 |2020-12-16 14:40:00 |  6.900| 105.099|Include  |
|102 |2020-12-16 14:41:00 |  7.617| 100.997|Include  |
|103 |2020-12-16 14:42:00 |  8.133| 102.631|Include  |
|104 |2020-12-16 14:43:00 |  8.167|  97.453|Include  |
|105 |2020-12-16 14:44:00 |  9.167| 101.767|Include  |
|106 |2020-12-16 14:45:00 |  8.717|  94.657|Include  |
|107 |2020-12-16 14:46:00 | 10.050| 108.964|Include  |
|108 |2020-12-16 14:47:00 | 10.667| 104.147|Include  |
|109 |2020-12-16 14:48:00 | 10.267|  98.650|Include  |
|110 |2020-12-16 14:49:00 | 10.517|  99.840|Include  |
|111 |2020-12-16 14:50:00 | 11.050| 104.975|Include  |
|112 |2020-12-16 14:51:00 | 12.250| 107.372|Include  |
|113 |2020-12-16 14:52:00 | 11.883| 106.654|Include  |
|114 |2020-12-16 14:53:00 | 12.933|  93.640|Include  |
|115 |2020-12-16 14:54:00 | 12.533| 107.406|Include  |
|116 |2020-12-16 14:55:00 | 13.600| 101.944|Include  |
|117 |2020-12-16 14:56:00 | 13.683| 106.552|Include  |
|118 |2020-12-16 14:57:00 | 12.867| 105.748|Include  |
|119 |2020-12-16 14:58:00 | 13.183| 112.693|Include  |
|120 |2020-12-16 14:59:00 | 13.283| 104.413|Include  |
|121 |2020-12-16 15:00:00 | 14.233| 110.331|Include  |
|122 |2020-12-16 15:01:00 | 14.517| 107.558|Include  |
|123 |2020-12-16 15:02:00 | 14.767| 109.906|Include  |
|124 |2020-12-16 15:03:00 | 13.900| 108.039|Include  |
|125 |2020-12-16 15:04:00 | 15.233| 106.024|Include  |
|126 |2020-12-16 15:05:00 | 15.350| 112.680|Include  |
|127 |2020-12-16 15:06:00 | 15.267| 109.436|Include  |
|128 |2020-12-16 15:07:00 | 15.667| 110.264|Include  |
|129 |2020-12-16 15:08:00 | 16.467| 105.146|Include  |
|130 |2020-12-16 15:09:00 | 16.400| 105.230|Include  |
|131 |2020-12-16 15:10:00 | 16.667| 106.238|Include  |
|132 |2020-12-16 15:11:00 | 16.850| 111.190|Include  |
|133 |2020-12-16 15:12:00 | 17.500| 113.729|Include  |
|134 |2020-12-16 15:13:00 | 18.983| 105.139|Include  |
|135 |2020-12-16 15:14:00 | 18.467| 104.650|Include  |
|136 |2020-12-16 15:15:00 | 19.467| 104.555|Include  |
|137 |2020-12-16 15:16:00 | 18.867| 105.681|Include  |
|138 |2020-12-16 15:17:00 | 21.100| 104.816|Include  |
|139 |2020-12-16 15:18:00 | 18.550| 108.136|Include  |
|140 |2020-12-16 15:19:00 | 20.833| 104.258|Include  |
|141 |2020-12-16 15:20:00 | 20.717| 109.182|Include  |
|142 |2020-12-16 15:21:00 | 22.067| 107.279|Include  |
|143 |2020-12-16 15:22:00 | 21.700| 104.896|Include  |
|144 |2020-12-16 15:23:00 | 22.700| 107.435|Include  |
|145 |2020-12-16 15:24:00 | 22.850| 109.877|Include  |
|146 |2020-12-16 15:25:00 | 22.900| 106.374|Include  |
|147 |2020-12-16 15:26:00 | 24.033| 109.959|Include  |
|148 |2020-12-16 15:27:00 | 23.983| 104.009|Include  |
|149 |2020-12-16 15:28:00 | 24.317| 111.061|Include  |
|150 |2020-12-16 15:29:00 | 24.283| 105.418|Include  |
|151 |2020-12-16 15:30:00 | 23.567| 113.308|Include  |
|152 |2020-12-16 15:31:00 | 24.783| 105.812|Include  |
|153 |2020-12-16 15:32:00 | 25.517| 111.487|Include  |
|154 |2020-12-16 15:33:00 | 25.717| 108.845|Include  |
|155 |2020-12-16 15:34:00 | 26.167| 113.146|Include  |
|156 |2020-12-16 15:35:00 | 26.967| 106.337|Include  |
|157 |2020-12-16 15:36:00 | 27.217| 107.777|Include  |
|158 |2020-12-16 15:37:00 | 27.617| 107.774|Include  |
|159 |2020-12-16 15:38:00 | 28.750| 110.673|Include  |
|160 |2020-12-16 15:39:00 | 28.267| 104.293|Include  |
|161 |2020-12-16 15:40:00 | 28.333| 106.742|Include  |
|162 |2020-12-16 15:41:00 | 29.200| 107.988|Include  |
|163 |2020-12-16 15:42:00 | 29.100| 110.671|Include  |
|164 |2020-12-16 15:43:00 | 30.100| 107.451|Include  |
|165 |2020-12-16 15:44:00 | 29.517| 109.631|Exclude  |
|166 |2020-12-16 15:45:00 | 31.883| 105.745|Include  |
|167 |2020-12-16 15:46:00 | 30.050| 112.312|Include  |
|168 |2020-12-16 16:04:00 |  0.100| 119.093|Exclude  |
|169 |2020-12-16 16:05:00 |  0.633|  32.229|Include  |
|170 |2020-12-16 16:06:00 |  1.133|  61.297|Exclude  |
|171 |2020-12-16 16:07:00 |  1.367|  53.696|Exclude  |
|172 |2020-12-16 16:08:00 |  1.717|  76.666|Include  |
|173 |2020-12-16 16:09:00 |  2.583|  73.134|Exclude  |
|174 |2020-12-16 16:10:00 |  2.333|  96.048|Exclude  |
|175 |2020-12-16 16:11:00 |  3.450|  87.983|Include  |
|176 |2020-12-16 16:12:00 |  3.367|  89.326|Include  |
|177 |2020-12-16 16:13:00 |  4.367|  91.499|Include  |
|178 |2020-12-16 16:14:00 |  4.300|  98.946|Include  |
|179 |2020-12-16 16:15:00 |  4.800|  88.376|Include  |
|180 |2020-12-16 16:16:00 |  5.517| 101.810|Include  |
|181 |2020-12-16 16:17:00 |  6.317|  85.456|Include  |
|182 |2020-12-16 16:18:00 |  6.483|  95.973|Include  |
|183 |2020-12-16 16:19:00 |  6.717|  94.661|Include  |
|184 |2020-12-16 16:20:00 |  6.450| 108.094|Include  |
|185 |2020-12-16 16:21:00 |  7.417| 101.931|Include  |
|186 |2020-12-16 16:22:00 |  7.683| 109.607|Include  |
|187 |2020-12-16 16:23:00 |  8.367|  94.168|Include  |
|188 |2020-12-16 16:24:00 |  8.067| 104.887|Include  |
|189 |2020-12-16 16:25:00 |  9.217| 102.190|Include  |
|190 |2020-12-16 16:26:00 |  9.450| 108.553|Include  |
|191 |2020-12-16 16:27:00 | 10.483|  96.864|Include  |
|192 |2020-12-16 16:28:00 |  9.917| 106.344|Exclude  |
|193 |2020-12-16 16:29:00 | 10.950| 103.341|Exclude  |
|194 |2020-12-16 16:30:00 | 11.200| 106.551|Include  |
|195 |2020-12-16 16:31:00 | 12.183| 105.205|Include  |
|196 |2020-12-16 16:32:00 | 12.200| 102.030|Include  |
|197 |2020-12-16 16:33:00 | 12.733| 104.972|Include  |
|198 |2020-12-16 16:34:00 | 12.967| 103.011|Include  |
|199 |2020-12-16 16:35:00 | 12.900| 102.283|Include  |
|200 |2020-12-16 16:36:00 | 13.183| 103.176|Exclude  |
|201 |2020-12-16 16:37:00 | 12.717| 103.064|Include  |
|202 |2020-12-16 16:38:00 | 13.333| 105.541|Include  |
|203 |2020-12-16 16:39:00 | 14.250| 105.695|Include  |
|204 |2020-12-16 16:40:00 | 13.467| 108.422|Include  |
|205 |2020-12-16 16:41:00 | 14.550| 107.001|Include  |
|206 |2020-12-16 16:42:00 | 13.950| 113.951|Exclude  |
|207 |2020-12-16 16:43:00 | 14.300| 106.251|Include  |
|208 |2020-12-16 16:44:00 | 14.417| 106.216|Include  |
|209 |2020-12-16 16:45:00 | 15.733| 107.551|Include  |
|210 |2020-12-16 16:46:00 | 15.533| 109.424|Include  |
|211 |2020-12-16 16:47:00 | 16.250| 106.239|Include  |
|212 |2020-12-16 16:48:00 | 15.533| 106.388|Include  |
|213 |2020-12-16 16:49:00 | 17.050| 107.775|Include  |
|214 |2020-12-16 16:50:00 | 16.700| 104.769|Include  |
|215 |2020-12-16 16:51:00 | 18.550| 105.870|Include  |
|216 |2020-12-16 16:52:00 | 17.567| 107.358|Include  |
|217 |2020-12-16 16:53:00 | 17.717| 105.198|Include  |
|218 |2020-12-16 16:54:00 | 18.600| 108.450|Include  |
|219 |2020-12-16 16:55:00 | 19.433| 103.753|Include  |
|220 |2020-12-16 16:56:00 | 19.167| 104.798|Include  |
|221 |2020-12-16 16:57:00 | 19.533| 107.416|Include  |
|222 |2020-12-16 16:58:00 | 20.150| 105.203|Include  |
|223 |2020-12-16 16:59:00 | 21.400| 103.365|Include  |
|224 |2020-12-16 17:00:00 | 22.050| 108.366|Include  |
|225 |2020-12-16 17:01:00 | 22.367| 105.635|Include  |
|226 |2020-12-16 17:02:00 | 22.083| 106.608|Include  |
|227 |2020-12-16 17:03:00 | 22.767| 106.327|Include  |
|228 |2020-12-16 17:04:00 | 22.083| 105.747|Include  |
|229 |2020-12-16 17:05:00 | 23.600| 104.919|Include  |
|230 |2020-12-16 17:06:00 | 23.467| 106.166|Include  |
|231 |2020-12-16 17:07:00 | 23.583| 107.484|Include  |
|232 |2020-12-16 17:08:00 | 25.083| 105.403|Include  |
|233 |2020-12-16 17:09:00 | 24.500| 105.550|Include  |
|234 |2020-12-16 17:10:00 | 25.317| 104.550|Include  |
|235 |2020-12-16 17:11:00 | 25.517| 105.136|Include  |
|236 |2020-12-16 17:12:00 | 25.933| 107.002|Include  |
|237 |2020-12-16 17:13:00 | 27.267| 107.623|Exclude  |
|238 |2020-12-16 17:14:00 | 25.100| 108.590|Include  |
|239 |2020-12-16 17:15:00 | 26.433| 108.591|Exclude  |
|240 |2020-12-16 17:16:00 | 26.683| 109.794|Exclude  |
|241 |2020-12-16 17:17:00 | 27.983| 107.205|Include  |
|242 |2020-12-16 17:18:00 | 27.967| 106.624|Include  |
|243 |2020-12-16 17:19:00 | 28.633| 105.682|Exclude  |
|244 |2020-12-16 17:20:00 | 28.217| 108.342|Include  |
|245 |2020-12-16 17:21:00 | 29.417| 106.300|Include  |
|246 |2020-12-16 17:22:00 | 29.700| 107.485|Include  |
|247 |2020-12-16 17:23:00 | 30.233| 106.390|Include  |
|248 |2020-12-16 17:24:00 | 29.250| 110.607|Include  |
|249 |2020-12-16 17:25:00 | 30.767| 107.253|Include  |
  • The following table is a cut down version of the full session summary table. The rows removed from the table are those that an inspection of the performance data and the observations made during the test indicate that they should not be included in the analysis. The primary reasons for excluding a row from the analysis include where the rows cover periods where the performance profile has changed for an identifiable reason unrelated to the test load (for example, interference in the test); a period where the test conditions were not met (for example, incorrect logging levels are set); periods where the applied load has saturated a component inducing an unacceptably high error rate, changing the profile of resource usage; etc.
|    |Interval            |   Rate|    Resp|Analysis |
|:---|:-------------------|------:|-------:|:--------|
|1   |2020-12-16 10:00:00 |  0.017|  94.841|Include  |
|2   |2020-12-16 10:01:00 |  0.850|  29.430|Include  |
|3   |2020-12-16 10:02:00 |  0.850|  57.233|Include  |
|4   |2020-12-16 10:06:00 |  2.500|  92.201|Include  |
|5   |2020-12-16 10:07:00 |  3.117|  83.209|Include  |
|6   |2020-12-16 10:08:00 |  3.333|  93.362|Include  |
|7   |2020-12-16 10:09:00 |  4.100|  97.154|Include  |
|8   |2020-12-16 10:10:00 |  4.317|  96.214|Include  |
|9   |2020-12-16 10:11:00 |  5.017|  97.720|Include  |
|10  |2020-12-16 10:12:00 |  4.783|  94.082|Include  |
|11  |2020-12-16 10:13:00 |  5.783|  92.443|Include  |
|12  |2020-12-16 10:14:00 |  5.933| 110.636|Include  |
|13  |2020-12-16 10:15:00 |  6.983|  96.418|Include  |
|14  |2020-12-16 10:16:00 |  6.583| 102.725|Include  |
|15  |2020-12-16 10:17:00 |  8.000|  95.972|Include  |
|16  |2020-12-16 10:18:00 |  8.183| 104.028|Include  |
|17  |2020-12-16 10:19:00 |  8.850|  97.559|Include  |
|18  |2020-12-16 10:20:00 |  8.633|  99.379|Include  |
|19  |2020-12-16 10:21:00 |  9.583|  98.776|Include  |
|20  |2020-12-16 10:22:00 |  9.383| 103.356|Include  |
|21  |2020-12-16 10:23:00 |  9.783|  96.617|Include  |
|22  |2020-12-16 10:24:00 | 10.083| 108.575|Include  |
|23  |2020-12-16 10:25:00 | 10.817| 105.079|Include  |
|24  |2020-12-16 10:26:00 | 11.283| 103.948|Include  |
|25  |2020-12-16 10:27:00 | 11.867| 103.333|Include  |
|26  |2020-12-16 10:28:00 | 12.300| 109.067|Include  |
|27  |2020-12-16 10:29:00 | 12.450| 100.395|Include  |
|28  |2020-12-16 10:30:00 | 12.050| 107.058|Include  |
|29  |2020-12-16 10:31:00 | 13.517| 105.194|Include  |
|30  |2020-12-16 10:32:00 | 12.883| 107.312|Include  |
|31  |2020-12-16 10:33:00 | 13.500| 107.434|Include  |
|32  |2020-12-16 10:34:00 | 13.517| 107.748|Include  |
|33  |2020-12-16 10:35:00 | 14.083| 114.661|Include  |
|34  |2020-12-16 10:36:00 | 13.217| 105.098|Include  |
|35  |2020-12-16 10:37:00 | 15.083| 108.026|Include  |
|36  |2020-12-16 10:38:00 | 14.933| 105.846|Include  |
|37  |2020-12-16 10:39:00 | 14.100| 105.674|Include  |
|38  |2020-12-16 10:40:00 | 15.033| 109.405|Include  |
|39  |2020-12-16 10:41:00 | 15.267| 106.817|Include  |
|40  |2020-12-16 10:42:00 | 15.833| 108.862|Include  |
|41  |2020-12-16 10:43:00 | 16.050| 104.720|Include  |
|42  |2020-12-16 10:44:00 | 15.700| 111.209|Include  |
|43  |2020-12-16 10:45:00 | 16.400| 100.088|Include  |
|44  |2020-12-16 10:46:00 | 17.067| 107.383|Include  |
|45  |2020-12-16 10:47:00 | 17.283| 105.995|Include  |
|46  |2020-12-16 10:48:00 | 17.617| 106.028|Include  |
|47  |2020-12-16 10:49:00 | 17.917| 103.376|Include  |
|48  |2020-12-16 10:50:00 | 18.167| 114.333|Include  |
|49  |2020-12-16 10:51:00 | 19.183| 105.040|Include  |
|50  |2020-12-16 10:52:00 | 18.867| 111.227|Include  |
|51  |2020-12-16 10:53:00 | 20.933| 106.195|Include  |
|52  |2020-12-16 10:54:00 | 20.867| 106.423|Include  |
|53  |2020-12-16 10:55:00 | 22.100| 104.614|Include  |
|54  |2020-12-16 10:56:00 | 19.683| 104.759|Include  |
|55  |2020-12-16 10:57:00 | 22.000| 105.947|Include  |
|56  |2020-12-16 10:58:00 | 21.733| 104.236|Include  |
|57  |2020-12-16 10:59:00 | 21.300| 108.107|Include  |
|58  |2020-12-16 11:00:00 | 23.800| 107.555|Include  |
|59  |2020-12-16 11:01:00 | 23.733| 102.289|Include  |
|60  |2020-12-16 11:02:00 | 22.467| 109.142|Include  |
|61  |2020-12-16 11:03:00 | 24.567| 108.240|Include  |
|62  |2020-12-16 11:04:00 | 24.917| 106.996|Include  |
|63  |2020-12-16 11:05:00 | 24.517| 108.048|Include  |
|64  |2020-12-16 11:06:00 | 24.783| 107.223|Include  |
|65  |2020-12-16 11:07:00 | 25.617| 106.866|Include  |
|66  |2020-12-16 11:08:00 | 24.750| 107.008|Include  |
|67  |2020-12-16 11:09:00 | 25.783| 107.481|Include  |
|68  |2020-12-16 11:10:00 | 26.300| 108.519|Include  |
|69  |2020-12-16 11:11:00 | 27.733| 106.017|Include  |
|70  |2020-12-16 11:12:00 | 27.517| 105.101|Include  |
|71  |2020-12-16 11:13:00 | 28.950| 108.013|Include  |
|72  |2020-12-16 11:14:00 | 28.133| 103.464|Include  |
|73  |2020-12-16 11:15:00 | 28.033| 105.412|Include  |
|74  |2020-12-16 11:16:00 | 28.200| 106.360|Include  |
|75  |2020-12-16 11:17:00 | 29.750| 101.032|Include  |
|76  |2020-12-16 11:18:00 | 29.000| 110.398|Include  |
|77  |2020-12-16 11:19:00 | 29.933| 110.535|Include  |
|78  |2020-12-16 11:20:00 | 30.267| 107.297|Include  |
|79  |2020-12-16 11:21:00 | 30.767| 108.064|Include  |
|80  |2020-12-16 11:22:00 | 30.483| 105.915|Include  |
|81  |2020-12-16 14:23:00 |  0.150| 139.255|Include  |
|82  |2020-12-16 14:24:00 |  0.017|  82.249|Include  |
|83  |2020-12-16 14:25:00 |  0.583|  30.961|Include  |
|84  |2020-12-16 14:26:00 |  1.167|  60.729|Include  |
|85  |2020-12-16 14:27:00 |  1.533|  62.166|Include  |
|86  |2020-12-16 14:28:00 |  1.750|  83.469|Include  |
|87  |2020-12-16 14:30:00 |  2.550|  84.025|Include  |
|88  |2020-12-16 14:31:00 |  3.517|  87.020|Include  |
|89  |2020-12-16 14:32:00 |  3.517|  91.404|Include  |
|90  |2020-12-16 14:33:00 |  4.483|  85.009|Include  |
|91  |2020-12-16 14:34:00 |  4.550|  97.051|Include  |
|92  |2020-12-16 14:35:00 |  5.317|  82.784|Include  |
|93  |2020-12-16 14:36:00 |  5.350|  99.134|Include  |
|94  |2020-12-16 14:37:00 |  5.883|  90.364|Include  |
|95  |2020-12-16 14:38:00 |  6.217| 100.255|Include  |
|96  |2020-12-16 14:39:00 |  6.633|  88.613|Include  |
|97  |2020-12-16 14:40:00 |  6.900| 105.099|Include  |
|98  |2020-12-16 14:41:00 |  7.617| 100.997|Include  |
|99  |2020-12-16 14:42:00 |  8.133| 102.631|Include  |
|100 |2020-12-16 14:43:00 |  8.167|  97.453|Include  |
|101 |2020-12-16 14:44:00 |  9.167| 101.767|Include  |
|102 |2020-12-16 14:45:00 |  8.717|  94.657|Include  |
|103 |2020-12-16 14:46:00 | 10.050| 108.964|Include  |
|104 |2020-12-16 14:47:00 | 10.667| 104.147|Include  |
|105 |2020-12-16 14:48:00 | 10.267|  98.650|Include  |
|106 |2020-12-16 14:49:00 | 10.517|  99.840|Include  |
|107 |2020-12-16 14:50:00 | 11.050| 104.975|Include  |
|108 |2020-12-16 14:51:00 | 12.250| 107.372|Include  |
|109 |2020-12-16 14:52:00 | 11.883| 106.654|Include  |
|110 |2020-12-16 14:53:00 | 12.933|  93.640|Include  |
|111 |2020-12-16 14:54:00 | 12.533| 107.406|Include  |
|112 |2020-12-16 14:55:00 | 13.600| 101.944|Include  |
|113 |2020-12-16 14:56:00 | 13.683| 106.552|Include  |
|114 |2020-12-16 14:57:00 | 12.867| 105.748|Include  |
|115 |2020-12-16 14:58:00 | 13.183| 112.693|Include  |
|116 |2020-12-16 14:59:00 | 13.283| 104.413|Include  |
|117 |2020-12-16 15:00:00 | 14.233| 110.331|Include  |
|118 |2020-12-16 15:01:00 | 14.517| 107.558|Include  |
|119 |2020-12-16 15:02:00 | 14.767| 109.906|Include  |
|120 |2020-12-16 15:03:00 | 13.900| 108.039|Include  |
|121 |2020-12-16 15:04:00 | 15.233| 106.024|Include  |
|122 |2020-12-16 15:05:00 | 15.350| 112.680|Include  |
|123 |2020-12-16 15:06:00 | 15.267| 109.436|Include  |
|124 |2020-12-16 15:07:00 | 15.667| 110.264|Include  |
|125 |2020-12-16 15:08:00 | 16.467| 105.146|Include  |
|126 |2020-12-16 15:09:00 | 16.400| 105.230|Include  |
|127 |2020-12-16 15:10:00 | 16.667| 106.238|Include  |
|128 |2020-12-16 15:11:00 | 16.850| 111.190|Include  |
|129 |2020-12-16 15:12:00 | 17.500| 113.729|Include  |
|130 |2020-12-16 15:13:00 | 18.983| 105.139|Include  |
|131 |2020-12-16 15:14:00 | 18.467| 104.650|Include  |
|132 |2020-12-16 15:15:00 | 19.467| 104.555|Include  |
|133 |2020-12-16 15:16:00 | 18.867| 105.681|Include  |
|134 |2020-12-16 15:17:00 | 21.100| 104.816|Include  |
|135 |2020-12-16 15:18:00 | 18.550| 108.136|Include  |
|136 |2020-12-16 15:19:00 | 20.833| 104.258|Include  |
|137 |2020-12-16 15:20:00 | 20.717| 109.182|Include  |
|138 |2020-12-16 15:21:00 | 22.067| 107.279|Include  |
|139 |2020-12-16 15:22:00 | 21.700| 104.896|Include  |
|140 |2020-12-16 15:23:00 | 22.700| 107.435|Include  |
|141 |2020-12-16 15:24:00 | 22.850| 109.877|Include  |
|142 |2020-12-16 15:25:00 | 22.900| 106.374|Include  |
|143 |2020-12-16 15:26:00 | 24.033| 109.959|Include  |
|144 |2020-12-16 15:27:00 | 23.983| 104.009|Include  |
|145 |2020-12-16 15:28:00 | 24.317| 111.061|Include  |
|146 |2020-12-16 15:29:00 | 24.283| 105.418|Include  |
|147 |2020-12-16 15:30:00 | 23.567| 113.308|Include  |
|148 |2020-12-16 15:31:00 | 24.783| 105.812|Include  |
|149 |2020-12-16 15:32:00 | 25.517| 111.487|Include  |
|150 |2020-12-16 15:33:00 | 25.717| 108.845|Include  |
|151 |2020-12-16 15:34:00 | 26.167| 113.146|Include  |
|152 |2020-12-16 15:35:00 | 26.967| 106.337|Include  |
|153 |2020-12-16 15:36:00 | 27.217| 107.777|Include  |
|154 |2020-12-16 15:37:00 | 27.617| 107.774|Include  |
|155 |2020-12-16 15:38:00 | 28.750| 110.673|Include  |
|156 |2020-12-16 15:39:00 | 28.267| 104.293|Include  |
|157 |2020-12-16 15:40:00 | 28.333| 106.742|Include  |
|158 |2020-12-16 15:41:00 | 29.200| 107.988|Include  |
|159 |2020-12-16 15:42:00 | 29.100| 110.671|Include  |
|160 |2020-12-16 15:43:00 | 30.100| 107.451|Include  |
|161 |2020-12-16 15:45:00 | 31.883| 105.745|Include  |
|162 |2020-12-16 15:46:00 | 30.050| 112.312|Include  |
|163 |2020-12-16 16:05:00 |  0.633|  32.229|Include  |
|164 |2020-12-16 16:08:00 |  1.717|  76.666|Include  |
|165 |2020-12-16 16:11:00 |  3.450|  87.983|Include  |
|166 |2020-12-16 16:12:00 |  3.367|  89.326|Include  |
|167 |2020-12-16 16:13:00 |  4.367|  91.499|Include  |
|168 |2020-12-16 16:14:00 |  4.300|  98.946|Include  |
|169 |2020-12-16 16:15:00 |  4.800|  88.376|Include  |
|170 |2020-12-16 16:16:00 |  5.517| 101.810|Include  |
|171 |2020-12-16 16:17:00 |  6.317|  85.456|Include  |
|172 |2020-12-16 16:18:00 |  6.483|  95.973|Include  |
|173 |2020-12-16 16:19:00 |  6.717|  94.661|Include  |
|174 |2020-12-16 16:20:00 |  6.450| 108.094|Include  |
|175 |2020-12-16 16:21:00 |  7.417| 101.931|Include  |
|176 |2020-12-16 16:22:00 |  7.683| 109.607|Include  |
|177 |2020-12-16 16:23:00 |  8.367|  94.168|Include  |
|178 |2020-12-16 16:24:00 |  8.067| 104.887|Include  |
|179 |2020-12-16 16:25:00 |  9.217| 102.190|Include  |
|180 |2020-12-16 16:26:00 |  9.450| 108.553|Include  |
|181 |2020-12-16 16:27:00 | 10.483|  96.864|Include  |
|182 |2020-12-16 16:30:00 | 11.200| 106.551|Include  |
|183 |2020-12-16 16:31:00 | 12.183| 105.205|Include  |
|184 |2020-12-16 16:32:00 | 12.200| 102.030|Include  |
|185 |2020-12-16 16:33:00 | 12.733| 104.972|Include  |
|186 |2020-12-16 16:34:00 | 12.967| 103.011|Include  |
|187 |2020-12-16 16:35:00 | 12.900| 102.283|Include  |
|188 |2020-12-16 16:37:00 | 12.717| 103.064|Include  |
|189 |2020-12-16 16:38:00 | 13.333| 105.541|Include  |
|190 |2020-12-16 16:39:00 | 14.250| 105.695|Include  |
|191 |2020-12-16 16:40:00 | 13.467| 108.422|Include  |
|192 |2020-12-16 16:41:00 | 14.550| 107.001|Include  |
|193 |2020-12-16 16:43:00 | 14.300| 106.251|Include  |
|194 |2020-12-16 16:44:00 | 14.417| 106.216|Include  |
|195 |2020-12-16 16:45:00 | 15.733| 107.551|Include  |
|196 |2020-12-16 16:46:00 | 15.533| 109.424|Include  |
|197 |2020-12-16 16:47:00 | 16.250| 106.239|Include  |
|198 |2020-12-16 16:48:00 | 15.533| 106.388|Include  |
|199 |2020-12-16 16:49:00 | 17.050| 107.775|Include  |
|200 |2020-12-16 16:50:00 | 16.700| 104.769|Include  |
|201 |2020-12-16 16:51:00 | 18.550| 105.870|Include  |
|202 |2020-12-16 16:52:00 | 17.567| 107.358|Include  |
|203 |2020-12-16 16:53:00 | 17.717| 105.198|Include  |
|204 |2020-12-16 16:54:00 | 18.600| 108.450|Include  |
|205 |2020-12-16 16:55:00 | 19.433| 103.753|Include  |
|206 |2020-12-16 16:56:00 | 19.167| 104.798|Include  |
|207 |2020-12-16 16:57:00 | 19.533| 107.416|Include  |
|208 |2020-12-16 16:58:00 | 20.150| 105.203|Include  |
|209 |2020-12-16 16:59:00 | 21.400| 103.365|Include  |
|210 |2020-12-16 17:00:00 | 22.050| 108.366|Include  |
|211 |2020-12-16 17:01:00 | 22.367| 105.635|Include  |
|212 |2020-12-16 17:02:00 | 22.083| 106.608|Include  |
|213 |2020-12-16 17:03:00 | 22.767| 106.327|Include  |
|214 |2020-12-16 17:04:00 | 22.083| 105.747|Include  |
|215 |2020-12-16 17:05:00 | 23.600| 104.919|Include  |
|216 |2020-12-16 17:06:00 | 23.467| 106.166|Include  |
|217 |2020-12-16 17:07:00 | 23.583| 107.484|Include  |
|218 |2020-12-16 17:08:00 | 25.083| 105.403|Include  |
|219 |2020-12-16 17:09:00 | 24.500| 105.550|Include  |
|220 |2020-12-16 17:10:00 | 25.317| 104.550|Include  |
|221 |2020-12-16 17:11:00 | 25.517| 105.136|Include  |
|222 |2020-12-16 17:12:00 | 25.933| 107.002|Include  |
|223 |2020-12-16 17:14:00 | 25.100| 108.590|Include  |
|224 |2020-12-16 17:17:00 | 27.983| 107.205|Include  |
|225 |2020-12-16 17:18:00 | 27.967| 106.624|Include  |
|226 |2020-12-16 17:20:00 | 28.217| 108.342|Include  |
|227 |2020-12-16 17:21:00 | 29.417| 106.300|Include  |
|228 |2020-12-16 17:22:00 | 29.700| 107.485|Include  |
|229 |2020-12-16 17:23:00 | 30.233| 106.390|Include  |
|230 |2020-12-16 17:24:00 | 29.250| 110.607|Include  |
|231 |2020-12-16 17:25:00 | 30.767| 107.253|Include  |
  • The following tables show estimates and projections of CPU usage for each class (by hosted function) of server where some confidence in these numbers is reasonable. A coefficient is determined reasonable by the significance of the respective class coefficient's p-value.
  • Where there is some significant response of the resource utilisation to the applied load, and where there is some confidence in this correlation, an estimate of the resource usage can be determined for capacity planning and/or comparison purposes. Here, the column Est Use @ 30.000000/s is the expected CPU usage at 30 requests per second. The column Estimate should be used as a factor to multiply by the transaction rate in order to estimate the resource usage required to support that transaction rate. The column Std. Error should be used to determine the confidence interval around the estimate:
|   |Class |Test                                  |Measure   |Units                    |Coef | Estimate| Std. Error| t value| p.value| Est Use @ 30.000000/s|
|:--|:-----|:-------------------------------------|:---------|:------------------------|:----|--------:|----------:|-------:|-------:|---------------------:|
|1  |LOAD  |TermAppISO Integrator Routing Changes |CPU Usage |Percent single processor |Rate |   9.7798|     0.5741| 17.0336|       0|              293.3945|
|4  |MODEL |TermAppISO Integrator Routing Changes |CPU Usage |Percent single processor |Rate |   7.3068|     0.5916| 12.3505|       0|              219.2026|
|7  |LOAD  |TermAppISO with 40 provider threads   |CPU Usage |Percent single processor |Rate |  10.1977|     0.5845| 17.4470|       0|              305.9298|
|10 |MODEL |TermAppISO with 40 provider threads   |CPU Usage |Percent single processor |Rate |   7.9295|     0.5812| 13.6430|       0|              237.8850|
|13 |LOAD  |TermAppISO with 80 provider threads   |CPU Usage |Percent single processor |Rate |   8.6570|     0.7336| 11.8001|       0|              259.7110|
|16 |MODEL |TermAppISO with 80 provider threads   |CPU Usage |Percent single processor |Rate |   6.5813|     0.7597|  8.6632|       0|              197.4388|
  • In some cases, it is possible to estimate with confidence the background workload on the various servers and server groups, the resource usage which is independent of the applied test load. The column Estimate indicates this. The column Std. Error should be used to determine a confidence interval:
|   |Class |Test                                  |Measure   |Units                    |Coef | Estimate| Std. Error| t value| p.value|
|:--|:-----|:-------------------------------------|:---------|:------------------------|:----|--------:|----------:|-------:|-------:|
|1  |LOAD  |TermAppISO Integrator Routing Changes |CPU Usage |Percent single processor |Bias | 110.0495|    10.4848| 10.4961|       0|
|4  |MODEL |TermAppISO Integrator Routing Changes |CPU Usage |Percent single processor |Bias | 122.6891|    10.8038| 11.3561|       0|
|7  |LOAD  |TermAppISO with 40 provider threads   |CPU Usage |Percent single processor |Bias | 101.5398|    10.3896|  9.7732|       0|
|10 |MODEL |TermAppISO with 40 provider threads   |CPU Usage |Percent single processor |Bias | 117.6328|    10.3313| 11.3861|       0|
|13 |LOAD  |TermAppISO with 80 provider threads   |CPU Usage |Percent single processor |Bias | 122.9775|    13.3204|  9.2323|       0|
|16 |MODEL |TermAppISO with 80 provider threads   |CPU Usage |Percent single processor |Bias | 150.1654|    13.7933| 10.8868|       0|
  • The following tables show estimates and projections of Network usage for each class (by hosted function) of server where some confidence in these numbers is reasonable. A coefficient is determined reasonable by the significance of the respective class coefficient's p-value.
  • Where there is some significant response of the resource utilisation to the applied load, and where there is some confidence in this correlation, an estimate of the resource usage can be determined for capacity planning and/or comparison purposes. Here, the column Est Use @ 30.000000/s is the expected Network usage at 30 requests per second. The column Estimate should be used as a factor to multiply by the transaction rate in order to estimate the resource usage required to support that transaction rate. The column Std. Error should be used to determine the confidence interval around the estimate:
|   |Class |Test                                  |Measure            |Units           |Coef |  Estimate| Std. Error| t value| p.value| Est Use @ 30.000000/s|
|:--|:-----|:-------------------------------------|:------------------|:---------------|:----|---------:|----------:|-------:|-------:|---------------------:|
|2  |LOAD  |TermAppISO Integrator Routing Changes |Network Usage recv |bits per second |Rate | 12978.364|   542.3693| 23.9290|       0|              389350.9|
|3  |LOAD  |TermAppISO Integrator Routing Changes |Network Usage sent |bits per second |Rate | 32193.800|   653.6896| 49.2494|       0|              965814.0|
|5  |MODEL |TermAppISO Integrator Routing Changes |Network Usage recv |bits per second |Rate | 17467.524|   683.9001| 25.5410|       0|              524025.7|
|6  |MODEL |TermAppISO Integrator Routing Changes |Network Usage sent |bits per second |Rate | 10756.811|   769.5274| 13.9785|       0|              322704.3|
|8  |LOAD  |TermAppISO with 40 provider threads   |Network Usage recv |bits per second |Rate | 12795.930|   585.1314| 21.8685|       0|              383877.9|
|9  |LOAD  |TermAppISO with 40 provider threads   |Network Usage sent |bits per second |Rate | 31183.826|   720.3647| 43.2889|       0|              935514.8|
|11 |MODEL |TermAppISO with 40 provider threads   |Network Usage recv |bits per second |Rate | 17365.660|   680.3398| 25.5250|       0|              520969.8|
|12 |MODEL |TermAppISO with 40 provider threads   |Network Usage sent |bits per second |Rate | 10172.372|   701.9124| 14.4924|       0|              305171.2|
|14 |LOAD  |TermAppISO with 80 provider threads   |Network Usage recv |bits per second |Rate | 11584.198|   765.3293| 15.1362|       0|              347525.9|
|15 |LOAD  |TermAppISO with 80 provider threads   |Network Usage sent |bits per second |Rate | 29457.871|  1469.8390| 20.0416|       0|              883736.1|
|17 |MODEL |TermAppISO with 80 provider threads   |Network Usage recv |bits per second |Rate | 17177.635|   679.8074| 25.2684|       0|              515329.0|
|18 |MODEL |TermAppISO with 80 provider threads   |Network Usage sent |bits per second |Rate |  9045.038|   690.0198| 13.1084|       0|              271351.1|
  • In some cases, it is possible to estimate with confidence the background workload on the various servers and server groups, the resource usage which is independent of the applied test load. The column Estimate indicates this. The column Std. Error should be used to determine a confidence interval:
|   |Class |Test                                  |Measure            |Units           |Coef | Estimate| Std. Error| t value| p.value|
|:--|:-----|:-------------------------------------|:------------------|:---------------|:----|--------:|----------:|-------:|-------:|
|2  |LOAD  |TermAppISO Integrator Routing Changes |Network Usage recv |bits per second |Bias | 124584.2|   9904.489| 12.5786|       0|
|3  |LOAD  |TermAppISO Integrator Routing Changes |Network Usage sent |bits per second |Bias | 109170.1|  11937.368|  9.1452|       0|
|5  |MODEL |TermAppISO Integrator Routing Changes |Network Usage recv |bits per second |Bias | 128789.6|  12489.057| 10.3122|       0|
|6  |MODEL |TermAppISO Integrator Routing Changes |Network Usage sent |bits per second |Bias | 307108.4|  14052.742| 21.8540|       0|
|8  |LOAD  |TermAppISO with 40 provider threads   |Network Usage recv |bits per second |Bias | 123844.1|  10400.925| 11.9070|       0|
|9  |LOAD  |TermAppISO with 40 provider threads   |Network Usage sent |bits per second |Bias | 114274.4|  12804.747|  8.9244|       0|
|11 |MODEL |TermAppISO with 40 provider threads   |Network Usage recv |bits per second |Bias | 130831.5|  12093.291| 10.8185|       0|
|12 |MODEL |TermAppISO with 40 provider threads   |Network Usage sent |bits per second |Bias | 291049.7|  12476.750| 23.3274|       0|
|14 |LOAD  |TermAppISO with 80 provider threads   |Network Usage recv |bits per second |Bias | 139212.9|  13895.777| 10.0184|       0|
|15 |LOAD  |TermAppISO with 80 provider threads   |Network Usage sent |bits per second |Bias | 136435.5|  26687.275|  5.1124|       0|
|17 |MODEL |TermAppISO with 80 provider threads   |Network Usage recv |bits per second |Bias | 131232.3|  12171.963| 10.7815|       0|
|18 |MODEL |TermAppISO with 80 provider threads   |Network Usage sent |bits per second |Bias | 398080.4|  12354.817| 32.2207|       0|

Feedback

Record

Notes from the test

Landscape

  • The analysis is performed for each test within the test session and for each unique Classification of a server in the collected Server landscape/Classification list. For each Interval the resources are summed across all the servers in that class. This means that the resource usage coefficients and projections are for the total resource usage across the Classification.
|   |Classification |Server    |IP_Address     |OSType |Description   |Hardware_Support |Server_Support  |Application_Support |SOURCE_FILE                            |
|:--|:--------------|:---------|:--------------|:------|:-------------|:----------------|:---------------|:-------------------|:--------------------------------------|
|1  |LOAD           |LOAD0     |176.67.166.86  |Linux  |CML EcoSystem |Patrick Hayward  |Patrick Hayward |Patrick Hayward     |CMLEcoSystem_Server_Classification.csv |
|2  |LOAD           |LOAD1     |176.67.166.89  |Linux  |CML EcoSystem |Patrick Hayward  |Patrick Hayward |Patrick Hayward     |CMLEcoSystem_Server_Classification.csv |
|3  |MODEL          |MODELAPP0 |176.67.166.20  |Linux  |CML EcoSystem |Patrick Hayward  |Patrick Hayward |Patrick Hayward     |CMLEcoSystem_Server_Classification.csv |
|4  |MODEL          |MODELAPP1 |176.67.166.72  |Linux  |CML EcoSystem |Patrick Hayward  |Patrick Hayward |Patrick Hayward     |CMLEcoSystem_Server_Classification.csv |
|5  |NETWORK        |NETWORK   |109.123.111.17 |Linux  |CML EcoSystem |Patrick Hayward  |Patrick Hayward |Patrick Hayward     |CMLEcoSystem_Server_Classification.csv |

Analysis

Test: TermAppISO Integrator Routing Changes

  • This test started at 2020-12-16 10:00:00 and ended at 2020-12-16 11:21:00.

Resource usage for platform Linux

Server class LOAD CPU usage

CPU Usage - cpu.cpu.system.user
Call:
lm(formula = Value.sum ~ Rate, data = summ.class.include)

Residuals:
    Min      1Q  Median      3Q     Max 
-95.818 -31.028  -2.253  37.176  75.617 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept) 110.0495    10.4848   10.50   <2e-16 ***
Rate          9.7798     0.5741   17.03   <2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 42.89 on 77 degrees of freedom
Multiple R-squared:  0.7903,	Adjusted R-squared:  0.7875 
F-statistic: 290.1 on 1 and 77 DF,  p-value: < 2.2e-16

D20201217 T144639 Linux CPU cpucpusystemuser USAGE BY LOAD CPUUsagePercentsingleprocessor LOAD TermAppISONFT IR 1.png

Server class LOAD Network usage

Network Usage recv - recv
Call:
lm(formula = Value.sum ~ Rate, data = summ.class.include)

Residuals:
   Min     1Q Median     3Q    Max 
-87580 -25970  -2891  34849  72610 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept) 124584.2     9904.5   12.58   <2e-16 ***
Rate         12978.4      542.4   23.93   <2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 40520 on 77 degrees of freedom
Multiple R-squared:  0.8815,	Adjusted R-squared:  0.8799 
F-statistic: 572.6 on 1 and 77 DF,  p-value: < 2.2e-16

D20201217 T144639 Linux Network recv USAGE BY LOAD NetworkUsagerecvbitspersecond LOAD TermAppISONFT IR 1.png

Network Usage sent - sent
Call:
lm(formula = Value.sum ~ Rate, data = summ.class.include)

Residuals:
    Min      1Q  Median      3Q     Max 
-150639  -32571   -2222   35736  138570 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept) 109170.1    11937.4   9.145  6.3e-14 ***
Rate         32193.8      653.7  49.249  < 2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 48830 on 77 degrees of freedom
Multiple R-squared:  0.9692,	Adjusted R-squared:  0.9688 
F-statistic:  2425 on 1 and 77 DF,  p-value: < 2.2e-16

D20201217 T144639 Linux Network sent USAGE BY LOAD NetworkUsagesentbitspersecond LOAD TermAppISONFT IR 1.png

Server class MODEL CPU usage

CPU Usage - cpu.cpu.system.user
Call:
lm(formula = Value.sum ~ Rate, data = summ.class.include)

Residuals:
     Min       1Q   Median       3Q      Max 
-105.983  -33.038    2.011   40.208   69.626 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept) 122.6891    10.8038   11.36   <2e-16 ***
Rate          7.3068     0.5916   12.35   <2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 44.2 on 77 degrees of freedom
Multiple R-squared:  0.6645,	Adjusted R-squared:  0.6602 
F-statistic: 152.5 on 1 and 77 DF,  p-value: < 2.2e-16

D20201217 T144639 Linux CPU cpucpusystemuser USAGE BY LOAD CPUUsagePercentsingleprocessor MODEL TermAppISONFT IR 1.png

Server class MODEL Network usage

Network Usage recv - recv
Call:
lm(formula = Value.sum ~ Rate, data = summ.class.include)

Residuals:
   Min     1Q Median     3Q    Max 
-99018 -38631  -6078  38439  91146 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept) 128789.6    12489.1   10.31 3.68e-16 ***
Rate         17467.5      683.9   25.54  < 2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 51090 on 77 degrees of freedom
Multiple R-squared:  0.8944,	Adjusted R-squared:  0.8931 
F-statistic: 652.3 on 1 and 77 DF,  p-value: < 2.2e-16

D20201217 T144639 Linux Network recv USAGE BY LOAD NetworkUsagerecvbitspersecond MODEL TermAppISONFT IR 1.png

Network Usage sent - sent
Call:
lm(formula = Value.sum ~ Rate, data = summ.class.include)

Residuals:
    Min      1Q  Median      3Q     Max 
-138393  -43011    6723   49943   94068 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept) 307108.4    14052.7   21.85   <2e-16 ***
Rate         10756.8      769.5   13.98   <2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 57490 on 77 degrees of freedom
Multiple R-squared:  0.7173,	Adjusted R-squared:  0.7137 
F-statistic: 195.4 on 1 and 77 DF,  p-value: < 2.2e-16

D20201217 T144639 Linux Network sent USAGE BY LOAD NetworkUsagesentbitspersecond MODEL TermAppISONFT IR 1.png

Test: TermAppISO with 40 provider threads

  • This test started at 2020-12-16 14:24:00 and ended at 2020-12-16 15:45:00.

Resource usage for platform Linux

Server class LOAD CPU usage

CPU Usage - cpu.cpu.system.user
Call:
lm(formula = Value.sum ~ Rate, data = summ.class.include)

Residuals:
    Min      1Q  Median      3Q     Max 
-90.543 -32.961   0.325  39.285  69.079 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept) 101.5398    10.3896   9.773 3.45e-15 ***
Rate         10.1977     0.5845  17.447  < 2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 44.02 on 78 degrees of freedom
Multiple R-squared:  0.796,	Adjusted R-squared:  0.7934 
F-statistic: 304.4 on 1 and 78 DF,  p-value: < 2.2e-16

D20201217 T144639 Linux CPU cpucpusystemuser USAGE BY LOAD CPUUsagePercentsingleprocessor LOAD TermAppISO IR 40Thrds 2.png

Server class LOAD Network usage

Network Usage recv - recv
Call:
lm(formula = Value.sum ~ Rate, data = summ.class.include)

Residuals:
   Min     1Q Median     3Q    Max 
-88468 -33608  -4585  40545  78441 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept) 123844.1    10400.9   11.91   <2e-16 ***
Rate         12795.9      585.1   21.87   <2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 44070 on 78 degrees of freedom
Multiple R-squared:  0.8598,	Adjusted R-squared:  0.858 
F-statistic: 478.2 on 1 and 78 DF,  p-value: < 2.2e-16

D20201217 T144639 Linux Network recv USAGE BY LOAD NetworkUsagerecvbitspersecond LOAD TermAppISO IR 40Thrds 2.png

Network Usage sent - sent
Call:
lm(formula = Value.sum ~ Rate, data = summ.class.include)

Residuals:
    Min      1Q  Median      3Q     Max 
-138541  -28229   -6853   31025  136027 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept) 114274.4    12804.7   8.924 1.51e-13 ***
Rate         31183.8      720.4  43.289  < 2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 54250 on 78 degrees of freedom
Multiple R-squared:   0.96,	Adjusted R-squared:  0.9595 
F-statistic:  1874 on 1 and 78 DF,  p-value: < 2.2e-16

D20201217 T144639 Linux Network sent USAGE BY LOAD NetworkUsagesentbitspersecond LOAD TermAppISO IR 40Thrds 2.png

Server class MODEL CPU usage

CPU Usage - cpu.cpu.system.user
Call:
lm(formula = Value.sum ~ Rate, data = summ.class.include)

Residuals:
    Min      1Q  Median      3Q     Max 
-96.748 -34.072  -0.073  41.925  62.874 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept) 117.6328    10.3313   11.39   <2e-16 ***
Rate          7.9295     0.5812   13.64   <2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 43.77 on 78 degrees of freedom
Multiple R-squared:  0.7047,	Adjusted R-squared:  0.7009 
F-statistic: 186.1 on 1 and 78 DF,  p-value: < 2.2e-16

D20201217 T144639 Linux CPU cpucpusystemuser USAGE BY LOAD CPUUsagePercentsingleprocessor MODEL TermAppISO IR 40Thrds 2.png

Server class MODEL Network usage

Network Usage recv - recv
Call:
lm(formula = Value.sum ~ Rate, data = summ.class.include)

Residuals:
    Min      1Q  Median      3Q     Max 
-119472  -34142   -4472   36359   93466 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept) 130831.5    12093.3   10.82   <2e-16 ***
Rate         17365.7      680.3   25.52   <2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 51240 on 78 degrees of freedom
Multiple R-squared:  0.8931,	Adjusted R-squared:  0.8917 
F-statistic: 651.5 on 1 and 78 DF,  p-value: < 2.2e-16

D20201217 T144639 Linux Network recv USAGE BY LOAD NetworkUsagerecvbitspersecond MODEL TermAppISO IR 40Thrds 2.png

Network Usage sent - sent
Call:
lm(formula = Value.sum ~ Rate, data = summ.class.include)

Residuals:
    Min      1Q  Median      3Q     Max 
-126840  -35791    2027   46972   86404 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept) 291049.7    12476.8   23.33   <2e-16 ***
Rate         10172.4      701.9   14.49   <2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 52860 on 78 degrees of freedom
Multiple R-squared:  0.7292,	Adjusted R-squared:  0.7257 
F-statistic:   210 on 1 and 78 DF,  p-value: < 2.2e-16

D20201217 T144639 Linux Network sent USAGE BY LOAD NetworkUsagesentbitspersecond MODEL TermAppISO IR 40Thrds 2.png

Test: TermAppISO with 80 provider threads

  • This test started at 2020-12-16 16:04:00 and ended at 2020-12-16 17:25:00.

Resource usage for platform Linux

Server class LOAD CPU usage

CPU Usage - cpu.cpu.system.user
Call:
lm(formula = Value.sum ~ Rate, data = summ.class.include)

Residuals:
     Min       1Q   Median       3Q      Max 
-221.626  -23.433    2.218   40.490   67.924 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept) 122.9775    13.3204   9.232 1.47e-13 ***
Rate          8.6570     0.7336  11.800  < 2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 49.24 on 67 degrees of freedom
Multiple R-squared:  0.6751,	Adjusted R-squared:  0.6703 
F-statistic: 139.2 on 1 and 67 DF,  p-value: < 2.2e-16

D20201217 T144639 Linux CPU cpucpusystemuser USAGE BY LOAD CPUUsagePercentsingleprocessor LOAD TermAppISO IR 80Thrds 3.png

Server class LOAD Network usage

Network Usage recv - recv
Call:
lm(formula = Value.sum ~ Rate, data = summ.class.include)

Residuals:
    Min      1Q  Median      3Q     Max 
-258682  -21562    1554   36159   73958 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept) 139212.9    13895.8   10.02 5.95e-15 ***
Rate         11584.2      765.3   15.14  < 2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 51370 on 67 degrees of freedom
Multiple R-squared:  0.7737,	Adjusted R-squared:  0.7704 
F-statistic: 229.1 on 1 and 67 DF,  p-value: < 2.2e-16

D20201217 T144639 Linux Network recv USAGE BY LOAD NetworkUsagerecvbitspersecond LOAD TermAppISO IR 80Thrds 3.png

Network Usage sent - sent
Call:
lm(formula = Value.sum ~ Rate, data = summ.class.include)

Residuals:
    Min      1Q  Median      3Q     Max 
-682884  -31975   -2386   52000  156790 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept)   136436      26687   5.112 2.86e-06 ***
Rate           29458       1470  20.042  < 2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 98650 on 67 degrees of freedom
Multiple R-squared:  0.857,	Adjusted R-squared:  0.8549 
F-statistic: 401.7 on 1 and 67 DF,  p-value: < 2.2e-16

D20201217 T144639 Linux Network sent USAGE BY LOAD NetworkUsagesentbitspersecond LOAD TermAppISO IR 80Thrds 3.png

Server class MODEL CPU usage

CPU Usage - cpu.cpu.system.user
Call:
lm(formula = Value.sum ~ Rate, data = summ.class.include)

Residuals:
     Min       1Q   Median       3Q      Max 
-243.950  -20.341    8.173   36.541   72.173 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept) 150.1654    13.7933  10.887  < 2e-16 ***
Rate          6.5813     0.7597   8.663 1.54e-12 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 50.99 on 67 degrees of freedom
Multiple R-squared:  0.5283,	Adjusted R-squared:  0.5213 
F-statistic: 75.05 on 1 and 67 DF,  p-value: 1.538e-12

D20201217 T144639 Linux CPU cpucpusystemuser USAGE BY LOAD CPUUsagePercentsingleprocessor MODEL TermAppISO IR 80Thrds 3.png

Server class MODEL Network usage

Network Usage recv - recv
Call:
lm(formula = Value.sum ~ Rate, data = summ.class.include)

Residuals:
   Min     1Q Median     3Q    Max 
-94940 -29197   3546  28001  86960 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept) 131232.3    12172.0   10.78 3.37e-16 ***
Rate         17177.6      679.8   25.27  < 2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 44530 on 66 degrees of freedom
Multiple R-squared:  0.9063,	Adjusted R-squared:  0.9049 
F-statistic: 638.5 on 1 and 66 DF,  p-value: < 2.2e-16

D20201217 T144639 Linux Network recv USAGE BY LOAD NetworkUsagerecvbitspersecond MODEL TermAppISO IR 80Thrds 3.png

Network Usage sent - sent
Call:
lm(formula = Value.sum ~ Rate, data = summ.class.include)

Residuals:
    Min      1Q  Median      3Q     Max 
-128661  -29686    1127   40736   78245 

Coefficients:
            Estimate Std. Error t value Pr(>|t|)    
(Intercept)   398080      12355   32.22   <2e-16 ***
Rate            9045        690   13.11   <2e-16 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 45200 on 66 degrees of freedom
Multiple R-squared:  0.7225,	Adjusted R-squared:  0.7183 
F-statistic: 171.8 on 1 and 66 DF,  p-value: < 2.2e-16

D20201217 T144639 Linux Network sent USAGE BY LOAD NetworkUsagesentbitspersecond MODEL TermAppISO IR 80Thrds 3.png

Performance

  • For test TermAppISO Integrator Routing Changes/TermAppISONFT_IR (Test 1, from 2020-12-16 10:00:00 to 2020-12-16 11:21:00), summary of response times by operation/function-outcome over the range of loads where the arrival rate did not exceed the observed or required peak target rate of 15 arrivals per second (this rate is as opposed to the projected/future peak rate). This cut-off time occured at 2020-12-16 10:39:00. The descriptive statistics mean, median and sd are calculated over the entire time-frame that the arrival rate did not exceed the target arrival rate, which includes any outliers caused by possible external influences (which are removed for the regression analysis).
  • Distribution of response times where rate does not exceed the target cutoff target rate for outcome disconnect:

D20201217 T144639 RESP SUMM 01 TermAppISONFT IR disconnect.png

|   |Basename                   |Outcome    | Count| Percent|  Resp| StdDev|
|:--|:--------------------------|:----------|-----:|-------:|-----:|------:|
|1  |authorisation_request_1100 |disconnect |     3|   0.015| 4.318|  0.124|
  • Distribution of response times where rate does not exceed the target cutoff target rate for outcome OK:

D20201217 T144639 RESP SUMM 01 TermAppISONFT IR OK.png

|   |Basename                         |Outcome | Count| Percent|  Resp| StdDev|
|:--|:--------------------------------|:-------|-----:|-------:|-----:|------:|
|2  |authorisation_request_1100       |OK      | 19400|  99.954| 4.531|  7.550|
|4  |transaction_advice_response_1230 |OK      | 19299|  99.855| 0.600|  0.426|
  • Distribution of response times where rate does not exceed the target cutoff target rate for outcome timeout:

D20201217 T144639 RESP SUMM 01 TermAppISONFT IR timeout.png

|   |Basename                         |Outcome | Count| Percent|   Resp| StdDev|
|:--|:--------------------------------|:-------|-----:|-------:|------:|------:|
|3  |authorisation_request_1100       |timeout |     6|   0.031| 99.999|      0|
|5  |transaction_advice_response_1230 |timeout |    28|   0.145| 99.999|      0|
  • For test TermAppISO with 40 provider threads/TermAppISO_IR_40Thrds (Test 2, from 2020-12-16 14:24:00 to 2020-12-16 15:45:00), summary of response times by operation/function-outcome over the range of loads where the arrival rate did not exceed the observed or required peak target rate of 15 arrivals per second (this rate is as opposed to the projected/future peak rate). This cut-off time occured at 2020-12-16 15:03:00. The descriptive statistics mean, median and sd are calculated over the entire time-frame that the arrival rate did not exceed the target arrival rate, which includes any outliers caused by possible external influences (which are removed for the regression analysis).
  • Distribution of response times where rate does not exceed the target cutoff target rate for outcome disconnect:

D20201217 T144639 RESP SUMM 02 TermAppISO IR 40Thrds disconnect.png

|   |Basename                   |Outcome    | Count| Percent|  Resp| StdDev|
|:--|:--------------------------|:----------|-----:|-------:|-----:|------:|
|1  |authorisation_request_1100 |disconnect |     2|    0.01| 4.258|   0.06|
  • Distribution of response times where rate does not exceed the target cutoff target rate for outcome OK:

D20201217 T144639 RESP SUMM 02 TermAppISO IR 40Thrds OK.png

|   |Basename                         |Outcome | Count| Percent|  Resp| StdDev|
|:--|:--------------------------------|:-------|-----:|-------:|-----:|------:|
|2  |authorisation_request_1100       |OK      | 19591|  99.974| 4.483|  7.560|
|4  |transaction_advice_response_1230 |OK      | 19503|  99.918| 0.602|  0.428|
  • Distribution of response times where rate does not exceed the target cutoff target rate for outcome timeout:

D20201217 T144639 RESP SUMM 02 TermAppISO IR 40Thrds timeout.png

|   |Basename                         |Outcome | Count| Percent|   Resp| StdDev|
|:--|:--------------------------------|:-------|-----:|-------:|------:|------:|
|3  |authorisation_request_1100       |timeout |     3|   0.015| 99.999|      0|
|5  |transaction_advice_response_1230 |timeout |    16|   0.082| 99.999|      0|
  • For test TermAppISO with 80 provider threads/TermAppISO_IR_80Thrds (Test 3, from 2020-12-16 16:04:00 to 2020-12-16 17:25:00), summary of response times by operation/function-outcome over the range of loads where the arrival rate did not exceed the observed or required peak target rate of 15 arrivals per second (this rate is as opposed to the projected/future peak rate). This cut-off time occured at 2020-12-16 16:43:00. The descriptive statistics mean, median and sd are calculated over the entire time-frame that the arrival rate did not exceed the target arrival rate, which includes any outliers caused by possible external influences (which are removed for the regression analysis).
  • Distribution of response times where rate does not exceed the target cutoff target rate for outcome disconnect:

D20201217 T144639 RESP SUMM 03 TermAppISO IR 80Thrds disconnect.png

|   |Basename                   |Outcome    | Count| Percent|  Resp| StdDev|
|:--|:--------------------------|:----------|-----:|-------:|-----:|------:|
|1  |authorisation_request_1100 |disconnect |     5|   0.026| 4.191|  0.021|
  • Distribution of response times where rate does not exceed the target cutoff target rate for outcome OK:

D20201217 T144639 RESP SUMM 03 TermAppISO IR 80Thrds OK.png

|   |Basename                         |Outcome | Count| Percent|  Resp| StdDev|
|:--|:--------------------------------|:-------|-----:|-------:|-----:|------:|
|2  |authorisation_request_1100       |OK      | 19369|  99.943| 5.214|  8.069|
|4  |transaction_advice_response_1230 |OK      | 19227|  99.704| 0.653|  0.493|
  • Distribution of response times where rate does not exceed the target cutoff target rate for outcome timeout:

D20201217 T144639 RESP SUMM 03 TermAppISO IR 80Thrds timeout.png

|   |Basename                         |Outcome | Count| Percent|   Resp| StdDev|
|:--|:--------------------------------|:-------|-----:|-------:|------:|------:|
|5  |transaction_advice_response_1230 |timeout |    57|   0.296| 99.999|      0|
|3  |authorisation_request_1100       |timeout |     6|   0.031| 99.999|      0|

Operation authorisation_request_1100

D20201217 T144639 Function authorisation request 1100 RESP.png

D20201217 T144639 Function authorisation request 1100 RATE.png

Operation transaction_advice_response_1230

D20201217 T144639 Function transaction advice response 1230 RESP.png

D20201217 T144639 Function transaction advice response 1230 RATE.png

Resource Usage

Linux Server CPU Usage

TermAppISO Integrator Routing Changes

Server LOAD0

D20201217 T144639 CMLXLINP CPU USAGE 01 TermAppISONFT IR LOAD0.png

Server LOAD1

D20201217 T144639 CMLXLINP CPU USAGE 01 TermAppISONFT IR LOAD1.png

Server MODELAPP0

D20201217 T144639 CMLXLINP CPU USAGE 01 TermAppISONFT IR MODELAPP0.png

Server MODELAPP1

D20201217 T144639 CMLXLINP CPU USAGE 01 TermAppISONFT IR MODELAPP1.png

TermAppISO with 40 provider threads

Server LOAD0

D20201217 T144639 CMLXLINP CPU USAGE 02 TermAppISO IR 40Thrds LOAD0.png

Server LOAD1

D20201217 T144639 CMLXLINP CPU USAGE 02 TermAppISO IR 40Thrds LOAD1.png

Server MODELAPP0

D20201217 T144639 CMLXLINP CPU USAGE 02 TermAppISO IR 40Thrds MODELAPP0.png

Server MODELAPP1

D20201217 T144639 CMLXLINP CPU USAGE 02 TermAppISO IR 40Thrds MODELAPP1.png

TermAppISO with 80 provider threads

Server LOAD0

D20201217 T144639 CMLXLINP CPU USAGE 03 TermAppISO IR 80Thrds LOAD0.png

Server LOAD1

D20201217 T144639 CMLXLINP CPU USAGE 03 TermAppISO IR 80Thrds LOAD1.png

Server MODELAPP0

D20201217 T144639 CMLXLINP CPU USAGE 03 TermAppISO IR 80Thrds MODELAPP0.png

Server MODELAPP1

D20201217 T144639 CMLXLINP CPU USAGE 03 TermAppISO IR 80Thrds MODELAPP1.png

Linux Server Disk Activity

Server LOAD1

D20201217 T144639 CMLXLINP DISK METRIC LOAD1 reads.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD1 reads merged.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD1 read sectors.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD1 read milli.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD1 writes.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD1 writes merged.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD1 write sectors.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD1 write milli.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD1 io inprogress.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD1 io milli.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD1 io weighted milli.png

Server MODELAPP1

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP1 reads.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP1 reads merged.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP1 read sectors.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP1 read milli.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP1 writes.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP1 writes merged.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP1 write sectors.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP1 write milli.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP1 io inprogress.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP1 io milli.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP1 io weighted milli.png

Server LOAD0

D20201217 T144639 CMLXLINP DISK METRIC LOAD0 reads.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD0 reads merged.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD0 read sectors.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD0 read milli.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD0 writes.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD0 writes merged.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD0 write sectors.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD0 write milli.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD0 io inprogress.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD0 io milli.png

D20201217 T144639 CMLXLINP DISK METRIC LOAD0 io weighted milli.png

Server MODELAPP0

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP0 reads.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP0 reads merged.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP0 read sectors.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP0 read milli.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP0 writes.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP0 writes merged.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP0 write sectors.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP0 write milli.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP0 io inprogress.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP0 io milli.png

D20201217 T144639 CMLXLINP DISK METRIC MODELAPP0 io weighted milli.png

Linux Server Memory Usage

Server LOAD1

D20201217 T144639 CMLXLINP MEMMEM METRIC LOAD1.png

Server MODELAPP1

D20201217 T144639 CMLXLINP MEMMEM METRIC MODELAPP1.png

Server LOAD0

D20201217 T144639 CMLXLINP MEMMEM METRIC LOAD0.png

Server MODELAPP0

D20201217 T144639 CMLXLINP MEMMEM METRIC MODELAPP0.png

Linux Server Swap Usage

Server LOAD1

D20201217 T144639 CMLXLINP MEMSWAP METRIC LOAD1.png

Server MODELAPP1

D20201217 T144639 CMLXLINP MEMSWAP METRIC MODELAPP1.png

Server LOAD0

D20201217 T144639 CMLXLINP MEMSWAP METRIC LOAD0.png

Server MODELAPP0

D20201217 T144639 CMLXLINP MEMSWAP METRIC MODELAPP0.png

Linux Server Network Usage

Server LOAD1

D20201217 T144639 CMLXLINP NET METRIC LOAD1 ibytes.png

D20201217 T144639 CMLXLINP NET METRIC LOAD1 ipackets.png

D20201217 T144639 CMLXLINP NET METRIC LOAD1 obytes.png

D20201217 T144639 CMLXLINP NET METRIC LOAD1 opackets.png

Server MODELAPP1

D20201217 T144639 CMLXLINP NET METRIC MODELAPP1 ibytes.png

D20201217 T144639 CMLXLINP NET METRIC MODELAPP1 ipackets.png

D20201217 T144639 CMLXLINP NET METRIC MODELAPP1 obytes.png

D20201217 T144639 CMLXLINP NET METRIC MODELAPP1 opackets.png

Server LOAD0

D20201217 T144639 CMLXLINP NET METRIC LOAD0 ibytes.png

D20201217 T144639 CMLXLINP NET METRIC LOAD0 ipackets.png

D20201217 T144639 CMLXLINP NET METRIC LOAD0 obytes.png

D20201217 T144639 CMLXLINP NET METRIC LOAD0 opackets.png

Server MODELAPP0

D20201217 T144639 CMLXLINP NET METRIC MODELAPP0 ibytes.png

D20201217 T144639 CMLXLINP NET METRIC MODELAPP0 ipackets.png

D20201217 T144639 CMLXLINP NET METRIC MODELAPP0 obytes.png

D20201217 T144639 CMLXLINP NET METRIC MODELAPP0 opackets.png

Wintel Server Resource Usage

Test TermAppISO Integrator Routing Changes

Wintel Server Resource Usage

Test TermAppISO Integrator Routing Changes

Test TermAppISO with 40 provider threads

Test TermAppISO with 80 provider threads

pSeries AIX Server Reource Usage

Test TermAppISO Integrator Routing Changes

Test TermAppISO with 40 provider threads

Test TermAppISO with 80 provider threads

* Code Magus Limited