How Stable Are Maintenance Priorities
The report examines, for an abstract set of assets, how maintenance priorities change when a few assumptions are varied. It draws on an assumptions register and shows an illustrative change in ranking; the lack of calibration is stated as a limit. The full text is the readable report.
Summary
A single maintenance priority list looks more dependable than it is when its assumptions stay invisible. Using an abstract set of six assets, this report shows how the ranking changes when only a few parameters are varied: the time horizon, a common deterioration factor, and the deterioration rate of a single asset. The report is a document from the scenario, not scientific evidence; numbers and assets are constructed and do not assess any real municipality.
Research question
The project Uncertainty in municipal maintenance models asks which assumptions change a priority list the most. A single model curve hides the fact that initial conditions, deterioration rates and weightings are uncertain. This report confines itself to a sub-question: how stable is the ranking when individual assumptions are changed systematically but only slightly, and which assumptions should be listed explicitly in an assumptions register?
Set-up
The example has four steps. First, a set of six abstract assets A to F is fixed. Second, the assumptions are recorded in a register (see Assumptions register for maintenance models). Third, a baseline run is computed. Fourth, a few parameters are varied one at a time and the rankings are compared. The modelling belongs to the modelling workshop; the project is led by the head of the Simulation and Modelling research area.
Each asset has an initial state s0 on a scale from 0 (good) to 3 (poor), a deterioration rate p (probability per year of dropping one state step) and a consequence weight c from 1 to 5. For a horizon of H years, a simplified expected-value approximation of the discrete state transition is used:
- expected state d = min(3, s0 + H · p);
- priority value = c · d;
- rank 1 has the largest priority value.
Rankings are compared by counting discordant pairs. A pair of assets is discordant if the two lists order it differently. With six assets there are 15 pairs; Kendall’s rank correlation is τ = 1 − 2 · (discordant pairs) / 15.
Assumptions
This report is a document; all values are constructed, uncalibrated and support no statement about real assets. The assumptions register for this example contains:
- The assets are independent of one another; there are no maintenance budgets and no dependencies.
- The state scale is equally spaced; a step from 2 to 3 counts the same as one from 0 to 1.
- Deterioration is constant and independent of age; the expected-value approximation ignores that the state ends at 3.
- The consequence weight is fixed and treated as known.
- The horizon is 5 years in the baseline run; it is freely chosen.
Each of these assumptions can change the ranking. In the example only assumptions 3 and 5 are varied.
Illustrative analysis
Constructed worked example, not a measurement. The baseline parameters are given in the first table.
| Asset | Initial state s0 (0 to 3) | Deterioration p per year | Consequence weight c (1 to 5) |
|---|---|---|---|
| A | 2 | 0.10 | 2 |
| B | 1 | 0.30 | 3 |
| C | 0 | 0.40 | 4 |
| D | 2 | 0.05 | 5 |
| E | 1 | 0.25 | 4 |
| F | 0 | 0.25 | 5 |
The baseline run (H = 5, factor 1) gives the priority values A 5.00, B 7.50, C 8.00, D 11.25, E 9.00 and F 6.25. The ranking is D, E, C, B, F, A. As a check: for C, d = min(3, 0 + 5 · 0.40) = 2, so 4 · 2 = 8. For D, d = 2 + 5 · 0.05 = 2.25 and the value is 5 · 2.25 = 11.25. Three variants are then computed.
| Run | Parameter change | Ranking (rank 1 first) | Discordant pairs versus baseline | τ |
|---|---|---|---|---|
| Baseline | H = 5; all p unchanged | D, E, C, B, F, A | 0 | 1.00 |
| V1 | H = 3 | D, E, B, C, A, F | 2 | 0.73 |
| V2 | H = 5; all p multiplied by 1.5 | C, D, E, F, B, A | 3 | 0.60 |
| V3 | H = 5; only p of C lowered to 0.20 | D, E, B, F, A, C | 3 | 0.60 |
In V1, B and C swap places, as do A and F; short horizons favour assets in a poor initial state. In V2, C moves to rank 1 because its rate is high and it reaches state 3 (the cap: 0 + 5 · 0.60 = 3). Asset D, with a high weight but a small rate, drops to rank 2. In V3, halving p for C alone moves that asset from rank 3 to rank 6. Asset D is first in two of the three variants and E is second or third, while the middle and the end of the list change more. A statement such as “D is the most urgent” therefore depends on assumptions 3 and 5.
The report recommends nothing for real assets on the basis of this example; it shows how a rank change can be documented traceably. The share of rank changes attributable to individual assumptions would be a result of its own in a larger study.
Limitations
The parameters are uncalibrated; there is no comparison with condition data, and the six assets stand for no real municipality. Three variants with one change each capture no interactions between parameters and do not amount to a systematic sensitivity analysis. The expected-value approximation neglects the spread of the discrete transitions. Choosing the priority value as the product of weight and expected state is also a convention that other methods would set differently. Municipal deployment planning cannot be derived from this.
Conclusion
In the constructed example, a few changes to two assumptions shift the ranking noticeably; the Kendall correlation with the baseline lies between 0.60 and 0.73. For the practice of such models this yields mainly a methodological requirement: assumptions should be kept in a register, and a priority list should always be shown together with a variation calculation. Whether and how strongly real lists fluctuate cannot be answered by this report.
Background literature
Real, verified sources. They are not part of the report and do not substantiate its content.
- Saltelli, A., Ratto, M., Andres, T., Campolongo, F., Cariboni, J., Gatelli, D., Saisana, M., & Tarantola, S. (2008). Global sensitivity analysis: The primer. Wiley. https://doi.org/10.1002/9780470725184 Relevant as a textbook on methods of global sensitivity analysis and on the question of which input assumptions drive a model output.
- Morris, M. D. (1991). Factorial sampling plans for preliminary computational experiments. Technometrics, 33(2), 161–174. https://doi.org/10.1080/00401706.1991.10484804 Relevant for the principle of varying parameters individually and in small steps, as the report hints at in a heavily simplified form.
- Saltelli, A., Aleksankina, K., Becker, W., Fennell, P., Ferretti, F., Holst, N., Li, S., & Wu, Q. (2019). Why so many published sensitivity analyses are false: A systematic review of sensitivity analysis practices. Environmental Modelling & Software, 114, 29–39. https://doi.org/10.1016/j.envsoft.2019.01.012 Relevant as an overview of common shortcomings in published sensitivity analyses, such as varying only single parameters at a time, which the report names explicitly as a limitation.