Flu seasons in the general population
The 2020 and 2021 flu seasons in Australia did not arrive. In fact, in Figure 1 it is hard to even make out the lines representing the weekly number of confirmed flu cases for 2020 and 2021 (green and light blue) since they are so flat and close to zero. It is also clear from the graph that the 2022 flu-season started earlier than usual and had a higher peak.
Flu seasons in residential aged care
The relevant quality indicator collected by MOA Benchmarking is called new respiratory tract infections (RTI) and it includes various infections: common cold, influenza-like illness, lower-respiratory tract infection, pneumonia. COVID-19 is now excluded from the definition since MOA has other tools for that. However, in this data there are some COVID-19 cases counted under RTI, but the mean profile for the aged care services included in this analysis are consistent with low COVID-19 cases. This was deduced by noting that the spike in January 2022 was small, despite being the peak for new COVID-19 cases in the general population.
Data was collected as the count of new respiratory infections in a month at an aged care service and the number of beds in that service at that time. The outcome of interest is the rate of new respiratory tract infections per 1000 bed days within each month computed on all aged care services included in the analysis. The calculation for the rate of new respiratory tract infections (RTI) in month M per 1000 bed days can be calculated from
To ensure that similar aged care services are analysed at the end of the period and the beginning I imposed the inclusion criteria that an aged care service had to have data for January 2018 and January 2022. This limited the sample size a lot compared to what would be available for benchmarking, but the data still tracked an average of 11,309 aged care consumers every month, which for a month with 30 days is 339,276 bed days.
Forecast of 2020 based on data available in 2019
The rate of respiratory tract infections per 1000 bed days for 2018 and 2019 is visualised in Figure 2. I observe that:
- Infections are seasonal.
- Infections peak around July and are at the lowest around February.
We allowed the Seasonal ARIMA (SARIMA) model to be selected automatically using an information criteria (AICc) and the “auto.arima” function in the R package forecast (Hyndman et al. 2022). Using this method I arrive at the model that can be written ARIMA(0,0,1)(1,1,0)[12].
The first part, (0,0,1), indicates that current rates are affected by shocks in the previous month, i.e., shocks to the rate of RTI tend to linger for one month. The second part, (1,1,0)[12], indicates that current rate is a function of the rate 12 months ago and the difference between the rates 12 and 24 months ago.
Residuals pass the Ljung-Box test with a lag of 11 (p=0.824). The residuals are visualised in Figure 3. The correlelogram doesn’t show any serial dependence in residuals. The distribution of residuals appears to be somewhat gaussian, but with a high peak and left skew. However, on the whole, I conclude that residuals appear reasonable.
The model can be written using the back-shift operator, B, as
and expanding the model, I get the form
The parameters for this model estimated based on the training data are given in Table 1. The sign of the indicates that a positive (negative) shock in the previous month tends to be associated with a positive (negative) shock in the current month. The indicates that the current rate is a combination of the rate a year ago and to a lesser extent the rate two years ago.
0.6 | -0.358 |
The RTI forecast using this SARIMA model over the next two years using data available at the end of 2019 is visualised in Figure 4 with 95% confidence intervals. The point forecast looks quite reasonable, if a season tends to be similar to the previous season.
What actually happened
It is probably obvious that the above forecast would not have captured the rate of new respiratory tract infections in 2020 since the flu season did not arrive, due to lockdowns and social distancing measures. The actual observed rate of new respiratory tract infections in aged care services over the analysis period is shown in Figure 5. In 2020 and 2021 not only was the seasonal effect much weaker, but the overall level was lower. In Figure 6 that the difference between the rate during flu-seasons (winter) and out of season (summer) disappeared in 2020.
Actual rate compared with forecast
The first border restrictions in Australia in response to COVID-19 were introduced March of 2020 (Parliment of Australia 2020). In Figure 7 the forecast looks reasonable up to and including March 2020. At March 2020 there appears to be a structural break and the sinusoidal wave that was predicted to continue did not appear in 2020 and 2021. The forecast error plotted in Figure 8 makes the missing flu seasons even more apparent.
While the flu season didn’t arrive in 2020 and 2021 as per the data in the overall population (Department of Health and Aged Care 2022), there was still a level of non-flu respiratory tract infections observed in the population of aged care consumers.
In more recent months, i.e., May-July 2022, there was a high level of respiratory tract infections. In these months, compared to the forecast based on pre-2020 data, the rate of RTI was high and peaked earlier than usual. The same features of the 2022 flu season were present in the general population as well, which can be observed in Figure 1.
The total cumulative deviation from the forecast at the end of 2021 was 0.372 per person. According to GEN Aged Care Data, the number of people using residential aged care as of 30th of June 2021 was 371,000 (Australian Institute of Health and Welfare 2022). Based on this, I estimate that about 138,000 respiratory tract infections were averted over 2020 and 2021.
Comparing directly with previous years
In addition to forecasting the rate of respiratory tract infections, I also compared 2020 and 2021 with previous years directly as in Figure 9. This leaves all the random variation of 2016-2019, but allows for an intuitive comparison with previous observed rates. The structural break after March 2020 can also be observed in this figure.
Different restrictions were present across states in response to COVID-19, so there are some differences in how RTI incidence changed by state. However, these differences do not alter the overall interpretation of this analysis.
Conclusion
The lack of 2020 and 2021 flu seasons in Australia, due to lockdowns and social distancing, were also observed in the aged care setting based on data on respiratory tract infections. However, a non-negligible number of new respiratory tract infections were still present throughout 2020 and 2021. Comparing forecasts to actual observations suggest there is a structural break in the rate of new respiratory tract infections after March 2020. In April 2022 the lower level of RTI incidence appears to have ended with the arrival of an earlier than usual flu season.