Skip to main content

A new scoring system derived from base excess and platelet count at presentation predicts mortality in paediatric meningococcal sepsis

Abstract

Introduction

The aim of this study was to derive a novel prognostic score for mortality in paediatric meningococcal sepsis (MS) based on readily available laboratory markers.

Methods

A multicentre retrospective cohort study for the consortium set and a single centre retrospective study for replication set. The consortium set were 1,073 children (age 1 week to 17.9 years) referred over a 15-year period (1996 to 2011), who had an admission diagnosis of MS, referred to paediatric intensive care units (PICUs) in six different European centres. The consortium set was split into a development set and validation set to derive the score. The replication set were 134 children with MS (age 2 weeks to 16 years) referred over a 4-year period (2007 to 2011) to PICUs via the Children's Acute Transport Service (CATS), London.

Results

A total of 85/1,073 (7.9%) children in the consortium set died. A total of 16/134 (11.9%) children in the replication set died. Children dying in the consortium set had significantly lower base excess, C-reactive protein (CRP), platelet and white cell count, more deranged coagulation and higher lactate than survivors. Paediatric risk of mortality (PRISM) score, Glasgow meningococcal septicaemia prognosis score (GMSPS) and Rotterdam score were also higher. Using the consortium set, a new scoring system using base excess and platelet count at presentation, termed the BEP score, was mathematically developed and validated. BEP predicted mortality with high sensitivity and specificity scores (area under the curve (AUC) in the validation set = 0.86 and in the replication set = 0.96). In the validation set, BEP score performance (AUC = 0.86, confidence interval (CI): 0.80 to 0.91) was better than GMSPS (AUC = 0.77, CI: 0.68, 0.85), similar to Rotterdam (AUC = 0.87, CI: 0.81 to 0.93) and not as good as PRISM (AUC = 0.93, CI: 0.85 to 0.97).

Conclusions

The BEP score, relying on only two variables that are quickly and objectively measurable and readily available at presentation, is highly sensitive and specific in predicting death from MS in childhood.

Introduction

Despite vaccination against Neisseria meningitidis serogroup C, meningococcal sepsis (MS) with non-vaccine serogroups, particularly serogroup B, remains a major public health challenge. Meningococcal disease can evolve extremely rapidly, with non-specific symptoms evolving into severe sepsis with multiple organ failure within hours. Much attention has rightly been devoted to the development of an effective vaccine and to the education of the lay public and medical staff to help identify and act on symptoms of early disease. However in the UK, despite these measures, there are still around 1,000 cases of meningococcal sepsis every year, with about 200 children requiring intensive care. The case fatality rate is 5 to 10% and of those who survive, 10 to 20% develop permanent sequelae, including skin scars, limb amputation, hearing loss, seizures and brain damage [1, 2].

A reliable prognostic scoring system would have two main purposes - first, to identify patients at high risk of deterioration, and second, for risk stratification in future trials of novel therapies in sepsis [3]. Previous clinical trials of specific novel therapies in meningococcal sepsis, targeting pathways of inflammation and coagulation such as recombinant bactericidal/permeability-increasing protein (rBPI) [4] and human activated protein C (rhAPC) [5], have failed for reasons which are not clear, but which may include case mix. Currently, therefore, therapy consists of antibiotics and supportive treatments only. Future trials of novel therapies in MS and indeed in other forms of bacterial sepsis are likely to succeed only if patients at high risk of severe disease are identified and enrolled, rather than patients reliably predicted to survive or die.

More than 20 previous studies have looked at factors which might be predictive of mortality in MS. These have included scoring systems which combine clinical data with laboratory data including the Glasgow meningococcal septicaemia prognostic score (GMSPS) [6] and the paediatric risk of mortality (PRISM) score [7], amongst numerous others (Table 1). The PRISM score, which is a general paediatric intensive care unit (PICU) severity of illness score, has been validated in MS [8]. Scoring systems solely based on laboratory markers include the product of the platelet and neutrophil count (the PN score) [9] and the Rotterdam score, based on potassium, base excess, platelet count and C-reactive protein (CRP) [10]. More recently, scores based on biomarkers have been proposed [11]. While biomarker scores can be highly accurate and are scientifically attractive, they are not useful at the point of presentation as the assays on which they depend take time to run. An ideal score would include a small number of variables that are quickly and objectively measurable, readily available at presentation and cost-effective.

Table 1 Data points used in the different scoring systems discussed in this paper.

Unfortunately, previous studies developing and testing such prognostic scoring systems have in the past not investigated large numbers of patients, the largest previous study looking at only 278 children [12]. Furthermore, PRISM, GMSPS and many of the other clinical or combined scoring systems depend to an extent on subjective assessments which may not be reliable. For example, GMSPS includes the variable 'parental opinion that child's condition has become worse over the past hour'. PRISM requires entry of multiple data points into a complex algorithm and thus is less attractive in emergency settings.

As part of a large European study of genetic factors contributing to disease severity and susceptibility in meningococcal disease, clinical and scoring data became available in a unique and substantial cohort of patients referred to PICUs in the United Kingdom, Austria, Germany and Holland [13].

The aim of this current study was to identify factors predictive of death in this population, including current scoring systems, when data was available. A new score was developed and validated using an independent cohort of patients referred to PICU via the North Thames regional retrieval service, the Children's Acute Transport Service, London, UK (CATS).

Materials and methods

Patients

Data was collected prospectively (and analysed retrospectively) from children referred to PICUs at participating centres over the 15-year study period, 1996 to 2011. Participating centres included St Mary's Hospital (London, UK), Alder Hey Children's Hospital (Liverpool, UK), Medical University of Graz (Graz, Austria), Erasmus-MC Sophia Children's Hospital (Rotterdam, Holland) Emma Children's Hospital (Amsterdam, Holland) (the 'consortium') and the Children's Acute Transport Service (CATS, London, UK). Clinical and other data in consortium patients were collected during ongoing studies at each hospital, approved by the institutional ethics committee for each participating centre. Informed consent was obtained for these patients according to local regulations. Retrospective data collection at CATS was approved by the Great Ormond Street Hospital for Children Clinical Audit Committee. Parental consent was deemed to be unnecessary for patients retrospectively included in this anonymised observational study. Each centre collected and recorded data into their own databases before entering anonymised data onto a centralised web-based data collection system (Dataphiles, Otley, UK).

Definitions

Any child referred to PICU with a clinical diagnosis of MS was eligible for inclusion. The clinical diagnosis of MS required the presence of fever and haemorrhagic rash together with clinical features of severe sepsis or septic shock, according to the criteria described by Goldstein et al. [14]. Children with isolated meningitis without sepsis physiology were excluded from the analysis.

Data

Anonymised data exports from the participating centres' databases were sent and uploaded into a central database held at Imperial College London for further analysis. Data included in the anonymised export were demographic data (age, sex, admission date, ethnic origin), diagnostic data (sepsis or meningitis as main presenting feature, serogroup of organism if available), clinical scores (PRISM, GMSPS and Rotterdam score), laboratory data (platelet count, white cell count, lactate, base excess coagulation profile, fibrinogen, potassium, CRP) and outcome data (survival). Unfortunately, outcomes other than death, including important morbidities such as skin loss requiring grafting or limb amputation, were not reliably recorded and hence could not be investigated in this study. Laboratory data, from the first recorded sample, were measured in each centre according to standard techniques.

Statistical analysis

Differences within the study groups were analysed with the t-test for unequal variance. Robust estimation of the area under the curve (AUC) of the receiver operating characteristic (ROC) was computed and its 95% confidence interval (CI) was estimated using a bootstrap method implemented in the R statistical package [15]. The statistical significance of the AUC was assessed using the Mann-Whitney test. The best cutoff point according to the Youden's statistic was defined as previously described [16]. Calibration of the model was assessed using Cox's calibration regression in the R statistical package.

Development and validation datasets

All records in the consortium set containing complete information on all laboratory variables plus gender were used as the development set (n = 309). The remainder of the records was used as the validation set (n = 623) (see Figure 1).

Figure 1
figure 1

Methodology. Data from two sources were collected: data contributed by consortium members (development and validation set) and by the Children's Acute Transport Service (replication set). Development set is subdivided into two sets. The complete records set includes those with complete information for all variables collected. Validation records are those records that include complete information for base excess (BE) and platelets but are not all variables.

Variable selection and survival prognosis score

Bayesian model averaging (BMA) for generalised linear models [17] was applied to the development set to identify variables significantly (α = 0.05) associated with survival outcome [15]. All available laboratory variables were included in this analysis (Figure S1 in Additional file 1). Logistic regression analysis was conducted to determine whether other study variables, including study centre, year of admission, age, weight and sex were associated with death. The new prognosis score was based on a logistic regression model developed using the selected laboratory variables and fit to the development set.

Survival prognosis score assessment on the validation dataset

The new prognosis score was assessed in the validation dataset and ROC curves as well as the AUC were compared with other benchmark prognosis scores from the literature using a bootstrap test for two paired ROC curves [18]. Monte Carlo cross validation was used to assess the performance of the logistic regression model on unseen data [19]. In the Monte Carlo analysis, data of the validation set was randomly split into equal train and test sets and the regression model was fit to the train set and evaluated on the test set (Figure 1). On each test set randomly generated, a performance statistic based on AUC test statistics described by DeLong et al. [20, 21] was computed for the paired comparison between the new score and the benchmark score. This procedure was repeated 105 times to obtain a distribution of the performance statistic in the validation set.

Replication set

A ROC curve using the model was produced from a recent replication dataset of 134 patients referred to CATS, comprising 16 non-survivors and 116 survivors.

Results

A total of 1,073 children (age 1 week to 17.9 years) with meningococcal sepsis were in the consortium set. Of these, 85 (8%) died; 581 (54%) were male. Demographics, clinical scores, laboratory data, interventions and outcome data are shown in Table 2. Eight children had Group A disease, 419 had Group B, 215 had Group C, 8 had W135, 4 were YW135 and 13 were logged as having positive cultures but no serogroup was available. The histograms of the laboratory data are shown in Figure S1 in Additional file 1. A total of 134 children (age 2 weeks to 16 years) were in the CATS replication set, of whom 16 (12% died). Details of the replication set are shown in Table 3.

Table 2 Demographic and other features of the study population, according to survival (mean with 95% confidence intervals shown, t-test with unequal variance).
Table 3 Details of replication set from the Children's Acute Transport Service, according to survival (mean with 95% confidence interval shown, t-test with unequal variance).

Development of a new score

A model built using BMA for logistic regression with binomial distribution prior probability (P = 0.5) of inclusion of a variable was fitted to the records of the development dataset with complete information for all variables (n = 309). The posterior probability of the model coefficients was analysed to identify variables to be included in the new prognosis score. Supplementary Figure S2 shows the posterior probability distribution of each variable coefficient (Figure S2 in Additional file 2). The variables that were most statistically important (α = 0.05), base excess (BE) and platelets, were used to build a model using logistic regression, termed the BEP score. The fitted model was statistically significant (likelihood ratio test P < 0.001, Hosmer-Lemeshow chi-square test = 20.2, P = 0.009) with considerable goodness of fit (Nagelkerke pseudo-R2 = 0.3 and Brier score = 0.046). Calibration of the BEP score on the entire consortium dataset shows a relatively small underestimation of the probability of death for BEP > 0.3 (the mean absolute error is 0.025 and the 0.9 quantile of the absolute error is only 0.066, (Figure S3 in Additional file 3). We tested for confounding or study design effects and did not find any association with study centre, year of admission, age, weight or sex (P > 0.6 for all variables).

BEP score regression coefficient analysis

We estimated the coefficients of the logistic regression model in the entire development dataset. Overall, the statistical significance of the variables is high and standard error of the coefficients is low, indicating that the choice of variables used in the model is appropriate and that the values of the coefficients are robust (data not shown). Using this analysis, the BEP score is mathematically defined as:

P death = 1 / 1 + e 0 . 18909 × B E + 0 . 0 1015 × P l a t e l e t s + 3 . 07861

BEP score cutoff

The performance of the BEP score for a range of cutoffs ((0.1 to 0.5)) was estimated on the development, validation and replication datasets (Table 4). For a cutoff as low as BEP > 0.3 a good discriminating performance can be achieved on all datasets positive predictive value ((PPV) > 0.5, negative predictive value (NPV) > 0.94). A contour plot of the BEP score probability of death as a function of BE and platelet count is shown for quick reference (Figure 2). The cutoff Θ that maximizes the Youden's statistic was estimated on the development dataset using the following equation: Θ = arg max (Sensitivity (Θ) + Specificity (Θ) -1). The cutoff was then applied to the validation and replication dataset and results are presented in Table S1 (Table S1 in Additional file 4). Overall, a good performance was consistently obtained in the validation and development datasets. Sensitivity confidence intervals obtained in the validation dataset includes the point estimates of the development dataset. Specificity confidence intervals obtained in development and validation datasets overlap and PPV was higher in the validation and replication dataset.

Table 4 Base excess and platelet count (BEP) performance for different cutoffs on the development, validation and replication datasets.
Figure 2
figure 2

Contour plot showing the probability of death for different ranges of base excess and platelet count (BEP) score. Notice for BEP > 0.15, the probability of death increases progressively for the same change in the variables.

Performance analysis of the scores on the validation data

The validation dataset was used to compare the performance of the different scores. These data consists of 623 individuals, 51 non-survivors and 572 survivors. ROC curves were generated for each score (Figure 3). BEP score performance (AUC = 0.86, CI: 0.80 to 0.91) was better than GMSPS (AUC = 0.77, CI: 0.68, 0.85), followed by Rotterdam (AUC = 0.87, CI: 0.81 to 0.93) and PRISM (AUC = 0.93, CI: 0.85 to 0.97). The bootstrap test for paired ROC curves demonstrated that BEP score was statistically significantly different from GMSPS (P = 0.03) but not significantly different from Rotterdam and PRISM (P = 0.68 and P = 0.22 respectively). The Monte Carlo cross validation analysis of the entire validation set (n = 623) demonstrated similar results (Figure S4 in Additional file 5), with BEP score AUC significantly different to PRISM (P = 0.04), almost significantly different to GMSPS (P = 0.056) but not different to Rotterdam (P = 0.541). Taken together, these results suggest that the BEP score is more accurate than GMSPS, equivalent to Rotterdam and not quite as accurate as PRISM.

Figure 3
figure 3

Receiver operating characteristic (ROC) curve of each score on the validation set ( n = 623).

Replication of the BEP score performance on out-of-sample data

A replication dataset of 134 additional records from CATS were collected comprising 16 non-survivors and 116 survivors. The performance of the BEP score was evaluated using AUC and the ROC curve (Figure 4). The AUC on the replication dataset (AUC = 0.96, CI: 0.90 to 0.99).

Figure 4
figure 4

Receiver operating characteristic (ROC) curve of the base excess and platelet count (BEP) score on the replication dataset ( n = 134).

Discussion

Numerous studies have looked at factors predictive of poor outcome in meningococcal disease, since the seminal study of Stiehm and Damrosch in 1966, which identified petechiae, hypotension, absence of meningitis, peripheral leukopenia and low erythrocyte sedimentation rate (ESR) as markers of a poor prognosis [22]. Since then, in the developed world, the case fatality rate from meningococcal disease has fallen from over 50% to under 10%, largely due to improvements in diagnosis and supportive therapy [23, 24]. However, trials of specific adjunctive therapies have not demonstrated any benefit. One reason for this may have been a failure to select a study population in whom neither death nor survival was inevitable. Therefore, any scoring system which helps to identify such populations may be of benefit in future clinical trials. Identification of populations of patients at high risk of death may also be useful for genetic studies looking at associations between genotype and disease severity.

Early studies developing prognostic scores in meningococcal sepsis tended to focus on clinical factors indicative of shock, which are amenable to supportive treatments, such as fluid loading, inotropic support and mechanical ventilation. One relatively recent study looking at laboratory markers focused on platelet and neutrophil count [8], and suggested that in an age of improved recognition and management of disease, markers of endothelial dysfunction were more useful than clinical markers of poor perfusion, the former representing pathophysiology not amenable to any specific treatment. However, GMSPS and PRISM, and scoring systems which combine clinical and laboratory markers continue to have clinical utility [25, 26]. Clearly, an accurate scoring system using a small number of variables which are rapidly available soon after the patient comes through the doors of the Emergency Department will have more utility than a score dependent on multiple variables, some of which may be difficult or slow to measure, require repeated measurement or which rely on subjective assessment.

In this study, the largest to date in meningococcal sepsis, a new and extremely simple scoring system is proposed. This new score, termed the BEP score, is solely based on base excess and platelet count, both very easy to measure variables which represent tissue hypoperfusion and endothelial damage respectively. With an AUC of 0.86 in the validation set and 0.96 in the replication set, BEP performed significantly better than GMSPS, similarly to Rotterdam score, and not as well as PRISM. BEP also performed similarly to PN product in its original description looking at patients admitted prior to 1999, in which PN product was demonstrated to have an AUC of 0.97 in the development set and 0.89 in the validation set [9]. Unfortunately, we were unable to look at the PN score in our patients as absolute neutrophil count was not consistently available in our dataset.

In our population PRISM had an AUC of 0.93, having previously been described as anywhere between 0.80 [26] to 0.95 [8]. This indicates that despite being developed 25 years ago, PRISM remains a reliable score. Its main disadvantages are that it requires collection and entry of multiple data points into a complex algorithm and that it has not been validated in a pre-PICU setting. GMSPS, which has some constituent variables which are notoriously difficult to measure objectively, has been reported to have an AUC from 0.96 [12] to 0.81 [9] in previous studies, with a tendency to decrease from the 1980s to the present day. In our population GMSPS had an AUC of 0.77. This continued fall in the performance of GMSPS may be because of ongoing improvements in disease recognition and in initiation of supportive treatments, or other as yet unidentified factors. The Rotterdam score had intermediate reliability in our validation set, with an AUC of 0.87. Unfortunately, there is no historical AUC to compare with Rotterdam score, AUC being unreported in the initial study describing the score [10].

Limitations

The most important limitation of this study is the fact that 'first recorded sample' is not clearly defined, the data consisting of multiple datasets from several European countries. While in some datasets the first recorded sample is that taken on presentation in the Emergency Department, in others the first sample was from the ICU admission. However, given the natural history of meningococcal disease, these time points are unlikely to have been more than a few hours apart. Additionally, the type of blood gas sample (whether arterial, capillary or venous), the calculation used to calculate base excess by the blood gas analyser and the resuscitation fluid administered were not recorded in the database.

A further limitation is that a few early deaths may have been missed out from the consortium set, that is, deaths occurring at referring hospitals prior to PICU referral. However the excellent performance of the BEP score despite this heterogeneity may also be considered to be a strength. Furthermore the fact that the score performed so well in the more homogeneous replication set, in which the first recorded sample was from presentation in Emergency Department and in which early deaths were likely to have been more reliably recorded, suggests that the score may have high utility at this important time point in the natural history of the disease.

Unfortunately, it was not possible to compare the BEP score to some previously described clinical scoring systems in this study because the data items used in those scoring systems were not available. Therefore it is still possible that another system based on clinical or other data might outperform the BEP score. Furthermore, while it would have been interesting to look at variations in performance of the BEP score over time, or across different centres or countries, it was not possible to do this given the nature of the data as some centres contributed more patients in the early part of the study period and others later. Hence it was not possible to dissect the individual contribution of these factors.

We were also unable to compare the performance of the BEP score to any other score in the replication dataset from CATS, as the data needed to produce these scores was not available retrospectively. It is also unclear as to why the BEP score had a higher AUC in the CATS replication dataset as compared to the validation dataset, although this may be due to the more homogeneous cohort which will have reliably included children who died in the referring centre prior to PICU admission.

Conclusions

In this study, the development of a new prognostic score for meningococcal sepsis is described. The new score, termed the BEP score, depends on base excess and platelet count at presentation. Both of these variables are objective and easy and quick to measure. They are also unlikely to be affected by observer error. We propose that the BEP score should be further evaluated for mortality prediction and risk stratification in meningococcal and in other forms of bacterial sepsis, in both adults and children.

Key messages

  • A new prognostic scoring system for paediatric meningococcal sepsis was developed and validated in a cohort of 1,073 patients and tested in a replication set of 134 patients.

  • The score, based on base excess and platelet count at presentation, has been named the BEP score

  • Both base excess and platelet count are objective and easy to measure

  • The BEP score is both sensitive and specific in predicting death

  • Further evaluation is required to determine the utility of the BEP score in other forms of sepsis

Abbreviations

AUC:

area under the curve

BEP:

base excess platelet count score

BMA:

Bayesian model averaging

CI:

confidence interval

CRP:

C-reactive protein

ESR:

erythrocyte sedimentation rate

GMSPS:

Glasgow meningococcal septicaemia prognosis score

MS:

meningococcal sepsis

NPV:

negative predictive value

PICU:

paediatric intensive care unit

PN:

platelet-neutrophil product

PPV:

positive predictive value

PRISM:

paediatric risk of mortality

rhAPC:

recombinant human activated protein C

rBPI:

recombinant bactericidal/permeability-increasing protein

ROC:

receiver operating curve.

References

  1. Erickson L, De Wals P: Complications and sequelae of meningococcal disease in Quebec, Canada, 1990-1994. Clin Infect Dis 1998, 26: 1159-1164. 10.1086/520303

    Article  CAS  PubMed  Google Scholar 

  2. Nadel S, Kroll JS: Diagnosis and management of meningococcal disease: the need for centralized care. FEMS Microbiol Rev 2007, 31: 71-83. 10.1111/j.1574-6976.2006.00059.x

    Article  CAS  PubMed  Google Scholar 

  3. Inwald D, Peters MJ: Meningococcal disease: identifying high-risk cases. Crit Care 2006, 10: 129. 10.1186/cc4873

    Article  PubMed Central  PubMed  Google Scholar 

  4. Levin M, Quint PA, Goldstein B, Barton P, Bradley JS, Shemie SD, Yeh T, Kim SS, Cafaro DP, Scannon PJ, Giroir BP: Recombinant bactericidal/permeability-increasing protein (rBPI21) as adjunctive treatment for children with severe meningococcal sepsis: a randomised trial. rBPI21 Meningococcal Sepsis Study Group. Lancet 2000, 356: 961-967. 10.1016/S0140-6736(00)02712-4

    Article  CAS  PubMed  Google Scholar 

  5. Nadel S, Goldstein B, Williams MD, Dalton H, Peters M, Macias WL, Abd-Allah SA, Levy H, Angle R, Wang D, Sundin DP, Giroir B, Researching severe Sepsis and Organ dysfunction in children: a gLobal perspective (RESOLVE) study group: Drotrecogin alfa (activated) in children with severe sepsis: a multicentre phase III randomised controlled trial. Lancet 2007, 369: 836-843. 10.1016/S0140-6736(07)60411-5

    Article  CAS  PubMed  Google Scholar 

  6. Sinclair JF, Skeoch CH, Hallworth D: Prognosis of meningococcal septicaemia. Lancet 1987, 2: 38.

    Article  CAS  PubMed  Google Scholar 

  7. Pollack MM, Ruttimann UE, Getson PR: Pediatric risk of mortality (PRISM) score. Crit Care Med 1988, 16: 1110-1116. 10.1097/00003246-198811000-00006

    Article  CAS  PubMed  Google Scholar 

  8. Leteurtre S, Leclerc F, Martinot A, Cremer R, Fourier C, Sadik A, Grandbastien B: Can generic scores (Pediatric Risk of Mortality and Pediatric Index of Mortality) replace specific scores in predicting the outcome of presumed meningococcal septic shock in children? Crit Care Med 2001, 29: 1239-1246. 10.1097/00003246-200106000-00033

    Article  CAS  PubMed  Google Scholar 

  9. Peters MJ, Ross-Russell RI, White D, Kerr SJ, Eaton FE, Keengwe IN, Tasker RC, Wade AM, Klein NJ: Early severe neutropenia and thrombocytopenia identifies the highest risk cases of severe meningococcal disease. Ped CCM 2001, 2: 225-231.

    Google Scholar 

  10. Kornelisse RF, Hazelzet JA, Hop WC, Spanjaard L, Suur MH, van der Voort E, de Groot R: Meningococcal septic shock in children: clinical and laboratory features, outcome, and development of a prognostic score. Clin Infect Dis 1997, 25: 640-646. 10.1086/513759

    Article  CAS  PubMed  Google Scholar 

  11. Wong HR, Salisbury S, Xiao Q, Cvijanovich NZ, Allen GL, Thomas NJ, Freishtat RJ, Anas N, Meyer K, Checchia PA, Lin R, Shanley TP, Bigham MT, Sen A, Nowak J, Quasney M, Henricksen JW, Chopra A, Banschbach S, Beckman E, Harmon K, Lahni P, Lindsell CJ: The pediatric sepsis biomarker risk model. Crit Care 2012, 16: R174. 10.1186/cc11652

    Article  PubMed Central  PubMed  Google Scholar 

  12. Riordan FA, Marzouk O, Thomson AP, Sills JA, Hart CA: Prospective validation of the Glasgow Meningococcal Septicaemia Prognostic Score. Comparison with other scoring methods. Eur J Paeds 2002, 161: 531-537. 10.1007/s00431-002-1024-7

    Article  Google Scholar 

  13. Davila S, Wright VJ, Khor CC, Sim KS, Binder A, Breunis WB, Inwald D, Nadel S, Betts H, Carrol ED, de Groot R, Hermans PW, Hazelzet J, Emonts M, Lim CC, Kuijpers TW, Martinon-Torres F, Salas A, Zenz W, Levin M, Hibberd ML, International Meningococcal Genetics Consortium: Genome-wide association study identifies variants in the CFH region associated with host susceptibility to meningococcal disease. Nature Genetics 2010, 42: 772-776. 10.1038/ng.640

    Article  CAS  PubMed  Google Scholar 

  14. Goldstein B, Giroir B, Randolph A, International Consensus Conference on Pediatric Sepsis: International pediatric sepsis consensus conference: definitions for sepsis and organ dysfunction in pediatrics. Pediatr Crit Care Med 2005, 6: 2-8. 10.1097/01.PCC.0000149131.72248.E6

    Article  PubMed  Google Scholar 

  15. Raftery A, Volinsky CT, Painter I, Yeung KY: BMA: Bayesian model averaging. R package version 3.14.1. , accessed January 2012 [http://crantastic.org/packages/BMA/versions/12543] [], accessed January 2012

  16. Bewick VL, Ball J: Statistics review 13: Receiver Operating Characteristic curves. Crit Care 2004, 8: 508-512. 10.1186/cc3000

    Article  PubMed Central  PubMed  Google Scholar 

  17. Hoeting JA, Madigan D, Raftery AE, Volinsky CT: Bayesian model averaging: A tutorial. Statistical Science 1999, 14: 382-401. 10.1214/ss/1009212519

    Article  Google Scholar 

  18. Robin X, Turck N, Hainard A, Tiberti N, Lisacek F, Sanchez JC, Müller M: pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics 2011, 12: 77. 10.1186/1471-2105-12-77

    Article  PubMed Central  PubMed  Google Scholar 

  19. Slawski M, Daumer M, Boulesteix AL: CMA - a comprehensive Bioconductor package for supervised classification with high dimensional data. BMC Bioinformatics 2008, 9: 439. 10.1186/1471-2105-9-439

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  20. DeLong ER, DeLong DM, Clarke-Pearson DL: Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 1988, 44: 837-845. 10.2307/2531595

    Article  CAS  PubMed  Google Scholar 

  21. Bandos AI, Rockette HE, Gur D: A permutation test sensitive to differences in areas for comparing ROC curves from a paired design. Statist Med 2005, 24: 2873-2893. 10.1002/sim.2149

    Article  Google Scholar 

  22. Stiehm ER, Damrosch DS: Factors in the prognosis of meningococcal infection. Review of 63 cases with emphasis on recognition and management of the severely ill patient. J Pediatr 1966, 68: 457-467. 10.1016/S0022-3476(66)80250-0

    Article  CAS  PubMed  Google Scholar 

  23. Booy R, Habibi P, Nadel S, de Munter C, Britto J, Morrison A, Levin M, Meningococcal Research Group: Reduction in case fatality rate from meningococcal disease associated with improved healthcare delivery. Arch Dis Child 2001, 85: 386-390. 10.1136/adc.85.5.386

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  24. Carcillo JA, Tasker RC: Fluid resuscitation of hypovolemic shock: acute medicine's great triumph for children. Intensive Care Med 2006, 32: 958-961. 10.1007/s00134-006-0189-3

    Article  PubMed  Google Scholar 

  25. Castellanos-Ortega A, Delgado-Rodríguez M: Comparison of the performance of two general and three specific scoring systems for meningococcal septic shock in children. Crit Care Med 2000, 8: 2967-2973.

    Article  Google Scholar 

  26. Castellanos-Ortega A, Delgado-Rodríguez M, Llorca J, Sánchez Burón P, Mencía Bartolomé S, Soult Rubio A, Milano Manso G, Domínguez Sampedro P, Blanco Montero R, Rodríguez Núñez A, Zambrano Pérez E, Rey Galán C, López Negueruela N, Reig Sáenz R: A new prognostic scoring system for meningococcal septic shock in children. Comparison with three other scoring systems. Intensive Care Med 2002, 28: 341-351. 10.1007/s00134-001-1196-z

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Dr. Inwald is grateful for support from HEFCE and the NIHR Biomedical Research Centre funding scheme. Dr. Couto Alves is grateful for funding from the European Commission.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to David P Inwald.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

ACA carried out the statistical analysis, interpreted the data and drafted the manuscript. LC advised on the statistical analysis and helped to draft the manuscript. DI conceived of the study, and participated in its design and coordination, analysed and interpreted the data and drafted the manuscript. VW, KP, AB, EC, ME, RdG, JH, TK, SN, WZ and PR acquired data for the study and approved the final manuscript. ML contributed to conception and design and approved the final manuscript. All authors read and approved the final manuscript.

Electronic supplementary material

Additional file 1: Figure S1: Histograms of the laboratory variables. (PDF 31 KB)

13054_2012_1745_MOESM2_ESM.PDF

Additional file 2: Figure S2: Posterior probability distribution of the regression coefficients estimates using Bayesian model averaging. (PDF 1 MB)

13054_2012_1745_MOESM3_ESM.PDF

Additional file 3: Figure S3: Calibration curves showing agreement between predicted and observed probability of death. (PDF 23 KB)

13054_2012_1745_MOESM4_ESM.DOC

Additional file 4: Table S1: Base excess and platelet count (BEP) score cutoff values that optimise the Youden Index and associated performance. Cutoff was estimated on development dataset and tested on all other sets. PPV, positive predictive value. (DOC 38 KB)

13054_2012_1745_MOESM5_ESM.PDF

Additional file 5: Figure S4: Monte-Carlo cross validation estimate of the out of sample area under the curve (AUC) for base excess and platelet count (BEP) and all benchmark scores using 105 random splits of the validation set into two equal sets for training and testing BEP score. (A-C) Z-score of the DeLong test statistics for the paired comparison between BEP and all benchmark prognosis scores. (D-F) Histograms of the AUC for each benchmark score. (G-H) Histograms of the BEP AUC on the set of records in common with each benchmark score. (PDF 39 KB)

Authors’ original submitted files for images

Rights and permissions

Reprints and permissions

About this article

Cite this article

Couto-Alves, A., Wright, V.J., Perumal, K. et al. A new scoring system derived from base excess and platelet count at presentation predicts mortality in paediatric meningococcal sepsis. Crit Care 17, R68 (2013). https://doi.org/10.1186/cc12609

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/cc12609

Keywords