| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
1 Edmonton, Alberta
2 Toronto, Ontario
| Article appraised |
|---|
|
|
|---|
| Structured abstract |
|---|
|
|
|---|
Design: Two cohort studies one for derivation and one for validation.
Setting: One hundred American Veterans Affairs medical centres that perform major surgery.
Patients: All non-cardiac operations performed under general, neuraxial, local, or monitored anesthesia at low-volume hospitals (< 140 cases per month) and the first 36 consecutive operations at high-volume hospitals (
140 cases per month) were included. Operations with very low mortality rates, major transplantation procedures, and patients with postoperative respiratory failure or unplanned intubation prior to diagnosis of postoperative pneumonia were excluded. Data from 160,805 patients (80.3% of all eligible patients; 1 September 1997 to 31 August 1999) were used for index derivation and from 155,266 patients (82.1% of all eligible patients; 1 September 1995 to 31 August 1997) for validation. All patients were followed prospectively for 30 days after the initial operation. Less than 20% of patients were excluded due to missing data.
Description of prediction guide: Logistic regression was used to identify preoperative predictors of postoperative pneumonia. The PPRI is a 14-item index (maximum score 84 points) that divides patients into five classes of increasing risk (Table I
) for postoperative pneumonia. Points are scored for type of surgery and anesthesia, general patient risk factors, respiratory risk factors, and neurological risk factors (Table II
).
|
|
Main results: Postoperative pneumonia developed in 1.5% of patients in the derivation cohort and 1.7% of patients in the validation cohort. The risk of postoperative pneumonia for patients in PPRI class 1, 2, 3, 4, and 5 were similar between the two cohorts.
Conclusions: The PPRI classified patients into five levels of risk for postoperative pneumonia with good discrimination.
Funding: The Office of Patient Care Services and the Health Services Research and Development Service, Department of Veterans Affair.
Correspondence: Dr. Ahasan M. Arozullah, Section of General Internal Medicine (M/C 787), University of Illinois College of Medicine, 840 South Wood Street, Room 440-M, Chicago, IL 60612-7323, USA. E-mail: arozulla{at}uic.edu
The postoperative pneumonia risk index represents a significant advance in this field. Similar to their earlier publication outlining a risk index for postoperative respiratory failure,2 Arozullah and colleagues conducted secondary analyses of data from the 100-hospital strong Veterans Affairs National Surgical Quality Improvement Program to derive a multifactorial risk index for predicting pneumonia after non-cardiac surgery. Their study is blessed with large numbers and a heterogeneous collection of patients and surgical procedures in which to evaluate potential predictors. They enrolled over 80% of all eligible patients without loss to follow-up, used appropriate statistical techniques, and validated their index in another cohort of patients drawn from the same quality improvement program. Further, their 14-item index is easy to apply and employs readily available preoperative clinical data.
However, this study has a number of important limitations. First, the results may not be as generalizable as they first appear: the patients were virtually all male veterans with high comorbidity; thus, the performance of the risk index in women or healthier populations is unknown. Similarly, although this index performed well in a broad spectrum of relatively high risk surgeries, its accuracy in individuals undergoing lower-risk surgical procedures (which were excluded) is unknown. Second, as all patients were not subjected to the criterion standard (postoperative radiography or standardized physical examination for pneumonia), the results may have been affected by ascertainment bias (i.e., clinicians may have been more likely to look for pneumonia in those patients they felt were at higher risk).3 This is particularly concerning in a non-blinded study, such as this one, in which the individuals doing the outcome follow-up are not blinded to the preoperative status of the patients. Third, the investigators chose to exclude 729 patients who were diagnosed with pneumonia after developing respiratory failure or requiring re-intubation. It is difficult to say whether this biased their results (as many of the variables identified in this study were also identified in their index for predicting postoperative respiratory failure),2 but clinicians may well question the logic of separating these often inter-related outcomes. Finally, and perhaps most importantly, the investigators did not include data (physical examination, pulmonary function tests, or arterial blood gases) commonly employed to assist in risk prediction. A systematic review of this literature identified several elements of the history, physical examination, and bedside laboratory testing that predict these complications.4 In a cohort study employing blinded and independent preoperative assessments and postoperative outcome ascertainment, we have demonstrated that a variety of physical exam maneuvers and pulmonary function abnormalities are predictive of pulmonary complications; however, numbers were small in this pilot study and data collection continues.5
Thus, although this study is an important advance in this field, particularly for those seeking to perform case-mix adjustment in comparing complication rates between hospitals and surgeons, there are still more questions than answers for the clinician faced with predicting an individual patients postoperative pulmonary risk. Further studies with prospective and blinded comparison of the preoperative evaluation and postoperative respiratory status are urgently needed.
| References |
|---|
|
|
|---|
2 Arozullah AM, Daley J, Henderson WG, Khuri SF. Multifactorial risk index for predicting postoperative respiratory failure in men after major noncardiac surgery. The National Veterans Administration Surgical Quality Improvement Program. Ann Surg 2000; 232: 24253.[Medline]
3 Lijmer JG, Mol BW, Heisterkamp S, et al. Empirical evidence of design-related bias in studies of diagnostic tests. JAMA 1999; 282: 10616.
4 Fisher BW, Majumdar SR, McAlister FA. Predicting pulmonary complications after nonthoracic surgery: a systematic review of blinded studies. Am J Med 2002; 112: 21925.[Medline]
5 McAlister FA, Gajic O, Khan NA, Straus S, et al. The accuracy of the history, physical exam and routine tests in predicting postoperative pulmonary complications. Chest 2001; 120(Suppl 4): 289S.
Arozullah et al. examined data collected prospectively by a network of research nurses in Veterans Administration (VA) hospitals as part of the National Surgical Quality Improvement Program (NSQIP). The NSQIP was initiated to allow for adjustment of patient preoperative risk when assessing surgical quality of care in VA hospitals. A data set collected from surgical patients from 1997 to 1999 was used for generation of the index; validation was performed with independent data from 1995 to 1997. Using sound statistical methods, and a clinically appropriate definition of pneumonia, the resulting postoperative pneumonia risk index (PPRI) comprises 25 weighted risk factors.
There are a number of limitations in this study. First, the study population is atypical and primarily comprises men with frequent comorbidity. Second, the reported decreased goodness-of-fit in some hospitals suggests data collection was not uniform from institution to institution. Third, the 1.5% incidence of pneumonia is lower than frequencies reported in most reports of pneumonia in selected high-risk patient cohorts. Finally, several surgical risk analyses have been developed from the current database.2 As the NSQIP database was not designed to primarily to evaluate respiratory risk, it is possible that data on relevant respiratory risk factors were missed.
Currently, the most suitable application of this index is for evaluative research to compare inter-hospital performance parameters, particularly within the VA hospital system. However, the proposed index is lengthy and not easily committed to memory. Simplicity impacts on the use of a scoring system applied for risk assignment in the clinical setting. A notable example is the Apgar score (five variables, each scored as 0, 1, or 2), which is routinely used to direct at-risk patients to high intensity care, whereas the APACHE II score (15 variables with multiple weights) is not. The complexity of the PPRI may achieve optimum accuracy in the VA population but this is at the expense of the ease of use in a broader patient group.
Over 20 years after the original analysis by Goldman, Lee et al. compared risk stratification for cardiac events in a large non-emergent non-cardiac surgical population using a simplified index.3 Six independent dichotomous variables were identified as present (0 points) or absent (1 point). The resultant index demonstrated little loss of predictive power compared to Goldmans index (nine risk factors with variable weights)1 and Detskys index (13 variables with variable weights)4 in a large surgical population. We propose that the PPRI be simplified in a similar fashion to Lee et al. (Table
). If this simplified index has predictive accuracy, it would find wider acceptance and use.
|
| References |
|---|
|
|
|---|
2 Arozullah AM, Daley J, Henderson WG, Khuri SF. Multifactorial risk index for predicting postoperative respiratory failure in men after major noncardiac surgery. The National Veterans Administration Surgical Quality Improvement Program. Ann Surg 2000; 232: 24253.
3 Lee TH, Marcantonio ER, Mangione CM, et al. Derivation and prospective validation of a simple index for prediction of cardiac risk of major noncardiac surgery. Circulation 1999; 100: 10439.
4 Detsky AS, Abrams HB, McLaughlin JR, et al. Predicting cardiac complications in patients undergoing non-cardiac surgery. J Gen Intern Med 1986; 1: 2119.[Medline]
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |