Introduction

Distal pancreatectomy (DP) is associated with a high complication rate of 30–50% with postoperative pancreatic fistula (POPF) as a dominant contributor, which can also have other severe consequences [1]. Risk factors for POPF after DP include high BMI, low serum albumin level, soft pancreatic texture, prolonged operating time, and excess blood loss [2, 3]. Over the past decades, fistula risk scores (FRS) have only been available for patients undergoing pancreatoduodenectomy [4,5,6]. Recently, the first three risk models for POPF after distal pancreatectomy have become available. First, the preoperative distal fistula risk score (D-FRS) includes pancreatic duct and pancreatic neck diameter as variables [7]. Second, the intraoperative D-FRS also incorporated BMI, pancreatic texture, and operating time [7]. Third, the DISPAIR FRS included pancreatic transection site (neck versus body/tail), pancreatic thickness at transection site, and presence of diabetes [8]. This third model is left out of the current study since it requires postoperative imaging, operation notes, and pathologist’s reports to determine the actual transection site and hence is actually considered a postoperative model [8].

Adequate risk estimation enables surgeons to use a tailor-made approach. Assessment of the risk of POPF prior to DP can lead to the application of preventive strategies such as preoperative endoscopic stent placement in the main pancreatic duct or injection of botulinum toxin, application of a polyglycolic acid mesh at the pancreatic remnant, and the perioperative use of somatostatin analogs or hydrocortisone [9,10,11,12]. Intraoperative risk estimation could lead to the use of mitigation strategies such as tailored use of abdominal drains or for benchmarking in the postoperative setting to improve outcomes [13, 14].

Studies validating preoperative and intraoperative D-FRS in a nationwide cohort are currently lacking [7].

Methods (Appendix)

This nationwide retrospective Dutch cohort study included all patients after DP for any indication, all of whom were registered in the Dutch Pancreatic Cancer Audit (DPCA) database between 2013 and 2021 with an available CT scan for assessment. In addition to the data from the DPCA, preoperative imaging was assessed to obtain information regarding the variables pancreatic neck thickness and pancreatic duct size and both variables were measured ventral to the confluence of the splenomesenteric veins by a trained observer, which were randomly checked afterwards. Given the observational character of this study, ethical approval was waived by the Medical Ethical Committee of Amsterdam UMC. The study protocol was approved by the scientific committee of the Dutch Pancreatic Cancer Group. The D-FRS was validated by filling in the probability equations with data from this cohort.

The predictive capacity of the models was represented by an area under the receiver operating characteristic (AUROC) curve. The goodness-of-fit was assessed using a calibration plot characterized by an intercept (ideal value, 0) and slope (ideal value, 1) [15, 16].

Results

Baseline characteristics

During the study period, a total of 1113 patients underwent DP in one of the 15 centers in the Netherlands. A total of 217 patients were excluded because the preoperative scan was not available for assessment. Of these 896 patients, 152 (17%) developed POPF of whom 144 grade B (95%) and 8 grade C (5%). Baseline characteristics and perioperative details of all patients are shown in Table S1. Table 1 summarizes the characteristics per group (POPF vs no POPF). In the POPF group, both the pancreatic neck and main pancreatic duct diameter were larger; there were fewer patients with diabetes, less often malignancy, and more often neuroendocrine tumor as the suspected preoperative diagnosis, and more patients in whom minimally invasive surgery was performed (70.2% POPF vs. 48.5% no POPF). Finally, blood loss was less and the number of venous resections was lower in the POPF group.

Table 1 Preoperative and intraoperative characteristics, no POPF vs POPF group

Validation

Results of the validation of the D-FRS are displayed in Table 2. The preoperative D-FRS, consisting of the variables pancreatic neck thickness and pancreatic duct diameter, showed an AUROC of 0.73 (95% CI 0.68–0.78) (Fig. S1a). The intraoperative D-FRS, comprising again of both pancreatic neck and duct diameter and in addition BMI, operating time, and soft pancreatic aspect, showed an AUROC of 0.69 (95% CI 0.64–0.74) (Fig. S1b).

Table 2 Validation of the preoperative and intraoperative D-FRS

Discussion

This first nationwide validation of the D-FRS found only the preoperative D-FRS to have an acceptable discriminative value for POPF after distal pancreatectomy with an AUROC of 0.73 which is consistent with the initial external validation of this model. The intraoperative risk score had a poor discriminative value with an AUROC of 0.69.

The univariable analysis confirmed that larger pancreatic duct and neck diameter were risk factors for the development of POPF. However, BMI, soft pancreatic texture, and prolonged operating time were not significant risk factors. This is mainly due to the operating time, which is subjected to confounders. In the current cohort, operation time was found to be shorter in the POPF group. That soft texture is not a risk factor can also be attributed to the overrepresentation of minimally invasive surgery of the POPF group, as it makes assessment of pancreatic texture more difficult and less reliable since this was assessed by sight and tactile feedback. Ideally, a predictive model only consists of objective and measurable variables such as in the preoperative D-FRS. This can be used to selectively drain patients and manage mitigation strategies, including optimal application of various transection techniques, sealants, or tissue patches. Besides, by risk group identification, surgeons can inform their patients about the risks, tailor-made per patient.

In the current study, validation of the DISPAIR FRS was considered not possible because of missing data on the location of pancreatic transection. The DISPAIR study group determined the transection location by postoperative CT images, operation notes, and pathologist’s reports which do not correspond well with a preoperative model and may therefore decrease its clinical relevance. Moreover, transection site was reported as a dichotomous variable with the option neck or body/tail, leading to a less accurate measurement at the transection site.

The current validation should be interpreted in light of some limitations. First, the minimally invasive approach was overrepresented in the POPF group which has been reported as a risk factor of POPF, but was not taken into the original model, which is plausible, since minimally invasive DP has become the routine approach in recent years and not taken into account in the D-FRS [17]. Second, measurement of the pancreatic duct and neck diameter on preoperative imaging was not done by experienced radiologists but done by four observers, trained by experienced radiologists. Afterwards, cases were randomly checked, and no significant inter-observer bias was found. Third, heterogeneity may have arisen from different types of transection and stump closure. However, there are no studies to date showing superiority in terms of type of stump closure regarding POPF rate following DP [18]. Fourth, the current study could not predict CR-POPF postoperatively, which has a great role in postoperative management and mitigation of CR-POPF, as Pecorelli et al. showed by predicting CR-POPF based on drain amylase, serum amylase, and CRP [19].

In conclusion, the current study is the first nationwide validation of the preoperative and intraoperative D-FRS showing acceptable distinguishing capacity for only the preoperative D-FRS for POPF. Therefore, the preoperative score could improve prevention and mitigation strategies such as drain management, which is currently investigated in the multicenter PANDORINA trial [20]. To prove the predictive accuracy and to develop a broadly applicable model, more nationwide validations and prospective studies are warranted.