Laparoscopic hepatectomy has progressively gained increased acceptance over the past two decades. As a technically demanding approach, it requires that surgeons should not only possess expertise in liver surgery but also comprehend the relationship between hepatic vessels and tumors. The use of laparoscopy has obvious advantages of being a less traumatic procedure with fewer complications and a potentially faster postoperative recovery. Despite these advantages, there are many drawbacks of laparoscopic surgery like lack of tactile perception, restricted vision, and the inability of seeing through the complex internal structure [1, 2]. By three-dimensional (3D) visualization of the liver and virtual hepatectomy, traditional ways of evaluating the positional relationship of blood vessels and measuring the volume of resected liver prior to surgery have been altered. Nevertheless, several problems have emerged. During the process of applying preoperative 3D surgical planning to the actual operation, issues such as spatial and temporal separation and lack of accuracy still exist [3,4,5]. Indocyanine green (ICG) fluorescence imaging has obvious advantages in detection of the boundaries of the tumor, identification of small liver tumors, and liver metastases and staining of the drainage area of the portal vein. It has been applied for the real-time navigation of hepatic tumors during liver resection, which cannot be achieved by traditional surgical approach, thereby enhancing the accuracy of surgery. However, ICG fluorescence imaging can be applied only to those lesions located superficially on the liver surface, because the near-infrared light only penetrates tissues to a depth of about 10 mm [6,7,8]. To perform a safe and effective laparoscopic hepatectomy, it is vital to grasp the positional relationship between the intrahepatic vessels and liver tumors.

To address these issues, we present a multimodal assistant system, the laparoscopic hepatectomy navigation system (LHNS), consisting of a fusion model of computed tomography (CT)-based 3D models with ICG fluorescence images. It is a system for real-time visualization of the relationship between liver lesions and intrahepatic anatomical structures, and the optimal cutting plane that has been preoperatively planned for the actual resection. The range of liver resection can be accurately determined and the preoperative planning based on the simulated resection can be well transformed. The LHNS is a solution that addresses the clinical need of intraoperative real-time navigation for safer and more effective liver resections.

Patients

The subjects comprised a total of 64 patients who had undergone laparoscopic hepatectomy at Zhujiang Hospital, Southern Medical University between January 2018 and December 2018. The inclusion criteria were as follows: (1) age ≥ 18 years, regardless of gender; (2) patients who were diagnosed with liver cancer according to preoperative CT and/or Gd-EOB-DTPA-enhanced magnetic resonance (MR); (3) no vascular invasion, extrahepatic metastasis, or distance metastasis detected according to CT and/or MR; (4) Child–Pugh class A or B liver function; and (5) patients who underwent laparoscopic hepatectomy. The exclusion criteria were as follows: (1) a history of previous abdominal surgery; (2) Child–Pugh class C liver function; and (3) incomplete data. All patients were informed of treatment details including surgical procedures, risks, and complications. Informed consent was obtained from each patient included in the study. The patients were divided into the LHNS group and non-LHNS group. Ultimately, 30 hepatectomy procedures were performed under LHNS guidance and 34 cases without. The patients with or without LHNS guidance were compared respect to preoperative baseline characteristics, surgical data, postoperative clinical outcomes. Our study protocol was approved by the Institutional Ethics Review Board of Zhujiang Hospital, Southern Medical University (approval code: 2018-GDYK-003). The study was registered at www.clinicaltrials.gov (ClinicalTrials.gov number, NCT03811704).

Surgical planning based on 3D reconstruction

3D images of the liver, blood vessels, and tumors were created using the Medical Image 3D Visualization System (MI-3DVS, software copyright No: 2008SR18798), based on preoperative CT images. From the 3D reconstructed images, virtual hepatectomy was performed to (1) assess the exact location of the liver tumor and its anatomical relationship to hepatic vasculature; (2) set the surgical margin; (3) determine the corresponding transection plane of hepatic artery, portal vein, and hepatic vein; (4) carry out detailed volumetric analyses; (5) assess the optimal transection plane [3].

Administration of ICG

(1) ICG (0.05–0.10 mg/kg) was injected intravenously 24–72 h prior to surgery. (2) Liver demarcation was identified during operation. Positive staining: ICG was injected intravenously at a dose of 2.5 mg into the tumor-bearing hepatic segment or the portal branches; negative staining: ICG was injected intravenously at a dose of 2.5 mg after clamping the segmental portal pedicle.

Laparoscopic hepatectomy navigation system (LHNS)

The LHNS (software copyright No. 2018SR840555) was developed in collaboration with Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences. It consists of preoperative model segmentation, intraoperative laparoscopic stereo surface reconstruction, intraoperative registration, and intraoperative laparoscopic posture tracking modules (Fig. 1). The LHNS is implemented in C ++ and Python using the open-source toolkit on the Windows 10 operating system. These kits include Insight Segmentation and Registration Toolkit (ITK) (www.itk.org), Visualization Toolkit (VTK) [2:www.vtk.org], Open Source Computer Vision Library (OpenCV) [3:www.opencv.org], TensorFlow [4:www.tensorflow.org] and the Medical Imaging Interaction Toolkit (MITK) [9]. We adopted the method of dense three-dimensional reconstruction of laparoscopic organs base on ORB-SLAM2 [10]. This method can simultaneously estimate the posture of the laparoscopic camera while obtaining 3D information of the organ surface. After the establishment of pneumoperitoneum pressure, the white-light HD mode of Pinpoint endoscopic fluorescence imaging system (Novadaq Technologies Inc., Canada) was used to capture 2–3 s of video images and then the surface model of liver was obtained by 3D dense stereo reconstruction method; then, the model was registered with the preoperative liver surface using Go-ICP method to obtain the spatial transformation matrix between the preoperative CT image space and the intraoperative laparoscopic space [11]. If the automatic registration effect was unsatisfactory, the system would provide a manual registration function. The subsequent fusion would dynamically adjust the preoperative and intraoperative spatial transformation matrix based on the initial registration results, and the posture of the laparoscopic camera estimated by this method. The preoperative model was projected onto the white-light HD image or fluorescent image of laparoscopy under the effect of the transformation matrix, forming the effect of augmented reality display [12].

Fig. 1
figure 1

Framework diagram of the navigation algorithm for the real-time fusion of preoperative 3D models and intraoperative indocyanine green fluorescence image. The display effect of augmented reality for real-time surgical navigation can be obtained through real-time fusion of 3D models reconstructed preoperatively from CT images and intraoperative laparoscopic image or intraoperative indocyanine green fluorescence image

The signal of laparoscopic image or Pinpoint fluorescence imaging system was first input into a video parser (e-communication system GK310, Guangzhou Guangkang Medical Technology Co., Ltd., Guangzhou, China), then transmitted to the laptop pre-installed with LHNS system through Epiphan AV.io HD™ video grabber, and then the preoperative reconstructed 3D model was imported into the LHNS. After registration, real-time fusion of 3D model and ICG fluorescence imaging would be displayed simultaneously on the computer monitor (Fig. 2).

Fig. 2
figure 2

A Through MI-3DVS, three-dimensional reconstruction of abdominal organs, hepatic artery, hepatic vein, portal vein, and tumor was performed based on CT data; B The preoperative reconstructed 3D model was imported into LHNS; C Intraoperative scene and use of video decoder device to import laparoscopic images into LHNS; D Intraoperative scene and use of video decoder device to import Pinpoint fluorescence imaging into LHNS

Statistical analysis

All statistical analyses were performed using IBM SPSS 22.0 for Windows. Continuous variables were compared using Student’s t test, and categorical variables were evaluated using the Chi-square test. The Mann–Whitney U test was used for analyzing the ranked data. P < 0.05 was considered as indicative of statistical significance.

Results

The clinicopathological features, surgical parameters and postoperative outcomes of the patients are summarized in Table 1. No significant differences between the two groups are identified. The LHNS group had a less blood loss (285.0 ± 163.0 mL vs. 391.1 ± 242.0 mL; P = 0.047), a less transfusion requirement (13.3% vs. 38.2%; P = 0.045), and a shorter postoperative hospital stay (7.8 ± 2.1 days vs. 10.6 ± 3.8 days; P < 0.001). There was no significant difference in operative time between these two groups. No accidental bleeding occurred. There were 5 cases of postoperative complications in the LHNS group and 9 cases in the Non-LHNS group. There were no significant differences in the incidence rate of complications between these two groups. All the complications were recovered eventually, and no perioperative death occurred in either group.

Table 1 Laparoscopic hepatectomy outcomes between patients with and without using the laparoscopic hepatectomy navigation system (LHNS)

The demarcation line or range of resection was clearly projected by the LHNS in 27 patients, undetectable in 2 patients due to large tumor size (> 10 cm) and restricted vision under laparoscopy, and unable to be consecutively identified in 1 patient because of long retention of ICG caused by the cirrhosis and abundant intrahepatic vascular communicating branches. In the LHNS group, the projected 3D images of the tumor and blood vessels showed the important pipeline structures, such as the middle hepatic vein and the variant portal vein branches, which may be encountered during liver resection.

Three exemplar case reports are presented to demonstrate the usefulness of real-time navigation for laparoscopic hepatectomy using image fusion of preoperative 3D surgical plan and intraoperative ICG fluorescence imaging.

Patient 1

A huge tumor was identified in the left lobe of the liver on the preoperative CT (Fig. 3A). Based on the reconstructed preoperative 3D images (Fig. 3B), a left hepatectomy was planned. Intraoperatively, the residual fluorescence in the left lobe was visualized, which resulted from impaired bile excretion in the left hepatic duct that are compressed by the tumor. The demarcation line of the liver surface was identified by direct vision. Real-time fusion of the 3D reconstructed images and the fluorescent images were displayed on a monitor (Fig. 3C). The dissection line was determined based on the preoperative virtual hepatectomy model and the demarcation line by ICG fluorescent signal (Fig. 3D); meanwhile, main branches of the portal vein, hepatic vein, and hepatic artery as well as the location of the tumor were visualized, which guided the anatomy of the first portal hepatis and the parenchymal dissection. The shape of the residual liver in the actual surgery was basically consistent with that of residual liver in virtual hepatectomy (Fig. 3E). Tumors were not developed in the fluorescence mode. The fluorescence signal on the liver section was ICG excretion disorder (Fig. 3F) caused by tumor compression.

Fig. 3
figure 3

An anatomic left hemi-hepatectomy for treatment of a hepatocellular carcinoma patient using the Laparoscopic Hepatectomy Navigation System (LHNS) is shown; A The preoperative CT showed that the tumor (about 93 mm in diameter) is located in the left lobe of the liver (white bold arrow); B A reconstructed 3D model based on preoperative CT image and anatomic left hemi-hepatectomy; C Real-time fusion of 3D image, Indocyanine Green fluorescence and laparoscopic images of tumors and portal vein; D Determination of resection line of liver by ICG fluorescence image; E 3D projection of patients’ residual liver; F No fluorescence development was found in the dissected specimen

Patient 2

Preoperative CT identified a tumor located in hepatic segments V and VI (Fig. 4A). Based on the reconstructed 3D images, a partial hepatectomy of segments V and VI was planned (Fig. 4B). Intraoperatively, ICG retention was observed around the tumor on the surface of hepatic segments V and VI. The fluorescent images were used as markers to superimpose the preoperative 3D reconstructed model and the ICG fluorescence images in real time (Fig. 4C). The intrahepatic vascular structures were visualized; the distance and relationship of the tumor and important pipelines were evaluated in real time to determine whether a radical excision margin was obtained (Fig. 4D). The branch of the right Glissonian sheath was taped and the blood flow was blocked guided by the 3D reconstructed images (Fig. 4E). The 3D images were adjusted to overlap with the liver in the surgical field, and 2 cm of resection margin was achieved. No residual tumor was detected on the liver section (Fig. 4F). The tumor was partially developed in the fluorescence mode.

Fig. 4
figure 4

A Partial hepatectomy for treatment of a hepatocellular carcinoma patient using the Laparoscopic Hepatectomy Navigation System (LHNS) is shown; A The preoperative CT shows that the tumor (about 43 mm in diameter) is located in the right lobe of the liver (white bold arrow); B A reconstructed 3D model based on preoperative CT images is shown, and partial hepatectomy is planned; C 3D model of tumor and portal vein was projected onto the ICG fluorescence image on the surface of liver; D The 3D images of tumor, hepatic artery, and portal vein were projected onto the surface of the liver; E The 3D model of preoperative virtual hepatectomy was projected onto the surface of the liver; F Part of tumor developed under fluorescence in the dissected specimen

Patient 3

Preoperative CT localized a huge tumor in the right lobe of the liver (Fig. 5A). Based on the reconstructed preoperative 3D images (Fig. 5B), a right hepatectomy was planned. Intraoperatively, the residual fluorescence around the tumor was observed, which resulted from ICG excretion disorders in the surrounding normal tissues that were compressed by the tumor. (Figure 5C). The 3D reconstructed model of the portal hepatis was superimposed with the laparoscopic image in real time. The branch of the right Glissonian sheath was taped and blood flow was blocked. The right hepatic artery and the right portal vein were ligated and blocked (Fig. 5D). ICG was injected intravenously. Fluorescent images obtained were projected onto the liver surface using the LHNS. Based on real-time fusion of preoperative 3D imaging and ICG fluorescent images, the dissection line was determined (Fig. 5E). Main branches of the hepatic portal vein, hepatic artery, and hepatic artery as well as the location of the tumor were visualized through the 3D reconstructed model. During parenchymal dissection, the transection plane was monitored and timely corrected by the fusion images of the 3D model and ICG fluorescence image (Fig. 5F).

Fig. 5
figure 5

An anatomic right hemi-hepatectomy for treatment of a hepatocellular carcinoma patient using the Laparoscopic Hepatectomy Navigation System(LHNS) is shown; A Preoperative CT showed that tumor (about 104 mm) is located in the right lobe of liver (white bold arrow); B Reconstructed 3D model based on preoperative CT images, and right hemi-hepatectomy; C 3D images of tumor, portal vein, and hepatic artery were projected onto the ICG fluorescence image on the surface of liver; D Determination of the resection line of liver by ICG fluorescence image; E 3D model of preoperative virtual hepatectomy and tumor were projected onto the surface of liver; F No residual tumor and bile leakage on liver cross section were detected by fluorescence

Discussion

Because of technical innovations and experience accumulation in liver surgery, the indications for laparoscopic hepatectomy are almost the same as the open hepatectomy. The advantages of the laparoscopic surgery over the laparotomy include a reduced pain, a shorter operative time and hospital stay, less complications, and a faster recovery. However, laparoscopic liver surgery is still limited by lack of hand tactile feedback, narrowed operating space, and limited visual field and visual angle of an endoscope [13,14,15]. These issues have been addressed to some extent by some of the most promising technologies developed in recent years, including CT, MR imaging, intraoperative ultrasound, ICG fluorescence imaging [16], augmented reality [17], and mixed reality [18]. In this study, we present a novel laparoscopic hepatectomy navigation system (LHNS), with which real-time navigation for laparoscopic hepatectomy can be achieved through the fusion of preoperative 3D model and intraoperative ICG fluorescence image. The liver resection guided by the LHNS is more accurate and reliable compared to the conventional image-guided surgery. The LHNS is superior because surgeons can concentrate on the surgical field without having to shift their vision to the laparoscopic image, ICG image and preoperative 3D image during the operation, which has eliminated the factors that lead to the operator’s hand–eye incoordination due to the spatial and temporal separation of 3D image-guided surgery. This procedure helps to realize real-time navigation of multimodal images during laparoscopic hepatectomy.

3D visualization of organs enhances the understanding of complex anatomical structures; virtual liver resection based on the reconstructed 3D models has been widely used these years. However, because of the non-rigid registration approach for hepatobiliary surgery, respiratory motion and deformation of the liver during the surgical procedures leads to inaccuracies of subsequent image-guided surgical navigation [3, 5, 19, 20]. Preoperatively, 3D images of the intrahepatic structure and tumor were generated using a 3D image processing software; intraoperatively, through a fast registration procedure, the 3D images were integrated with the current patient and surgical instrument position into one coordinate system. To track the position of surgical instruments, the optical tracking system (Polaris Spectra optical tracker, Northern Digital Inc., Waterloo, Ontario, Canada) was used. According to the relative positional relationship between surgical instruments and lesions in the 3D model, surgeons can understand the important anatomical structure near the operating site in real time, which enhances the accuracy and safety of liver surgery [21]. Despite these virtues, there are certain drawbacks in the tracking system, such as light occlusion and long configuration time, which easily affect the surgical process. While in the LHNS, ORB-SLAM2 was used to acquire the real-time camera pose. After the first registration, the subsequent model position was adjusted according to the camera’s pose in real time. Since we do not use an external tracking system during navigation, the registration time required is greatly reduced. The setup time of the current navigation system is mainly derived from the reconstruction of the intraoperative liver surface and the registration with the preoperative liver model. The system setup before navigation only takes about 30 s. The setting up and use of the navigation is trained by the engineer before the operation, and can be performed independently by surgeons during the operation. Currently, the navigation of abdominal surgery is mostly realized by augmented reality technology and mixed reality technology. The preoperative 3D images of the liver are projected onto the patient’s body and superimposed with the patient’s real liver during the liver surgery, which helps the surgeons to observe the overlapped images of 3D models and actual surgical sites. It enables surgeons to visualize the complex liver anatomy, allowing them to predict and judge the important blood vessels or anatomical structures to be encountered in advance, thereby greatly improving the safety of operation [18, 22].

ICG is a near-infrared fluorescent dye certified by FDA in the USA, which is mainly metabolized by hepatocytes and excreted through biliary tract [23]. The pathological changes at cellular and molecular levels in living organisms are reflected using ICG fluorescence imaging. The definition of the tumor boundary at the cellular level can be preliminarily achieved. During operation, dynamic observation can be carried out, and the transection plane can be adjusted and corrected according to the fluorescence boundary of hepatic parenchyma [16]. At present, ICG fluorescence imaging has obvious advantages in the recognition of the biliary system, the definition of liver tumor boundary, the detection of small lesions, the intraoperative real-time navigation, and portal vein drainage area identification [7]. The fluorescence imaging system originally developed for clinical use consists of a small control unit and a charge coupled device camera that filters out light at wavelengths below 820 nm and 36 diodes capable of emitting wavelength 760 nm. Fluorescent image data are transmitted to a personal computer through video capture card to display and store [6]. Later, the technology has been developed to fuse images of macroscopic surgical fields and near-infrared images into a single display. However, during laparotomy, surgeons are required to shift between the direct vision and the fusion images. Therefore, the fusion ICG fluorescence imaging system may be more suitable for laparoscopic surgery [16]. Recently, a new Medical Imaging Projection System (MIPS) integrates the ICG fluorescence imaging and active projection mapping for liver resection. Continuous 3D projection combined with fluorescence imaging can effectively determine the line of resection, identify anatomical markers of hepatic parenchyma and guide the incision of deep hepatic parenchyma [24]. Our LHNS integrates preoperative models and ICG images on the same computer monitor and expands the application of ICG fluorescence imaging technology. It has the following advantages over traditional intraoperative image-guided techniques: surgeons can focus on the same monitor without distraction because of changing the field of vision in the different monitors; the plane of preoperative virtual hepatectomy is implemented into actual operation, which is a good transformation of preoperative surgical planning; the positional relationship between tumor and intrahepatic duct is well understood in real time according to the 3D model of the overlapping image, which can guide the excision of liver parenchyma and reduce the injury of important ducts; ICG fluorescence signal on the liver surface can be used as a marker for the registration of the 3D model with the liver, which can solve the problems of complicated instrument connection, limited space and long installation of the system.

In our study, the two groups showed no apparent difference in patient demographics, operation time, and postoperative complications. However, there were some differences between the two groups in operative blood loss, intraoperative blood transfusion, and postoperative hospital stays. Although there was no significant difference in complications between the two groups, the overall complication rate in the LHNS group tended to be lower than that in the Non-LHNS group (16.7 vs. 26.5%, P = 0.384). Compared with the LHNS group, the Non-LHNS group had a higher incidence of incision infection and pulmonary infection; meanwhile, current studies revealed that postoperative infective complications decreased long-term overall survival and recurrence-free survival in patients treated with liver resection for hepatocellular carcinoma [25]. In addition, previous studies have demonstrated that perioperative blood transfusion is one of the adverse factors that affect the perioperative recovery and long-term survival of the patient [26,27,28]. Therefore, we believe that the low incidence of complications in the LHNS group is mainly related to the reduction of intraoperative bleeding and blood transfusion, which may help to improve the long-term overall survival and recurrence-free survival of patients undergoing liver resection for malignant tumors. In the LHNS group, augmented reality technology was used to superimpose the 3D images onto the surgical field. These superimposed virtual images guided the anatomy of the porta hepatis and parenchymal transection. The branches of the main hepatic and portal veins to be encountered on the transection plane can be strategically identified with greater accuracy, preventing major intraoperative bleeding caused by vascular injury. Hemorrhage has always been a major problem encountered during laparoscopic hepatectomy [29], and it is the main cause of conversion to open surgery. The patients with conversion of laparoscopic surgery to open surgery showed a worse postoperative outcome, higher complications, and higher perioperative mortality than those with complete laparoscopic surgery [30, 31]. Positional registration of the 3D model, the fluorescent image and the real-time anatomical site was attained by the LHNS. The location and scope of the lesion were displayed intuitively by the fluorescent signal. The adjacent relationship between the lesion and its important adjacent organs were identified by the projection of the 3D model. The LHNS allows surgeons to determine the variant blood vessels, the branches of the hepatic vein and portal vein during laparoscopic hepatectomy, which, therefore, could prevent and reduce intraoperative bleeding.

In patient 1, ICG was distributed in the excised liver area, and the tumor protruded through the surface of the liver. The 3D model of the tumor and the portal vein (Fig. 3C), and the demarcation line based on preoperative virtual hepatectomy were projected onto the liver surface. In comparison, the fluorescent signal that formed by ICG retention in the liver showed that the demarcation between the left and right lobe of the liver was not a straight line (Fig. 3D). In patient 2, ICG aggregated in the target area for resection, which was considered ICG excretion disorder due to compression of the surrounding liver tissue by the tumor. The fluorescent signal provided markers for projection of the tumor (Fig. 4C). From the projected 3D image, the intrahepatic location of the tumor and the portal vein were identified (Fig. 4D); meanwhile, the range of the resection area by virtual liver resection was projected onto the actual operation (Fig. 4E). In patient 3, ICG was partially accumulated in the tumor, but the tumor did not compress the hepatic duct to cause wide distribution of ICG in the target area for resection. For example, in patient 1, the 3D model was projected onto the liver surface to show the relationship between the tumor and intrahepatic vessels (Fig. 5C), and the resection line could be determined by ICG images and the ischemic line (Fig. 5D). The 3D model of the tumor and preoperative virtual hepatectomy could not be completely superimposed in the actual operation due to pneumoperitoneum pressure and liver deformation (Fig. 5E). However, ICG images can guide the parenchymal dissection in real time. No residual tumor and bile leakage on liver cross section were detected by fluorescence (Fig. 5F).

The demarcation line could not be detected using the LHNS in 3 cases. In 2 cases, the tumor was huge (103 mm in diameter) and located in the right lobe of liver. The right and left lobes of the liver where the tumor was located could not be displayed simultaneously due to the restricted space and field of view and the effect of pneumoperitoneum under laparoscope leading to inaccurate identification of the demarcation line by projection, while the demarcation line could be clearly displayed through peripheral vein injection of ICG after blocking the right branch of portal vein. In order to improve the detection and application effect of ICG in large tumors leading to portal vein obstruction, ICG can be injected before operation. During operation, tumor location can be identified by fluorescent signals. When large tumors compress normal liver tissues, the delayed excretion of ICG presents circular fluorescent signals surrounding the tumors [32, 33]. When tumor compression causes the obstruction of the portal vein, anatomical hepatectomy with ICG positive staining may be difficult. Negative staining can be used to preserve the lateral hepatic segment. In the other case, ICG injected preoperatively was still diffused on the liver surface in patients with cirrhosis who underwent right hepatectomy. The demarcation line could be temporarily displayed on the liver surface through peripheral vein injection of ICG after blocking the right branch of portal vein; then, ICG was circulated to the whole liver through the communicating branch of portal vein. Therefore, ICG staining may not be able to clearly identify the demarcation line during hepatectomy, while the projection of preoperative 3D model provides an effective solution to this problem. Direct projection of the 3D model the liver surface through the LHNS can guide the anatomy and transection of Glissonian sheath in the first porta hepatis. At the same time, according to the range of ICG staining, the transection plane can be adjusted in real time according to the liver parenchymal staining. The demarcation line of the liver parenchyma in some patients becomes less clear with the prolongation of staining time. The image projection provides real-time and continuous monitoring and timely correction of the transection plane to ensure safe surgical margins, which, therefore, could maximize the functional liver volume and achieve the anatomical, functional, and radical hepatectomy. In addition, our current experience suggests that the application of the LHNS has profound clinical significance—especially for tumors with complex intrahepatic positional relationship—such as the presence of hepatic artery, portal vein, and hepatic vein variation in the liver, the proximity of tumors to important vascular systems, the severe distortion of intrahepatic vessels caused by tumor compression, and the presence of small tumors located in the deep liver parenchyma which are difficult to be detected during operation. Intraoperative image fusion techniques could reduce bleeding and enhance the safety of surgery through avoiding the injury of important pipeline structure.

Limitations

The main limitation of this study is its retrospective nature, with the inherent risk of strong selection bias. Besides, the small sample size for the study group and short follow-up time are believed to have an impact on the study to some extent. Therefore, further research is required to include more research objects and observation indexes, and further long-term research will be valuable to clarify the long-term outcome of the malignant tumors to know the advantages in survival. With the advent of digital and intelligent liver surgery [34], it is hoped that in the near future, the advantages of the LHNS in laparoscopic hepatectomy will become more obvious with the extension of clinical application.

Conclusions

To sum up, the fusion of 3D model with ICG florescence imaging through the LHNS can provide convenient and reliable intraoperative multimodal image guidance for laparoscopic hepatectomy, which compensates for the defects of tactile sense and visual fields to some extent, thereby enhancing the safety of operation. Our next step is to address the reduced accuracy of real-time navigation caused by liver deformation due to factors such as pneumoperitoneum pressure, respiration, heartbeat, and surgical procedures. There is also a need for a prospective or randomized large-scale clinical study to confirm that LHNS-guided laparoscopic hepatectomy can enhance the accuracy of surgery and reduce postoperative complications compared with traditional laparoscopic hepatectomy.