Enhanced long-term outcomes with laparoscopic bariatric surgery in patients with severe obesity and metabolic dysfunction-associated steatotic liver disease: a retrospective cohort study
Highlight box
Key findings
• In this population-based study, laparoscopic surgery was associated with reduced risks of adverse liver outcomes and non-liver outcomes including cardiovascular disease, chronic kidney disease, and obesity-related cancers, as well as lower healthcare utilization and pharmacy costs, compared with open surgery among patients with metabalolic dysfunction-associated steatotic liver disease (MASLD) and severe obesity.
What is known and what is new?
• Bariatric surgery is a potential treatment for weight loss in patients with MASLD and severe obesity. However, the impact of bariatric surgery types on long-term outcomes and healthcare utilization in this population has not been well characterized.
• This study firstly compared the long-term clinical outcomes to include both liver and non-liver adverse events, as well as healthcare utilization and costs between laparoscopic surgery and open surgery in patients with MASLD and severe obesity.
What is the implication, and what should change now?
• Laparoscopic surgery is a promising potential treatment for patients with MASLD and severe obesity with more favorable long-term outcomes and healthcare utilization and costs than open surgery. Randomized clinical trials and additional cost-effectiveness analysis are needed to corroborate the findings.
Introduction
Metabolic dysfunction-associated steatotic liver disease (MASLD) is associated with end-stage liver disease as well as non-liver complications such as cardiovascular disease (CVD), chronic kidney disease (CKD) and other non-liver cancers (1-3). MASLD affects approximately 30% of people globally with increasing incidence and prevalence that is forecasted to reach 55% by 2040 (4). Such trends are due to the rapid increase of metabolic disorders such as obesity and type 2 diabetes (5).
There are currently limited pharmacological therapies approved specifically for MASLD. Weight loss through lifestyle modifications and use of some weight loss drugs like semaglutide remain the major treatments but are limited by poor adherence over time (6). European Association for the Study of the Liver (EASL)-European Association for the Study of Diabetes (EASD)-European Association for the Study of Obesity (EASO) Clinical Practice Guidelines suggested that patients with MASLD and class II or III obesity [body mass index (BMI) ≥35 kg/m2] can consider bariatric surgery if lifestyle interventions or pharmacological therapy do not work well on weight loss (7). Bariatric surgery for severe obesity (class II or III obesity) can offer an effective and durable alternative for weight loss, especially with increasing use of laparoscopic surgery such as laparoscopic sleeve gastrectomy (SG) as opposed to open Roux-en-Y operation (8,9). Weight loss following bariatric surgery is associated with improvements in liver steatosis, inflammation, and fibrosis (10,11) as well as reduced risk of adverse liver and non-liver events and mortality (12-14). Additionally, a recent randomized trial found that bariatric surgery resolved steatohepatitis more effectively than lifestyle modifications (15). In addition, bariatric surgery may offer the potential for achieving hepatic recompensation in MASLD-related cirrhosis and is getting increasing attention (16).
Prior studies generally found that laparoscopic surgery as compared to open surgery was associated with a reduced risk of postoperative mortality, infections, and other complications as well as reduced length of stay and hospital charges, but higher reoperation rates after surgery (17-21). However, most studies mainly focused on short-term postoperative complications or mortality. As a result, data comparing long-term complications of laparoscopic vs. open bariatric surgery are sparse, particularly among patients with MASLD and severe obesity. Therefore, we aimed to compare long-term liver- and non-liver complications and healthcare utilization and costs in patients with MASLD and severe obesity who underwent laparoscopic vs. open bariatric surgery. We present this article in accordance with the STROBE reporting checklist (available at https://hbsn.amegroups.com/article/view/10.21037/hbsn-24-529/rc).
Methods
Data source
We conducted a retrospective cohort study using the Merative™ Marketscan® Research Databases housed in the Population Health Science Center at Stanford University, Palo Alto, California (22,23). The Marketscan® database is a large national administrative claims database with data on approximately 250 million Americans with private health insurance and Medicare supplemental insurance in the United States (U.S.) between January 2007 and December 2022.
Study population
We first identified adult patients with at least one inpatient or two outpatient diagnoses for MASLD. According to the 2023 MASLD guideline of American Association for the Study of Liver Diseases (AASLD) (24), MASLD patients are those who have hepatic steatosis and at least one of five cardiometabolic risk factors. We further restricted the study population to patients with severe obesity (BMI ≥35 kg/m2) to be consistent with the indications for bariatric surgery on individuals with a BMI ≥35 kg/m2, with or without coexisting comorbidities in clinical guidelines (25). To avoid misclassification, only patients with bariatric surgery that performed after the first MASLD diagnosis were included. Patients with diagnosis of hepatocellular carcinoma (HCC), cirrhosis or liver transplant, or history of other cancers prior to the first MASLD diagnosis date were also excluded. Patients were followed until the occurrence of liver or non-liver outcomes, withdrawal from insurance or last follow-up date (12/31/2022), whichever came first.
Bariatric surgery cohort
We categorized 46,476 patients with MASLD and severe obesity into laparoscopic surgery (n=39,190) and open surgery group (n=7,286). The index date was defined as the bariatric surgery date. All bariatric surgeries were defined using the Current Procedural Terminology (CPT), International Classification of Diseases, Ninth and Tenth Revision, Clinical Modification (ICD-9-CM and ICD-10-CM) procedure codes recommended by the American Society for Metabolic and Bariatric Surgery including laparoscopic/open Roux-en-Y gastric bypass (RYGB), laparoscopic/open SG, laparoscopic/open vertical-banded gastroplasty (VBG), laparoscopic/open adjustable gastric banding (AGB), open biliopancreatic diversion-duodenal switch (BPD/DS) (Table S1).
Study outcomes
The study outcomes were the incidence of (I) adverse liver outcomes, including HCC, cirrhosis, and liver decompensation; and (II) adverse non-liver outcomes, including CVD, CKD, and primary obesity-related cancers. Any liver-related outcomes were a composite outcome of HCC, cirrhosis, and/or liver decompensation.
Healthcare use and costs
All-cause healthcare use was reported as the annual number of claims per patient for inpatient admissions, emergency department (ED) visits, outpatient visits, and pharmaceutical prescriptions. We also assessed the prevalence of having at least one inpatient admission, ED visit, outpatient visit, and pharmaceutical prescriptions following the index date. Similarly, all-cause inpatient, ED, outpatient, and pharmaceutical healthcare costs were reported as annual costs per patient adjusted to 2021 U.S. dollars (USD), where all dollar estimates were inflated to 2021 dollars using the Medical Care Component of the Consumer Price Index (CPI).
Ethical statement
The study was conducted in accordance with the Declaration of Helsinki and its subsequent amendments. This study protocol was reviewed and approved by the institutional review board of Stanford Research Compliance Office at Stanford University, California (approval No. 13927), and individual consent for this retrospective analysis was waived because anonymous and de-identified information was used for the analyses.
Statistical analysis
Descriptive statistics included mean and standard deviation (SD) or median [interquartile range (IQR)] reported for continuous variables, counts with percentages reported for categorical variables. Continuous variables of two independent groups were compared by Student’s t-tests or Wilcoxon signed-rank test; categorical variables were analyzed by Pearson’s Chi-squared or Fisher’s exact tests, where appropriate.
To adjust for potential confounding variables and bias for adverse liver and non-liver outcomes between laparoscopic and open surgery, we used propensity score matching (PSM) and a nearest-neighbor 1:1 matching scheme to match these two groups, with the logit of the propensity score (PS) within 0.2 SD. The PS was developed from a logistic regression model using age, sex, geographic region, insurance type, provider specialty, year of MASLD diagnosis, year of bariatric surgery, Charlson Comorbidity Index (CCI), the presence of diabetes, hypertension, hyperlipidemia, asthma, obstructive sleep apnea, obesity hypoventilation syndrome and use of metabolic medications. For continuous variables, we did not have missing data on age and CCI. For categorical variables, sex (female/male), geographic region (Northeast, North central, South, West, and unknown), insurance type [health maintenance organization (HMO), preferred provider organization (PPO), and others], provider specialty [non-gastroenterologist (GI)/endocrinologist (Endo), GI/Endo], year of MASLD diagnosis (2007–2011, 2012–2016, and 2017–2022), year of bariatric surgery (2007–2015 and 2016–2022), the presence of comorbidities (yes/no) and use of metabolic medications (yes/no) also did not show any missing data in the database (Appendix 1). Thus, no missing data need to be addressed for these variables. For healthcare use and costs, we additionally matched for the two groups among those who had complete healthcare use and cost records in the Marketscan® database. Incidence analyses of adverse liver and non-liver outcomes excluded patients who had specific outcomes at baseline. The Kaplan-Meier method was used to examine the cumulative incidence of liver and non-liver outcomes in the two groups, with log-rank test for comparison. Cox proportional hazard model was used to estimate hazard ratios (HRs) and 95% confidence intervals (CIs) of adverse liver and non-liver outcomes. We did not perform competing risks model adjusting for non-liver outcomes (e.g., CVD or cancer) but analyzed non-liver outcomes independently because several studies have found that when patients develop CVD, CKD, or non-liver cancer, they still have possibility to develop cirrhosis or HCC during their lifetime (26-29).
We performed subgroup analyses stratified by index year (2007–2012 and 2013–2021), age (<50 and ≥50 years) and sex to investigate the association between bariatric surgery types and the risk of adverse liver and non-liver outcomes. Index year, age, and sex were not adjusted for in subgroup analyses stratified by each of these specific respective factors. To confirm the robustness of findings, we performed sensitivity analyses: (I) we excluded patients with viral hepatitis or other hepatobiliary diseases; and (II) we excluded adverse outcomes within 1 year after the index date. To detect residual bias from unmeasured confounding, we performed negative control analyses including anemia and hemiplegia without known association with bariatric surgery types. Statistical significance was defined as a two-tailed P value <0.05. All statistical analyses were performed using R software version 4.3.3 (R Foundation for Statistical Computing, Vienna, Austria).
Results
Patient characteristics
We identified 922,914 patients with MASLD diagnosis between 2007 and 2022. After excluding patients aged <18 years, those without severe obesity, those with significant alcohol use, and history of HCC, cirrhosis, liver transplant or other cancers prior to the first MASLD diagnosis date, 46,476 eligible patients with MASLD and severe obesity (BMI ≥35 kg/m2) were included in the analysis (Figure S1). Compared to those with open surgery (n=7,286), patients with laparoscopic surgery (n=39,190) were younger (44.72 vs. 54.84 years), less likely to be male (23.5% vs. 38.6%) and to have comorbidities including DM, hypertension, hyperlipidemia, CVD, CKD, non-liver cancers, asthma and obesity-related comorbidity at baseline (Table 1). After 1:1 PSM, a total of 5,629 matched pairs of patients with laparoscopic surgery and open surgery were similar across demographic and clinical characteristics.
Table 1
| Characteristics | Before PSM | After PSM | |||||
|---|---|---|---|---|---|---|---|
| Laparoscopic surgery (n=39,190) |
Open surgery (n=7,286) | Absolute standardized difference† | Laparoscopic surgery (n=5,629) |
Open surgery (n=5,629) | Absolute standardized difference† | ||
| Age (years) | 44.72 (10.68) | 54.84 (11.98) | 0.95 | 51.21 (10.67) | 51.85 (11.01) | 0.06 | |
| Male | 9,228 (23.5) | 2,815 (38.6) | 0.36 | 1,900 (33.8) | 1,921 (34.1) | 0.009 | |
| Geographic region | 0.14 | 0.02 | |||||
| Northeast | 7,326 (18.7) | 1,661 (22.8) | 1,266 (22.5) | 1,225 (21.8) | |||
| North central | 6,669 (17.0) | 1,543 (21.2) | 1,094 (19.4) | 1,110 (19.7) | |||
| South | 16,061 (41.0) | 2,692 (36.9) | 1,954 (34.7) | 2,185 (38.8) | |||
| West | 6,677 (17.0) | 887 (12.2) | 934 (16.6) | 717 (12.7) | |||
| Unknown | 2,457 (6.3) | 503 (6.9) | 381 (6.8) | 392 (7.0) | |||
| Insurance type | 0.03 | <0.001 | |||||
| HMO | 5,397 (13.8) | 999 (13.7) | 896 (15.9) | 775 (13.8) | |||
| PPO | 22,354 (57.0) | 4,049 (55.6) | 3,060 (54.4) | 3,300 (58.6) | |||
| Others | 11,439 (29.2) | 2,238 (30.7) | 1,673 (29.7) | 1,554 (27.6) | |||
| Specialty | 0.55 | 0.04 | |||||
| Non-GI/Endo | 36,130 (92.2) | 5,641 (77.4) | 4,582 (81.4) | 4,642 (82.5) | |||
| GI/Endo | 3,060 (7.8) | 1,645 (22.6) | 1,047 (18.6) | 987 (17.5) | |||
| Year of MASLD diagnosis | 0.90 | 0.09 | |||||
| 2007–2011 | 12,129 (30.9) | 5,250 (72.1) | 3,527 (62.7) | 3,851 (68.4) | |||
| 2012–2016 | 14,568 (37.2) | 1,912 (26.2) | 1,885 (33.5) | 1,655 (29.4) | |||
| 2017–2022 | 12,493 (31.9) | 124 (1.7) | 217 (3.9) | 123 (2.2) | |||
| Year of bariatric surgery | 0.74 | 0.054 | |||||
| 2007–2015 | 24,385 (62.2) | 7,137 (98.0) | 5,333 (94.7) | 5,481 (97.4) | |||
| 2016–2022 | 14,805 (37.8) | 149 (2.0) | 296 (5.3) | 148 (2.6) | |||
| CCI | 2.91 (1.32) | 5.06 (2.77) | >0.99 | 4.05 (1.97) | 4.06 (1.89) | 0.01 | |
| Comorbidities | |||||||
| Diabetes | 12,466 (31.8) | 3,918 (53.8) | 0.47 | 2,921 (51.9) | 2,606 (46.3) | 0.12 | |
| Hypertension | 19,021 (48.5) | 5,371 (73.7) | 0.50 | 4,047 (71.9) | 3,804 (67.6) | 0.09 | |
| Hyperlipidemia | 13,802 (35.2) | 4,434 (60.9) | 0.54 | 3,316 (58.9) | 3,058 (54.3) | 0.10 | |
| CVD | 1,107 (2.8) | 1,053 (14.5) | 0.70 | 422 (7.5) | 422 (7.5) | <0.001 | |
| CKD | 1,007 (2.6) | 938 (12.9) | 0.65 | 398 (7.1) | 402 (7.1) | 0.005 | |
| Non-liver cancer | 199 (0.5) | 354 (4.9) | 0.61 | 124 (2.2) | 126 (2.2) | 0.005 | |
| Asthma | 3,543 (9.0) | 1,084 (14.9) | 0.20 | 816 (14.5) | 764 (13.6) | 0.03 | |
| Obstructive sleep apnea | 11,451 (29.2) | 2,058 (28.2) | 0.02 | 1,875 (33.3) | 1,578 (28.0) | 0.12 | |
| Obesity hypoventilation syndrome | 93 (0.2) | 43 (0.6) | 0.07 | 22 (0.4) | 20 (0.4) | 0.007 | |
| Medication | |||||||
| Metformin | 6,634 (16.9) | 1,152 (15.8) | 0.03 | 1,111 (19.7) | 883 (15.7) | 0.11 | |
| Insulin | 3,226 (8.2) | 1,223 (16.8) | 0.31 | 878 (15.6) | 765 (13.6) | 0.07 | |
| Sulfonylureas | 2,553 (6.5) | 753 (10.3) | 0.16 | 616 (10.9) | 513 (9.1) | 0.07 | |
| Thiazolidinedione | 1,418 (3.6) | 499 (6.8) | 0.17 | 432 (7.7) | 366 (6.5) | 0.06 | |
| DPP-4 inhibitors | 1,977 (5.0) | 611 (8.4) | 0.15 | 501 (8.9) | 440 (7.8) | 0.050 | |
| SGLT2 inhibitors/GLP-1 agonists | 1,034 (2.6) | 68 (0.9) | 0.11 | 115 (2.0) | 58 (1.0) | 0.06 | |
| ACEI | 6,465 (16.5) | 1,433 (19.7) | 0.09 | 1,146 (20.4) | 1,032 (18.3) | 0.055 | |
| ARB | 4,920 (12.6) | 1,192 (16.4) | 0.12 | 911 (16.2) | 877 (15.6) | 0.02 | |
| BB | 5,494 (14.0) | 1,653 (22.7) | 0.25 | 1,157 (20.6) | 1,067 (19.0) | 0.046 | |
| CCB | 2,946 (7.5) | 782 (10.7) | 0.12 | 577 (10.3) | 546 (9.7) | 0.02 | |
| Statin | 8,484 (21.6) | 2,405 (33.0) | 0.28 | 1,886 (33.5) | 1,733 (30.8) | 0.07 | |
Continuous variables are expressed as mean (SD); categorical variables were presented as numbers (percentage). †, the balance in baseline clinical characteristics was assessed between two groups before and after PSM by using absolute standardized differences, with values of below 0.2 indicating good balance and over 0.2 indicating imbalance. All variables were adjusted in PSM. ACEI, angiotensin-converting-enzyme inhibitors; ARB, angiotensin receptor blockers; BB, beta blockers; CCB, calcium channel blockers; CCI, Charlson Comorbidity Index; CKD, chronic kidney disease; CVD, cardiovascular disease; DPP-4, dipeptidyl peptidase-4; Endo, endocrinologist; GI, gastroenterologist; GLP-1, glucagon-like peptide-1 receptor; HMO, health maintenance organization; MASLD, metabolic dysfunction-associated steatotic liver disease; PPO, preferred provider organization; PSM, propensity score matching; SD, standard deviation; SGLT2, sodium-glucose co-transporter-2.
Utilization trend, patient characteristics, and postoperative complications by bariatric surgery procedure types
Among all bariatric surgeries performed, RYGB was the dominant surgery procedure prior to 2012 then declined to 30% after, whereas SG became the dominant procedure accounting for more than half of bariatric surgeries after 2012 (Figure 1). Other procedures including ABG, VBG, and BPD/DS were rarely performed throughout the study period.
Within each time period 2007–2015 or 2016–2021, patients with laparoscopic surgery were younger, less likely to be male and had less comorbidities (Table S2). In regard to <30-day postoperative complications, there were no significant differences between laparoscopic and open surgery in the frequency of incisional hernia and intestinal obstruction, but laparoscopic surgery group had more gastrointestinal bleeding (0.18% vs. 0.03%) and nausea/vomiting (1.48% vs. 0.10%) than open surgery group (Table S3). In regard to medium-term complications, laparoscopic surgery group had lower rates of gastroesophageal reflux disease (0.80% vs. 2.44%), incisional hernia (0.20% vs. 0.81%), chronic diarrhea (0.63% vs. 1.48%), and reoperation rate (0.51% vs. 2.74%), but had a higher rate of dumping syndrome (0.24% vs. 0.03%) than open surgery group.
Association between bariatric surgery types and adverse liver outcomes
In the PSM cohort, during a mean follow-up duration of 3.72 and 4.04 years of laparoscopic and open surgery, 331 (4.0%), 20 (0.2%), 330 (4.0%), and 266 (2.9%) patients developed any liver-related outcomes, HCC, cirrhosis and liver decompensation, respectively. Cumulative incidence of any liver-related outcomes was significantly lower for patients with laparoscopic surgery compared to those with open surgery at 5 years (3.7% vs. 6.7%) and 10 years (6.0% vs. 11.3%, P<0.001; Figure 2A). Similar findings were observed in the outcome of cirrhosis and liver decompensation (Figure 2B,2C). Because PSM has effectively balanced the relevant baseline characteristics of the study groups, we did not further adjust for these variables in multivariable analysis. Patients with laparoscopic surgery had a 47% lower risk of any liver-related outcomes [adjusted HR (aHR) =0.53; 95% CI: 0.42–0.67; P<0.001] and cirrhosis (aHR =0.53; 95% CI: 0.42–0.66; P<0.001), and 32% reduced risk of liver decompensation (aHR =0.68; 95% CI: 0.53–0.87; P=0.002) compared to those with open surgery (Table 2). There was no statistically significant difference in the risk of HCC between laparoscopic and open surgery.
Table 2
| Outcomes | No. of patients | No. of events | Person-years | Incidence rate per 1,000 person-years (95% CI) | Multivariable analysis | |
|---|---|---|---|---|---|---|
| Adjusted HR (95% CI)† | P value | |||||
| Any liver-related outcomes | ||||||
| Open | 4,218 | 222 | 17,044 | 13.03 (11.37–14.86) | Ref. | |
| Laparoscopic | 4,057 | 109 | 15,110 | 7.21 (5.92–8.70) | 0.53 (0.42–0.67) | <0.001 |
| HCC‡ | ||||||
| Open | 4,788 | <11 | 19,409 | 0.52 (0.25–0.95) | Ref. | |
| Laparoscopic | 4,738 | <11 | 17,780 | 0.56 (0.27–1.03) | 1.26 (0.52–3.07) | 0.61 |
| Cirrhosis | ||||||
| Open | 4,222 | 222 | 17,050 | 13.02 (11.36–14.85) | Ref. | |
| Laparoscopic | 4,057 | 108 | 15,114 | 7.15 (5.86–8.63) | 0.53 (0.42–0.66) | <0.001 |
| Liver decompensation | ||||||
| Open | 4,614 | 160 | 18,663 | 8.57 (7.30–10.01) | Ref. | |
| Laparoscopic | 4,630 | 106 | 17,244 | 6.15 (5.03–7.43) | 0.68 (0.53–0.87) | 0.002 |
| CVD | ||||||
| Open | 4,292 | 499 | 16,215 | 30.77 (28.13–33.60) | Ref. | |
| Laparoscopic | 4,332 | 172 | 15,900 | 10.82 (9.26–12.56) | 0.33 (0.28–0.40) | <0.001 |
| CKD | ||||||
| Open | 4,367 | 335 | 17,018 | 19.69 (17.63–21.91) | Ref. | |
| Laparoscopic | 4,348 | 146 | 16,215 | 9.00 (7.60–10.59) | 0.44 (0.36–0.54) | <0.001 |
| Obesity-related cancer | ||||||
| Open | 5,433 | 105 | 19,218 | 5.46 (4.47–6.61) | Ref. | |
| Laparoscopic | 5,484 | 58 | 17,711 | 3.27 (2.49–4.23) | 0.58 (0.42–0.80) | <0.001 |
| Colorectal cancer | ||||||
| Open | 5,481 | 26 | 19,539 | 1.33 (0.87–1.95) | Ref. | |
| Laparoscopic | 5,518 | 14 | 17,948 | 0.78 (0.43–1.31) | 0.57 (0.30–1.09) | 0.09 |
| Pancreatic cancer | ||||||
| Open | 5,465 | 21 | 19,554 | 1.07 (0.66–1.64) | Ref. | |
| Laparoscopic | 5,519 | <11 | 17,986 | 0.33 (0.12–0.73) | 0.29 (0.12–0.71) | 0.007 |
| Female-specific cancer | ||||||
| Open | 5,465 | 61 | 19,354 | 3.15 (2.41–4.05) | Ref. | |
| Laparoscopic | 5,492 | 37 | 17,777 | 2.08 (1.47–2.87) | 0.65 (0.43–0.98) | 0.041 |
†, using PSM adjusting for age, sex, geographic region, insurance type, provider specialty, year of MASLD diagnosis, year of bariatric surgery, CCI, the presence of diabetes, hypertension, hyperlipidemia, asthma, obstructive sleep apnea, obesity hypoventilation syndrome and use of metabolic medications for all analyses, respectively. ‡, cirrhosis was additionally adjusted in the analysis of HCC. Due to the small number of HCC (<11) in each category, we did not show the exact number of HCC in the table for patient privacy policy of Population Health Sciences. CCI, Charlson Comorbidity Index; CI, confidence interval; CKD, chronic kidney disease; CVD, cardiovascular disease; HCC, hepatocellular carcinoma; HR, hazard ratio; MASLD, metabolic dysfunction-associated steatotic liver disease; No., number; PSM, propensity score matching; ref., reference.
Association between bariatric surgery types and adverse non-liver outcomes
For non-liver outcomes, 671 (7.8%), 481 (5.5%), and 163 (1.5%) patients developed CVD, CKD, and obesity-related cancers, respectively. Patients with laparoscopic surgery had lower cumulative incidence of CVD, CKD and obesity-related cancers than those with open surgery at 5 and 10 years (Figure 2D-2F). In multivariable analysis, patients with laparoscopic surgery had a 67% reduced risk of CVD (aHR =0.33; 95% CI: 0.28–0.40; P<0.001), 56% reduced risk of CKD (aHR =0.44; 95% CI: 0.36–0.54; P<0.001), and 42% reduced risk of obesity-related cancers (aHR =0.58; 95% CI: 0.42–0.80; P<0.001), compared to those who had open surgery (Table 2). We further investigated specific obesity-related cancers. Patients with laparoscopic surgery had lower cumulative incidence of colorectal cancer, pancreatic cancer and female-specific cancer than those with open surgery (Figure S2A-S2C). After multivariable adjustment, laparoscopic surgery group was associated 71% lower risk of pancreatic cancer (aHR =0.29; 95% CI: 0.12–0.71; P=0.007), 35% lower risk of female-specific cancer (aHR =0.65; 95% CI: 0.43–0.98; P=0.041) and a trend of lower risk of colorectal cancer (aHR =0.57; 95% CI: 0.30–1.09; P=0.09) (Table 2).
Healthcare use and costs between bariatric surgery types
After PSM for two bariatric surgery types among those who had complete healthcare use and cost records, we included 1,880 matched pairs of patients with laparoscopic surgery and open surgery. Patients with laparoscopic surgery had less frequent all-cause annual inpatient admissions (0.04 vs. 0.06, P=0.04), ED visits (0.03 vs. 0.08, P=0.01) and outpatient visits (2.09 vs. 2.63, P=0.01; Table 3). Compared to open surgery group, laparoscopic surgery group had a lower prevalence of having at least one ED visit (3.1% vs. 8.0%, P<0.001) and outpatient visit (54.7% vs. 71.5%, P<0.001), but higher prevalence of having at least one pharmacy claims annually (64.7% vs. 59.7%, P=0.002). Patients with laparoscopic surgery had higher annual outpatient costs ($1,249 vs. $922, P<0.001) but lower pharmacy costs ($21,766 vs. $24,353, P<0.001) compared to those with open surgery (Table 4). However, there was no significant difference in the annual costs of inpatient admissions or ED visits between the two surgery types.
Table 3
| All-cause healthcare utilization | Laparoscopic surgery (n=1,880) | Open surgery (n=1,880) | P value |
|---|---|---|---|
| Inpatient admission | |||
| Proportion with at least one visit | 196 (10.4) | 220 (11.7) | 0.23 |
| Number of inpatient admissions per person | 0.04 (0.17) | 0.06 (0.22) | 0.04 |
| Length of stay per person (days) | 0.68 (5.19) | 0.93 (4.90) | 0.13 |
| ED visits | |||
| Proportion with at least one visit | 59 (3.1) | 150 (8.0) | <0.001 |
| Number of ED visits per person | 0.03 (0.31) | 0.08 (0.77) | 0.01 |
| Outpatient visits | |||
| Proportion with at least one visit | 1,029 (54.7) | 1,344 (71.5) | <0.001 |
| Number of outpatient visits per person | 2.09 (5.77) | 2.63 (7.19) | 0.01 |
| Number of outpatient visits per person | 0.26 (0–1.59) | 0.64 (0–2.22) | – |
| Pharmacy claims | |||
| Proportion with at least one visit | 1,216 (64.7) | 1,123 (59.7) | 0.002 |
| Number of pharmacy claims | 89.68 (300.18) | 94.44 (362.16) | 0.66 |
| Number of pharmacy claims | 30.4 (0–82.5) | 23.7 (0–85.3) | – |
Continuous variables were presented as mean (SD) or median (IQR); categorical variables were presented as count (percentage). For healthcare utilization, we additionally matched for the two groups among those who had complete healthcare use and costs record in the Marketscan® Research Databases. Comparison of continuous variables were performed using Wilcoxon signed-rank test; comparisons of categorical variables were analyzed by Pearson’s chi-square or Fisher’s exact tests, where appropriate. ED, emergency department; IQR, interquartile range; MASLD, metabolic dysfunction-associated steatotic liver disease; SD, standard deviation.
Table 4
| All-cause healthcare cost† (USD) | Laparoscopic surgery (n=1,880) | Open surgery (n=1,880) | P value |
|---|---|---|---|
| Inpatient admissions | 14,814 [16,035] | 17,396 [39,227] | 0.56 |
| ED visits | 288 [486] | 269 [444] | 0.64 |
| Outpatient visits | 1,249 [5,057] | 922 [5,365] | <0.001 |
| Pharmacy claims | 21,766 [64,277] | 24,353 [82,019] | <0.001 |
Continuous variables were presented as mean [SD]. For healthcare costs, we additionally matched for the two groups among those who had complete healthcare use and costs record in the Marketscan® Research Databases. †, all costs were adjusted to 2021 USD using the medical care component of the CPI. For comparisons, all P values were obtained from Wilcoxon signed-rank test. CPI, Consumer Price Index; ED, emergency department; MASLD, metabolic dysfunction-associated steatotic liver disease; SD, standard deviation; USD, United States dollar.
Subgroup and sensitivity analysis
Consistent findings were observed in subgroup analyses stratified by index year (2007–2012 and 2013–2022), age (<50 and ≥50 years), and sex (Tables S4-S6 and Figure S3A-S3C). The results of sensitivity analyses were also consistent with our main findings. When excluding patients with viral hepatitis or other hepatobiliary diseases and excluding adverse outcomes within 1 year after the index date, laparoscopic surgery was still associated with risk reductions in liver-related outcomes, CVD, CKD, and obesity-related cancers (Tables S7,S8). In negative control analyses, observed risks of anemia and hemiplegia without known association with bariatric surgery were similar across patients with laparoscopic and open surgery, showing no obvious residual bias from unmeasured confounding for the comparison (Table S9).
Discussion
To our knowledge, this is the first study to compare the long-term clinical outcomes to include both liver and non-liver adverse events, as well as healthcare utilization and costs between laparoscopic surgery and open surgery in patients with MASLD and severe obesity. In this population-based study, laparoscopic surgery was associated with reduced risks of adverse liver outcomes and non-liver outcomes including CVD, CKD, and obesity-related cancers, as well as lower healthcare use and pharmacy costs, compared with open surgery among patients with MASLD and severe obesity.
In a retrospective study of patients with biopsy-proven MASH and obesity, bariatric surgery was associated with a significantly lower risk of incident major adverse liver outcomes and cardiovascular events compared with the nonsurgical group (12). Another nationwide study from the U.S. showed that bariatric surgery was associated with significant risk reduction in any cancer and obesity-related cancers in patients with MASLD and severe obesity compared to those who did not undergo bariatric surgery (14). Recent evidence from a decision analysis study by Rouhi et al. found that surgical weight loss was associated with a reduction in the progression of MASH, thereby reducing the need for liver transplant (30). The results of this decision analysis align with our study’s findings by underscoring the benefit of bariatric surgery on the long-term outcomes with the reduction of end-stage liver disease and liver transplant. Our study adds to the current knowledge by providing long-term outcome data for patients undergoing bariatric surgery by the types of surgery. We found that patients with laparoscopic surgery had more favorable long-term outcomes than those with open surgery. These significant findings may be interpreted by that patients who underwent laparoscopic surgery might be less sick, have less complications and proves to achieve better quality of life after surgery compared to those with open surgery (31). In addition to data on several liver and non-liver adverse events, we provided data for specific obesity-related cancers including colorectal cancer, pancreatic cancer and female-specific cancer which reduced risks with laparoscopic surgery as compared to open surgery.
Laparoscopic bariatric surgery has been associated with more favorable liver outcomes in terms of liver enzyme normalization, liver histology improvement, and overall liver function recovery, possibly due to the less traumatic nature of the surgery and reduced stress and inflammatory response on the liver during recovery compared with open surgery (32). Consistent with our study, a prior randomized controlled trial compared laparoscopic and open gastric bypass surgery in morbidly obese patients with MASLD and found that the laparoscopic group had more significant reductions in weight loss, liver fat content, and improved liver function when compared to open surgery group (31). Our study also provided important data for the association between laparoscopic surgery and non-liver complications, which may be partly due to the less invasive nature of the procedure, quicker recovery, fewer complications and better control over cardiovascular risk factors such as diabetes and obesity (33,34). Prior studies have reported fewer long-term complications related to CVD in patients undergoing laparoscopic surgery as compared to open operation (35,36). However, data comparing laparoscopic vs. open bariatric surgery on the long-term outcomes of extrahepatic cancer risk are sparse. Regardless, weight loss achieved through both types of surgery is known to reduce the incidence of certain cancers and laparoscopic surgery tends to have a better long-term recovery and less inflammation response, which may help reduce the likelihood of developing cancer, but further studies are needed (37,38).
The U.S. national trend of laparoscopic surgery dramatically increase over time, paralleled by a substantial decrease in open surgery from 2006 to 2015 (8). Our study also demonstrated that laparoscopic surgery was preferred for better outcomes compared to the open approach. In this study, among different bariatric surgery types, we further showed SG was more prevalent over RYGB in U.S. since 2016, which may be attributed to the simpler procedure, improvement of surgical techniques, shorter operation time and lower morbidity and mortality rates observed with SG (39). Our subgroup analyses also supported that laparoscopic surgery was associated with lower risk of liver and non-liver outcomes than open surgery regardless of index year, age and sex.
A 6-year follow-up of bariatric surgery and control cohorts found that total costs including inpatient, outpatient and pharmacy costs in the first two years postoperative for patients with laparoscopic surgery were significantly lower than those with open surgery, but these differences did not persist in subsequent periods (40). This study was limited by the shorter follow-up for the newer procedures during 2002–2008. Banka et al. reported that patients who underwent open surgery had longer median lengths of inpatient stay (3.5 vs. 2.4 days) and higher inpatient costs ($35,018 vs. $32,671) than those who had laparoscopic surgery using the 2005–2007 Nationwide Inpatient Sample from the U.S. (18). However, this retrospective study only reported inpatient utilization and costs but did not investigate ED, outpatient and pharmacy use and costs. In our study, we provided evidence that patients with laparoscopic surgery had less frequent inpatient, ED and outpatient visits, and had lower pharmacy costs compared to those with open surgery, which suggests patients with laparoscopic surgery may achieve better health state and quality of life after surgery.
Strengths and limitations
There are several strengths of this study. First, we had a large sample size with individual-level claims data from a real-world cohort that is representative of the general U.S. population with private health insurance. Second, to minimize the impact of selection bias and confounding variables in retrospective data, PSM was used to minimize confounders between the two groups. This methodological strength provides further evidence of the strong association between bariatric surgery types and long-term outcomes. Lastly, we adjusted for multiple confounding variables associated with adverse outcomes, as well as conducted multiple subgroups, sensitivity analyses and negative control analyses to further enhance the robustness of our results.
Our study also had several limitations. We did not adjust for additional potential confounders such as race, lifestyle, and socioeconomic status as they were not available in the Marketscan® database, so future studies are needed to evaluate these factors. Also, administrative claims databases are prone to have under-coding and misclassification issues. However, as this is a large database maintained with rigorous methods, the misinterpretation of disease states may be minimized. Additionally, our study focused on short and medium-term complication rates, so further studies are needed to assess potential differences in the long-term complications of the different bariatric surgical approaches. Furthermore, the database only included insured individuals, so the findings may not apply to individuals who are uninsured or underinsured, but individuals with lesser health coverage may have more advanced disease and even higher risk for complications. Lastly, though we adjusted for as many potential confounders associated with adverse outcomes that were available, there may still be some potential unmeasured confounders that were not captured. The criteria for surgical approach selection as unmeasured confounders can vary based on the patient’s health and medical history (e.g., severe obesity-related comorbidities, high BMI, abdominal anatomy may be better suited for open surgery) and surgical experience and expertise (e.g., surgeons with extensive experience in laparoscopic techniques and facility support may prefer this method for less complications), as well as patient’s preference and risk tolerance (e.g., recovery time and cost) (25). These potential selection biases can lead to an overestimation or underestimation of the benefits of one approach over the other. For example, if laparoscopic surgeries are usually performed by more experienced surgeons or at better-equipped hospitals, the study could incorrectly attribute better outcomes to the laparoscopic approach, when in reality the differences might be due to these confounding factors. Conversely, if open surgery is performed in less experienced surgeons or in less-equipped facilities, its outcomes may appear worse than they truly are. However, we performed additional negative control analyses which suggested that our findings were robust despite the potential presence of unmeasured confounders and residual bias after PSM. In addition, entropy balancing can also be a complementary method to PSM for addressing unmeasured confounding in future studies (41).
Conclusions
In this population-based study, patients with MASLD and severe obesity who underwent laparoscopic surgery had significantly lower risk of adverse liver and non-liver outcomes including CVD, CKD, and obesity-related cancers than those who had open surgery. Patients with laparoscopic surgery were also associated with less healthcare utilization and pharmacy costs compared to those with open surgery. The present study suggests that laparoscopic surgery is a promising potential treatment for patients with MASLD and severe obesity with more favorable long-term outcomes and healthcare utilization and costs than open surgery. Although our study provides novel information, randomized clinical trials and additional cost-effectiveness analysis are needed to corroborate our findings.
Acknowledgments
Data for this project were accessed using the Stanford Center for Population Health Sciences Data Core. The Population Health Sciences Data Core is supported by a National Institutes of Health National Center for Advancing Translational Science Clinical and Translational Science Award (UL1TR003142) and from Internal Stanford funding. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.
Footnote
Reporting Checklist: The authors have completed the STROBE reporting checklist. Available at https://hbsn.amegroups.com/article/view/10.21037/hbsn-24-529/rc
Data Sharing Statement: Available at https://hbsn.amegroups.com/article/view/10.21037/hbsn-24-529/dss
Peer Review File: Available at https://hbsn.amegroups.com/article/view/10.21037/hbsn-24-529/prf
Funding: None.
Conflicts of Interest: All authors have completed the ICMJE uniform disclosure form (available at https://hbsn.amegroups.com/article/view/10.21037/hbsn-24-529/coif). M.H.N. declares research funding from Pfizer, Enanta, Astra Zeneca, Glycotest, GSK, Delfi, Innogen, Exact Science, CurveBio, Gilead, Vir Biotech, Helio Health, National Cancer Institute, National Health Institute, Roche; and leadership or fiduciary role and consulting fees from Exelixis, Gilead, Intercept, GSK, Exact Science. The other authors have no conflicts of interest to declare.
Ethical Statement: The authors are accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. The study was conducted in accordance with the Declaration of Helsinki and its subsequent amendments. This study protocol was reviewed and approved by the institutional review board of Stanford Research Compliance Office at Stanford University, California (approval No. 13927), and individual consent for this retrospective analysis was waived because anonymous and de-identified information was used for the analyses.
Open Access Statement: This is an Open Access article distributed in accordance with the Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International License (CC BY-NC-ND 4.0), which permits the non-commercial replication and distribution of the article with the strict proviso that no changes or edits are made and the original work is properly cited (including links to both the formal publication through the relevant DOI and the license). See: https://creativecommons.org/licenses/by-nc-nd/4.0/.
References
- Lin H, Lee HW, Yip TC, et al. Vibration-Controlled Transient Elastography Scores to Predict Liver-Related Events in Steatotic Liver Disease. JAMA 2024;331:1287-97. [Crossref] [PubMed]
- Zhou XD, Targher G, Byrne CD, et al. An international multidisciplinary consensus statement on MAFLD and the risk of CVD. Hepatol Int 2023;17:773-91. [Crossref] [PubMed]
- Sun DQ, Targher G, Byrne CD, et al. An international Delphi consensus statement on metabolic dysfunction-associated fatty liver disease and risk of chronic kidney disease. Hepatobiliary Surg Nutr 2023;12:386-403. [Crossref] [PubMed]
- Le MH, Yeo YH, Li X, et al. 2019 Global NAFLD Prevalence: A Systematic Review and Meta-analysis. Clin Gastroenterol Hepatol 2022;20:2809-2817.e28. [Crossref] [PubMed]
- Eslam M, El-Serag HB, Francque S, et al. Metabolic (dysfunction)-associated fatty liver disease in individuals of normal weight. Nat Rev Gastroenterol Hepatol 2022;19:638-51. [Crossref] [PubMed]
- Rinella ME, Neuschwander-Tetri BA, Siddiqui MS, et al. AASLD Practice Guidance on the clinical assessment and management of nonalcoholic fatty liver disease. Hepatology 2023;77:1797-835. [Crossref] [PubMed]
- European Association for the Study of the Liver (EASL). European Association for the Study of Obesity (EASO). EASL-EASD-EASO Clinical Practice Guidelines on the management of metabolic dysfunction-associated steatotic liver disease (MASLD). J Hepatol 2024;81:492-542. [Crossref] [PubMed]
- Alalwan AA, Friedman J, Park H, et al. US national trends in bariatric surgery: A decade of study. Surgery 2021;170:13-7. [Crossref] [PubMed]
- Nguyen NT, Nguyen B, Gebhart A, et al. Changes in the makeup of bariatric surgery: a national increase in use of laparoscopic sleeve gastrectomy. J Am Coll Surg 2013;216:252-7. [Crossref] [PubMed]
- Lassailly G, Caiazzo R, Buob D, et al. Bariatric Surgery Reduces Features of Nonalcoholic Steatohepatitis in Morbidly Obese Patients. Gastroenterology 2015;149:379-88; quiz e15-6. [Crossref] [PubMed]
- Lassailly G, Caiazzo R, Ntandja-Wandji LC, et al. Bariatric Surgery Provides Long-term Resolution of Nonalcoholic Steatohepatitis and Regression of Fibrosis. Gastroenterology 2020;159:1290-1301.e5. [Crossref] [PubMed]
- Aminian A, Al-Kurd A, Wilson R, et al. Association of Bariatric Surgery With Major Adverse Liver and Cardiovascular Outcomes in Patients With Biopsy-Proven Nonalcoholic Steatohepatitis. JAMA 2021;326:2031-42. [Crossref] [PubMed]
- Krishnan A, Hadi Y, Alqahtani SA, et al. Cardiovascular Outcomes and Mortality After Bariatric Surgery in Patients With Nonalcoholic Fatty Liver Disease and Obesity. JAMA Netw Open 2023;6:e237188. [Crossref] [PubMed]
- Rustgi VK, Li Y, Gupta K, et al. Bariatric Surgery Reduces Cancer Risk in Adults With Nonalcoholic Fatty Liver Disease and Severe Obesity. Gastroenterology 2021;161:171-184.e10. [Crossref] [PubMed]
- Verrastro O, Panunzi S, Castagneto-Gissey L, et al. Bariatric-metabolic surgery versus lifestyle intervention plus best medical care in non-alcoholic steatohepatitis (BRAVES): a multicentre, open-label, randomised trial. Lancet 2023;401:1786-97. [Crossref] [PubMed]
- Feng G, Han Y, Yang W, et al. Recompensation in MASLD-related cirrhosis via metabolic bariatric surgery. Trends Endocrinol Metab 2025;36:118-32. [Crossref] [PubMed]
- Al-Mazrou AM, Bellorin O, Dhar V, et al. Minimally invasive versus open duodenal switch: a nationwide retrospective analysis. Surg Endosc 2022;36:7000-7. [Crossref] [PubMed]
- Banka G, Woodard G, Hernandez-Boussard T, et al. Laparoscopic vs open gastric bypass surgery: differences in patient demographics, safety, and outcomes. Arch Surg 2012;147:550-6. [Crossref] [PubMed]
- Rausa E, Bonavina L, Asti E, et al. Rate of Death and Complications in Laparoscopic and Open Roux-en-Y Gastric Bypass. A Meta-analysis and Meta-regression Analysis on 69,494 Patients. Obes Surg 2016;26:1956-63. [Crossref] [PubMed]
- Reges O, Greenland P, Dicker D, et al. Association of Bariatric Surgery Using Laparoscopic Banding, Roux-en-Y Gastric Bypass, or Laparoscopic Sleeve Gastrectomy vs Usual Care Obesity Management With All-Cause Mortality. JAMA 2018;319:279-90. [Crossref] [PubMed]
- Reoch J, Mottillo S, Shimony A, et al. Safety of laparoscopic vs open bariatric surgery: a systematic review and meta-analysis. Arch Surg 2011;146:1314-22. [Crossref] [PubMed]
- Park H, Dawwas GK, Liu X, et al. Nonalcoholic fatty liver disease increases risk of incident advanced chronic kidney disease: a propensity-matched cohort study. J Intern Med 2019;286:711-22. [Crossref] [PubMed]
- Yeo YH, Hwang J, Jeong D, et al. Surveillance of patients with cirrhosis remains suboptimal in the United States. J Hepatol 2021;75:856-64. [Crossref] [PubMed]
- Rinella ME, Lazarus JV, Ratziu V, et al. A multisociety Delphi consensus statement on new fatty liver disease nomenclature. Hepatology 2023;78:1966-86. [Crossref] [PubMed]
- Eisenberg D, Shikora SA, Aarts E, et al. 2022 American Society of Metabolic and Bariatric Surgery (ASMBS) and International Federation for the Surgery of Obesity and Metabolic Disorders (IFSO) Indications for Metabolic and Bariatric Surgery. Obes Surg 2023;33:3-14. [Crossref] [PubMed]
- Carballo-Folgoso L, Álvarez-Velasco R, Lorca R, et al. Evaluation of cardiovascular events in patients with hepatocellular carcinoma treated with sorafenib in the clinical practice. The CARDIO-SOR study. Liver Int 2021;41:2200-11. [Crossref] [PubMed]
- Gundling F, Seidl H, Schmidtler F, et al. Nonhepatic cancer in liver cirrhosis: a retrospective study of prevalence, complication rate after specific oncological treatment, follow-up and prognostic predictors of outcome in 354 patients with cirrhosis. Anticancer Res 2011;31:2931-8. [PubMed]
- Roca-Fernandez A, Banerjee R, Thomaides-Brears H, et al. Liver disease is a significant risk factor for cardiovascular outcomes - A UK Biobank study. J Hepatol 2023;79:1085-95. [Crossref] [PubMed]
- Sarno G, Montalti R, Giglio MC, et al. Hepatocellular carcinoma in patients with chronic renal disease: Challenges of interventional treatment. Surg Oncol 2021;36:42-50. [Crossref] [PubMed]
- Rouhi AD, Castle RE, Hoeltzel GD, et al. Sleeve Gastrectomy Reduces the Need for Liver Transplantation in Patients with Obesity and Non-Alcoholic Steatohepatitis: a Predictive Model. Obes Surg 2024;34:1224-31. [Crossref] [PubMed]
- Nguyen NT, Goldman C, Rosenquist CJ, et al. Laparoscopic versus open gastric bypass: a randomized study of outcomes, quality of life, and costs. Ann Surg 2001;234:279-89; discussion 289-91. [Crossref] [PubMed]
- Schmitz SM, Kroh A, Koch A, et al. Comparison of Liver Recovery After Sleeve Gastrectomy and Roux-en-Y-Gastric Bypass. Obes Surg 2021;31:3218-26. [Crossref] [PubMed]
- Oliveira SC, Neves JS, Souteiro P, et al. Impact of Bariatric Surgery on Long-term Cardiovascular Risk: Comparative Effectiveness of Different Surgical Procedures. Obes Surg 2020;30:673-80. [Crossref] [PubMed]
- Srinivasan M, Thangaraj SR, Arzoun H, et al. The Impact of Bariatric Surgery on Cardiovascular Risk Factors and Outcomes: A Systematic Review. Cureus 2022;14:e23340. [Crossref] [PubMed]
- Benotti PN, Wood GC, Carey DJ, et al. Gastric Bypass Surgery Produces a Durable Reduction in Cardiovascular Disease Risk Factors and Reduces the Long-Term Risks of Congestive Heart Failure. J Am Heart Assoc 2017;6:e005126. [Crossref] [PubMed]
- Gerber P, Naqqar D, von Euler-Chelpin M, et al. Incidence of Cancer and Cardiovascular Disease After Bariatric Surgery in Older Patients. JAMA Netw Open 2024;7:e2427457. [Crossref] [PubMed]
- Aminian A, Wilson R, Al-Kurd A, et al. Association of Bariatric Surgery With Cancer Risk and Mortality in Adults With Obesity. JAMA 2022;327:2423-33. [Crossref] [PubMed]
- Wilson RB, Lathigara D, Kaushal D. Systematic Review and Meta-Analysis of the Impact of Bariatric Surgery on Future Cancer Risk. Int J Mol Sci 2023;24:6192. [Crossref] [PubMed]
- Salminen P, Helmiö M, Ovaska J, et al. Effect of Laparoscopic Sleeve Gastrectomy vs Laparoscopic Roux-en-Y Gastric Bypass on Weight Loss at 5 Years Among Patients With Morbid Obesity: The SLEEVEPASS Randomized Clinical Trial. JAMA 2018;319:241-54. [Crossref] [PubMed]
- Weiner JP, Goodwin SM, Chang HY, et al. Impact of bariatric surgery on health care costs of obese persons: a 6-year follow-up of surgical and comparison cohorts using health plan data. JAMA Surg 2013;148:555-62. [Crossref] [PubMed]
- Zagar AJ, Kadziola Z, Lipkovich I, et al. Evaluating different strategies for estimating treatment effects in observational studies. J Biopharm Stat 2017;27:535-53. [Crossref] [PubMed]

