Abstract
Background
Validated coding algorithms are essential to generate high-quality, real-world evidence from claims data studies.
Objective
We aimed to evaluate the validity of the algorithms to identify patients with bone metastases using claims data from a Japanese hospital.
Patients and Methods
This study used administrative claims data and electronic medical records at Juntendo University Hospital from April 2017 to March 2019. We developed two candidate claims-based algorithms to detect bone metastases, one based on diagnosis codes alone (Algorithm 1) and the other based on the combination of diagnosis and imaging test codes (Algorithm 2). Of the patients identified by Algorithm 1, 100 patients were randomly sampled. Among these 100 patients, 88 patients met the conditions of Algorithm 2; further, 12 additional patients were randomly sampled from those identified by Algorithm 2, thus obtaining a total of 100 patients for Algorithm 2. They were evaluated for their true diagnosis using the patient chart review as the gold standard. The positive predictive value (PPV) was calculated to assess the accuracy of each algorithm.
Results
For Algorithm 1, 82 patients were analyzed after excluding 18 patients without diagnostic imaging reports. Of these, 69 patients were true positive by chart review, resulting in a PPV of 84.1% (95% confidence interval (CI) 74.5–90.6). For Algorithm 2, 92 patients were analyzed after excluding eight patients whose diagnoses were not judged by chart review. Of these, 76 patients were confirmed positive by chart review, yielding a PPV of 82.6% (95% CI 73.4–89.1).
Conclusion
Both claims-based algorithms yielded high PPVs of approximately 85%, with no improvement in PPV by adding imaging test conditions. The diagnosis code-based algorithm is sufficient and valid for identifying bone metastases in this Japanese hospital.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
This is the first study to validate claims-based algorithms for detecting patients with bone metastases in Japan. |
We evaluated two algorithms based on (1) diagnosis codes alone and (2) diagnosis codes plus imaging test codes. |
The diagnosis code-based algorithm had a positive predictive value of 84.1%. |
The algorithm based on the combination of diagnosis and imaging test codes had a positive predictive value of 82.6%. |
The diagnosis code-based algorithm demonstrated sufficient utility for identifying bone metastases in Japanese hospitals’ claims data. |
1 Introduction
Routinely collected health data, or real-world data (RWD), are not originally collected for research, but they provide a large amount of data that can be utilized for research. Therefore, RWD are increasingly being used in clinical, epidemiological, and health economics studies. RWD include administrative claims data, electronic medical records, primary-care surveillance data, and disease registries [1]. Each data source has strengths and limitations [2]. Administrative claims data, for example, have advantages such as large sample size, high population representativeness, longitudinal nature, and cost-efficiency in data collection [2, 3]. In Japan, administrative claims data are commonly used in RWD studies.
Administrative claims data also pose challenges for research use [4]. In claims data studies, outcomes and exposures are defined based on claims records. However, because these records were initially input for reimbursement purposes, they may not necessarily indicate or capture the correct medical status of patients. Inaccuracy of these data can cause misclassification of outcomes and exposures, which can deteriorate the credibility of the study results [5]. To address this problem, researchers should use validated claims-based algorithms to identify the patients or outcomes [6]. In contrast to Western countries where algorithm validation studies have been aggressively conducted [7, 8], such validation is not yet a common practice in Japan [9], despite the growth of claims data studies. Algorithm validation studies should be conducted more often in Japan to enhance the quality of real-world evidence based on claims data studies.
Bone is a common site of cancer metastasis. Bone metastases may occur in any cancer [10], but are particularly common in breast and prostate cancers, followed by thyroid, kidney, and bronchus cancers [11]. Bone metastases can accompany skeletal-related events (SREs), such as pain, hypercalcemia, pathological fracture, spinal cord or nerve root compression [12, 13], thereby seriously affecting daily lives and impairing health-related quality of life [14, 15]. Although the direct impact of bone metastases on patients’ survival is unclear due to the multiple factors involved [10, 16], bone metastases or SREs are associated with increased mortality [17, 18]. With such an enormous clinical burden on patients, the appropriate management of patients with bone metastases, including the prevention of SREs, has been an important topic in oncology and public health research.
Outside Japan, multiple studies have evaluated the clinical and economic burden of bone metastases (and SREs) using administrative claims data, with some using diagnosis records alone to identify bone metastases [19,20,21,22,23]. Contrastingly, others have used a combination of diagnosis records and procedure or prescription records [24,25,26]. However, most studies did not use validated algorithms. Although a few Western studies have evaluated the validity of algorithms to identify bone metastases using claims data [27,28,29,30], such validation studies have yet to be conducted in Japan. A validated algorithm to identify these patients will generate high-quality, real-world evidence on this critical clinical condition in Japan.
Therefore, in this study, we evaluated the validity of the algorithms to identify patients with bone metastases using administrative claims data from a Japanese hospital. We evaluated the two candidate algorithms based either on (1) diagnosis records alone or (2) a combination of diagnosis and examination records, using the patient chart review as the gold standard.
2 Material and Methods
2.1 Study Design and Data Source
A cross-sectional study was conducted at a university hospital, the Juntendo University Hospital (Tokyo, Japan). Juntendo University Hospital is a designated regional cancer care hospital with a bed size of 1051, which treats approximately 32,800 inpatients and 984,000 outpatients in a year. This validation study used administrative claims data and electronic medical records for patients who visited the hospital during a 2-year study period from April 2017 to March 2019 and who had the International Statistical Classification of Diseases and Related Health Problems, 10th revision (ICD-10) codes of C79.5 (secondary malignant neoplasm of bone and bone marrow). In the administrative claims data, diagnoses are available in disease names, seven-digit Japanese claims codes (disease codes), and ICD-10 codes. Additionally, procedure names and nine-digit Japanese claims codes (procedure codes) were recorded for procedures and examinations.
This study was approved by the ethics committee of Juntendo University Hospital. As this study was a retrospective chart and claims data review, informed consent was not required, and hence was not obtained. However, information about the study, including the purpose and data use, was posted on the hospital’s website, ensuring that participants had the right to opt out.
2.2 Candidate Algorithms
Based on a review of previous literature [27, 28] and expert opinions, we derived two algorithms to identify patients with bone metastases:
-
1)
Algorithm 1: Presence of at least one diagnosis record of bone metastases (a subset of the diseases with ICD-10 codes of C79.5) during the study period.
-
2)
Algorithm 2: Presence of at least one diagnosis record of bone metastases, with a record of imaging test in the month or preceding month of the diagnosis of bone metastases.
Bone metastases were defined as a subset of the diseases with ICD-10 codes of C79.5 using the seven-digit disease codes for the diseases or conditions of bone metastases excluding bone marrow infiltration (Online Supplementary Material (OSM) Table 1); these diseases were all classified as the ICD-10 code of C79.5. A disease code marked as a suspected diagnosis (a disease name that is assigned to a test order, and remains as suspected until the diagnosis is confirmed by a doctor) was not considered evidence of bone metastasis.
In Algorithm 2, we added an imaging test condition to Algorithm 1, expecting it may increase the accuracy of identifying the target population. Imaging tests were defined as computed tomography (CT), magnetic resonance imaging (MRI), positron emission tomography (PET), or bone scintigraphy. The nine-digit procedure codes for these examinations are provided in OSM Table 2.
2.3 Study Population and Sampling
Of all patients in the obtained data, we identified patients 18 years or older who met the above-defined Algorithm 1 or Algorithm 2. As Algorithm 2 was more stringent, where an additional condition was included in Algorithm 1, patients for each algorithm were sampled sequentially. First, we randomly sampled 100 patients from patients identified by Algorithm 1. Next, of the 100 patients, 88 met the definition of Algorithm 2, and an additional 12 were sampled from patients identified by Algorithm 2 to sample 100 patients in total for Algorithm 2. We set the sample size to 100 because it is considered a sufficient number to evaluate the diagnostic accuracy of an algorithm in this sampling method (i.e., random sampling from the patients meeting the outcome) with an acceptable precision level [31].
2.4 Patient Chart Review
Chart review was used as the gold standard. Two radiologists independently reviewed the diagnostic imaging reports for each patient to ascertain whether the patient had bone metastases.
The evaluators reviewed every report of imaging tests (i.e., CT, MRI, PET, and bone scintigraphy) performed in the same or preceding month of the first diagnosis record of bone metastases. Each evaluator determined the presence of bone metastases in the patient if the report contained a statement indicating its presence (i.e., true positive); otherwise, the patient was judged to have no bone metastases (i.e., false positive). If their judgments agreed, a determination was made. If there was a discrepancy between the two judgments, the evaluators discussed and made a final judgment. If necessary, information on medical charts outside the review period was also reviewed. If the evaluators did not reach an agreed conclusion, the case was considered “unable to judge” and excluded from the analysis.
2.5 Statistical Analyses
Summary statistics were calculated for age, sex, diagnosis names, and imaging tests performed to describe the background characteristics of the study population. The validity of the two claims-based algorithms was evaluated using positive predictive values (PPVs). For each algorithm, the PPV was calculated as the proportion of bone metastasis cases judged by chart review (i.e., true positive cases) among all the patients reviewed (i.e., patients identified by the algorithm as having bone metastases). The 95% confidence interval (CI) of the PPV, assuming a binomial distribution, was calculated using Wilson’s method [32].
All statistical analyses were performed using R version 4.1.0 (R Foundation for Statistical Computing, Vienna, Austria).
3 Results
3.1 Characteristics of the Study Population
Among 2641 patients extracted from the hospital administrative claims data with records including ICD-10 codes of C79.5, we identified 715 patients with bone metastases using Algorithm 1 (i.e., based on diagnosis records alone) and 620 patients using Algorithm 2 (i.e., based on diagnosis records plus imaging test records). The background characteristics of the patients are summarized in Table 1. We randomly selected 100 patients for chart review for each group (Figs. 1, 2).
3.2 Patients Identified by Algorithm 1
Of the 100 patients, 18 were excluded from the analysis due to a lack of diagnostic imaging reports. Thus, the remaining 82 patients formed the Algorithm 1 cohort. The mean ± standard deviation (SD) age was 64.07 ± 13.74 years, and 65.85% were men (Table 1). Of these, 74 (90.24%) patients underwent CT scans, and 49 (59.76%), 27 (32.93%), and 23 (28.05%) had MRI, bone scintigraphy, and PET, respectively, in the month or preceding month of diagnosis. Among the overall 715 patients, 620 patients (86.7%) had records of the imaging tests, and among the 100 sampled patients, 88 patients (88.0%) had records. The characteristics of these 82 patients were similar to those of the overall 715 patients (Table 1).
3.3 Patients Identified by Algorithm 2
Of the 100 patients, eight patients were extracted from the analysis because the true diagnosis was impossible to judge by chart review. Thus, Algorithm 2 cohort consisted of 92 patients. The mean ± SD age was 63.75 ± 13.85 years, and 64.13% were men (Table 1). Proportions of patients who underwent imaging tests, CT, MRI, bone scintigraphy, and PET, were similar to those in the Algorithm 1 cohort (92.39%, 60.87%, 31.52%, and 27.17%, respectively). Notably, the background characteristics of this sampled population did not deviate from those of the overall patients (Table 1).
No notable differences existed between Algorithm 1 and Algortithm 2 cohorts.
3.4 Validity of the Algorithms
Of the 82 patients identified by Algorithm 1, 69 patients were true bone metastases based on chart review. Thus, the PPV was 84.1% (95% CI 74.5–90.6) (Table 2). Similarly, of the 92 patients identified by Algorithm 2, 76 patients had bone metastases based on chart review, which resulted in a PPV of 82.6% (95% CI 73.4–89.1)—adding a condition of imaging test to diagnosis records did not improve the PPV.
4 Discussion
Using validated algorithms to reduce misclassification is crucial to obtain high-quality, real-world evidence based on administrative claims data. To the best of our knowledge, this is the first study to assess the validity of algorithms to identify patients with bone metastases using claims data from a large hospital in Japan, using chart review as the gold standard. We evaluated the two algorithms, one using diagnosis records alone and the other using diagnosis and imaging test records. Consequently, both demonstrated high PPVs for identifying bone metastases from claims data at this hospital.
Remarkably, even the most straightforward algorithm based solely on diagnosis codes had a high PPV of 84.1%. We expected that adding an imaging test would reduce the number of false-positive cases. However, the algorithm combining the diagnosis and imaging test records resulted in a PPV of 82.6%. Because bone metastasis is usually diagnosed based on symptoms and testing, including plain radiography, a diagnosis record of bone metastases may be highly reliable. This may have also been responsible for the high reliability of the diagnosis records in this study. At any rate, our results indicated that using diagnosis codes alone was sufficient to identify patients with bone metastases in this hospital’s claims data, and adding extra conditions was not worth the effort. This result was unexpected, given that stricter conditions can increase diagnostic accuracy for some diseases [33]. However, our results were welcome in terms of practicality and efficiency.
The two claims-based algorithms achieved high PPVs. Nevertheless, Algorithms 1 and 2 falsely included 13 and 16 patients, respectively, who did not have bone metastases according to the gold standard. One possible reason for this is that the disease name was recorded for examination purposes. A provisional or suspected diagnosis is recorded as an “uncertain” diagnosis. Nonetheless, such an “uncertain” flag may sometimes not be recorded when ordering examinations in the next month to avoid cancellation. It can also be omitted in busy clinical settings [31]. Furthermore, they may have forgotten to correct disease names after a definitive diagnosis was determined, leaving incorrect disease names in claims records [33]. These are known causes of the inaccuracy of diagnosis in claims data in Japan and hard to avoid altogether. However, the high PPVs of our algorithms indicate an acceptably low rate of including these patients; thus, we consider that the impact of false-positive cases using our algorithm would not be significant.
Because PPVs depend on prevalence [34], and because the purposes of the algorithms developed may differ, there is no value in direct comparison of PPVs obtained in other validation studies conducted using different databases. Still, some previous studies have shown the potential of a simple algorithm based on diagnosis codes alone, similar to the present results. For example, Jensen et al. reported the utility of the single ICD-10 code (C79.5) to identify bone metastases using electronic medical registry data in Denmark, which had a high PPV (100% in prostate cancer and 86% in breast cancer) [27]. In the USA, the single ICD-9 code of 198.5 had a high PPV of 100% when used among inpatients with prostate cancer using Medicare data [30], although the same ICD-9 code had a slightly low PPV of 72.1% when used for breast cancer patients using claims data [28]. The combination of diagnosis and procedure records may be ideal in some settings. However, our results, in addition to these previous studies, suggest that they may not always be necessary.
This study focused on PPVs because a high PPV is important for identifying a group of people with a specific disease [34]. A high PPV is deemed important in comparative studies because it is considered that the non-differential sensitivity of disease misclassifications with high PPVs will not bias the risk ratio between groups [31]. We aimed to obtain algorithms to identify patients with bone metastases to examine treatment effects or the clinical/economic burden. Therefore, we prioritized maximizing the inclusion of patients who genuinely have this disease while minimizing the inclusion of those who do not—we did not aim to maximize the representativeness of the target population. We achieved our goal by obtaining algorithms with high PPVs. However, it should be noted that an algorithm with a high PPV has high specificity, potentially sacrificing its sensitivity [34], that is, it may miss some patients who do, indeed, have the disease. Thus, our algorithms may not be appropriate for estimating the incidence or prevalence of bone metastases. Researchers should use an algorithm whose high sensitivity is also confirmed for studies with such purposes.
One strength of this validation study was the use of chart review by radiologists as the gold standard, the results of which are considered the most reliable. For example, a previous study using cancer registry data as the gold standard to assess the validity of ICD-9 coding for bone metastases reported unsatisfactory results, and recommended the use of chart review as the gold standard [35]. Another strength was that our samples had high representativeness of the target population. All variables for patients’ background characteristics were similarly distributed between the overall and sampled populations.
In Japan, the linkage between databases is highly restricted [31]; currently available commercial claims databases are not linked to patients’ medical records. As the validity of claims-based coding cannot be evaluated using linked data, chart review is the most practical and reliable option in validation studies in Japan. However, it is time-consuming and may not always be feasible, although such validation should always be conducted. Therefore, our results are expected to provide valuable information regarding the accuracy of diagnosis codes to identify bone metastasis patients as the first step; these results could also serve as a reference for similar studies in the future and be combined with the new results to update the information. As a next step, studies in other facilities should focus on accumulating evidence or assessing parameters other than PPV (such as sensitivity or specificity) to promote the application of the algorithm in real-word practice.
This study has some limitations. First, the study was conducted using administrative claims data from a single hospital in Japan, which limits the generalizability of the results. Although guidelines are available for managing bone metastases in each malignancy, these are not strict, and several treatment options are available. Thus, treatment or diagnostic policies may differ between hospitals. The customs of administrative procedures may also vary at the individual and hospital levels. Therefore, our results may not apply to settings where the characteristics of hospitals or patients are primarily different from ours. Second, the prevalence of bone metastases might be higher in a large university hospital like Juntendo University Hospital than in other hospitals; consequently, such a high prevalence might have resulted in the high PPVs in our analyses. Third, as mentioned above, we did not evaluate the sensitivity of these algorithms. Our algorithms were intended to be used in comparative studies to examine treatment effects or clinical/economic burdens, but not in studies to estimate the incidence or prevalence of bone metastases, where further characterization of the algorithms (i.e., calculations of the sensitivity and specificity) is necessary. Fourth, for Algorithm 2, we sampled patients by a two-step procedure: 88 patients who met the definition of Algorithm 2 were selected from 100 patients for Algorithm 1, and 12 additional patients were randomly sampled from those identified by Algorithm 2, to obtain a total of 100 patients. Patients for Algorithm 2 could have been sampled in one step from 540 patients identified by Algorithm 2, but we took a two-step procedure instead because, from the viewpoint of feasibility, we intended to make the sample number the minimum required for sufficient precision. However, this procedure might not generate any additional bias because the population sampled by the two procedures are both considered to be random samples from patients identified by Algorithm 2 and are inherently the same. Despite these limitations, this was the first coding validation study to identify bone metastases using claims data in Japan, and we believe that our data will still be informative for researchers in this field.
5 Conclusion
In conclusion, we found that the two claims-based algorithms, one based on diagnosis records alone and the other based on diagnosis and imaging test records, had high PPVs of approximately 85% in identifying patients with bone metastases. Adding imaging test conditions did not improve the PPV, indicating that identification solely based on diagnosis records would be sufficient for use in this hospital’s claims data. Although the generalizability of the present study is limited, our results, for the first time, provide evidence of the utility of our coding for identifying bone metastases from a hospital’s claims data in Japan. We hope that this validated algorithm will enhance the credibility of RWD studies on this critical clinical condition in Japan.
References
Martin M, Bell R, Bourgeois H, et al. Bone-related complications and quality of life in advanced breast cancer: results from a randomized phase III trial of denosumab versus zoledronic acid. Clin Cancer Res. 2012;18(17):4841–9.
Nabhan C, Klink A, Prasad V. Real-world evidence—what does it really mean? JAMA Oncol. 2019;5(6):781–3.
Schneeweiss S, Avorn J. A review of uses of health care utilization databases for epidemiologic research on therapeutics. J Clin Epidemiol. 2005;58(4):323–37.
Tyree PT, Lind BK, Lafferty WE. Challenges of using medical insurance claims data for utilization analysis. Am J Med Qual. 2006;21(4):269–75.
Funk MJ, Landi SN. Misclassification in administrative claims data: quantifying the impact on treatment effect estimates. Curr Epidemiol Rep. 2014;1(4):175–85.
Benchimol EI, Manuel DG, To T, Griffiths AM, Rabeneck L, Guttmann A. Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data. J Clin Epidemiol. 2011;64(8):821–9.
Khan NF, Harrison SE, Rose PW. Validity of diagnostic coding within the General Practice Research Database: a systematic review. Br J Gen Pract. 2010;60(572):e128–36.
McBrien KA, Souri S, Symonds NE, et al. Identification of validated case definitions for medical conditions used in primary care electronic medical record databases: a systematic review. J Am Med Inform Assoc. 2018;25(11):1567–78.
Koram N, Delgado M, Stark JH, Setoguchi S, de Luise C. Validation studies of claims data in the Asia-Pacific region: a comprehensive review. Pharmacoepidemiol Drug Saf. 2019;28(2):156–70.
Shibata H, Kato S, Sekine I, et al. Bone metastasis treatment guidelines. 2nd ed. Tokyo: Nankodo, Co. Ltd; 2015.
Coleman RE. Clinical features of metastatic bone disease and risk of skeletal morbidity. Clin Cancer Res. 2006;12(20 Pt 2):6243s–9s.
Coleman RE. Skeletal complications of malignancy. Cancer. 1997;80(8):1588–94.
Tsuzuki S, Park SH, Eber MR, Peters CM, Shiozawa Y. Skeletal complications in cancer patients with bone metastases. Int J Urol. 2016;23(10):825–32.
Saad F, Ivanescu C, Phung D, et al. Skeletal-related events significantly impact health-related quality of life in metastatic castration-resistant prostate cancer: data from PREVAIL and AFFIRM trials. Prostate Cancer Prostatic Dis. 2017;20(1):110–6.
Kunikane H, Yokota I, Katakami N, et al. Prospective analysis of the association between skeletal-related events and quality of life in patients with advanced lung cancer (CSP-HOR13). Oncol Lett. 2019;17(1):1320–6.
Katagiri H, Okada R, Takagi T, et al. New prognostic factors and scoring system for patients with skeletal metastasis. Cancer Med. 2014;3(5):1359–67.
Yong M, Jensen AÖ, Jacobsen JB, Nørgaard M, Fryzek JP, Sørensen HT. Survival in breast cancer patients with bone metastases and skeletal-related events: a population-based cohort study in Denmark (1999–2007). Breast Cancer Res Treat. 2011;129(2):495–503.
Choksi P, Papaleontiou M, Guo C, Worden F, Banerjee M, Haymart M. Skeletal complications and mortality in thyroid cancer: a population-based study. J Clin Endocrinol Metab. 2017;102(4):1254–60.
Delea T, McKiernan J, Brandman J, et al. Retrospective study of the effect of skeletal complications on total medical care costs in patients with bone metastases of breast cancer seen in typical clinical practice. J Support Oncol. 2006;4(7):341–7.
Delea TE, McKiernan J, Brandman J, et al. Impact of skeletal complications on total medical care costs among patients with bone metastases of lung cancer. J Thorac Oncol. 2006;1(6):571–6.
Hagiwara M, Delea TE, Chung K. Healthcare costs associated with skeletal-related events in breast cancer patients with bone metastases. J Med Econ. 2014;17(3):223–30.
Wen L, Valderrama A, Costantino ME, Simmons S. Real-world treatment patterns in patients with castrate-resistant prostate cancer and bone metastases. Am Health Drug Benefits. 2019;12(3):142–9.
Hong S, Youk T, Lee SJ, Kim KM, Vajdic CM. Bone metastasis and skeletal-related events in patients with solid cancer: a Korean nationwide health insurance database study. PLoS ONE. 2020;15(7): e0234927.
Sathiakumar N, Delzell E, Morrisey MA, et al. Mortality following bone metastasis and skeletal-related events among women with breast cancer: a population-based analysis of US Medicare beneficiaries, 1999–2006. Breast Cancer Res Treat. 2012;131(1):231–8.
Sathiakumar N, Delzell E, Morrisey MA, et al. Mortality following bone metastasis and skeletal-related events among men with prostate cancer: a population-based analysis of US Medicare beneficiaries, 1999–2006. Prostate Cancer Prostatic Dis. 2011;14(2):177–83.
Perrault L, Fradet V, Lauzon V, LeLorier J, Mitchell D, Habib M. Burden of illness of bone metastases in prostate cancer patients in Québec, Canada: a population-based analysis. Can Urol Assoc J. 2015;9(9–10):307–14.
Jensen AØ, Nørgaard M, Yong M, Fryzek JP, Sørensen HT. Validity of the recorded International Classification of Diseases, 10th edition diagnoses codes of bone metastases and skeletal-related events in breast and prostate cancer patients in the Danish National Registry of Patients. Clin Epidemiol. 2009;1:101–8.
Liede A, Hernandez RK, Roth M, Calkins G, Larrabee K, Nicacio L. Validation of International Classification of Diseases coding for bone metastases in electronic health records using technology-enabled abstraction. Clin Epidemiol. 2015;7:441–8.
Sathiakumar N, Delzell E, Yun H, et al. Accuracy of medicare claim-based algorithm to detect breast, prostate, or lung cancer bone metastases. Med Care. 2017;55(12):e144–9.
Dolan MT, Kim S, Shao YH, Lu-Yao GL. Authentication of algorithm to detect metastases in men with prostate cancer using ICD-9 codes. Epidemiol Res Int. 2012;2012: 970406.
Iwagami M, Aoki K, Akazawa M, et al. Taskforce report on the validation of diagnosis codes and other outcome definitions in the Japanese receipt data. Jpn J Pharmacoepidemiol. 2018;23(2):95–123.
Wilson EB. Probable inference, the law of succession, and statistical inference. J Am Stat Assoc. 1927;22(158):209–12.
Shima D, Ii Y, Higa S, et al. Validation of novel identification algorithms for major adverse cardiovascular events in a Japanese claims database. J Clin Hypertens (Greenwich). 2021;23(3):646–55.
Chubak J, Pocobelli G, Weiss NS. Tradeoffs between accuracy measures for electronic health care data algorithms. J Clin Epidemiol. 2012;65(3):343-349.e2.
Onukwugha E, Yong C, Hussain A, Seal B, Mullins CD. Concordance between administrative claims and registry data for identifying metastasis to the bone: an exploratory analysis in prostate cancer. BMC Med Res Methodol. 2014;14:1.
Acknowledgements
Medical writing support was provided by Clinical Study Support, Inc.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Funding
This study was conducted as part of a joint research course (Real-World Evidence and Data Assessment) between Juntendo University and Shin Nippon Biomedical Laboratories Ltd.
Conflict of interest
TH and RW are employees of Clinical Study Support, Inc. NS and RK have no conflicts of interest to report.
Data availability
The datasets generated and analyzed during the current study are available from the corresponding author upon reasonable request.
Ethics approval
The ethics committee of Juntendo University Hospital approved this study. This study was conducted in accordance with the provisions of the Declaration of Helsinki.
Consent to participate
Because this was a retrospective chart and claims data review, informed consent was not required according to the Japanese Ethical Guidelines for Medical and Health Research Involving Human Subjects, and thus was not obtained. However, information about the study, including the purpose and data use, was posted on the hospital’s website, ensuring that participants had the right to opt out.
Consent for publication
Not applicable.
Author contributions
TH and RW conceptualized this study and analyzed the data. NS and RK substantially contributed to the interpretation of the data. TH drafted the original manuscript, and NS, RW, and RK revised it critically for important intellectual content. All authors read and approved the final version. Further, they agreed to be accountable for all aspects of the work.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License, which permits any non-commercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc/4.0/.
About this article
Cite this article
Hirano, T., Saito, N., Wakabayashi, R. et al. Validation of Algorithms to Identify Bone Metastases Using Administrative Claims Data in a Japanese Hospital. Drugs - Real World Outcomes 10, 187–194 (2023). https://doi.org/10.1007/s40801-022-00347-x
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40801-022-00347-x