Abstract
This study aimed to determine the retest variability of quantitative fundus autofluorescence (QAF) in patients with and without age-related macular degeneration (AMD) and evaluate the predictive value of patient reliability indices on retest reliability. A total of 132 eyes from 68 patients were examined, including healthy individuals and those with various stages of AMD. Duplicate QAF imaging was conducted at baseline and 2 weeks later across six study sites. Intraclass correlation (ICC) analysis was used to evaluate the consistency of imaging, and mean opinion scores (MOS) of image quality were generated by two researchers. The contribution of MOS and other factors to retest variation was assessed using mixed-effect linear models. Additionally, a Random Forest Regressor was trained to evaluate the extent to which manual image grading of image quality could be replaced by automated assessment (inferred MOS). The results showed that ICC values were high for all QAF images, with slightly lower values in AMD-affected eyes. The average inter-day ICC was found to be 0.77 for QAF segments within the QAF8 ring and 0.74 for peripheral segments. Image quality was predicted with a mean absolute error of 0.27 on a 5-point scale, and of all evaluated reliability indices, MOS/inferred MOS proved most important. The findings suggest that QAF allows for reliable testing of autofluorescence levels at the posterior pole in patients with AMD in a multicenter, multioperator setting. Patient reliability indices could serve as eligibility criteria for clinical trials, helping identify patients with adequate retest reliability.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Introduction
Age-related macular degeneration (AMD) is the leading cause of severe visual impairment in high-income countries1. To this day, there is only limited understanding of the pathogenesis of AMD and therapies for early and intermediate stages of AMD are missing2 though both late stages (neovascular and atrophic AMD) have treatment options now.
The retinal pigment epithelium (RPE) plays a key role in the pathogenesis of AMD and various other retinal diseases. RPE health and disease can be clinically assessed by fundus autofluorescence imaging (FAF)3,4 since RPE cells accumulate intracellular granules with intrinsic fluorophores. While frequency and distribution of these granules undergo age and disease related changes, specifically in AMD, these subcellular changes can be clinically visualized via FAF. Through technological advancement, it is now possible to quantify and compare FAF levels between patients, study sites and patient visits5. This is achieved in quantitative autofluorescence imaging (QAF) through incorporating a scaling bar6 in the imaging device.
The MACUSTAR study is a European Union funded project that aims to develop and validate clinical endpoints for studies in intermediate AMD (iAMD) that can be used to demonstrate effectiveness of therapeutic approaches7,8. The MACUSTAR study focuses on the iAMD stage. Age-related and AMD-related changes at the posterior pole are is divided into different stages based on pathologic changes at the posterior pole and classified using clinical fundus imaging [stages: no, early, intermediate, and late (geographic atrophy/neovascular) AMD]. The iAMD stage is of particular importance as patients often remain many years in this disease stage with only mild visual impairment. Therefore, it would be highly desirable to develop novel therapeutics that intervene during this time. As such, QAF was included to the study protocol as it could potentially assess the effect of new therapies targeting the RPE. So far, studies using QAF have found reduced autofluorescence in AMD patients, and questioned the strategy of some therapeutic approaches including visual cycle modulators9,10,11. These findings suggest that maintaining AF levels could be indicative of maintenance of RPE health and even halting AMD progression. To reliably extract such information from QAF studies, the reliability of QAF measurements needs to be further defined.
To this day, there is only limited information on the retest reliability of serial QAF images12,13,14. First, the retest reliability of QAF has only been determined for the middle Delori ring (QAF 8) and information of QAF for the whole macular region remains to be investigated15. Second, retest reliability of QAF to date is limited on small AMD patient cohorts and not all disease stages of AMD have been investigated13. Third, although a major advantage of QAF is the comparison between study sites and devices, to our knowledge, this has not been investigated in AMD. Lastly, the predictive value of “patient-reliability indices” with regard to the retest reliability in the setting of QAF is unknown. This includes the predictive value of global factors affecting all regions of the macula (e.g., disease stage, visual acuity) and local factors affecting the retest reliability of the central and peripheral macula (e.g., blur and reduced signal with increasing eccentricity due to insufficient zoom). For QAF to be applicable in clinical trials, it is mandatory to be able to identify patients with a good retest reliability.
Herein, we determined the retest reliability of QAF in individuals with and without AMD from the MACUSTAR cohort. These were assessed for all disease stages of AMD and over the whole macular area as a prerequisite for the clinical significance of QAF changes over time in interventional studies. Additionally, we investigated the predictive value of patient-reliability indices for forecasting retest reliability of patients in order to identify suitable candidates for clinical trials using QAF.
Results
Cohort
Eighty-one eyes from 46 patients with AMD (2 early AMD, 28 iAMD, 16 late AMD) and 39 eyes of 22 healthy controls from the MACUSTAR cohort were included in the analysis (Table 1). Number of images per site was (mean ± SD) 55.6 ± 68.3. Mean BCVA was logMAR 0.16 ± 0.36 for patients [− 0.04 ± 0.02 early AMD, 0.025 ± 0.10 iAMD, 0.80 ± 0.23 late AMD (both geographic atrophy and neovascular AMD)] and logMAR − 0.06 ± 0.1 for the subjects void of AMD relevant maculopathy.
Retest reliability of QAF
ICC of QAF8 (mean [95% confidence interval]) for all QAF images was 0.95 [0.93–0.96] for the intra-day and 0.79 [0.72–0.85] (Table 2), CoR as an alternate measure is reported in Table 3 for the inter-day analysis for all eyes (Fig. 1). For patients with late AMD, the ICC was slightly worse at 0.94 [0.90–0.97] for the intra-day and 0.64 [0.42–0.82] for the inter-day analysis. Excluding late AMD eyes yielded ICCs of 0.93 [0.91–0.95] (intra-day) and 0.84 [0.74–0.92] (inter-day). ICCs for all individual disease stages are reported in Table 2.
The average inter-day ICC across all 96 segments was 0.77 [0.70–0.84]. For segments within the QAF8 ring the ICC was higher with 0.77 [0.69–0.84] and lower in peripheral segments of the QAF 97 Grid 0.74 [0.65–0.81]. Including only one eye per patient into analysis did not change ICCs noticably (Table 4).
Patient reliability indices
Image quality was a major driver of retest variability. Therefore, we designed a MOS of image quality, used machine learning techniques to automate image quality grading (RFR-MOS), and evaluated the effect of image quality on retest reliability in linear mixed models (Fig. 2). MOS for QAF images was 4.48 ± 0.39 overall. MOS was significantly higher in healthy (MOS of 4.51 ± 0.36) than AMD affected eyes (MOS of 4.48 ± 0.38; Mann–Whitney U p = 0.004). The RFR-MOS performed with a mean absolute error (MAE) of 0.27 (Fig. 3). The effect of patient specific factors (age, disease status, lens status, MOS/RFR-MOS in two separate models) were evaluated with linear mixed models and are reported in Table 5. In both models, using MOS or RFR-MOS, image quality proved to be the most predictive factor for retest reliability.
Retest reliability of identified “eligible images”
As a model for clinical trial criteria, we chose a combination of patient reliability indices that (i) are easily and objectively determinable and (ii) offer valuable information about retest reliability. As such, we chose the following criteria: MOS of ≥ 4.5 and only included healthy, early- and iAMD participants (see paragraph patient reliability indices and Table 5). We further included only the QAF8 values as they proved to be most reliable in preceding analyses14. After applying the quality criteria, inter-day ICC improved from 0.79 to 0.84 [0.74–0.92]. We further provided the ICC for intra- and inter-day variability of QAF retest-reliability for alternate clinical trial criteria (Table 6) to ensure a good balance between data availability and retest-reliability requirements. For example, reducing the MOS to ≤ 3.5 with all other criteria constant, deteriorated the inter-day ICC to 0.8 [0.7–0.88].
Discussion
This study provides retest-reliability of QAF imaging values for same-day and 2-week follow up visits. QAF image quality, as assessed by either human graders or random forest regression, was most predictive of retest variability. These findings provide important insights into the reliability of reported QAF values and patient selection for studies including QAF imaging as an endpoint.
Retest reliability
Proper repeatability and reliability as well as consistent follow-up agreement are a prerequisite for investigating possible changes in QAF in longitudinal studies as they yield the best chance to detect a true effect/change. So far, reported retest reliability has varied heavily. In healthy eyes, retest has been reported as ± 6–± 11% for same day and ± 7% to ± 14% for inter-day variability6,15,16. In monocentric studies of retinal diseases, QAF retest reliability was reported slightly lower but nonetheless excellent: ± 10.3% in recessive Stargardt disease (same day)14, ± 7% in Best vitelliform macular dystrophy (same day), ± 18.1%–± 20.2% (inter-day) AMD17,18. First real-life multi-center results from an interventional study in Stargardt disease, however, showed a higher retest variability of ± 26.1% (same day) and ± 40.3% (inter-day)19, respectively. Possible reasons for this deviation are demanding imaging protocol and operator variability, among others20. The reported results are in line with our results of ± 10.0% (same day) and ± 18.9% (inter-day), respectively.
Our results confirm the notion that QAF is substantially more challenging in a multicenter study. We, therefore, also propose methods of patient selection and QAF measurement techniques in this study, to improve the reliability of measurements even in the absence of large sample sizes. Additionally, improved staff training may lead to improved results. Future studies should compare retest reliability in relation to imaging staff experience.
Reiter and colleagues13 also investigated differences in QAF values in healthy and AMD patients for the different rings of the Delori pattern, and found that the middle eight-segment ring achieved best reproducibility. Similarly, we investigated retest reliability for individual segments, and could corroborate that the segments related to the QAF8 were associated with better retest reliability than more peripheral segments. This should be taken into consideration in future studies analyzing QAF outside of the border of the Delori grid, and especially in the near-periphery. We suspect worse retest reliability in the border-zone of the QAF image due to shadowing effects of the eyelid and/or insufficient zoom during image acquisition.
Predicted image quality
To our knowledge, this is the first study analyzing the effects of image quality on QAF measurements and retest reliability. In other imaging modalities (e.g., OCT or OCT angiography), image quality assessment is already routinely used in clinical studies21,22,23. Most metrics for image quality assessment in image processing applications rely on a sensitivity-based framework (e.g., peak signal-to-noise ratio)24,25,26. However, the downside in such an approach is that pathology is falsely classified as deteriorated image quality. For example, a peak signal-to-noise ratio will differ strongly if the RPE is missing like is the case in geographic atrophy (peak signal vanished). We, therefore, aimed on developing an objective image quality metric that correlates with perceived quality measurement. Our RF-MOS was trained on a human-based opinion score and strongly correlates with perceived image quality. Replacing manual image grading by an automated assessment would nonetheless have several advantages, apart from saving time: image quality assessment would become less prone to human error, and more reproducible (and thus comparable between studies)27.
Table 6 can assist investigators in selecting cut-off values for image-quality while accounting for disease status, study design and the QAF Grid utilized. Through automated image quality assessment, the expected ICC´s will match the results of this study to a higher degree than would be feasible through human grading.
Patient reliability indices
Patient reliability indices have a long-standing history in ophthalmology and originally stem from glaucoma25,26. In glaucoma management, visual field assessment is extremely important but also dependent on patient’s performance. Here false-positive error, fixation loss and other indicators can determine the reliability of visual field testing in a patient28. In imaging, these indices are currently not being used routinely, but may be beneficial in more challenging modalities such as QAF. Our finding was that only image quality had a significant effect on retest reliability. Retest reliability between the different disease stages did not prove to be statistically different (albeit slightly lower values for late AMD were found)24,29,30,31,32. These results suggest that QAF is feasible in all AMD disease stages.
Given the limited number of patients outside of the iAMD group, these results have to be interpreted cautiously. Reiter and colleagues found a higher retest reliability in AMD patients (ICC 0.93 with retinal changes/ICC 0.96 without retinal changes)13 than in control participants. For interventional studies utilizing QAF, we propose criteria to ensure a high reliability of QAF imaging.
Limitations and strengths
Some reliability indices such as the skill level of the operator could not be evaluated. Furthermore, the dataset was skewed with a limited number of patients in the early and late AMD categories. Finally, additional information on the lens status (e.g., cataract score, QAF of the lens, lenticular nuclear density) could have added insight into the effect of the ageing lens on retest reliability33,34,35. The order of the imaging protocol and time of day was not mandatory; therefore, patient fatique during the imaging session might also affect QAF retest reliability. Finally, the inclusion of both eyes from one participant to determine the ICC values disregards the hierarchical structure of the data. We, therefore, further report ICC values including only a random of each participant in Table 4. However, strengths of this study include the multicenter design and having both duplicate same day and 2-week follow-up images in a large cohort of both AMD-affected and healthy participants that were well characterized with multimodal imaging. Furthermore, novel elements in this study are the use of patient reliability indices to identify patient cohorts with good retest reliability as well as subjective and machine learning based image quality assessment.
Conclusions
In conclusion, QAF retest reliability for iAMD patients was good, higher for same day than different day repeats. Image quality, assessed by human or automated grading, is the major driver of retest variability. Based on our results we propose solutions for patient selection to augment retest reliability and pave the way for QAF inclusion in future interventional clinical trials.
Methods
In the prospective European MACUSTAR study, participants with iAMD and neighboring disease stages (early AMD, late AMD) as well as healthy controls were clinically evaluated with multimodal imaging and functional testing for a study period of 3 years8,36. For the current analysis, images from the cross-sectional arm of the MACUSTAR clinical study with available QAF images (6 study sites, 120 participants) were included. This study was conducted and analyzed in compliance with the Declaration of Helsinki and according to the standards of good clinical practice. This study was approved by the EMA, US FDA, and NICE, and participants signed written informed consent before study inclusion7. The study was further approved by the local ethic committees of the University Hospital Bonn ethics committee (384/17), Paris Ouest IV (04/18_2), AIBILI (032/2017/AIBILI/CE), Nova Medical School (13507/2017), London Queen Square Research Ethics Committee (18/LO/0145), Center for Sundhed Glostrup (H-18000126), Comitato Etico Milano (37910/2018), Ospedale San Raffaele (dated 25/10/2018), Radboudumc technology center (2017-3954) and LUMC commissie medische ethiek (L18.055/SH/sh).
Inclusion and exclusion criteria of the MACUSTAR study have been reported elsewhere7. Briefly, subjects aged 55–85 at baseline, AMD (with the largest cohort being iAMD) or healthy eyes and the absence of other eye disorders were included36. iAMD was defined as bilateral large drusen and/or pigment abnormalities or extrafoveal geographic atrophy in the partner eye (for a full list of AMD disease stage criteria see Table 1 in Terheyden et al.36). Additional exclusion criteria from the MACUSTAR requirements for the current study were the non-availability of QAF images at baseline and 2-week follow up visit, insufficient image quality (see assessment below) for image analyses, and a high degree of lens opacification. Certified staff at the individual study sites acquired all multimodal images (including but not limited to color/multicolor fundus photography, optical coherence tomography OCT, green FAF, blue FAF) as well as QAF images. Retinal imaging including QAF imaging was performed by certified technicians and on certified equipment. Retinal imaging was assessed after administration of mydriatic eye drops (e.g., 2.5% phenylephrine, 0.5% tropicamide). The order of image acquisition and specific time of day was not mandatory but guidelines were provided to the study sites. From the MACUSTAR assessment of functional endpoints (including but not limited to fundus controlled perimetry, low luminance acuity, Moorefield’s acuity test, dark adaptation contrast sensitivity and performance based tests) only the best corrected visual acuity was used in this study. Best-corrected visual acuity was assessed by certified personnel using standard ETDRS charts and converted to logMAR for analysis7.
Image analysis
QAF images were provided by the central reading center of the MACUSTAR study (GRADE Reading Center, Bonn, Germany). As described previously, custom written FIJI plugins (“https://sites.imagej.net/CreativeComputation/”) were used for QAF analysis12. Briefly, using landmark correspondences (e.g., vessel bifurcations), images were registered to SD-OCT images to ensure aligned QAF measurements (equal rotation and uniform scaling). Next, for QAF analysis grid positioning, the foveola (maximal foveal depression and rise of external limiting membrane) and the closest edge of the optic nerve head were marked in corresponding OCT scans.
QAF images were then post-processed and adjusted for the device-specific reference calibration factor as provided by the manufacturer, as well as subject's age. Finally, QAF images were converted to colored 8-bit images, with QAF values limited to 0–511 [QAF a.u.]. The QAF97 grid used bisects each original QAF ring segment (and results used for the eccentricity analysis), resulting in a total of 97 segments6 (Supplemental Figs. 1 and 2). Further, the QAF 8 (mean of middle Delori ring) was used and reported as this was the most common outcome measure in other QAF studies6. For each segment, the mean, maximum and minimum QAF values, standard deviation of QAF values, and the number of pixels of the analyzed area were exported.
To further analyze the effect of QAF image quality on retest reliability, opinion scores of QAF images were gathered. Opinion scores of QAF image quality (focus, illumination, symmetry, zoom, centering) were compiled by two trained medical readers (LvdE, MM) and averaged to yield mean opinion scores (MOS). Grading was performed masked to each other. Images were graded on a semi-qualitative scale between 0 and 5 and the mean of all criteria was computed.
Statistical analysis
Statistical analyses were performed in Python (notably using the scikit-learn37 and Pingouin38 packages) and R using the lmerTest39 and MuMin40 packages. To quantify retest variability, the Intraclass Correlation Coefficient (ICC) as defined by Shrout and Fleiss20, and the repeatability coefficient (RC), computed as outlined by Bland and Altman41 via intra-subject standard deviations, were used.
ICCs were evaluated between duplicate images at one visit (intra-day) and between images at baseline and 2-week follow up (inter-day), for all four images separately.
Visual acuity was converted to the logarithm of the Minimum Angle of Resolution (logMAR). To consider the association between MOS and retest variability, we utilized linear mixed-effect models to account for intra-subject correlation, with nested random effects for study site and patient. Age, lens status and disease stage were included as categorical fixed effects.
For MOS prediction, we used a Random Forest Regressor (RFR), as implemented by scikit-learn, with 200 estimators, no bootstrapping, and otherwise the default hyperparameters42. As predictors, the lens status, age at baseline, and each segment value of the QAF 96 grid was used. These validation MOS predictions were then used to repeat the mixed-effect model analysis with RFR-MOS in place of the true MOS.
Data availability
The datasets used and/or analyzed during the current study available from the corresponding author on reasonable request.
References
Lim, L. S., Mitchell, P., Seddon, J. M., Holz, F. G. & Wong, T. Y. Age-related macular degeneration. Lancet 379, 1728–1738 (2012).
Holz, F. G. et al. Multi-country real-life experience of anti-vascular endothelial growth factor therapy for wet age-related macular degeneration. Br. J. Ophthalmol. 99, 220–226 (2015).
Bermond, K. et al. Autofluorescent organelles within the retinal pigment epithelium in human donor eyes with and without age-related macular degeneration. Investig. Ophthalmol. Vis. Sci. 63, 23 (2022).
Schmitz-Valckenberg, S. et al. Fundus autofluorescence imaging. Prog. Retin. Eye Res. 81, 100893 (2021).
Sparrow, J. R., Duncker, T., Schuerch, K., Paavo, M. & de Carvalho, J. R. L. Lessons learned from quantitative fundus autofluorescence. Prog. Retin. Eye Res. 74, 100774 (2020).
Greenberg, J. P. et al. Quantitative fundus autofluorescence in healthy eyes. Investig. Ophthalmol. Vis. Sci. 54, 5684–5693 (2013).
Terheyden, J. H. et al. Clinical study protocol for a low-interventional study in intermediate age-related macular degeneration developing novel clinical endpoints for interventional clinical trials with a regulatory and patient access intention—MACUSTAR. Trials 21, 659 (2020).
Finger, R. P. et al. MACUSTAR: Development and clinical validation of functional, structural, and patient-reported endpoints in intermediate age-related macular degeneration. Ophthalmologica 241, 61–72 (2019).
von der Emde, L. et al. Natural history of quantitative autofluorescence in intermediate age-related macular degeneration. Retina 41, 694–700 (2021).
Reiter, G. S. et al. Longitudinal changes in quantitative autofluorescence during progression from intermediate to late age-related macular degeneration. RETINA 41, 1236–1241 (2021).
Gliem, M. et al. Quantitative fundus autofluorescence in early and intermediate age-related macular degeneration. JAMA Ophthalmol. 134, 817–824 (2016).
Kleefeldt, N. et al. Quantitative fundus autofluorescence: Advanced analysis tools. Transl. Vis. Sci. Technol. 9, 2 (2020).
Reiter, G. S. et al. Repeatability and reliability of quantitative fundus autofluorescence imaging in patients with early and intermediate age-related macular degeneration. Acta Ophthalmol. 97, e526–e532 (2019).
Dhooge, P. P. A. et al. Repeatability of quantitative autofluorescence imaging in a multicenter study involving patients with recessive Stargardt disease 1. Transl. Vis. Sci. Technol. 12, 1 (2023).
Delori, F. et al. Quantitative measurements of autofluorescence with the scanning laser ophthalmoscope. Investig. Ophthalmol. Vis. Sci. 52, 9379–9390 (2011).
Müller, P. L. et al. Monoallelic ABCA4 mutations appear insufficient to cause retinopathy: A quantitative autofluorescence study. Investig. Ophthalmol. Vis. Sci. 56, 8179–8186 (2015).
Burke, T. R. et al. Quantitative Fundus Autofluorescence in Recessive Stargardt Disease (2014)https://doi.org/10.1167/iovs.13-13624
Duncker, T. et al. Quantitative fundus autofluorescence and optical coherence tomography in best vitelliform macular dystrophy. Investig. Ophthalmol. Vis. Sci. 55, 1471–1482 (2014).
Pas, J. A. A. H. et al. Reliability of quantitative autofluorescence imaging in a multicenter study involving patients with Stargardt disease. Investig. Ophthalmol. Vis. Sci. 63, 4098-F0062 (2022).
Fleiss, J. L. & Shrout, P. E. Intraclass correlations: Uses in assessing rater reliability. Psychol. Bull. 86, 420–420 (1979).
Lauermann, J. L. et al. Automated OCT angiography image quality assessment using a deep learning algorithm. Graefe’s Arch. Clin. Exp. Ophthalmol. 257, 1641–1648 (2019).
Czakó, C. et al. The effect of image quality on the reliability of OCT angiography measurements in patients with diabetes. Int. J. Retina Vitreous 5, 46 (2019).
Al-Sheikh, M., Ghasemi Falavarjani, K., Akil, H. & Sadda, S. R. Impact of image quality on OCT angiography based quantitative measurements. Int. J. Retina Vitreous 3, 13 (2017).
Jiang, G.-Y., Huang, D.-J., Wang, X. & Yu, M. Overview on image quality assessment methods. Dianzi Yu Xinxi Xuebao J. Electron. Inf. Technol. 2010, 219–226 (2010).
Wang, Z. & Bovik, A. Reduced- and no-reference image quality assessment. IEEE Signal Process. Mag. 28, 29–40 (2011).
Wang, Z., Bovik, A. C. & Lu, L. Why is image quality assessment so difficult? In 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing Vol. 4 IV-3313-IV–3316 (2002).
Kim, J. & Lee, S. Deep learning of human visual sensitivity in image quality assessment framework. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 1676–1684 (2017).
Bengtsson, B. Reliability of computerized perimetric threshold tests as assessed by reliability indices and threshold reproducibility in patients with suspect and manifest glaucoma. Acta Ophthalmol. Scand. 78, 519–522 (2000).
von der Emde, L. et al. Mesopic and dark-adapted two-color fundus-controlled perimetry in choroidal neovascularization secondary to age-related macular degeneration. Transl. Vis. Sci. Technol. 8, 7 (2019).
Bickler-Bluth, M., Trick, G. L., Kolker, A. E. & Cooper, D. G. Assessing the utility of reliability indices for automated visual fields: Testing ocular hypertensives. Ophthalmology 96, 616–619 (1989).
Katz, J. & Sommer, A. Reliability indexes of automated perimetric tests. Arch. Ophthalmol. 106, 1252–1254 (1988).
Birt, C. M. et al. Analysis of reliability indices from Humphrey visual field tests in an urban glaucoma population. Ophthalmology 104, 1126–1130 (1997).
Magalhães, F. P., Costa, E. F., Cariello, A. J., Rodrigues, E. B. & Hofling-Lima, A. L. Comparative analysis of the nuclear lens opalescence by the Lens Opacities Classification System III with nuclear density values provided by Oculus Pentacam: A cross-section study using Pentacam Nucleus Staging software. Arq. Bras. Oftalmol. 74, 110–113 (2011).
Reiter, G. S. et al. Influence of lens opacities and cataract severity on quantitative fundus autofluorescence as a secondary outcome of a randomized clinical trial. Sci. Rep. 11, 12685 (2021).
Charng, J. et al. Imaging lenticular autofluorescence in older subjects. Investig. Ophthalmol. Vis. Sci. 58, 4940–4947 (2017).
Saßmannshausen, M. et al. Intersession repeatability of structural biomarkers in early and intermediate age-related macular degeneration: A MACUSTAR study report. Transl. Vis. Sci. Technol. 11, 27 (2022).
Pedregosa, F. et al. Scikit-learn: Machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011).
Vallat, R. Pingouin: Statistics in Python. J. Open Source Softw. 3, 1026 (2018).
Kuznetsova, A., Brockhoff, P. B. & Christensen, R. H. B. LmerTest package: Tests in linear mixed effects models. J. Stat. Softw. 82, 1–26 (2017).
Kamil Bartón. Package ‘MuMIn’. (2022).
Bland, J. M. & Altman, D. G. Measurement error. BMJ Br. Med. J. 312, 1654–1654 (1996).
Abraham, A. et al. Machine Learning for Neuroimaging with Scikit-learn (2014)https://doi.org/10.3389/fninf.2014.00014
Dislaimer
The communication reflects the author's view and neither IMI nor the European Union, EFPIA, or any Associated Partners are responsible for any use that may be made of the information contained therein.
Funding
Open Access funding enabled and organized by Projekt DEAL. This project has received funding from the Innovative Medicines Initiative 2 Joint Undertaking under grant agreement No. 116076. This Joint Undertaking receives support from the European Union’s Horizon 2020 research and innovation programme and EFPIA NIH/NEI R01EY027948 (TA).
Author information
Authors and Affiliations
Consortia
Contributions
L.v.d.E., S.S.V., R.P.F., F.G.H., T.A. designed the study L.v.d.E., M.M., J.H.T., K.R.S. conducted the measurements and imaging L.v.d.E., M.V., J.H. performed statistical analysis L.v.d.E., M.W., T.A. wrote the main manuscript text. All authors reviewed the manuscript.
Corresponding author
Ethics declarations
Competing interests
LvdE: Heidelberg Engineering (R). MM, MV, JH: None. MS: Gerok Research Grant (BONFOR O-137.0030, Faculty of Medicine, University of Bonn, Bonn, Germany), Carl Zeiss MedicTec AG (F), CenterVue (F), Heidelberg Engineering (F). JHT: Heidelberg Engineering (F), Optos (F), Carl Zeiss Meditec (F), CenterVue (F), Novartis (R), Okko (R). KRS: MacRegen Inc (I). SSV: AlphaRET (C), Apellis (C, R), Bayer (F), Bioeq (C), Carl Zeiss MediTec (F), Heidelberg Engineering (F, R), Katairo (C), Kubota Vision (C), Novartis (C, F), Pixium (C), Perceive Therapeutics (C), Roche (C, F), SparingVision (C), STZ GRADE Reading Center (O). RPF: C Alimera, Apellis, Bayer, Böhringer-Ingelheim, Novartis, ODOS, Oxford Innovation, ProGenerika, Roche/Genentech; F Biogen, CentreVue (now Icare), Heidelberg Engineering, Zeiss Meditec. FGH: Acucela (C,F), Allergan (F), Apellis (C, F), Bayer (C, F), Boehringer-Ingelheim (C), Bioeq/Formycon (F,C), CenterVue (F), Ellex (F), Roche/Genentech (C,F), Geuder (C,F), Graybug (C), Gyroscope (C), Heidelberg Engineering (C,F), IvericBio (C, F), Kanghong (C,F), LinBioscience (C), NightStarX (F), Novartis (C,F), Optos (F), Oxurion (C), Pixium Vision (C,F), Oxurion (C), Stealth BioTherapeutics (C), Zeiss (F,C). TA: Roche (C), Novartis (C), Novartis (R), Apellis (C), Bayer (C).
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
von der Emde, L., Mallwitz, M., Vaisband, M. et al. Retest variability and patient reliability indices of quantitative fundus autofluorescence in age-related macular degeneration: a MACUSTAR study report. Sci Rep 13, 17417 (2023). https://doi.org/10.1038/s41598-023-43417-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-023-43417-y
- Springer Nature Limited