Determination of Relative Weightings for Sacroiliac Joint Pathologies in the OMERACT Juvenile Arthritis Magnetic Resonance Imaging Sacroiliac Joint Score.

2023

04/2023

2077-0383

This study aims to determine the relative weights (point value) of items of the juvenile idiopathic arthritis magnetic resonance imaging-sacroiliac joint scoring system (JAMRIS-SIJ). An adaptive multicriteria decision analysis was performed using the 1000Minds web application to determine the relative weights of the items in the JAMRIS-SIJ inflammation and damage domains. Experts in imaging and rheumatology independently completed a conjoint analysis survey (CAS) to determine the point value of the measurement items of the JAMRIS-SIJ. Each CAS survey question asked the expert to compare two hypothetical patient profiles, which were otherwise similar but different at two items at a time, and to select which item showed a more severe stage of inflammation or osteochondral damage. In addition, experts ranked 14 JAMRIS-SIJ grade only or image + grade patient vignettes while blinded to the CAS-derived weights. The validity of the weighted JAMRIS-SIJ was tested by comparing the expert CAS-weighted score and the image + grade ranking method. Seventeen experts completed the CAS (11 radiologists and 6 rheumatologists). Considering the point value for inflammation domain items, osteitis (24.7%) and bone marrow edema (24.3%) had higher group-averaged percentage weights compared to inflammation in erosion cavity (16.9%), joint space enhancement (13.1%), joint space fluid (9.1%), capsulitis (7.3%), and enthesitis (4.6%). Similarly, concerning the damage domain, ankylosis (41.3%) and erosion (25.1%) showed higher group-averaged weights compared to backfill (13.9%), sclerosis (10.7%), and fat metaplasia lesion (9.1%). The Spearman correlation coefficients of the CAS-weighted vignette order and unweighted JAMRIS-SIJ grade only order vignettes for all experts were 0.79 for inflammation and 0.80 for damage. The correlations of image vignettes among imaging experts to CAS were 0.75 for inflammation and 0.90 for damage. The multicriteria decision analysis identified differences in relative weights among the JAMRIS-SIJ measurement items. The determination of the relative weights provided expert-driven score scaling and face validity for the JAMRIS-SIJ, enabling the future evaluation of its longitudinal construct validity.

10.3390/jcm12072729

J Clin Med

37048812

Normal hip joint fluid volumes in healthy children of different ages, based on MRI volumetric quantitative measurement.

2020

2020 Jun 29

1432-1998

<p><strong>BACKGROUND: </strong>While magnetic resonance imaging (MRI) of the pelvis and hips is common in pediatric patients, to date there are no data on the quantification of normal hip joint fluid volume in this patient population.</p>

<p><strong>OBJECTIVE: </strong>We sought to assess the feasibility and reliability of quantitative hip joint fluid measurement in the pediatric population to estimate the normal volume of fluid in a pediatric hip joint.</p>

<p><strong>MATERIALS AND METHODS: </strong>Seventy healthy children ages 8-17&nbsp;years underwent a pelvic MRI including a large field of view coronal T2 fat-saturated sequence where hips were entirely imaged. Following 3 training sessions, 2 readers with experience in musculoskeletal imaging performed volumetric quantitative measurements of hip fluid (140 hips) using semiautomated pixel-based thresholding on custom MATLAB software.</p>

<p><strong>RESULTS: </strong>The mean processing time per hip was 2&nbsp;min, 41&nbsp;s. The mean volume of fluid in a hip joint was 2.1&nbsp;mL (range: 0.38-5.41&nbsp;mL), increasing slightly with age. Volumes were also greater in boys than in girls (P=0.004). Intra-observer and interobserver agreement were high (intra-class correlation coefficients 0.93 and 0.98, respectively), with mean volume differences of 0.04&nbsp;mL for intra-observer and 0.09&nbsp;mL for interobserver.</p>

<p><strong>CONCLUSION: </strong>A semiautomated pixel-based thresholding approach was feasible and reliable for measuring joint fluid in pediatric hip MRI. The average fluid volume of 2.1&nbsp;mL can represent a visually substantial quantity of fluid per MRI slice, particularly in small children, and should not be misinterpreted as a joint effusion.</p>

10.1007/s00247-020-04744-8

Pediatr Radiol

32601743

Variability in magnetic resonance imaging interpretation of the pediatric sacroiliac joint.

2020

2020 Apr 11

2151-4658

<p><strong>OBJECTIVE: </strong>Magnetic resonance imaging (MRI) is pivotal in the assessment of early sacroiliitis in children. We aimed to evaluate the agreement between local radiology reports and central imaging reviewers for active inflammation and structural damage at the sacroiliac joints (SIJs).</p>

<p><strong>METHODS: </strong>Eight hospitals each contributed up to 20 cases of consecutively imaged children and adolescents with juvenile idiopathic arthritis and suspected sacroiliitis. Studies were independently reviewed by 3 experienced musculoskeletal pediatric radiologists. Local assessments of global impression and lesions were coded from the local radiology reports by two study team members. Test properties of local reports were calculated using the central imaging team's majority as the reference standard.</p>

<p><strong>RESULTS: </strong>For 120 evaluable subjects, median age was 14 years, half of cases were male, and median disease duration at time of imaging was 0.8 years (IQR: 0-2). Sensitivity, 93.5% (95% CI: 78.6-99.2%), and specificity, 69.7% (95% CI: 59.0-79.0%), of local reports for inflammation were high and moderate, respectively, but positive predictive value (PPV) was low 51.8% (95% CI: 38.0-65.3%). Twenty-seven (23%) cases had active inflammation reported locally but rated normal centrally, nineteen (70%) with subsequent medication changes. Sensitivity of local reports detecting structural damage was low, 45.7% (95% CI: 28.8-63.4%), and specificity, 88.2% (95% CI: 79.4-94.2%), was high; PPV was low 61.5% (95% CI: 40.6-79.8%).</p>

<p><strong>CONCLUSION: </strong>Substantial variation exists in the interpretation of inflammatory and structural lesions at the SIJs in children. In order to reliably identify pathology, additional training in the MR appearance of the maturing SIJ is greatly needed.</p>

10.1002/acr.24206

Arthritis Care Res (Hoboken)

32277735

Spondyloarthritis Research Consortium of Canada sacroiliac joint inflammation and structural scores: change score reliability and recalibration utility in children.

2020

58

2020 Mar 24

1478-6362

<p><strong>BACKGROUND: </strong>The SPARCC sacroiliac joint inflammation (SIS) and structural (SSS) scores are reliable measures to quantify abnormalities in the pediatric sacroiliac joint. We aimed to evaluate the utility of online calibration modules for the SIS and SSS and the reliability of their component change scores.</p>

<p><strong>METHODS: </strong>Change score reliability of 6 raters was assessed by overall and pairwise intraclass correlation coefficients (ICCs) before and after the use of real-time iterative calibration (RETIC) modules for both the SIS and SSS comprised of 20 adult cases. Acceptable ICC for change scores was &gt; 0.7 for SIS and &gt; 0.5 for all SSS components. Sensitivity to change was assessed by the standardized response mean (SRM).</p>

<p><strong>RESULTS: </strong>In scoring exercise 1, the SIS had acceptable reliability with a change score ICC of 0.80 and sclerosis was the only SSS lesion that met the acceptability threshold with a change score ICC of 0.52. After RETIC calibration, the SIS overall (ICC = 0.83) and mean pairwise (ICC = 0.83) change scores remained reliable with a large SRM (0.90). All SSS components except sclerosis met the overall and mean pairwise change score ICC acceptability thresholds-backfill: overall = 0.54, mean pairwise = 0.50; fat metaplasia: overall = 0.65, mean pairwise = 0.57; erosion: overall = 0.60, mean pairwise = 0.58; and ankylosis: overall = 0.96, mean pairwise = 0.96. The SSS RETIC module augmented the number of SSS components surpassing the acceptability threshold from 1 to 4. Sensitivity to change, as measured by the SRM, was large for erosion (0.96), moderate for backfill (0.55) and sclerosis (0.70), and small for fat metaplasia (0.36) and ankylosis (0.28).</p>

<p><strong>CONCLUSION: </strong>RETIC modules improved the overall reliability of SPARCC SIS and SSS change scores for previously calibrated raters. SIS recalibration was not as helpful to the most experienced raters who achieved high levels of agreement before recalibration. The SPARCC SIS and all SSS components except sclerosis are reliable measures to quantify change over time in children. A pediatric-specific RETIC tool should be developed to enhance the calibration of readers.</p>

10.1186/s13075-020-02157-4

Arthritis Res. Ther.

32209120

Radiographs in screening for sacroiliitis in children: what is the value?

2018

141

2018 Jul 11

1478-6362

<p><strong>BACKGROUND: </strong>We aimed to evaluate the diagnostic utility of pelvic radiographs versus magnetic resonance imaging (MRI) of the sacroiliac joints in children with suspected sacroiliitis.</p>

<p><strong>METHODS: </strong>This was a retrospective cross-sectional study of children with suspected or confirmed spondyloarthritis who underwent pelvic radiograph and MRI within 6 months of one another. Images were scored independently by five raters. Interrater reliability was calculated using Fleiss's kappa coefficient (κ). Test properties of radiographs for depiction of sacroiliitis were calculated using MRI global sacroiliitis impression as the reference standard.</p>

<p><strong>RESULTS: </strong>The interrater agreement for global impression was κ = 0.34 (95% CI 0.19-0.52) for radiographs and κ = 0.72 (95% CI 0.52-0.86) for MRI. Across raters, the sensitivity of radiographs ranged from 25 to 77.8% and specificity ranged from 60.8 to 92.2%. Positive and negative predictive values ranged from 25.9 to 52% and from 82.7 to 93.9%, respectively. The misclassification rate ranged from 6 to 17% for negative radiographs/positive MRI scans and from 48 to 74% for positive radiographs/negative MRI scans. When the reference standard was changed to structural lesions consistent with sacroiliitis on MRI, the misclassification rate was higher for negative radiographs/positive MRI scans (9-23%) and marginally improved for positive radiographs/negative MRI scans (33-52%).</p>

<p><strong>CONCLUSION: </strong>Interrater reliability of MRI was superior to radiographs for global sacroiliitis impression. Misclassification for both negative and positive radiographs was high across raters. Radiographs have limited utility in screening for sacroiliitis in children and result in a significant proportion of both false negative and positive findings versus MRI findings.</p>

10.1186/s13075-018-1642-8

Arthritis Res. Ther.

29996925

Feasibility and Reliability of the Spondyloarthritis Research Consortium of Canada Sacroiliac Joint Structural Score in Children.

2018

2018 Jun 15

0315-162X

<p><strong>OBJECTIVE: </strong>There is a critical need for measures to evaluate structural progression in the pediatric sacroiliac joint (SIJ). We aimed to evaluate the construct validity and reliability of the Spondyloarthritis Research Consortium of Canada SIJ Structural Score (SSS) in children with suspected or confirmed juvenile spondyloarthritis.</p>

<p><strong>METHODS: </strong>The SSS assesses structural lesions of the SIJ on magnetic resonance imaging (MRI) through the cartilaginous part of the joint. We conducted 3 sequential reading exercises with 6 readers (1 adult and 3 pediatric radiologists, 1 adult and 1 pediatric rheumatologist). Each exercise was preceded by a calibration module. Interobserver reliability was assessed using intraclass correlation coefficients (ICC). Prespecified acceptable reliability thresholds were ICC &gt; 0.5 for erosion, backfill, and sclerosis, and ICC &gt; 0.7 for ankylosis and fat metaplasia.</p>

<p><strong>RESULTS: </strong>The SSS had face validity and was feasible to score in pediatric cases for all 3 reading exercises. Of the cases used in the 3 exercises, 58% were male and the median age was 14 years (range 6.8-18.7 yrs). After calibration, median ICC across all readers for each SSS component were the following: erosion 0.67 (interquartile range 0.54-0.80), backfill 0.33 (0.19-0.52), fat metaplasia 0.74 (0.62-0.85), sclerosis 0.63 (0.48-0.77), and ankylosis 0.44 (0.28-0.62). Prespecified reliability thresholds were achieved in the third exercise for erosion, sclerosis, and fat metaplasia but not for backfill or ankylosis.</p>

<p><strong>CONCLUSION: </strong>The SSS was feasible to score and had acceptable reliability for pediatric SIJ MRI evaluation. The ICC improved with additional calibration and reading exercises, even for readers with limited experience.</p>

10.3899/jrheum.171329

J. Rheumatol.

29907669

Feasibility and reliability of the Spondyloarthritis Research Consortium of Canada sacroiliac joint inflammation score in children.

2018

56

2018 Mar 22

1478-6362

<p><strong>BACKGROUND: </strong>Published methods for quantification of magnetic resonance imaging (MRI) evidence of inflammation in the sacroiliac joint lack validation in pediatric populations. We evaluated the reliability and construct validity of the Spondyloarthritis Research Consortium of Canada (SPARCC) sacroiliac joint inflammation score (SIS) in children with suspected or confirmed juvenile spondyloarthritis (JSpA).</p>

<p><strong>METHODS: </strong>The SPARCC SIS measures the presence, depth, and intensity of bone marrow inflammation on MRI through the cartilaginous part of the joint. Six readers blinded to clinical details except age, participated in two reading exercises, each preceded by a calibration exercise. Inter-observer reliability was assessed using intraclass correlation coefficients (ICCs) and for pre-specified acceptable reliability the inraclass correlation coefficient (ICC) was &gt; 0.8.</p>

<p><strong>RESULTS: </strong>The SPARCC SIS had face validity and was feasible to score in pediatric cases in both reading exercises. Cases were mostly male (64%) and the median age at the time of imaging was 14.9 years. After calibration, the median ICC across all readers for the SIS total score was 0.81 (IQR 0.71-0.89). SPARCC SIS had weak correlation with disease activity (DA) as measured by the JSpADA (r = - 0.12) but discriminated significantly between those with and without elevated C-reactive protein (p = 0.03).</p>

<p><strong>CONCLUSION: </strong>The SPARCC SIS was feasible to score and had acceptable reliability in children. The ICC improved with additional calibration and reading exercises, for both experienced and inexperienced readers.</p>

10.1186/s13075-018-1543-x

29566735