Help Privacy Policy Disclaimer
  Advanced SearchBrowse


  Tractography reproducibility challenge with empirical data (TraCED): The 2017 ISMRM diffusion study group challenge

Nath, V., Schilling, K. G., Parvathaneni, P., Huo, Y., Blaber, J. A., Hainline, A. E., et al. (2020). Tractography reproducibility challenge with empirical data (TraCED): The 2017 ISMRM diffusion study group challenge. Journal of Magnetic Resonance Imaging, 51(1), 234-249. doi:10.1002/jmri.26794.

Item is


show hide
Genre: Journal Article


show Files




Nath, Vishwesh1, Author
Schilling, Kurt G.1, Author
Parvathaneni, Prasanna1, Author
Huo, Yuankai1, Author
Blaber, Justin A.1, Author
Hainline, Allison E.1, Author
Barakovic, Muhamed1, Author
Romascano, David1, Author
Rafael‐Patino, Jonathan1, Author
Frigo, Matteo1, Author
Girard, Gabriel1, Author
Thiran, Jean‐Philippe1, Author
Daducci, Alessandro1, Author
Rowe, Matt1, Author
Rodrigues, Paulo1, Author
Prčkovska, Vesna1, Author
Aydogan, Dogu B.1, Author
Sun, Wei1, Author
Shi, Yonggang1, Author
Parker, William A.1, Author
Ould Ismail, Abdol A.1, AuthorVerma, Ragini1, AuthorCabeen, Ryan P.1, AuthorToga, Arthur W.1, AuthorNewton, Allen T.1, AuthorWasserthal, Jakob1, AuthorNeher, Peter1, AuthorMaier‐Hein, Klaus1, AuthorSavini, Giovanni1, AuthorPalesi, Fulvia1, AuthorKaden, Enrico1, AuthorWu, Ye1, AuthorHe, Jianzhong1, AuthorFeng, Yuanjing1, AuthorPaquette, Michael1, Author              Rheault, Francois1, AuthorSidhu, Jasmeen1, AuthorLebel, Catherine1, AuthorLeemans, Alexander1, AuthorDescoteaux, Maxime1, AuthorDyrby, Tim B.1, AuthorKang, Hakmook1, AuthorLandman, Bennett A.1, Author more..
1External Organizations, ou_persistent22              


Free keywords: Tractography; Reproducibility; In vivo; Challenge; DW‐MRI; HARDI
 Abstract: Background Fiber tracking with diffusion‐weighted MRI has become an essential tool for estimating in vivo brain white matter architecture. Fiber tracking results are sensitive to the choice of processing method and tracking criteria. Purpose To assess the variability for an algorithm in group studies reproducibility is of critical context. However, reproducibility does not assess the validity of the brain connections. Phantom studies provide concrete quantitative comparisons of methods relative to absolute ground truths, yet do no capture variabilities because of in vivo physiological factors. The ISMRM 2017 TraCED challenge was created to fulfill the gap. Study Type A systematic review of algorithms and tract reproducibility studies. Subjects Single healthy volunteers. Field Strength/Sequence 3.0T, two different scanners by the same manufacturer. The multishell acquisition included b‐values of 1000, 2000, and 3000 s/mm2 with 20, 45, and 64 diffusion gradient directions per shell, respectively. Assessment Nine international groups submitted 46 tractography algorithm entries each consisting 16 tracts per scan. The algorithms were assessed using intraclass correlation (ICC) and the Dice similarity measure. Statistical Tests Containment analysis was performed to assess if the submitted algorithms had containment within tracts of larger volume submissions. This also serves the purpose to detect if spurious submissions had been made. Results The top five submissions had high ICC and Dice >0.88. Reproducibility was high within the top five submissions when assessed across sessions or across scanners: 0.87–0.97. Containment analysis shows that the top five submissions are contained within larger volume submissions. From the total of 16 tracts as an outcome relatively the number of tracts with high, moderate, and low reproducibility were 8, 4, and 4. Data Conclusion The different methods clearly result in fundamentally different tract structures at the more conservative specificity choices. Data and challenge infrastructure remain available for continued analysis and provide a platform for comparison. Level of Evidence: 5


Language(s): eng - English
 Dates: 2019-01-072019-05-062019-06-092020-01
 Publication Status: Published in print
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Degree: -



Legal Case


Project information


Source 1

Title: Journal of Magnetic Resonance Imaging
Source Genre: Journal
Publ. Info: Chicago, IL : Society for Magnetic Resonance Imaging
Pages: - Volume / Issue: 51 (1) Sequence Number: - Start / End Page: 234 - 249 Identifier: ISSN: 1053-1807
CoNE: https://pure.mpg.de/cone/journals/resource/954925594512