Leaderboard (CAMUS - Test results)



(last and final update: January 2023)

You must refer to this citation for any use of the CAMUS database

  • S. Leclerc, E. Smistad, J. Pedrosa, A. Ostvik, et al.
    "Deep Learning for Segmentation using an Open Large-Scale Dataset in 2D Echocardiography" in IEEE Transactions on Medical Imaging, vol. 38, no. 9, pp. 2198-2210, Sept. 2019.

    doi: 10.1109/TMI.2019.2900516

Left ventricle - endocardium
Rank User Mean DICE ED Mean DICE ES Mean Hausdorff ED Mean Hausdorff ES Mean MAD ED Mean MAD ES
intra-observer variability 0.945 0.930 4.6 4.5 1.4 1.3
1 Hang-Jung Ling (NN-Unet) 0.952 0.935 4.3 4.2 1.3 1.3
2 Hongrong Wei (CLAS) 0.947 0.929 4.6 4.6 1.4 1.4
3 Christoforos Sfakianakis (GUDU) 0.946 0.929 4.7 4.7 1.4 1.4
4 Sarah Leclerc (U-Net) 0.936 0.912 5.3 5.5 1.7 1.7
5 Ozan Oktay (ACNN) 0.936 0.913 5.6 5.6 1.7 1.7
Rank User EF correlation EF MAE Volume ED correlation Volume ED MAE Volume ES correlation Volume ES MAE
intra-observer variability 0.896 4.7 0.978 6.5 0.981 4.5
1 Hang-Jung Ling (NN-Unet) 0.857 4.7 0.977 5.9 0.987 4.0
2 Christoforos Sfakianakis (GUDU) 0.897 4.0 0.977 6.7 0.981 4.6
3 Hongrong Wei (CLAS) 0.926 4.0 0.958 7.7 0.979 4.4
4 Sarah Leclerc (U-Net) 0.845 5.0 0.926 11.2 0.960 7.5
5 Ozan Oktay (ACNN) 0.807 5.5 0.928 9.7 0.954 6.9

Left ventricle - epicardium
Rank User Mean DICE ED Mean DICE ES Mean Hausdorff ED Mean Hausdorff ES Mean MAD ED Mean MAD ES
intra-observer variability 0.957 0.951 5.0 5.0 1.7 1.7
1 Hang-Jung Ling (NN-Unet) 0.963 0.959 4.6 4.4 1.5 1.5
2 Hongrong Wei (CLAS) 0.961 0.955 4.8 4.9 1.5 1.6
2 Christoforos Sfakianakis (GUDU) 0.960 0.955 4.8 4.9 1.6 1.6
3 Sarah Leclerc (U-Net) 0.956 0.946 5.2 5.7 1.7 1.9
4 Ozan Oktay (ACNN) 0.953 0.945 5.9 5.9 1.9 2.0

Left atrium
Rank User Mean DICE ED Mean DICE ES Mean Hausdorff ED Mean Hausdorff ES Mean MAD ED Mean MAD ES
1 Hang-Jung Ling (NN-Unet) 0.902 0.935 5.1 4.3 2.0 1.6
2 Hongrong Wei (CLAS) 0.902 0.927 5.2 4.8 1.9 1.8
3 Christoforos Sfakianakis (GUDU) 0.894 0.926 5.4 5.0 2.3 1.9
4 Sarah Leclerc (U-Net) 0.889 0.918 5.7 5.3 2.2 2.0
5 Ozan Oktay (ACNN) 0.881 0.911 6.0 5.8 2.3 2.2