Automatic 3D Cranial Landmark Positioning based on  Surface Curvature Feature using Machine Learning

Putu Hendra Suputra; Anggraini Dwi Sensusiati; Myrtati Dyah Artaria; Gijsbertus Jacob Verkerke; Eko Mulyanto Yuniarno; I Ketut Eddy Purnama

doi:10.17977/um018v5i12022p27-40

Automatic 3D Cranial Landmark Positioning based on Surface Curvature Feature using Machine Learning

Putu Hendra Suputra, Anggraini Dwi Sensusiati, Myrtati Dyah Artaria, Gijsbertus Jacob Verkerke, Eko Mulyanto Yuniarno, I Ketut Eddy Purnama

Abstract

Cranial anthropometric reference points (landmarks) play an important role in craniofacial reconstruction and identification. Knowledge to detect the position of landmarks is critical. This work aims to locate landmarks automatically. Landmarks positioning using Surface Curvature Feature (SCF) is inspired by conventional methods of finding landmarks based on morphometrical features. Each cranial landmark has a unique shape. With the appropriate 3D descriptors, the computer can draw associations between shapes and landmarks using machine learning. The challenge in classification and detection in three-dimensional space is to determine the model and data representation. Using three-dimensional raw data in machine learning is a serious volumetric issue. This work uses the Surface Curvature Feature as a three-dimensional descriptor. It extracts the local surface curvature shape into a projection sequential value (depth). A machine learning method is developed to determine the position of landmarks based on local surface shape characteristics. Classification is carried out from the top-n prediction probabilities for each landmark class, from a set of predictions, then filtered to get pinpoint accuracy. The landmark prediction points are hypothetically clustered in a particular area, so a cluster-based filter is appropriate to isolate them. The learning model successfully detected the landmarks, with the average distance between the prediction points and the ground truth being 0.0326 normalized units. The cluster-based filter is implemented to increase accuracy compared to the ground truth. Thus, SCF is suitable as a 3D descriptor of cranial landmarks.

Full Text:

PDF

References

P. T. Jayaprakash, “Conceptual transitions in methods of skull-photo superimposition that impact the reliability of identification: A review,” Forensic Sci. Int., vol. 246, pp. 110–121, 2015.

M. A. Lenza, A. A. De Carvalho, E. B. Lenza, M. G. Lenza, H. M. De Torres, and J. B. De Souza, “Radiographic evaluation of orthodontic treatment by means of four different cephalometric superimposition methods,” Dental Press J. Orthod., vol. 20, no. 3, pp. 29–36, 2015.

C. C. Snow, B. P. Gatliff, and K. R. McWilliams, “Reconstruction of facial features from the skull: An evaluation of its usefulness in forensic anthropology,” Am. J. Phys. Anthropol., vol. 33, no. 2, pp. 221–227, 1970.

H. Ullrich and C. N. Stephan, “Mikhail Mikhaylovich Gerasimov's Authentic Approach To Plastic Facial Recpnstruction,” Anthropologie, vol. LIV/2, no. October 2014, pp. 97–107, 2016.

P. Claes, D. Vandermeulen, S. De Greef, G. Willems, J. G. Clement, and P. Suetens, “Computerized craniofacial reconstruction: Conceptual framework and review,” Forensic Sci. Int., vol. 201, no. 1–3, pp. 138–145, 2010.

P. H. Suputra, A. D. Sensusiati, E. M. Yuniarno, M. H. Purnomo, and I. K. E. Purnama, “3D Laplacian Surface Deformation for Template Fitting on Craniofacial Reconstruction,” in ICCCM’20: Proceedings of the 8th International Conference on Computer and Communications Management, 2020, pp. 27–32.

M. de Buhan and C. Nardoni, “A facial reconstruction method based on new mesh deformation techniques,” Forensic Sci. Res., vol. 3, no. 3, pp. 256–273, 2018.

T. Gietzen et al., “A method for automatic forensic facial reconstruction based on dense statistics of soft tissue thickness,” PLoS One, vol. 14, no. 1, pp. 1–19, 2019.

P. Guyomarc’h, F. Santos, B. Dutailly, P. Desbarats, C. Bou, and H. Coqueugniot, “Three-dimensional computer-assisted craniometrics: A comparison of the uncertainty in measurement induced by surface reconstruction performed by two computer programs,” Forensic Sci. Int., vol. 219, no. 1–3, pp. 221–227, 2012.

L. Jiang, J. Zhang, B. Deng, H. Li, and L. Liu, “3D Face Reconstruction with Geometry Details from a Single Image,” IEEE Trans. Image Process., vol. 27, no. 10, pp. 4756–4770, 2018.

A. Lodha, M. Mehta, M. N. Patel, and S. K. Menon, “Facial soft tissue thickness database of Gujarati population for forensic craniofacial reconstruction,” Egypt. J. Forensic Sci., vol. 6, no. 2, pp. 126–134, 2016.

B. Rosario Campomanes-Álvarez et al., “Modeling Facial Soft Tissue Thickness for Automatic Skull-Face Overlay,” IEEE Trans. Inf. Forensics Secur., vol. 10, no. 10, pp. 2057–2070, 2015.

L. J. Short, B. Khambay, A. Ayoub, C. Erolin, C. Rynn, and C. Wilkinson, “Validation of a computer modelled forensic facial reconstruction technique using CT data from live subjects: a pilot study,” Forensic Sci. Int., vol. 237, pp. 147.e1-147.e8, 2014.

Y. Zhao et al., “Laplacian Musculoskeletal Deformation for Patient-Specific Simulation and Visualisation,” in 2013 17th International Conference on Information Visualisation, Jul. 2013, pp. 505–510.

E. Mulyanto Yuniarno, M. Hariadi, and M. Hery Purnomo, “Point cloud registration for a non-deformable object using surface curvature features,” J. Theor. Appl. Inf. Technol., vol. 51, no. 3, pp. 506–514, 2013.

H. Jacinto, S. Valette, and R. Prost, “Multi-atlas automatic positioning of anatomical landmarks,” J. Vis. Commun. Image Represent., vol. 50, no. November, pp. 167–177, 2018.

S. M. Lee, H. P. Kim, K. Jeon, S. H. Lee, and J. K. Seo, “Automatic 3D cephalometric annotation system using shadowed 2D image-based machine learning,” Phys. Med. Biol., vol. 64, no. 5, 2019.

C. Lindner, C. W. Wang, C. T. Huang, C. H. Li, S. W. Chang, and T. F. Cootes, “Fully Automatic System for Accurate Localisation and Analysis of Cephalometric Landmarks in Lateral Cephalograms,” Sci. Rep., vol. 6, no. August, pp. 1–10, 2016.

H. Kanaan and A. Behrad, “Three-dimensional shape recognition and classification using local features of model views and sparse representation of shape descriptors,” J. Inf. Process. Syst., vol. 16, no. 2, pp. 343–359, 2020.

S. H. Kang, K. Jeon, S. H. Kang, and S. H. Lee, “3D cephalometric landmark detection by multiple stage deep reinforcement learning,” Sci. Rep., vol. 11, no. 1, pp. 1–13, 2021.

N. Chowdhury et al., “Concurrent segmentation of the prostate on MRI and CT via linked statistical shape models for radiotherapy planning,” Med. Phys., vol. 39, no. 4, p. 2214, 2012.

M. Bayome, J. Hyun Park, and Y. A. Kook, “New three-dimensional cephalometric analyses among adults with a skeletal class I pattern and normal occlusion,” Korean J. Orthod., vol. 43, no. 2, pp. 62–73, 2013.

A. H. Ross, D. E. Slice, and S. E. Williams, “Geometric Morphometric Tools for the Classification of Human Skulls. Research Report,” pp. 1–59, 2010.

M. A. Ulinuha, E. M. Yuniarno, S. M. S. Nugroho, and M. Hariadi, “Outer contour extraction of skull from CT scan images,” IOP Conf. Ser. Mater. Sci. Eng., vol. 185, no. 1, 2017.

X. F. Han, J. S. Jin, M. J. Wang, W. Jiang, L. Gao, and L. Xiao, “A review of algorithms for filtering the 3D point cloud,” Signal Process. Image Commun., vol. 57, no. May, pp. 103–112, 2017.

DOI: http://dx.doi.org/10.17977/um018v5i12022p27-40