Individual Identification in Facial Appearance Biometrics Based on Macroscopical Comparison

doi:10.12116/j.issn.1004-5619.2020.200909

Abstract

Abstract:

Individual identification is one of the research hotspots in the practice of forensic science， and the judgment is usually built on the comparison of the unique biological characteristics of the individual， such as fingerprints， iris and DNA. With the dramatic increase in the number of cases related to video image investigations， there is an increasing need for the technology to identify individuals based on the macroscopic comparison of facial appearance biometrics. At present， with the introduction of computer three-dimensional （3D） modeling and 3D superimposition comparison technology， considerable progress has been made in individual identification methods based on macroscopic comparison of facial appearance biometrics. This paper reviews individual facial appearance biometric methods based on macroscopical comparison, comprehensively analyzes the advantages and limitations of different methods, and puts forward recommendations and prospects for subsequent research.

Key words: forensic medicine, individual identification, biometric recognition, macroscopical comparison, facial characteristics, review

CLC Number:

DF795.1

De-min HUO, Wei-wei MO, Fei-ming ZHAO, Zi-hao ZHOU, Meng DU, Ji-long ZHENG, Kai-jun MA. Individual Identification in Facial Appearance Biometrics Based on Macroscopical Comparison[J]. Journal of Forensic Medicine, 2022, 38(3): 308-313.

Figures/Tables 1

References 46

1	UZÜN I， DAREGENLI O， SIRIN G， et al. Identification procedures as a part of death investigation in Turkey[J]. Am J Forensic Med Pathol，2012，33（1）：1-3. doi：10.1097/PAF.0b013e3182243eae .
2	ROSSY Q， IOSET S， DESSIMOZ D， et al. Integrating forensic information in a crime intelligence database[J]. Forensic Sci Int，2013，230（1/2/3）：137-146. doi：10.1016/j.forsciint.2012.10.010 .
3	CAPLOVA Z， OBERTOVA Z， GIBELLI D M， et al. Personal identification of deceased persons： An overview of the current methods based on physical appearance[J]. J Forensic Sci，2018，63（3）：662-671. doi：10.1111/1556-4029.13643 .
4	TAMIR A. Numerical survey of the different shapes of the human nose[J]. J Craniofacial Surg，2011，22（3）：1104-1107. doi：10.1097/SCS.0b013e3182108eb3 .
5	VANEZIS P， LU D， COCKBURN J， et al. Morphological classification of facial features in adult Caucasian males based on an assessment of photographs of 50 subjects[J]. J Forensic Sci，1996，41（5）：786-791.
6	BERTILLON A， MCCLAUGHRY R W. Signaletic instructions including the theory and practice of anthropometrical identification[M]. Chicago： Werner Company，1896.
7	RITZ-TIMME S， GABRIEL P， OBERTOVÀ Z， et al. A new atlas for the evaluation of facial features： Advantages， limits， and applicability[J]. Int J Leg Med，2011，125（2）：301-306. doi：10.1007/s00414-010-0446-4 .
8	HOULTON T M R， STEYN M. Finding Makhubu： A morphological forensic facial comparison[J]. Forensic Sci Int，2018，285：13-20. doi：10.1016/j.forsciint.2018.01.022 .
9	CAPLOVA Z， COMPASSI V， GIANCOLA S， et al. Recognition of children on age-different images： Facial morphology and age-stable features[J]. Sci Justice，2017，57（4）：250-256. doi：10.1016/j.scijus.2017.03.005 .
10	URBANOVÁ P. Performance of distance-based matching algorithms in 3D facial identification[J]. Egypt J Forensic Sci，2016，6（2）：135-151. doi：10.1016/j.ejfs.2016.04.004 .
11	LUCAS T， KUMARATILAKE J， HENNEBERG M. Metric identification of the same people from images： How reliable is it?[J]. J Anthropol，2016，2016：1-10. doi：10.1155/2016/1760313 .
12	NURHUDATIANA A， KONG A W K， CRAFT N， et al. Relatively permanent pigmented or vascular skin marks for identification： A pilot reliability study[J]. J Forensic Sci，2016，61（1）：52-58. doi：10.1111/1556-4029.12872 .
13	KULSHRESHTHA M， MONDAL P R. Acquired body marks： A mode of identification in forensics[J]. J Forensic Leg Med，2017，52：98-109. doi：10.1016/j.jflm.2017.08.012 .
14	CHAIKUNRAT J， PONGPANITANON P， PETJU M. Victim identification in the tsunami disaster in Thailand[J]. J Heal Sci，2011，20：897-902.
15	SOOMER H， RANTA H， PENTTILÄ A. Identification of victims from the M/S Estonia[J]. Int J Leg Med，2001，114（4/5）：259-262. doi：10.1007/s004140000180 .
16	王宁，苗春雨，吕金星. 正面照片面部特征指标用于个人识别的选择及评价[J].中国法医学杂志，2016，31（6）：570-573. doi：10.13618/j.issn.1001-5728.2016.06.009 .
	WANG N， MIAO C Y， LÜ J X. Selection and evaluation of facial characteristic indexes of frontal photo for personal identification[J]. Zhongguo Fayixue Zazhi，2016，31（6）：570-573.
17	TOME P， FIERREZ J， VERA-RODRIGUEZ R， et al. Identification using face regions： Application and assessment in forensic scenarios[J]. Forensic Sci Int，2013，233（1/2/3）：75-83. doi：10.1016/j.fors-ciint.2013.08.020 .
18	KLEINBERG K F， VANEZIS P， BURTON A M. Failure of anthropometry as a facial identification technique using high-quality photographs[J]. J Forensic Sci，2007，52（4）：779-783. doi：10.1111/j.1556-4029.2007.00458.x .
19	DAVIS J P， VALENTINE T， DAVIS R E. Computer assisted photo-anthropometric analyses of full-face and profile facial images[J]. Forensic Sci Int，2010，200（1/2/3）：165-176. doi：10.1016/j.forsciint. 2010.04.012 .
20	JAYAPRAKASH P T. Conceptual transitions in methods of skull-photo superimposition that impact the reliability of identification： A review[J]. Forensic Sci Int，2015，246：110-121. doi：10.1016/j.fors-ciint.2014.10.043 .
21	MORETON R， MORLEY J. Investigation into the use of photoanthropometry in facial image comparison[J]. Forensic Sci Int，2011，212（1/2/3）：231-237. doi：10.1016/j.forsciint.2011.06.023 .
22	HALBERSTEIN R A. The application of anthropometric indices in forensic photography： Three case studies[J]. J Forensic Sci，2001，46（6）：1438-1441.
23	GIBELLI D， OBERTOVÁ Z， RITZ-TIMME S， et al. The identification of living persons on images： A literature review[J]. Leg Med，2016，19：52-60. doi：10.1016/j.legalmed.2016.02.001 .
24	KIM S H， SHIN H S. Three-dimensional analysis of the correlation between soft tissue and bone of the lower face using three-dimensional facial laser scan[J]. J Craniofacial Surg，2018，29（8）：2048-2054. doi：10.1097/SCS.0000000000004781 .
25	CEINOS R， TARDIVO D， BERTRAND M F， et al. Inter- and intra-operator reliability of facial and dental measurements using 3D-stereophotogrammetry[J]. J Esthet Restor Dent，2016，28（3）：178-189. doi：10. 1111/jerd.12194 .
26	KOTTNER S， EBERT L C， AMPANOZI G， et al. VirtoScan -- A mobile， low-cost photogrammetry setup for fast post-mortem 3D full-body documentations in X-ray computed tomography and autopsy suites[J]. Forensic Sci Med Pathol，2017，13（1）：34-43. doi：10.1007/s12024-016-9837-2 .
27	CUMMAUDO M， GUERZONI M， MARASCIUOLO L， et al. Pitfalls at the root of facial assessment on photographs： A quantitative study of accuracy in positioning facial landmarks[J]. Int J Leg Med，2013，127（3）：699-706. doi：10.1007/s00414-013-0850-7 .
28	YOSHINO M， TANIGUCHI M， IMAIZUMI K， et al. A new retrieval system for a database of 3D facial images[J]. Forensic Sci Int，2005，148（2/3）：113-120. doi：10.1016/j.forsciint.2004.04.074 .
29	YOSHINO M， MATSUDA H， KUBOTA S， et al. Computer-assisted facial image identification system using a 3-D physiognomic range finder[J]. Forensic Sci Int，2000，109（3）：225-237. doi：10.1016/S0379-0738（00）00149-3 .
30	YOSHINO M， NOGUCHI K， ATSUCHI M， et al. Individual identification of disguised faces by morphometrical matching[J]. Forensic Sci Int，2002，127（1/2）：97-103. doi：10.1016/S0379-0738（02）00115-9 .
31	FRASER N L， YOSHINO M， IMAIZUMI K， et al. A Japanese computer-assisted facial identification system successfully identifies non-Japanese faces[J]. Forensic Sci Int，2003，135（2）：122-128. doi：10.1016/S0379-0738（03）00182-8 .
32	CATTANEO C， CANTATORE A， CIAFFI R， et al. Personal identification by the comparison of facial profiles： Testing the reliability of a high-resolution 3D-2D comparison model[J]. J Forensic Sci，2012，57（1）：182-187. doi：10.1111/j.1556-4029. 2011.01944.x .
33	ATSUCHI M， TSUJI A， USUMOTO Y， et al. Assessment of some problematic factors in facial image identification using a 2D/3D superimposition technique[J]. Leg Med，2013，15（5）：244-248. doi：10.1016/j.legalmed.2013.06.002 .
34	URBANOVÁ P， FERKOVÁ Z， JANDOVÁ M， et al. Introducing the FIDENTIS 3D face database[J]. Anthropol Rev，2018，81（2）：202-223. doi：10.2478/anre-2018-0016 .
35	MARTOS R， VALSECCHI A， IBÁÑEZ O， et al. Estimation of 2D to 3D dimensions and proportionality indices for facial examination[J]. Forensic Sci Int，2018，287：142-152. doi：10.1016/j.forsciint.2018.03.037 .
36	GIBELLI D， DE ANGELIS D， POPPA P， et al. A view to the future： A novel approach for 3D-3D superimposition and quantification of differences for identification from next-generation video surveillance systems[J]. J Forensic Sci，2017，62（2）：457-461. doi：10.1111/1556-4029.13290 .
37	GIBELLI D， PUCCIARELLI V， POPPA P， et al. 3D-3D facial superimposition between monozygotic twins： A novel morphological approach to the assessment of differences due to environmental factors[J]. Leg Med，2018，31：33-37. doi：10.1016/j.legalmed.2017. 12.011 .
38	GIBELLI D， PALAMENGHI A， POPPA P， et al. Improving 3D-3D facial registration methods： Potential role of three-dimensional models in personal identification of the living[J]. Int J Legal Med，2021，135（6）：2501-2507. doi：10.1007/s00414-021-02655-3 .
39	MOU Q N， JI L L， LIU Y， et al. Three-dimensional superimposition of digital models for individual identification[J]. Forensic Sci Int，2021，318：110597. doi：10.1016/j.forsciint.2020.110597 .
40	KOTTNER S， SCHAERLI S， FÜRST M， et al. VirtoScan-on-Rails - an automated 3D imaging system for fast post-mortem whole-body surface documentation at autopsy tables[J]. Forensic Sci Med Pathol，2019，15（2）：198-212. doi：10.1007/s12024-019-00095-5 .
41	UBELAKER D H， WU Y H， CORDERO Q R. Craniofacial photographic superimposition： New developments[J]. Forensic Sci Int Synergy，2019，1：271-274. doi：10.1016/j.fsisyn.2019.10.002 .
42	WINDHAGER S， MITTEROECKER P， RUPIĆ I， et al. Facial aging trajectories： A common shape pattern in male and female faces is disrupted after menopause[J]. Am J Phys Anthropol，2019，169（4）：678-688. doi：10.1002/ajpa.23878 .
43	JOE M. Age progression and regression[M]//WILKIN-SON C， RYNN C. Craniofacial identification. Cambridge： Cambridge University Press，2012：68-75. doi：10.1017/cbo9781139049566.006 .
44	GIBSON S J， SCANDRETT C M， SOLOMON C J， et al. Computer assisted age progression[J]. Forensic Sci Med Pathol，2009，5（3）：174-81. doi：10.1007/s12024-009-9102-z .
45	SCHMIDLIN E J， STEYN M， HOULTON T M R， et al. Facial ageing in South African adult males[J]. Forensic Sci Int，2018，289：277-286. doi：10.1016/j.forsciint.2018.05.006 .
46	MATTHEWS H， PENINGTON A， CLEMENT J， et al. Estimating age and synthesising growth in children and adolescents using 3D facial prototypes[J]. Forensic Sci Int，2018，286：61-69. doi：10.1016/j.forsciint. 2018.02.024 .

方法	对象	面部特征标志点	对应点-点间距离或面积测量值		参考文献
方法	对象	面部特征标志点	个体内差异	个体间差异	参考文献
2D-3D人脸叠加比对	100例日本男性	眉外侧点、双侧眼内角点、双侧眼外角点、双侧鼻翼点、鼻下点、双侧口角点、口裂点、颏下点、耳上点、耳下点	2.3~2.8 mm	4.0~14.6 mm	[30]
	13例高加索男性	双侧眼内角点、双侧眼外角点、鼻根点、鼻尖点、鼻下点、人中点、双侧口角点、口裂点、颏下点	1.8~3.0 mm（前视图）； 1.7~2.5 mm（左前斜视图）	2.9~6.8 mm（前视图）； 3.0~7.1 mm（左前斜视图）	[31]
	50例高加索男性	眉间点、鼻根点、鼻尖点、双侧鼻翼点、鼻下点、人中点、上下唇中点、颏唇沟点、颏前点（及各点连线间面积）	0.7~1.9 mm； 43~133 mm²	>1.77 mm；>157 mm²	[32]
	9对日本单卵双胞	双侧眼内角点、双侧眼外角点、双侧鼻翼点、鼻下点、人中点、双侧口角点、口裂点、双侧下颌角点、颏下点	（1.1±0.2） mm	（2.0±0.3） mm（胞胎内）	[33]
3D-3D人脸叠加比对	20例欧洲男性	整体3D人脸点云	（2.10±0.90） mm （RMS值）	（4.47±1.55）mm（RMS值）	[36]
	10对欧洲单卵双胞胎	整体3D人脸点云	（1.00±0.30） mm （RMS值）	（1.90±0.50） mm（胞胎内RMS值）；（3.40±0.70 ）mm（个体间RMS值）	[37]
	50例欧洲男性	整体3D人脸点云	0.17~1.38 mm （RMS值）	1.74~4.28 mm（RMS值）	[38]

方法	对象	面部特征标志点	对应点-点间距离或面积测量值		参考文献
方法	对象	面部特征标志点	个体内差异	个体间差异	参考文献
2D-3D人脸叠加比对	100例日本男性	眉外侧点、双侧眼内角点、双侧眼外角点、双侧鼻翼点、鼻下点、双侧口角点、口裂点、颏下点、耳上点、耳下点	2.3~2.8 mm	4.0~14.6 mm	[30]
	13例高加索男性	双侧眼内角点、双侧眼外角点、鼻根点、鼻尖点、鼻下点、人中点、双侧口角点、口裂点、颏下点	1.8~3.0 mm（前视图）； 1.7~2.5 mm（左前斜视图）	2.9~6.8 mm（前视图）； 3.0~7.1 mm（左前斜视图）	[31]
	50例高加索男性	眉间点、鼻根点、鼻尖点、双侧鼻翼点、鼻下点、人中点、上下唇中点、颏唇沟点、颏前点（及各点连线间面积）	0.7~1.9 mm； 43~133 mm²	>1.77 mm；>157 mm²	[32]
	9对日本单卵双胞	双侧眼内角点、双侧眼外角点、双侧鼻翼点、鼻下点、人中点、双侧口角点、口裂点、双侧下颌角点、颏下点	（1.1±0.2） mm	（2.0±0.3） mm（胞胎内）	[33]
3D-3D人脸叠加比对	20例欧洲男性	整体3D人脸点云	（2.10±0.90） mm （RMS值）	（4.47±1.55）mm（RMS值）	[36]
	10对欧洲单卵双胞胎	整体3D人脸点云	（1.00±0.30） mm （RMS值）	（1.90±0.50） mm（胞胎内RMS值）；（3.40±0.70 ）mm（个体间RMS值）	[37]
	50例欧洲男性	整体3D人脸点云	0.17~1.38 mm （RMS值）	1.74~4.28 mm（RMS值）	[38]

[1]	Wen LI, Hao-zhe LI, Chen CHEN, Wei-xiong CAI. Research Progress and Application Prospect of Facial Micro-Expression Analysis in Forensic Psychiatry [J]. Journal of Forensic Medicine, 2023, 39(5): 493-500.
[2]	Zhong-hua WANG, Shu-jin LI. Research Progress on Molecular Biology of Human Height Estimation [J]. Journal of Forensic Medicine, 2023, 39(5): 487-492.
[3]	Lu CHEN, Zhe ZHOU, Sheng-qi WANG. Process of Forensic Medicine in DNA Identification of Aged Human Remains [J]. Journal of Forensic Medicine, 2023, 39(5): 478-486.
[4]	Yong ZENG, Dong-hua ZOU, Ying FAN, Qing XU, Lu-yang TAO, Yi-jiu CHEN, Zheng-dong LI. Research Progress and Forensic Application of Human Vascular Finite Element Modeling and Biomechanics [J]. Journal of Forensic Medicine, 2023, 39(5): 471-477.
[5]	Hong-xia HAO, Jie-min CHEN, Rong-rong WANG, Xiao-ying YU, Meng WANG, Zhi-lu ZHOU, Yan-liang SHENG, Wen-tao XIA. The Value of VR-PVEP in Objective Evaluation of Monocular Refractive Visual Impairment [J]. Journal of Forensic Medicine, 2023, 39(4): 382-387.
[6]	Jie BAI, Jing SUN, Xiao-guang CHENG, Fan LIU, Hua LIU, Xu WANG. Construction and Application of Rib Fracture Diagnosis Model Based on YOLOv3 Algorithm [J]. Journal of Forensic Medicine, 2023, 39(4): 343-349.
[7]	Fei FAN, Juan WU, Zhen-hua DENG. Application Progress of Objective Audiological Detection Techniques in Forensic Clinical Medicine [J]. Journal of Forensic Medicine, 2023, 39(4): 360-366.
[8]	Jian XIANG, Xu WANG, Li-li YU, Kang-jia JIN, Ying-kai YANG. Objective Assessment of Visual Field Defects Caused by Optic Chiasm and Its Posterior Visual Pathway Injury [J]. Journal of Forensic Medicine, 2023, 39(4): 350-359.
[9]	Qing-qing XIANG, Li-fang CHEN, Qin SU, Yu-kun DU, Pei-yan LIANG, Xiao-dong KANG, He SHI, Qu-yi XU, Jian ZHAO, Chao LIU, Xiao-hui CHEN. Research Progress on Microbial Community Succession in the Postmortem Interval Estimation [J]. Journal of Forensic Medicine, 2023, 39(4): 399-405.
[10]	Zhang-ming GAO, Jing-yu SHI, Hao ZENG, Xue-jun ZHANG. Rapid Determination of Bucinnazine in Blood by UPLC-MS/MS [J]. Journal of Forensic Medicine, 2023, 39(4): 388-392.
[11]	Yu-qi CAO, Yan SHI, Ping XIANG, Yin-long GUO. Research Progress on Machine Learning Assisted Non-Targeted Screening Strategy for Identification of Fentanyl Analogs [J]. Journal of Forensic Medicine, 2023, 39(4): 406-416.
[12]	Xu WANG. Legal Theories， Disability Models and Principles of Disability Assessment [J]. Journal of Forensic Medicine, 2023, 39(4): 329-336.
[13]	Ran LI, Hong-yu SUN. Methods and Research Hotspots of Forensic Kinship Testing [J]. Journal of Forensic Medicine, 2023, 39(3): 231-239.
[14]	Xiao-yan MA, Hong-yu SUN, Qing LI. Research Progresses of Tri-Allelic Patterns in Autosomal STR in Forensic DNA Analysis [J]. Journal of Forensic Medicine, 2023, 39(3): 240-246.
[15]	Hao-yang WANG, Jian WU, Qian ZHANG, Xin-feng MIN, Xiu-yan LIU, Yin-long GUO. Structural Analysis and Characterization of 4-F-α-PVP Analog 4-F-3-Methyl-α- PVP Hydrochloride [J]. Journal of Forensic Medicine, 2023, 39(2): 144-150.