Research on Visual Inspection Algorithm of Crimping Appearance Defects for Wiring Harness Terminals

doi:10.16182/j.issn1004731x.joss.20-0984

Abstract

Abstract:

Aiming at the low efficiency and high missing rate of wiring harness terminals, an image detection method based on machine vision is proposed. The characteristic parameters of five typical defects in three main parts of wiring harness terminals are analyzed and defined. Tthe algorithms of extracting positioning datum, segmenting inspected-parts adaptively, extracting the defect features and calculating the characteristic parameters are designed respectively, and the defects criterions are given. The experimental results show that the algorithms are suitable for single defect and multi-class defects, both the miss detection rate and the false positiveness rate are low. The accuracy and real-time performance are high, and can meet the practical application requirements.

Key words: machine vision, image processing, wire harness, image segmentation, defect detection

CLC Number:

Bingan Yuan, Mingen Zhong, Jingxin Ni. Research on Visual Inspection Algorithm of Crimping Appearance Defects for Wiring Harness Terminals[J]. Journal of System Simulation, 2022, 34(5): 1152-1159.

Figures/Tables 15

Fig. 1

Fig. 2

Fig. 3

Fig. 4

Fig. 5

Fig. 6

Fig. 7

Fig. 8

Fig. 9

Fig. 10

Table 1

Table 2

Fig. 11

Fig. 12

Table 3

References 14

[1]	芦碧波, 扈天卿, 刘甜甜. 面向线束端子显微图像分割的变指数色度滤波[J]. 光学精密工程, 2019, 27(8): 1894-1900.
	Lu Bibo, Hu Tianqing, Liu Tiantian. Variable Exponential Chromaticity Filtering for Microscopic Image Segmentation of Wire Harness Terminals[J]. Opt. Precision Eng. , 2019, 27(8): 1894-1900.
[2]	Yost W T. Process for Nondestructive Evaluation of the Equality of a Crimped Wire Connector[P]. US: US8671551 B2, 2014-3-18.
[3]	芦碧波, 刘利群, 郑艳梅, 等. 一种线束端子显微图像全自动分割方法[J]. 光电工程, 2016, 43(10): 49-55.
	Lu Bibo, Liu Liqun, Zheng Yanmei, et al. A Method for Segmenting the Microscopic Cable Harness Image Automatically[J]. Opto-Electronic Engineering, 2016, 43(10): 49-55.
[4]	侯守明, 王阳, 唐琪博, 等. 一种基于偏微分方程和Canny算子的图像分割方法[J]. 山西大学学报(自然科学版), 2017, 40(4): 676-682.
	Hou Shouming, Wang Yang, Tang Qibo, et al. An Image Segmentation Method based on Partial Differential Equations and Canny Operator[J]. Journal of Shanxi University (Natural Science Edition), 2017, 40(4): 676-682.
[5]	芦碧波, 刘甜甜, 郭海儒. 色度亮度空间中的线束端子显微图像分割[J]. 应用光学, 2017, 38(6): 931-936.
	Lu Bibo, Liu Tiantian, Guo Hairu. Wire Harness Terminals Microscopic Image Segmentation in Chromaticity Brightness Space[J]. Journal of Applied Optics, 2017, 38(6): 931-936.
[6]	GB/T 18290.2-2015/IEC 60352-2:2006，无焊连接第2部分：压接连接一般要求、试验方法和使用导则[S]. 北京: 中国标准出版社, 2016.
	GB/T 18290.2-2015/IEC 60352-2:2006, Solderless Jointspart 2: General Requirements, Test Methods and Guidelines for Use of Compression Joints[S]. Beijing: China Standards Press, 2016.
[7]	Fang L, Jing Q. Robust Fuzzy Local Information and Lp-Norm Distance-Based Image Segmentation Method[J]. IET Image Processing (S1751-9659), 2017, 11(4): 217-226.
[8]	张相胜, 焦鹏, 潘丰. 基于机器视觉的汽车线束压接缺陷检测系统[J]. 仪表技术与传感器, 2020(3): 73-77.
	Zhang Xiangsheng, Jiao Peng, Pan Feng. Defect Detection System Design for Automotive Wiring Harness Crimping Using Machine Vison[J]. Instrument Technique and Sensor, 2020(3): 73-77.
[9]	张莉, 冯定忠, 刘鹏玉, 等. 基于灰数逼近理想解排序法的夹具设计方案评价[J]. 中国机械工程, 2016, 27(20): 2728-2734.
	Zhang Li, Feng Dingzhong, Liu Pengyu, et al. Evaluation of Jig and Fixture Design Scheme Based on Grey Number TOPSIS[J]. China Mechanical Engineering, 2016, 27(20): 2728-2734.
[10]	吴斌, 叶东, 张鑫, 等. 非合作目标姿态测量的嵌入式算法[J]. 光学精密工程, 2016, 24(11): 2804-2813.
	Wu Bin, Ye Dong, Zhang Xin, et al. Embedded Algorithm for Relative Pose Measurement Between Non-Cooperative Targets[J]. Opt. Precision Eng., 2016, 24(11): 2804-2813.
[11]	张姣, 李俊山, 杨亚威. 结合仿射变换和多层B样条配准的湍流畸变图像校正[J]. 光学精密工程, 2015, 23(3): 846-854.
	Zhang Jiao, Li Junshan, Yang Yawei. Turbulence Distorte Image Correction Using Affine Transformation and Multilevel B-Spline Registration[J]. Opt. Precision Eng., 2015, 23(3): 846-854.
[12]	傅思勇, 吴禄慎, 陈华伟, 等. 综合多畸变因素的摄像机标定[J]. 仪器仪表学报, 2018, 39(2): 248-256.
	Fu Siyong, Wu Lushen, Chen Huawei, et al. Camera Calibration Based on Multiple Distortion Factors[J]. Chinese Journal of Scientific Instrument, 2018, 39(2): 248-256.
[13]	Wang X, Jiang Z, Yao J, et al. Extraction and Identification Methods of Micro-Fractured Characteristics Information in Pore Space of Porous Media Based on Morphological Theory[J]. Chinese Science Bulletin (S1001-6538), 2018, 63(6): 579-589.
[14]	刘睿, 范秀敏, 尹旭悦, 等. 面向手工装配的线缆目标图像分割方法[J]. 计算机辅助设计与图形学学报, 2018, 30(4): 666-672.
	Liu Rui, Fan Xiumin, Yin Xuyue, et al. A Method for Image Segmentation of Wire and Cable Targets Formanual Assembly[J]. Journal of Computer-Aided Design and Graphics, 2018, 30(4): 666-672.

条件	缺陷类型
N<T_NA	芯线浅打
L<T_{L_AL}	芯线浅打
L>T_{L_AH}	芯线深打

条件	缺陷类型
N<T_NC	绝缘皮深打
L<T_{L_CL}	绝缘皮深打
L>T_{L_CH}	绝缘皮浅打

缺陷位置	样本数	检出数	误检数	漏检率%	误检率%	准确率%
仅A部	938	935	3	0.64	0.32	99.68
仅B部	1 110	1 106	0	0.36	0.00	100.00
仅C部	1 057	1 055	10	1.14	0.95	99.05
A部+B部	1 176	1 170	4	0.85	0.34	99.66
A部+C部	1 250	1 244	12	1.44	0.96	99.04
B部+C部	1 132	1 129	6	0.80	0.53	99.47
A部+B部+C部	1 537	1 532	14	1.24	0.91	99.09
综合	8 200	8 171	49	0.95	0.60	99.40

[1]	Wei Zhou, Yuxiang Liu, Guangping Liao, Xin Ma. Siamese Object Tracking Algorithm Combined with the Intersection over Union Loss [J]. Journal of System Simulation, 2022, 34(9): 1956-1967.
[2]	Shiqi Lin, Jikai Wang, Haoyuan Pei, Hao Zhao, Zonghai Chen. Monocular Semantic SLAM Method Based on Object Relation Description [J]. Journal of System Simulation, 2022, 34(2): 278-284.
[3]	Wang Kun, Ji Yao, Liu Peilun, Wang Li. Infrared Image Segmentation of Aircraft Skin Based on Otsu and Improved I-Ching Divination Evolutionary Algorithm [J]. Journal of System Simulation, 2021, 33(2): 421-433.
[4]	Feng Xiao, Zhang Hui, Zhou Rui, Qiao Lu, Wei Dong, Li Dandan, Zhang Yuyao, Zheng Guoqing. Variety Recognition Based on Deep Learning and Double-Sided Characteristics of Maize Kernel [J]. Journal of System Simulation, 2021, 33(12): 2983-2991.
[5]	Gu Juping, Cheng Tianyu, Hua Liang, Wang Jianping, Zhao Jian, Cao Yong. Overview of Image Segmentation and Registration for Spine Biological Modeling [J]. Journal of System Simulation, 2019, 31(2): 167-173.
[6]	Zhang Qing, Zou Xiangjun, Lin Guichao, Sun Yanhui. Image Feature Extraction and Online Grading Method for Weight and Shape of Strawberry [J]. Journal of System Simulation, 2019, 31(1): 7-9.
[7]	Gao Shangbing, Xie Zheng, Pan Zhigeng, Qin Fangzhe, Li Rui. Novel Automatic Pavement Crack Detection Algorithm [J]. Journal of System Simulation, 2017, 29(9): 2009-2015.
[8]	Zhou Binbin, Gao Shangbing, Pan Zhigeng, Wang Liangliang, Wang Hongyang. Vehicle Logo Recognition Based on Sparse Sampling and Gradient Distribution Features [J]. Journal of System Simulation, 2017, 29(9): 2035-2042.
[9]	Pan Xiuqiang, Shan Jinxiao, Yang Caifeng. Image Segmentation and Offset Correction Based on Minimal Relative Entropy Theoryand Level Set Method [J]. Journal of System Simulation, 2017, 29(11): 2731-2741.
[10]	Yang Jiabo, Yang Gang, Yang Meng. Augmented Reality System Based on Depth Image Segmentation and Object Tracking [J]. Journal of System Simulation, 2017, 29(11): 2788-2795.
[11]	Wang Le, Luo Yu, Wang Haikuan, Fei Minru. Measurement Error Correction Model of ToF Depth Camera [J]. Journal of System Simulation, 2017, 29(10): 2323-2329.
[12]	Yang Yong, Zheng Liangren, Guo Ling, Ye Yangdong. Color-texture Image Segmentation Approach Designed by Integrating Geodesic Active Contour Model and Multilayer Graph Cut Model [J]. Journal of System Simulation, 2016, 28(9): 2159-2168.
[13]	Li Xinli, Li Nan, Sun Yujia, Lu Gang, Yan Yong, Liu Shi. Research on Flame Radical Imaging and Extreme Learning Machine to Prediction of NOx Emissions [J]. Journal of System Simulation, 2016, 28(5): 1179-1185.
[14]	Yang Yong, Guo Ling, Dai Wenzheng, Ye Yangdong. Regional Credible Fusion Based Color-texture Image Segmentation Approach [J]. Journal of System Simulation, 2016, 28(10): 2304-2312.
[15]	Jin Yaoli, Wang Shiliang, Xu Gang, Hu Weihua, Wang Yigang. Automatic Hair Contour Extraction Method with Complex Background [J]. Journal of System Simulation, 2015, 27(10): 2305-2309.