TY - JOUR
T1 - Color vision deficiency datasets & recoloring evaluation using GANs
AU - Li, Hongsheng
AU - Zhang, Liang
AU - Zhang, Xiangdong
AU - Zhang, Meili
AU - Zhu, Guangming
AU - Shen, Peiyi
AU - Li, Ping
AU - Bennamoun, Mohammed
AU - Shah, Syed Afaq Ali
PY - 2020/10/1
Y1 - 2020/10/1
N2 - People with Color Vision Deficiency (CVD) cannot distinguish some color combinations under normal situations. Recoloring becomes a necessary adaptation procedure. In this paper, in order to adaptively find the key color components in an image, we first propose a self-adapting recoloring method with an Improved Octree Quantification Method (IOQM). Second, we design a screening tool of CVD datasets that is used to integrate multiple recoloring methods. Third, a CVD dataset is constructed with the help of our designed screening tool. Our dataset consists of 2313 pairs of training images and 771 pairs of testing images. Fourth, multiple GANs i.e., pix2pix-GAN [1], Cycle-GAN [2], Bicycle-GAN [3] are used for colorblind data conversion. This is the first ever effort in this research area using GANs. Experimental results show that pix2pix-GAN [1] can effectively recolor unrecognizable colors for people with CVD, and we predict that this dataset can provide some help for color blind images recoloring. Datasets and source are available at: https://github.com/doubletry/pix2pix, https://github.com/doubletry/CycleGAN and https://github.com/doubletry/BicycleGAN.
AB - People with Color Vision Deficiency (CVD) cannot distinguish some color combinations under normal situations. Recoloring becomes a necessary adaptation procedure. In this paper, in order to adaptively find the key color components in an image, we first propose a self-adapting recoloring method with an Improved Octree Quantification Method (IOQM). Second, we design a screening tool of CVD datasets that is used to integrate multiple recoloring methods. Third, a CVD dataset is constructed with the help of our designed screening tool. Our dataset consists of 2313 pairs of training images and 771 pairs of testing images. Fourth, multiple GANs i.e., pix2pix-GAN [1], Cycle-GAN [2], Bicycle-GAN [3] are used for colorblind data conversion. This is the first ever effort in this research area using GANs. Experimental results show that pix2pix-GAN [1] can effectively recolor unrecognizable colors for people with CVD, and we predict that this dataset can provide some help for color blind images recoloring. Datasets and source are available at: https://github.com/doubletry/pix2pix, https://github.com/doubletry/CycleGAN and https://github.com/doubletry/BicycleGAN.
KW - Color vision deficiency
KW - GAN
KW - Improved octree quantification method
KW - Recolor
UR - http://www.scopus.com/inward/record.url?scp=85088803621&partnerID=8YFLogxK
U2 - 10.1007/s11042-020-09299-2
DO - 10.1007/s11042-020-09299-2
M3 - Article
AN - SCOPUS:85088803621
SN - 1380-7501
VL - 79
SP - 27583
EP - 27614
JO - Multimedia Tools and Applications
JF - Multimedia Tools and Applications
IS - 37-38
ER -