Abstract
Palmprint as biometrics has gained increasing attention recently due to its discriminative ability and robustness. However, existing methods mainly improve palmprint verification within one spectrum, which is challenging to verify across different spectrums. Additionally, in distributed server-client-based deployment, palmprint verification systems predominantly necessitate clients to transmit private data for model training on the centralized server, thereby engendering privacy apprehensions. To alleviate the above issues, in this paper, we propose a physics-driven spectrum-consistent federated learning method for palmprint verification, dubbed as PSFed-Palm. PSFed-Palm draws upon the inherent physical properties of distinct wavelength spectrums, wherein images acquired under similar wavelengths display heightened resemblances. Our approach first partitions clients into short- and long-spectrum groups according to the wavelength range of their local spectrum images. Subsequently, we introduce anchor models for short- and long-spectrum, which constrain the optimization directions of local models associated with long- and short-spectrum images. Specifically, a spectrum-consistent loss that enforces the model parameters and feature representation to align with their corresponding anchor models is designed. Finally, we impose constraints on the local models to ensure their consistency with the global model, effectively preventing model drift. This measure guarantees spectrum consistency while protecting data privacy, as there is no need to share local data. Extensive experiments are conducted to validate the efficacy of our proposed PSFed-Palm approach. The proposed PSFed-Palm demonstrates compelling performance despite only a limited number of training data. The codes have been released at https://github.com/Zi-YuanYang/PSFed-Palm.
Similar content being viewed by others
Data availability statement
The data that support the findings of this study are available from PolyU (Zhang et al., 2010) and CASIA (Hao et al., 2008) but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of PolyU (Zhang et al., 2010) and CASIA (Hao et al., 2008).
References
Han, C., Shan, S., Kan, M., Wu, S., & Chen, X. (2022). Personalized convolution for face recognition. International Journal of Computer Vision, 130(2), 344–362.
Gomez-Barrero, M., Drozdowski, P., Rathgeb, C., Patino, J., Todisco, M., Nautsch, A., Damer, N., Priesnitz, J., Evans, N. & Busch, C. (2021). Biometrics in the era of covid-19: Challenges and opportunities. arXiv preprint arXiv:2102.09258.
Zhang, D., Kong, W.-K., You, J., & Wong, M. (2003). Online palmprint identification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(9), 1041–1050.
Xu, Y., Fei, L., Wen, J., & Zhang, D. (2018). Discriminative and robust competitive code for palmprint recognition. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 48(2), 232–241.
Liang, X., Yang, J., Lu, G., & Zhang, D. (2021). Compnet: Competitive neural network for palmprint recognition using learnable Gabor kernels. IEEE Signal Processing Letters, 28, 1739–1743.
Yang, Z., Xia, W., Qiao, Y., Lu, Z., Zhang, B., Leng, L., & Zhang, Y. (2023). Co3net: Coordinate-aware contrastive competitive neural network for palmprint recognition. IEEE Transactions on Instrumentation and Measurement, 72, 3276506.
Su, L., Fei, L., Zhao, S., Wen, J., Zhu, J., & Teng, S. (2023). Learning modality-invariant binary descriptor for crossing palmprint to palm-vein recognition. Pattern Recognition Letters, 172, 1–7.
Dong, X., Khan, M. K., Leng, L., & Teoh, A. B. J. (2022). Co-learning to hash palm biometrics for flexible iot deployment. IEEE Internet of Things Journal, 9(23), 23786–23794.
Fei, L., Zhang, B., Jia, W., Wen, J., & Zhang, D. (2020). Feature extraction for 3-d palmprint recognition: A survey. IEEE Transactions on Instrumentation and Measurement, 69(3), 645–656.
Zhong, D., Du, X., & Zhong, K. (2019). Decade progress of palmprint recognition: A brief survey. Neurocomputing, 328, 16–28.
Zhang, S., Wang, H., Huang, W., & Zhang, C. (2018). Combining modified lbp and weighted src for palmprint recognition. Signal, Image and Video Processing, 12, 1035–1042.
Guo, Z., Zhang, D., Zhang, L., & Zuo, W. (2009). Palmprint verification using binary orientation co-occurrence vector. Pattern Recognition Letters, 30(13), 1219–1227.
Yang, Z., Leng, L., Wu, T., Li, M., & Chu, J. (2023). Multi-order texture features for palmprint recognition. Artificial Intelligence Review, 56(2), 995–1011.
Zhang, L., Li, H., & Niu, J. (2012). Fragile bits in palmprint recognition. IEEE Signal Processing Letters, 19(10), 663–666.
Sun, Z., Tan, T., Wang, Y. & Li, S.Z. (2005). Ordinal palmprint represention for personal identification. In Proceedings of IEEE/CVF international conference on computer vision and pattern recognition (CVPR), 1, 279–284.
Yang, Z., Leng, L., & Min, W. (2021). Extreme downsampling and joint feature for coding-based palmprint recognition. IEEE Transactions on Instrumentation and Measurement, 70, 1–12.
Kong, A., Zhang, D., & Kamel, M. (2006). Palmprint identification using feature-level fusion. Pattern Recognition, 39(3), 478–487.
Fei, L., Lu, G., Jia, W., Teng, S., & Zhang, D. (2018). Feature extraction methods for palmprint recognition: A survey and evaluation. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 49(2), 346–363.
Kong, W. K., Zhang, D., & Li, W. (2003). Palmprint feature extraction using 2-d gabor filters. Pattern Recognition, 36(10), 2339–2347.
Jia, W., Huang, D.-S., & Zhang, D. (2008). Palmprint verification based on robust line orientation code. Pattern Recognition, 41(5), 1504–1513.
Fei, L., Xu, Y., & Zhang, D. (2016). Half-orientation extraction of palmprint features. Pattern Recognition Letters, 69, 35–41.
Fei, L., Xu, Y., Tang, W., & Zhang, D. (2016). Double-orientation code and nonlinear matching scheme for palmprint recognition. Pattern Recognition, 49, 89–101.
Jiang, F., Li, Q., Liu, P., Zhou, X.-D. & Sun, Z. (2023). Adversarial learning domain-invariant conditional features for robust face anti-spoofing. International Journal of Computer Vision, 1–24.
Zhao, S., Fei, L., Wen, J., Zhang, B., Zhao, P., & Li, S. (2022). Structure suture learning-based robust multiview palmprint recognition. IEEE Transactions on Neural Networks and Learning Systems.
Matkowski, W. M., Chai, T., & Kong, A. W. K. (2019). Palmprint recognition in uncontrolled and uncooperative environment. IEEE Transactions on Information Forensics and Security, 15, 1601–1615.
Chai, T., Prasad, S., & Wang, S. (2019). Boosting palmprint identification with gender information using deepnet. Future Generation Computer Systems, 99, 41–53.
Genovese, A., Piuri, V., Plataniotis, K. N., & Scotti, F. (2019). Palmnet: Gabor-pca convolutional networks for touchless palmprint recognition. IEEE Transactions on Information Forensics and Security, 14(12), 3160–3174.
Zhong, D., Liu, S., Wang, W. & Du, X. (2018). Palm vein recognition with deep hashing network. In Proceedings of Chinese conference on pattern recognition computer vision (PRCV), pp. 38–49.
Zhu, H., Long, M., Wang, J., Cao, Y. (2016). Deep hashing network for efficient similarity retrieval. In Proceedings of the AAAI conference on artificial intelligence (AAAI), vol. 30.
Wu, T., Leng, L., Khan, M. K., & Khan, F. A. (2021). Palmprint-palmvein fusion recognition based on deep hashing network. IEEE Access, 9, 135816–135827.
Cho, S., Oh, B.-S., Toh, K.-A., & Lin, Z. (2019). Extraction and cross-matching of palm-vein and palmprint from the RGB and the NIR spectrums for identity verification. IEEE Access, 8, 4005–4021.
Cho, S., Oh, B.-S., Kim, D., & Toh, K.-A. (2021). Palm-vein verification using images from the visible spectrum. IEEE Access, 9, 86914–86927.
Wicaksana, J., Yan, Z., Yang, X., Liu, Y., Fan, L., & Cheng, K.-T. (2022). Customized federated learning for multi-source decentralized medical image classification. IEEE Journal of Biomedical and Health Informatics, 26(11), 5596–5607.
McMahan, B., Moore, E., Ramage, D., et al. (2017). Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics, pp. 1273–1282.
Li, T., Sahu, A. K., Zaheer, M., et al. (2020). Federated optimization in heterogeneous networks. In Proceedings of machine learning and systems, 2, 429–450.
Li, X., Jiang, M., Zhang, X., et al. (2021). Fedbn: Federated learning on non-iid features via local batch normalization. arXiv preprint arXiv:2102.07623.
Arivazhagan, M.G., Aggarwal, V., Singh, A.K. & Choudhary, S. (2019). Federated learning with personalization layers. arXiv preprint arXiv:1912.00818.
Wu, C., Wu, F., Lyu, L., Huang, Y., & Xie, X. (2022). Communication-efficient federated learning via knowledge distillation. Nature Communications, 13(1), 2032.
Liang, P.P., Liu, T., Ziyin, L., Allen, N.B., Auerbach, R.P., Brent, D., Salakhutdinov, R. & Morency, L.-P. (2020). Think locally, act globally: Federated learning with local and global representations. arXiv preprint arXiv:2001.01523.
Yang, Z., Xia, W., Lu, Z., Chen, Y., Li, X., & Zhang, Y. (2023). Hypernetwork-based physics-driven personalized federated learning for ct imaging. IEEE Transactions on Neural Networks and Learning Systems.
Ma, X., Zhang, J., Guo, S. & Xu, W. (2022). Layer-wised model aggregation for personalized federated learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 10092–10101.
Dai, Y., Chen, Z., Li, J., Heinecke, S., Sun, L. & Xu, R. (2023). Tackling data heterogeneity in federated learning with class prototypes. In Proceedings of the AAAI conference on artificial intelligence (AAAI), vol. 37, pp. 7314–7322.
Shao, H., & Zhong, D. (2020). Towards privacy palmprint recognition via federated hash learning. Electronics Letters, 56(25), 1418–1420.
DeJonge, K. C., Mefford, B. S., & Chávez, J. L. (2016). Assessing corn water stress using spectral reflectance. International Journal of Remote Sensing, 37(10), 2294–2312.
Khosla, P., Teterwak, P., Wang, C., Sarna, A., Tian, Y., Isola, P., Maschinot, A., Liu, C., & Krishnan, D. (2020). Supervised contrastive learning. Proceedings Advances in Neural Information Processing Systems (NIPS), 33, 18661–18673.
Zhang, D., Guo, Z., Lu, G., Zhang, L., & Zuo, W. (2010). An online system of multispectral palmprint verification. IEEE Transactions on Instrumentation and Measurement, 59(2), 480–490.
Kingma, D. P. & Ba, J. (2014). Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.
Jain, A. K., Ross, A. & Prabhakar, S. (2004). An introduction to biometric recognition. IEEE Transactions on Circuits and Systems for Video Technology, 14(1), 4–20.
Hao, Y., Sun, Z., Tan, T. & Ren, C. (2008). Multispectral palm image fusion for accurate contact-free palmprint recognition. In Proceedings of IEEE international conference image processes (ICIP), pp. 281–284. IEEE.
Yang, Z., Chen, Y., Huangfu, H., Ran, M., Wang, H., Li, X., & Zhang, Y. (2023). Dynamic corrected split federated learning with homomorphic encryption for u-shaped medical image networks. IEEE Journal of Biomedical and Health Informatics, 27(12), 5946–5957.
Akter, M., Moustafa, N., Lynar, T., & Razzak, I. (2022). Edge intelligence: Federated learning-based privacy protection framework for smart healthcare systems. IEEE Journal of Biomedical and Health Informatics, 26(12), 5805–5816.
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China under Grants 62271335; in part by the Sichuan Science and Technology Program under Grant 2021JDJQ0024; and in part by the Sichuan University “From 0 to 1” Innovative Research Program under Grant 2022SCUH0016. The Science and Technology Development Fund, Macao S.A.R (FDCT) 0028/2023/RIA1.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Segio Escalera.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Yang, Z., Teoh, A.B.J., Zhang, B. et al. Physics-Driven Spectrum-Consistent Federated Learning for Palmprint Verification. Int J Comput Vis (2024). https://doi.org/10.1007/s11263-024-02077-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11263-024-02077-9