skip to main content
research-article

Light Codes for Fast Two-Way Human-Centric Visual Communication

Published:29 September 2023Publication History
Skip Abstract Section

Abstract

Visual codes, such as QR codes, are widely used in several applications for conveying information to users. However, user interactions based on spatial codes (e.g., displaying codes on phone screens for exchanging contact information) are often tedious, time consuming, and prone to errors due to image corruptions such as noise, blur, saturation, and perspective distortions. We propose Light Codes (LICO), a novel method for fast and fluid exchange of information among users. Light codes are based on transmitting and receiving temporal codes (instead of spatial) using compact and low-cost transceiver devices. The resulting approach enables seamless and near instantaneous exchange of short messages among users with minimal physical and cognitive effort. We design novel coding techniques, hardware prototypes, and applications that are optimized for human-centric communication, and facilitate fast and fluid user-to-user interactions in various challenging conditions, including a range of distances, motion, and ambient illumination. We evaluate the performance of the proposed methods both via quantitative analysis and user study based comparisons with several existing approaches including display-camera links, Bluetooth, and near-field communication, which show strong preference toward Light Codes in various real-world application scenarios.

Skip Supplemental Material Section

Supplemental Material

REFERENCES

  1. Abramson Norman. 1985. Development of the ALOHANET. IEEE Transactions on Information Theory 31, 2 (1985), 119123.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Abramson Norman. 1990. VSAT data networks. Proceedings of the IEEE 78, 7 (1990), 12671274.Google ScholarGoogle ScholarCross RefCross Ref
  3. Abramson Norman. 2009. The ALOHAnet—Surfing for wireless data. IEEE Communications Magazine 47, 12 (2009), 2125.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Amazon. 2022. Popl Dot Digital Business Card–Smart NFC Sticker Tag. Retrieved January 1, 2022 from https://tinyurl.com/3yft3eumGoogle ScholarGoogle Scholar
  5. Apple. 2022. Share Audio with AirPods or Beats Headphones. Retrieved January 1, 2022 from https://support.apple.com/en-us/HT210421Google ScholarGoogle Scholar
  6. Baluja Shumeet. 2017. Hiding images in plain sight: Deep steganography. In Advances in Neural Information Processing Systems, Guyon I., Luxburg U. Von, Bengio S., Wallach H., Fergus R., Vishwanathan S., and Garnett R. (Eds.), Vol. 30. Curran Associates, 111.Google ScholarGoogle Scholar
  7. Barry John R. and Kahn Joseph M.. 1995. Link design for nondirected wireless infrared communications. Applied Optics 34, 19 (July1995), 37643776.Google ScholarGoogle ScholarCross RefCross Ref
  8. Coskun Vedat, Ozdenizci Busra, and Ok Kerem. 2013. A survey on near field communication (NFC) technology. Wireless Personal Communications 71, 3 (2013), 22592294.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. DigiKey. 2022. Understanding the Basics of Infrared Communications. Retrieved September 7, 2023 from https://www.digikey.com/en/maker/blogs/2021/understanding-the-basics-of-infrared-communicationsGoogle ScholarGoogle Scholar
  10. Dot.2022. Shop Basics. Retrieved August 1, 2023 from https://dotcards.net/collections/all-productsGoogle ScholarGoogle Scholar
  11. GitHub. 2021. WeChat QR Code Detector for Detecting and Parsing QR Code. Retrieved September 7, 2023 from https://github.com/opencv/opencv_contrib/tree/4.x/modules/wechat_qrcodeGoogle ScholarGoogle Scholar
  12. Hao Tian, Zhou Ruogu, and Xing Guoliang. 2012. COBRA: Color barcode streaming for smartphone systems. In Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services (MobiSys ’12). 8598.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Haugen P. R., Rychnovsky S., Husain A., and Hutcheson L.. 1986. Optical interconnects for high speed computing. Optical Engineering 25, 10 (1986), 251076.Google ScholarGoogle ScholarCross RefCross Ref
  14. Hu Wenjun, Mao Jingshu, Huang Zihui, Xue Yiqing, She Junfeng, Bian Kaigui, and Shen Guobin. 2014. Strata: Layered coding for scalable visual communication. In Proceedings of the 20th Annual International Conference on Mobile Computing and Networking(MobiCom ’14). ACM, New York, NY, 7990.Google ScholarGoogle Scholar
  15. (IEC) International Electrotechnical Commission. 2006. Photobiological safety of lamps and lamp systems. International Standard IEC 62471:2006. IEC.Google ScholarGoogle Scholar
  16. Jo Kensei, Gupta Mohit, and Nayar Shree K.. 2016. DisCo: Display-camera communication using rolling shutter sensors. ACM Transactions on Graphics 35, 5 (2016), Article 150, 13 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Langlotz Tobias and Bimber Oliver. 2007. Unsynchronized 4D barcodes: Coding and decoding time-multiplexed 2D colorcodes. In Proceedings of the International Conference on Advances in Visual Computing.Google ScholarGoogle Scholar
  18. Lee C. G., Park C. S., Kim J. H., and Kim D. H.. 2007. Experimental verification of optical wireless communication link using high-brightness illumination light-emitting diodes. Optical Engineering 46, 12 (2007), 125005.Google ScholarGoogle Scholar
  19. Martin J.. 2005. The impact of the DOCSIS 1.1/2.0 MAC protocol on TCP. In Proceedings of the 2nd IEEE Conference on Consumer Communications and Networking.Google ScholarGoogle ScholarCross RefCross Ref
  20. Metcalfe Robert M. and Boggs David R.. 1976. Ethernet: Distributed packet switching for local computer networks. Communications of the ACM 19, 7 (July 1976), 395404.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Miao Guowang, Zander Jens, Sung Ki Won, and Slimane Ben. 2016. Fundamentals of Mobile Data Networks. Cambridge University Press.Google ScholarGoogle Scholar
  22. Nayar Shree K., Wang Jian, and Chen Wenzheng. 2022. Long distance QR code decoding. US Patent 11,461,924.Google ScholarGoogle Scholar
  23. Nguyen Viet, Tang Yaqin, Ashok Ashwin, Gruteser Marco, Dana Kristin, Hu Wenjun, Wengrowski Eric, and Mandayam Narayan. 2016. High-rate flicker-free screen-camera communication with spatially adaptive embedding. In Proceedings of the 35th Annual International Conference on Computer Communications (IEEE INFOCOM ’16). 19. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Otte Rob, Jong Leo P. De, and Roermund Arthur H. M. Van. 2013. Low-Power Wireless Infrared Communications. Springer.Google ScholarGoogle Scholar
  25. Pahlavan K. and Levesque A.. 1994. Wireless data communications. Proceedings of the IEEE 82, 9 (1994), 13981430.Google ScholarGoogle ScholarCross RefCross Ref
  26. Park Hyuncheol and Barry J. R.. 2004. Trellis-coded multiple-pulse-position modulation for wireless infrared communications. IEEE Transactions on Communications 52, 4 (2004), 643651. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  27. Paus Annika. 2007. Near Field Communication in Cell Phones. Seminararbeit Ruhr-Universitat Bochum.Google ScholarGoogle Scholar
  28. Perli Samuel David, Ahmed Nabeel, and Katabi Dina. 2010. PixNet: Interference-free wireless links using LCD-camera pairs. In Proceedings of the 16th Annual International Conference on Mobile Computing and Networking (MobiCom ’10). 137148.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Peterson W. W. and Brown D. T.. 1961. Cyclic codes for error detection. Proceedings of the IRE 49, 1 (1961), 228235.Google ScholarGoogle ScholarCross RefCross Ref
  30. Sony. 2022. Sony SIRC Protocol. Retrieved November 1, 2022 from https://www.sbprojects.net/knowledge/ir/sirc.phpGoogle ScholarGoogle Scholar
  31. Statista. 2019. Protective Case Usage among U.S. Smartphone Owners 2017. Retrieved August 19, 2023 from https://www.statista.com/statistics/368627/us-protective-case-usage-among-smartphone-owners/Google ScholarGoogle Scholar
  32. Stavenow B.. 1984. Throughput-delay characteristics and stability considerations of the access channel in a mobile telephone system. ACM SIGMETRICS Performance Evaluation Review 12, 3 (1984), 105112.Google ScholarGoogle Scholar
  33. Tancik Matthew, Mildenhall Ben, and Ng Ren. 2020. StegaStamp: Invisible hyperlinks in physical photographs. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR ’20). 15151524. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  34. Tran Vu, Jayatilaka Gihan, Ashok Ashwin, and Misra Archan. 2021. DeepLight: Robust & unobtrusive real-time screen-camera communication for real-world displays. In Proceedings of the International Conference on Information Processing in Sensor Networks.Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Tsonev Dobroslav, Videv Stefan, and Haas Harald. 2014. Light fidelity (Li-Fi): Towards all-optical networking. In Broadband Access Communication Technologies VIII, Vol. 9007. International Society for Optics and Photonics, 900702.Google ScholarGoogle Scholar
  36. Semiconductors Vishay. 2022. TFDU4301 Infrared Transceiver Module (SIR, 115.2 kbit/s) for IrDA® Applications. Retrieved August 19, 2023 from https://www.vishay.com/docs/81965/tfdu4301.pdfGoogle ScholarGoogle Scholar
  37. Vucic J., Kottke C., Nerreter S., Langer K.-D., and Walewski J. W.. 2010. 513 Mbit/s visible light communications link based on DMT-modulation of a white LED. Journal of Lightwave Technology28, 24 (2010), 35123518.Google ScholarGoogle ScholarCross RefCross Ref
  38. Wengrowski Eric and Dana Kristin. 2019. Light field messaging with deep photographic steganography. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR ’19). 15151524. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  39. Yuan Wenjia, Dana Kristin, Ashok Ashwin, Gruteser Marco, and Mandayam Narayan. 2012. Dynamic and invisible messaging for visual MIMO. In Proceedings of the IEEE Workshop on the Applications of Computer Vision (WACV ’12). 345352. DOI:Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Light Codes for Fast Two-Way Human-Centric Visual Communication

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Graphics
        ACM Transactions on Graphics  Volume 43, Issue 1
        February 2024
        211 pages
        ISSN:0730-0301
        EISSN:1557-7368
        DOI:10.1145/3613512
        Issue’s Table of Contents

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 29 September 2023
        • Online AM: 30 August 2023
        • Accepted: 22 August 2023
        • Revised: 21 August 2023
        • Received: 29 November 2022
        Published in tog Volume 43, Issue 1

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
      • Article Metrics

        • Downloads (Last 12 months)382
        • Downloads (Last 6 weeks)48

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      View Full Text