📌 For those reading this article: If you are considering IT patents for software, SaaS, IoT, etc., please also take a look at patent attorney services that specialize in IT patents.
The table below summarizes patent cases related to AR (Augmented Reality) and VR (Virtual Reality) technologies in various fields that have been applied for or registered in Japan in the past five years (from 2020 onwards). There are a wide variety of applicants, including companies and universities, and it can be seen that the development of AR/VR technology is progressing in a wide range of fields such as medicine, manufacturing, education, and games.
| Applicant (company/university name, etc.) | Publication/registration number | Name of invention | Summary (Characteristics of AR/VR) | Technical features/specific effects |
|---|---|---|---|---|
| CS Reporters Co., Ltd. XR iPLAB | Unexamined Patent Publication 2020-149399 (Published) | How to provide virtual reality space | A method that automatically synchronizes a character's lip sync based on each user's voice data in a VR space where multiple users participate. | The server receives audio from the user terminal, extracts parameters through audio analysis, and generates the character's voice and video. It allows you to easily match the mouth movements of your VR avatar to the actual voice, improving realism and immersion. |
| Nomura Research Institute, Inc. (NRI) | Unexamined Patent Publication 2023-74321 (Published) | Product positioning system | Photographs of store display shelves are taken with a smartphone camera, and the position of each product's price tag is detected based on the AR markers on both ends of the shelves. | Obtain shelf information from the 1D/2D code (AR marker) on the edge of the shelf, and record product information and display position corresponding to the price tag. It is possible to understand the product display position by simply taking pictures of display shelves with a common smartphone camera, contributing to improving inventory management and demand forecasting accuracy in retail stores. |
| Sumitomo Metal Mining Co., Ltd. | Unexamined Patent Publication 2024-172349 (Published) | Lithium niobate single crystal,... and AR glass | We provide high-quality lithium niobate single crystals suitable for waveguide materials in AR glasses. By minimizing light absorption in visible light, the brightness and clarity of AR displays are improved. | Developed a growth method that suppresses the platinum impurity concentration within the single crystal to 1.0ppm or less. Reduces light absorption derived from platinum, creating a crystal with high refractive index and low loss. Contributes to improving the transparency of optical waveguides for AR and enables clear hologram display. |
| B Bridge Co., Ltd. | Patent No. 6828934 (Registered) | Navigation devices,…methods | AR navigation technology that overlays traveling direction and route information on smartphone camera images. Provides intuitive directions similar to Google Maps' AR display. | By combiningGPS data with proprietary correction technology and accurately recognizing sidewalks and narrow alleys, we have created a system that can provide guidance even at night or indoors (in environments with no signal). You can reach your destination without getting lost even at complex intersections, improving navigation accuracy and convenience. |
| TDK Corporation | Unexamined Patent Publication 2024-94883 (Published) | Retinal projection device and near eye wearable device | A glasses-type near-eye wearable AR device that uses laser scanning to project images directly onto the user's retina. | The laser beam is reflected by a large number of minute reflectors placed on the inner surface of the lens and an image is drawn on the retina. By subdividing and optimally arranging the reflector area, the exclusive area on the lens is reduced, ensuring both the visibility of see-through glasses and high-resolution display. It is possible to design AR glasses that are thinner and lighter than conventional ones. |
| Canon Inc. | Unexamined Patent Publication 2021-118415 (Published) | Head-mounted display control device, etc. | Technology to suppress light leakage that occurs when a head-mounted display (HMD) is attached. Virtual images are clearly displayed even in bright environments such as outdoors, without sacrificing the immersive feeling. | We propose a control system that includes a removable shading member on the HMD body, and closes the gap between the user's face and the HMD depending on the amount of ambient light. It shuts out outside light in bright places, and reduces the feeling of being trapped in dark places. Automatically adjusts ambient light to improve visibility and immersion of VR images. |
| Juntendo University (joint application: Pulse Co., Ltd.) | Patent 7219895 (Registered) |
Medical VR system “Uraraka VR” | Medical VR therapy system that relieves chronic pain and anxiety about hospitalization. By immersing patients in VR images, they can divert their attention from pain and anxiety, aiming to relieve pain without relying on drugs. | The mobile integrated VR headset allows you to use it in a comfortable position even on the bed. VR usage status and pain scores can be recorded for each patient and monitored in real time by medical professionals. Expected as a new digital analgesic method for reducing neuropathic pain and preoperative anxiety. |
| UNIVRS Co., Ltd. | Patent 7441442 (Registered) |
Movement technology to prevent VR sickness | A movement interface that significantly reduces "VR sickness" (3D sickness) when using VR content. A unique technology that allows the viewpoint in VR to move according to the actual movement of the body. | Developed an algorithm that links the movement of the user's head and limbs to movement and viewpoint operations in VR space. Posture and movement are reflected in real time from sensor values of HMD and controller. You won't get sick even with intense images and prevent motion sickness-like complaints. Contributes to improved freedom of expression in VR games and training simulators. |
| University of Miyazaki (Professor Norihito Kawasue team) | Patent 7210862 (Registered) | "Glasses that allow you to see the pig's weight" | A smart glasses-type AR system for pig farming that instantly estimates the weight of a pig just by looking at it. A solution that speeds up and non-contact weighing of livestock, which used to be hard labor. | Composed of head-mounted smart glasses and a 3D camera. AI analyzes the pig's body shape data captured by the camera, and displays the estimated weight on a glass display overlaid with the pig's image. High accuracy with errors within a few percent. It is possible to instantly determine whether the weight is suitable for shipping (115 kg), dramatically reducing the burden of conventional weighing work. |
* "Publication" indicates patent publication gazette, "patent" indicates patent registration publication.
From the list above, we will select five representative cases that have received particular attention, and will explain in detail the technical characteristics and effects of each.
[Case Summary] Juntendo University School of Medicine and the startup company Pulse (a subsidiary of Ignis) jointly developed Uraraka VR, an innovative rehabilitation and pain relief system that applies VR technology to medical care, and filed a patent application in 2019. This system aims to reduce chronic neuralgia and pre-surgery anxiety and stress by immersing hospitalized patients in VR images to distract them from their pain and anxiety.
[Technical Features] It uses an integrated mobile VR headset that can be worn and used by patients while lying on their backs on the hospital bed. This allows patients to receive treatment in a relaxed position, making it less stressful for elderly patients and post-surgery patients. It also has management functions for medical professionals, allowing each patient's VR session time and pain scores (VAS values, etc.) to be recorded and shared in real time. Based on this data, doctors can evaluate the effectiveness and utilize it in treatment plans.
[Specific effects] It is expected that the immersive experience of VR images will ease concentration and attachment to pain and anxiety in the patient's brain. In fact, it has been reported that the secretion of dopamine in the brain by the reward experience of games has the effect of suppressing pain and fear, and ``Uraraka VR'' is attracting attention as a means of digital pain relief without side effects that utilizes this principle. As the world's first example of chronic pain relief without relying on painkillers, it is expected to contribute to the future development of medical VR.
[Case Summary] In order to solve the problem of "VR sickness" (3D sickness), which is a problem in VR games, the startup UNIVRS has developed a unique movement interface technology that links body movements and movement within VR, and is applying for a patent in 2019. This technology makes it difficult for users to experience motion sickness-like discomfort even when intense visual expressions are used in VR content, and the company has successfully raised approximately 100 million yen in funding for this idea.
[Technical Features] VR sickness usually occurs due to a misalignment between visual information and the semicircular canals (body's sense of balance). This technology reduces this discrepancy by matching the movement of the viewpoint and character behavior in VR to the user's actual body movements as much as possible. For example, a controller or HMD's motion sensor can detect the player's head or hand movements, and the in-game view will move in accordance with that direction. Furthermore, even when there is no corresponding input device, the player's intended movement is estimated and reflected in walking and turning movements using a unique algorithm.
[Specific effects] This mechanism alleviates the discrepancy between the image and the physical experience, and significantly reduces the discomfort that causes VR sickness. Previously, it was necessary to restrict movement speed and effects during games to prevent VR sickness, but with the application of this technology, these restrictions will be reduced, allowing for a more free and dynamic VR experience. In fact, UNIVRS is utilizing this technology to turn famous works into VR games (such as "Attack on Titan VR"), and it is expected to be a fundamental technology that expands the range of commercial VR content.
[Case Summary] There are also examples of Japanese companies obtaining patents in the field of AR navigation, which is attracting attention as the next generation of route guidance in map apps. B-Bridge has developed a navigation technology that displays arrows and routes in the direction of travel superimposed on smartphone real-view camera images, and was granted a patent in 2021 (Patent No. 6828934). Google Maps' AR navigation function (Live View) has become a hot topic, and BeBridge's technology improves accuracy with its unique functions.
[Technical Features] This AR navigation incorporates the company's proprietary position correction algorithm in addition to current location and direction information from the smartphone's GPS and electronic compass. Specifically, it combines map data and sensor information to highly accurately estimate the user's ``desired walking area,'' and corrects the direction and position of the arrows that should be displayed. As a result, even if the GPS deviates in a built-up area, it is difficult to deviate from the route, and even in environments where the GPS is temporarily interrupted, such as underground malls or indoor parking lots, the system is able to continue navigating offline from the starting position and orientation.
[Specific effects] Route guidance linked to real scenery is displayed on the screen, allowing you to intuitively solve traditional problems such as ``I can't find my destination even when I look at a map'' and ``I don't know which way to go after exiting.'' In particular, B-Bridge's technology has improved guidance accuracy at night and in narrow alleys, making it easier to reach areas that are difficult to reach. In the future, there are plans for character-based guidance displays and collaboration with public transportation (MaaS), and this patented technology can significantly revolutionize the user experience of pedestrian navigation systems.
[Case Summary] Application of AR technology is progressing in the agricultural field as well. A research team led by Professor Norihito Kawasue of the Faculty of Engineering at the University of Miyazaki has developed a system that measures a pig's weight with a camera and displays it on AR glasses, ``Glasses that allow you to see the pig's weight,'' and is currently applying for an international patent in 2021. Traditionally, pig farmers weighed hundreds of pigs one by one on a scale to determine the appropriate age for shipping, a process that was both hard work and stressful for the pigs. This technology allows this work to be performed instantly and without contact.
[Technical Features] The system consists of a 3D camera with depth sensor and smart glasses. When a worker looks at a pig using AR glasses, the pig's body shape data captured by the camera is sent to a computer in real time. An estimation algorithm using AI (deep learning) calculates the carcass weight (body weight) from its body shape and displays the result superimposed on the glass display. For example, "Pig No. XX: Estimated 115 kg" is an image of a number superimposed on the shape of a pig.
[Specific effects] The measurement error is highly accurate, within a few percent, and it is possible to determine at a glance whether the pigs have reached the ideal shipping weight of 115 kg. As a result, wasteful fattening is eliminated and the appropriate shipping time is not missed. It also makes it easier to manage individual animals during group breeding, which was difficult to do manually. Best of all, it eliminates the need for the heavy labor of catching large pigs and placing them on a scale, significantly reducing the physical strain on the operator. In the future, it is being considered to install fixed cameras in pigpens and apply it to a system for automatic judgment and automatic sorting, and it is attracting attention both domestically and internationally as an advanced example of livestock IoT/AI.
[Case Summary] Don't miss the patent publication (Unexamined Patent Publication No. 2024-94883) for Retinal Projection AR Glasses by TDK, a major electronic components company. This is an advanced AR display technology that incorporates a laser scanning projection device into a wearable glasses-type device to draw images directly onto the user's retina. The display methods of transmissive AR glasses, including Apple's "Vision Pro" which has been a hot topic in recent years, are broadly divided into transmissive liquid crystal/organic EL types and projector types, but this patent takes the latter approach of direct retinal projection using an ultra-compact projector.
[Technical Features] The device has a built-in semiconductor laser light source and a small MEMS mirror (movable mirror), and this mirror scans the laser light at high speed to scan and draw images. The biggest feature is that the entire inner surface of the eyeglass lens is used as a screen. It has a structure in which a large number of extremely small reflectors are lined up on the inner surface of the lens, and when laser light hits the pixel area covered by each unit reflector, it is reflected toward the retina. By devising the arrangement pattern of the unit reflectors and laser scanning control, we are able to form a high-resolution virtual image on the retina while making the reflectors on the lens almost invisible to the naked eye.
[Specific effects] This technology enables AR display that combines wide viewing angles and clear images even with glasses-type devices. Conventional transmissive HMDs had the disadvantage that the display and mirrors partially obstructed the view, but with this model, the reflector is minute, so obstruction to the view is minimized. Another advantage is that because it projects directly onto the retina, an in-focus image can always be obtained regardless of the eye's refractive adjustment. As a result, we will contribute to the realization of next-generation smart glasses that can clearly see AR information superimposed on real-world scenery without any discomfort. It is expected to have a wide range of applications from industrial use to entertainment, and can be said to be a fundamental technology that will dramatically improve the display quality of AR glasses.
As mentioned above, the AR/VR-related patents filed and registered in Japan in the last five years include technologies in a wide variety of fields, from games, medicine, industry, and agriculture. Advanced ideas are being published as patents not only by major companies but also by startups and university research teams, indicating that the AR/VR field is developing across the board. Especially in recent years, research and development has accelerated with keywords such as smart glasses, AR cloud, and metaverse, and this is reflected in patent applications. By keeping an eye out for published patent information, you will be able to quickly grasp the direction of next-generation AR/VR solutions.
References/information sources: Patent information platform (J-PlatPat), company press releases, patent publications (patent publications/patents) data, etc.
🚀 For those considering applying for an IT patent
Get strong patent rights for inventions in software, SaaS, IoT, AI, and mobile apps.
A patent attorney well-versed in the IT field will help you obtain rights that protect your business's competitive advantage. Estimates and initial consultations are free.
AUTHOR
Takefumi SUGIURA （杉浦 健文）
EVORIX Intellectual Property Law Firm Managing Patent Attorney
Supports clients across IT, manufacturing, startups, fashion, and medical industries, covering patent, trademark, design, and copyright filings through trials and infringement litigation. Specialized in IP strategy for AI, IoT, Web3, and FinTech. Member of the Japan Patent Attorneys Association (JPAA), Asian Patent Attorneys Association (APAA), and Japan Trademark Association (JTA).