Open access peer-reviewed chapter

Holographic Pepper’s Ghost: Upright Virtual-Image Screen Realized by Holographic Mirror

Written By

Tomoya Nakamura, Shinji Kimura, Kazuhiko Takahashi, Yuji Aburakawa, Shunsuke Takahashi, Shunsuke Igarashi, Shiho Torashima and Masahiro Yamaguchi

Submitted: 22 November 2018 Reviewed: 04 March 2019 Published: 27 March 2019

DOI: 10.5772/intechopen.85600

From the Edited Volume

Holographic Materials and Applications

Edited by Manoj Kumar

Chapter metrics overview

1,502 Chapter Downloads

View Full Metrics

Abstract

A holographic mirror is a reflection-type holographic optical element that works as an off-axis mirror. It realizes an upright see-through screen serving as a virtual-image display and virtual camera. Such screen enables to realize virtual-image-based attractive applications like Pepper’s ghost only with a thin optical system. This chapter describes the concept of a holographic-mirror-based virtual-image display and virtual camera, an experimental method for exposing the holographic mirror based on holographic printing, methods for dispersion compensation, and experimental results for the proposed virtual-image display and camera.

Keywords

  • holographic optical element
  • virtual-image display
  • virtual camera
  • dispersion compensation
  • volume hologram
  • Pepper’s ghost

1. Introduction

The fusion of optical images and real objects has been an interesting topic in the field of optics and information technology. A famous example is Pepper’s ghost [1], which was invented over 100 years ago. In Pepper’s ghost, a virtual image is displayed on real objects by using a slanted half mirror, which can realize surprising visual experiences like optical illusions. The perception of cyber-physical fusion using virtual images mainly relies on the imperceptibility of the frame of the display, which is caused by an axial displacement between the image plane and the screen plane. Recently, such technology has been revisited in the context of augmented reality (AR). For example, virtual imaging has been used in various applications from head-mounted displays (HMDs) [2] to public theaters [3], where digital images are displayed as overlapping on real objects.

A holographic optical element (HOE) is capable of implementing various flexible optical functions on a thin, flat, and transparent film based on wavefront recording and reconstruction. Many applications of HOEs exploit their flexibility in performing optical functions and their see-through characteristics. HOEs have been applied to head-up displays (HUDs) [4], head-mount displays (HMDs) [2, 4, 5, 6, 7, 8], bidirectional displays [9], see-through diffusive screens [10] projection-type three-dimensional (3-D) displays [11, 12, 13, 14], 3-D user interfaces [15], wearable eye-gaze detection systems [16], solar-power generation systems [17], vibration and temperature measurements [18, 19], and 3-D telepresence systems [20].

To realize the virtual-image-based applications only with a thin optical system, we have proposed a new optical system that integrates an HOE-based mirror referred as holographic mirror, dispersion-compensation optics, and a digital projector [21]. We also showed that a similar optical design can be applied to the realization of a virtual camera, by using a virtualization method of a camera device based on off-axis image capturing [21]. In this chapter, we describe background on the virtual-image-based applications in Section 2, a method for exposing a holographic mirror in Section 3, the concept and verification of the proposed virtual-image display in Section 4, and the concept and verification of the proposed virtual camera in Section 5. More detailed background information for the work described here is given in [21].

Advertisement

2. Holographic Pepper’s ghost

Pepper’s ghost is an illusion technique exploiting virtual images. Since the virtual image is formed outside the frame of a display, it is perceived as if it was appearing on the air. This feature is useful for realizing the unconventional visual systems based on cyber-physical fusion, which is recently referred as AR technology. This kind of visual applications can provide attractive and surprising user experiences such as the ultra-realistic telepresence system.

The classical realization of an optical system for the Pepper’s ghost is based on the use of a slanted half mirror, like that in Figure 1(a). It is simple to realize this arrangement of the optical system; however, the optical system will likely be bulky due to the tilted alignment. If the screen for a virtual-image display could be implemented in an upright alignment like Figure 1(b), it could be integrated with flat walls, doors, windows, and existing 2-D screens. Such usage might be interesting because it allows ordinary environments to be converted into screens for virtual-image display. For instance, an ordinary wall can serve as a screen for a virtual-image-based video-communication system [22]. Figure 2 presents the concept on such system realized by the holographic Pepper’s ghost which is presented in this chapter. In the figure, a person is talking with a virtual image of another person on a real chair behind an upright window with achieving the line of sight. Exploiting the feature of the holographic mirror, a display for virtual-image formation can be realized by an upright thin screen unlike the conventional Pepper’s ghost with a slanted half mirror.

Figure 1.

Concept on (a) Pepper’s ghost and (b) holographic Pepper’s ghost.

Figure 2.

An example of a virtual-image-based video-communication system based on the holographic Pepper’s ghost. A person is talking with a virtual image on a real chair placed behind an upright window.

An HOE can be used for realizing such an upright virtual-image screen. Since an HOE is a kind of hologram, flexible optical functions can be implemented on a thin flat film by means of wavefront recording and reconstruction. For example, it is possible to realize a holographic mirror which works as an off-axis mirror by Bragg diffraction. The holographic mirror can be used for an upright virtual-image screen as mentioned above and shown in Figure 1(b). One problem in applying a holographic mirror to a virtual-image screen is the chromatic dispersion caused by diffraction, which results in spatial blurring of the virtual image. This problem can simply be solved by using a laser light source; however, especially when presenting a large, deep virtual image, safety and speckle become problems. Insertion of a band-pass filter is another possible solution [16]; however, this reduces the light-use efficiency.

Advertisement

3. Exposure of a holographic mirror using a hologram printer

A holographic mirror can simply be implemented by exposing a photosensitive material using two coherent parallel beams. Figure 3(a) shows the experimental setup used in our experiment. In the setup, a diode-pumped solid-state (DPSS) laser (Samba 100 mW manufactured by Cobolt, 532 nm) was used as a light source. A half-wave plate (HWP) and a polarization beam splitter (PBS) were placed in front of the laser to split the beam with a controlled intensity ratio. In addition, an acousto-optic modulator (AOM) was inserted to function as an electrical shutter. The two beams were delivered by polarization-maintaining single-mode optical fiber (pmSMF) to regions close to the photosensitive material. We used a photopolymer (Bayfol HX200 manufactured by Covestro) as the photosensitive material. The photopolymer was exposed by the interference fringes. We adopted the scanning-based exposure method called holographic printing [23, 24, 25, 26, 27, 28, 29] to realize spatially uniform diffraction efficiency of the holographic mirror. The photopolymer was mounted on a two-axes-motorized stage for scanning.

Figure 3.

(a) Experimental setup for exposing a holographic mirror and (b) the appearance of the diffracted light (a star on a spatially uniform background) by the exposed holographic mirror.

The angle between the two beams incident on the photopolymer was set to 135 ° . The duration of each exposure was 10 ms, and the diameter of each beam on the photopolymer was 1.1 mm. The total number of scans was 175 × 175 . The spatial interval of each scan was 0.8 mm, and the time interval between scans was 2 s. The overall size of the holographic mirror was 14  × 14 cm. The appearance of a virtual image of a white paper including a star symbol formed with an exposed holographic mirror is shown in Figure 3(b). Thanks to the holographic printing, the brightness of the image was spatially uniform. The diffraction efficiency measured based on ISO 17901-1 was 72.4% at 526.4 mm. More detailed information is given in [21].

Advertisement

4. Virtual-image display using a holographic mirror and dispersion-compensation optics

Since the holographic mirror is a volume hologram, the diffracted light should disperse chromatically, and this chromatic dispersion results in spatial blurring of the virtual image. The size of the blur caused by dispersion can be modeled as follows:

b = z λ λ tan θ E1

where b is the size of the blur, z is the depth of the virtual image from the holographic mirror, λ is the range of transmissive wavelengths through the holographic mirror, λ is the central wavelength of the propagating light, and θ is the diffraction angle of the holographic mirror. For a more generalized model, see [21]. As indicated by Eq. (1), the size of the blur linearly scales with the depth of the virtual image, the spectral width of the light, and the diffraction angle of the holographic mirror.

To suppress the blur, dispersion compensation is necessary. Figure 4 illustrates the concept in the case of an integrated optical system with a holographic mirror, projection optics, and blur-compensation optics. The key idea is the replacement of a real display with an intentionally dispersed image, which contributes to dispersion compensation of the holographic mirror. In the system, a projector projects an image on a diffuser via a diffractive optical element (DOE). In such an optical system, a dispersed image appears on the diffuser screen. If the direction and the amount of dispersion are correctly designed for dispersion compensation, the spatial blur of the virtual image can be compensated. As a result, an observer can see a sharp virtual image through the holographic mirror.

Figure 4.

Optical design of the virtual-image display with a holographic mirror and diffuser-based blur-compensation optics.

As a related method, dispersion compensation using two identical HOEs was proposed [30, 31]. Compared with the conventional method, the advantages of the proposed DOE-based method are superior light-use efficiency and a practical level of blur suppression [21]. As mentioned also in the Introduction section, another related method is to limit the spectral width by using a laser light source or a band-pass filter. Compared with this method, our method has merits from the perspective of safety and brightness.

We verified the proposed method using the setup in Figure 5. We placed a reflection-type DOE (VIS Holographic Grating manufactured by Edmund optics) having 1200 grooves per millimeter in a 50 mm square in front of a projector (EH-TW5200 by EPSON) with an internal metal halide lamp. We also placed an A4-sized diffuser screen and a holographic mirror described in the previous section. We set the distance between the diffuser and the holographic mirror to 600 mm, and that between the DOE and the diffuser to 600 mm. The design conditions for the system parameters are presented in [21].

Figure 5.

Setup for experimental verification of the proposed virtual-image display.

Figure 6(a) shows the images projected on the diffuser without and with a DOE. The images without the DOE were generated by replacing the DOE with a mirror. As shown in the figure, the image with the DOE was chromatically dispersed along the direction of diffraction (in this case, vertical direction). The images were severely blurred in direct observation; however, these are the expected results.

Figure 6.

(a) Projected images on a diffuser and (b) virtual images displayed by the proposed virtual-image display without and with a DOE.

Figure 6(b) shows the virtual images generated without and with a DOE, captured by a camera placed at the observer’s position. The results without the DOE indicate that the virtual images were blurred along the dispersion direction. In contrast, the virtual images with the DOE were successfully resolved even along the dispersion direction. Using a resolution chart, the vertical resolution was improved from 0.12 to 0.42 cycle/mm.

Figure 7 shows the depth of the virtual images from multiple observations while changing the observer’s position. As indicated in the figure, motion parallax was confirmed experimentally with a blur-compensated virtual image. In addition, since the camera focused on the virtual mirror, the holographic-mirror screen was defocused. These observations show the displacement of the axial position of the holographic mirror working as a screen and the displayed virtual image.

Figure 7.

Experimental virtual images observed while changing the viewing position.

Advertisement

5. Virtual camera using holographic mirror and dispersion-compensation optics

The virtual-image display having the geometry in Figure 1(b) can also work inversely by replacing the projector with a camera, which can realize a virtual camera [21]. A virtual camera is a camera in which a virtual image of a real camera captures subjects, which allows off-axis image capturing. One benefit of off-axis image capturing is that frontal shooting of the subject can be accomplished by a camera placed at an invisible position. Figure 8 illustrates the concept. In the figure, an observer in front of a holographic mirror is captured from the front as if an invisible camera were placed behind the mirror, where a real camera device is placed at an off-axis position. By integrating the virtual camera with the virtual-image display, a virtual-image screen that can also capture frontal images can be realized. Such a screen can be applied to, e.g., a virtual-image-based video-communication system that achieves line of sight image capturing [22].

Figure 8.

Optical design for the virtual camera using a holographic mirror.

To make use of the virtual camera with an upright holographic mirror, dispersion compensation is needed, as with the virtual display described above. In principle, the same optical system as that used for the virtual-image display can be adopted for the virtual camera; however, the insertion of a diffuser is not suitable for image capturing because the light intensity is severely reduced, and the intensity of environmental light sources (e.g., sunlight) cannot be controlled in general. To deal with this problem, we propose an alternative optical design without a diffuser for dispersion compensation. Figure 9 shows the concept of the proposed optical system. Compared with the display application in Figure 4, the diffuser and the projector are replaced with a convex lens and a camera, respectively. In this configuration, the light source is environmental illumination such as sunlight or room light. A convex lens is used for converting the spectrally diverging dispersed light into converging light. As a result of inserting the lens, a real image of the subject is optically formed between the lens and the DOE. A camera captures the formed real image via the DOE. Since the light is not diffused in the optical system, the light-use efficiency is superior to that of the diffuser-based display system, but on the other hand, the acceptable positions of the camera for capturing the image are restricted.

Figure 9.

Optical design of the virtual camera with a holographic mirror and the lens-based blur-compensation optics.

Figure 10 shows the setup used for experimental verification. The holographic mirror and the DOE are as same as those described in the previous section. The diameter and focal length of the lens were 100 and 300 mm, respectively. A color CCD camera (Flea3 manufactured by FLIR) was used for image capturing. The distance between the holographic mirror and the lens was 590 mm, and that between the lens and a DOE was 680 mm. Design conditions for the system parameters are given in [21].

Figure 10.

Setup for experimental verification of the proposed virtual camera.

Figure 11 shows the images experimentally captured by the proposed virtual camera system. Without a DOE, the chromatic dispersion of the holographic mirror degraded the vertical spatial resolution of the captured image. In contrast, with the DOE, the resolution degradation was successfully restored. By visual assessment of the images of a resolution chart, the vertical spatial resolution was improved from 0.80 to 1.46 cycle/mm. The result with a doll indicates the possibility of the proposed optical system for visual video-communication systems for human users.

Figure 11.

Experimentally captured images obtained by the proposed virtual camera without and with a DOE.

Advertisement

6. Conclusion

In this chapter, we introduced a technology on the holographic Pepper’s ghost based on a virtual-image display and a virtual camera using a holographic mirror and blur-compensation optics. The holographic mirror works as an off-axis mirror, which can be used for an upright screen of the virtual-image display and the virtual camera. To make use of the holographic mirror in imaging systems, compensation of chromatic dispersion is necessary for preventing resolution degradation. We proposed two optical systems that integrate DOE-based dispersion-compensation optics, imaging devices, and a holographic mirror. In the systems, the chromatic dispersion of the holographic mirror was compensated optically. We experimentally verified the realization of the concepts on the virtual-image display and the virtual camera, and the effectiveness of the dispersion compensation.

The proposed systems can be applied to upright, thin, see-through screens for virtual-image displays and virtual cameras. The system can be used for, e.g., virtual-image-based interactive displays and video-communication systems where the screen can be integrated with environmental objects like flat walls and screen panels.

Advertisement

Acknowledgments

The authors would like to thank Covestro Deutschland AG for providing the photopolymer holographic recording material.

References

  1. 1. Pepper’s ghost [Internet]. Available from: https://en.wikipedia.org/wiki/Pepper’s_ghost [Accessed: 30-01-2019]
  2. 2. Kasai I, Tanijiri Y, Endo T, Ueda H. A practical see-through head mounted display using a holographic optical element. Optical Review. 2001;8:241-244
  3. 3. Ochi D, Kamera A, Takahashi K, Makiguchi M, Takeuchi K. VR technologies for rich sports experience. In: ACM SIGGRAPH; 21:1-21:2. 2016
  4. 4. Withrington RJ. Optical display systems utilizing holographic lenses. UP Patent 3940204A; 1975
  5. 5. Farrar RA. Helmet-mounted holographic aiming sight. US Patent 3633988A; 1970
  6. 6. Mukawa H, Akutsu K, Matsumura I, Nakano S, Yoshida T, Kuwahara M, et al. A full-color eyewear display using planar waveguides with reflection volume holograms. Journal of the Society for Information Display. 2009;17:185-193
  7. 7. Yeom H-J, Kim H-J, Kim S-B, Zhang H, Li B, Ji Y-M, et al. 3D holographic head mounted display using holographic optical elements with astigmatism aberration compensation. Optics Express. 2015;23:32025-32034
  8. 8. Piao J-A, Li G, Piao M-L, Kim N. Full color holographic optical element fabrication for waveguide-type head mounted display using photopolymer. Journal of the Optical Society of Korea. 2013;17:242-248
  9. 9. Hedili MK, Freeman MO, Urey H. Transmission characteristics of a bidirectional transparent screen based on reflective microlenses. Optics Express. 2013;21:24636-24646
  10. 10. Piao M-L, Kwon K-C, Kang H-J, Lee K-Y, Kim N. Full-color holographic diffuser using time-scheduled iterative exposure. Applied Optics. 2015;54:5252-5259
  11. 11. Jang G, Lee C-K, Jeong J, Li G, Lee S, Yeom J, et al. Recent progress in see-through three-dimensional displays using holographic optical elements. Applied Optics. 2016;55:A71-A85
  12. 12. Wakunami K, Hsieh P-Y, Oi R, Senoh T, Sasaki H, Ichihashi Y, et al. Projection-type see-through holographic three-dimensional display. Nature Communications. 2016;7:12954
  13. 13. Yamaguchi M. Light-field and holographic three-dimensional displays. Journal of the Optical Society of America A. 2016;33:2348-2364
  14. 14. Nakamura T, Yamaguchi M. Rapid calibration of a projection-type holographic light-field display using hierarchically upconverted binary sinusoidal patterns. Applied Optics. 2017;56:9520-9525
  15. 15. Yamaguchi M, Higashida R. 3D touchable holographic light-field display. Applied Optics. 2016;55:A178-A183
  16. 16. Zhou M, Matoba O, Kitagawa Y, Takizawa Y, Matsumoto T, Ueda H, et al. Fabrication of an integrated holographic imaging element for a three-dimensional eye-gaze detection system. Applied Optics. 2010;49:3780-3785
  17. 17. Kasezawa T, Horimai H, Tabuchi H, Shimura T. Holographic window for solar power generation. Optical Review. 2016;23:997-1003
  18. 18. Bavigadda V, Jallapuram R, Mihaylova E, Toal V. Electronic speckle-pattern interferometer using holographic optical elements for vibration measurements. Optics Letters. 2010;35:3273-3275
  19. 19. Kumar M, Shakher C. Measurement of temperature and temperature distribution in gaseous flames by digital speckle pattern shearing interferometry using holographic optical element. Optics and Lasers in Engineering. 2015;73:33-39
  20. 20. Blanche P, Bablumian A, Voorakaranam R, Christenson C, Lin W, Gu T, et al. Holographic three-dimensional telepresence using large-area photorefractive polymer. Nature. 2010;468:80-83
  21. 21. Nakamura T, Kimura S, Takahashi K, Aburakawa Y, Takahashi S, Igarashi S, et al. Off-axis virtual-image display and camera by holographic mirror and blur compensation. Optics Express. 2018;26:24864-24880
  22. 22. Kimura S, Nakamura T, Takahashi S, Igarashi S, Torashima S, Yamaguchi M, et al. Research of video communication system using holographic optical elements. IEICE Technical Report. 2018;265:21-24
  23. 23. Yamaguchi M, Ohyama N, Honda T. Holographic three-dimensional printer: New method. Applied Optics. 1992;31:217-222
  24. 24. Klug M, Holzbach M, Ferdman A. Method and apparatus for recording 1-step full-color full-parallax holographic stereograms. US Patent US6330088B1; 1998
  25. 25. Brotherton-Ratcliffe D, Vergnes F, Rodin A, Grichine M. Holographic Printer. US Patent US7800803B2; 1999
  26. 26. Hong K, Park S, Yeom J, Kim J, Chen N, Pyun K, et al. Resolution enhancement of holographic printer using a hogel overlapping method. Optics Express. 2013;21:14047-14055
  27. 27. Yamaguchi T, Miyamoto O, Yoshikawa H. Volume hologram printer to record the wavefront of three-dimensional objects. Optical Engineering. 2012;51:075802
  28. 28. Nishi W, Matsushima K. A wavefront printer using phase-only spatial light modulator for producing computer-generated volume holograms. Proceedings of SPIE. 2014;9006:90061F
  29. 29. Wakunami K, Oi R, Senoh T, Sasaki H, Ichihashi Y, Yamamoto K. Wavefront printing technique with overlapping approach toward high definition holographic image reconstruction. Proceedings of SPIE. 2016;9867:98670J
  30. 30. Hartman NF. Heads-up display with holographic dispersion correcting. US Patent 4613200A; 1986
  31. 31. Klein A. Dispersion Compensation for Reflection Holography [thesis]. Cambridge: Massachusetts Institute of Technology; 1996

Written By

Tomoya Nakamura, Shinji Kimura, Kazuhiko Takahashi, Yuji Aburakawa, Shunsuke Takahashi, Shunsuke Igarashi, Shiho Torashima and Masahiro Yamaguchi

Submitted: 22 November 2018 Reviewed: 04 March 2019 Published: 27 March 2019