Holographic optical elements (HOEs) are based on the principle of holography, which can implement arbitrary functions such as convex lenses and concave mirrors. The performance of HOEs is expected to be enhanced by a cooperative operation of multiple HOEs. However, the design of multiple HOEs is difficult to achieve with conventional design methods such as ray tracing software. We will introduce the HOE design of the cooperative operation by machine learning. In this work, we implemented a diffractive deep neural network (D2NN) to realize the cooperative operation by multiple HOEs at the visible wavelengths. D2NN is a kind of optical neural network that is represented by light propagation, and it is implemented by multiple DOEs that can represent arbitrary optical functions. However, multiple-layer HOEs cause noise to be overlapped on the output wavefront since the HOE generates unnecessary lights such as the direct light and high-order lights. Therefore, we implemented the D2NN consisting of two layers of HOEs by an off-axis D2NN, which avoids this obstacle. The two-layer HOEs were trained to perform a classification task of handwritten digits as a task. The trained D2NN model with HOEs was evaluated in a numerical simulation, achieving 87.1% accuracy in the simulation. The method enables the design of cooperative operation of multiple HOEs, it enables HOEs to achieve more complex and higher performance functions.
Holography is the ultimate three-dimensional (3D) imaging technology, and research is actively being conducted on generating at high-speed holograms with enormous amounts of information and improving image quality. Because computer holography is based on wave optics algorithms, reconstructing the texture of 3D images is difficult. On the other hand, in principle, reconstructing texture in integral photography based on geometric optics is easy and the method is well established. We developed a high-performance special-purpose computer, called holographic reconstruction for ultra-realistic imaging, dedicated to the ray-wavefront conversion method. The design and implementation of the circuit for the hologram generation were performed using field-programmable gate array technology. Parallelization was performed at each step for increasing the speed of the calculation process. Furthermore, by sending output data directly to a displaying device in the high-definition multimedia interface, the communication between the host personal computer (PC) and special-purpose computer was controlled in one direction, which significantly reduced communication time. The system was ∼7.7 times faster than a PC alone and succeeded in the holographic reproduction of a textured 3D image in real time at 30 frames per second for a 1024 × 1024-pixel hologram.
Phase-shifting interferometry selectively extracting wavelength information has been proposed since 2013, which is called computational coherent superposition (CCS) of multiple wavelengths. In this proceeding, we apply CCS to self-interference incoherent holography and construct single-path, mechanical-motion-free, wavelength-multiplexed, incoherent multicolor digital holographic microscopy systems. Also, we numerically investigate quantum fluctuation in phase-shifting interferometry for the sensing of weak light such as natural light and nonlinear light. After that, we briefly discuss the difference between the digital holography systems with CCS and phase-shifting interferometry with a Bayer color image sensor.
We can record digitally-designed information of three-dimensional (3D) objects or optical elements on a holographic photosensitive material by using wavefront printing technology. But the hologram data generated from the digitally-designed information are very huge and there are often the occurrences of the unnecessary bidirectional communications. To solve this problem, we studied on a special-purpose computer for wavefront printing technology. This technique consists of generating the light-ray information from digitally-designed information of 3D objects, converting the light-ray information to the wavefront information and generating the hologram data locally from the wavefront information in interaction. In this paper, we designed the emulator of the special-purpose computer for wavefront printing technology and obtained the amount of information (the number of bits) required for the circuit by comparing the 3D images reconstructed from the holograms generated by the emulator. As a result, the amount of information of the wavefront information converted from the light-ray information most affected the quality of the 3D images reconstructed from the holograms generated by the emulator and we can design the emulator that can reduce the noise component from those 3D images. In the future, we will design the special-purpose computer for wavefront printing technology by using hardware description language and implement that special-purpose computer on a programmable logic device such as a field programmable gate array.
KEYWORDS: Holography, Wavefronts, Printing, 3D displays, 3D printing, Electromagnetism, Communication engineering, Communication and information technologies, Photonics, Electro-optical engineering
In this paper, we introduce hologram printing technology. This technology includes the following technologies, computer-generated hologram, hologram printer, duplication, and application-depended technologies. When this technology is applied to static hologram, the media can present static 3D objects more clearly than traditional 3D technologies such as lenticular lens and integral photography(IP) because it is based on holography. When this technology is applied to holographic optical elements(HOE), the HOE will be useful for many purposes especially for large optical elements. For example, when it is used as screen, the visual system which consists of the screen and projector can present dynamic 2D or 3D objects. Since this technology digitally designs hologram/HOE and manufactures them by wavefront printer, it is good at generating small lot of production. As a result, it is effective for the research stage of both 2D and 3D display. In addition, it is also effective for commercial stage due to simple duplication method.
Several wavefront printers have been recently proposed. Since the printers can record an arbitrary computer-generated wavefront, they are expected to be useful for fabricating complex mirror arrays used in front projection 3-D screens without using real existing optics. We prototyped two transparent reflective screens using our hologram printer in experiments. These screens could compensate for a spherically distorted reference wave caused by a short projection distance to obtain an ideal reference wave. Owing to the use of the wavefront-printed screen, the 3-D display was simply composed of a normal 2-D projector and a screen without using extra optics. In our binocular system, reflected light rays converged to the left and right eyes of the observer and the crosstalk was less than 8%. In the light field system, the reflected light rays formed a spatially sampled light field and focused a virtual object in a depth range of ±30 mm with a ±13.5-deg viewing angle. By developing wavefront printing technology, a complex optics array may easily be printed by nonprofessionals for optics manufacturing.
Wavefront printing for a digitally-designed hologram has got attentions recently. In this printing, a spatial light modulator (SLM) is used for displaying a hologram data and the wavefront is reproduced by irradiating the hologram with a reference light the same way as electronic holography. However, a pixel count of current SLM devices is not enough to display an entire hologram data. To generate a practical digitally-designed hologram, the entire hologram data is divided into a set of sub-hologram data and wavefront reproduced by each sub-hologram is sequentially recorded in tiling manner by using X-Y motorized stage. Due to a lack of positioning an accuracy of X-Y motorized stage and the temporal incoherent recording, phase continuity of recorded/reproduced wavefront is lost between neighboring subholograms. In this paper, we generate the holograms that have different size of sub-holograms with an overlap or nonoverlap, and verify the size of sub-holograms effect on the reconstructed images. In the result, the reconstructed images degrade with decreasing the size of sub-holograms and there is little or no degradation of quality by the wavefront printing with the overlap.
KEYWORDS: Wavefronts, Printing, 3D image reconstruction, Holograms, Holography, Diffraction, Spatial light modulators, 3D acquisition, 3D image processing, 3D printing
A hologram recording technique, generally called as “wavefront printer”, has been proposed by several research groups for static three-dimensional (3D) image printing. Because the pixel number of current spatial light modulators (SLMs) is not enough to reconstruct the entire wavefront in recording process, typically, hologram data is divided into a set of subhologram data and each wavefront is recorded sequentially as a small sub-hologram cell in tiling manner by using X-Y motorized stage. However since previous works of wavefront printer do not optimize the cell size, the reconstructed images were degraded by obtrusive split line due to visible cell size caused by too large cell size for human eyesight, or by diffraction effect due to discontinuity of phase distribution caused by too small cell size. In this paper, we introduce overlapping recording approach of sub-holograms to achieve both conditions: enough smallness of apparent cell size to make cells invisible and enough largeness of recording cell size to suppress diffraction effect by keeping the phase continuity of reconstructed wavefront. By considering observing condition and optimization of the amount of overlapping and cell size, in the experiment, the proposed approach showed higher quality 3D image reconstruction while the conventional approach suffered visible split lines and cells.
KEYWORDS: Holograms, Holography, Photography, 3D image reconstruction, Video, Spatial light modulators, 3D displays, 3D image processing, Diffraction, Video acceleration
This paper describes electronic holography output of three-dimensional (3D) video with integral photography as input. A real-time 3D image reconstruction system was implemented by using a 4K (3840×2160) resolution IP camera to capture 3D images and converting them to 8K (7680×4320) resolution holograms. Multiple graphics processing units (GPUs) were used to create 8K holograms from 4K IP images. In addition, higher resolution holograms were created to successfully reconstruct live-scene video having a diagonal size of 6 cm using a large electronic holography display.
A holographic TV system based on multiview image and depth map coding and the analysis of coding noise effects in reconstructed images is proposed. A major problem for holographic TV systems is the huge amount of data that must be transmitted. It has been shown that this problem can be solved by capturing a three-dimensional scene with multiview cameras, deriving depth maps from multiview images or directly capturing them, encoding and transmitting the multiview images and depth maps, and generating holograms at the receiver side. This method shows the same subjective image quality as hologram data transmission with about 1/97000 of the data rate. Speckle noise, which masks coding noise when the coded bit rate is not extremely low, is shown to be the main determinant of reconstructed holographic image quality.
We have recently developed an electronic holography reconstruction system by tiling nine 4Kx2K liquid crystal on silicon (LCOS) panels seamlessly. Magnifying optical systems eliminate the gaps between LCOS panels by forming enlarged LCOS images on the system’s output lenses. A reduction optical system reduces the tiled LCOS images to the original size, returning to the original viewing zone angle. Since this system illuminates each LCOS panel through polarized beam splitters (PBS) from different distances, viewing-zone-angle expansion was difficult since it requires illumination of each LCOS panel from different angles. In this paper, we investigated viewing-zone-angle expansion of this system by integrating point light sources in the magnifying optical system. Three optical fibers illuminate a LCOS panel from different angles in time-sequential order, reconstructing three continuous viewing-zones. Full-color image reconstruction was realized by switching the laser source among R, G, and B colors. We propose a fan-shaped optical fiber arrangement to compensate for the offset of the illumination beam center from the LCOS panel center. We also propose a solution for high-order diffraction light interference by inserting electronic shutter windows in the reduction optical system.
Electronic holography technology is expected to be used for realizing an ideal 3DTV system in the future, providing
perfect 3D images. Since the amount of fringe data is huge, however, it is difficult to broadcast or transmit it directly. To
resolve this problem, we investigated a method of generating holograms from depth images. Since computer generated
holography (CGH) generates huge fringe patterns from a small amount of data for the coordinates and colors of 3D
objects, it solves half of this problem, mainly for computer generated objects (artificial objects). For the other half of the
problem (how to obtain 3D models for a natural scene), we propose a method of generating holograms from multi-view
images and associated depth maps. Multi-view images are taken by multiple cameras. The depth maps are estimated
from the multi-view images by introducing an adaptive matching error selection algorithm in the stereo-matching
process. The multi-view images and depth maps are compressed by a 2D image coding method that converts them into
Global View and Depth (GVD) format. The fringe patterns are generated from the decoded data and displayed on
8K4K liquid crystal on silicon (LCOS) display panels. The reconstructed holographic image quality is compared using
uncompressed and compressed images.
This paper introduces two 3D visual systems toward ultra-realistic communication. The first system includes integral photography video camera that uses a lens array and a 4K2K-resolution video camera for the capture of ray information at slightly separated locations. The second system includes camera array that uses 300 cameras to capture ray information at more sparse locations than integral photography. Both systems use electronic holography as an ideal 3D display. These systems are characterized in that the ray-based image sensors are used to capture 3D objects under natural light and electronic holography is used to reconstruct the 3D objects.
Phase-shifting digital holography is a hologram capture method used for natural scenes. We propose a method for
enlarging the viewing-zone angle for the electronic holography input. During hologram generation, if we use multiple
reference beams or multiple object beams whose incident angles differ slightly from each other, the viewing-zone angle
of the phase-shifted hologram can be expanded several times compared to the original. In the experiment, a phase-shifted
hologram with a viewing-zone angle of 16 degrees was generated using 3 object beams whose incident angles differ
from each other by 5.6 degrees.
We have developed some prototype systems for ultra-realistic communication in future using electronic holography as 3D display, since electronic holography is the technology to reconstruct ideal 3D objects in space. In this paper, we describe the basis of the systems and introduce three of them, i.e., a real-time electronic holography system with integral photography, wide viewing-zone-angle electronic holography system, and electronic holography system with camera array.
Computer generated holograms (CGH) are expected in holography 3D display for the reconstruction of realistic or artistic virtual 3D objects. We propose a CGH approach that combines computer graphics (CG) technology and wave propagation theory. Our approach is based on the following assumptions. Virtual 3D objects are described by the popular computer graphics format that uses a set of triangular surfaces, and CG technology can be used to render ray information on these surfaces. The hologram plane is flat. Each triangular surface is tilted (that is, not parallel) relative to the hologram plane. An advantage of our approach is that even though the surfaces are tilted, the sampling pitch on the tilted surfaces can be defined.
KEYWORDS: Cameras, Holography, Stereo holograms, 3D displays, Stereoscopic cameras, Holograms, Signal processing, Current controlled current source, Fourier transforms, Optical design
Holographic stereograms can display 3D objects by using ray information. To display high quality representations of real 3D objects by using holographic stereograms, relatively dense ray information must be prepared as the 3D object information. One promising method of obtaining this information uses a combination of a camera array and view interpolation which is signal processing technique. However, it is still technically difficult to synthesize ray information without visible error by using view interpolation. Our approach uses a densely arranged camera array to reduce this difficulty. Even though view interpolation is a simple signal processing technique, the synthesized ray information produced by this camera array should be adequate. We designed and manufactured a densely arranged camera array and used it to generate holographic stereograms.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.