Hybrid simulation ray-tracing improvements for creating realistic scenes for signature assessment

Koen van der Sanden; Maarten Hogervorst; Piet Bijl

doi:10.1117/12.2680348

23 October 2023 Hybrid simulation ray-tracing improvements for creating realistic scenes for signature assessment

Koen van der Sanden, Maarten Hogervorst, Piet Bijl

Proceedings Volume 12736, Target and Background Signatures IX; 1273606 (2023) https://doi.org/10.1117/12.2680348
Event: SPIE Security + Defence, 2023, Amsterdam, Netherlands

Abstract

Our study employs a simulation technique (‘hybrid simulation’), which combines sensor imagery of real environments with virtual objects to generate realistic target imagery for signature assessment. This method is preferred over entirely virtual scenes, for which it can be challenging to replicate reality with sufficient fidelity. In prior research, we investigated three methods for creating hybrid scenes using Unity software: i) using recordings of a scale-model of the target within the scene, ii) using material capture, which involves recording probe spheres in the scene to map colors directly onto the virtual target and iii) combining 360-degree light field measurements with BRDF measurements to integrate a virtual target into the scene. Although the hybrid scenes demonstrated reasonable agreement with the validation scenes, discrepancies both in color and luminance were observed. To address this, we replaced the Unity rendering engine with the validated RADIANCE lighting simulation raytracing engine. In this study, hybrid scenes are rendered using the RADIANCE engine and compared to validation scenes. Additionally, we introduce a second layer of interaction that enables the virtual target to affect the recorded imagery. As a result, the virtual target can now create shadows and affect the appearance of the recorded imagery. The combined improvement of the rendering engine and the inclusion of the interaction between the virtual target and real environment has resulted in more realistic scenes, making them more appropriate for camouflage assessment.

Conference Presentation

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Koen van der Sanden, Maarten Hogervorst, and Piet Bijl "Hybrid simulation ray-tracing improvements for creating realistic scenes for signature assessment", Proc. SPIE 12736, Target and Background Signatures IX, 1273606 (23 October 2023); https://doi.org/10.1117/12.2680348

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available