Next-Gen Hyperspectral Processing: Transforming UAV Platforms With Real-Time 3D Hypermesh

Significant advancements in processing power relative to both weight and power consumption have dramatically increased the computational capabilities available on lightweight platforms such as UAVs. HySpex has collaborated with the Norwegian Research Centre and ReSe Applications GmbH to develop hardware and software for converting raw hyperspectral data into fully visualized 3D hypermesh, as well as application-specific mesh tailored to diverse needs.

One of the key challenges is properly co-registering VNIR (visible and near-infrared) and SWIR (short-wave infrared) imaging spectrometers, which have distinct sampling point spread functions. Aligning the point spread functions of these two systems is essential for achieving high spectral fidelity at the pixel level. A solution involves merging data from the VNIR and SWIR spectrometers to cover the full spectrum from 400nm to 2500nm, producing a unified hyperspectral dataset that maintains spectral fidelity across the entire spectral range. Also, the digital surface model is crucial for precise 3D scene reconstruction, and advanced processing techniques generate surface models in real time, which are represented in the mesh, allowing for ray tracing. This presentation will demonstrate how these technologies function in a real-world mining environment, providing valuable insights into the terrain and material composition.

About the presenter
Trond Løke has a master’s degree in photonics from the Norwegian University of Science and Technology (NTNU). He calibrated and characterized Norsk Elektro Optikk's (NEO) first hyperspectral system in 2002 and was part of designing HySpex’s first hyperspectral imaging system in 2003, eventually becoming the CTO. In 2020, Løke became the CEO of NEO located in Oslo, Norway.