Hyperspectral recovery from RGB images using Gaussian Processes

Research output: Contribution to journalArticlepeer-review

54 Citations (Scopus)
154 Downloads (Pure)


We propose to recover spectral details from RGB images of known spectral quantization by modeling natural spectra under Gaussian Processes and combining them with the RGB images. Our technique exploits Process Kernels to model the relative smoothness of reflectance spectra, and encourages non-negativity in the resulting signals for better estimation of the reflectance values. The Gaussian Processes are inferred in sets using clusters of spatio-spectrally correlated hyperspectral training patches. Each set is transformed to match the spectral quantization of the test RGB image. We extract overlapping patches from the RGB image and match them to the hyperspectral training patches by spectrally transforming the latter. The RGB patches are encoded over the transformed Gaussian Processes related to those hyperspectral patches and the resulting image is constructed by combining the codes with the original Processes. Our approach infers the desired Gaussian Processes under a fully Bayesian model inspired by Beta-Bernoulli Process, for which we also present the inference procedure. A thorough evaluation using three hyperspectral datasets demonstrates the effective extraction of spectral details from RGB images by the proposed technique.

Original languageEnglish
Article number8481553
Pages (from-to)100-113
Number of pages14
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Issue number1
Publication statusPublished - 1 Jan 2020


Dive into the research topics of 'Hyperspectral recovery from RGB images using Gaussian Processes'. Together they form a unique fingerprint.

Cite this