Fig. 2

Identifying the spectral information from captured leaky mode pattern images. a The transformer architecture used for spectra reconstruction. MobileViT units are used to introduce the benefits of both CNN and transformer. The 4 sets of images in the center are the activations of the first convolutional layer and the three mobileViT blocks, respectively. b Clustering of leaky mode patterns visualizes the high accuracy of the reconstructed results. Here 10 different clusters are used to show the identification results of 1000 patterns of different wavelengths. c Reconstruction of tested peak spectra. The black dashed lines indicate the ground truths, while the solid lines are the corresponding predicted spectra. The working bandwidth is limited by the performance of our silicon CIS used