RamanMAE: Masked Autoencoders Enable Efficient Molecular Imaging by Learning Biologically Meaningful Spectral Representations
This article has been Reviewed by the following groups
Discuss this preprint
Start a discussion What are Sciety discussions?Listed in
- Evaluated articles (Arcadia Science)
Abstract
Article activity feed
-
-
We compared the performance ofRamanMAE-based smoothing with the Savitzky-Golay algo-rithm (which is sensitive to polynomial order and windowsize choices) and found that RamanMAE provides equivalentor slightly better similarity between reconstructions from thelow and high SNR spectra
from the plots, it seems like using S-G for denoising is comparable to RamanMAE. it would be good to know what the advantage is of RamanMAE as a much more computationally intensive algorithm
-
Figure 1.
i am confused how the 2D representation (image) is actually created. does the wrapping go patch-by-patch or by the entire width of the image? perhaps an illustration could be useful.
-
Overall, these re-sults show that the RamanMAE embeddings capture biolog-ically relevant information and have utility for downstreamclassification tasks in challenging biological datasets
I agree that this analysis sounds promising, but I think it would be more convincing with a comparison to more traditional methods (e.g. random forest after PCA or NMF)
-
e shaped400-dimensional Raman spectra in the fingerprint wavenum-ber region
Since several different datasets were used here, what preprocessing was necessary to obtain spectra with this consistent range and resolution? Was it necessary to upsample or downsample the spectra from some datasets?
-
As expected, the UMAP projection showsthat the P231, CTC, and LM cells are progressively clustered
I would be very cautious about drawing this (or any) conclusions on the basis of a UMAP, as UMAP embeddings can be strongly dependent on hyperparameter choices.
-
Since the circulating tumor cells will have a population ofcells that will become lung metastatic cells in the future, asignificant degree of overlap between CTC and LM cells isreasonably expected
I'm not sure I follow this: just because some CTCs will eventually become metastatic doesn't necessarily mean that they will look similar or "overlap" in the present.
-
We split the entire high SNR dataset into training,validation, and test dataset
I think more details abour how the data were split into train and test sets would be important to include here. From reading the supmat of [20], it sounds like the 172k spectra were obtained from 11 hyperspectral images, implying that many of the individual spectra are likely to be highly correlated, so I think care would be needed when splitting into train/test sets to avoid data leakage (e.g. perhaps by splitting at the level of the original hyperspectral images)
-
We leveraged a large publicly available Raman spec-tral datase
This is missing a citation - presumably this dataset was from [20]?
-
we useda masking ratio of 0.5 to randomly mask half the region ofthe spectra in each step
Could you comment on this was value was chosen? It seems like it could be a really important hyperparameter...
-
For each spectrum,we used a patch size of 16 in 1D spectra, which translatedto a patch size of 4 in 2D image, yielding 16 patches foreach spectrum
If the spectra are 400-dimensional and the patch size is 16, there would be 20 patches per spectrum, not 16.
-
