Bio-friendly long-term subcellular dynamic recording by self-supervised image enhancement microscopy

This article has been Reviewed by the following groups

Read the full article

Listed in

Log in to save this article

Abstract

Fluorescence microscopy has become an indispensable tool for revealing the dynamic regulation of cells and organelles. However, stochastic noise inherently restricts optical interrogation quality and exacerbates observation fidelity when balancing the joint demands of high frame rate, long-term recording and low phototoxicity. Here we propose DeepSeMi, a self-supervised-learning-based denoising framework capable of increasing signal-to-noise ratio by over 12 dB across various conditions. With the introduction of newly designed eccentric blind-spot convolution filters, DeepSeMi effectively denoises images with no loss of spatiotemporal resolution. In combination with confocal microscopy, DeepSeMi allows for recording organelle interactions in four colors at high frame rates across tens of thousands of frames, monitoring migrasomes and retractosomes over a half day, and imaging ultra-phototoxicity-sensitive Dictyostelium cells over thousands of frames. Through comprehensive validations across various samples and instruments, we prove DeepSeMi to be a versatile and biocompatible tool for breaking the shot-noise limit.

Article activity feed

  1. A very interesting computer-learning technique to improve signal to noise and enhance resolution of sub-cellular structures. The impact of this work will be more directly transmitted with clearer writing. Some specific suggestions are annotated throughout the paper.

    One tool that might facilitate this is: https://hemingwayapp.com/

  2. requiring no clean data as references and no compromise of spatiotemporal resolution on diverse imaging systems

    without the need for baseline data or loss of spatiotemporal resolution

  3. The computationally 15-fold multiplied photon budget in a standard confocal microscope by DeepSeMi allows for recording organelle interactions in four colors and high-frame-rate across tens of thousands of frames, monitoring migrasomes and retractosomes over a half day, and imaging ultra-phototoxicity-sensitive Dictyostelium cells over thousands of frames, all faithfully and sample-friendly.

    consider making this a simpler, declarative statement(s)

  4. enlarged

    increased is a better word choice than enlarged. Enlarged means to make bigger in size not magnitude. Increased is more accurate when talking about a larger number.

  5. and bio-friendly breaking the shot-noise limit, facilitating automated analysis of massive data about cell migrations and organelle interactions.

    simplify and make more direct

  6. colors

    suggest saying "fluorophores in different channels. They were: tagBFP-SKL (Ex/Em 402/457 nm),..." to give the excitation and emission spectra for each fluorophore.

  7. magnificence of the harmonically orchestrated systems, organs, tissues, and cells

    awkward phrasing. Perhaps something like "magnificently well-orchestrated systems of organs, tissues, and cells" or

  8. Compared to recently developed interpolation-based denoising methods, DeepSeMi is capable of observing organelles of sophisticated movements and transformations without motion artifacts

    Great point, may be stronger if framed as, "DeepSeMi improves upon interpolation-based denoising methods by (fill in the blank to describe what it is based on), which allows for observation of organelle dynamics without motion artifacts"

  9. lustrous and remarkable advances in enriched fluorescence microscope[1, 9–12] have brought flourishing discoveries

    awkward phrasing. Not sure what "enriched fluorescence microscope" really means

  10. Such gorgeous patterns reflect live organelles of complex, dynamic, and interplay in highly dynamic yet organized interactions capable of orchestrating complex cellular functions

    awkward phrasing. Perhaps it would be better to clearly make the point that organelle interactions are dynamic and studying them with high spatiotemporal resolution is important to understand their function in the cell.

  11. but either damaging the fragile living systems or poisoning the cellular health and both altering morphological and functional interpretations that follow.

    perhaps "but this practice can increase phototoxicity to the live specimens and disrupt the normal morphology" would be more clear

  12. We applied DeepSeMi to circumvent the problem, which enabled dual-color and high-SNR imaging at the 45.3 μW dosage at 488 nm and the 49.8 μW dosage at 561 nm over 30 minutes without apparent photodamage

    Great use of specific language here.

  13. helps better observation of structures and functions of cells and organisms in vivo

    is this implying that because of their transparency, there is decreased background/noise? Perhaps this should be clarified.

  14. A very interesting computer-learning technique to improve signal to noise and enhance resolution of sub-cellular structures. The impact of this work will be more directly transmitted with clearer writing. Some specific suggestions are annotated throughout the paper.

    One tool that might facilitate this is: https://hemingwayapp.com/

  15. helps better observation of structures and functions of cells and organisms in vivo

    is this implying that because of their transparency, there is decreased background/noise? Perhaps this should be clarified.

  16. We applied DeepSeMi to circumvent the problem, which enabled dual-color and high-SNR imaging at the 45.3 μW dosage at 488 nm and the 49.8 μW dosage at 561 nm over 30 minutes without apparent photodamage

    Great use of specific language here.

  17. colors

    suggest saying "fluorophores in different channels. They were: tagBFP-SKL (Ex/Em 402/457 nm),..." to give the excitation and emission spectra for each fluorophore.

  18. enlarged

    increased is a better word choice than enlarged. Enlarged means to make bigger in size not magnitude. Increased is more accurate when talking about a larger number.

  19. Compared to recently developed interpolation-based denoising methods, DeepSeMi is capable of observing organelles of sophisticated movements and transformations without motion artifacts

    Great point, may be stronger if framed as, "DeepSeMi improves upon interpolation-based denoising methods by (fill in the blank to describe what it is based on), which allows for observation of organelle dynamics without motion artifacts"

  20. lustrous and remarkable advances in enriched fluorescence microscope[1, 9–12] have brought flourishing discoveries

    awkward phrasing. Not sure what "enriched fluorescence microscope" really means

  21. but either damaging the fragile living systems or poisoning the cellular health and both altering morphological and functional interpretations that follow.

    perhaps "but this practice can increase phototoxicity to the live specimens and disrupt the normal morphology" would be more clear

  22. Such gorgeous patterns reflect live organelles of complex, dynamic, and interplay in highly dynamic yet organized interactions capable of orchestrating complex cellular functions

    awkward phrasing. Perhaps it would be better to clearly make the point that organelle interactions are dynamic and studying them with high spatiotemporal resolution is important to understand their function in the cell.

  23. magnificence of the harmonically orchestrated systems, organs, tissues, and cells

    awkward phrasing. Perhaps something like "magnificently well-orchestrated systems of organs, tissues, and cells" or

  24. and bio-friendly breaking the shot-noise limit, facilitating automated analysis of massive data about cell migrations and organelle interactions.

    simplify and make more direct

  25. The computationally 15-fold multiplied photon budget in a standard confocal microscope by DeepSeMi allows for recording organelle interactions in four colors and high-frame-rate across tens of thousands of frames, monitoring migrasomes and retractosomes over a half day, and imaging ultra-phototoxicity-sensitive Dictyostelium cells over thousands of frames, all faithfully and sample-friendly.

    consider making this a simpler, declarative statement(s)

  26. requiring no clean data as references and no compromise of spatiotemporal resolution on diverse imaging systems

    without the need for baseline data or loss of spatiotemporal resolution