Search bioRxiv⌕ Search

bioRxiv · 10.1101/2022.03.09.483582

A Dynamic Bottom-Up Saliency Detection Method for Still Images

Abstract

IntroductionExisting saliency detection algorithms in the literature have ignored the importance of time. They create a static saliency map for the whole recording time. However, bottom-up and top-down attention continuously compete and the salient regions change through time. In this paper, we propose an unsupervised algorithm to predict the dynamic evolution of bottom-up saliency in images. MethodWe compute the variation of low-level features within non-overlapping patches of the input image. A patch with higher variation is considered more salient. We use a threshold to ignore less salient parts and create a map. A weighted sum of this map and its center of mass is calculated to provide the saliency map. The threshold and weights are set dynamically. We use the MIT1003 and DOVES datasets for evaluation and break the recording to multiple 100ms or 500ms-time intervals. A separate ground-truth is created for each interval. Then, the predicted dynamic saliency map is compared to the ground-truth using Normalized Scanpath Saliency, Kullback-Leibler divergence, Similarity, and Linear Correlation Coefficient metrics. ResultsThe proposed method outperformed the competitors on DOVES dataset. It also had an acceptable performance on MIT1003 especially within 0-400ms after stimulus onset. ConclusionThis dynamic algorithm can predict an images salient regions better than the static methods as saliency detection is inherently a dynamic process. This method is biologically-plausible and in-line with the recent findings of the creation of a bottom-up saliency map in the primary visual cortex or superior colliculus.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Sadeghi, L., Kamkar, S., Abrishami Moghaddam, H.. 2022-03-10. A Dynamic Bottom-Up Saliency Detection Method for Still Images. https://doi.org/10.1101/2022.03.09.483582

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Preserving Nanotherapy-Induced Allogeneic Murine Islet Graft Tolerance During Distal Methicillin-Resistant Staphylococcus aureus Skin Infection

Eliminating lifelong immunosuppression can make islet transplantation a durable alternative to insulin therapy for type 1 diabetes. As short-course tolerogenic regimens are developed to replace lifelong immunosuppression, it is critical to test their robustness against perturbations such as hospital-acquired infections, which transplant recipients routinely encounter. Herein, we investigated whether rapamycin-loaded polymersomes (rPS), a subcutaneous nanotherapy that induces long-term murine islet allograft survival, can preserve host defenses in a Methicillin-resistant Staphylococcus aureus (MRSA) skin infection, and whether the resulting immune response from this distal infection relative to graft location erodes rPS-induced tolerance. rPS maintained neutrophil antibacterial activity despite inhibiting oxidative mechanisms in vitro, and rPS-treated mice demonstrated normal recovery following MRSA challenge. However, MRSA skin infection caused a decline of ~43% in recipient survival for rPS-treated mice, despite surviving recipients retaining glucose-stimulated insulin responsiveness. This erosion of allograft acceptance coincided with a burst of IL-6 within 24h of the infection followed by elevated TNF-[a] and neutrophilia at 13 days post-infection. Combining rPS with a single dose of methylprednisolone reduced IL-6 and TNF- without altering neutrophilia, nearly doubling survival among infected recipients to 80%. Our findings demonstrate that partial dampening of inflammatory insults can restore superior islet allograft acceptance following perioperative infection.

bioengineering↗

Extensional Flow Microfluidics Reveal Size-Dependent Core-Shell Mechanical Heterogeneity in Pancreatic Tumor Spheroids

Understanding the mechanical behavior of cancer cell aggregates is important for investigating metastatic potential and developing effective therapeutics. Tumor cell clusters are major contributors to metastasis and can undergo extreme deformation to migrate through capillaries smaller than the cluster size, suggesting complex multicellular mechanics. Despite their clinical significance, the mechanics of multicellular spheroids remain underexplored. In this study, the mechanical behavior of spheroids formed from the pancreatic cancer cell line PANC-1 was investigated using a cross-slot microfluidic device. Suspended spheroids from two size ranges were stretched in non-contact extensional flow (small spheroids mostly 40 < D0 < 75 m, large spheroids mostly 90 < D0 < 145 m). Digital image correlation analyses of intra-spheroid strains revealed strong deformation differences for small and large spheroids while analyses based on 2D projected contours of the spheroid shape did not show trends. Smaller spheroids deformed relatively homogeneously and exhibited significant overall stretching. In contrast, larger spheroids displayed heterogeneous deformation characterized by a stiff central core and a deformable outer shell. To investigate the origin of these mechanical differences, cellular morphology and the expression of stiffness-associated proteins, including vimentin and E-cadherin, were assessed from confocal microscopy. Larger spheroids display significantly lower nuclear sphericity than small spheroids, indicating more cellular packing with increasing spheroid size. Additionally, vimentin expression was concentrated in the outer shell of large spheroids, whereas small spheroids exhibit vimentin expression throughout the aggregate. Thus individual cell morphology and cytoskeletal networks seemed to contribute to the core-shell biomechanical behavior of the large spheroids and lack thereof for small spheroids. Taken together, this study suggests that as spheroids grow, they transition from an irregular and disorganized cluster at low cell numbers to a coordinated and hierarchical structure at sufficient cell numbers that corresponds to diameters {gtrsim} 100 m.

bioengineering↗

Material context and TGF-β blockade timing determine retained matrix in patient-derived bioprinted keratoconus stroma

Stromal repair requires newly formed matrix to persist while the contractile response to TGF-{beta} is controlled. We developed patient-derived bioprinted gelatin methacryloyl (GelMA) stroma to connect material-dependent cell responses with matrix retention after timed receptor blockade. In constructs from six keratoconus (KC) and six normal donors, KC cells retained disease-associated transcription while secreting procollagen I and lumican at normal-donor levels per unit DNA. Comparisons with two-dimensional culture and matched cast GelMA showed that the three-dimensional environment increased matrix induction and lowered resting contractile expression. Printing added a stromal identity response that persisted as retained lumican. Delayed blockade after a TGF-{beta}1 pulse preserved matrix transcription and late secretion. Eleven days after withdrawal, this finite course left more native collagen and lower contractile-gene expression than vehicle in 9/12 donors. Across the tested blockade regimens, at least one regimen achieved both outcomes at the final endpoint in 11/12 donors, including every KC donor. Culture format changed the preferred regimen. Choosing finite blockade by retained collagen instead of secretion changed the schedule in half the donors; the selected arms contained 22.2% more collagen. Retained collagen and contractile expression therefore provide joint endpoints for designing when TGF-{beta}-pathway courses, including losartan and TGF-{beta}3 treatment for keratoconic and scarred corneas, should start and stop.

bioengineering↗