Automated

AssayScope is an intuitive application dedicated to large scale image processing and data analysis. It is meant for histology, cell culture (2D, 3D, 2D+t) and phenotypic analysis. 

​The Allen Cell Structure Segmenter is a Python-based open source toolkit developed at the Allen Institute for Cell Science for 3D segmentation of intracellular structures in fluorescence microscope images.

It consists of two complementary elements:

1. Classic image segmentation workflows for 20 distinct intracellular structure localization patterns. A visual “lookup table” is outlining the modular algorithmic steps for each segmentation workflow. This provides an intuitive guide for selection or construction of new segmentation workflows for a user’s particular segmentation task. 
2. Human-in-the-loop iterative deep learning segmentation workflow trained on ground truth manually curated data from the images segmented with the segmentation workflow. Importantly, this module was not released yet.

DeconvolutionLab2 includes a friendly user interface to run the following deconvolution algortihms: Regularized Inverse Filter, Tikhonov Inverse Filter, Naive Inverse Filter, Richardson-Lucy, Richardson-Lucy Total Variation, Landweber (Linear Least Squares), Non-negative Least Squares, Bounded-Variable Least Squares, Van Cittert, Tikhonov-Miller, Iterative Constraint Tikhonov-Miller, FISTA, ISTA.

The backbone of our software architecture is a library that contains the number-crunching elements of the deconvolution task. It includes the tool for a complete validation pipeline. Inquisitive minds inclined to peruse the code will find it fosters the understanding of deconvolution.

Quote " finding and/or analyzing colocalization of bright intensity spots (cells, particles, vesicles, comets, dots, etc) in images with heterogeneous background (microscopy, astronomy, engineering, etc). "

Uses Gaussian-Mexican hat convolution for preprocessing.

h-Dome transformation, useful for spot detection.

Jython code example:

from de.unihalle.informatik.MiToBo.core.datatypes.images import MTBImage
from de.unihalle.informatik.MiToBo.morphology import HDomeTransform3D
from ij import IJ

imp = IJ.getImage()
mtb = MTBImage.createMTBImage( imp.duplicate() )
hdome = HDomeTransform3D(mtb, 10.0)
hdome.runOp()
mtbdone = hdome.getResultImage()
imp2 = mtbdone.getImagePlus()
imp2.show()

Nessys: Nuclear Envelope Segmentation System

Nessys is a software written in Java for the automated identification of cell nuclei in biological images (3D + time). It is designed to perform well in complex samples, i.e when cells are particularly crowded and heterogeneous such as in embryos or in 3D cell cultures. Nessys is also fast and will work on large images which do not fit in memory.

Nessys also offers an interactive user interface for the curation and validation of segmentation results. Think of this as a 3D painter / editor. This editor can also be used to generate manually segmented images to use as ground truth for testing the accuracy of the automated segmentation method.

Finally Nessys, contains a utility for assessing the accuracy of the automated segmentation method. It works by comparing the result of the automated method to a manually generated ground truth. This utility will provide two types of output: a table with a number of metrics about the accuracy and an image representing a map of the mismatch between the result of the automated method and the ground truth.

InspectJ is a free ImageJ/FIJI tool to inspect digital image integrity.

InspectJ_v2 is a newer version for advanced users. It applies additional features like histogram equalization and gamma correction for improved image inspections.

The Topology ToolKit (TTK) is an open-source library and software collection for topological data analysis in scientific visualization.

TTK can handle scalar data defined either on regular grids or triangulations, either in 2D or in 3D. It provides a substantial collection of generic, efficient and robust implementations of key algorithms in topological data analysis. It includes:
 · For scalar data: critical points, integral lines, persistence diagrams, persistence curves, merge trees, contour trees, Morse-Smale complexes, topological simplification;
 · For bivariate scalar data: fibers, fiber surfaces, continuous scatterplots, Jacobi sets, Reeb spaces;
 · For uncertain scalar data: mandatory critical points;
 · For time-varying scalar data: critical point tracking;
 · For high-dimensional / point cloud data: dimension reduction;
 · and more!

 

TTK makes topological data analysis accessible to end users thanks to easy-to-use plugins for the visualization front end ParaView. Thanks to ParaView, TTK supports a variety of input data formats.
 

TTK is written in C++ but comes with a variety of bindings (VTK/C++, Python) and standalone command-line programs. It is modular and easy to extend. We have specifically developed it such that you can easily write your own data analysis tools as TTK modules.

The software FishInspector provides automatic feature detections in images of zebrafish embryos (body size, eye size, pigmentation). It is Matlab-based and provided as a Windows executable (no matlab installation needed).

The recent version requires images of a lateral position. It is important that the position is precise since deviation may confound with feature annotations. Images from any source can be used. However, depending on the image properties parameters may have to be adjusted. Furthermore, images obtained with normal microscope and not using an automated position system with embryos in glass capillaries require conversion using a KNIME workflow (the workflow is available as well). As a result of the analysis the software provides JSON files that contain the coordinates of the features. Coordinates are provided for eye, fish contour, notochord , otoliths, yolk sac, pericard and swimbladder. Furthermore, pigment cells in the notochord area are detected. Additional features can be manually annotated. It is the aim of the software to provide the coordinates, which may then be analysed subsequently to identify and quantify changes in the morphology of zebrafish embryos.

This is a classical workflow for spot detection or blob like structures (vesicules, melanosomes,...)

Step 1 Laplacian of Gaussian to enhance spots . Paraeters= radius, about the average spot radius

Step 2 Detect minima (using Find Maxima with light background option to get minima). Parameter : Tolerance to Noise: to be tested, hard to predict. About the height of the enhanced feautures peaks

The best way to start writing an ImageJ2 plugin (ImageJ2 developers call it command and not plugin) is to download the example command from github and modify it. There is a video tutorial on the whole workflow on how to do this on youtube.

AutoPilot is the open source project that hosts the general algorithm for fast and robust assessment of local image quality, an automated computational method for image-based mapping of the three-dimensional light-sheet geometry inside a fluorescently labeled biological specimen, and a general algorithm for data-driven optimization of the system state of light-sheet microscopes capable of multi-color imaging with multiple illumination and detection arms.

Please also check out ImageJ and Fiji.

SIMPLETRACKER a simple particle tracking algorithm that can deal with gaps.

Tracking , or particle linking, consist in re-building the trajectories of one or several particles as they move along time. Their position is reported at each frame, but their identity is yet unknown: we do not know what particle in one frame corresponding to a particle in the previous frame. Tracking algorithms aim at providing a solution for this problem. 

simpletracker.m is - as the name says - a simple implementation of a tracking algorithm, that can deal with gaps. A gap happens when one particle that was detected in one frame is not detected in the subsequent one. If not dealt with, this generates a track break, or a gap, in the frame where the particle disappear, and a false new track in the frame where it re-appear. 

Mean square displacement (MSD) analysis is a technique commonly used in colloidal studies and biophysics to determine what is the mode of displacement of particles followed over time. In particular, it can help determine whether the particle is:

• freely diffusing;
• transported;
• bound and limited in its movement.

On top of this, it can also derive an estimate of the parameters of the movement, such as the diffusion coefficient.

@msdanalyzer is a MATLAB per-value class that helps performing this kind of analysis. The user provides several trajectories he measured, and the class can derive meaningful quantities for the determination of the movement modality, assuming that all particles follow the same movement model and sample the same environment.

ZEN and APEER – Open Ecosystem for integrated Machine-Learning Workflows

Open ecosystem for integrated machine-learning workflows to train and use machine-learning models for image processing and image analysis inside the ZEN software or on the APEER cloud-based platform

Highlights ZEN

• Simple User Interface for Labeling and Training
• Engineered Features Sets and Deep Feature Extraction + Random Forrest for Semantic Segmentation
• Object Classification workflows
• Probability Thresholds and Conditional Random Fields
• Import your own trained models as *.czann files (see: czmodel · PyPI)
• Import "AIModel Containes" from arivis AI for advanced Instance Segmentation
• Integration into ZEN Measurement Framework
• Support for Multi-dimensional Datasets and Tile Images
• open and standardized format to store trained models

ZEN Intellesis Segmentation

ZEN Intellesis - Pretrained Networks

Intellesis Object Classification

Highlights Aarivis AI

• Web-based tool to label datasets to train Deep Neural Networks
• Fully automated hyper-parameter tuning
• Export of trained models for semantic segmentation and AIModelContainer for Instance Segmentation

Annotation Tool

Bisque (Bio-Image Semantic Query User Environment) : Store, visualize, organize and analyze images in the cloud. It also allow to run workflows using a set of deployed tools, such as CellProfiler, RootTipMultin Nuclear Tracker, Microtubule tracker etc...

Bisque was developed for the exchange and exploration of biological images.

The Bisque system supports several areas useful for imaging researchers from image capture to image analsysis and querying. The bisque system is centered around a database of images and metadata. Search and comparison of datasets by image data and content is supported. Novel semantic analyses are integrated into the system allowing high level semantic queries and comparison of image content.

• Bisque is free and open-source
• Flexible textual and graphical annotations
• Cloud scalability: PBs of images, millions of annotations
• Distributed storage: local, iRODS, S3
• Integrated image analysis, high-throughput with Condor
• Analysis in MATLAB, Python, Java+ImageJ
• 100+ biological image formats
• Very large 5D images (100+ GB)

OpenImadis stands for Open Image Discovery: A platform for Image Life Cycle Management. It was previously called CID iManage (for Curie Image Database).

No image data conversions, no duplication.

- Uploads data to a secure server in the original format

- Unique id for data

Supports sharing and collaboration with access control

- Allows users to upload, view, update or download data based on their access privileges

Supports multiple ways of attaching meta-information

- Annotations, comments and file attachments

-Analysis results as query-able visual objects

Supports Archiving (data moving to another long-term storage but still searchable)

Facilitates custom visualization and analysis

- Access data from preferred analysis and visualization tools

- Access relevant bits of data to build efficient web and mobile application

Facilitate easy access to analysis and visualization applications hosted on other servers

- Run analysis on dedicated compute clusters

- Access applications hosted and published by other users

Highly Scalable

- Supports on-the-fly addition of server nodes to scale concurrent usage

This notebook uses the rOMERO-gateway and EBImage to process an Image associated to the paper 'Timing of gene expression in a cell-fate decision system'.

The Image "Pos22" is taken from the dataset idr0040-aymoz-singlecell/experimentA/YDA306_AGA1y_PRM1r_Mating. It is a timelapse Image with 42 timepoints separated by 5 minutes. This Image is used to fit a model for the growth of the yeast cells. The notebook does not replicate any of the analysis of the above mentioned paper.

Its purpose is mainly to demonstrate the use of Jupyter, rOMERO-gateway and EBimage.

What it does:

• For each time point of one movie:
  • Read the image for this time point  from the IDR
  • Threshold the images and count the cells using EBimage functions
• Fit an exponential model to the count of cells against time to get a coefficient of grow (exponential factor)

This one example workflow from the Cell Profiler(CP)  Examples . CP is commonly used to count cells or other objects as well as percent-positives, by measuring the per-cell staining intensity. This pipeline shows how to do both of these tasks, and demonstrates how various modules may be used to accomplish the same result. 

In a few words, it used the IdentifyPrimaryObject module of CellProfiler to detect nuclei from a channel (e.g DAPI), then again the same module on another channel to detect another probe (e.g some particular histone)  .

Then objects (nuclei) are related to the second object (Histone), to create a parent child-relation ship: where nuclei can have histone has child. Nuclei are then filtered according to the property of having histone (positive) or not having histone (negtiveobject) related to them.  If needed, nuclei can be expanded in order to include touching object rather than object inside only.

The percentage of positive nuclei vs total number of nuclei can then be computed using the CalculateMath Module.

This is a Jupyter notebook demonstrating the run of a code from IDR data sets by loading a CellProfiler Pipeline 

The example here is applied on real data set, but does not correspond to a biological question. It aims to demonstrate how to create a jupyter notebook to process online plates hosted in the IDR.

It reads the plate images from the IDR.

It loads the CellProfiler Pipeline and replace the reading modules used to read local files from this defaults pipeline by module allowing to read data remotely accessible.

It creates a CSV file and displays it in the notebook.

It makes some plot with Matplotlib.

Python/C++ port of the ImageJ extension TurboReg/StackReg written by Philippe Thevenaz/EPFL.

A python extension for the automatic alignment of a source image or a stack (movie) to a target image/reference frame.

This component can be used to find moving foreground features, which can be a powerful way to suppress false background detections in subsequent tracking steps.

set time window, and standard deviations above background for foreground time window should be more than 2x larger than time taken for a feature to traverse a pixel (NB. total window is 2x half-width +1) moving foreground identified by intensity increase relative to background average (i.e. median) for a pixel over a given time window "soft" segmentation, yielding foreground probability related to excess intensity (in standard deviations) over background level crude Anscombe transform applied to data to stabilize the variance