Visualisation

VTK is an open-source software system for image processing, 3D graphics, volume rendering and visualization. VTK includes many advanced algorithms (e.g., surface reconstruction, implicit modeling, decimation) and rendering techniques (e.g., hardware-accelerated volume rendering, LOD control).

VTK is used by academicians for teaching and research; by government research institutions such as Los Alamos National Lab in the US or CINECA in Italy; and by many commercial firms who use VTK to build or extend products.

The origin of VTK is with the textbook "The Visualization Toolkit, an Object-Oriented Approach to 3D Graphics" originally published by Prentice Hall and now published by Kitware, Inc. (Third Edition ISBN 1-930934-07-6). VTK has grown (since its initial release in 1994) to a world-wide user base in the commercial, academic, and research communities.

TissUUmaps is a browser-based tool for fast visualization and exploration of millions of data points overlaying a tissue sample. TissUUmaps can be used as a web service or locally in your computer, and allows users to share regions of interest and local statistics.

ELEPHANT is a platform for 3D cell tracking, based on incremental and interactive deep learning.
It implements a client-server architecture. The server is built as a web application that serves deep learning-based algorithms. The client application is implemented by extending Mastodon, providing a user interface for annotation, proofreading and visualization.

Fractal is a framework to process high-content imaging data at scale and prepare it for interactive visualization. Fractal provides distributed workflows that convert TBs of image data into OME-Zarr files. The platform then processes the 3D image data by applying tasks like illumination correction, maximum intensity projection, 3D segmentation using cellpose and measurements using napari workflows. The pyramidal OME-Zarr files enable interactive visualization in the napari viewer.

Relate is a correlative software package optimised to work with EM, EDS, EBSD, & AFM data and images.  It provides the tools you need to correlate data from different microscopes, visualise multi-layered data in 2D and 3D, and conduct correlative analyses.

• Combining data from different imaging modalities (e.g. AFM, EDS & EBSD)

• Interactive display of multi-layer correlated data

• Analytical tools for metadata interrogation

• Documented workflows and processes

Correlate

• Import data from AZtec using the H5oina file format
• Import AFM data
• Correlate both sets of data using intuitive image overlays and image matching tools
• Produce combined multimodal datasets

Visualise

• 2D display of multi-layered data
• 3D visualisation of topography combined with AFM material properties, EM images, and EDS & EBSD map overlays
• Customisation of colour palettes, data overlays, image rendering options, and document display
• Export images and animations

Analyse

• Generate profile (cross section) views of multimodal data
• Measure and quantify data across multiple layers
• Analyse areas via data thresholding using amount of x-ray counts, phase maps, height, or other material properties.
• Select an extensive range of measurement parameters
• Export analytical data to text or CSV files

SMLM is a mature but still growing field, which still lacks efficient and user-friendly analysis and visualization software platform adapted for both users and developers. We here introduce PoCA, a powerful open-source software platform dedicated to the visualization and analysis of 2D and 3D point-cloud data. PoCA allows manipulating large datasets, and integrates a plugin architecture, a native batch analysis engine and a Python code interpreter, facilitating both the analysis of data and the integration of new methods.

Correlia is an open-source ImageJ/FIJI plug-in for the registration of 2D multi-modal microscopy data-sets. The software is developed at ProVIS - Centre for Correlative Microscopy and is specifically designed for the needs of chemical microscopy involving various micrographs as well as chemical maps at different resolutions and field-of-views.

ClearMap is a toolbox for the analysis and registration of volumetric data from cleared tissues.

It was initially developed to map brain activity at cellular resolution in whole mouse brains using immediate early gene expression. It has since then been extended as a tool for the qunatification of whole mouse brain vascualtur networks at capilary resolution.

It is composed of sevral specialized modules or scripts: tubemap, cellmap, WobblyStitcher.

ClearMap has been designed to analyze O(TB) 3d datasets obtained via light sheet microscopy from iDISCO+ cleared tissue samples immunolabeled for proteins. The ClearMap tools may also be useful for data obtained with other types of microscopes, types of markers, clearing techniques, as well as other species, organs, or samples.

A collection of Java tools and HTTP services (APIs) for rendering transformed image tiles that includes:

• a JSON data model for render, tile, and transform specifications,
• a Java stand-alone render application / library,
• a set of render web services that provide RESTful APIs to persisted collections of tile and transform specifications, and
• a set of Java clients for processing/rendering data that utilize the render web services to retrieve and/or store persisted specifications.
• Docker packaging for building the libraries and deploying the render web services

The basic concept is to render images (tiles) based on transformation files, without having to store the big generated image from an alignment of tiles (mosaicking).

Phindr3D is a comprehensive shallow-learning framework for automated quantitative phenotyping of three-dimensional (3D) high content screening image data using unsupervised data-driven voxel-based feature learning, which enables computationally facile classification, clustering and data visualization.

Please see our GitHub page and the original publication for details.

Viv is a JavaScript library providing utilities for rendering primary imaging data. Viv supports WebGL-based multi-channel rendering of both pyramidal and non-pyramidal images. The rendering components of Viv are provided as Deck.gl layers, facilitating image composition with existing layers and updating rendering properties within a reactive paradigm.

KNIME workflow to visualize a dataset described by multiple quantitative features (ex: a list of samples or cells, each described with multiple morphological features) as a 3D cloud of points (each point corresponding to one sample/cell) as well as a line plot (1 line per sample/cell).

For the 3D plot, the workflow uses Principal Component Analysis (PCA) for dimensionality reduction, ie it simplifies the information for each sample from n-features to 3 pseudo-features which are used as x,y,z-coordinates for each sample. The original features should cover similar value range, to make sure the PCA is not biased towards the large values features. One option is to normalize the values (min/max or Z-score). 

Also make sure that the resulting PCA represents a decent % of the original data variance (at least 70%). Otherwise the PCA plot will not be representative of the original data-distribution. The % is shown in the title of the PCA plot.

The workflow is interactive and so selecting in one panel of the figure will highlight in the other panel too.

It was originally published for the visualization of phenotypic kidney features in zebrafish, but the workflow is generic by design and can be reused for any quantitative feature set. 

MoBIE (Multimodal Big Image Data Exploration) is a framework for sharing and interactive browsing of multimodal big image data. The MoBIE Fiji viewer is based on BigDataViewer and enables browsing of MoBIE datasets. 

It is also called Platybrowser, and uses the n5 format.

The Morphonet Python API provide an easy interface to interact directly with the MorphoNet server. Very useful to upload, download your dataset and superimpose on it any quantitative and quantitative informations.

MorphoNet is a novel concept of web-based morphodynamic browser to visualise and interact with complex datasets, with applications in research and teaching. 

MorphoNet offers a comprehensive palette of interactions to explore the structure, dynamics and variability of biological shapes and its connection to genetic expressions. 

By handling a broad range of natural or simulated morphological data, it fills a gap which has until now limited the quantitative understanding of morphodynamics and its genetic underpinnings by contributing to the creation of ever-growing morphological atlases.

Summary

napari is a fast, interactive, multi-dimensional image viewer for Python. It’s designed for browsing, annotating, and analyzing large multi-dimensional images. It’s built on top of Qt (for the GUI), vispy (for performant GPU-based rendering), and the scientific Python stack (e.g. numpy, scipy). It includes critical viewer features out-of-the-box, such as support for large multi-dimensional data, and layering and annotation. By integrating closely with the Python ecosystem, napari can be easily coupled to leading machine learning and image analysis tools (e.g. scikit-image, scikit-learn, TensorFlow, PyTorch), enabling more user-friendly automated analysis.

Installation

• The installation procedure for Silicon Mac (M1 Processor, arm64 ) requires some tricks. As of Oct 2021, this procedure by Peter Sobolewski works but:
  • For installing pyqt5, use a slightly different command `brew install PyQt@5` to install PyQt5.  

Wolfram Mathematica (usually termed Mathematica) is a modern technical computing system spanning most areas of technical computing — including neural networks, machine learning, image processing, geometry, data science, visualizations, and others. The system is used in many technical, scientific, engineering, mathematical, and computing fields.

Dragonfly is a software platform for the intuitive inspection of multi-scale multi-modality image data. Its user-friendly experience translates into powerful quantitative findings with high-impact visuals, driven by nuanced easy-to-learn controls.

For segmentation: It provides an engine fior machine Learning, Watershed and superpixel methods, support histological data .

It offers a 3D viewer, and python scripting capacities .

It is free for reserach use, but not for commercial usage.

Web based viewer developped for google for very big data: 

Neuroglancer is a WebGL-based viewer for volumetric data. It is capable of displaying arbitrary (non axis-aligned) cross-sectional views of volumetric data, as well as 3-D meshes and line-segment based models (skeletons). The segmentation has to be done before loading the dataset, it is not done Inside the viewer.

This is not an official Google product.

It has among other the nice feature of beeing able to generate url for sharing a specific view.

Note that the only supported browser for now are 

• Chrome >= 51
• Firefox >= 46

FPBioimage is a volumetric visualization tool which runs in all modern web browsers. Try the tool yourself at our example site here.

The PYthon Microscopy Environment is an open-source package providing image acquisition and data analysis functionality for a number of microscopy applications, but with a particular emphasis on single molecule localisation microscopy (PALM/STORM/PAINT etc ...). The package is multi platform, running on Windows, Linux, and OSX.

It comes with 3 main modules:

• PYMEAcquire - Instrument control and simulation
• dh5view - Image Data Analysis and Viewing
• VisGUI - Visualising Localization Data Sets

CellProfiler Analyst (CPA) allows interactive exploration and analysis of data, particularly from high-throughput, image-based experiments. Included is a supervised machine learning system which can be trained to recognize complicated and subtle phenotypes, for automatic scoring of millions of cells. CPA provides tools for exploring and analyzing multidimensional data, particularly data from high-throughput, image-based experiments analyzed by its companion image analysis software, CellProfiler.

The Image Data Explorer is a Shiny app that allows the interactive visualization of images and ROIs associated with data points shown in a scatter plot. It is useful for exploring the relationships between images/ROIs and associated data represented in tabular format. Additional functionalities include data annotation, dimensionality reduction and classification and feature selection.

This suite provides plugins to enhance 3D capabilities of ImageJ.

• 3D Filters (mean, median, max, min, tophat, max local, …) and edge and symmetry filter
• 3D Segmentation (iterative thresholding, spots segmentation, watershed, …)
  • 3D hysteresis thresholding with two thresholds (see 2D hysteresis for explanation).
  • 3D simple segmentation with thresholding to label 3D objects (similar to 3D objects counter).
  • 3D iterative thresholding (find optimal threshold for each object).
  • 3D spot segmentation with various local threshold estimations.
  • 3D Maxima Finder (with noise parameter)
  • 3D seeds-based watershed with automatic local maxima detection for seeds.
• 3D Mathematical Morphology tools (fill holes, binary closing, distance map, …)
• 3D RoiManager (3D display and analysis of 3D objects)
• 3D Analysis (Geometrical measurements, Mesh measurements, Convex hull, …)
  • 3D Geometrical measurements (volume, surface, …) for each labelled object.
  • 3D Centroid, to compute centroids of labelled objects.
  • 3D Intensity measurements (mean, integrated density, …) in a opened image for each labelled object.
  • 3D Shape measurements (compactness, elongation, …) for each labelled object.
  • 3D Mesh Measurements after triangulation (see 3D Viewer for surface mesh computation).
  • 3D fitting by an ellipsoid and main direction computation (details here).
  • 3D convex hull (see http://rsbweb.nih.gov/ij/plugins/3d-convex-hull/index.html).
  • 3D Radial Distance Area Ratio (RDAR)
  • 3D Density, to compute density of dots, based on closest distance analysis (details here).
• 3D MereoTopology (Relationship between objects)
• 3D Tools (Drawing ellipsoids and lines, cropping, …)
  • Drawing 3D line
  • Drawing 3D ellipsoids in any direction
  • Drawing in stacks as volumes
  • Drawing in 3D viewer as surfaces

Spimagine is a python package to interactively visualize and process time lapsed volumetric data as generated with modern light sheet microscopes (hence the Spim part). The package provides a generic 3D+t data viewer and makes use of GPU acceleration via OpenCL. If provides further an image processor interface for the GPU accelerated denoising and deconvolution methods of gputools.

It is only for display (no analysis). The only drawback: it does not handle multichannel time lapse 3D data (only one channel at a time).

It is an interactive front-end visualization for registration software based on Elasix (VTK/ITK)

"The Microscope Image Analysis Toolbox MiToBo is an extension for the widely used image processing application ImageJ and its new release ImageJ 2.0.
MiToBo ships with a set of operators ready to be used as plugins in ImageJ. They focus on the analysis of biomedical images acquired by various types of microscopes."

shinyHTM is an open source, web-based tool for data exploration, image visualization and normalization of High Throughput Microscopy data. Within shinyHTM the user is guided through a linear workflow which follows the following best practices:

• Inspect the numerical data through plotting
• Measurements are linked to raw images
• Perform quality control to exclude images with aberrations or where image analysis failed
• Perform a reproducible data analysis
• Normalize data and report statistical significance

Image visualization relies on Fiji/ImageJ, along with its wealth of analytical tools.

shinyHTM can be used to analyze image features obtained with CellProfiler, ImageJ or any other bioimage analysis software. The output of analysis is a publication-ready scoring of the data.

shinyHTM is based on the R shiny package.

The Topology ToolKit (TTK) is an open-source library and software collection for topological data analysis in scientific visualization.

TTK can handle scalar data defined either on regular grids or triangulations, either in 2D or in 3D. It provides a substantial collection of generic, efficient and robust implementations of key algorithms in topological data analysis. It includes:
 · For scalar data: critical points, integral lines, persistence diagrams, persistence curves, merge trees, contour trees, Morse-Smale complexes, topological simplification;
 · For bivariate scalar data: fibers, fiber surfaces, continuous scatterplots, Jacobi sets, Reeb spaces;
 · For uncertain scalar data: mandatory critical points;
 · For time-varying scalar data: critical point tracking;
 · For high-dimensional / point cloud data: dimension reduction;
 · and more!

 

TTK makes topological data analysis accessible to end users thanks to easy-to-use plugins for the visualization front end ParaView. Thanks to ParaView, TTK supports a variety of input data formats.
 

TTK is written in C++ but comes with a variety of bindings (VTK/C++, Python) and standalone command-line programs. It is modular and easy to extend. We have specifically developed it such that you can easily write your own data analysis tools as TTK modules.

ParaView is an open-source, multi-platform data analysis and visualization application. ParaView users can quickly build visualizations to analyze their data using qualitative and quantitative techniques. The data exploration can be done interactively in 3D or programmatically using ParaView’s batch processing capabilities.

ParaView was developed to analyze extremely large datasets using distributed memory computing resources. It can be run on supercomputers to analyze datasets of petascale size as well as on laptops for smaller data, has become an integral tool in many national laboratories, universities and industry, and has won several awards related to high performance computation.

Please also check out ImageJ and Fiji.

Python is a programming language.

Python 2.7.0 was released on July 3rd, 2010.

Python 2.7 is scheduled to be the last major version in the 2.x series before it moves into an extended maintenance period. This release contains many of the features that were first released in Python 3.1.

 A bugfix release, 2.7.16, is currently available. Its use is recommended.

Matplotlib is a comprehensive library for creating static, animated, and interactive visualizations in Python.

This note presents the design of a scalable software package named ImagePy for analysing biological images. Our contribution is concentrated on facilitating extensibility and interoperability of the software through decoupling the data model from the user interface. Especially with assistance from the Python ecosystem, this software framework makes modern computer algorithms easier to be applied in bioimage analysis.

Python is a programming language.

This ParaViewWeb Docker container is used by the Galaxy Project.  Paraview is an VTK based visualization server, for 3D.

Drishti (from Sanskrit  word for "vision" or "insight") is a multi-platform, open-source volume-exploration and presentation tool. Written for visualizing tomography data, electron-microscopy data and the like.

An R package for the (3D) visualisation and analysis of biological image data, especially tracings of single neurons. nat is the core package of a wider suite of neuroanatomy tools introduced at http://jefferislab.github.io.

vmtk is a collection of libraries and tools for 3D reconstruction, geometric analysis, mesh generation and surface data analysis for image-based modeling of blood vessels.

vmtk is composed of

• C++ classes (VTK and ITK -based algorithms)
• Python classes (high-level functionality - each class is a script)
• PypeS - Python pipeable scripts, a framework which enables vmtk scripts to interact with each other

Facade API on top of JOGL (http://jogamp.org/jogl/www/) offering a simple interface for creating OpenGL contexts/windows, GLSL shader programs, and textures. Use it in your favourite JVM-based language.

scenery is a scenegraphing and rendering library. It allows you to quickly create high-quality 3D visualisations based on mesh data. scenery contains both a OpenGL 4.1 and Vulkan renderer. The rendering pipelines of both renderers are configurable using YAML files, so it's easy to switch between e.g. Forward Shading and Deferred Shading, as well as stereo rendering. Rendering pipelines can be switched on-the-fly.

Both renderers support rendering to head-mounted VR goggles like the HTC Vive or Oculus Rift via OpenVR/SteamVR.

The Multiview Reconstruction software package enables users to register, fuse, deconvolve and view multiview microscopy images. The software is designed for lightsheet fluorescence microscopy (LSFM), but is applicable to any form of three or higher dimensional imaging modalities like confocal timeseries or multicolor stacks. 

The BigDataViewer is a re-slicing browser for terabyte-sized multi-view image sequences. BigDataViewer was developed with multi-view light-sheet microscopy data in mind and integrates well with Fiji's SPIMage processing pipeline.