Multimodal imaging

Relate is a correlative software package optimised to work with EM, EDS, EBSD, & AFM data and images.  It provides the tools you need to correlate data from different microscopes, visualise multi-layered data in 2D and 3D, and conduct correlative analyses.

• Combining data from different imaging modalities (e.g. AFM, EDS & EBSD)

• Interactive display of multi-layer correlated data

• Analytical tools for metadata interrogation

• Documented workflows and processes

Correlate

• Import data from AZtec using the H5oina file format
• Import AFM data
• Correlate both sets of data using intuitive image overlays and image matching tools
• Produce combined multimodal datasets

Visualise

• 2D display of multi-layered data
• 3D visualisation of topography combined with AFM material properties, EM images, and EDS & EBSD map overlays
• Customisation of colour palettes, data overlays, image rendering options, and document display
• Export images and animations

Analyse

• Generate profile (cross section) views of multimodal data
• Measure and quantify data across multiple layers
• Analyse areas via data thresholding using amount of x-ray counts, phase maps, height, or other material properties.
• Select an extensive range of measurement parameters
• Export analytical data to text or CSV files

Orthanc aims at providing a simple, yet powerful standalone DICOM server. It is designed to improve the DICOM flows in hospitals and to support research about the automated analysis of medical images. Orthanc lets its users focus on the content of the DICOM files, hiding the complexity of the DICOM format and of the DICOM protocol.

Orthanc can turn any computer running Windows, Linux or OS X into a DICOM store (in other words, a mini-PACS system). Its architecture is lightweight and standalone, meaning that no complex database administration is required, nor the installation of third-party dependencies.

What makes Orthanc unique is the fact that it provides a RESTful API. Thanks to this major feature, it is possible to drive Orthanc from any computer language. The DICOM tags of the stored medical images can be downloaded in the JSON file format. Furthermore, standard PNG images can be generated on-the-fly from the DICOM instances by Orthanc.

Orthanc also features a plugin mechanism to add new modules that extends the core capabilities of its REST API. A Web viewer, a PostgreSQL database back-end, a MySQL database back-end, and a reference implementation of DICOMweb are currently freely available as plugins.

Correlia is an open-source ImageJ/FIJI plug-in for the registration of 2D multi-modal microscopy data-sets. The software is developed at ProVIS - Centre for Correlative Microscopy and is specifically designed for the needs of chemical microscopy involving various micrographs as well as chemical maps at different resolutions and field-of-views.

This Fiji plugin is a python script for CLEM registration using deep learning, but it could be applied in principle to other modalities. The pretrained model was learned on chromatin SEM images and fluorescent staining, but a script is also provided to train an new model, based on CSBDeep. The registration is then performed as a feature based registration, using register virtual stack plugin (which extract features and then perform RANSAc. Editing the script in python gives access to more option (such as the transformation model to be used, similarity by default. Images need to be prepared such that they contain only one channel, but channel of ineterst (to be transformed with the same transformation) can be given as input, and Transform Virtual Stack plugin can be used as well.

The library contains several helper functions to generate MoBIE project folders and add data to it.  Itis a python library to generate data in the MoBIE data storage layout. 

For further information, look to http://biii.eu/mobie-fiji-viewer