The Biomedical Image Segmentation App

Biomedisa is a free and easy-to-use open-source application for segmenting large 3D volumetric images such as CT and MRI scans, developed at The Australian National University CTLab. Biomedisa's smart interpolation of sparsely pre-segmented slices enables accurate semi-automated segmentation by considering the complete underlying image data. Additionally, Biomedisa enables deep learning for fully automated segmentation across similar samples and structures. It is compatible with segmentation tools like Amira/Avizo, ImageJ/Fiji, and 3D Slicer.

Installation: Please follow the installation instructions.
Data: Download application examples from our Gallery.
[Biomedisa] Lösel, P.D. et al. Nat. Commun. 11, 5577 (2020).
[Deep Learning] Lösel, P.D. et al. PLoS Comput. Biol. 19, e1011529 (2023).
[Smart Interpolation] Lösel, P. & Heuveline, V. Proc. SPIE 9784, 97842L (2016).

Here are three concise working examples that illustrate the key features of Biomedisa (version 24.5.22 or higher) using Python. Update Biomedisa through pip install -U biomedisa. Explore more options of the Smart Interpolation and Deep Learning on GitHub.

In this webinar presented by Volume Imaging Australia and Microscopy Australia, you learn how to use Biomedisa in combination with 3D Slicer, both freely available open-source platforms for biological and medical image analysis. We begin by using Biomedisa’s smart interpolation to semi-automatically create training data. This data will then be used to train Biomedisa’s deep neural network for automated segmentation, demonstrated through example cases such as mouse molar teeth from micro-CT scans and mitochondria in electron microscopy images.

Large numbers of brain samples can reveal minor but statistically and biologically relevant variations that provide important insights into animal behavior, ecology, and evolution. Here, we used micro-CT imaging and Biomedisa's deep learning feature to perform automated analysis of 187 bee brains (honeybees and bumblebees). In bumblebees, we found a significantly larger right side of the optic and antennal lobes, providing a potential explanation for reported variations in visual and olfactory learning (bees learn better with their right eye and right antenna). Check out the paper!

HEDI as a tool that uses computed tomography with Valsalva maneuver to detect and assess hernia size, volume, and abdominal wall instability. Our first clinical application of HEDI in the preoperative evaluation of 31 patients shows significantly improved success rates compared to reported rates, with all patients remaining pain-free and experiencing no hernia recurrence after three years of follow-up. Check out the preprint!

Using Biomedisa's deep learning online is becoming more and more popular. The number of AI-based segmentations performed online exceeded three quarters of the interpolation tasks in the last three months of 2022. For those without access to GPUs, training your model online may be the optimal choice. Automated segmentation can then also achieved locally even with a CPU.

Biomedisa's smart interpolation runs on both NVIDIA GPUs and Intel CPUs with OpenCL. Follow the installation instructions. The best available platform is selected automatically. You can manually select a specific platform by calling one of the options: --platform cuda, opencl_NVIDIA_GPU or opencl_Intel_CPU. If you are using Biomedisa via web browser, select the platform on the Profile tab. Performance tests were run on examples from the gallery. Mineralized wasp: (1077, 992, 2553), every 20th slice pre-segmented. Trigonopterus: (1497, 734, 1117). Mouse molar: (413, 553, 413).

Biomedisa enables volume rendering with ParaView Glance. Use the 3D feature button to render a selection of files. In addition, you can use the newly added mesh generator to visualize your segmentation results. Choose "Attribute" for "Color By" to color each segment individually. Check out the head of the bull ant queen.

This short tutorial shows how to use Biomedisa to segment a weevil from a tomographic image stack (presented by Thomas van de Kamp, KIT).

Comparison of Biomedisa with a conventional approach for segmenting a weevil from a tomographic image stack (Lösel et al. Nat. Commun.).

Biomedisa segmentation results of a medaka rice fish, a fossil parasoid wasp reconstructed from Baltic amber, the tracheal system of a hissing cockroach, and the head of a bull ant queen (featured in Lösel et al. Nat. Commun.).

Biomedisa has been published as an open-source project in Nature Communications. The paper demonstrates that Biomedisa can drastically reduce both the time and human effort required to segment large images when compared to the conventional approach of densely pre-segmented slices, as well as when compared to other segmentation tools. Follow us on Twitter and YouTube for updated news and content.

Data acquisition was performed at the School of Dentistry from a sample of the Biology Department (Universidad del Valle, Cali, Colombia). The segmentation was done with AVIZO and Biomedisa, the 3D rendering and animation with Dragonfly. (Video: Julián Balanta-Melo).

It’s a surface mesh based on a fast synchrotron microCT scan of an Ichneumonid wasp at IPS@KIT. Scan duration: 43s, pre-segmentation with Amira, semi-automated segmentation with Biomedisa, rendering with CINEMA 4D. (Video: Thomas van de Kamp).

Julián Balanta-Melo et al. studied the effect of masticatory function on tooth enamel and dentin in adult mouse molars after segmentation of three separate materials (enamel, dentin, and alveolar bone). Left: 3D reconstruction with enamel (white) and dentin (yellow) without surrounding alveolar bone tissue. Their results were published in Revista Estomatología.

Wasps in several-million-year-old fly pupae studied with synchrotron X-ray micro tomography and analysed with Biomedisa. Parasitic wasps existed as early as several million years ago. Within a project coordinated by Karlsruhe Institute of Technology (KIT), researchers of various disciplines for the first time definitively discovered fossil parasites inside their hosts. The scientists studied fly pupae from old collections using ultrafast X-ray imaging. They found 55 cases of parasitation and described four extinct wasp species that were unknown until now. Their findings are reported in Nature Communications. The data is available at fossils.kit.edu and in our gallery.

The parasitic wasp Xenomorphia resurrecta deposits an egg in a fly pupa. Following imaging of the mineralized fly pupae at the imaging beamline of the Institute for Photon Science and Synchrotron Radiation (IPS) at Karlsruhe Institute of Technology, the parasitic wasps from the Paleogene were reconstructed digitally with Biomedisa. (Video: Thomas van de Kamp, KIT; Nature Communications)

Artificial intelligence in the form of deep neural networks has become an established method not only in speech recognition but also in image processing. Biomedisa AI is optimized for the segmentation of 3D image data. Artificial neural networks can be trained on fully pre-segmented data and applied to new, unknown data, enabling fully automated segmentation within seconds. See our gallery for an example.

Users, collaborators and scientists interested in using photon sources for their research, will meet at the annual DESY Photon Science Users’ Meeting "Research with Synchrotron Radiation and FELs" from 25 June to 26 January in Hamburg. We'll present Biomedisa within the scope of the talk "The NOVA project: maximizing beam time efficiency through synergistic analyses of SRμCT data" in the satellite "Helmholtz-Zentrum Geesthacht GEMS Outstation: Materials Research and High Resolution Imaging". We are looking forward to seeing you in Hamburg.

To support the workflow of Amira users, it is no longer necessary to convert Amira files to TIFF format. Images and labels can be loaded directly into Biomedisa as Amira files. The Biomedisa result is then saved as an Amira mesh with all meta information and can be loaded back into Amira.

The ICTMS 2017, from 26 June to 30 June, will bring together an international group of scientists, from universities, research organisations and industry, to discuss a broad range of issues related to the use of 3D tomographic imaging in materials and structures. An abstract can be found here.

The ISC High Performance 2017, from 19 June to 22 June, is dedicated to tackling HPC technological development and its application in scientific fields, as well as its adoption in commercial environments. It brings together researchers from academy and industry in the field of high performance computing. Biomedisa was represented together with the Computing Center of Heidelberg University and the EMCL.

Segmenting the blood pool and myocardium from a 3D cardiovascular magnetic resonance image allows to create a patient-specific heart model for surgical planning in children with complex congenital heart disease. By using Biomedisa we achieved a high segmentation accuracy combined with a small amount of manual labeling and a short computing time.

Read more »

Instead of using static images or movies, complex morphological 3D models based on segmented datasets have been published in the last years as 3D PDF files. 3D PDF files allow the user to handle and examine relevant structures interactively. As an example, you can download a 3D model of Euphthiracarus reticulatus by Sebastian Schmelzle here and open it with Adobe Reader. If you want to find out more, download more examples or even read about animated 3D PDF files, we strongly recommend you to read "Three-Dimensional Reconstructions Come to Life – Interactive 3D PDF Animations in Functional Morphology" by Thomas van de Kamp et al.

Read more »

On 8 December 2016 the 12th Modellierungstag Rhein-Neckar will focus on data visualization. The event aims to enable an exchange between scientists, developers, theorists, and industry. We will present Biomedisa and its recent developments.

MICCAI 2016, the 19th International Conference on Medical Image Computing and Computer Assisted Intervention, was held from 17 October to 21 October in Athens, Greece. The annual MICCAI conference attracts world leading biomedical scientists, engineers, and clinicians from a wide range of disciplines associated with medical imaging and computer assisted intervention. The biomedical image segmentation app was presented in a workshop being held along with the conference.

From 13 October to 16 October the 9th Graduiertentreffen der DZG (Deutsche Zoologische Gesellschaft e.V.) Fachgruppe Morphologie took place at KIT, Karlsruhe. Presentations were given about classical, modern, and future-oriented morphological image processing techniques. We presented our application and came into contact with many users and developers of morphological analysis tools. On 13 September we also gave a talk at the DZG Workshop "Engineering tools in morphology – automated image processing, rapid prototyping and determination of material properties" in Kiel, Germany.

From 27 February to 3 March 2016 the SPIE Medical Imaging Conference 2016 took place in San Diego, California, USA. More than 1,000 presentations were given on the latest research in the area of medical imaging covering various topics such as Physics of Medical Imaging, Image Processing, Computer-Aided Diagnosis as well as Image-Guided Procedures, Robotic Interventions, and Modeling. Biomedisa presented its diffusion algorithm based on their research „Enhancing a Diffusion Algorithm for 4D Image Segmentation Using Local Information" within the BMBF Project ASTOR.

Read more »