Heart clone using MONAI

-
Drag to rotate, scroll to zoom. The heart stands on an axial slice of the CT it was built from, with a coronal slice behind it and the scanned volume drawn as a cage; the sagittal slice is off by default. Each slice averages a 2 mm slab, which is 5 measured slices, because a single gated phase is a noisy image. The number beside the slider is the volume enclosed by the heart surface at that phase. 32,004 triangles per phase, 21 phases, 4.4 MB.

How it was built

  1. The study

    A gated 4D cardiac CT of a truncal valve case, from the Jolley Lab at CHOP. 21 phases, 0.6 mm voxels, 2.5 GB.

  2. Finding the heart

    TotalSegmentator v2 through MONAI Physio, contrast aware. 58 structures in 400 s on an RTX 4050, on the reference phase only.

  3. Measuring the motion

    Greedy diffeomorphic registration warps the other 20 phases onto phase 15. The deformation fields are measured tissue displacement. 19.8 min.

  4. Fitting a browser

    One surface decimated with vtkDecimatePro, so every phase keeps the same vertices. Shipped as glTF morph targets. 7.0 MB.

Sources

Toolkit: MONAI Physio (opens in a new tab) 2026.9.1, Apache 2.0, NVIDIA and Project MONAI. Segmentation: TotalSegmentator (opens in a new tab), Wasserthal and colleagues, Radiology: Artificial Intelligence, 2023. Study: Slicer-Heart-CT, Jolley Lab, Children's Hospital of Philadelphia, through SlicerHeart (opens in a new tab).

Questions

One study, built end to end to see whether the pipeline holds together in a browser. Not a clinical measurement and not for diagnostic use.

What am I looking at?

A surface of one child's heart, rebuilt from a cardiac CT and moving through the beat the scan recorded. It is not an animation drawn by hand: each of the 21 shapes is measured, and the slider steps through them in the order they were acquired. The slices under and behind the heart are the CT itself, so the surface can be checked against the image it came from.

What is a gated cardiac CT?

A heart moves too fast for one exposure, so the scanner records continuously and sorts the data by where it fell in the cardiac cycle, read from the ECG. The result is not one image but a stack of them, here 21, each showing the same anatomy at a different moment of the beat.

The cost is noise. The dose that would make one clean image is split across the phases, so a single phase is grainier than a standard CT. That is why each slice drawn here averages a 2 mm slab, five measured slices, rather than showing one.

What is segmentation, and what did it?

Segmentation labels every voxel with the structure it belongs to, which turns a grey volume into named objects that can be measured or drawn. Here it was done by TotalSegmentator v2 in its contrast-aware form, run through MONAI Physio: 58 structures in about 400 seconds on an RTX 4050, on the reference phase only.

Running it once rather than 21 times is deliberate. A network run independently per phase gives 21 unrelated label maps that flicker against each other; one segmentation carried through the beat by registration stays consistent.

How does the shape move if only one phase was segmented?

By deformable registration. A greedy diffeomorphic algorithm warps each of the other 20 phases onto phase 15 and reports the deformation field: for every point in the volume, where that tissue went. That field is applied to the single segmented surface, so the mesh is pushed around by measured displacement rather than remodelled from scratch. About 20 minutes of compute.

The useful property is correspondence. Every phase has the same vertices in the same order, so a vertex that sits on the apex stays on the apex.

How does a 2.5 GB study fit in a browser?

The volume never reaches the browser. Only the surface does, decimated with vtkDecimatePro to 32,004 triangles and shipped as glTF morph targets: one mesh plus a set of per-vertex offsets for each phase, which the graphics card interpolates between. 21 phases, 4.4 MB. The CT slices are sent as three images, not as the volume.

What is the volume number beside the slider?

The volume enclosed by the surface at that phase, computed from the mesh. It moves the way a ventricular volume curve should, which is a useful check that the registration did something physical, but it is a property of a decimated surface rather than a clinical measurement, and the case is a truncal valve rather than a normal heart.