CTvox for iPhone & iPod touch

Page created by Ricardo Harris
 
CONTINUE READING
CTvox for iPhone & iPod touch
CTvox for iPhone & iPod touch
Version 1.5
CTvox for iPhone & iPod touch
Contents
Introduction .......................................................................................................................................... 1

Background ........................................................................................................................................... 1

    Volume rendering ............................................................................................................................ 1

    Multi-volume rendering................................................................................................................... 2

    Transfer function ............................................................................................................................. 2

Installing CTvox ..................................................................................................................................... 3

Creating and transferring volume data................................................................................................. 3

    VXM file transfer using Dropbox ..................................................................................................... 4

    VXM file transfer using iTunes ......................................................................................................... 6

Using CTvox ........................................................................................................................................... 7

    Rendering view ................................................................................................................................ 7

    Transfer function editor................................................................................................................. 10

    Multiple volumes ........................................................................................................................... 13
CTvox for iPhone & iPod touch
CTvox for iPhone & iPod touch 1.5                                                                       1

Introduction
The CTvox app brings 3D visualization of volumetric data using direct volume rendering to the iPhone
and iPod touch. Direct volume rendering is a visualization technique that allows intuitive and
interactive exploration of 3D voxel data by selectively introducing transparency and color. Examples
of 3D voxel data include (micro)CT and MRI scans and synthetic data resulting from numeric
computations.

Central to volume rendering is the concept of the transfer function: it governs the mapping of the
original scalar data to a voxel's transparency and emission color, which are determining for the
rendering's appearance.

The following section offers a more detailed theoretical background on these concepts. To get
started right away, skip to the section on installing CTvox, on creating and transferring volume data
or on using CTvox.

Background
Volume rendering

Volume rendering is a 3D visualization technique that works directly on the volume data, rather than
relying on a geometric model built using this data as is the case in surface rendering. It allows to
interactively make selected portions of the data more or less transparent, providing a way to see
through the data and thus reveal complex 3D relationships in real-time.

In volume rendering, every voxel of the volume is assigned:

       an emission color: the voxel emits light of a certain color and intensity. This color is
        characterized by its red, green and blue components (or channels).
       an opacity (opacity, also referred to as alpha, is the opposite of transparency.) The
        transparency of a voxel determines how much of the light from more distant voxels (along
        the same line of sight) passes through.

The so-called transfer function determines how the original volume data (in the case of CT,
representing X-ray attenuation) is mapped to emission and opacity. By adequately mapping to
emission color, distinct features can be color-highlighted (in the case of CT, e.g. different material
types). By tuning the opacity mapping, the degree to which more distant features shine through and
thus contribute to the final rendering can be modified (in real time). Specific features can even be
totally suppressed by mapping the corresponding data values to full transparency (= zero opacity).

The concept of imaging mode is also determining for the appearance of the rendering. The
supported imaging modes are:

       Surface
        This mode corresponds to the general emission-absorption model described above.
CTvox for iPhone & iPod touch
CTvox for iPhone & iPod touch 1.5                                                                         2

       Maximum intensity projection
        For every ray hitting the screen, only the most opaque voxel along the ray is retained.
        Hence, this mode automatically highlights the structures of maximum intensity.
       Attenuation
        In this mode, the opacities for every voxel along a ray hitting the screen are integrated, mi-
        micking the effect of a radiograph taken along the current viewing direction.

Multi-volume rendering
The technique of volume rendering can readily be extended to multiple volumes: every volume has
its own transfer function, yielding an emission color and opacity per volume. These emission colors
and opacities are then appropriately weighted to produce a combined emission color and combined
opacity.

A typical application for multi-volume rendering is multi-modality 3D imaging, in which distinct 3D
imaging techniques (CT, MRI, SPECT/PET, ...) provide multiple volumetric images (and typically
complementary information) of a single sample.

When working with multiple volumes, only the Surface imaging mode makes sense and is thus the
only imaging mode available.

Using the weight controls, the relative contribution of any volume to the rendering can be increased
or diminished; for instance, a volume can temporarily be made invisible.

Transfer function

In volume rendering, every voxel in the volume is assigned an emission color (the color the voxel
emits, determined by its red, green and blue components) as well as an opacity (opacity is the
opposite of transparency.) Both of course depend on the original volume data and the mapping is
governed by the so-called transfer function. The horizontal axis in the plot represents the original
scalar data (the x-ray attenuation), the vertical axis represents one of the transfer function
components (red, green, blue, luminance, opacity).

Modifying the opacity controls the visibility of the corresponding voxels and how much they obscure
more distant voxels. By setting the opacity for a given intensity range to zero (full transparency), the
corresponding voxels are effectively made invisible.

Two types of transfer functions exist:

       The color channels are linked into a single intensity (or luminance) channel, which modulates
        a user-specified base color. Only varying intensities of the specified base color or gray scales
        (if the base color is white) will appear in the image.
       The color channels vary independently (red, green and blue channels).
        Multiple colors can be introduced in the image and are typically used to highlight various
        elements of the volume data.

The following table illustrates both types of transfer functions:
CTvox for iPhone & iPod touch
CTvox for iPhone & iPod touch 1.5                                                                        3

                          Channels                    Rendering

                          luminance
                          opacity

                          red
                          green
                          blue
                          opacity

Installing CTvox
To install CTvox on your device, go through Apple’s App Store, in the usual fashion (the app is free of
charge.)

Creating and transferring volume data
Volume data for the CTvox app is stored in a VXM file. A VXM file contains both the volume data and
the associated transfer function(s).

VXM files are generated using the companion CTvox application for the Windows desktop, shown
below.

The desktop application can be downloaded free of charge from the Bruker microCT website, here.
CTvox for iPhone & iPod touch
CTvox for iPhone & iPod touch 1.5                                                                        4

To generate a VXM file from a dataset, select Export as VXM Data... from the Actions menu. All
currently visible volumes (up to four volumes) will be included in the exported dataset. The volume
data is adequately resized and saved as a single VXM file. The transfer function(s) (one per volume),
the scene's background color and the various labels are stored in the VXM file as well.
For full details on creating VXM files, we refer to the desktop application's online help on the Export
as VXM Data command.

The easiest way to transfer a VXM file to your iPhone or iPod touch is to download it wirelessly using
the device itself. Any method will do: through the web browser, as an email attachment, using a
cloud storage app such as Dropbox, Google Drive or OneDrive. Next, open the downloaded file: this

may be initiated automatically after download or may require you tapping the Share button       :
CTvox will launch and open the VXM file. From then on, the dataset is available for loading from
CTvox's storage.

A set of example datasets is available here.

In the following sections, we’ll first cover in more detail how to use Dropbox to transfer VXM files,
then describe an alternative method using iTunes.

VXM file transfer using Dropbox
Dropbox is one of several free cloud storage and file synchronization services. Files can be uploaded
to Dropbox's servers and then shared between any number of computers and mobile devices. As
such, it's ideally suited to transfer VXM files generated on your Windows PC using CTvox to your iOS
device.

Popular competitors offering a similar service include Google Drive and Microsoft's OneDrive.

Signing up for the service can be done through the Dropbox website, as part of the Windows
installation or from within the various mobile apps. To create an account, you'll need to specify your
first and last name and an email address as id.

Visit the Dropbox website to download the Windows version of the software. Installing Dropbox on
your PC creates a special Dropbox folder in the file system. Files placed in this folder will
automatically be synchronized with the cloud storage and thus be accessible from any computer or
device connected to internet that supports Dropbox.

To install Dropbox on your iPhone or iPod touch, go through Apple's App Store, in the usual fashion.
CTvox for iPhone & iPod touch
CTvox for iPhone & iPod touch 1.5                                                                  5

When installation has completed, launch the Dropbox app and sign up or sign in, depending on
whether you've already created your account. Navigate to the desired VXM files in your Dropbox.

The screenshot below shows a Dropbox subfolder containing VXM files.

Tap a VXM file to download it to the device. When downloading has completed, the app reports that
it cannot display the VXM file.
CTvox for iPhone & iPod touch
CTvox for iPhone & iPod touch 1.5                                                                          6

However, tapping the Share button , then selecting Open In... offers to open the downloaded file
using CTvox. As previously mentioned, this will copy the dataset to CTvox's dedicated storage and
launch CTvox to open it. From then on, the dataset is available in the Open dataset view.

VXM file transfer using iTunes

As an alternative method, you can use iTunes (9.1 or later) to transfer VXM files (and TF files, for that
matter) to your iPhone or iPod touch. Here's how (the following screenshots were taken using
iTunes 12.2 on Windows):

    1. Connect your device (physically) to your computer and launch iTunes.
    2. Select your device.

    3. Select the Apps tab and scroll to the bottom of the page.
CTvox for iPhone & iPod touch
CTvox for iPhone & iPod touch 1.5                                                                     7

   4. The CTvox app should be listed under the File Sharing section. Select the CTvox app: the files
      associated with CTvox on your device will appear in the Documents pane on the right.
   5. Use the Add... button or drag and drop files onto the Documents pane to transfer them to
      the device.

Transferred VXM and TF files will now appear in the Open dataset and Load transfer function views,
respectively.

Using CTvox
Rendering view

When launched, the app opens to an empty rendering view, waiting for a dataset to be opened.

Tapping the Open dataset button      presents a list of the datasets in the app's storage.
CTvox for iPhone & iPod touch
CTvox for iPhone & iPod touch 1.5                                                                      8

Tapping the Edit button in the navigation bar allows you to delete datasets from the storage: tap the
   button to the left of a dataset, then confirm by tapping         .

Tap a listed dataset to open it.

The following gestures are available to adjust the scene:

         Dragging with a single finger rotates the volume.
         Pinching moves the camera closer or further.
         Dragging with two fingers translates the volume.
         A long press followed by dragging moves the faces of the clipping box.

By default, volume and clipping box will move as one. Setting Control to Clipping box in the Clipping
options      will cause the clipping box to move independently from the volume.
CTvox for iPhone & iPod touch 1.5                                                                       9

The remaining Clipping options include switching between clipping and cutting action for the clipping
box and showing/hiding the clipping box. A double tap in the rendering view will also switch control
between volume and clipping box.

The     button groups the remainder of the settings:

The Imaging mode specifies how light contributions from the various voxels are blended and is thus
determining for the final appearance of the rendering (cfr. background item on volume rendering.)

Tapping the Reset scene button        resets the scene (orientation and translation of both volume and
clipping box, size of the clipping box) as well as the Clipping options and Imaging mode settings.

The background color for the rendering can be modified: tapping the Background color row pops up
a color picker to select the new color.
CTvox for iPhone & iPod touch 1.5                                                                        10

Please note that loading a dataset changes the background color: when creating the VXM file using
the desktop application, the then active background color is stored in the file; the mobile app will
apply the stored background color when opening a dataset.

In the same vein, up to two text labels are included by the desktop application in the created VXM
file. These labels can be used to augment the dataset with information such as a description,
authoring information or copyright notice.
The visibility of the labels can be toggled (unless the content protection feature was checked during
export) and their size adjusted. The labels can be repositioned, too, simply by dragging them.

The following table summarizes the controls for the rendering view.

                 Touch/gesture                Effect
                 One finger drag              Rotation
                 Two finger drag              Translation
                 Pinch                        Camera distance
                 Long press + drag            Move face clipping box
                 Single tap                   Show transfer function editor
                 Double tap                   Toggle volume/clipping box control

Transfer function editor

A single tap in the rendering view or tapping the       button opens the transfer function editor: the
transfer function is overlaid on the rendering view and available for editing. As the transfer function
is modified, the rendering is updated in real time. A preview bar shows the resulting emission color.
CTvox for iPhone & iPod touch 1.5                                                                       11

Single tapping outside the plot or tapping the Done button closes the transfer function editor and
reverts to the rendering view.

The toolbar’s leftmost button is used to select the active channel, i.e. the one that’s being edited,
and to set channel-specific properties. The button displays the active channel (the opacity channel is
abbreviated as A, for alpha), its background reflects the selected base color.

Switching the active channel may switch the transfer function's type (cfr. background item on
transfer functions.)

When the transfer function's type is luminance-opacity, tapping the Base color row presents a color
picker to set the transfer function's base color.
CTvox for iPhone & iPod touch 1.5                                                                      12

The type of curve interpolating the markers for the active channel can also be specified: a jagged
polyline (useful to realize sharp transitions) or a smooth spline.

Use the following touches/gestures to edit the active curve:

       A single tap adds a marker or moves an existing one.
       Drag a marker to move it.
       Double tap a marker to remove it.

The Reset button       allows you to reset the active channel, all channels or revert to the original
transfer function included with the dataset.

Transfer functions can be saved and subsequently reloaded. The file format used is the same as for
the desktop version (TF files), hence transfer functions can be exchanged. Use the         button to
invoke the Load and Save transfer function views.
CTvox for iPhone & iPod touch 1.5                                                                       13

The TF file extension is registered with CTvox, which means that TF files can be transferred to the
app's dedicated storage by downloading them to the device and then requesting to open them in
CTvox (cfr. Creating and transferring volume data.) From then on, they will show up in the Load
transfer function view.

Tapping the Edit button in the navigation bar allows you to selectively delete transfer functions.

Multiple volumes

After opening a multi-volume dataset, the toolbar will show an additional button         to invoke the
Multi-volume options.

A legend to identify the various volumes can be displayed. These volume labels are inserted by the
desktop application in the VXM file at the time of creation.
Like the text labels discussed earlier, the size of the volume labels can be adjusted and the legend
can be repositioned by dragging it.

The relative contribution of the various volumes to the rendering can be adjusted interactively by
enabling the volume weight controls: a set of sliders, one per volume, is overlaid on the rendering,
allowing adjustment of the relative weights.
The screenshot below shows the volume weight controls for a four-volume dataset.
CTvox for iPhone & iPod touch 1.5                                                                      14

The controls can be repositioned by dragging the translucent pane.
Tapping Reset weights     will restore the volume weights to their initial values.

The following screenshot showcases an application of multi-volume datasets. The VXM dataset
consists of two volumes: a structural micro-CT scan of a core sample (a cylindrical rock section) and
the matching pore thickness information, obtained through post-processing of the micro-CT data.
The rock structure has been given a clay-like appearance and is augmented with the color-coded
pore thickness information. The legend, weight control and labels are all visible.

The transfer function editor, too, looks slightly different for a multi-volume dataset: since every
volume has its own transfer function, a volume selector appears leftmost in the toolbar, to allow
switching between the various transfer functions.

The Reset menu has some additional options:
CTvox for iPhone & iPod touch 1.5                                                                       15

     Restore all initial TF
      This will reset every volume's transfer function to its initial state, rather than just the one
      currently selected.
     Apply TF to all volumes
      This option will apply the currently selected transfer function to the remaining volumes, i.e.
      all volumes will have identical transfer functions.
You can also read