ABSTRACT: a virtual view for guiding the service

As an alternative to building custom electronic devices that connect to mobile phones via
Bluetooth or USB, we present a new approach using Augmented Reality (AR) and machine
vision to digitally recognize a biomedical device and capture readings automatically. AR to
create accurate 3-dimensional reconstructions of tumors and human organs. The complex image
reconstructing technology basically empowers surgeons with X-ray views – without any
radiation exposure, in real time. The AR graphic overlay is used to provide feedback to patients
and doctors by displaying personalized reference values. It is integrate with EMR’s, clinical
information feeds and medical imaging systems to support clinical decision making through a
combined AR view. It uses everyday technology – any pair of computers, tablets or smartphones
with cameras can be used to connect surgeons & students, in real time, anywhere in the world.
AR can be used to capture medical device data on a mobile phone and help automate the data
recording tasks performed by health workers in developing countries.
THE TERM “augmented reality” (AR) refers to the overlay of computer-generated graphics over
a real-world scene. A special requirement of AR is the fact that the structure generated by
computer graphics has to be linked to the viewed scenery, i.e., the perceived position of the
scenery and the computer-generated object have to match. Besides using a display system that
allows for merging real and virtual views, a second requirement is the accurate tracking of the
position of the viewer relative to the viewed scene . A head-mounted display (HMD) can be used
to generate a virtual view for guiding the service engineer through the plane’s blueprints during
inspection. The joint display of virtual and real scenery in the HMD which is difficult to achieve
in a simple HMD design where the only optical element in the viewer’s optical path is a simple
beamsplitter. The acceptance of the HMD by physicians. Clinical experience with CAS clearly
shows that an additional cumbersome device such as a bulky HMD will not find a place in the
operating room.
The Varioscope is a head-mounted, lightweight operating binocular developed and produced by
Life Optics, Vienna, Austria (Available at http://www.lifeoptics.com). It features autofocus with
automatic parallax correction (operating range: approximately 300–600 mm) and zoom
(magnification range 3.6–7.2 ). Parallax correction is necessary since the short operating range
would otherwise inevitably lead to double images due to the parallax between left and right eye;
in the current version of the Varioscope, merging the optical axes of the left and right tube is
achieved by moving the tubes in- and outwards. The overall weight of the Varioscope is about
300 grams. The physical dimensions of the base instrument are 73x120x64 mm (W/L/H).
This commercially available device was modified for AR visualization in close cooperation with
the manufacturer and Docter Optics, Vienna, Austria; we refer to the prototype as the Varioscope
AR. Since the optical properties of the Varioscope are the same as of an astronomical telescope,
the insertion of image rectification prisms into the optical path is necessary; this offers a
convenient way to add the beamsplitters for merging the computer-images and the optical view
as captured by the lens of the Varioscope.