Virtual Simulation
Virtual Simulation
Dr. Stelios Zimeras (zimste@aegean.gr) University of the Aegean, Department of Statistics and Assurance Sciences, 83200 Karlovasi Samos, Greece. Abstract
Simulators are medical devices used in the oncology clinics to perform the simulation for the external beam radiotherapy treatment. Unlikely for a clinic to obtain a real Simulator is a high investment in terms of money, space and personnel. The alternative here can be a Virtual Simulator (VS). The CT simulators are system-software that can perform the simulation process using the Computed Tomography (CT) data set of the patient, including the external patients skin landmarks, instead of the physical patient. In this paper, a new high performance CT based virtual simulation system running on a low cost widely available PC hardware EXOMIO would be presented. The implemented high-end visualization techniques allow the users to simulate every function of the real simulator including the mechanical component movements, radiation beam projection and fluoroscopy. localization-reference markers made from radio-opaque material (e.g. aluminium), which are attached on the patients skin. The volumetric CT data are directly transferred to the CT-Sim via the local network of the clinic. This work describes a new CT based virtual simulator system, EXOMIO1, that has been developed at Fraunhofer IGD in collaboration with Stdtisches Klinikum Offenbach, department for radiation therapy, and is now used in clinical practice already at several institutes worldwide. Its main advantages are: (a) it is based on low cost and widely available hardware (PC), unlike the other commercially available systems that depend on expensive workstations, (b) it provides high quality and high performance visualization tools and (c) it can be connected via network to any DICOM supporting CT or MR scanner and via DICOM-RT supplements it enables support for treatment planning system and verification system at linear accelerators.
1 INTRODUCTION
Radiation therapy (RT) uses high-energy photon rays in order to deliver a very accurate dose of radiation to a well-defined target volume with minimal damage to surrounding healthy tissues. The desired result is the eradication of the disease and the improvement or prolonging of patients life. RT is a very demanding process that requires accuracy and effectivity. The RT process is composed of several steps. One important step in this process is simulation. Simulation provides localization of the target volume, the area that will receive the maximum amount of dose, and delineation organ at risk, the volumes and organs that must receive the minimum dose. Once these structures have been well defined, the next step is the definition of the irradiation fields in relation with the target volume and the organs at risk. During treatment, the patients receive their therapy via a number of fractions. Therefore, there must be a confirmation that the irradiation orientation and the structure localization remain unchanged. One of the significant technological advances in radiation oncology in the past 20 years is the implementation of CT-based virtual simulation in the clinical routine. The concept, often termed CT-Sim virtualises the simulation process that is performed on a conventional simulator. The patient is scanned on the CT device together with
the detector is making a 360-degree rotation. During the rotation the detector takes numerous snapshots (profiles) of the attenuated x-ray beam. The CT images are reconstructed from a large number of measurements of xray transmission through the patient. This projection data are used to reconstruct the CT image (Figure 1). Figure 2 shows an slice from an x-ray CT in the heart lung area.
Figure 3. Current clinical routine for external beam treatment delivery. One of the significant technological advances in radiotherapy in the past 20 years is the implementation of CT or Virtual Simulators (VS), in the clinical routine. Sherouse in 1987 [1] first proposed the concept, often termed CT-Sim to distinguish it from Sim-CT where a simulator is modiefied for CT use and by the late 1990s several designs and clinical assessments of CT virtual simulators have been reported [1-8]. Using VS, the clincal routine is modefied accordingly (Figure 4) [9,10]: 1. 2. Collect patients CT data including attached aluminium markers. Transfer CT data to VS. The physician defines the tumour volume and the organs at risk and she/he will place the necessary fields relative to the tumour volume. The simulation plan and the CT data are transferred via DICOM (Digital image and Communication in Medicine) server to the TPS for dose calculation and final treatment plan optimization. Verify patient position on LINAC before irradiation. Perform treatment on the treatment machine (Linear Accelerator or LINAC).
3.
4. 5.
Figure 4. Current clinical routine for external beam treatment delivery. Considering the above steps, one can evaluate the importance of the communication requirements of a CT-
Sim. In EXOMIO the philosophy of the stand-alone CTSim system is adapted. In practice, the system is capable to interface any CT scanner device and any treatment planning system through DICOM communication protocol. The DICOM protocol is used for communicating digital images from the medical imaging modalities, and the DICOM-RT supplements to communicate structures and beam data to/from the treatment planning systems and verification systems. All datasets can be stored in the EXOMIO server and one can access them from any client installed on the local network of the institution.
movements of the mechanical component and description of the components dimensions (e.g., multileaf collimator, or MLC) (Figure 5).
Figure 5. The six-window layout of EXOMIO. On the left side the slices windows, the middle lower window is the OEV, the lower right the Room View and the upper right hosts the BEV.
rendering techniques or to those images that are generated from volume data using a better approximation of the physical model. In both cases we try to simulate the attenuation of the X-ray through the digital patients body. The manipulation of tissue properties like the mass attenuation coefficient, assist the generation of unique images simulating physical principles of radiographic imaging. The most common example is the generation of mega-voltage DRR images for direct comparison with the portal images. In addition DRR images provide unique anatomical information to the clinicians that no conventional X-ray device can produce. An example of different X-ray reconstruction modes is illustrated in Figure 6.
Figure 6. Volume rendering modes supported from EXOMIO. On the top row from left to right: isovalue mode, semitransparent mode and maximum intensity projection. On the lower row X-ray images reconstructed using different tissue ranges. From left to right: full tissue range, muscle tissues and lung tissues. Another type of 3D image with high importance in CT simulation is the external body surface anatomy. Highresolution volumetric CT data in combination with volume rendering techniques can produce a very accurate representation of 3D patient anatomy. This concept is extremely suitable for assessing the configuration of the radiation beam in three dimensions. EXOMIO supports the visualization of the irradiation beam and block arrangement as 3D semitransparent objects. In addition the light field projection of the radiation field, delineated or not, can be simulated and manipulated in real time during field rearrangement or shielding block-contour design (Figure 7).
Figure 7. The light field projection on patients skin (left). 3D beam object reconstructed with patients CT data (middle). Virtual light field projection on patients surface.
In figure 10 an oblique cut in the OEV window is shown and is used for the validation of the field configuration through the 3D patient volume. Figure 8 demonstrates the overall 3D nature of the EXOMIO simulator. This includes the addition of a fifth field, which is noncoplanar to the four fields in the box-technique.
Figure 8: 3D segmentation images for different organs : Skin, Lungs and Spinal canal, Bronchus, Spinal canal with left lung and tumour, Spinal canal and Lungs (different view).
RESULTS
One example of the use of EXOMIO in clinical practice would be presented. The patient is a 75 years old patient with stage T3N0M0 cancer of the prostate. The radiation fields cover the entire prostate glands, which includes safety margins. For this case, CT slices of 3mm thickness and 3mm slice distance have been reconstructed using spiral CT acquisition from a 512x512 pixel matrix. Figure 9 shows the clinical target volume (CTV) delineation procedure. EXOMIO offers the possibility to contour the CTV in at least three planes (one sagittal, one coronal and at least one axial CT plane) and it automatically extracts the 3D CTV. The physician can then do fine contour corrections if necessary. After the CTV is validated the physicians decide the appropriate clinical margins. In this prostate case anisotropic margin of 10 mm in the lateral, 10 mm in the cranio-caudal and 0 mm in the ventro-dorsal axes have been used.
Figure 10: Planning of an additional fifth beam noncoplanar to the four fields of the box-technique. (Top left) Coronal plane. (Centre left) Sagittal plane. (Bottom left) CT slice with the fifth field. (Top right) DRR for the new field with the automatically on PTV adapted block: irregular field. (Bottom centre) OEV showing the patient, the beam cone and the light field projection on the skin for the fifth field and the 3D PTV. (Bottom right) 3D room view of the virtual simulator and patient.
DISCUSSION
Figure 9: Automatic extraction of PTV from delineated CTV in EXOMIO by applying user defined clinical margins. The extracted PTV and CTV are shown in different colours in the three major planes and in the OEV (3D).
The advantages of CT-based virtual simulation are well known and include the fact that target volumes, critical organs and structures can be effectively defined and displayed in multiple image planes (axial, coronal, sagittal or oblique). Improved manual and automated contouring tools greatly simplify normal critical structure, tumour, and target volume delineation. A direct interface to the treatment planning system permits efficient virtual verification. In CT-Sim it is possible to display more information on the same screen such as: (a) the beams eye-view, where the Digital Reconstructed Radiograph is displayed, (b) the room view including a 3D model of the simulator or the treatment machine and (c) the observers eye-view, where the 3D surface reconstruction of the patient is shown. These images offer the user an overview of the simulation and treatment planning process. Furthermore, in virtual simulation one can observe larger parts of the patients volume than on the conventional simulator where fluoroscopy is limited by the dimensions
of the image intensifier (detector). According to our clinical experience the CT-Sim system could simulate all of the treatment cases, replacing completely the real simulator. The CT-Sim system has been easily integrated into our clinical radiotherapy routine. The modification required in the CT room was the installation of the laser marking system for the registration of the treatment reference point, similar to the installation in the LINAC room. In addition, the flat CT table-top had to replace the original curved table-top. Visualization of multileaf collimator (MLC) field is only possible with CT-Sim and this is most important because of widespread use of MLCs. CT-Sim also makes it possible, without the patient needing to be recalled, for verification to be repeated after changes to the treatment plan. Indeed, CT-Sim may eliminate the requirement for a conventional simulator for several treatment sites. All the main features of a classical simulator are available, software based, in EXOMIO. The validation of beam geometries in a classical simulator is only based on X-ray contrast between tissues of different densities such as bone, lung or a contrast filled organ such as the bladder. In particular CT based simulation enables accurate delineation of multi-field geometries, all necessary field matching and multi-planar field adaptation as shown in our results. These functions are not possible with classical simulation. In addition the CT based virtual simulation brings benefit for patient scheduling because it avoids the often experienced bottlenecks in patient workload flow within a department of radiation oncology. Finally 3D visual representation of the particular organ, in addition with the clinical examinations, could be a powerful tool to the doctors for diagnosis, medical treatment or surgery.
4 5 6
8 9 10
ACKNOWLEDGEMENT
The author would like to thank Prof George Sakas and Grigoris Karangelis for the useful scientific help and comments about the progress of this work. Also many thanks to MedCom Company and Stdtisches Klinikum Offenbach whom gave him equipments and medical data sets for the implementation of the above work. Finally the author would like to thank the EC and the Marie Curie Fellowship Association for this great opportunity to work with different people. This work was supported by a Marie Curie Industry Host Fellowship Grant no: HPMICT-1999-00005 and the author is a MCFA member.
11 12 13 14 15
REFERENCES
1 Sherouse, G.; Mosher, C.; Novins, K.; Rosemann, J.; Chaney, E.L. Virtual simulation: concept and implementation. In: Proceedings of 9th International Conference of the Use of Computers in Radiation Therapy (ICCR). Scheveningen, The Netherlands: North Holland Publishing Co.; 1987:433-436. 2 Nagata, Y.; Nishidai, T.; Abe, M.; Takahashi, M.; Okajima, K.; Yamaoka, N.; Ishihara, H.; Kubo, Y.; Ohta, H.; Kazusa, C. CT Simulator: A new 3-D
16
planning and simulating system for radiotherapy: Part 2. Clinical application. Int J Rad Oncol Biol Phys 1990;18:505-513. Nishidai, T.; Nagata, Y.; Takahashi, M.; Abe, M.; Yamaoka, N.; Ishihara, H.; Kubo, Y.; Ohta, H.; Kazusa, C. CT Simulator: A new 3-D planning and simulating system for radiotherapy: Part 1. Description of system. Int J Rad Oncol Biol Phys 1990;18:499504. Rosenman, J.; Sailer, S.; Sherouse, G.; Chaney, EL.; Tepper, JE. Virtual simulation: Initial clinical results. Int J Rad Oncol Biol Phys 1991;20:843-851. Sherouse, G.; Chaney, EL. The portable virtual simulator. Int J Rad Oncol Biol Phys 1991;21:475482. Perez, C.; Purdy, J.A.; Harms, W.; Gerber, R.; Matthews, J.; Grigsby P.W.; Graham, M.L.; Emami, B.; Lee, HK.; Michalski, JF.; Baker, S. Design of a fully integrated three-dimensional computed tomography simulator and preliminary clinical evaluation. Int J Rad Oncol Biol Phys 1994;30:887897. Butker, E.K.; Helton, D.J.; Keller, J.W.; Hughes, L.L.; Crenshaw, T.; Davis, L.W. A totally integrated simulation technique for three field breast treatment using a CT simulator. Med Phys 1996;23:1809-1814. Chen, G.T.Y.; Pelizzari, C.A.; Vijayakumar, S. Imaging: The Basis for Effective Therapy. Front Radiat Ther Oncol 1996;29:31-42. Michalski, J.M.; Purdy, J.A.; Harms, W.; Matthews, J.W. The CT-Simulation 3D Treatment Planning Process. Front Radiat Ther Oncol 1996;29:43-56. Karangelis G, Zamboglou N: EXOMIO: A 3D Simulator for External Beam Radiotherapy. , Volume Graphics 2001- Proceedings of the Joint IEEE TCVG and Eurographics Workshop in Stony Brook, New York, USA, Springer-Verlag Wien New York, 2001 351-362. Cai, W. Transfer functions in DRR volume rendering. CARS'99, Paris, France, June 1999, 23-26. Levoy, M. Display of surface from volume data. IEEE CG&A, 1988:8(5). Sakas, G. Interactive volume rendering of large fields. The Visual Computer, 1993, 9(8):425-438. Sakas, G., Grimm, M. and Savopoulos, A. Optimised maximum intensity projection (MIP), Rendering Techniques'95, Springer Verlag 1995:51-63. G. Karangelis, S. Zimeras, E. Firle, Min Wang, G. Sakas: Volume definition tools for medical image applications, 4th MICCAI International Conference, Utrecht, Neitherlands, M.-A. Viergever , T. Dohi, M. Vannier (eds.), Springer-Verlag, Lecture Notes in Computer Sciences 2208, pages 1295-1297. S. Zimeras, G. Karangelis: Semi-automatic Segmentation Techniques for CT Medical Data, 3rd
caesarium Computer Aided Medicine November 1213, Bonn, Germany, 2001. 17 G. Karangelis, S. Zimeras: An Accurate 3D Segmentation Method of the Spinal Canal Applied on CT Images, BVM 2002, Confedrence Proceedings Meiler M, Saupe D, Kruggel F, Handels H, Lehmann TM, (Hrsg) Bildverarbeitung fr die Medizin 2002, Springer-Verlag, Berlin, 2002, 366-369, Germany. 18 S. Zimeras, G. Karangelis, E. Firle: Object segmentation and shape reconstruction using
computer-assisted segmentation tools, Medical Imaging 2002, San-Diego, USA. 19 G. Karangelis and S. Zimeras: 3D segmentation method of the spinal cord applied on CT data, Computer Graphics Topics, 1/2002, Vol 14, 28-29.