How 3D and mixed reality can transform bone cancer surgery

When a patient is diagnosed with osteosarcoma, an aggressive form of bone cancer, the mission is to remove the tumor entirely. Leaving behind even a microscopic cluster of malignant cells can be the difference between remission and cancer recurrence. In the world of musculoskeletal oncology, a specialized orthopedic surgeon must act as both an architect and a demolition expert.

An article published in Arthroplasty shows how a Yale team compared mixed reality, patient-specific instruments, and freehand approaches to osteosarcoma resection. This proof of concept illustrates how the adoption of patient-specific instrumentation and mixed reality techniques can preserve bones and joints while decreasing resection failure rates.

Bone cancer surgery

Musculoskeletal oncology surgeons have historically relied on what is known as a wide margin strategy. Margins refer to the distance between the edge of the tumor and the healthy cells. This surgical technique involves cutting well into the healthy bone surrounding the tumor. By removing a significant buffer of healthy material, the surgeon creates a safety zone, ensuring the cancer is trapped within the removed segment.

However, this precaution comes at a cost. Removing too much bone can mean the loss of a knee joint, the shortening of a limb, or the need for a full amputation. It can create lifelong physical limitations for the patient and permanently affect quality of life. On the other hand, cutting too close to the tumor can leave cancerous cells behind.

For decades, this delicate balance was struck using freehand techniques. A surgeon would look at a two-dimensional scan, pick up a surgical marker, and draw a line on the patient’s bone based on mental measurements and experience.

As technology evolves, a new question has emerged: Can surgeons use digital blueprints to make these cuts with the precision of a laser, saving the limb without risking the life?

Limits of the human hand

The traditional freehand approach is a testament to surgical skill but can be limited by human perception. Even the most gifted surgeon is trying to translate a flat, black-and-white image from a computer screen onto a complex, three-dimensional curve of a human bone. In the operating room, the view is also obscured by muscle, blood vessels, and the visual constraints of the surgical site.

“When we operate freehand, we are essentially navigating a three-dimensional landscape using a two-dimensional map,” explains Dieter Lindskog, MD, associate professor of orthopedics and rehabilitation at Yale School of Medicine and one of the article’s authors.

“The challenge is much more than the cut itself,” he says. “It’s the multidimensional accounting for the tumor’s depth and rotation hidden beneath the surface of the bone. Even a minor deviation in the angle of the saw can result in a margin that is dangerously thin on the underside of the bone where we can’t easily see.”

3D printed surgical guides

Imagine a jigsaw puzzle piece designed to fit on one specific spot on an individual’s bone. By using 3D printing, engineers can create exactly that—a physical stencil that snaps onto the bone during surgery, which is unique to that person. These guides feature built-in slots for the saw blade, effectively locking the surgeon into the perfect cutting path.

In a laboratory setting, these guides have proven to be revolutionary. They remove the guesswork, allowing the surgeon to hug the tumor closely while staying safely in the clear.

While these tools offer incredible stability, they also represent a bridge between traditional craft and high-tech engineering. Steven Tommasini, Ph.D., research scientist and the article’s principal investigator, notes that the benefit of patient-specific instrumentation goes beyond just the operating room.

“The real magic of these guides happens when we create an exact replica of the patient’s anatomy long before they even go in for surgery,” he says. “By simulating the physics of the cut and the specific density of the patient’s bone, we can engineer a tool that accounts for the tiny amount of bone lost to the width of the saw blade itself, known as the kerf, which is something the human eye simply cannot calculate with precision.”

Holographically enhanced surgeons

Mixed reality is at the forefront of high precision, integrated surgical technology. Unlike virtual reality, which shuts out the physical world and creates a simulated setting, mixed reality overlays digital information directly onto the real environment. In this scenario, surgeons wear specialized headsets that allow them to see the patient’s bone and a glowing, holographic layer of the surgical plan at the same time.

This digital blueprint floats in space, perfectly aligned with the patient’s anatomy. The surgeon can see exactly where the tumor hides beneath the surface and where the safe line has been drawn in the pre-surgical planning phase. It can be compared to having X-ray vision paired with a GPS navigation system.

Researchers recently compared the mixed reality method, physical 3D-printed guides, and the traditional freehand technique.

Mapping the safety zone

When the researchers analyzed the accuracy of these methods on anatomical models, the assistance of mixed reality showed a clear advantage. The freehand method, while performed by a highly trained specialist, showed a wider range of inconsistency. Without a guide, the cuts tended to wander, sometimes veering too close to the tumor and other times taking more healthy bone than necessary.

Both the 3D-printed guides and mixed reality headsets allowed for a much narrower safety margin. Because the technology provided a constant, visual confirmation of the saw’s position, the researchers found they could plan tumor removals that were much closer to the malignant cells without increasing the risk of leaving cancerous portions behind.

While the physical guides were slightly more stable, the mixed reality headset offered flexibility and adaptability that physical plastic could not match. A hologram can be adjusted. It does not need to be re-printed and shipped from a factory, and it provides a 360-degree real-time view of the internal geography of the bone that a physical stencil simply cannot match.

From concept to creation

According to the researchers, there is a shift toward limb salvage surgery that is both more conservative and more successful. When more of the natural bone and joint are preserved, the body’s ability to heal and regain function is vastly improved.

Importantly though, the technology is not a replacement for the surgeon’s intuition. During the study, one of the digital models became unstable, showing that technology, whether a software glitch or a hardware misalignment, can fail. A surgeon using mixed reality must still be a master of the freehand craft and also be prepared to take over entirely should the hologram fail.

More research will be needed to understand how these techniques compare when used in real surgical cases.

Scientists are now working on enhancements for mixed reality that make sure that the hologram stays fixed to the bone even if the bone moves or the surgeon shifts their head.

“We have to remember that a hologram doesn’t have tactile resistance,” warns Tommasini. “While the visual guidance is revolutionary, the surgeon still needs to feel the bone’s density and the vibration of the saw. The technology tells us where to go, but the surgeon’s hands still determine how we get there safely.”

The story of bone cancer surgery is evolving to one of precision and preservation.

The goal remains the same as it was a century ago: Save the patient. But today, surgeons are closer than ever to saving a patient’s quality of life as well. By using digital blueprints to navigate the hidden landscape of the human body, multidisciplinary teams are proving that the best way to fight a 3D challenge like bone cancer is with a 3D solution.