INSTRUMENTS

Laparoscopic instruments

What the seven instrument classes of the CVAT label set look like, how to tell them apart and which pixels belong in each mask.

This page is still being reviewed by our scientific, clinical and legal experts. It describes plans, not finished work.

Every instrument below has a 3D model: press Rotate in 3D, then drag or use the arrow keys to turn it and scroll or pinch to zoom.

Read this first

  • The pictures are synthetic. The project built every model from simple shapes in Blender (the script); they are not photographs and not copies of any manufacturer’s product. Real instruments differ in colour, jaw shape and shaft width, so learn the shape first and the colour second.
  • Real frames are harder. Smoke, blood, glare, motion blur and the edge of the scope’s field of view all change how an instrument looks. The synthetic frames here show the idea of each rule, not its hardest case.
  • The rules are a draft. Class names and colours match the project’s CVAT label set. Defining a class is the Clinical Lead’s decision; until the rules below are approved, the instructions in your CVAT task take precedence over this page.

Drawing an instrument mask

  1. One shape per instrument. Two graspers in view are two shapes, both labelled grasper.
  2. The whole visible instrument. Tip or jaws, joint and shaft, up to the edge of the image. The black insulated shaft belongs to the instrument too.
  3. Only what you can see. Where tissue, blood or another instrument covers part of it, do not draw underneath: the mask may break into pieces, and that is correct.
  4. Not the surroundings. Tissue held in the jaws, the instrument’s shadow, its reflection on wet tissue, smoke at the tip and the trocar it passes through are not part of the instrument.
  5. When unsure, say so. If you cannot tell which instrument it is, add the disputed tag to the frame instead of guessing. It goes to the Clinical Lead, and the guideline improves.

Grasper

CVAT label: grasper

The grasper holds and lifts tissue. In a cholecystectomy it usually holds the gallbladder up and out of the way while another instrument dissects, so it is in view for much of the operation.

  • Look for: two straight jaws of the same length that open symmetrically from a joint, often with a window (fenestration) and ridges on the inside; a black insulated shaft about 5 mm across.
  • Do not confuse with: the bipolar forceps (slender, often curved jaws with coloured insulation), scissors (thin blades that cross) or the clip applier (a wider shaft and a clip between the jaws).
  • The mask: jaws, joint and shaft as one shape. Tissue held between the jaws is not part of the grasper.

In the synthetic frame a fold of tissue lies across the shaft. The mask stops on each side of the fold and is not joined underneath it: draw only what you can see.

Synthetic studio render of the grasper tip on a grey background.
Synthetic laparoscopic frame: the grasper over a red tissue bed with a yellow fat pad. The same frame with the grasper mask filled and outlined in its CVAT colour.
Top: the model. Bottom: a synthetic frame, and the same frame with the pixels to draw in the grasper colour.

Bipolar forceps

CVAT label: bipolar

Bipolar forceps pass current between their two jaws to seal small vessels and stop bleeding.

  • Look for: slender jaws, often curved, with insulation in a colour (blue on many models) and bare metal at the very tips.
  • Do not confuse with: the grasper, whose jaws are broader, straight and usually all metal. Colours differ between manufacturers, so judge by shape first and colour second.
  • The mask: both jaws, the insulated joint and the shaft. Smoke or a spark at the tips is not the instrument.
Synthetic studio render of the bipolar forceps tip on a grey background.
Synthetic laparoscopic frame: the bipolar forceps over a red tissue bed with a yellow fat pad. The same frame with the bipolar forceps mask filled and outlined in its CVAT colour.
Top: the model. Bottom: a synthetic frame, and the same frame with the pixels to draw in the bipolar colour.

L-hook

CVAT label: hook

The L-hook is a monopolar electrode used to dissect tissue with current. In CholecSeg8k this class is called L-hook electrocautery.

  • Look for: a thin metal wire that leaves a tapered insulated shaft and bends through a right angle at the end.
  • Do not confuse with: the irrigator, a blunt tube with no bend. When the bend points straight at the camera the hook can look like a short straight wire, so follow it over neighbouring frames.
  • The mask: the shaft, the taper and the whole wire, even where it is only a few pixels wide. The smoke it makes and its glare on wet tissue are not part of it.
Synthetic studio render of the L-hook tip on a grey background.
Synthetic laparoscopic frame: the L-hook over a red tissue bed with a yellow fat pad. The same frame with the L-hook mask filled and outlined in its CVAT colour.
Top: the model. Bottom: a synthetic frame, and the same frame with the pixels to draw in the hook colour.

Scissors

CVAT label: scissors

Scissors cut: in a cholecystectomy, mostly the cystic duct and the cystic artery between clips.

  • Look for: two thin blades, usually curved to one side, that cross each other at a pivot near the tip.
  • Do not confuse with: the grasper. Grasper jaws meet face to face; scissor blades slide past each other and have no window.
  • The mask: both blades, the pivot and the shaft. The cut tissue is not part of the scissors.
Synthetic studio render of the scissors tip on a grey background.
Synthetic laparoscopic frame: the scissors over a red tissue bed with a yellow fat pad. The same frame with the scissors mask filled and outlined in its CVAT colour.
Top: the model. Bottom: a synthetic frame, and the same frame with the pixels to draw in the scissors colour.

Clip applier

CVAT label: clipper

The clip applier closes the cystic duct and the cystic artery with clips before they are cut.

  • Look for: a wider shaft than the other instruments (often 10 mm rather than 5 mm), broad jaws that close in parallel, and a clip loaded between them.
  • Do not confuse with: the grasper. A clip in the jaws, or a clip left behind on tissue, is the strongest clue.
  • The mask: jaws, the loaded clip and the shaft. Clips already placed on tissue stay behind when the instrument leaves; they are not clipper, and the label set has no class for them yet.
Synthetic studio render of the clip applier tip on a grey background.
Synthetic laparoscopic frame: the clip applier over a red tissue bed with a yellow fat pad. The same frame with the clip applier mask filled and outlined in its CVAT colour.
Top: the model. Bottom: a synthetic frame, and the same frame with the pixels to draw in the clipper colour.

Suction-irrigator

CVAT label: irrigator

The suction-irrigator washes the operating field and sucks out blood, fluid and smoke.

  • Look for: a plain metal tube with a blunt rounded end and side holes near the tip; it has no jaws and no bend.
  • Do not confuse with: the L-hook (a thin wire with a right-angle bend) or the bare shaft of another instrument whose tip is out of view.
  • The mask: the whole visible tube. Fluid coming out of it and blood being sucked in are not part of it.
Synthetic studio render of the irrigator tip on a grey background.
Synthetic laparoscopic frame: the irrigator over a red tissue bed with a yellow fat pad. The same frame with the irrigator mask filled and outlined in its CVAT colour.
Top: the model. Bottom: a synthetic frame, and the same frame with the pixels to draw in the irrigator colour.

Specimen bag

CVAT label: specimen_bag

At the end of the operation the gallbladder is put into a retrieval bag and removed through a port.

  • Look for: a clear or milky plastic film crumpled into sharp creases, with thin streaks of glare along them. The edge has a welded seam, and the mouth usually has a hem with a drawstring or a stiffer rim.
  • Do not confuse with: glare on wet tissue or smoke. The bag has straight creases and a clean edge; glare does not. Tissue seen through the film keeps its colour, only a little paler.
  • The mask (proposed): the whole bag as one shape, including what you see through the film, plus the drawstring as far as you can follow it. This rule is still waiting for the Clinical Lead, so follow your CVAT task if it says otherwise.
Synthetic studio render of an empty specimen bag on a grey background: clear creased film with a white hem and a drawstring at its mouth.
Synthetic laparoscopic frame: a clear specimen bag with a green specimen inside, lying on a red tissue bed next to a yellow fat pad. The same frame with the specimen bag mask filled and outlined in its CVAT colour.
Top: the model. Bottom: a synthetic frame, and the same frame with the pixels to draw in the specimen_bag colour.

Telling them apart

What you see Most likely Check
Two straight jaws, often with a window grasper Jaws all metal, opening symmetrically
Slender curved jaws with coloured insulation bipolar Bare metal only at the very tips
A thin wire bent through a right angle hook Tapered insulated shaft behind it
Two thin blades crossing at a pivot scissors Blades slide past each other, no window
A wide shaft, broad jaws, a clip between them clipper Shaft visibly wider than the others
A blunt tube with side holes irrigator No jaws, no bend
Crumpled clear film with streaks of glare specimen_bag Straight creases, a seam at the edge, a drawstring or rim at the mouth
Only a shaft, the tip out of view Unknown Neighbouring frames, or tag disputed

Open questions for the Clinical Lead

  • The project’s annotation guideline v1.0 mentions separate labels for shaft, joint and jaws, while the CVAT label set has one class per instrument. Until this is settled, follow the label set of your task.
  • Whether the specimen bag mask includes what is seen through the film, and the drawstring.
  • How to draw edges blurred by motion or veiled by smoke.
  • Whether clips placed on tissue get a class of their own.

About the pictures and models

The renders and models come from scripts/blender/instruments.py in the website repository and are published under CC BY 4.0, like the site’s other illustrations. The tissue bed is noise, not anatomy. The masks are rendered with one sample per pixel, so every pixel is wholly in or out of the instrument. Download a model: grasper, bipolar, hook, scissors, clipper, irrigator, specimen bag (glTF binary).

Back to annotation in CVAT.