Tsai's Versatile Camera Calibration | VitaVision
Back to atlas

Tsai's Versatile Camera Calibration

4 min readAdvancedHistoricalView in graph
Based on
A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses
Tsai · IEEE Journal on Robotics and Automation 1987
DOI ↗

Goal

Given a precision 3D calibration target with N5N \geq 5 (coplanar) or N7N \geq 7 (non-coplanar) points of known metric coordinates (xw,yw,zw)(x_w, y_w, z_w) and their measured pixel positions (Xf,Yf)(X_f, Y_f), recover the camera-to-world rigid transform (R,T)SO(3)×R3(R, T) \in SO(3) \times \mathbb{R}^3, the effective focal length ff, the first-order radial distortion coefficient κ1\kappa_1, and the horizontal scan-uncertainty factor sxs_x. The defining property is a linear closed-form first stage that produces a near-correct extrinsic estimate without any initial guess, leaving only three coupled intrinsic parameters (f,Tz,κ1)(f, T_z, \kappa_1) for a short nonlinear refinement.

Historical context

In 1987 the dominant alternative was Faig-style full-bundle calibration: an eleven-parameter Levenberg–Marquardt solve initialised from a rough manual guess, run on a precision-machined calibration object. Two costs followed from that approach — the LM solve was sensitive to the initial guess, and the wall-clock cost on minicomputer hardware was large enough to preclude in-line calibration. Industrial machine-vision pipelines worked around both by relying on hand-tuned calibration that was expensive to redo when a camera moved.

Tsai's contribution was the two-stage decomposition built on the radial alignment constraint. Because radial lens distortion displaces image points along the line from the image origin, the direction from the image origin to the distorted point is the same as the direction to the undistorted point and to the projection of the world ray onto the image. That parallelism eliminates ff, κ1\kappa_1, κ2\kappa_2, and TzT_z from the constraint equation, leaving Stage 1 as a linear least-squares solve for combinations of RR and (Tx,Ty)(T_x, T_y) — closed-form, no initial guess. Stage 2 then has three coupled unknowns and converges in one or two LM iterations from the ignoring-distortion linear seed. The reported wall-clock cost on a 68000-based minicomputer was roughly an order of magnitude lower than full eleven-parameter LM, with reported accuracy of one part in 2000 of the working range on a multi-plane calibration object.

The structural limitation was the precision 3D target. A flat pattern provides five constraints per view; the coplanar variant of the method cannot separate sxs_x from the extrinsic parameters and requires sxs_x to be supplied from a separate calibration. The non-coplanar variant recovers sxs_x but needs a 3D fixture machined to roughly 0.1× the desired final accuracy. Zhang's planar calibration lifted this requirement: by capturing 3\geq 3 views of a single planar pattern and exploiting the image of the absolute conic, Zhang recovers all five intrinsics including sxs_x from a flat checkerboard. The 1987 fixture-based workflow gave way to the 2000 multi-view planar workflow, which has been the industry-standard treatment for the last quarter century.

The page is preserved as the citation root for Tsai-Lenz hand-eye calibration (which consumes Tsai's per-station extrinsics directly) and for the radial alignment constraint itself, which still appears in specialised calibration variants where the geometric trick is reused.

References

  1. R. Y. Tsai. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE Journal on Robotics and Automation 3(4)
    –344, 1987. pdf
  2. Z. Zhang. A Flexible New Technique for Camera Calibration. IEEE TPAMI 22(11)
    –1334, 2000. The successor: lifts the precision-3D-target requirement.
  3. J. Weng, P. Cohen, M. Herniou. Camera calibration with distortion models and accuracy evaluation. IEEE TPAMI 14(10)
    –980, 1992. Adds tangential / Brown–Conrady distortion that Tsai 1987 explicitly excluded.
  4. R. K. Lenz, R. Y. Tsai. Techniques for calibration of the scale factor and image center for high accuracy 3D machine vision metrology. IEEE TPAMI 10(5)
    –720, 1988. Companion paper that recovers (Cx,Cy)(C_x, C_y) alongside sxs_x for the coplanar variant.

Feeds into