Publications / 2025 / Identifying frequency-domain operating deflection shapes and internal damage in structures using geometric vision method

Identifying frequency-domain operating deflection shapes and internal damage in structures using geometric vision method

Haoran Zhang, Jiaren Zuo, Zhangyu Yao, Deyang Zhang, Lei Lu, Wei Pan, Zhilong Su
Results in Engineering, 29:108474
Identified 3D mode shape of the test specimen at 150.6 Hz. Fig. 9(c) of the paper.

In one sentenceTwo synchronized high-speed cameras turn image motion into full-field vibration shapes in the frequency domain, and a wavelet scan of those shapes locates hidden internal damage without contact sensors or excitation data.

The problem

An operating deflection shape (ODS) describes how a structure deforms at each vibration frequency while it is in service. Because it does not require prior knowledge of the excitation, it offers an automatic way to assess dynamic behaviour and to detect damage. Measuring it is the hard part. Conventional contact sensors are bulky in operation and serve a single function, and non-contact laser vibrometers sample one point at a time and need complex calibration, which is impractical when many degrees of freedom are involved. Vision methods can measure dense surface motion, but stereo digital image correlation (stereo-DIC), which tracks speckle points across images and triangulates them, reconstructs displacement in the time domain first, where noise has to be filtered out and the filtering can remove high-frequency motion as well. Earlier frequency-domain triangulation methods use one camera that sees the object from several views through relative motion, so camera poses change between views, must be re-estimated at every step, and introduce phase delays.

Internal damage adds a second difficulty. Visual crack detection only sees surface defects, while vibration-based damage identification usually needs precise excitation information or contact sensors, and recent vision-based variants still rely on pseudo-excitation or heuristic steps such as denoising and clustering.

Photo of two high-speed cameras on tripods, labelled right camera and left camera, aimed at a thin metal specimen. An inset shows the specimen's speckle-patterned face with an orange region of interest, and its plain back face with a circled embedded defect, 21 mm from the side edge and 192 mm along the length.
The experimental setup: two high-speed cameras observe a vibrating specimen whose speckled face defines the region of interest (ROI). The defect is a blind hole on the other face, invisible to the cameras. Fig. 4 of the paper.

How it works

The method uses a stereo pair of still high-speed cameras with a fixed geometry. After calibration and rectification, every observed point is described by one parameter, its disparity, which makes the map from stereo image motion to the frequency-domain ODS linear. A wavelet transform of the resulting ODS fields then exposes internal damage.

  1. RANSAC calibration. Zhang’s planar-target method runs inside a RANSAC loop: random subsets of checkerboard corners are used for calibration until the averaged re-projection error meets a threshold. Corners that lose imaging precision in some poses therefore no longer bias the focal lengths, principal points and distortion factors.
  2. Stereo and temporal matching. Only the reference stereo pair is rectified. Each point of interest is matched along the epipolar line with spatial DIC, then tracked through the original left and right image sequences with temporal DIC. Rectification is applied to the tracked point coordinates rather than to whole images, which avoids interpolation errors.
  3. Depth parameterization. In the rectified geometry a point’s depth is d = Bf/δ, with baseline B, focal length f and disparity δ, so each point has one unknown instead of three. Its image motion is encoded in a state vector ξ(t) = x₁(t)/δ(t), where x₁(t) is the point’s image coordinate in the left camera.
  4. ODS in the frequency domain. The ODS is a linear function of the state-vector change, U(ω) = Bf · Δξ(ω), obtained with a discrete Fourier transform and no triangulation step. The ODS fields at all frequencies form the response spectrum, and each peak corresponds to a full-field ODS map.
  5. Wavelet damage identification. Each ODS field is treated as an image on the left reference grid. Damage due to stiffness loss shows up as a step in the ODS, and a Haar wavelet transform produces normalized coefficients that peak at the damage. The peak gives the location and the damage degree, a relative change in ODS amplitude that reflects the local stiffness loss.
Four-panel pipeline linked by arrows: RANSAC calibration with left and right checkerboard images and matched corners; stacked speckle image pairs labelled stereo matching and temporal tracking; a cyan-to-magenta ODS map labelled ODS estimation; and a 3D surface with one sharp peak labelled damage identification. The arrows are labelled stereo rectification, Fourier transformation and wavelet transformation.
The four-step pipeline: RANSAC calibration, stereo and temporal matching, ODS estimation and damage identification. Fig. 1 of the paper.
Schematic of left and right image sequences in a reference state and a deformed state. A point u1(0) maps to a rectified point x1(0), which is matched by a blue dashed spatial-matching curve to x2(0) and mapped back to u2(0). Red dashed curves show temporal matching from the reference to the deformed state, u1(t) and u2(t), which are then mapped to x1(t) and x2(t).
Spatial-temporal matching with local rectification. Points are matched in the rectified reference pair, tracked in the original sequences, and only their coordinates are rectified. Fig. 3 of the paper.

Results

The test specimen is a 1.5 mm thick, 300 mm × 50 mm plate of 304 stainless steel with a blind hole, 8.0 mm in diameter and 1.0 mm deep, on the face the cameras do not see. An exciter drove it at 17 Hz, close to its first natural frequency, while the two cameras (2560 × 1920 pixels) recorded 5000 stereo pairs at 1000 fps. RANSAC calibration lowered the re-projection error from 0.088 to 0.039 (Table 2) and the mean 3D error of an 8 × 8 test target from 0.124 mm to 0.013 mm (Table 3). On the flat specimen, the depth error ranged from −0.06 to 0.09 mm (mean 0.02 mm), against −0.17 to 0.35 mm (mean 0.09 mm) with Zhang’s calibration (Fig. 6).

At the transducer location, the vision-based spectrum captured the complete set of peaks. Even at 34.4 Hz, the smallest amplitude of 0.14 mm was estimated within 0.01 mm, while stereo-DIC missed most of the components other than the resonance. The full-field ODS maps at 17.0, 51.2, 150.6 and 248.8 Hz show the amplitude falling and the shape growing more complex as frequency rises, and singular value decomposition of these fields gives the corresponding 3D mode shapes. The wavelet damage landscape peaked at 0.208; transformed to the specimen frame, the damage lies at (24.26, 195.13) mm against the actual (25.00, 196.00) mm.

Amplitude spectrum from 0 to 500 Hz with black, blue and red curves for our method, stereo-DIC and the transducer. The tallest peak is at 17.0 Hz, near 1.8 mm; smaller peaks are marked at 8.6, 34.4, 51.2 and 150.6 Hz and near 250 Hz. A zoomed inset of the low-frequency range shows the black and red curves sharing the small peaks, which the blue curve mostly lacks.
ODS spectra at the transducer location: the proposed method (black), stereo-DIC (blue) and the displacement transducer (red). Fig. 7 of the paper.
Four colour maps of the rectangular region of interest, 275 mm by 38 mm, at 17.00, 51.20, 150.60 and 248.80 Hz. At 17 Hz the amplitude rises smoothly from cyan to magenta toward one end; at higher frequencies the patterns become more varied and the colour bars span smaller amplitudes.
Full-field ODS maps of the plate at (a) 17.0, (b) 51.2, (c) 150.6 and (d) 248.8 Hz. Fig. 8 of the paper.
Left: 3D surface of the damage response over the region of interest, flat except for one sharp spike labelled Peak (0.208). Right: top view of the same field, uniform cyan with a small circled point at (170.13, 21.67) mm.
The damage landscape from the wavelet transform (a) and the identified location in ROI coordinates (b). Fig. 10 of the paper.

The method was also applied to a 3D-printed resin blade with curved surfaces, a 340 mm chord and two internal defects (5 mm and 3 mm in diameter, 0.8 mm and 0.6 mm deep) under a 0–300 Hz sweep excitation. Spectra at three points along the chord gave six characteristic frequencies, and the corresponding ODS maps yielded the first six mode shapes without excitation information. Both defects were found, with damage degrees of 5.1% and 3.2% and maximum positioning errors of 1.08 mm and 1.11 mm.

3D surface of the damage response over the blade-shaped region, mostly flat cyan, with two spikes labelled Damage 1 (5.1%) and Damage 2 (3.2%).
The two internal defects identified on the blade specimen, with their damage degrees. Fig. 15 of the paper.

The authors note two limits. The two separate cameras used here are not integrated enough for long-term monitoring, and they propose a compact biprism stereo optic as a path forward. The damage algorithm recovers the location and extent of internal damage but not its shape or orientation.

Cite

@article{zhang2025identifying,
  title={Identifying frequency-domain operating deflection shapes and internal damage in structures using geometric vision method},
  author={Zhang, Haoran and Zuo, Jiaren and Yao, Zhangyu and Zhang, Deyang and Lu, Lei and Pan, Wei and Su, Zhilong},
  journal={Results in Engineering},
  pages={108474},
  year={2025},
  publisher={Elsevier},
  doi={10.1016/j.rineng.2025.108474}
}
Type
Article Journal
Topic
Optics & Image Processing
Venue
Results in Engineering, 29:108474
Year
2025
DOI