Load Asymmetry Angle Estimation Using Multiple-View Videos

A robust computer vision-based approach is developed to estimate the load asymmetry angle defined in the revised NIOSH lifting equation. The angle of asymmetry enables the computation of a recommended weight limit for repetitive lifting operations in a workplace to prevent lower back injuries. An open-source package OpenPose is applied to estimate the two-dimensional (2-D) locations of skeletal joints of the worker from two synchronous videos. Combining these joint location estimates, a computer vision correspondence and depth estimation method is developed to estimate the 3-D coordinates of skeletal joints during lifting. The angle of asymmetry is then deduced from a subset of these 3-D positions. Error analysis reveals unreliable angle estimates due to occlusions of upper limbs. A robust angle estimation method that mitigates this challenge is developed. We propose a method to flag unreliable angle estimates based on the average confidence level of 2-D joint estimates provided by OpenPose. An optimal threshold is derived that balances the percentage variance reduction of the estimation error and the percentage of angle estimates flagged. Tested with 360 lifting instances in a NIOSH-provided dataset, the standard deviation of angle estimation error is reduced from 10.13 degrees to 4.99 degrees. To realize this error variance reduction, 34% of estimated angles are flagged and require further validation.

Automated summary

A computer vision-based approach was developed to estimate the load asymmetry angle in the revised NIOSH lifting equation, utilizing 2-D and 3-D joint location detection. A robust angle estimation method was developed, along with a technique to flag unreliable angle estimates.