Abstract: In the report， in order to solve the problem that the measuring speed and the measuring precision can not be guaranteed at the same time， based on the combination of YOLO target detection algorithm and stereo depth cameras， a novel approach for motion measurement of marine buoys based on machine vision was proposed， and a fixed-type vibration table experiment was performed for validating. The results indicated that the system can accurately and stably track and measure the spatial position of the buoy marker， and which can be used in the real environment. Our findings provide a better solution for the real-time tracking and measurement of marine buoys， and which is helpful for improving the safety of manual work at sea.