YOLO is a pretty simple and flexible architecture. Like most of these models, you can label some data and just freeze the intermediate layers and just retrain the final predictor head.

Checkout as well darknet, which runs at really high fps on super cheap hardware