Yeah, You can do it, but you have to use yolo with own object tracking, If yolo is object detection. Please compare the detectron2 prediction file and my prediction file from that you can get an idea, After that check my github prediction file, my main code will be there, So according to your Yolo file please copy the code and modify it.

Thanks