Yes, I think this is very tractable for a first project. I've played around with using AI to do optical-only with pose detection models -- if I had to do it again, I would probably start with this model and try to get it running locally:

https://github.com/facebookresearch/co-tracker

This sounds like a perfect place for you to get started!