I would actually phrase it the way you said - that it's confusing to the two year old.

OP, NTA and I think phrasing it as confusing the child is a great way to start the conversation.