The way that you have cut the film, you can take the audience out of the action if it becomes evident that there is a stunt double doing it rather than the actor. I'd rather stay with the character and the story point behind the fight, rather than cutting to a wide angle of the fight.
