Was this with using Flash video? iTabletop uses Flash and has the same problem and we never managed to nail what causes it. With two people it always seems fine. Add a third or more, and on occasion, perhaps with some combination of browsers, you get one player unable to be heard by the others.