Standard behavior for 3d dice is they stay on the table until you interact with them in some way. Just to doublecheck, what happens if you interact with the dice after rolling them? Will the dice go away at that point, or does it require a new roll?
I downgraded my nexus 7 to 4.4 (for unrelated performance reasons) and the dice no longer show up at all, same as my samsung. 3d dice aren't super important so I'm not worrying about it, just thought I would post my observations in case it's useful to a dev.