You can't format those boxes, as far as I'm aware. There's a trick I use to put info on my maps: Create a character (with whatever name you want). Give this character an ability with name Show-Room-Info and text @{selected|bar1} and make this a token action. Now, put a token in your room (on the GM layer) that represents the character from above. Put /w GM, followed by whatever text you want, in the bar1 of the token. You can include the normal chat formatting in this text, for example stars for bold, underline for cursive, et cetera. Then you can select the token and click the token action, and it will whisper you all the information about the room in a formatted way. This is admittedly very different from the system you have currently set up.