Yup. There's no way to do it via a batch upload (yet), but you can upload individual sprites by just dragging it from your computer's file folder onto the battle map in Roll20. This gets added to your personal art library that you'll be able to access from every campaign you build.
