You probably want at least a couple of hundred mA to get burning power.
The USB spec guarantees 100mA. If you want more, you can request up to a guaranteed 500mA by making the request through the USB port so unless your device can communicate to the USB controller to request the extra current...