Some distros have a LiveCD base which you can update if you make a LiveUSB with persistence.
Basically it is the LiveCD on a stick but changes you make make to it (Updates, settings, packages, etc) stick for the next time you boot into it.
Great little concept and it allows you to carry around...