While using Knoppix or another live CD you can save your files to a USB thumb drive or another CD (if the computer has two). You can also save the files by emailing them to yourself.

There are also ways to save your settings with Linux live CDs. I'll post information on how to do that for each distro soon.