The easiest way I have found to remove labels is to bake the bottles.
Preheat your oven to 200 degrees and grab your rinses bottles.
Stick the bottles directly on your rack for 10 minutes.
Use a pot holder to grab the bottle and pull off the label.
The label comes over bringing the stickiness along so your bottle is clean!
You can use this method if you want to get crafty with your bottle or if you want to save your labels.
And since the label is still sticky you can stick the label directly into a book.
Always, always count your blessings