Removing books you’ve finished from your Kindle has always been possible, but with one catch. Whatever you remove from your device persists in your account. It’s not gone forever, it’s simply gone from the specific Kindle device you’re using. You likely caught on to that caveat the first time you pressed-and-held your finger on a book on your Kindle and tapped the “Remove From Device” option.