I have removed two older editions of my book from my bookshelf but they still appear in a search on Amazon. Also, the one new book on my Bookshelf only appears as a kindle book in Amazon unless I do a direct search on the ASIN number. Then it is available in kindle and paperback. This is not the case if I search on the book title or the authors name. Why is this?
If your older books are print books, they will linger forever, due to the used book sellers--who don't actually have your book, but who list it because someday they might.
If your unpublished books are ebooks, they should disappear when you click unpublish. It can sometimes take a few days, so if it's been a few days, use the Contact link at lower right to ask KDP about it. Good luck!