If you find swiping an item too hard to do, you can tap “Delete” instead then tap the minus sign to the left of the book listing instead.

Recognize that deleting the book will remove the book from your device, but if you marked the book as “Finished”, doing so will knock this status off your account until you next pick up and try to read the book again.