You can't "accidentally" throw it away. It tells you it is a quest item and tells you that you are about to break the quest. You can't call it a bug if it told you not to do something. I will pull this bear mount over, take your weapons away, and make y'all take a time out.