I've seen people try and justify using literally in place of figuratively by suggesting that it's an act of hyperbole. After a lengthy debate with someone where I was initially against the idea, I found myself unsure at the end.
Were you literally unsure, or figuratively unsure?
It's a pretty clear case, if you think on it. Literally has a specific meaning. Use extra adjectives or adverbs to add hyperbole, don't use a word that doesn't mean the right thing.