You can blame the days of long ago, when it was hard to write a rounded letter 'u' in Middle English manuscripts for the fact that words in modern English don't end in the letter 'v.'

The ugly solution created was to add a silent 'e' at the end of the word that ended in the /v/ sound and call it good. What could possibly go wrong?