February came into English from French.
The French feverier became English feverere, or feverell. During the
16th and 17th centuries writers began re-Latinizing their spelling
to make words look more like original ancient language sources. It
was a way to make documents look more intelligent, so along with
many other words, they made February look more like Februarius.