Never vs Ever

Yes, okay, maybe it may seem even more confusing to you.  As to your question, the words -never- and -ever- are adverbs--English does not conjugate its adverbs nor its adjectives.  Adverbs do not change the tense of a verb for adverbs are not part of a verb construction.  Yes, adverbs can tell us where, when, how, and why an action took, takes, or will take place, but adverbs are not a part of a verbs tense or form.  As far as I know, you can use an adverb or adverbial phrase in any verb tense-form construction.   Again, should you still have doubts or questions, don't give up--we will find an answer for you.

Please, if I am ever wrong with any of this stuff, I would never be offended if I were to be corrected.   :)