It is indeed not correct to say “J’oublie” when talking about something you forgot to do.

However, it can be used aptly to express the fact that you always forget to do/say/whatever something, which would be said “J’oublie à chaque fois !”.

It does not matter that you talk about the past since you insist upon the idea you never do it.