Same word applies: “une singularité“. You may use “une singularité gravitationnelle” when you are talking about a “trou noir”.

When talking about singular functions, in a broader sense, I am trying to promote the nice French word of “affût” (in similarity to “sharp”), but without much success so far.