A couple of expressions that are commonly used in France in such a situation:

Mon téléphone beugue. (pronounced like "bug", from the verb beuguer which has variants)

Mon téléphone déconne. (Colloquial).

They are conveying the intended meaning of an ongoing, repetitive or sporadic issue which is how I understand is glitching. On the other hand, my phone has a glitch refers more to a single defect, something that doesn’t work as intended.

Beware not to translate "to have a glitch" by être en panne. Being en panne means being out of order, unusable while having a glitch means working fine but having sometimes an odd behavior.

The formal/technical way to describe it is:

Mon téléphone¹ a un problème intermittent/inattendu, un comportement bizarre.

¹_{Or portable, mobile, GSM, Natel, cellulaire depending on the French speaking country.}

According to the French free encyclopedia (and this ref.) you can say what follows if you know that the error comes from a program (for instance blurred 3D display).

• Il y a un glitch/bug/bogue dans mon téléphone.

If the problem is not known to you, that is if you don’t know whether the hardware or the software is responsible, you can simply use the general forms that follow; they cover all aspects of malfunctionning, that due to the programmation and that due to the electronics/electrics and as well server problems. All listed possibilities belong to the standard French language.

• Mon téléphone est détraqué. (out of order or totally unusable)
• Mon téléphone a une panne. (remark as above)
• Mon téléphone est en panne. (rather totally unusable)
• Mon téléphone marche/fonctionne mal. (out of order)
• Mon téléphone a un fonctionnement erratique. (out of order)