A330 autothrust issue

[Loxan]

Hello. The moment I take of in the a330-300 (RR) and engage ap and pull back the thrust levers to climb detent as the pfd tells me to do it goes to man thr. I use the same procedures I see most people use yet this still happens to me for some reason. Im on a windows 11 device and I use a wireless xbox controller incase that matters somehow. Incase anyone wants to know more exactly my procedures I will gladly respond but I dont wanna make this initial message too long.

Edited Tuesday at 03:19 PM by Loxan
I forgot to add some details