Originally Posted by
10x25mm
Most likely you are 'pushing' the trigger, pushing the entire pistol to the left after the sear releases the hammer. Try catching the center line of trigger with the joint between the distal (outermost) and intermediate phalanges of your trigger finger. This can offset the push.
You probably have long fingers and are not getting a strong grip on the pistol because your shooting hand fingertips are touching or close to touching your palm. An ideal pistol grip size should have your fingertips about an inch from your palm when loosely gripped.