As Wichman said, to check if you are pushing to one side or the other, when cutting, stop and release the project. the wood should stay in place. If it moves, you are pushing to one side.
This is one reason I use Pegas MGT blades as they are not stamped, so you follow the line more straight on. If you are in the USA, I maybe able to give you some sample. Send me a message.