Your tool’s TLO active when setting the Z axis work offset?
You have to do both of the above for the work offsets to work properly.
You are welcome to send over your CAM file (if you are using Fusion 360), your work offsets and your TLO for the tool you are using and we can take a look.
I am not having any luck replicating the problem. When I post process the g-code out of your Fusion file using the Pocket NC post processor available in the Fusion library, I get a g-code program that looks correct in the simulator as long as I put in the work offsets shown in the screenshot you provided.
Are you using the Pocket NC post that is available in the Fusion library and making sure that Rotated work Offsets is not disabled in the post properties window?
Do you have any more information that might help discover why your tool paths appear to be offset?