Here's a quick illustration of what I mean. I simply drew the arrow by hand. If I get Matlab to show me the code for it, it gives
annotation(figure1,'arrow',[0.354235423542354 0.224422442244224],...
[0.526863777089783 0.390092879256966]);
but the end point's x-coordinate (0.2244...) does not correspond to the 20 s (20 s / 180 s = 0.1111...) where 180 s is the "length" of my x-axis in the units that I want to plot.