WindowButtonDownFcn not working once brushing or data cursor is set on.

I have a GUI with an axes in it (a 3D plot).

Try as might, I am not able to get the following functionality in the GUI.

1) Clicking on a button makes brushing on (can be done )

2) Clicking/dragging inside the graph selects data. (can be done)

3) Clicking anywhere outside the graph should switch off the brushing tool.

(I have a context menu for the GUI which I need to use except when collecting data from the plot)

I am unable to get this to work. The only way I can switch off the brushing tool is by assigning it in the callback for a button. Can this not happen inside the WIndownButtonDownFcn ?

I would prefer not using the figure toolbar in the GUI if possible.