Using image recognition for masonry mesh (2D)

Hi

I am trying to make a program where you can make a mesh out of an image of a masonry facade. So basically, the program makes a 2D mesh of the masonry, without windows, doors, ... in it. Only the masonry should be meshed.

What is the best way to do this? Use image recognition? Or another technique?

Thanks!