Polymeric sand should not wash out in a single heavy rain. Now if you have a gutter constantly dumping across the brick with a heavy flow that will washout even the toughest polymeric sand.