I ended up creating my own editor tool/window combo:
The general idea is the following:
Click a quad vertex, add a wall point, upper point is just Vector3.up.
And allow to remove any point as well.
Along necessary data/logic, etc.
Though manually paint, any vertex can form a collider thus I'll get vertex perfect colliders.
I now leverage the following:...