Problem with agents pushed into unwalkable areas seems to be fixed – instead of trying to keep the on walkable, wrote a “push back to walkable” function.
Now to the next problem – pathfinding!
P.S. Navigation calls units – agents, sounds neat. Agent “Serf” bringing stone to agent “Builder” 😉