coord_sf breaks fallback #2501

See tidyverse/ggplot2#6232 which afaict is a great leap forward-

What can we do from the sf side, or more generally from the R mapping side, to improve things here? Cc: tmap @mtennekes and @Nowosad