You asked the search engines to stay out so they did. You’ll need to be patient while they explore their new found freedom to ‘look’.
You can submit your site maps to many of the search engines to prompt them to start looking.
I usually don’t block the search engines unless I never want them looking.
My guess is they’ll be slow to find a new site where they will attempt to spider the whole thing up to their limits of ‘good behavior’. So a few posts would give you a head start and those may change but the search engines know how to deal with those cases and I don’t think a search engine ever gets exasperated with fluctuating content.
If you ever want to see that process in action install HTTrack on a computer at your location and watch it as it spiders your or your competitor’s site. It’s pretty interesting how that works.
If there’s a robots txt file it will read that and decide to follow it’s recommendations or reject them then start spidering… or quit.
Search engines may spider a site even if the robots txt tells them ‘no’ as it’s a good place to discover links outside of the target site.
