No robots.txt file

The only “official” way to stop WordPress from generating a virtual robots.txt file (without altering the core code) is to have a physical robots.txt file in the blog directory. Even if the physical robots.txt file is blank, it will still override the virtual robots.txt file.

I think using the add_action filter is a better solution than to change the functions.php file:

https://wpmu.org/wpmu-robotstxt-globally/

you have a self-hosted blog, here are some of the things that can ease up your blogging experience-
create a new blank file on your desktop named “robots.txt” in there put this text (taken from mine, works fine):

User-agent: *
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: /feed
Disallow: /comments
Disallow: /category/*/*
Disallow: */trackback
Disallow: */feed
Disallow: */comments
Disallow: /*?*
Disallow: /*?
Allow: /wp-content/uploads

User-agent: Adsbot-Google
Allow: /

User-agent: Googlebot-Mobile
Allow: /

User-agent: ia_archiver-web.archive.org
Disallow: /

# Google Image
User-agent: Googlebot-Image
Disallow:
Allow: /*

# Google AdSense
User-agent: Mediapartners-Google*
Disallow:
Allow: /*

# digg mirror
User-agent: duggmirror
Disallow: /

Sitemap: https://icompile.0fees.net/sitemap.xml.gz

**********
Note 1.
change the last line to your sitemap.xml or sitemap.xml.gz file location, which is usually in the root of your wordpress folder, along with wp-admin folder and wp-content.
if you don’t know it, keep reading ’till the end, I am explaining it again. if you use the “XML Sitemap Generator for WordPress” plugin (I do) then un-Tick the ‘V’ from the line “Add sitemap URL to the virtual robots.txt file.” in your plugin configuration page.

*********

Note 2.
Wordpress uses a “virtual” robots.txt file as long you don’t have a real one in your wordpress blog-root. so once you upload it to your wordpress blog-root from your desktop all your problems should be gone.

*********

Note 3.
make sure you give a read permissions to every one (754 permissions is good) you can change it using ftp-client or you host’s-cPanel.

O.K. lets continue…
once you’ve done all of the steps above, make sure you’ve properly registered in those two sites:

https://www.google.com/webmasters/tools
https://www.google.com/analytics

follow the steps to add your website in the google-search index,
you’ll need to verified that you’ve got access the the root by uploading a simple html file with a name like google0b11136ba11c6118.html once finished up you’ll need to make your blog a more SEO-friendly, so make sure you’ve got the following plugins to run things smooth (no code insertion/ editing is needed):

-"All in One SEO Pack"
-"Google Analytics for WordPress"
-"Google XML Sitemaps"
-"Shockingly Simple Favicon" (recommended so you'll have an icon in the google-search page)
-"WordPress Mobile Pack" (so you can get into the google mobile results)

you should re-visit the google links above in a few days to refine some of the settings, also copy-paste the google-id string from Google Analytics to “Google Analytics for WordPress” so it will track the visits in your blog.
after you’ve got a few posts in your blog, take a look at the “Google XML Sitemaps” settings page, rebuild manually, make sure the ‘V’ of the virtual robots.txt is UNTICKED and finds your location to the sitemap.xml and gz files, created by this plugin, usually its in your blog-root, using a ftp-client such as FileZilla browse your blog’s folders find the robots.txt and make sure the line at the end having the right location to your sitemap.xml.gz (gz if a compressed file, of the sitemap.xml saving you extra web-traffic).

list your blog-website using some free-services you can find in google, that auto-submit your websites to many search engines around the world,

another way to make your website more search-engine friendly is to make sure it has Permalink (under settings in the admin page), selecting the buttom “Custom Structure” and putting “/%postname%/” and applying (without the semicolons, just /%postname%/) will make your posts look prettier, and listed better in the search engine’s results. and when you are posting or editing a blog make sure to fill up the extra information that “All in One SEO Pack” plugin has put in for you to fill.

update the PING-LIST, its under “settings”-“writing” (admin page).

https://rpc.pingomatic.com/
https://1470.net/api/ping/
https://a2b.cc/setloc/bp.a2b/
https://api.feedster.com/ping/
https://api.moreover.com/RPC2/
https://api.moreover.com/ping/
https://api.my.yahoo.co.jp/RPC2/
https://api.my.yahoo.com/RPC2/
https://api.my.yahoo.com/ping/
https://api.my.yahoo.com/rss/ping/
https://audiorpc.weblogs.com/RPC2/
https://bblog.com/ping.php/
https://bitacoles.net/notificacio.php/
https://bitacoles.net/ping.php/
https://bitacoras.net/ping/
https://blo.gs/ping.php/
https://blog.goo.ne.jp/
https://blog.goo.ne.jp/XMLRPC/
https://blogbot.dk/io/xml-rpc.php/
https://blogdb.jp/
https://blogdb.jp/xmlrpc/
https://blogdigger.com/RPC2/
https://blogmatcher.com/u.php/
https://blogoole.com/ping/
https://blogoon.net/ping/
https://blogpeople.net/ping/
https://blogroots.com/tb_populi.blog?id=1/
https://blogsearch.google.ae/ping/RPC2/
https://blogsearch.google.at/ping/RPC2/
https://blogsearch.google.be/ping/RPC2/
https://blogsearch.google.bg/ping/RPC2/
https://blogsearch.google.ca/ping/RPC2/
https://blogsearch.google.ch/ping/RPC2/
https://blogsearch.google.cl/ping/RPC2/
https://blogsearch.google.co.cr/ping/RPC2/
https://blogsearch.google.co.hu/ping/RPC2/
https://blogsearch.google.co.id/ping/RPC2/
https://blogsearch.google.co.il/ping/RPC2/
https://blogsearch.google.co.in/ping/RPC2/
https://blogsearch.google.co.it/ping/RPC2/
https://blogsearch.google.co.jp/ping/RPC2/
https://blogsearch.google.co.ma/ping/RPC2/
https://blogsearch.google.co.nz/ping/RPC2/
https://blogsearch.google.co.th/ping/RPC2/
https://blogsearch.google.co.uk/ping/RPC2/
https://blogsearch.google.co.ve/ping/RPC2/
https://blogsearch.google.co.za/ping/RPC2/
https://blogsearch.google.com.ar/ping/RPC2/
https://blogsearch.google.com.au/ping/RPC2/
https://blogsearch.google.com.br/ping/RPC2/
https://blogsearch.google.com.co/ping/RPC2/
https://blogsearch.google.com.do/ping/RPC2/
https://blogsearch.google.com.mx/ping/RPC2/
https://blogsearch.google.com.my/ping/RPC2/
https://blogsearch.google.com.pe/ping/RPC2/
https://blogsearch.google.com.sa/ping/RPC2/
https://blogsearch.google.com.sg/ping/RPC2/
https://blogsearch.google.com.tr/ping/RPC2/
https://blogsearch.google.com.tw/ping/RPC2/
https://blogsearch.google.com.ua/ping/RPC2/
https://blogsearch.google.com.uy/ping/RPC2/
https://blogsearch.google.com.vn/ping/RPC2/
https://blogsearch.google.com/ping/RPC2/
https://blogsearch.google.de/ping/RPC2/
https://blogsearch.google.es/ping/RPC2/
https://blogsearch.google.fi/ping/RPC2/
https://blogsearch.google.fr/ping/RPC2/
https://blogsearch.google.gr/ping/RPC2/
https://blogsearch.google.hr/ping/RPC2/
https://blogsearch.google.ie/ping/RPC2/
https://blogsearch.google.in/ping/RPC2/
https://blogsearch.google.it/ping/RPC2/
https://blogsearch.google.jp/ping/RPC2/
https://blogsearch.google.lt/ping/RPC2/
https://blogsearch.google.nl/ping/RPC2/
https://blogsearch.google.pl/ping/RPC2/
https://blogsearch.google.pt/ping/RPC2/
https://blogsearch.google.ro/ping/RPC2/
https://blogsearch.google.ru/ping/RPC2/
https://blogsearch.google.se/ping/RPC2/
https://blogsearch.google.sk/ping/RPC2/
https://blogsearch.google.tw/ping/RPC2/
https://blogsearch.google.us/ping/RPC2/
https://blogshares.com/rpc.php/
https://blogsnow.com/ping/
https://blogstreet.com/xrbin/xmlrpc.cgi/
https://blogupdate.org/ping/
https://bulkfeeds.net/
https://bulkfeeds.net/rpc/
https://catapings.com/ping.php/
https://coreblog.org/ping/
https://effbot.org/rpc/ping.cgi/
https://feedsky.com/api/RPC2/
https://fgiasson.com/pings/ping.php/
https://hamo-search.com/ping.php/
https://holycowdude.com/rpc/ping/
https://imblogs.net/ping/
https://lasermemory.com/lsrpc/
https://mod-pubsub.org/
https://mod-pubsub.org/kn_apps/blogchatt/
https://mod-pubsub.org/knapps/blogchatt/
https://mod-pubsub.org/ping.php/
https://newsblog.jungleboots.org/ping.php/
https://newsisfree.com/RPCCloud/
https://packetmonster.net/xmlrpc.php/
https://ping.amagle.com/
https://ping.bitacoras.com/
https://ping.blo.gs/
https://ping.blogg.de/
https://ping.bloggers.jp/rpc/
https://ping.blogmura.jp/rpc/
https://ping.blogoon.net/
https://ping.blogs.yandex.ru/RPC2/
https://ping.cocolog-nifty.com/xmlrpc/
https://ping.exblog.jp/xmlrpc/
https://ping.fakapster.com/rpc/
https://ping.fc2.com/
https://ping.feedburner.com/
https://ping.feeds.yahoo.com/RPC2/
https://ping.kutsulog.net/
https://ping.myblog.jp/
https://ping.namaan.net/rpc/
https://ping.rootblog.com/rpc.php/
https://ping.snap.com/ping/RPC2/
https://ping.syndic8.com/xmlrpc.php/
https://ping.weblogalot.com/rpc.php/
https://ping.weblogs.se/
https://ping.wordblog.de/
https://pinger.blogflux.com/rpc/
https://pingoat.com/
https://pingoat.com/goat/RPC2/
https://pingqueue.com/rpc/
https://popdex.com/addsite.php/
https://r.hatena.ne.jp/rpc/
https://rcs.datashed.net/
https://rcs.datashed.net/RPC2/
https://rpc.blogbuzzmachine.com/RPC2/
https://rpc.bloggerei.de/ping/
https://rpc.blogrolling.com/pinger/
https://rpc.britblog.com/
https://rpc.icerocket.com:10080/
https://rpc.newsgator.com/
https://rpc.reader.livedoor.com/ping/
https://rpc.tailrank.com/feedburner/RPC2/
https://rpc.technorati.com/rpc/ping/
https://rpc.technorati.jp/rpc/ping/
https://rpc.twingly.com/
https://rpc.weblogs.com/RPC2/
https://rpc.wpkeys.com/
https://services.newsgator.com/ngws/xmlrpcping.aspx/
https://signup.alerts.msn.com/alerts-PREP/submitPingExtended.doz/
https://snipsnap.org/RPC2/
https://syndic8.com/xmlrpc.php/
https://thingamablog.sourceforge.net/ping.php/
https://topicexchange.com/
https://topicexchange.com/RPC2/
https://trackback.bakeinu.jp/bakeping.php/
https://wasalive.com/ping/
https://weblogues.com/RPC/
https://weblogues.com/ping/
https://www.a2b.cc/
https://www.a2b.cc/setloc/bp.a2b/
https://www.bitacoles.net/ping.php/
https://www.blogdigger.com/RPC2/
https://www.bloglines.com/ping/
https://www.blogoole.com/ping/
https://www.blogoon.net/ping/
https://www.blogpeople.net/
https://www.blogpeople.net/servlet/weblogUpdates/
https://www.blogroots.com/
https://www.blogroots.com/tb_populi.blog?id=1/
https://www.blogroots.com/tbpopuli.blog?id=1/
https://www.blogsdominicanos.com/ping/
https://www.blogshares.com/rpc.php/
https://www.blogsnow.com/ping/
https://www.blogstreet.com/xrbin/xmlrpc.cgi/
https://www.catapings.com/ping.php/
https://www.feedsky.com/api/RPC2/
https://www.holycowdude.com/rpc/ping/
https://www.imblogs.net/ping/
https://www.lasermemory.com/
https://www.lasermemory.com/lsrpc/
https://www.mod-pubsub.org/kn_apps/blogchatter/ping.php/
https://www.mod-pubsub.org/knapps/blogchatter/ping.php/
https://www.mod-pubsub.org/ping.php/
https://www.newsisfree.com/RPCCloud/
https://www.newsisfree.com/xmlrpctest.php/
https://www.octora.com/add_rss.php/
https://www.popdex.com/
https://www.popdex.com/addsite.php/
https://www.snipsnap.org/
https://www.snipsnap.org/RPC2/
https://www.wasalive.com/ping/
https://www.weblogues.com/
https://www.weblogues.com/RPC/
https://www.xianguo.com/xmlrpc/ping.php/
https://www.zhuaxia.com/rpc/server.php/
https://xmlrpc.blogg.de/
https://xping.pubsub.com/ping/
https://zhuaxia.com/rpc/server.php/
https://zing.zingfast.com/

while it is a bit bigger then recommended, take something like 30%-50% of it for the best results.

ah.. and post interesting things every now and then to keep your blog alive..

also, you can address me directly with specific questions

Elad Karako
https://iCompile.0fees.net/