Website indexing on Google, Bing and Yandex: get found by ChatGPT too

A laptop showing a statistics dashboard with charts

Website indexing is how a search engine adds your pages to its database so they can appear in its results. To get indexed, add your site to Google Search Console, Bing Webmaster Tools and Yandex Webmaster, submit your sitemap in each, and switch on IndexNow so Bing and Yandex hear about new pages straight away. To be found by ChatGPT too, make sure your website doesn't block OpenAI's search crawler, OAI-SearchBot.

None of this guarantees a top ranking, but it's the first step for any hotel, restaurant or excursion company in Sharm El Sheikh that wants to be found.

Key points

  • Indexing comes before ranking: a page that isn't indexed can't appear in search results or in Google's AI Overviews.
  • Google needs Search Console and a sitemap. It isn't part of IndexNow.
  • Bing and Yandex both use IndexNow, and a WordPress plugin can send them every new page automatically.
  • Yandex matters if Russian-speaking guests matter to you.
  • ChatGPT search only shows sites that allow its search crawler.

What website indexing means, and why it isn't ranking

Getting into search results happens in three steps:

  1. Crawling: a search engine's robot visits your page.
  2. Indexing: the search engine stores the page and what it's about.
  3. Ranking: it decides where the page appears for each search.

You can't control ranking directly, but you can make crawling and indexing easy. Even then, nothing is guaranteed: Google says a page found in a sitemap may still not be crawled or indexed.

Indexing is also the way into Google's AI answers. Google says that to appear as a supporting link in AI Overviews or AI Mode, a page must be indexed and eligible to show in Google Search with a snippet, and there are no additional technical requirements.

Which search engines matter for a business in Sharm

Search engine or assistantWho it matters forHow you get inFree tool
GoogleGuests from most countries, plus Google MapsSitemap and URL InspectionGoogle Search Console
BingGuests who use Bing or Microsoft's browser and appsSitemap and IndexNowBing Webmaster Tools
YandexRussian-speaking guestsSitemap and IndexNowYandex Webmaster
ChatGPT searchTravellers who ask ChatGPT for recommendationsAllow OAI-SearchBot in robots.txtNone needed
Seznam, Naver, Yep and othersSmaller marketsIndexNowNone needed

Yandex deserves a place on this list: it has about 70% of search in Russia (StatCounter, October 2026). If Russian-speaking guests matter to you, so does Yandex.

Website indexing on Google: Search Console and your sitemap

A sitemap is a file that lists the pages on your site. Most WordPress SEO plugins create one for you; on our own site, Rank Math creates it at /sitemap_index.xml.

  1. Add your site to Google Search Console and verify that you own it. You need owner permission to submit a sitemap.
  2. Test the sitemap. Run a live test on the sitemap's address in the URL Inspection tool. "Page fetch" should show "Successful".
  3. Submit it. Open the Sitemaps report, paste the sitemap address into "Add a new sitemap" and click Submit (Google Search Console Help).
  4. Check the status. If it doesn't say "Success", click the row to see what's wrong.
  5. Request indexing for your most important pages. Inspect a new page in URL Inspection and click "Request indexing". There's a daily limit, and Google says indexing typically takes a day or so but can take much longer in some cases. For many pages at once, Google recommends the sitemap instead.

Bing and Yandex: webmaster tools and IndexNow

Bing Webmaster Tools

  1. Sign in to Bing Webmaster Tools.
  2. Import your site from Google Search Console. Bing lists your verified sites with their sitemaps, and the sites you import are verified automatically (Bing Webmaster Tools Help).
  3. Or add the site by hand and verify it with an XML file, a meta tag or a DNS record.
  4. Give it time. Bing says it usually takes 48 hours for its data to appear after you add a site.

Yandex Webmaster

  1. Add your site to Yandex Webmaster and confirm that you own it.
  2. Add your sitemap. Go to the Sitemap files page, choose the site, enter the sitemap address and click Add. You can also point to the sitemap with a line in your robots.txt file (Yandex Webmaster Help).
  3. Wait for the robot. Yandex says it downloads the file within two weeks, and indexed pages appear in search within two weeks.
  4. Push important new pages. Use Indexing → Reindex pages for a new offer or price list you want found quickly.

IndexNow: tell Bing and Yandex the moment you publish

IndexNow lets your website notify search engines as soon as a page is added, updated or deleted. A submission to one participating engine is shared with all the others.

The list on indexnow.org includes Bing, Yandex, Seznam, Naver, Yep, the Internet Archive and Amazonbot. Google isn't on it, so for Google you still need your sitemap and Search Console. IndexNow doesn't guarantee indexing either, but it helps changes get found faster.

On WordPress you don't need to write code: plugins such as Rank Math's Instant Indexing send the notices for you.

How we did it on sharmsites.com

  • Google: in early October 2026 we verified sharmsites.com in Google Search Console with a DNS record and submitted the sitemap.
  • IndexNow: on 28 October we sent all 15 pages to Bing and Yandex through IndexNow, using Rank Math's Instant Indexing. It now sends every new or updated page by itself.
  • Bing: the same day we verified the site in Bing Webmaster Tools and submitted sitemap_index.xml.
  • Yandex: we verified the site in Yandex Webmaster, and the 15 pages were queued for crawling. Its sitemap tool was read-only that day, so for now Yandex reads the sitemap from our robots.txt.

Getting found by ChatGPT and other AI assistants

OpenAI uses separate crawlers, and you control each one separately in your robots.txt file:

CrawlerWhat it doesIf you block it
OAI-SearchBotFinds websites for ChatGPT's search answersYour site won't be shown in ChatGPT search answers (it can still appear as a navigational link)
GPTBotCollects content that may be used to train OpenAI's AI modelsYour content shouldn't be used for training; ChatGPT search isn't affected
ChatGPT-UserVisits a page when a ChatGPT user asks it toRobots.txt rules may not apply, because a person started the visit

OpenAI is clear: sites that block OAI-SearchBot "will not be shown in ChatGPT search answers" (OpenAI). To check yours:

  1. Open yoursite.com/robots.txt and look for "OAI-SearchBot", or for a rule that blocks every bot (User-agent: * followed by Disallow: /).
  2. Remove any rule that blocks OAI-SearchBot. OpenAI says changes can take about 24 hours to reach its systems.
  3. Check your firewall or CDN. OpenAI recommends allowing requests from its published IP ranges. Security settings at your host can block crawlers without you knowing.
  4. Decide on GPTBot separately. Blocking it is a choice about AI training; it doesn't remove you from ChatGPT search.

A rule that allows ChatGPT's search crawler looks like this:

`` User-agent: OAI-SearchBot Allow: / ``

Being crawled doesn't mean being recommended. AI assistants prefer pages with clear facts: what you offer, prices, location, opening hours and languages. Our guide to SEO for AI search covers that part.

Being in ChatGPT's answers is free. If you also want to appear below them as a paid placement, see ChatGPT ads in Egypt.

Why pages don't get indexed: a quick check

ProblemHow to spot itFix
A "noindex" tag on the pageURL Inspection says the page is excluded by noindexRemove it in your SEO plugin; in WordPress, also check that "Discourage search engines" is off under Settings → Reading
Blocked in robots.txtURL Inspection or Yandex Webmaster says the page is blockedEdit robots.txt
No links to the pageThe page isn't in your menu, sitemap or any other pageAdd it to the sitemap and link to it from related pages
Several versions of one page (http and https, with and without www)Google picks a different version as the main oneRedirect every version to one https address
Thin or copied contentSearch Console shows "Crawled - currently not indexed"Add useful, original text: prices, details, FAQs
Server errorsSitemap or page returns an error instead of loadingFix it with your host; Yandex flags a sitemap that doesn't return the normal "200" status

When we moved sharmsites.com to https in October 2026, we also replaced 433 old http:// links inside the site, so search engines see one version of each page.

What changes in 2027

  • AI answers are built on search indexes. Google's AI Overviews and AI Mode only link to indexed pages, so indexing becomes the entry ticket to AI answers too.
  • More crawlers knock on the door. IndexNow already reaches crawlers beyond search engines, such as Amazonbot. Decide crawler by crawler instead of blocking everything.
  • Fresh pages matter more. When guests ask an AI assistant about this season's prices or offers, pages that are updated and sent through IndexNow and your sitemap have the best chance of being found.

FAQ

How long does website indexing take?

It varies, and no search engine guarantees it. Google says indexing after a request typically takes a day or so but can take much longer. Yandex says its robot downloads a new sitemap within two weeks, and indexed pages appear in search within two weeks. IndexNow helps Bing and Yandex find new pages sooner.

Do I need Bing and Yandex if I'm already on Google?

If you want every guest to find you, yes. Bing Webmaster Tools is quick to set up when you import your site from Google Search Console, and Yandex matters for Russian-speaking guests. With IndexNow switched on, both hear about every new page automatically, so the extra work after set-up is small.

Does IndexNow work with Google?

No. Google isn't on IndexNow's list of participating search engines, which includes Bing, Yandex, Seznam, Naver, Yep, the Internet Archive and Amazonbot. For Google, submit your sitemap in Search Console and use URL Inspection to request indexing of your most important new pages, within its daily limit.

How do I get my website into ChatGPT?

First, make sure your robots.txt file and firewall don't block OAI-SearchBot, OpenAI's search crawler. OpenAI says blocked sites won't be shown in ChatGPT search answers. Then give it something worth showing: clear pages about your services, prices, location and languages, kept up to date. Being crawled doesn't guarantee a mention.

Should I block GPTBot?

That's your choice, and it doesn't affect ChatGPT search. GPTBot collects content that may be used to train OpenAI's models, while OAI-SearchBot finds pages for search answers. You can allow OAI-SearchBot and block GPTBot, or allow both. Just make sure a rule meant for GPTBot doesn't block OAI-SearchBot by mistake.

Need help getting your website indexed?

We set up Google Search Console, Bing Webmaster Tools, Yandex Webmaster and IndexNow for businesses in Sharm El Sheikh, and check that AI crawlers can reach your site, as part of our SEO and Google Maps service. Have pages in several languages? Read our guide to multilingual SEO, or see our 2027 tourism marketing guide. Message us on WhatsApp or use our contact page.

WhatsApp us

Sharm Sites is a digital marketing and digital solutions agency at Khan 83, Genena City Mall, Sharm El Sheikh. We help hotels, restaurants, travel agencies and other businesses in South Sinai with websites, SEO, social media and ads, booking systems and AI solutions. WhatsApp: +20 150 770 7705. Email: info@sharmsites.com.

Ready to grow your business in Sharm El Sheikh?

Tell us about your business on WhatsApp or by phone, and we will suggest the next step.