Everyone uses a search engine and expects good quality and relevant search results to match the terms they were looking for.
But very few people know how a search engine finds what you are looking for.
When you do a search, you aren’t actually searching the internet – you are looking for results in the search engine’s index, which is just like the index in a book.
Let’s take a closer look at what happens when you enter a phrase in a search engine.
The search engine picks the important words (keywords), out of your phrase. It ignores words like ‘the’, ‘and’, ‘or’, ‘I’, ‘to’ – all common words that don’t really mean anything by themselves.
If you want the search engine to find the exact phrase, you can put quotation marks around it: “To be, or not to be”.
It then looks for your keywords in its index.
No search engine has found every single web page on the internet – there are far too many new pages added each day for search engine crawlers (spiders) to keep up. The pages that a search engine knows about are added to its index. Small scripts constantly crawl around the internet like spiders and collect the information on all of the websites they visit to build and update this index.
Metasearch engines have agreements with the larger search engines to use their indexes. They don’t build their own index.
A search engine index is used just like a book’s index – the search engine takes the keywords from your search phrase, looks in its index, and returns a list of links to webpages that contain those keywords.
Each search result, when it is displayed, will typically include a title, its URL (web address), and a snippet. You can use these pieces of information to decide whether to visit the page or not.
Of course, that’s a simplified explanation. It’s actually a difficult problem to choose the appropriate keywords, and quickly find matching entries in the index. Learn more about crawlers and search engine indexes here
At this point, many of the popular search engines save your search phrase, and add it to the profile they builds on you – this can identify your computer, IP, location, language, previous searches, etc. These search engines use your profile and your search history to find more ‘relevant’ results and show targeted ads. If you’d prefer to keep your searches private, it’s actually quite difficult. It isn’t easy to find out what personal data is collected by most search engines, or what your personal information is actually used for.
Now that the search engine has a the matching pages to your keywords, it shows you a list, ranking the pages in the order it thinks you will find most useful. Mostly this is based on how closely a page matches your keyword, but there are many other factors that go into ranking results, like the number of links going to and from a webpage.
Normal search engines also use the profile they have built on you. One person might see very different results to another, even though they search for the same word. None of these ranking algorithms are made public, so it is hard to no know exactly what factors influence the results you see.
In addition to being a private search engine, findx is transparent – you can see and adjust what ranking factors are used, This means that everyone sees the same results by default, but because everyone is different, you can adjust the search engine to match your own specific requirements for searching the internet – sign up to try findx today.
By contributing to improve search results, you can let quality results rise to the top of the list. You can flag broken, malicious or bad content and suggest improvements to titles and descriptions. Social rating of search results makes sense – it is the same method that most websites already use (product ratings, favourites on social media posts, etc).
Displaying advertisements to earn money is common: Large news websites, specialised blogs and also search engines show you ads.
Ads are matched to your keywords and displayed near the search results. Some search engines use the detailed profile they have built on you, to target you with personalised ads based on your previous searches and your personal information. Another common way that search engines make money, is to collect the keywords you search for, and sell that information about you via an advertising network.
We believe that ads are not the problem, but collecting your personal data and tracking you online is not ethical. That’s why findx doesn’t collect your searches or sell your personal information to anyone – but we do display ads.
Some search engines will pass your search phrase on to web page when you click on a result. This was originally to help webmasters write better content, but it has since turned into a big industry. Your search phrase may be added to your profile built by the website you visit.
Findx does not pass your search terms on by default, because we want you to keep your privacy. You can turn this off in the settings if you want to ‘help’ the webmasters out.
Map search, shopping search, image search, video search – most search engines have specialised search indexes for these types of searches. They still use keywords in the same way to find and rate results for you. Read more about these features of findx
If you have any questions about search engines, if you want to know anything specific about findx, our private search engine, or have any feedback for us then feel free to drop by our online community.
Findx is created as a search engine alternative with full privacy, and a true search engine with it’s own crawler and index.
Get access before it launches later this year, and to receive the latest updates from Privacore.