WikiDwarf: Created page with "{{short description|Deliberate manipulation of search engine indexes}} {{more citations needed|date=February 2021}} '''Spamdexing''' (also known as '''search engine spam''', '..."

2021-06-03T07:41:05Z

Created page with "{{short description|Deliberate manipulation of search engine indexes}} {{more citations needed|date=February 2021}} '''Spamdexing''' (also known as '''search engine spam''', '..."

New page

{{short description|Deliberate manipulation of search engine indexes}}
{{more citations needed|date=February 2021}}
'''Spamdexing''' (also known as '''search engine spam''', '''search engine poisoning''', '''[[Black hat hacker|black-hat]] [[search engine optimization]]''' ('''SEO'''), '''search spam''' or '''web spam''')<ref>[http://searchengineland.com/what-is-search-engine-spam-the-video-edition-15202.php ''SearchEngineLand'', Danny Sullivan's video explanation of Search Engine Spam, October 2008] . Retrieved 2008-11-13.</ref> is the deliberate manipulation of [[Web search engine|search engine]] [[Index (search engine)|indexes]]. It involves a number of methods, such as [[link building]] and repeating unrelated phrases, to manipulate the relevance or prominence of resources indexed, in a manner inconsistent with the purpose of the indexing system.<ref name="wspy">"Word Spy - spamdexing" (definition), March 2003, webpage:[http://www.wordspy.com/words/spamdexing.asp WordSpy-spamdexing].</ref><ref name=Gyongyi>{{Citation | first=Zoltán | last=Gyöngyi | author-link1=Zoltán Gyöngyi | first2=Hector | last2=Garcia-Molina | contribution=Web spam taxonomy | contribution-url=http://airweb.cse.lehigh.edu/2005/gyongyi.pdf | title=Proceedings of the First International Workshop on Adversarial Information Retrieval on the Web (AIRWeb), 2005 in The 14th International World Wide Web Conference (WWW 2005) May 10, (Tue)-14 (Sat), 2005, Nippon Convention Center (Makuhari Messe), Chiba, Japan. | year=2005 | publisher=ACM Press | place=New York, NY | isbn=1-59593-046-9 | author-link2=Hector Garcia-Molina }}</ref>

Spamdexing could be considered to be a part of [[search engine optimization]], although there are many search engine optimization methods that improve the quality and appearance of the content of web sites and serve content useful to many users.<ref name=Ntoulas>{{Citation | first=Alexandros | last=Ntoulas |author-link=Alexandros Ntoulas | first2=Mark | last2=Manasse | author2-link=Mark Manasse | first3=Marc | last3=Najork | author3-link=Marc Najork | first4=Dennis | last4=Fetterly | author4-link=Dennis Fetterly | contribution=Detecting Spam Web Pages through Content Analysis | title=The 15th International World Wide Web Conference (WWW 2006) May 23–26, 2006, Edinburgh, Scotland. | year=2006 | publisher=ACM Press | place=New York, NY | isbn=1-59593-323-9 }}</ref>

Search engines use a variety of [[algorithm]]s to determine relevancy ranking. Some of these include determining whether the search term appears in the [[body text]] or [[Uniform Resource Locator|URL]] of a [[web page]]. Many search engines check for instances of spamdexing and will remove suspect pages from their indexes. Also, search-engine operators can quickly block the results listing from entire websites that use spamdexing, perhaps in response to user complaints of false matches. The rise of spamdexing in the mid-1990s made the leading search engines of the time less useful. Using unethical methods to make websites rank higher in search engine results than they otherwise would is commonly referred to in the SEO (search engine optimization) industry as "black-hat SEO". These methods are more focused on breaking the search-engine-promotion rules and guidelines. In addition to this, the perpetrators run the risk of their websites being severely penalized by the [[Google Panda]] and [[Google Penguin]] search-results ranking algorithms.<ref>{{cite news |first=Ann |last=Smarty |title=What Is BlackHat SEO? 5 Definitions |url=http://www.searchenginejournal.com/what-is-blackhat-seo-5-definitions/8151/ |work=Search Engine Journal |date=2008-12-17 |access-date=2012-07-05 }}</ref>

Common spamdexing techniques can be classified into two broad classes: ''content spam''<ref name="Ntoulas"/> (or ''term spam'') and ''link spam''.<ref name=Gyongyi/>

==History==
The earliest known reference<ref name="wspy"/> to the term ''spamdexing'' is by Eric Convey in his article "Porn sneaks way back on Web," [[The Boston Herald]], May 22, 1996, where he said:

<blockquote>The problem arises when site operators load their Web pages with hundreds of extraneous terms so search engines will list them among legitimate addresses.
The process is called "spamdexing," a combination of [[spamming]] — the Internet term for sending users unsolicited information — and "[[Web indexing|indexing]]."<ref name=wspy/></blockquote>

==Content spam==
These techniques involve altering the logical view that a search engine has over the page's contents. They all aim at variants of the [[vector space model]] for information retrieval on text collections.

===Keyword stuffing===
Keyword stuffing involves the calculated placement of keywords within a page to raise the keyword count, variety, and density of the page. This is useful to make a page appear to be relevant for a [[web crawler]] in a way that makes it more likely to be found. Example: A promoter of a [[Ponzi scheme]] wants to attract web surfers to a site where he advertises his scam. He places hidden text appropriate for a fan page of a popular music group on his page, hoping that the page will be listed as a fan site and receive many visits from music lovers. Older versions of indexing programs simply counted how often a keyword appeared, and used that to determine relevance levels. Most modern search engines have the ability to analyze a page for keyword stuffing and determine whether the frequency is consistent with other sites created specifically to attract search engine traffic. Also, large webpages are truncated, so that massive dictionary lists cannot be indexed on a single webpage.{{cn|date=December 2019}} (However, spammers can circumvent this webpage-size limitation merely by setting up multiple webpages, either independently or linked to each other.)

=== Hidden or invisible text ===
Unrelated [[hidden text]] is disguised by making it the same color as the background, using a tiny font size, or hiding it within [[HTML]] code such as "no frame" sections, [[alt attribute]]s, zero-sized [[Span and div|DIVs]], and "no script" sections. People manually screening red-flagged websites for a search-engine company might temporarily or permanently block an entire website for having invisible text on some of its pages. However, hidden text is not always spamdexing: it can also be used to enhance [[web accessibility|accessibility]].{{citation needed|date=May 2021}}

===Meta-tag stuffing===
This involves repeating keywords in the [[meta tag]]s, and using meta keywords that are unrelated to the site's content. This tactic has been ineffective since 2005.{{citation needed|date=February 2017}}

===Doorway pages===
"Gateway" or [[doorway page]]s are low-quality web pages created with very little content, which are instead stuffed with very similar keywords and phrases. They are designed to rank highly within the search results, but serve no purpose to visitors looking for information. A doorway page will generally have "click here to enter" on the page; autoforwarding can also be used for this purpose. In 2006, Google ousted vehicle manufacturer [[BMW]] for using "doorway pages" to the company's German site, BMW.de.<ref>{{cite news |first=David |last=Segal |title=The Dirty Little Secrets of Search |url=https://www.nytimes.com/2011/02/13/business/13search.html?pagewanted=all |work=[[The NY Times]] |date=2011-02-13 |access-date=2012-07-03 }}</ref>

===Scraper sites===
[[Scraper sites]] are created using various programs designed to "scrape" search-engine results pages or other sources of content and create "content" for a website.{{citation needed|date=October 2012}} The specific presentation of content on these sites is unique, but is merely an amalgamation of content taken from other sources, often without permission. Such websites are generally full of advertising (such as [[pay per click|pay-per-click]] ads), or they redirect the user to other sites. It is even feasible for scraper sites to outrank original websites for their own information and organization names.

===Article spinning===
[[Article spinning]] involves rewriting existing articles, as opposed to merely scraping content from other sites, to avoid penalties imposed by search engines for [[duplicate content]]. This process is undertaken by hired writers{{citation needed|date=May 2021}} or automated using a [[thesaurus]] database or a [[neural network]].

===Machine translation===
Similarly to [[article spinning]], some sites use [[machine translation]] to render their content in several languages, with no human editing, resulting in unintelligible texts that nonetheless continue to be indexed by search engines, thereby attracting traffic.

==Link spam==
Link spam' is defined as links between pages that are present for reasons
other than merit.<ref name=Davison>{{Citation
| first=Brian | last=Davison | author-link=Brian D. Davison
| contribution = Recognizing Nepotistic Links on the Web
| contribution-url = http://www.cse.lehigh.edu/~brian/pubs/2000/aaaiws/aaai2000ws.pdf
| title=AAAI-2000 workshop on Artificial Intelligence for Web Search
| year=2000 | pages=23–28 | publisher=AAAI Press | place=Boston
}}</ref> Link spam takes advantage of link-based ranking algorithms, which gives [[websites]] higher rankings the more other highly ranked websites link to it. These techniques also aim at influencing other link-based ranking techniques such as the [[HITS algorithm]].{{cn|date=December 2019}}

===Link farms===
Link farms are tightly-knit networks of websites that link to each other for the sole purpose of gaming the search engine ranking algorithms. These are also known facetiously as ''mutual admiration societies''.<ref>{{cite web|url=http://www2.sims.berkeley.edu/courses/is141/f05/lectures/se-course-intro.pdf|title=Search Engines:Technology, Society, and Business - Marti Hearst, Aug 29, 2005|website=berkeley.edu}}</ref> Use of links farms has been greatly reduced after Google launched the first Panda Update in February 2011, which introduced significant improvements in its spam-detection algorithm.

=== Private blog networks ===
Blog networks (PBNs) are a group of authoritative websites used as a source of contextual links that point to the owner's main website to achieve higher search engine ranking. Owners of PBN websites use expired domains or [[Domain name auction|auction domains]] that have [[backlink]]s from high-authority websites. Google targeted and penalized PBN users on several occasions with several massive deindexing campaigns since 2014.<ref>{{Cite news|url=http://searchengineland.com/google-targets-sites-using-private-blog-networks-manual-action-ranking-penalties-204000|title=Google Targets Sites Using Private Blog Networks With Manual Action Ranking Penalties|date=2014-09-23|newspaper=Search Engine Land|language=en-US|access-date=2016-12-12}}</ref>

===Hidden links===
Putting [[hyperlink]]s where visitors will not see them is used to increase [[link popularity]]. Highlighted link text can help rank a webpage higher for matching that phrase.

===Sybil attack===
A [[Sybil attack]] is the forging of multiple identities for malicious intent, named after the famous multiple personality disorder patient "[[Sybil (Schreiber book)|Sybil]]"{{citation needed|date=May 2021}}. A spammer may create multiple web sites at different [[domain name]]s that all link to each other, such as fake blogs (known as [[spam blogs]]).

===Spam blogs===
Spam blogs are blogs created solely for commercial promotion and the passage of link authority to target sites. Often these "splogs" are designed in a misleading manner that will give the effect of a legitimate website but upon close inspection will often be written using spinning software or be very poorly written with barely readable content. They are similar in nature to link farms.{{citation needed|date=May 2021}}

===Guest blog spam===

Guest blog spam is the process of placing guest blogs on websites for the sole purpose of gaining a link to another website or websites. Unfortunately, these are often confused with legitimate forms of guest blogging with other motives than placing links. This technique was made famous by [[Matt Cutts]], who publicly declared "war" against this form of link spam.<ref>{{cite web|url=https://www.mattcutts.com/blog/guest-blogging/|title=The decay and fall of guest blogging for SEO|date=20 January 2014|website=mattcutts.com}}</ref>

===Buying expired domains===
{{See also|Domaining}}
Some link spammers utilize expired domain crawler software or monitor DNS records for domains that will expire soon, then buy them when they expire and replace the pages with links to their pages. However, it is possible but not confirmed that Google resets the link data on expired domains. {{citation needed|date=June 2015}} To maintain all previous Google ranking data for the domain, it is advisable that a buyer grab the domain before it is "dropped".

Some of these techniques may be applied for creating a [[Google bomb]] — that is, to cooperate with other users to boost the ranking of a particular page for a particular query.

===Cookie stuffing===
[[Cookie stuffing]] involves placing an [[affiliate marketing|affiliate]] tracking cookie on a website visitor's computer without their knowledge, which will then generate revenue for the person doing the cookie stuffing. This not only generates fraudulent affiliate sales, but also has the potential to overwrite other affiliates' cookies, essentially stealing their legitimately earned commissions.

=== Using world-writable pages ===
Web sites that can be edited by users can be used by spamdexers to insert links to spam sites if the appropriate anti-spam measures are not taken.

Automated [[spambot]]s can rapidly make the user-editable portion of a site unusable.
Programmers have developed a variety of automated [[Forum spam#Spam prevention|spam prevention techniques]] to block or at least slow down spambots.

====Spam in blogs====
[[Spam in blogs]] is the placing or solicitation of links randomly on other sites, placing a desired keyword into the hyperlinked text of the inbound link. Guest books, forums, blogs, and any site that accepts visitors' comments are particular targets and are often victims of drive-by spamming where automated software creates nonsense posts with links that are usually irrelevant and unwanted.

====Comment spam====
Comment spam is a form of link spam that has arisen in web pages that allow dynamic user editing such as [[wikis]], [[blogs]], and [[guestbooks]]. It can be problematic because [[Software agent|agents]] can be written that automatically randomly select a user edited web page, such as a Wikipedia article, and add spamming links.<ref name=Mishne>{{cite conference
| first = Gilad | last = Mishne | author-link = Gilad Mishne |author2=David Carmel |author3=Ronny Lempel
| title = Blocking Blog Spam with Language Model Disagreement
| book-title = Proceedings of the First International Workshop on Adversarial Information Retrieval on the Web
| year=2005 | url = http://airweb.cse.lehigh.edu/2005/mishne.pdf
| access-date = 2007-10-24 }}</ref>

====Wiki spam====
Wiki spam is a form of link spam on wiki pages. The spammer uses the open editability of wiki systems to place links from the wiki site to the spam site.

====Referrer log spamming====
[[Referrer spam]] takes place when a spam perpetrator or facilitator accesses a [[web page]] (the ''referee''), by following a link from another web page (the ''[[referrer]]''), so that the referee is given the address of the referrer by the person's Internet browser. Some [[website]]s have a referrer log which shows which pages link to that site. By having a [[Internet bot|robot]] randomly access many sites enough times, with a message or specific address given as the referrer, that message or Internet address then appears in the referrer log of those sites that have referrer logs. Since some [[Web search engine]]s base the importance of sites on the number of different sites linking to them, referrer-log spam may increase the search engine rankings of the spammer's sites. Also, site administrators who notice the referrer log entries in their logs may follow the link back to the spammer's referrer page.

==== Countermeasures ====
Because of the large amount of spam posted to user-editable webpages, Google proposed a nofollow tag that could be embedded with links. A link-based search engine, such as Google's [[PageRank]] system, will not use the link to increase the score of the linked website if the link carries a nofollow tag. This ensures that spamming links to user-editable websites will not raise the sites ranking with search engines. Nofollow is used by several major websites, including [[WordPress|Wordpress]], [[Blogger (service)|Blogger]] and [[Wikipedia]].{{citation needed|date=October 2012}}

==Other types==

===Mirror websites===
A [[mirror website|mirror site]] is the hosting of multiple websites with conceptually similar content but using different [[Uniform Resource Locator|URLs]]. Some search engines give a higher rank to results where the keyword searched for appears in the URL.

===URL redirection===
[[URL redirection]] is the taking of the user to another page without his or her intervention, ''e.g.'', using [[META refresh]] tags, [[Adobe Flash|Flash]], [[JavaScript]], [[Java (programming language)|Java]] or [[Server side redirect]]s. However, [[HTTP 301|301 Redirect]], or permanent redirect, is not considered as a malicious behavior.

===Cloaking===
[[Cloaking]] refers to any of several means to serve a page to the search-engine [[Web crawler|spider]] that is different from that seen by human users. It can be an attempt to mislead search engines regarding the content on a particular web site. Cloaking, however, can also be used to ethically increase accessibility of a site to users with disabilities or provide human users with content that search engines aren't able to process or parse. It is also used to deliver content based on a user's location; Google itself uses [[IP delivery]], a form of cloaking, to deliver results. Another form of cloaking is ''code swapping'', ''i.e.'', optimizing a page for top ranking and then swapping another page in its place once a top ranking is achieved. Google refers to these type of redirects as ''Sneaky Redirects''.<ref>{{cite web|url=https://support.google.com/webmasters/answer/2721217?hl=en|title=Sneaky redirects - Search Console Help|website=support.google.com}}</ref>

== Countermeasures ==
{{Expand section|date=October 2017}}

=== Page omission by search engine ===
Spamdexed pages are sometimes eliminated from search results by the search engine.

=== Page omission by user ===
Users can employ search operators for filtering. For Google, a keyword preceded by "-" (minus) will omit sites that contains the keyword in their pages or in the URL of the pages from search result. As an example, the search "-<unwanted site>" will eliminate sites that contains word "<unwanted site>" in their pages and the pages whose URL contains "<unwanted site>".

Users could also use the [[Google Chrome]] extension "Personal Blocklist (by Google)", launched by Google in 2011 as part of countermeasures against [[content farm]]ing.<ref>{{cite web|url=http://gigazine.net/news/20161129-personal-blocklist-by-google/|title=Google検索結果の悪質なサイトを非表示＆通報し検索品質アップに貢献できるGoogle公式Chrome拡張機能「Personal Blocklist」|website=gigazine.net}}</ref><ref>{{cite web|url=http://searchengineland.com/googles-personal-blocklist-delete-google-search-results-on-chrome-64757|title=New: Block Sites From Google Results Using Chrome's "Personal Blocklist" - Search Engine Land|date=14 February 2011|website=searchengineland.com}}</ref> Via the extension, users could block a specific page, or set of pages from appearing in their search results. As of 2021, the original extension appears to be removed, although similar-functioning extensions may be used.

==References==
{{Reflist}}

[[Category:Black hat search engine optimization]]
[[Category:Spamming]]

Spamdexing - Revision history

WikiDwarf: Created page with "{{short description|Deliberate manipulation of search engine indexes}} {{more citations needed|date=February 2021}} '''Spamdexing''' (also known as '''search engine spam''', '..."