Design and Development for Search Engines
Articles, Tutorials
- Designing
For Search Engines and Stars
by Shirley E. Kaiser, M.A., (WebsiteTips.com's
Editor) for DigitalWeb Magazine.
Thorough tutorial that covers a lot of ground, and has received
many kudos from top industry experts. Written for site owners,
designers, students and instructors. Stated as a "must
read" by many industry experts.
[04/2001 by Shirley Kaiser, for Digital Web
Magazine.]
- Ask
the Expert: Danny Sullivan on Search Engines
From C|Net Builder.com. Great interview article on how search
engines find, list, and rank sites and how to use this information
to your advantage.
[11/04/1999 by Sarahjane White, for C|Net
Builder.]
- Building
Dynamic Pages with Search Engines in Mind
by Tim Perdue, PHP Builder. Working with Apache, Tim's tutorial
shows you how to code your dynamic pages to not include the &
and ? in the URLs (those can stop a search engine dead in its
tracks, not indexing your pages properly). Tim's method, which
also includes SSI,
has proven to work just fine with a site of over 200,000 pages and
growing.
[01/17/1999 by Tim Perdue, PHP Builder.]
- New
Directions in Optimizing Page Content
by Paul Bruemmer, ClickZ. Emphasizes importance of optimizing
content for search engines and visitors, quality copywriting,
keyword placement, site navigation, links to your site, more.
[06/13/2001 Paul Bruemmer, ClickZ.]
- Notes
on helping search engines index your Web site
W3C information about helpful elements to include
in your site development and how to implement them, such as the
page language using the <LINK> element,
keywords and descriptions using the <META>
element, and more.
[W3C - w3.org, HTML 4.01
notes]
- Priming
the Search Engines
From WebDeveloper.com. A 5-part article filled with info and tips
on building your site for optimization from the ground up, site
promotion, site submission to search engines, what NOT to do (such
as what's considered 'spamming the search engines,'), and a
thorough resource of links.
[by Scott Clark and David Fiedler for
WebDeveloper.com]
- Registering
Dynamic Sites
by Paul Bruemmer, ClickZ. Helpful information and tips about
search engine optimization for dynamically generated pages. See
the follow-up article to this, too - Solutions for Dynamic Page
Registration - described below.
[09/20/2001 by Paul Bruemmer, ClickZ.]
- Search
Engine Comparison Chart
by Submit Corner. Scan this chart quickly to see which search
engines support meta tags, which use link popularity, how much
time submissions takes, and more.
[by Submit Corner]
- Search
Engine Friendly URLs with PHP and Apache
by Garrett Coakley for evolt.org. Helpful, good tutorial.
[08/21/2001, by Garrett Coakley for
evolt.org.]
- Search
Engine Optimisation
By Tom Farrell, Frontend Usability InfoCentre. Good article about
what's important with optimizing your site -- attracting visitors
and links from other sites and a site's popularity, in addition to
meta tags and other optimizing techniques. Concise, well written
article.
[10/08/2001, by Tom Farrell, frontend.com.]
- Search
Engine Tips
Good article for newbies or advanced Internet users from Submit
It! Great explanations.
[by Submit It!]
- Search
Engine Tutorial For Web Designers
From NorthernWebs.com. Helpful tutorial, with the basics and
details about designing a website for search engine optimization.
Covers numerous search engines, with full pages discussing how
many of the top search engines handle indexing.
[Northern Webs]
- SEO
and the Web Site Design Process
by Paul Breummer, ClickZ. Good overview article about the top
items to consider with SEO and web design.
[12/19/2001 Paul Breummer, ClickZ. Thanks to
womendesigners
discussion list.]
- Solutions
for Dynamic Page Registration
by Paul Bruemmer, ClickZ. Follow-up article to Registering
Dynamic Sites noted above. Excellent info here, too.
[09/20/2000 by Paul Bruemmer, ClickZ.]
- The
Four Search Engines to be Listed in and Why
by Paul Bruemmer, ClickZ. Very insightful article about which
search engines can be most helpful for generating traffic to your
website. Good info here.
[11/08/2000, by Paul Bruemmer, ClickZ.]

Web Robots and Robots Exclusion Information
Looking for robots, such as Botspot? See the Internet
Robots section.
- Building
a Better Spider Trap
by SpiderHunter.com. Good tutorial with lots of information about
identifying spiders, ways of excluding spiders such as via
robots.txt, and much more.
- HTML
Author's Guide to the Robots META tag
by Martijn Koster. Concise info about implementation.
- How to keep
bad robots, spiders and web crawlers away
by Fleiner.com. Learn how to identify, trap, and ban bad robots
from your site.
- RoboGen
by Rietta Solutions, a visual robots exclusion file editor. The
site states that you can easily create a robots.txt file for your
site.
- Robots
Exclusion
by Martijn Koster. The Robots Exclusion Protocol, The Robots META
tag.
- Search
Engine Spider IP Addresses
by SearchEngineWorld. Listing of known search engine
spider/crawler ip addresses and hosts.
- The
Search Engine Watch SpiderSpotting Chart
by Danny Sullivan, Search Engine Watch. Although notes last update
of 1998, it's nonetheless a helpful chart. Links to more
resources, too.
- spiders_bots_and_agents
Listing of spiders, their IP addresses, names, hosts, and more.
Helpful, especially for reading stats logs, too.
- The
Web Robots FAQ...
by Martijn Koster. Thorough FAQ explaining search robots, how they
function, how to work with them, how to steer them away from your
pages if desired, more.
- Who's
Knocking on the Door? or, what you should know about the
Robots.txt file and the Robot's Meta Tag
Rhoda Schueller's very good explanation with examples.

Helpful Charts About Search Engines and Directories
- Directory
Submission Chart
One of the most helpful directory submission charts out there with
quick information about title length, description length,
keywords, how to submit, and turnaround times for submissions,
paid submissions or not, and more. Note: this chart is in the
subscriber area.
[by Danny Sullivan, Search Engine Watch]
- Search
Engine Submission Chart
One of the most helpful charts out there with quick information
about time frames for submissions, paid submissions or not, and
more. Note: this chart is in the subscriber area.
[by Danny Sullivan, Search Engine Watch]

How Search Engines Index, Rank Sites
Articles, Tutorials
- Google
Information for Webmasters
Google's information about submitting sites, removing sites from
their listings, how they rank pages, and more info here. Huge help
for Web site owners.
[Google.com]
- How
Search Engines Work
by Danny Sullivan, Search Engine Watch. Good overview of how
search engines list and rank a website. Links to more articles,
info.
- Search
Engine Tutorial For Web Designers
From NorthernWebs.com. Helpful tutorial, with the basics and
details about designing a website for search engine optimization.
Covers numerous search engines, with full pages discussing how
many of the top search engines handle indexing.

Checking and Developing Link Popularity and Why
- Developing
a Successful Link-Building Campaign
Helpful tips and links to information in this informative article
about how to develop a successful link-building campaign for your
site or for your clients' sites.
[By Debra Mastaler - December 13, 2001 (From
the Rank Write Roundtable Newsletter)]
- How
to Use Search Engines to Find Pages That Link to Your Site
by Kevin Elliott, About.com Web Search Guide. Short article about
how to find sites that are linking to yours. Includes links to
more resources.
[by Kevin Elliott, About.com.]
- LinkPopularity.com
See who links to your web site. This service provides an easy
one-click method of checking link popularity on three of the major
search engines. They also provide a free monthly customized Link
Popularity Report via e-mail.
Check your links here:
- Link
Analysis Can Help (or Harm) Your Web Site
by Detlev Johnson for WorkZ. Great explanation about how the
search engines rank by link popularity and what you can do to
increase your rankings. Links to more resources, too.
[12/18/00, by Detlev Johnson for WorkZ.]
- Link
Popularity Check - Marketleap Visibility Index
Very helpful, insightful free tool that charts out your link
popularity and compares your results with similar sites if you
wish.
- Links
to Your Website--Do They Matter?
by Shirley Kaiser, SKDesigns. Read about the importance of
networking with other websites to have reciprocal links.
[05/2000 by Shirley Kaiser, SKDesigns.]
- Measuring
Link Popularity
by Danny Sullivan, Search Engine Watch. [Article
updated 09/06/2001, Danny Sullivan, Search Engine Watch.]
- Reverse
Search Inside Out: Part 1: Why and How to Search Backwards
by Kevin Elliott, About.com Web Search Guide. Explains helpfulness
of reverse look-ups for a variety of purposes, including finding
links to your site. Includes tools, resources, more. Helpful
article. [06/11/2001 Kevin Elliott,
About.com.]
- The
Road to Link Popularity
Paul J. Bruemmer, 9-26-2001, ClickZ. Using Google's toolbar to
check your popularity, using link popularity for better rankings,
realistic ways to build your link popularity.
[09/26/2001 by Paul Breummer, ClickZ.]

Current Keyword Searches (Search Engine Spies)
Some of the search engines and directories have pages that show the
most current keywords and phrases being submitted in real time. Others
reflect top keyword phrases by the day, week, or month. There's a
variety of information available, as you'll see in the descriptions.
- Ask Jeeves
Take A Peek
This page has the top 50 questions being asked at Ask Jeeves,
refreshed every 30 seconds.
- Google
Zeitgeist
"Search patterns, trends, and surprises according to Google."
This page is a good resource for Google info. It lists the
following: top 10 declining queries and top 10 gaining queries for
the previous week and the previous month. Also for the previous
month it lists the languages used to search, country of origin,
top 5 translations for anthrax, top image searches. Another chart
it shows is the top browsers used for several months (several
versions of Internet Explorer, Netscape, and "Other"),
which is interesting to see for an overall trend over a period of
time.
- Kanoodle
Search Spy
Refreshed every 10 seconds showing the latest searches at Kanoodle.
(Warning: this information is unfiltered.)
- Metacrawler
MetaSpy
Choose the filtered or unfiltered listings of the live top 15-20
searches at Metacrawler. Automatically refreshes every 15 seconds.
- Search.com Top
100 Searches
C|net's top 100 searches for the week.
- The Lycos 50 daily
Report
With Aaron Schatz. List of the top 50 most popular search terms,
and includes commentary, FAQs, and more. Quite a gold mine here!
- Yahoo! Buzz Index
Lists the current top 20 search terms for the week, with archives
to the past several weeks. Shows declining and gaining queries,
weeks on the chart, and articles about the top leaders.
Additionally, there are links to other sections of information,
including category top search terms (movies, music, TV, sports,
and other top categories); top photos; most viewed news stories;
most e-mail news stories; top overall.

Search Engine Submissions
Articles, Tutorials
- Getting
Listed in Major Search Engines and Directories
by Paul Bruemmer. Good article about which search engines are
important for submitting your site, the difference between a
search engine and a search directory, URLs to the important ones,
fees for submissions, and related.
[Paul Bruemmer, Web-Ignite Corporation.]
- Search
Engine Submission Tips
Very informative, helpful information from Search Engine Watch.
[by Danny Sullivan, Search Engine Watch.]
- The
Overlooked Killer App: Paid Inclusion

Learn the basics about paid inclusions, pay-per-click, CPC
directories, Per-URL programs, and XML feeds.
[09/18/2002, by Kevin Lee for ClickZ.]

Free Search Engine Submissions
- Search
Engine Submission Links
by J.K. Bowman's Spider Food. Direct URLs to hand submit your site
to various top search engines and directories. Also suggests which
are more worthwhile to use the paid submissions.
- SelfPromotion.com
Submit to sites for no charge or bump up to a professional
service.
- Submit-Away
Website Promotion Center. Submit site to 600+ directories, more
info.
- Submit It!
Website promotion and marketing services.
- Submit
to Search Engines
by KL Nguyen. At least 100 search engines and directories with
direct links to submission pages. Short annotations of language
and/or country, too.

Professional Site Submissions, SEO Experts
- RankWrite
Top professionals Jill Whalen and Heather Lloyd-Martin. Highly
recommended, top in their field.
- Search
Engine Watch
Top professional Danny Sullivan. Highly recommended, top of his
field.

Search Engine Submission Programs
- Submission
Wolf
Popular site submission program by Trellian Software.
- WebPosition
Gold
Top ranked search engine submission software, provides advice,
help, much more, in addition to specialized site submissions for
each search engine.

Resource Sites
Sites Devoted to Search Engines, SEO, Marketing
This listing includes sections of Web sites or entire Web sites
devoted to search engine information or search engine optimization.
- Rank Write
Roundtable
One of the best resources around for search engine optimization,
information, optimizing your content, and related. They have many
easy-to-understand articles and tips, and their weekly newsletter
discussion is also archived, packed with tons of helpful,
top-notch information.
[Jill Whalen and Heather Martin,
Rankwrite.com]
- Search
Engine Optimization Ethics
Offers ethical search engine optimization and submission services.
In-depth articles on search engine placement and web site
promotion issues.
- Search
Engine Secrets
from Webmaster T's World of Design. Great reference. Tutorials,
annotated links to a variety of information.
[by Webmaster T's World of Design.]
- Search
Engine Watch
Known as one of the top websites for accurate, up-to-date
information about search engines and optimization.
[by Danny Sullivan, Search Engine Watch.]
- Web Search
About.com's terrific section on search engines, optimization, link
popularity, and much more. Many good articles, tutorials, links to
more. Excellent.
[by Kevin Elliott, About.com.]

More Links Resources
The following links are pages or sites with many more links to more
resources about search engines, optimization, marketing and promoting
your site, and related.

Website Promotion
- 10
Site Promotion Tips
Concise article with good points about bringing in and keeping
visitors at your website, including metatags, keywords, marketing
and promotion, tracking search engine placement, what to avoid in
site design and why (such as image maps and frames), links to
resources and further information. Good info here.
- FAQ:
How To Announce Your New Web Site
Summarizes very well, provides links to resources, search engines,
directories, more. Helpful article.
- Online
Publicity Resources
Helpful listing of high quality resources to promote and list your
site.
- The
Beginners Guide to Website Promotion
Very good introduction to submitting to search engines and how,
reciprocal linking, newsletters, announcements, and other means of
promoting your site.
[Northern Webs.]
- TipsZone.com -
web site promotion tips
Web site promotion, internet marketing, and online advertising
tips to help you grow your online business. Highly recommended.
- Tracking
Your Web Site Traffic
by Jean Kaiser, About.com Guide to Web Design. Detailed tutorial
about reading log files, analyzing visitors, learning where
they're coming from, freeware and shareware, resources to more
info.
- Understanding
the Power of Search Engine Marketing
by Paul J. Bruemmer, 10-24-01, ClickZ. Article about understanding
how search engine rankings impact how people find your site, buy
your products and services, and more. Includes statistics, search
engines vs. search directories, investing in search engine
optimization,
- Web
Site Marketing Primer
How else can I promote my site?
- Yahoo!
Announcement Services
Announce your website by registering at any of the dozens of host
sites listed at this website, most of which are free. Valuable
source.

Other Tools
Free Online Website Tools
See also
Validating
Tools (HTML
section)
Link
Checkers (HTML
section).
See the Design
section for learning more about cross-browser accessibility and
screen resolutions.
The tools below are free online tools available at the listed Web
sites.
- AnyBrowser.com
View your website on a variety of browsers from this site, check
your HTML, view your site from different screen window sizes, and
more tools. A real eye-opener and help to see if changes need to
be made to your website to be viewed consistently.
- Dr.
HTML
Free one-page website analysis tool. Purchase available to analyze
your entire website.
- GoTo
Keywords Suggestion Tool
Fantastic tool to use online. Try a variety of keywords and
keyword phrases to see how they rank via GoTo.com's search engine.
This is a very helpful barometer for figuring out which keyword
phrases to utilize for your website, including paid rankings.
(Remember: Keywords and keyword phrases need to be utilized
throughout your content, not just your meta tags.)
- Link
Popularity Check - Marketleap Visibility Index
Very helpful, insightful free tool that charts out your link
popularity and compares your results with similar sites if you
wish.
- LinkPopularity.com
See who links to your web site. This service provides an easy
one-click method of checking link popularity on three of the major
search engines. They also provide a free monthly customized Link
Popularity Report via e-mail.
Check your links here:
- SiteOwner
(formerly SiteInspector)
An all-in-one website that has tools to help your website all at
one stop: SiteInspector, LinkFinder, SubmitIt!, Merchant Planet,
Position Agent, ListBot, ClickTrade, FastCounter, and more.
- Web
Site Garage
For website maintenance, run diagnostics on your web pages, see
how your web page looks on 18 different browsers. Also has website
promotion and analysis tools.
- Wordspot
Check out keywords and keyword phrases with this free online tool.
Or subscribe to their larger report, too.
- WordTracker
This service is the most helpful one available for figuring out
the best keywords and keyword phrases to include in the content
and meta tags for your site.

Website Statistics and Counters
- TheCounter
Tracks a variety of information about visitors. Shows over period
of months or breakdown by each hour or day.
- eXTReME
Tracking
Free service for statistical tracking. Includes summary totals,
unique visitors, domains, countries, cities, system tracking
(browsers, screen resolutions and colors), referrer tracking,
more. Details at site. For a small monthly fee, this tracking can
also be accessible by password with no public viewing (free
service is accessible to anyone).
- HitBOX Site
Analyzer
Tracks and analyzes a variety of information about visitors. Free
and charge services available.
- SiteMeter
Free service. Tracks page views per visit, time zone, OS, web
browsers, more.
- Website
Tracker
Total hits, unique hits, average hits, visitor profiles, system
tracking, more. All information for past 10 days, brief summaries
for months, year. Free service.
- SuperStats
View site traffic reports, visitor profile reports (browsers, OS,
monitor resolutions, colors, countries, more), referrers, search
engines, more. Has free version and an upgraded version with a
monthly charge (low cost).
- WebTrends
Considered one of the best statistical log programs on the market.

Newsletters, Discussion Lists, Forums
For more, see also the section on Discussion
Lists, Ezines, and Newsletters.
Discussion Newsletters or Digests
- I-Search
Discussion digest from Adventive. Excellent, great info.
- Rank Write
Roundtable
Top-notch weekly search engine optimization discussion newsletter
geared for site owners and designers. Top-notch, professional.
- Search
Engine Forums
Find answers and ask your questions here at a variety of forums on
specific search engines and general information. Helpful resource.

|