In these olden days of the Internet, you just needed to submit your site to search engines and wait a few days and everything was fine and dandy. Making your site appear high in search engines these days is next to impossible due to changing rules and formulas defined by search engines.

It is advisable to avoid so-called experts that spam your inbox saying they can improve your site’s SEO for $99 (but strangely do not have a website themselves).

There is no golden rule or trade secret to getting pages ranked high on search engines. You will need to do a number of things to get higher in search results or even appear on search results at all.

Google is not the only search engine and you will need to do a number of things to appear on all of them. Other search engines include DuckDuckGo, Bing, Yahoo, Ask and 14 more search engines here.

Site maps

Google and other top search engines expect your website to declare pages on your site via a sitemap.xml file (specifications here). There is a number of ways you can generate a site map file. If you use the WordPress CMS there are a number of plugins that generate sitemap.xml files for you. Search Engines have automatic bots that will read known sitemap files in order to update their search results.

Q1) Does your web site have a sitemap file?

Warnings

Most search engines will ignore your website if it is not trustworthy. You will be classified trustworthy if:

• Your website is linked to from many other trustworthy sites.
• Your website is not in an untrustworthy country or on an untrustworthy web site host.
• Your website does not have banned words or linked banned media.
• You don’t serve malicious files (or your Web servers IP address has never served malicious files).
• Your website is updated frequently. Sites like http://web.archive.org/web/*/www.microsoft.com will let you know how frequently a site has been updated.
• Your website needs to be secure (must have a secure SSL certificate installed and enabled). Google tells you HTTPS sites get better ranking here.
• Your website needs to be fast, a search engine will not point people to slow sites period.
• Your website also needs to have a lot of past and current traffic.

Content

Your site will also need to have good content in order to be seen as a valuable site. A blog is a good way to create new content and get new organic traffic to your site. You will need a desirable product or service to be high in the search engines result (e.g Chart generator or sell a  good product or service ). Your site also needs to contain the matching keywords to be referred to when people search for a particular thing.

It is easy to appear high in the search results if you use feed google enough words that match your article but it is hard enough to get to the top of the rankings for the term “SEO” with “144,00,000” other matching pages in google coming up for “SEO”

If you are going to pay someone to improve your SEO ask for their track record on SEO ranks, ask for examples, adding the more words to search results to get higher is lazy. I think being high in google rankings with 2 words is near impossible unless you use a location in the search term.  Google search is a trying to match the right results based on what you feed it and if you fail in any way your site is ranked down.

Analytics

Using search engines analytics like Google Analytics is a good way to ensure search engines know you exist (Google at least) and let you know what works and allows you to generate more content of what works.

Inbound Links

Most search engines prioritize your site over others if you have a high number of links to your site (inbound links), you can have the best site but with no inbound links to your site, you are in trouble. Creating fake links from non-important sites won’t cheat the system.

Site Speed 

Your web site need needs to be fast in order to be deemed trustworthy from search engines. A slow site will fall down the search engine page listing. Do everything you can do to speed up your site (start with ensuring the server is in the right location on a  non-shared server with a fast website utilizing cached content).

I have updated my post on Speeding up WordPress, my site used to load in 28 seconds, it now loads less than 9 seconds.

Secure sites

Google and other search engines will soon require your site to have a strong SSL certificate and high security (read my guide on SSL here and content security policy and public key pinning here).

You can check your site’s SSL certificate here. Check your site with shodan.io often for security flaws.

Blacklists

You will need to ensure your site is hosted on non-malicious serves and is using modern clean web technology.  Search engines prefer to redirect people to sites that use modern web technologies like HTML5 over transitional HTML websites.

Metadata (Dublin Core)

Metadata is important to allow search engines to know what is on a web page without remembering everything on each page. Read more on the latest metadata standards here.

Logs

Do check your logs (error and activity logs) for website crawlers activity (active and missed).

Search your website logs for known crawler activity. Are you missing search engines?

Your logs will tell you how many hits are coming from search engines.  I have had 1300+ people visit my site from Google this month alone.

Set goals around search engine targets and work toward them (percentage or total traffic).

Campaigns

Although campaigns are not directly related to SEO they do allow you to combine stats around page loads and advertising campaigns. I prefer to track campaigns with a custom central redirect page (e.g /go/index.php) that logs the inbound clicks.

// Save this to a file called index.php (maybe under a folder called "/go/" at the top of your server (e.g "https://www.fearby.com/go/index.php")
header("Cache-Control: no-cache, must-revalidate");
header("Expires: Sat, 26 Jul 1997 05:00:00 GMT");
header('Content-Type: text/html; charset=utf-8');

// Insert campaign logging code here
// todo

/* Sample Usage
https://www.fearby.com/go/?seo
https://www.fearby.com/go/?aws
*/
switch ($_SERVER['QUERY_STRING']) { 

	case "seo":
		header( 'Location: https://fearby.com/article/how-to-boost-your-sites-seo/' ) ;
		break;

	case ("beyondssl"):
		header( 'Location: https://fearby.com/article/beyond-ssl-with-content-security-policy-public-key-pinning-etc/' ) ;
		break;

	case ("mysql"):
		header( 'Location: https://fearby.com/article/setting-up-a-fast-distributed-mysql-environment-with-ssl/' ) ;
		break;
	
	case ("aws"):
		header( 'Location: https://fearby.com/article/creating-an-aws-ec2-ubuntu-14-04-server-with-nginx-node-and-mysql-and-phpmyadmin/' ) ;
		break;

	case ("do"):
		header( 'Location: https://fearby.com/article/how-to-buy-a-new-domain-and-ssl-cert-from-namecheap-a-server-from-digital-ocean-and-configure-it/' ) ;
		break;

	default: 
		echo "I could not find a page for the URL you specified.";
		break;
}

Long Tail Titles.

I use long and descriptive titles to mention what my blog post is about. I find that this helps with matching what and Google search loves it.

Some of my descriptive post titles

• How to develop software ideas
• Setting up a fast distributed MySQL environment with SSL
• Adding secure credit card payments to your website
• How to setup pooled MySQL connections in Node JS that don’t disconnect

Using long page titles can ensure people click on your links with confidence ( and they will know what your site is about ). Pageviews are not everything, engagement is.

My most recent popular posts.

I think I need to create some more technical guides as they seem popular.

Stats

Viewing statistics and reports can help you determine the popularity of your site.

Analytics

Reviewing Logs, viewing campaign data, viewing misc reports can help you identify incoming traffic to verify working acquisition sources.

I like looking at Google Analytics Behaviour reports for viewing inbound visits.  I can see over 19,000 incoming visitors from google over the last 2.5 years with no sightmap.xml (this proves that content and long titles work).

Adding your site to bing searches

Go to https://www.bing.com/toolbox/submit-site-url and submit your site.

I tried to submit my XML files to Bing but the form stalled (my bad I did not see the organization size mandatory field).

I changed the domain above to just the domain (no sitemap).

I added my 6 sitemaps to the Bing Webmaster tools.

Submit your sitemap files in the Bing Webmaster tools.

Adding Your Site to the Google Search Console

I am trying the WordPress SEO plugin by Yoest but before I do I am adding my site to the Google Search Console (linked to my Gmail account). You will need to add your site to Google Search Console to have Google index your site.

Before Google trusts your domain you need to verify ownership of the domain  ( for me I uploaded the verification files with the free FileZilla FTP program then loaded the file, then clicked verify at the Google Search Console page ).

Now my domain is verified and the Google Search console allows me to view the search status of my domain.

Installing a WordPress SEO Plugin – Yoast

Install the Yoast Plugin in WordPress (follow the install steps after you activate from step 1-8). You can add Yoast to your WordPress via the Add Plugins screen or download then upload it.

Don’t forget to activate then run the advanced Yoast configuration wizard.

After you get an authorization code it is important that you select your website from the profile list (if you don’t see this STOP and add your site to the Google Search Console (you cannot skip this step)).

Continue through steps 9-12 and finish installing the Yoast plugin.

Don’t forget to enable sitemaps (and review your settings). Now you can open the SEO plugin advanced options (/wp-admin/admin.php?page=wpseo_dashboard) and review the plugin options.

I installed the plugin but no sitemap.xml was created???

Twitter user https://www.twitter.com/atimmer10 said I may need to save the/wp-admin/options-permalink.php settings (no luck, this did not fix it and no sitemap.xml was created ).

I edited an existing published post and changed the short link and re-published a post ( no luck, this did not fix it and no sitemap.xml was created ).

I read this Yoast FAQ about the sitemap.xml not being created. I added the following to my .htaccess file ( no luck, this did not fix it and no sitemap.xml was created ).

# Yoast SEO - XML Sitemap Rewrite Fix
RewriteEngine On
RewriteBase /
RewriteRule ^sitemap_index.xml$ /index.php?sitemap=1 [L]
RewriteRule ^locations.kml$ /index.php?sitemap=wpseo_local_kml [L]
RewriteRule ^geo_sitemap.xml$ /index.php?sitemap=geo [L]
RewriteRule ^([^/]+?)-sitemap([0-9]+)?.xml$ /index.php?sitemap=$1&sitemap_n=$2 [L]
RewriteRule ^([a-z]+)?-?sitemap.xsl$ /index.php?xsl=$1 [L]
# END Yoast SEO - XML Sitemap Rewrite Fix

I still cannot get Yoast to create a sitemap.xml???

It turns out Yoast was creating a hidden /sitemap_index.xml

I then added the 6 individual sitemaps to the Google Search Console and Google started indexing my site.

Now Google will index my site and Yoast will auto-update my sitemaps when I Add/Edit or Delete a piece of content.

Do monitor your sitemap syncs from time to time.

Add your sitemaps(s) to Yahoo, Bing and Ask search engines

More on adding your site to search engines on the Yoast website here. Also, read this article.

robots.txt

robots.txt is also an older sitemap.xml file format, read more here.

I made a backwards-compatible robots.txt file

User-agent: *
Disallow: 
Disallow: /cgi-bin/
Disallow: /wp-admin/
Sitemap: https://fearby.com/post-sitemap.xml
Sitemap: https://fearby.com/page-sitemap.xml
Sitemap: https://fearby.com/news-sitemap.xml
Sitemap: https://fearby.com/category-sitemap.xml
Sitemap: https://fearby.com/post_tag-sitemap.xml
Sitemap: https://fearby.com/news-category-sitemap.xml

Generate a robots.txt here and read more here.

Other Plugins

Generate sitemaps from Yoast sitemaps with WP SEO HTML Sitemaps.

Other Tools

• Google has a Structured Data Testing Tool to allow you to diagnose various search issues.
• Webpage accessibility checker.
• Webpage speed checker

Top WordPress Plugins

Do More of What Works

Review pages and see what works, you may find old pages or posts are more popular than new ones.

Set Goals and Measure Them

Goals like page views are popular targets for SEO results but focusing on lowering bounce rates and increasing customer session time is just as important.

Through changes in the last 30 days, I have lowered my bounce rate from 94% to 80%. I have made some changes to my site to pick up chicks at the end of posts and hope to get a 50% or lower bounce rate.

Where are your visitors coming from?

Google Analytics will reveal where visitors come from. Twitter, Facebook, etc. Knowing where your readers are located allows you to target more users.

Time of Day

Knowing the time of day (from Google Analytics) will show you when it is best to post and promote.

Visitor Frequency

Google Analytics will tell you if your visitors are one-time visitors or regular visitors.

Conclusion

Ensure your sitemaps is up to date and keep adding new content.

Donate and make this blog better

Ask a question or recommend an article
[contact-form-7 404 "Not Found"]

V1.7 added info 1 month later