I moved my domain to UpCloud (on the other side of the world) from Vultr (Sydney) and could not be happier with the performance. Here is what I did to set up a complete Ubuntu 18.04 system (NGINX, PHP, MySQL, WordPress etc). This is not a paid review (just me documenting my steps over 2 days).

Background (CPanel hosts)

In 1999 I hosted my first domain (www.fearby.com) on a host in Seattle (for $10 USD a month), the host used CPanel and all was good.  After a decade I was using the domain more for online development and the website was now too slow (I think I was on dial-up or ADSdL 1 at the time). I moved my domain to an Australian host (for $25 a month).

After 8 years the domain host was sold on and performance remained mediocre. After another year the new host was sold on again and performance was terrible.

Advertisement:

Page load times were near 30 seconds.

I started receiving Resource Limit Is Reached warnings (basically this was a plot by the new CPanel host to say “Pay us more and this message will go away”).

The straw that broke the camels back was they demanded $150/year fee for a dodgy SSL certificate.

I needed to move to a self-managed server where I was in control.

Advertisement:

Buying a Domain Name

Buy a domain name from Namecheap here.

Self Managed Server

I found a good web IDE ( http://www.c9.io/ ) that allowed me to connect to a cloud VM.  C9 allowed me to open many files and terminal windows and reconnect to them later. Don’t get excited as AWS have purchases C9 and it’s not the same.

C9 IDE

I spun up a Digital Ocean Server at the closest data centre in Singapore. Here was my setup guide creating a Digital Ocean VM, connecting to it with C9 and configuring it. I moved my email to G Suite and moved my WordPress to Digital Ocean (other guides here and here).

I was happy as I could now send emails via CLI/code, set up free SSL certs, add second domain email to G Suite and Secure G Suite. No more usage limit errors either.

Self-managing servers require more work but it is more rewarding (flexible, faster and cheaper).  Page load times were now near 20 seconds (10-second improvement).

Latency Issue

Over 6 months, performance on Digital Ocean (in Singapore) from Australia started to drop (mentioned here).  I tried upgrading the memory but that did not help (latency was king).

Moved the website to Australia

I moved my domain to Vultr in Australia (guide here and here). All was good for a year until traffic growth started to increase.

I tried upgrading the memory on Vultr and I setup PHP child workers, setup Cloudflare.

GT Metrix scores were about a “B” and Google Page Speed Scores were in the lower 40’s. Page loads were about 14 seconds (5-second improvement).

Tweaking WordPress

I set up an image compression plugin in WordPress then set up a cloud image compression and CDN Plugin from the same vendor.  Page Speed info here.

GT Metrix scores were now occasionally an “A” and Page Speed Scores were in the lower 20’s. Page loads were about 3-5 seconds (10-second improvement).

Mixed bag from Vultr (more optimizing and performance weree needed).

Google Chrome Developer Console Audit Results on Vultr hosted website were not very good (I stopped checking as nothin helped).

The problem was the Vultr server (400km away in Sydney) was offline (my issue) and everything above did (adding more memory, adding 2x CDN’s (EWWW and Cloudflare), adding PHP Child workers etc) did not seem to help???

Enter UpCloud

Recently, A friend sent a link to a blog article about a host called “UpCloud” who promised “Faster than SSD” performance.  This can’t be right “Faster than SSD”, I was intrigued.  I wanted to check it out as I thought nothing was faster than SSD (well maybe RAM).

I signed up for a trial and ran a disk IO test, read the review here and I was shocked. It’s fast. Very fast.

Summary: UpCloud was twice as fast (Disk IO and CPU) as Vultr (+ an optional $4/m firewall and $3/m for 1x backup).

fyi: Labels above are K Bytes per second. iozone loops through all file sizes from 4 Kybtes to 16,348 KBytes and measures through the reads per second. To be honest, the number meanings don’t interest me, I just want to compare apples to apples.

(image snip from http://www.iozone.org/ that explains the numbers)

I might have to copy my website on UpCloud and see how fast it is.

Where to Deploy and Pricing

Uplcloud Pricing: https://www.upcloud.com/pricing/

UpCloud does not have a data centre in Australia yet so why choose UpCloud.

Most of my site’s visitors are based in the US and UpCloud have disk IO twice as fast as Vultr (Win Win?).  I could deploy to Chicago?

My site’s traffic is growing and I need to ensure the site is fast enough in the future.

Advertisement:

Creating and UpCloud VM

I used a friends referral code and signed up created my first VM.

fyi: Use my Referral code and get $25 free credit.  Sign up only takes 2 minutes.

https://www.upcloud.com/register/?promo=D84793

UpCould support page is located here: https://www.upcloud.com/support/

• Quick start: Introduction to UpCloud
• How to deploy a Cloud Server
• Deploy a cloud server with UpCloud’s API

More UpCloud Links to read

• Two-Factor Authentication on UpCloud
• Floating IPs on UpCloud
• How to manage your firewall
• Finalizing deployment

I was not sure how to log in after signing up so I went back to https://www.upcloud.com/and clicked Sign In ( https://my.upcloud.com/login ).

Now I can see a dashboard 🙂

I was happy to see 24/7 support is available.

UpCloud Dashboard

After logging in I noticed I could customize the dashboard.

It would be nice to see an UpCloud API or some way that I can push data to the dashboard from my VM (via scheduled cron jobs). I’d really like to see my data in this dashboard, not at the level of PM2 but things like CPU/Memory history, logs, disk used/free, connections etc

UpCloud Trial Mode

I am not sure what limits to the trial mode (5 days)?

UPDATE: A friend signed up for a trial and did not deposit some money (e.g $10) in 7 days and his server was deleted.  We deposited $10 via PayPal and he was still in trial mode. If you are signing up and want to keep your server you will need to exit trial mode by depositing money from a DEBIT/CC card (that is not blocked overseas) ASAP.

Deploy My First UpCloud Server

This is how I deployed a server.

If you are going to deploy a server consider using my referral code and get $25 credit for free.

Under the “deploy a server” widget I named the server and choose a location (I think I was supposed to use an FQDN name (e.g “fearby.com”)). The deploy worked though. I clicked continue, then more options were made available.

1. Enter a short server description.
2. Choose a location (Frankfurt, Helsinki, Amsterdam, Singapore, London and Chicago)
3. Choose the number of CPU’s and amount of memory
4. Specify disk number/names and type (MaxIOPS or HDD).
5. Choose an Operating System
6. Select a Timezone
7. Define SSH Keys for access
8. Allowed login methods
9. Choose hardware adapter types
10. Where the send the login password

fyi How to generate a new SSH Key (on OSX or Ubuntu)

Output

Did the key export (yes)

> /temp# ls /temp/ -al
> drwxr-xr-x 2 root root 4096 Jun 9 15:33 .
> drwxr-xr-x 27 root root 4096 Jun 8 14:25 ..
> -rw——- 1 user user 1766 Jun 9 15:33 example_rsa
> -rw-r–r– 1 user user 396 Jun 9 15:33 example_rsa.pub

“example_rsa” is the private key and “example_rsa.pub “is the public key.

• The public key needs to be added to the server to allow access.
• The private key needs to be added to any local connecting ssh program.

Initialization script (after deployment)

I was pleased to see an initialization script section that calls actions after the server is deployed. I configured the initialization script to pull down a few GB of backups from my Vultr website in Syndey (files now removed).

This was my Initialization script.

Confirm and Deploy

I clicked “Confirm and deploy” but I had an alert that said trial mode can only deploy servers up to 1024MB of memory.

Exiting UpCloud Trial Mode

I opened the dashboard and clicked My Account then Billing, I could see the $25 referral credit but I guess I cant use that in Trial.

I exited trail mode by deposited $10 (USD).

fyi: Server prices are listed below (or view prices here).

Now I can go back and deploy the server with the same settings above (1x CPU, 2GB Memory, Ubuntu 18.04, MaxIOPS Storage etc)

Advertisement:

Deploy in progress.

UpCloud Server Deployed

The server is now deployed, now I can connect to it with my SSH program (vSSH).  Simply add the server’s IP, username, password and the SSH private key (generated above) to your ssh program of choice.

fyi: The public key contents start with “ssh-rsa”.

I noticed that the initialization script downloaded my 2+GB of files already. Nice.

UpCloud Billing Breakdown

I can now see in UpCloud billing page in my dashboard that credit is deducted daily (68c), at this rate, I have 49 days credit left?

I can manually deposit funds or set up automatic payments 🙂

UpCloud Backup Options

Note: Backup are charged at $0,056 for every GB stored – so $5,6 for every 100GB per month (half that for 50GB etc)

I made a manual backup and can set an automatic schedule if need be. Nice.

UpCloud Firewall Options

I set up a firewall at UpCloud to only allow the minimum number of ports (UpCoud DNS, HTTP, HTTPS and My IP to port 22).  The firewall feature is charged at $0.0056 an hour ($4.03 a month)

I love the ability to set firewall rules on incoming, destination and outgoing ports.

Update: I updated my firewall to allow inbound ICMP (IPv4/IPv6) and UDP (IPv4/IPv6) packets.

Because my internet provider has a dynamic IP, I set up a VPN with a static IP and whitelisted it for backdoor access.

Local Ubuntu ufw Firewall

I duplicated the rules in my local ufw (2nd level) firewall (and blocked mail)

UpCloud Download Speeds

I pulled down a 1.8GB Ubuntu 18.08 Desktop ISO 3 times from gigenet.com and the file downloaded in 32 seconds (57MB/sec). Nice.

Install Common Ubuntu Packages

I installed common Ubuntu packages.

Timezone

I checked the servers time (I thought this was auto set before I deployed)?

I reset the time to Australia/Sydney.

Now the timezone is set 🙂

Shell History

I increase the shell history.

SSH Login

I created a ~/.ssh/authorized_keys file and added my SSH public key to allow password-less logins.

I added my pubic ssh key I exited the ssh session and logged back in. I can now log in without password.

Install NGINX

nginx/1.14.0 is now installed.

A quick GT Metrix test.

Install MySQL

Run these commands to install and secure MySQ.

Securing the MySQL server deployment.
> Would you like to setup VALIDATE PASSWORD plugin?: n
> New password: **********************************************
> Re-enter new password: **********************************************
> Remove anonymous users? (Press y|Y for Yes, any other key for No) : y
> Disallow root login remotely? (Press y|Y for Yes, any other key for No) : y
> Remove test database and access to it? (Press y|Y for Yes, any other key for No) : y
> Reload privilege tables now? (Press y|Y for Yes, any other key for No) : y
> Success.

I disabled the validate password plugin because I hate it.

MySQL Ver 14.14 Distrib 5.7.22 is now installed.

Set MySQL root login password type

Set MySQL root use to authenticate via “mysql_native_password”. Run the “mysql” command.

Now lets set the root password authentication method to “mysql_native_password”

Check Authentication method

Now we need to flush permissions

Done

Advertisement:

Install PHP

Install PHP 7.2

PHP 7.2.5, Zend Engine v3.2.0 with Zend OPcache v7.2.5-1 is now installed. Do update PHP frequently.

I made the following changes in /etc/php/7.2/fpm/php.ini

> cgi.fix_pathinfo=0
> max_input_vars = 1000
> memory_limit = 1024M
> max_file_uploads = 20M
> post_max_size = 20M

Install PHP Modules

sudo apt-get install php-pear php7.2-curl php7.2-dev php7.2-mbstring php7.2-zip php7.2-mysql php7.2-xml

Install PHP FPM

Configure PHP FPM config

Edit /etc/php/7.2/fpm/php.ini

> cgi.fix_pathinfo=0
> max_input_vars = 1000
> memory_limit = 1024M
> max_file_uploads = 20M
> post_max_size = 20M

Reload php sudo service

Install PHP Modules

Configuring NGINX

If you are not comfortable editing NGINX config files read here, here and here.

I made a new “www root” folder, set permissions and created a default html file.

I edited the “root” key in “/etc/nginx/sites-enabled/default” file and set the root a new location (e.g” /www-root”)

I added these performance tweaks to /etc/nginx/nginx.conf

> worker_cpu_affinity auto;
> worker_rlimit_nofile 100000

I add the following lines to “http {” section in /etc/nginx/nginx.conf

Check NGINX Status

Install Open SSL that supports TLS 1.3

This is a work in progress. The steps work just fine for me on Ubuntu 16.04. but not Ubuntu 18.04.?

Instaling Adminer MySQL GUI

I will use the PHP based Adminer MySQL GUI to export and import my blog from one server to another. All I needed to do is install it on both servers (simple 1 file download)

Use Adminer to Export My Blog (on Vultr)

On the original server open Amdiner (http) and..

1. Login with the MySQL root account
2. Open your database
3. Choose “Save” as the output
4. Click on Export

Save the “.sql” file.

I used Adminer on the UpCloud server to Import My Blog

fyi: Depending on the size of your database backup you may need to temporarily increase your upload and post sizes limits in PHP and NGINX before you can import your database

Edit /etc/php/7.2/fpm/php.ini
> max_file_uploads = 100M
> post_max_size =100M

And Edit: /etc/nginx/nginx.conf
> client_max_body_size 100M;

Don’t forget to reload NGINX config and restart NGINX and PHP. Take note of the maximum allowed file size in the screenshot below. I temporarily increased my upload limits to 100MB to upload to be able to restore my 87MB blog.

Now I could open Adminer on my UpCloud server.

1. Create a new database
2. Click on the database and click Import
3. Choose the SQL file
4. Click Execute to import it

Don’t forget to create a user and assign permissions (as required (check your wp-config.php file)).

Tip: Don’t forget to lower the maximum upload file size and max post size  after you import your database,

Cloudflare DNS

I use Cloudflare to manage DNS, I need to tell it about my new server.

You can get your servers IP details from the UpCloud dashboard.

At Cloudflare update your DNS details to point to the serves new IPv4 (“A Record”) and IPv6 (“AAAA Record”).

Advertisement:

Domain Error

I waited an hour and my website was suddenly unavailable.  At first, I thought this was Cloudflare forcing the redirection of my domain to HTTP (that was not yet set up).

I chatted with UpCloud chat on their webpage and they kindly assisted me to diagnose all the common issues like DNS values, DNS replication, Cloudflare settings and the error was pinpointed to my NGINX installation.  All NGINX config settings were ok from what we could see?  I uninstalled NGINX and reinstalled it (and that fixed it). Thanks, UpCloud Support 🙂

Reinstalled NGINX

I reinstalled NGINX and reconfigured /etc/nginx/nginx.conf (I downloaded my SSL cert from my old server just in case).

Here is my /etc/nginx/nginx.conf file.

Here is my /etc/nginx/sites-available/default file (fyi, I have not fully re-setup TLS 1.3 yet so I remarked the settings out)

SSL Labs SSL Certificate Check

All good thanks to the config above.

Install WP-CLI

I don’t like setting up FTP to auto-update WordPress plugins. I use the WP-CLI tool to manage WordPress installations by the command line. Read my blog here on using WP-CLI.

Download WP-CLI

Move WP-CLI to the bin folder as “wp”

Test wp

Update WordPress Plugins

Now I can run “wp plugin update” to update all WordPress plugins

Update WordPress Core

WordPress core file can be updated with “wp core update”

Troubleshooting: Use the flag “–allow-root “if wp needs higher access (unsafe action though).

Install PHP Child Workers

I edited the following file to setup PHP child workers /etc/php/7.2/fpm/pool.d/www.conf

Changes

> pm = dynamic
> pm.max_children = 40
> pm.start_servers = 15
> pm.min_spare_servers = 5
> pm.max_spare_servers = 15
> pm.process_idle_timeout = 30s;
> pm.max_requests = 500;
> php_admin_value[error_log] = /var/log/www-fpm-php.www.log
> php_admin_value[memory_limit] = 512M

Advertisement:

Restart PHP

Test NGINX config, reload NGINX config and restart NGINX

Output (14 workers are ready)

Memory Tweak (set at your own risk)

vm.swappiness = 1

Setting swappiness = 1 all but disables the swap file and tells the Operating System to aggressively use ram, a value of 10 is safer. Only set this if you have enough memory available (and free).

Possible swappiness settings:

> vm.swappiness = 0 Swap is disabled. In earlier versions, this meant that the kernel would swap only to avoid an out of memory condition when free memory will be below vm.min_free_kbytes limit, but in later versions, this is achieved by setting to 1.[2]> vm.swappiness = 1 Kernel version 3.5 and over, as well as Red Hat kernel version 2.6.32-303 and over: Minimum amount of swapping without disabling it entirely.
> vm.swappiness = 10 This value is sometimes recommended to improve performance when sufficient memory exists in a system.[3]
> vm.swappiness = 60 The default value.
> vm.swappiness = 100 The kernel will swap aggressively.

The “htop” tool is a handy memory monitoring tool to “top”

Also you can use good old “watch” command to show near-live memory usage (auto-refreshes every 2 seconds)

Script to auto-clear the memory/cache

As a habit, I am setting a cronjob to check when free memory falls below 100MB cache is automatically cleared (freeing memory).

Script Contents: clearcache.sh

I set the cronjob to run every 15 mins, I added this to my cronjob

Sample log output

I will check the log (/scripts/clearcache.log) in a few days and view the memory trends.

After 1/2 a day Ubuntu 18.04 is handling memory just fine, no externally triggered cache clears have happened 🙂

I used https://crontab.guru/every-hour to set the right schedule in crontab.

I rebooted the VM.

Swap File

fyi: Here is a handy guide on viewing swap file usage here. I’m not using swap files so it is only fyi.

After the system rebooted I checked if the swappiness setting was active.

Yes, swappiness is set.

File System Tweaks – Write Back Cache (set at your own risk)

First, check  your disk name and file system

Take note of your disk name (e.g vda1)

I used TuneFS to enable writing data to the disk before writing to the journal. tunefs is a great tool for setting file system parameters.

Warning (snip from here): “I set the mode to journal_data_writeback. This basically means that data may be written to the disk before the journal. The data consistency guarantees are the same as the ext3 file system. The downside is that if your system crashes before the journal gets written then you may loose new data — the old data may magically reappear.”

Warning this can corrupt your data. More information here.

I ran this command.

I edited my fstab to append the “writeback,noatime,nodiratime” flags for my volume after a reboot.

Edit FS Tab:

I added “writeback,noatime,nodiratime” flags to my disk options.

Updating Ubuntu Packages

Show updatable packages

Update Packages

Unattended Security Updates

Read more on Ubuntu 18.04 Unattended upgrades here, here and here.

Install Unattended Upgrades

Enable Unattended Upgrades

Now I configure what packages not to auto update

Edit /etc/apt/apt.conf.d/50unattended-upgrades

Find “Unattended-Upgrade::Package-Blacklist” and add packages that you don’t want automatically updated, you may want to manually update these (and monitor updates).

I prefer not to auto-update critical system apps (I will do this myself).