This is quick guide explaining how I created my first JavaFX application using the Gluon Scene Builder in the IntelliJ IDEA IDE.
in
Creating your first Java FX app and using the Gluon Scene Builder in the IntelliJ IDEA IDE
This is quick guide explaining how I created my first JavaFX application using the Gluon Scene Builder in the IntelliJ IDEA IDE.
Advertisement:
I have a number of guides on moving away from CPanel, Setting up VM’s on UpCloud, AWS, Vultr or Digital Ocean along with installing and managing WordPress from the command line. I created this blog post on creating a Java GUI app with the older Swing technology (Java FX replaces Swing). I now want to create a JavaFX app to control my UpCloud VM’s.
If you have not read my previous posts I have now moved my blog etc to the awesome UpCloud host. Sign up using this link to get $25 free credit.
Do read: Preparing for JavaFX Application Development: https://wiki.openjdk.java.net/display/OpenJFX/Building+OpenJFX#BuildingOpenJFX-Mac
Downloading Java
Download and install Java SE 8 or higher from http://www.oracle.com/technetwork/java/javase/downloads/index.html
Download Intelli J IDEA IDE
Goto https://www.jetbrains.com/idea/
Click Download
Download the community edition
Install Intelli J IDEA IDE
Install Scenebuilder
I downloaded the Java Scene Builder (1.1 or 2.0) from here.
Install the Scene Builder (open the installer and drag it to your applications folder).
Configure the Scene Builder in IntelliJ IDEA IDE
- Open Intelli J IDEA IDE (set the default’s you wish)
- Create a New Project
- Open Intelli J IDEA IDE Preferences
- Open Languages & Frameworks then JavaFX and set your Scene Builder path (e.g /Applications/JavaFX Scene Builder 2.0.app/)
- Exit Preferences
You can now create a JavaFX project an have a workign scene builder GUI.
After you create a JavaFX project open your JavaFX fxml file in Scene Builder (right click on the .fxml file and select Open in Scene Builder)
Extended Scene Builder from Gluon
I read that there is a better Scene builder GUI available from https://gluonhq.com/products/scene-builder/
Read some of the Java Scene Builder v Gluon Scene Builder history here at Reddit for the latest on why.
I am going to download the Gluon Scene Builder from http://gluonhq.com/products/scene-builder/
Download and install the Gluon Scene builder (at the time of writing requires Java 9 or higher).
Now open IntelliJ IDEA IDE and open the preferences and change the scene builder path from “/Applications/JavaFX Scene Builder 2.0.app/” to “/Applications/SceneBuilder.app/“.
Save the IntelliJ IDEA preferences and Right click on your projects “fxml” file again and click “Open In Scene Builder” , do verify it is indeed the Gluon Scene builder by opening the about menu.
Designing your first JavaFX app
Now you can design and code a JavaFX application with Gluon Scene Builder.
I am not an expert at java apps so i’d highly recommend you follow this guide to learn how to build a well-structured JavaFX panel layout (just ignore that it is using the standard Scene Builder, it works with the gluon one).
You should now have a working Java FX App
The scene builder will save changes to your fxml file
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 | <?xml version="1.0" encoding="UTF-8"?> <?import javafx.geometry.Insets?> <?import javafx.scene.control.Button?> <?import javafx.scene.control.Label?> <?import javafx.scene.control.Menu?> <?import javafx.scene.control.MenuBar?> <?import javafx.scene.control.MenuItem?> <?import javafx.scene.control.TextArea?> <?import javafx.scene.control.TextField?> <?import javafx.scene.control.TreeView?> <?import javafx.scene.layout.BorderPane?> <?import javafx.scene.layout.HBox?> <?import javafx.scene.layout.Region?> <?import javafx.scene.layout.VBox?> <BorderPane maxHeight="-Infinity" maxWidth="-Infinity" minHeight="-Infinity" minWidth="-Infinity" prefHeight="400.0" prefWidth="600.0" xmlns="http://javafx.com/javafx/9.0.4" xmlns:fx="http://javafx.com/fxml/1" fx:controller="sample.Controller"> <top> <VBox BorderPane.alignment="CENTER"> <children> <MenuBar> <menus> <Menu mnemonicParsing="false" text="File"> <items> <MenuItem mnemonicParsing="false" text="Close" /> </items> </Menu> <Menu mnemonicParsing="false" text="Edit"> <items> <MenuItem mnemonicParsing="false" text="Delete" /> </items> </Menu> <Menu mnemonicParsing="false" text="Help"> <items> <MenuItem mnemonicParsing="false" text="About" /> </items> </Menu> </menus> </MenuBar> <HBox spacing="8.0"> <children> <TextField promptText="ip" /> <TextField promptText="Username" /> <TextField promptText="Password" /> <Button mnemonicParsing="false" onMouseClicked="#loginButtonClicked" prefHeight="27.0" prefWidth="68.0" text="Login" /> <Region HBox.hgrow="ALWAYS" /> <Button mnemonicParsing="false" onMouseClicked="#settingsButtonClicked" text="Settings" /> </children> <padding> <Insets bottom="8.0" left="8.0" right="8.0" top="8.0" /> </padding> </HBox> </children> </VBox> </top> <left> <TreeView prefHeight="200.0" prefWidth="200.0" BorderPane.alignment="CENTER" /> </left> <center> <TextArea prefHeight="200.0" prefWidth="200.0" BorderPane.alignment="CENTER" /> </center> <bottom> <HBox BorderPane.alignment="CENTER"> <children> <Label text="Label" /> </children> <padding> <Insets bottom="2.0" left="2.0" right="2.0" top="2.0" /> </padding> </HBox> </bottom> </BorderPane> |
Advertisement:
You can add functions into your controller class
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 | package sample; public class Controller { public void loginButtonClicked(){ System.out.println("Login"); } public void settingsButtonClicked(){ System.out.println("Settings"); } } |
Instaling Gluon JavaFX Templates
Close your test project and create a new project, but before you do click Configure then Plugins
Now lets open In the following screen click Browse Repositories.
Search the repository for and install the “Gluon” plugin
Restart IntelliJ IDEA IDE then you can use templates when creating a project.
Get your own VM
If you have not read my previous posts I have now moved my blog etc to the awesome UpCloud host. Sign up using this link to get $25 free credit.
Packaging a Java app for distribution on OSX
I will show how you can package your app to run on a Mac by using this.
Coming Soon
I will add more guides soon on using a custom JavaFx app to allow you to manage your own UpCloud server and perform Deploy/Init/Setup/Configure/Operate actions. Running CLI commands to deploy and manage a server is fun but is very tedious.
I blogged recently about using the UpCloud API and setting up a subdomain recently (I will use this server to test and prove the Javmanagementnt app).
Advertisement:
Links
- Official Javafx examples
- Official Java learning paths.
- Javafx examples at javacodegeeks.com
- Java widgets
- Reddit JavaHelp
- Jenkov Tutorials
I hope this guide helps someone.
Ask a question or recommend an article
Revision History
V1.6 Jenkov Tutorials
V1.5 Reddit java help
V1.4 added java widgets link
V1.3 added javafx examples link.
V1.2 added Java learning paths
V1.1 added offical Javafx examples
v1.0 Initial post
Open a Windows 10 Boot Camp Installation on OSX in Parallels (like a VM)
This guide will show you how you can open a Windows 10 Boot Camp Installation on OSX in Parallels (like a VM).
Advertisement:
Installing Parallels on a Mac allows you to install Windows in A VM, this is handy but you may want to install Windows on a Mac drive with Boot camp (guide here) for better performance.
Can you load this VM-less Windows install in OSX rather than reboot it, the answer is YES (with Parallels v13).
Setup your Windows Bootcamps (see my guide here).
Create a new VM image in Parallels (Select Boot Camp)
Click Continue
Confirm the reaction warning.
Name the VM and choose a location
Set desired memory etc.
Choose your desired clipboard and disk access settings.
Done, now Parallels will prepare your VM (Really Boot Camp)
Preparing
Parallel tools will be automatically installed.
Done, you will now be able to load your Apple Bootcamp partition as it is was a VM inside OSX (or boot it)
yes, the VM file is pointing to the Boot Camp partition.
I hope this guide helps someone.
Ask a question or recommend an article
Revision History
v1.0 Initial post
Deploying nodejs apps in the background and monitoring them with PM2 from keymetrics.io
This guide will help you install and setup the pm2 NodejJS process monitor PM2 from Keymetrics.io for free and manage your node apps performance and exceptions.
Advertisement:
What is PM2?
PM2 is a production process manager for Node.js applications with a built-in load balancer. It allows you to keep applications alive forever, to reload them without downtime and to facilitate common system admin tasks. This is the steps I used on Ubuntu 16.04. This is NOT a paid endorsement (just self-documenting).
Key Features of PM2
PM2 offers web-based monitoring dashboard, exception reporting, load balancer, CPU and memory monitoring, transaction tracer and much more for NodeJS apps.
What is PM2?
Official page: http://pm2.keymetrics.io/
More info https://www.npmjs.com/package/pm2
Install PM2
1 | npm install pm2 -g |
Install Output
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 | npm install pm2 -g /usr/bin/pm2 -> /usr/lib/node_modules/pm2/bin/pm2 /usr/bin/pm2-dev -> /usr/lib/node_modules/pm2/bin/pm2-dev /usr/bin/pm2-docker -> /usr/lib/node_modules/pm2/bin/pm2-docker /usr/bin/pm2-runtime -> /usr/lib/node_modules/pm2/bin/pm2-runtime /usr/lib └─┬ pm2@2.10.2 ├─┬ async@2.6.0 │ └── lodash@4.17.5 ├── blessed@0.1.81 ├─┬ chalk@1.1.3 │ ├── ansi-styles@2.2.1 │ ├── escape-string-regexp@1.0.5 │ ├─┬ has-ansi@2.0.0 │ │ └── ansi-regex@2.1.1 │ ├── strip-ansi@3.0.1 │ └── supports-color@2.0.0 ├─┬ chokidar@2.0.3 │ ├─┬ anymatch@2.0.0 │ │ └─┬ micromatch@3.1.10 │ │ ├── arr-diff@4.0.0 │ │ ├─┬ define-property@2.0.2 │ │ │ └─┬ is-descriptor@1.0.2 │ │ │ ├── is-accessor-descriptor@1.0.0 │ │ │ └── is-data-descriptor@1.0.0 │ │ ├─┬ extend-shallow@3.0.2 │ │ │ ├── assign-symbols@1.0.0 │ │ │ └─┬ is-extendable@1.0.1 │ │ │ └── is-plain-object@2.0.4 │ │ ├─┬ extglob@2.0.4 │ │ │ ├─┬ define-property@1.0.0 │ │ │ │ └─┬ is-descriptor@1.0.2 │ │ │ │ ├── is-accessor-descriptor@1.0.0 │ │ │ │ └── is-data-descriptor@1.0.0 │ │ │ ├─┬ expand-brackets@2.1.4 │ │ │ │ ├── debug@2.6.9 │ │ │ │ ├── define-property@0.2.5 │ │ │ │ ├── extend-shallow@2.0.1 │ │ │ │ └── posix-character-classes@0.1.1 │ │ │ └── extend-shallow@2.0.1 │ │ ├── fragment-cache@0.2.1 │ │ ├── kind-of@6.0.2 │ │ ├─┬ nanomatch@1.2.9 │ │ │ ├─┬ is-odd@2.0.0 │ │ │ │ └── is-number@4.0.0 │ │ │ └── is-windows@1.0.2 │ │ ├── object.pick@1.3.0 │ │ └── regex-not@1.0.2 │ ├── async-each@1.0.1 │ ├─┬ braces@2.3.2 │ │ ├── arr-flatten@1.1.0 │ │ ├── array-unique@0.3.2 │ │ ├─┬ extend-shallow@2.0.1 │ │ │ └── is-extendable@0.1.1 │ │ ├─┬ fill-range@4.0.0 │ │ │ ├── extend-shallow@2.0.1 │ │ │ ├─┬ is-number@3.0.0 │ │ │ │ └─┬ kind-of@3.2.2 │ │ │ │ └── is-buffer@1.1.6 │ │ │ ├── repeat-string@1.6.1 │ │ │ └── to-regex-range@2.1.1 │ │ ├── isobject@3.0.1 │ │ ├── repeat-element@1.1.2 │ │ ├─┬ snapdragon@0.8.2 │ │ │ ├─┬ base@0.11.2 │ │ │ │ ├─┬ cache-base@1.0.1 │ │ │ │ │ ├─┬ collection-visit@1.0.0 │ │ │ │ │ │ ├── map-visit@1.0.0 │ │ │ │ │ │ └── object-visit@1.0.1 │ │ │ │ │ ├── get-value@2.0.6 │ │ │ │ │ ├─┬ has-value@1.0.0 │ │ │ │ │ │ └─┬ has-values@1.0.0 │ │ │ │ │ │ └── kind-of@4.0.0 │ │ │ │ │ ├─┬ set-value@2.0.0 │ │ │ │ │ │ └── extend-shallow@2.0.1 │ │ │ │ │ ├─┬ to-object-path@0.3.0 │ │ │ │ │ │ └── kind-of@3.2.2 │ │ │ │ │ ├─┬ union-value@1.0.0 │ │ │ │ │ │ └─┬ set-value@0.4.3 │ │ │ │ │ │ └── extend-shallow@2.0.1 │ │ │ │ │ └─┬ unset-value@1.0.0 │ │ │ │ │ └─┬ has-value@0.3.1 │ │ │ │ │ ├── has-values@0.1.4 │ │ │ │ │ └── isobject@2.1.0 │ │ │ │ ├─┬ class-utils@0.3.6 │ │ │ │ │ ├── arr-union@3.1.0 │ │ │ │ │ ├── define-property@0.2.5 │ │ │ │ │ └─┬ static-extend@0.1.2 │ │ │ │ │ ├── define-property@0.2.5 │ │ │ │ │ └─┬ object-copy@0.1.0 │ │ │ │ │ ├── copy-descriptor@0.1.1 │ │ │ │ │ ├── define-property@0.2.5 │ │ │ │ │ └── kind-of@3.2.2 │ │ │ │ ├── component-emitter@1.2.1 │ │ │ │ ├─┬ define-property@1.0.0 │ │ │ │ │ └─┬ is-descriptor@1.0.2 │ │ │ │ │ ├── is-accessor-descriptor@1.0.0 │ │ │ │ │ └── is-data-descriptor@1.0.0 │ │ │ │ ├─┬ mixin-deep@1.3.1 │ │ │ │ │ ├── for-in@1.0.2 │ │ │ │ │ └── is-extendable@1.0.1 │ │ │ │ └── pascalcase@0.1.1 │ │ │ ├── debug@2.6.9 │ │ │ ├─┬ define-property@0.2.5 │ │ │ │ └─┬ is-descriptor@0.1.6 │ │ │ │ ├─┬ is-accessor-descriptor@0.1.6 │ │ │ │ │ └── kind-of@3.2.2 │ │ │ │ ├─┬ is-data-descriptor@0.1.4 │ │ │ │ │ └── kind-of@3.2.2 │ │ │ │ └── kind-of@5.1.0 │ │ │ ├── extend-shallow@2.0.1 │ │ │ ├── map-cache@0.2.2 │ │ │ ├── source-map@0.5.7 │ │ │ ├─┬ source-map-resolve@0.5.1 │ │ │ │ ├── atob@2.1.0 │ │ │ │ ├── decode-uri-component@0.2.0 │ │ │ │ ├── resolve-url@0.2.1 │ │ │ │ ├── source-map-url@0.4.0 │ │ │ │ └── urix@0.1.0 │ │ │ └── use@3.1.0 │ │ ├─┬ snapdragon-node@2.1.1 │ │ │ ├─┬ define-property@1.0.0 │ │ │ │ └─┬ is-descriptor@1.0.2 │ │ │ │ ├── is-accessor-descriptor@1.0.0 │ │ │ │ └── is-data-descriptor@1.0.0 │ │ │ └─┬ snapdragon-util@3.0.1 │ │ │ └── kind-of@3.2.2 │ │ ├── split-string@3.1.0 │ │ └─┬ to-regex@3.0.2 │ │ └─┬ safe-regex@1.1.0 │ │ └── ret@0.1.15 │ ├─┬ glob-parent@3.1.0 │ │ ├── is-glob@3.1.0 │ │ └── path-dirname@1.0.2 │ ├── inherits@2.0.3 │ ├─┬ is-binary-path@1.0.1 │ │ └── binary-extensions@1.11.0 │ ├─┬ is-glob@4.0.0 │ │ └── is-extglob@2.1.1 │ ├─┬ normalize-path@2.1.1 │ │ └── remove-trailing-separator@1.1.0 │ ├── path-is-absolute@1.0.1 │ ├─┬ readdirp@2.1.0 │ │ ├── graceful-fs@4.1.11 │ │ ├─┬ minimatch@3.0.4 │ │ │ └─┬ brace-expansion@1.1.11 │ │ │ ├── balanced-match@1.0.0 │ │ │ └── concat-map@0.0.1 │ │ ├─┬ readable-stream@2.3.6 │ │ │ ├── core-util-is@1.0.2 │ │ │ ├── isarray@1.0.0 │ │ │ ├── process-nextick-args@2.0.0 │ │ │ ├── safe-buffer@5.1.1 │ │ │ ├── string_decoder@1.1.1 │ │ │ └── util-deprecate@1.0.2 │ │ └── set-immediate-shim@1.0.1 │ └── upath@1.0.4 ├── cli-table-redemption@1.0.1 ├── commander@2.13.0 ├─┬ cron@1.3.0 │ └── moment-timezone@0.5.14 ├─┬ debug@3.1.0 │ └── ms@2.0.0 ├── eventemitter2@1.0.5 ├── fclone@1.0.11 ├── gkt@1.0.0 ├─┬ mkdirp@0.5.1 │ └── minimist@0.0.8 ├── moment@2.22.0 ├─┬ needle@2.2.0 │ ├── debug@2.6.9 │ ├─┬ iconv-lite@0.4.21 │ │ └── safer-buffer@2.1.2 │ └── sax@1.2.4 ├─┬ nssocket@0.6.0 │ ├── eventemitter2@0.4.14 │ └── lazy@1.0.11 ├── pidusage@1.2.0 ├─┬ pm2-axon@3.1.0 │ ├── amp@0.3.1 │ ├── amp-message@0.1.2 │ └── escape-regexp@0.0.1 ├── pm2-axon-rpc@0.5.0 ├─┬ pm2-deploy@0.3.9 │ ├── async@1.5.2 │ └── tv4@1.3.0 ├─┬ pm2-multimeter@0.1.2 │ └── charm@0.1.2 ├─┬ pmx@1.6.4 │ ├── deep-metrics@0.0.1 │ ├── json-stringify-safe@5.0.1 │ └─┬ vxx@1.2.2 │ ├─┬ continuation-local-storage@3.2.1 │ │ ├── async-listener@0.6.9 │ │ └── emitter-listener@1.1.1 │ ├── debug@2.6.9 │ ├── extend@3.0.1 │ ├── is@3.2.1 │ ├── lodash.findindex@4.6.0 │ ├── lodash.isequal@4.5.0 │ ├── lodash.merge@4.6.1 │ ├── methods@1.1.2 │ ├── shimmer@1.2.0 │ └── uuid@3.2.1 ├─┬ promptly@2.2.0 │ └─┬ read@1.0.7 │ └── mute-stream@0.0.7 ├── semver@5.5.0 ├─┬ shelljs@0.7.8 │ ├─┬ glob@7.1.2 │ │ ├── fs.realpath@1.0.0 │ │ ├─┬ inflight@1.0.6 │ │ │ └── wrappy@1.0.2 │ │ └── once@1.4.0 │ ├── interpret@1.1.0 │ └─┬ rechoir@0.6.2 │ └─┬ resolve@1.7.0 │ └── path-parse@1.0.5 ├─┬ source-map-support@0.5.4 │ └── source-map@0.6.1 ├── sprintf-js@1.1.1 ├── v8-compile-cache@1.1.2 ├─┬ vizion@0.2.13 │ └── async@1.5.2 └─┬ yamljs@0.3.0 └─┬ argparse@1.0.10 └── sprintf-js@1.0.3 |
PM2 Pricing
PM2 appears to be for high-end apps but I am only using the free version or PM2 (thanks KeyMetrics)
Create a bucket for your node app
Login to keymetrics.io,
Click Generate New Bucket
Give the bucket a name etc.
You can now link your bucket with your local pm2 installation (keep the keys private (this one no longer exists))
Linking your local pm2 installation with your keymetrics bucket
1 2 3 | pm2 link l3brztzboz25him i6kofelsyfo7xrd [KM] Connecting [Monitoring Enabled] Dashboard access: https://app.keymetrics.io/#/r/i6kofelsyfo7xrd |
To add an existing node app to PM2 type the following.
1 2 | cd /your-node-application-path/ pm2 start yourapp.js -i 0 --name "myappname" |
You can view node apps that pm2 is managing by typing
1 | pm2 status |
I had a two CPU VM and I found that the app I added was added to each of the two CPU (I only needed one) so I needed to delete the second app on my second core
1 | pm2 delete 1 |
Restart the API
1 | pm2 restart myappname |
You can add a single node apps one 1, 3 or max available CPU’s
1 2 3 4 5 6 7 8 | # Start the maximum processes depending on available CPUs pm2 start app.js -i 0 # Start the maximum processes -1 depending on available CPUs pm2 start app.js -i -1 # Start 3 processes pm2 start app.js -i 3 |
Again, to add an existing node app to PM2 type the following.
1 2 | cd /your-node-application-path/ pm2 start yourapp.js -i 0 --name "myappname" |
Now you can view node app data online. If you don’t have a node app ready you can use the test app.
You can monitor your node app locally too from the CLI.
You can also view a demo bucket at keymetrix.io
PM2’s one age documentation can be found here.
I hope this guide helps someone.
Ask a question or recommend an article
Revision History
v1.0 Initial post
Upgrading the RAM, CPU and Memory on a Vultr Ubuntu VM in the cloud
Upgrading the RAM, CPU and Memory on a Vultr Ubuntu VM in the cloud is quite simple.
Advertisement:
I have a number of guides on moving hasting away form CPanel, Setting up VM’s on AWS, Vultr or Digital Ocean along with installing and managing WordPress from the command line. I prefer Vultr as they are located in the country (Australia) and are easy to use.
First, you need to shut down the server from within the VM (SSH), I used the command.
1 | sudo shutdown now |
Once the VM is shut down (wait a few minutes) you can turn off the VM in the Vultr GUI.
You can then go to Settings, Change Plan and review upgrade options.
Snapshot
Don’t forget to take a final snapshot.
Goto the Snapshots page (read this guide to restore a snapshot) and click Take Snapshot.
You can see snapshot progress on the main screen.
It may take a while for your snapshot to change from Pending to Processing.
Upgrade
When the snapshot is done it will auto boot and allow you to upgrade.
Choose the Upgrade specifications (Settings, Change Plan)
Click Upgrade
Confirm
The upgrade process will take a few minutes (I could see the CU and Ram was updated but the Storage was pending)
Testing
After the upgrade happened the VM will autoboot, login and check tour specifications (Useful Linux Commands).
I use the htop command to view specification information.
I did a quick benchmark pre-optimizing and I can see a speed bump of 0.2s. Time to optimize.
I threw 50 concurrent clients at my website (with loader.io) and the server handled it fine with no increase above memory capacity like before.
Optimize
Now I need to Optimize. Truth be told I did optimize and harden PHP and crashed PHP-FPM so I had o restore a VM snapshot.
Troubleshooting
If all else fails (post-upgrade configuration) you can restore the Vultr VM from a snapshot.
I hope this guide helps someone.
P.S If you don’t have a VM on Vultr click this link to set one up in minutes (setup guide here).
Ask a question or recommend an article
Revision History
v1.0 Initial post
How to setup PHP FPM on demand child workers in PHP 7.x to increase website traffic
This blog post will show you how to setup PHP FPM on-demand child workers in PHP 7.x to increase website traffic.
Advertisement:
My blog was experiencing a number of slow page loads and often running “sudo service php7.0-fpm restart” would resolve the problem. I have blogged before about setting up Ubuntu Servers on AWS, Digital Ocean and Vultr but this post is about debugging and speeding up PHP on Ubuntu self-managed servers.
Background
I tried the normal tweaks in “/etc/php/7.0/fpm/php.ini” like
1 | memory_limit = 512M |
I setup servers like this.
Temporary Fix
I had even set up a temporary NGINX and php7.0-fpm restart ever 5 and 1-minute respectively until I had time to look into this.
1 2 | */5 * * * * /etc/init.d/nginx restart * * * * * sudo service php7.0-fpm restart |
Debug
I checked out the PHP7.0-fpm.log and I found the following
1 2 3 4 5 6 7 8 9 | [25-Feb-2018 16:35:35] WARNING: [pool www] server reached pm.max_children setting (5), consider raising it [25-Feb-2018 17:02:26] WARNING: [pool www] server reached pm.max_children setting (5), consider raising it [25-Feb-2018 17:51:09] WARNING: [pool www] server reached pm.max_children setting (5), consider raising it [25-Feb-2018 18:18:51] WARNING: [pool www] server reached pm.max_children setting (5), consider raising it [25-Feb-2018 20:58:12] WARNING: [pool www] server reached pm.max_children setting (5), consider raising it [25-Feb-2018 21:02:57] WARNING: [pool www] server reached pm.max_children setting (5), consider raising it [25-Feb-2018 21:30:58] WARNING: [pool www] server reached pm.max_children setting (5), consider raising it [25-Feb-2018 21:35:10] WARNING: [pool www] server reached pm.max_children setting (5), consider raising it [25-Feb-2018 23:36:28] WARNING: [pool www] server reached pm.max_children setting (5), consider raising it |
Setting up a PHP-FPM pool
Read the official guide here on configuring PHP FPM pools etc.
I edited “/etc/php/7.0/fpm/pool.d/www.conf” and added the following to set up a pool of PHP-FPM servers.
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 | ; Note: This value is mandatory. pm = dynamic ; The number ocf child processes to be created when pm is set to 'static' and the ; maximum number of child processes when pm is set to 'dynamic' or 'ondemand'. ; This value sets the limit on the number of simultaneous requests that will be ; served. Equivalent to the ApacheMaxClients directive with mpm_prefork. ; Equivalent to the PHP_FCGI_CHILDREN environment variable in the original PHP ; CGI. The below defaults are based on a server without much resources. Don't ; forget to tweak pm.* to fit your needs. ; Note: Used when pm is set to 'static', 'dynamic' or 'ondemand' ; Note: This value is mandatory. pm.max_children = 40 ; The number of child processes created on startup. ; Note: Used only when pm is set to 'dynamic' ; Default Value: min_spare_servers + (max_spare_servers - min_spare_servers) / 2 pm.start_servers = 10 ; The desired minimum number of idle server processes. ; Note: Used only when pm is set to 'dynamic' ; Note: Mandatory when pm is set to 'dynamic' pm.min_spare_servers = 5 ; The number of seconds after which an idle process will be killed. ; Note: Used only when pm is set to 'ondemand' ; Default Value: 10s pm.process_idle_timeout = 30s; ; The number of requests each child process should execute before respawning. ; This can be useful to work around memory leaks in 3rd party libraries. For ; endless request processing specify '0'. Equivalent to PHP_FCGI_MAX_REQUESTS. ; Default Value: 0 pm.max_requests = 250 |
You may need more or fewer child processes depending on your needs and free memory.
After editing the PHP-FPM config file restart PHP-FPM
1 | sudo service php7.0-fpm restart |
Restart Nginx
1 | sudo /etc/init.d/nginx restart |
You will be able to view the PHP child process status by typing the following
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 | service php7.0-fpm status ● php7.0-fpm.service - The PHP 7.0 FastCGI Process Manager Loaded: loaded (/lib/systemd/system/php7.0-fpm.service; enabled; vendor preset: enabled) Active: active (running) since Mon 2018-02-26 00:33:17 AEDT; 5min ago Docs: man:php-fpm7.0(8) Main PID: 1284 (php-fpm7.0) Status: "Processes active: 0, idle: 10, Requests: 56, slow: 0, Traffic: 0.2req/sec" Tasks: 11 Memory: 330.1M CPU: 39.558s CGroup: /system.slice/php7.0-fpm.service ├─1284 php-fpm: master process (/etc/php/7.0/fpm/php-fpm.conf) ├─1503 php-fpm: pool www ├─1504 php-fpm: pool www ├─1505 php-fpm: pool www ├─1506 php-fpm: pool www ├─1507 php-fpm: pool www ├─1508 php-fpm: pool www ├─1509 php-fpm: pool www ├─1511 php-fpm: pool www ├─1512 php-fpm: pool www └─1513 php-fpm: pool www Feb 25 10:33:16 servername systemd[1]: Starting The PHP 7.0 FastCGI Process Manager... Feb 25 10:33:17 servername systemd[1]: Started The PHP 7.0 FastCGI Process Manager. |
You can use htop (commands here) to see child PHP processes in the pool and to verify free memory.
This command is good for watching free memory on a server
1 | watch -n 1 'free -m' |
I prefer to use up free memory (if available) and leave about 100mb free.
1 2 3 4 5 | Every 1.0s: free -m Mon Feb 26 00:47:55 2018 total used free shared buff/cache available Mem: 992 518 120 40 353 280 Swap: 0 0 0 |
Hope this helps someone.
Donate and make this blog better
Ask a question or recommend an article
Revision History
v1.0 Initial Post
OSX speed tested before applying Spectre and Meltdown patches in 10.13.2
Below is a quick post of how OSX speed fairs before and after application of the OSX 10.13.2 update (that fixed Spectre and Meltdown CPU issues).
Advertisement:
I read of up to 30% speed drops with Redis after Spectre and Meltdown patches and was curious how OSX faired.
Here’s what happened last night to one of our busier redis servers before and after patching for meltdown. Using the same 200k/12 minute axes on both: down from ~145k ops/sec to ~95ks ops/sec, or about 35% slower. pic.twitter.com/H6sM0C5i1V
— Nick Craver (@Nick_Craver) January 12, 2018
News
MacOS High Sierra 10.13.2 Update Released with Bug Fixes
Patches
macOS High Sierra 10.13.2 Combo Update + Supplement Update
Benchmarks (before applying patches)
Here are Cinebench R15 benchmarks on OSX 10.13.1 before upgrading to 10.13.2 on a 2-year-old core i5 based iMac.
High Sierra 10.13.1, Cinebench R15 and TG Pro running in the background.
CPU: 490 cb points.
Now time to test the GPU in Cinebench…
GPU: 79.33 fps.
Now time to run a Geekbench CPU benchmark.
Here is a breakdown of the scores (2 mins after a fresh reboot and the best of three runs).
Geekbench Single-Core Score: 4433
Geekbench Multi-Core Score: 13,005
Here is a breakdown of advanced GeekBench tests…
I tried to update to 10.3.2 via the software updates but my network was having troubles (human error, my firewall was too aggressive)
I downloaded the manual 10.13.2 update from Apple (not realising my firewall was blocking the app updates (I blocked app updated as soon as spectre news hit so I could write this post)).
I downloaded and opened the 2.8GB 10.13.2 update.
PKG was extracted from the DMG.
10.13.2 Installation Wizard.
I solved my networking issues (disable my firewall) and was able to verify the installation of the 10.13.2 patch and download further 10.13.2 supplemental updates.
I verified all 10.13.2 updates were downloaded and installed and rebooted three times.
2 Minutes after a reboot I ran the same Cinebench R15 CPU benchmark.
CPU: 484 cb
Cinebench R15 CPU dropped about 6 points (about a 1.22448979591837% drop, not massive)
Geek bench Single CPU scores fell from 4433 to 4194 (about 5.436498984886081% slower, not as bad as I expected).
Geek Bench Multi CPU scores fell from 13,005 to 12,868 (about 1.053440984236832% slower, not as bad as I expected).
Versions of Software
Cinebench R15
Geek Bench
Results
Cinebench CPU
Graphs are unfortunately zoomed in (I could not find out how to tell Excel to zoom out). I will update when I find out how to zoom out results.
Green/Left = OSX 10.3.1.
Blue/Right = OSX 10.3.2 (post Spectre/Meltdown Patch).
Cinebench GPU
Green/Left = OSX 10.3.1.
Blue/Right = OSX 10.3.2 (post Spectre/Meltdown Patch).
Geekbench Single CPU
Green/Left = OSX 10.3.1.
Blue/Right = OSX 10.3.2 (post Spectre/Meltdown Patch).
Geekbench Multi CPU
Green/Left = OSX 10.3.1.
Blue/Right = OSX 10.3.2 (pst Spectre/Meltdown Patch.
Geekbench Other
Green= OSX 10.3.1.
Blue = OSX 10.3.2 (post Spectre/Meltdown Patch).
Note: Most results were slightly slower but some were faster post patch.
Conclusion
It looks like performance falls 1-5% on a 2 year old system, not as bad as I was expecting.
Donate and make this blog better
Ask a question or recommend an article
Revision History
v1.0 Initial Draft
Hope this helps someone.
Security checklist for securing a self-managed Ubuntu server in the cloud
Below is a (perpetually updated) security checklist for securing a self-managed Ubuntu server. Recently WordPress released patch v4.8.3 that fixed some SQL injection issues. Is your OS, Database, Web Server, OS and software up to date?
Advertisement:
Although I have recently blogged about securing Ubuntu in the cloud, and running a server Audit with Lynus, this new post is really about obtaining a mindset change and allocating time (each week) to ensure your self-managed servers and software is kept up to date. You can easily list down the actions you need to follow but keeping a system up to date is hard work. Sites like www.shodan.io will reveal what servers or services are vulnerable, let software updates lapse long enough and an open exploit may open a hole to your system. It only takes minutes to set up a $2.5 a month Ubuntu server with Vultr, $5 a month Digital Ocean Server or AWS server but you need to maintain it.
I highly recommend that you watch the following video that highlights the need for even minor vulnerabilities to be patched asap. If you leave one minor vulnerability open you will give hackers a foothold into your system.
Follow @jawache on twitter.
Troy Hunt has a great post about the simplicity of hacking. Hacking is child’s play.
General Security Checklist
- Do Setup a Firewall and only allow needed ports to accept data (use tools like Portscan and Shodan.io to find open ports).
- Use least access permissions (on NGINX, PHP and MySQL processes).
- Use strong unique passwords for every service (1Password and sites like Gibson Research Corp have password generators, use www.howsecureismypassword.net to check tour passwords strength)
- Enable logging.
Find log files on your system:
1 2 | cd / find -iname "*.log" |
Output (handy logs to review):
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 | ./var/log/mongodb/mongod.log ./var/log/fail2ban.log ./var/log/mysql/error.log ./var/log/ufw.log ./var/log/lynis.log ./var/log/dpkg.log ./var/log/nginx/error.log ./var/log/nginx/nginxcriterror.log ./var/log/nginx/access.log ./var/log/audit/audit.log ./var/log/php7.0-fpm.log ./var/log/mail.log ./backup/backup.log ./scripts/boot.log etc |
- Enable brute force detection and banning (fail2ban etc) Read more here.
- Secure folders with service accounts.
- Do secure software (e.g WordPress Wordfence)
- Do use SSL Certificates (and use modern cyphers and test with https://www.ssllabs.com/ssltest/)
- Monitor SSL vulnerabilities.
- Do a Lynis security report.
- Install a Virus scanner (read here).
- Secure MySQL/Databases.
First, find the version of MySQL
1 2 | mysql --version mysql Ver 14.14 Distrib 5.7.19, for Linux (x86_64) |
Read the official MySQL manual here and security guidelines here.
Read this Digital Ocean guide on securing MySQL.
- Other: _______
Application (coding) checklist
Retain and protect information.
- Disable errors (PHP: turn off or here)
- Enable logging (web server, PHP and or node)
- Sanitize data (never trust uses data) in code (see how to do this in PHP 7)
- Do no develop on production boxes (use parameterised queries and follow OWASP application security procedures.
- Read the OWASP Secure Coding Practices – Quick Reference Guide
Infrastructure
Plan for the worst, hope for the best.
- Use the latest Long Term Support (LTS) version or Ubuntu
- Update packages
View app packages (Ubuntu 16.04) with updates
1 | sudo /usr/lib/update-notifier/apt-check -p |
View app packages (Ubuntu 16.04) with updates
1 | apt list --upgradable |
To update packages type (remember to backup data and config files first)
1 | sudo apt-get update && sudo apt-get upgrade |
Among other things, you will see the following information
1 2 3 4 5 6 7 | The following packages will be upgraded: binutils certbot cracklib-runtime curl distro-info-data grub-common grub-pc grub-pc-bin grub2-common initramfs-tools initramfs-tools-bin initramfs-tools-core libapache2-mod-php7.0 libcrack2 libcurl3 libcurl3-gnutls libgnutls-openssl27 libgnutls30 libicu55 libpam-systemd libsystemd0 libudev1 linux-firmware linux-libc-dev lshw mdadm mysql-client-5.7 mysql-client-core-5.7 mysql-common mysql-server mysql-server-5.7 mysql-server-core-5.7 nodejs php7.0 php7.0-cli php7.0-common php7.0-curl php7.0-dev php7.0-fpm php7.0-gd php7.0-imap php7.0-intl php7.0-json php7.0-ldap php7.0-mbstring php7.0-mysql php7.0-opcache php7.0-pgsql php7.0-phpdbg php7.0-pspell php7.0-readline php7.0-recode php7.0-snmp php7.0-tidy php7.0-xml php7.0-zip python-acme python-certbot python-certbot-nginx python-cffi-backend python-chardet python-idna python-six python3-chardet python3-distupgrade python3-six python3-update-manager systemd systemd-sysv ubuntu-release-upgrader-core udev update-manager-core wget |
Show available updates
1 2 3 | /usr/lib/update-notifier/apt-check --human-readable 0 packages can be updated. 0 updates are security updates. |
- Only work on code checked into GitHub or BitBucket (You will thank me when data or servers disappear).
- Backup configuration files or backup to remote servers (my rsync guide here)
- Use snapshots of VM’s.
- Use Green/Blue server deployments (toggle one server a Prod and the other and Dev/Test and have one ready for a hot spare). Digital Ocean has a good guide here.
- Consider forcing Content Security Polic and Public Key Pinning or at least using LetsEncrypt SSL certificates.
- Take Snapshots of VM’s (automate)
- Backup MySQL databases:
1 | sudo mysqldump --all-databases > /backup/dump-$( date '+%Y-%m-%d_%H-%M-%S' ).sql -u root -p |
Other Useful Linus Terminal Commands.
Mindset/Culture
Dedicate time to securing your site.
- Spend one day a week (or automate) the updating of the OS/Software (no excuses).
- Follow people on twitter and subscribe to newsletters of those that are security conscious
Don’t forget to read securing Ubuntu in the cloud blog post here.
And check out the extensive Hardening a Linux Server guide at thecloud.org.uk: https://thecloud.org.uk/wiki/index.php?title=Hardening_a_Linux_Server
More to come..
Donate and make this blog better
Ask a question or recommend an article
v1.2 added link to Hardening Linux Server link
v1.1 added @jawache link
Short (Article):