Methodology · Updated 22 March 2026
How we test products
Every device that earns a star rating on this site has been through the same 25-point rubric, a 14-day minimum daily-use cycle and three independent reviewers. We publish the scorecards, sign them, and date-stamp every review.
25-point rubric
Five weighted criteria, scored 0–5 each.
14-day minimum
Daily-use cycle per reviewer, logged hourly.
No incentives
Units bought at retail. No supplier copy approval.
Signed & dated
Every scorecard carries a reviewer signature.
The 25-point rubric
| Criterion | Max | How we score it |
|---|---|---|
| Build & finish | 5 | Drop test from 1m onto hardwood, hinge/seal inspection, threading wear after 50 fill cycles. |
| Flavour consistency | 5 | Blind triangle test across 3 reviewers at puff #1, #500, #1500 and end-of-life. |
| Battery accuracy | 5 | Puff count to manufacturer claim measured with logging mouthpiece (±5% tolerance). |
| Leak & safety | 5 | 14-day daily-carry log, temperature cycling 5–40 °C, short-circuit & overcharge bench check. |
| Value | 5 | Cost per 1000 puffs / mL benchmarked against the 12-month category median. |
The lab — photos from our March 2026 round
Bench tests are run from our Collins Street office. Below: the puff-count logger, the climate-cycled carry log and the blind flavour panel sheets.
Testing walkthrough video
A 6-minute tour of the bench, the rubric and a worked example scoring a Uwell Caliburn G3.
Filmed 2026-03-20 · Hosted on YouTube · Replace embed ID with the production upload before launch.
Scorecards — 2026 round
Every row below is signed by the lead reviewer for that unit. Download the full CSV for raw scores.
| Product | Reviewer | Test window | Total | Verdict |
|---|---|---|---|---|
| IGET Bar Plus 6000 | Marcus Tan | 2026-02-03 → 2026-02-17 | 21.5 / 25 | Recommended |
| Alibarbar Crystal 7000 | Daniel Whitfield | 2026-02-04 → 2026-02-18 | 20.5 / 25 | Recommended |
| Uwell Caliburn G3 | Priya Naidu | 2026-02-10 → 2026-02-24 | 23.0 / 25 | Editor's Choice |
| Vaporesso XROS 4 | Marcus Tan | 2026-02-11 → 2026-02-25 | 22.0 / 25 | Recommended |
| SMOK Novo 5 | Daniel Whitfield | 2026-02-12 → 2026-02-26 | 20.0 / 25 | Recommended |
| Kuz Bar 9000 | Priya Naidu | 2026-03-01 → 2026-03-15 | 20.5 / 25 | Recommended |
| Uwell Crown X | Marcus Tan | 2026-03-02 → 2026-03-16 | 21.5 / 25 | Recommended |
| Starter Bundle (Pod) | Daniel Whitfield | 2026-03-08 → 2026-03-22 | 23.5 / 25 | Editor's Choice |
Reviewer sign-off
Each reviewer signs every scorecard they author. Signatures below are the same ones used on the downloadable PDF scorecards and on individual review pages.
Founder & Managing Director
Signed 2026-03-22
Head of Product & Compliance
Signed 2026-03-22
Senior Editor — Buying Guides
Signed 2026-03-22
Want the raw data?
The CSV includes per-criterion scores, leak counts, battery-accuracy percentages and pass/fail safety notes for every unit. Auditors, journalists and researchers are welcome to email hello@emberandcoil.com.au for the full PDF bundle with reviewer signatures.
Download CSV