Wanting to Test Vacuums

VacuumLand – Vintage & Modern Vacuum Enthusiasts

Help Support VacuumLand:

I'll leave you to evidence the details and specifics of this convincingly (it never happens with this type of cookie-cutter response). It's too easy to play cosmetic contrarian. I provide evidence, then cite it—because that's why I provided it, then you claim I can't credibly cite my evidence for <no reason stated>. Absurd logic. Then you claim there are inaccurate claims, yet evidence none. If only you had credibility to lose after hollow smear comments like this.
Your responses are the cookie cutter ones. That’s the whole freaking point here.

When you are challenged to provide actual evidence on these matters you simply post circular links back to the same exact materials that are being questioned.

Want evidence? Look at your own posts.
 
Why does this have to be such a debate. A vacuum needs lots of air moving at a decent speed. You need air moving at a point above the limit of airflow for that orifice size. Pressure then forces the air quicker.
You're right. It became a debate here when directed attacks via false claims were made that needed defending...and ultimately weren't, naturally. It had already been fully answered here.
 
You're right. It became a debate here when directed attacks via false claims were made that needed defending...and ultimately weren't, naturally. It had already been fully answered here.
Sounds like maybe someone is in fact motivated by “clicks and profits,”
The worst are motivated by clicks and profit on social media. It doesn't have to be this way.
Explaining it again for you: You continually link your own material to dodge others questions. Often you could easily respond with a sentence or two in good faith versus sending someone down a wild goose chase that frequently doesn’t answer the question anyway.
 
There's no need to quantify airflow at all, for the most part, and it should be done professionally using an orifice plate as discussed elsewhere if anyone wants to be taken seriously. Not a single 'enthusiast' has done it correctly that I've seen, and as professional engineers do in industry for example. That tells you everything you need to know about where you should NOT be looking for any advice. Everyone should understand all this by now since the resources are available to learn how these machines work, and it reveals a lot about where help simply can't be provided fruitfully anymore. I suspect the lurkers understand, and at 23k views, there are a lot of them on topics of interest to them.
So we should only measure suction?
 
Exactly, cheesewonton.
I still recall when I was a kid agitation came from arm muscles. We had a 1957 ( I believe ) Lewyt Big Wheel and I remember my mom scrubbing the carpets with that suction only floor nozzle like she was scrubbing a really dirty floor with a bristle brush, or holy stoning the teak deck of an old warship. I mean serious hard scrubbing, not just letting the nozzle glide over the carpet. That cleaned nothing. It was hard sweaty work. Flopping the rug over the clothes line and beating it with a broom stick was almost easier. And unlike the ads from that era she sure as heck wasn't wearing a dress, earrings and high heels !
 
Nah, cleaning performance and cleaning efficiency is more important. It's how vacuums have to effectively and efficiently use its airflow and suction. Ask @Vacuum Facts
The same vacuum with a suction only floor nozzle cleans, or should I say doesn't clean, much differently than it does with an electric power nozzle on the end of the wand. Agitation matters greatly.
 
Okay... So did anyone (else) try to properly measure actual cleaning performance?
Only the laboratories can measure it to industry standards. As long as you have a representative and reproducible method, you can make relative comparisons, which I do. Frickhelm probably fits that bill as he shows the trends you'd expect, and his results are consistent with mine, showing independent reproduction to some degree. There are issues though with some of the new technologies in the V16 that render both our testing insufficient for that particular machine, as you'll find out in my review. That's a problem for me because I'm not quite sure what to do about it yet. I have some ideas, but I'm too busy at the moment to work on it as a hobby. The V16 is amazing though, but also a victim of itself, uniquely.
 
Only the laboratories can measure it to industry standards. As long as you have a representative and reproducible method, you can make relative comparisons, which I do. Frickhelm probably fits that bill as he shows the trends you'd expect, and his results are consistent with mine, showing independent reproduction to some degree.
@Vacuum Facts, so your and @frickhelm 's method(s) is(/are) the best, because it's (both) consistent, reproducible and representative, similar to laboratories' standard, but accessible and doable at home, especially if you have backed carpets (not shaggy rugs as Kirby fans would've suggested). Too bad reviewers focused on doing the big mess tests which are not representative. Such reproducible-yet-representative tests like yours should be the gold standard in YouTube vacuum cleaner reviews and tests, not the afterthought it currently is.
There are issues though with some of the new technologies in the V16 that render both our testing insufficient for that particular machine, as you'll find out in my review. That's a problem for me because I'm not quite sure what to do about it yet. I have some ideas, but I'm too busy at the moment to work on it as a hobby. The V16 is amazing though, but also a victim of itself, uniquely.
Yep, V16 is a tragic machine. It's precisely as my hypothetical review of it would describe. Too bad you refused to give away the true problems for us. But we do know the cause of all its sudden deficiency in performance as you and @frickhelm noticed: it has to do with Dyson brand's stupid recklessness. It's ridiculous and too dupe-like of them to launch the V16 in such crippling state.
 
Only the laboratories can measure it to industry standards. As long as you have a representative and reproducible method, you can make relative comparisons, which I do. Frickhelm probably fits that bill as he shows the trends you'd expect, and his results are consistent with mine, showing independent reproduction to some degree. There are issues though with some of the new technologies in the V16 that render both our testing insufficient for that particular machine, as you'll find out in my review. That's a problem for me because I'm not quite sure what to do about it yet. I have some ideas, but I'm too busy at the moment to work on it as a hobby. The V16 is amazing though, but also a victim of itself, uniquely.
Ok then, test a Sebo G4 or BS36, Lux D820 and something from Lindhause like a Healthcare Pro or Diamante. Compare them to the bagless vacuums. Test a modern Miele too. Don't be afraid.
 
What makes @Vacuum Facts and @frickhelm testing methods more representative than many of the other tests we see on the web? Please note I am not attempting to disparaging either of these tests.

There are two parts here to my question:

1. I don't know where the exact details of either's methodology are described. I do recall seeing @Vacuum Facts on one of his videos but I don't recall which one and the details, I think he does specify and demonstrate the method.
-But are all variables known; ie specifics on carpet, measuring technique(s), etc? To produce 'gold standard laboratory results' that are truly repeatable all possible variables must be controlled. One example of this is the exact specifics of the carpet being used for the test. A different make/type/etc used across testing/testors can have drastic effect on the results. I am not sure this particular one is realistically controllable.

2. The test dust: It is a good but not perfect 'real world representative,' since what I have found from one of @frickhelm video (linked here:

details on dust at approx 0:25 to 0:27) it is 90-200 microns. However, the issue I see is that isn't truly representative of all household dust and debris a vacuum will be tasked with cleaning.

-One example is Cat litter, anyone with a cat/cat litter box knows they manage to track bits of litter wherever the cats may roam.
"The typical particle size for most cat litter ranges from 250 microns to 2,500 microns (0.25 mm to 2.5 mm).
-(from a google AI search results of "cat litter size in microns")
-Another example of larger material is breakfast cereal. Anyone with children will understand this one.

These are simple examples of why I personally find value in the oft disparaged 'big mess tests' as these materials are often in these tests. Note I am not in anyway claiming these 'big mess tests' are "consistent, reproducible and representative" or preferred to @Vacuum Facts & @frickhelm methods. The 'big mess tests' are just more 'data points' in vacuum machine performance/capabilities.
 
Ok then, test a Sebo G4 or BS36, Lux D820 and something from Lindhause like a Healthcare Pro or Diamante. Compare them to the bagless vacuums. Test a modern Miele too. Don't be afraid.
He tested a Sebo Felix and found it very hard to disparage the actual cleaning results.

But found plenty of what he may claim as "objective" issues with the machine, including calling it "junk."

 
He tested a Sebo Felix and found it very hard to disparage the actual cleaning results.

But found plenty of what he may claim as "objective" issues with the machine, including calling it "junk."


I might not disagree. I have an exceedingly low opinion of the Felix and Dart from a usability standpoint. I don't like the high handle weight. The swivel nozzle that works so well with a canister hose and wand is much harder to handle when you have all the weight of the vacuum to control and I am not really fond of the thing blowing hot air on me. Oh yeah, the hose is not so nice either, the whole machine topples over much too easily and no built in spotting wand. For an extra hundred bucks I'll take a G4 any day.
 
Too bad you refused to give away the true problems for us.
Too bad no one has deduced it for themselves. The information needed is freely out there now. Very disheartening for me. I've explained why I'm tight-lipped several times already. It's not a secret as such, it's just a tool I'll use to expose everything wrong with the internet, social media, and 'reviewers' out there come my review. It would have been out day 1 if Dyson hadn't decided to drag the V16's release out, globally, over a year.

Ok then, test a Sebo G4 or BS36, Lux D820 and something from Lindhause like a Healthcare Pro or Diamante. Compare them to the bagless vacuums. Test a modern Miele too. Don't be afraid.
I've tested many machines, including Sebos and Henrys and Kirbys, and plenty of others people just like you said should be tested. Most machines can easily brute force good performance. That's not the issue. The issue is that Dyson are achieving incredible performance under real world conditions using ever less energy. The V16 is amazing in this regard...not that you can tell due to their simultaneous mistakes that completely mask any of this.

What makes @Vacuum Facts and @frickhelm testing methods more representative than many of the other tests we see on the web? Please note I am not attempting to disparaging either of these tests.
Four fairly simple reasons. Firstly, the tests are fairly real-world representative—not stupid exaggerated building site tests which fall victim to the faulty logic that if a machine can clean the bulk of a big mess well, it can clean the remainder of a relatively smaller residual, more real-world mess well (and the converse)...just not true for reasons discussed in my lecture no one watched. This amongst other representative steps taken. Secondly, the testing quantifies dirt removal trends and shows their behaviour is in line with expectations of first order systems. Thirdly, the test result trends are reproducible and consistent, allowing fair testing. Finally, they don't suffer from obvious experimental weaknesses to the limits of what can be achieved outside a laboratory that anyone barely out of their PhD could spot. The V16 creates some new weaknesses with the methods I've seen (and use), which are tough to address without throwing away old data for comparison...more in my eventual review...
 
Four fairly simple reasons. Firstly, the tests are fairly real-world representative—not stupid exaggerated building site tests which fall victim to the faulty logic that if a machine can clean the bulk of a big mess well, it can clean the remainder of a relatively smaller residual, more real-world mess well (and the converse)...just not true for reasons discussed in my lecture no one watched. This amongst other representative steps taken. Secondly, the testing quantifies dirt removal trends and shows their behaviour is in line with expectations of first order systems. Thirdly, the test result trends are reproducible and consistent, allowing fair testing. Finally, they don't suffer from obvious experimental weaknesses to the limits of what can be achieved outside a laboratory that anyone barely out of their PhD could spot. The V16 creates some new weaknesses with the methods I've seen (and use), which are tough to address without throwing away old data for comparison...more in my eventual review...
With the 'big mess tests' I pretty much agree. Where I don't agree is using that 'certified dust' alone is representative of real world use either. I do think there is value in some of the other testing what I will call "little mess testing" where (relatively) small amounts of various materials are spread out to demonstrate/test how well they pick them up. (note I am not claiming these are done scientifically, or are in anyway superior to other methods of testing such as yours. In fact I would claim the opposite, these "little mess tests" are simple demonstrations but can still provide information on cleaning performance.)

Your method isn't faulty; that is not what I am claiming. What I am claiming is:
  1. It isn't exactly reproducible (for others to do) as the identical testbed carpet is very likely not available to everyone who would like to reproduce the results. This of course is true for all the other tests/demonstrations short of full blown labratory testing.
  2. More importantly it is what I have already mentioned regarding the certified test dust. It is not wholly representative of the types of debris a vacuum may encounter under regular use.
But to digress, as I believe we all agree on here, short of full blown laboratory testing (or demonstrating) in any form is going to have shortcomings; that none of them should be relied upon as final judgments to a machine's overall effectiveness.
 
There's actually one small, simple hack to the Shark Navigator that makes it the best vacuum possible. More power than central vacuums, lighter than stick vacuums, higher capacity than shop vacuums... It's a shame they released it in such a state. It's such an easy fix to make, anyone could do it at home.

I'm not going to tell you though, for reasons. Just trust me bro.

@Absolute Rainbow
 
Where I don't agree is using that 'certified dust' alone is representative of real world use either.
Me too. I don't use certified dust (because it's expensive). But you understand why certified dust exists, though, right? If not, go read up on it, understand what it represents and why, and understand why that's important for a vacuum cleaner.

I do think there is value in some of the other testing what I will call "little mess testing" where (relatively) small amounts of various materials are spread out to demonstrate/test how well they pick them up. (note I am not claiming these are done scientifically, or are in anyway superior to other methods of testing such as yours. In fact I would claim the opposite, these "little mess tests" are simple demonstrations but can still provide information on cleaning performance.)
Conclusions from such testing don't reliably tell you much about real-world performance. Because of that, I don't value such clueless internet bedroom testing, since it can mislead.

Your method isn't faulty; that is not what I am claiming. What I am claiming is:
  1. It isn't exactly reproducible (for others to do) as the identical testbed carpet is very likely not available to everyone who would like to reproduce the results. This of course is true for all the other tests/demonstrations short of full blown labratory testing.
  2. More importantly it is what I have already mentioned regarding the certified test dust. It is not wholly representative of the types of debris a vacuum may encounter under regular use.
The specific test isn't important since we're not following inustry standards (because we can't because we don't have a lab or millions to spend). What's important is the quantified trends that result and their relative comparison under the same conditions, whatever they might be. I'm amazed there's even another person who seems to recognise that, although I'm uncertain to what degree, and thus produces such trends. It's the relative trends which are consistent. When I saw Frickhelm's trend data for the V16, I knew he was doing things reasonably right because it showed the same completely unexpected and totally counterintuitive results I'd observed that I just couldn't believe at first. Not a single one of those other 'reviews' out there has done anything like this. At best they've vaguely shown, albeit not necessarily for good reason and likely by accident, that it doesn't perform as well. But it's so vague. Yet other reviews claim, without convincing evidence, it's a great performer. No data, no sale; bad service.

But to digress, as I believe we all agree on here, short of full blown laboratory testing (or demonstrating) in any form is going to have shortcomings; that none of them should be relied upon as final judgments to a machine's overall effectiveness.
Not sure about that. When said trends are reproducible and representative from fair testing, they allow meaningful relative comparison between machines for real-world conditions. That's the whole point of doing semi-professional home testing, it allows for an apples-to-apples comparison between different machines.

I've moved on from plain effectiveness. Most machines brute force performance easily, and have, since some lazily jammed in 3000+W motors. I'm now looking at performance per Watt of energy consumed to sift out the better machines, both technologically and environmentally. (And then all the usability stuff and features therein.) I mean, the V16 (...can) achieve mains performance under real-world conditions on carpet using just ~138 W, including the cleaner head. That's just *insane* and I don't know of any other machine that achieves that. And no one has pointed this out in the 'reviews'. It took a lot of technology to achieve that (that brings other usability benefits). The otherwise highly efficient Gen5 was almost twice that at ~220 W. This is also why people need to wise up to marketing, e.g. "ultra powerful 900W motors !1!11!", as I'll discuss.
 
There's actually one small, simple hack to the Shark Navigator that makes it the best vacuum possible. More power than central vacuums, lighter than stick vacuums, higher capacity than shop vacuums... It's a shame they released it in such a state. It's such an easy fix to make, anyone could do it at home.

I'm not going to tell you though, for reasons. Just trust me bro.
You mock, but you'll just look silly once my review is out and it's revealed. Doubly so that no one figured it out for themselves. It's so f*cking obvious if you understand the basic science of these machines—especially given that someone kindly produced an accessible description out there for people.
 
Me too. I don't use certified dust (because it's expensive). But you understand why certified dust exists, though, right? If not, go read up on it, understand what it represents and why, and understand why that's important for a vacuum cleaner.
Yes, shouldn't that be evident in the response? I do not claim its unimportant... I claim its not 'wholly representative' of general household debris.

Conclusions from such testing don't reliably tell you much about real-world performance. Because of that, I don't value such clueless internet bedroom testing, since it can mislead.
Example: If a machine consistently struggles to pick up a certain kind of debris (ie cat litter) in these tests, you might not find that valuable information, but I sure do.. (again... Not claiming its scientific, there may be other factors involved, but practically speaking such test would discourage myself from recommending said unit for that said case use...)

The specific test isn't important since we're not following inustry standards (because we can't because we don't have a lab or millions to spend). What's important is the quantified trends that result and their relative comparison under the same conditions, whatever they might be. I'm amazed there's even another person who seems to recognise that, although I'm uncertain to what degree, and thus produces such trends. It's the relative trends which are consistent. When I saw Frickhelm's trend data for the V16, I knew he was doing things reasonably right because it showed the same completely unexpected and totally counterintuitive results I'd observed that I just couldn't believe at first. Not a single one of those other 'reviews' out there has done anything like this. At best they've vaguely shown, albeit not necessarily for good reason and likely by accident, that it doesn't perform as well. But it's so vague. Yet other reviews claim, without convincing evidence, it's a great performer. No data, no sale; bad service.
Yes, but the issue here is "you" are the only one that can make the comparison under the same conditions, therefore it is not widely repeatable. (again, this limitation is understandable) My point here is no one can, so it is not 'fair' to criticize others' testing methods if they are consistent across the testing (most are not as yours are). But to use your own words, "we're not following industry standards."

Here is an example of a 'jump to conclusion:' You make a conclusion jump that because his results are the same, you assume his test methods are the same. You cannot possibly deny this, you just said you did so in your own words. You should know there could be countless of other factors leading to the same 'results.'

Not sure about that. When said trends are reproducible and representative from fair testing, they allow meaningful relative comparison between machines for real-world conditions. That's the whole point of doing semi-professional home testing, it allows for an apples-to-apples comparison between different machines.
If we take this statement at face value, there is still issues as all of these 'at home tests' are not comprehensive. That is my point, examples of each below:
-Using certified test dust doesn't account for large particles (ie cat litter). not wholly representative of real world use
-Big/Small mess tests are not repeatable. While they may(!) be more 'wholly representative' in terms of types of debris, they are also unrealistic.
I've moved on from plain effectiveness. Most machines brute force performance easily, and have, since some lazily jammed in 3000+W motors. I'm now looking at performance per Watt of energy consumed to sift out the better machines, both technologically and environmentally.
Fair enough, to each their own... Personally I would prefer whatever machine gets the floors the cleanest in the shortest amount of time/least amount of effort.

And then all the usability stuff and features therein.) I mean, the V16 (...can) achieve mains performance under real-world conditions on carpet using just ~138 W, including the cleaner head. That's just *insane* and I don't know of any other machine that achieves that. And no one has pointed this out in the 'reviews'. It took a lot of technology to achieve that (that brings other usability benefits). The otherwise highly efficient Gen5 was almost twice that at ~220 W. This is also why people need to wise up to marketing, e.g. "ultra powerful 900W motors !1!11!", as I'll discuss.
Whether or not the V16 can be a 'mains replacement' is debatable at best.
a) Much debate(?), consensus seems to be that legacy Dyson machines perform better.
b) Much debate (and evidence) that V15 cordless machine is as effective as quality corded units in dirt extraction.

The V15/V16 might be suitable for your personal usage, but I have learned the hard way for me it (V15) is not cut out for being a true 'mains' replacement. Yes this is a personal anecdote, and there is no way to scientifically qualify, prove, etc. I can list a several examples of 'why' I state this, but since they are not scientifically provable I will decline unless asked.
 
You mock, but you'll just look silly once my review is out and it's revealed. Doubly so that no one figured it out for themselves. It's so f*cking obvious if you understand the basic science of these machines—especially given that someone kindly produced an accessible description out there for people.
Just wait until my Shark® Navigator™ review comes out and I reveal the simple fix. It's so obvious, I don't know how anyone isn't talking about it yet. It would only take a moment to describe, but I'm just too busy. Trust me though. Shark is truly at the top of the game—the peak of vacuum cleaner innovation and efficiency.
 
@Vacuum Facts you thought everyone can figure it out ourselves because there's enough data now. You claim the data is there, but where is it? You seems pretty confident, enough that you chose not to give away where and why should you continue to be tight-lipped, all because you want to teach the reviewers a lesson, dragged over by V16 launch being staggered (so that the US wouldn't get it until 2026). It's an example of you making stuffs that... well, people hardly understands.

We did get the data we really got, and it involves the motor doing 450W for normal deep cleaning (in Boost mode), not 900W that it was capable of (the lower pretty consumption is there for increased runtime, but in vacuum that's basically it). That means halved the max suction and about 20% lesser Auto mode at best - enough to put it in the leagues of modern copycats out of the box. (Post-mod V16 performs about as well in Auto mode as the pre-mod Boost mode, according to datas) So maybe the modification is related to the motor and the related electronics. While thankfully the V16 is much, much more efficient, its power is crippled by Dyson's relatively newfound oversight which is stupid (bordering on reckless, even), and it's possible they're spending the time gap between the initial launch and the US launch to actually fix the real problem.

@cheesewonton (too), I believe that the reviewers all failed to figure out the reason why the V16 was crippled out of the box precisely because they didn't get the real data. We can glance the data VF gave us and know that the mod might have to involve tampering with the motor or cyclones (after all, the V16 has variable cyclones) somehow without breaking or bricking the vacuum. But the reviewers didn't, except for @frickhelm who figured out independently but @Vacuum Facts is the most thorough because he presented the most data out of any reviewers. Both gave us accessible descriptions regarding proper home testing (not to be confused with lab-grade tests, obviously) and physics, but so far you didn't give us the methods. @Vacuum Facts, I asked for the method needed, not the data which I already accepted.

The ultimate conclusion is that the V16 is a tragic machine. It is genuinely a superior vacuum with true mains-equivalent performance and long runtime plus serious advancements in usability and performance but is seriously crippled out of the box, thanks to Dyson's stupid (and arguably reckless) oversight which led to mis-tuned motor and/or self-gimped cyclones, and ultimately the performance matching that of copycats instead of proper Dyson machines (V15, Gen5, etc.) unless modified/revised to fix it all. Have we managed to mass-complain about the actual problem yet?

As for the @Hatsuwr mentioning Shark Navigator...
There's actually one small, simple hack to the Shark Navigator that makes it the best vacuum possible. More power than central vacuums, lighter than stick vacuums, higher capacity than shop vacuums... It's a shame they released it in such a state. It's such an easy fix to make, anyone could do it at home.

I'm not going to tell you though, for reasons. Just trust me bro.
Great, now you've summed up what I feel about VF's deliberately-delayed review of the V16. We know the data, but not the method. He's still the best vacuum cleaner reviewer ever, precisely because he's objective and relies on actual representative data. That guy also have proper bedroom testing (much closer to laboratories' standard) as opposed to unrepresentative tests such as big messes or other exaggerated ones.

@Vacuum Facts now that I noticed it, you're updating your testing procedure. How do you plan to do so, and to address the V16's quirks?
 

Latest posts

Back
Top