Wi-Fi Performance Comparison for Android Media Players and HDMI Sticks

If you’re mainly using your Android mini PC or STB to stream videos over the web or your local network, Wi-Fi performance is actually more important than CPU performance, and I’ve recently had quite a few issues with Wi-Fi with both T428 (RK3188 / Broadcom Wi-Fi module) and CS868 (AllWinner A31 / Realtek Wi-Fi module), which were only fixed after upgrading my router firmware. So I’ve decided to re-test most of the mini PCs I own with the upgraded router firmware, and the number are highly confusing, and I found out there’s probably be no easy to way to estimate the overall Wi-Fi performance of any device, and it’s most probably highly dependent on the router used, and its firmware version.

My router is TP-LINK WR940N, a 300 Mbps Wireless N router with three antennas. Since I bought it, I had never upgraded the firmware (3.9.18 Build 100104 Rel.36350n) from 2010. When I test Android mini PCs or media players, I always place the device is the same area which is about 5 meters from the router, but not line of sight, and I transfer a 278 MB file from a SAMBA share in a PC running Ubuntu. I use ES File Explorer to perform the transfer, and I check the time with a stop watch. I write the time, and calculate the throughput. In theory, the NAND flash write speed could also be a bottleneck, but considering the throughput are always less than 3MB/s, and the file is only 278MB, which is less than the amount of RAM, I believe it should not impact the results.

Here are the results I got with the old router firmware since I started doing this test.

Wi-Fi Throughput in MB/s
Wi-Fi Throughput in MB/s

Matricom G-Box Midnight MX2 is the fastest by a wide margin, and T428 and CS868 have pretty poor performance because they often lost the signal during the transfer.

As I explain in CS868 review, upgrading the router firmware completely changes the performance of CS868, and improves T428 significantly. So equipped with my “new” router with firmware 3.13.9 Build 120201 Rel.54965n, I tested the devices again to see if results would be much different, and if we could find some patterns, e.g. Realtek Wi-Fi module perform better or not. I performed the file transfer three times on each device, to make sure there was not too much variation between transfers.

The updated results show CS868 far ahead, while G-Box Midnight MX2 is not that good anymore, and may have been negatively impacted by my router firmware upgrade. That’s the complete opposite of earlier results.

Wi-Fi Throughput in MB/s
Wi-Fi Throughput in MB/s

The table below shows more details about the tests and the devices.

Product Time 1 Time 2 Time 3 Throughput (MB/s) Connection Speed /
Signal Strength
Wi-Fi Module Firmware / Build Number Remark
Hi-802 (Freescale I.MX6) 03:32 04:33 04:25 1.112 150Mbps (Good) Realtek RTL8188CUS R13.4-rc2 V1.65.3 Slow microSD, high CPU usage (around 6 to 7)
G-Box Midnight MX2 (AML8726-MX) 04:20 03:44 03:44 1.178 150Mbps (Excellent) Realtek RTL8188EUS JOP40D.20130422 Highly Variable speed (Up to 2.6 MB/s)
T428 (RK3188) 03:02 03:15 03:32 1.416 65Mbps (Excellent) Broadcom AP6330 Rk31sdk-eng 4.2.2 JDQ39 eng root 20130419 Highly variable speed (Up to 1.7 MB/s), lost signal once, and cancelled test
Tronsmart Prometheus (AML8726-MX) 03:05 03:10 03:08 1.481 150Mbps (Excellent) Realtek RTL8188EUS JOP40D.20130307 Constant speed around 1.5MB/s, high CPU usage (4 to 5)
MK908 (RK3188) 02:47 02:30 02:47 1.723 150Mbps (Excellent) Broadcom AP6210 mk908_100j1 15-04-2013 Constant speed around 1.7MB/s
CS868 (AllWinner A31) 01:30 01:30 01:28 3.112 150Mbps (Good) Realtek RTL8188EUS fiber_onda809q9-eng 4.1.1 MASTER eng ok 20130506 Constant speed around 3MB/s
Measy U2C (RK3066) 02:40 N/A N/A 135Mbps (Excellent) Mediatek MT5931 B12_RK3066_Public_V411_121224 Worked the first time, but then failed to transfer the file completely 4 times, so I gave up

I dropped E-Great H5 and Droid Stick A2 from the tests due to lack of time, and Measy U2C is not included into the chart because it could not reliably transfer the file, and I only managed to fully transfer the file once, over 5 attempts. This also happened once with T428, but the 3 other tests worked.  As I previously assumed, the connection speed, be it 65 Mbps, 135 Mbps or 150 Mbps, does not actually matter. The conclusion of those tests is a bit disappointing, as the only one I can make is that you can’t really make conclusions. If I had only use the original router firmware, I would have said CS868 Wi-Fi is a disaster, but after firmware upgrade of the router, CS868 is the best ever mini PC I’ve ever seen when it comes to Wi-Fi throughput, and is clearly ahead of any other devices. Bear in mind CS868 only has a chip antenna, and can still easily outperform other device with an standard internal antenna.

With regards to Wi-Fi modules, Realtek RTL8188EUS is both at the top of the chart and the bottom with the new router firmware, so the overall performance seems to depend on overall system design, and the interoperability with the router. One of the advantage of devices based RTL8188 is that the drivers source code is available, Mediatek MT5931 source has recently been “leaked”, but I don’t think Broadcom IC source is available.

Support CNX Software - Donate via PayPal or become a Patron on Patreon

26
Leave a Reply

avatar
26 Comment threads
0 Thread replies
0 Followers
 
Most reacted comment
Hottest comment thread
7 Comment authors
Beelink i68 (Rockchip RK3368) TV Box ReviewARM para hobbyistas - parte 2 de 3 - economizando com Linux em Mini PCs - Embarcados - Sua fonte de informações sobre Sistemas EmbarcadosInfocus CS1 A83 (C2107) Android Tablet ReviewReview of M8 Android Kitkat TV Box Powered by Amlogic S802 SoCReview of Tronsmart Vega S89 Elite Amlogic S802 TV Box Recent comment authors
  Subscribe  
newest oldest most voted
Notify of
anon
Guest
anon

Personally I had such difficulties with my sticks, but all changed after first moving from the included power supply to take power out of my TV, and after seeing the both Wifi signal speeds and quality skyrocket (and never lose contact after that) I moved to use high-quality USB high-current hub as my “extension cord” for all my 5V devices, there has never been any problems since, even the overheating from overclocking doesn’t seem to freeze the sticks anymore…

All my sticks are registered as an 150Mbps devices, but my router indicated they are really only 65Mbps standards compliant… works for me, too bad the quality goes down to 13Mbps instantly after starting DLNA streaming, 720p no problem, 1080p hick-ups once in a while, why 65Mbps -> 13Mbps downgrade? who knows.

So you really should also test all sticks with some good quality 5V source as well, as those same Chinese “2A” PSUs that come with virtually all of those sticks are really lacking in both input and output filtering.

Personally I am considering building an USB “hub” power supply out of those 5V 10A industrial/laboratory PSUs (sold for LED strip lights) available on places like amazon.com, and they cost only around $20-$30.

trackback

[…] WiFi molto migliori rispetto ai primi esemplari usciti, ma quale si comporta meglio degli altri? Da cnx-software arriva una bella comparativa tra Mini PC Android recenti, messi a confronto proprio nella […]

trackback

[…] Android TV box WiFi performance comparison One of the biggest problems I’ve found with many cheap Android TV sticks and boxes if flaky WiFi. CNXSoft set out to compare WiFi performance of 9 devices… with odd results that show that your router setup might be just as important as choosing a good Android device. [CNX Software] […]

mftvrocks
Guest

great comparison

bravomail
Guest

Power supply and taking antenna out of box. It’s easier than it sounds. 1st open the case using screwdriver or knife starting from HDMI plug and moving clockwise. Using a knife or drill make a hole on the side of case. Get antenna out of case. Get much better Wifi reception. Also – try testing 10 or 15 meters away from router with walls on the way – that will be more realistic.

Klein
Guest
Klein

I think that the problem is the test, SMB is the worst bandwide(or throughput) test posible, you must isolate latency (rtt) and throughput, also layer 2 error is important. in all measure avg, min, max and standard deviation are useful to understand where is the problem.
Also try isolate components in the transmition system to find measure change, if you change many components at same time(soc,wifi module, OS kernel version, driver version, network stack configuration) you dont find the responsability of individual component.
Thanks, your articles are always very useful.

trackback

[…] really excellent, the best, by far, I had seen in the dozen of devices I had tested, although an upgrade to my router firmware somehow changed that. This is also one the rare device that will support OTA firmware update. There […]

LinuxMint
Guest
LinuxMint

Are you sure, that those AP6[4|3|2|1]xx WiFi modules are made by Broadcom?
Poking around the web, I couldn’t find any reference linking those to BC.
On the other hand however, there are now indications, that AP6493, AP6441, AP6476, AP6383, AP6330, AP6376, AP6210 and AP6181 are manufactured by ampak.com.tw, a subsidiary of gemtek.com.tw, even though, none of those products can be found on either company’s website.

avirex
Guest
avirex

thanks for this test, although i am more confused now than before. 🙂 i would love to see another test like this with more full size boxes (like the Geniatech, Mele, etc) and maybe using a greater distance to the router, and also using something like speedtest.net APK for the testing (for upload/download tests)… i have noticed huge improvement when boxes have an external antenna, and my house is prone to these issues with my router being at the opposite end of the house with many walls between..

LinuxMint
Guest
LinuxMint

@cnxsoft
Thank you for getting to the bottom of it.
That was some awesome detective work on your part 🙂

trackback

[…] I’m not sure what they have done with Wi-Fi, but they have done it right, and made all other mini PCs and STBs look like junk when it comes to Wi-Fi performance. [Update: Wi-Fi performance seems to be a complex matter, and updating my router firmware changed the pecking order] […]

trackback

[…] bear in mind there are many factors when it comes to Wi-Fi performance, and the results you’ve got with your setup may be completely different than the ones […]

trackback

[…] These are the results for my setup, and yours may vary considerably. […]

trackback

[…] bear in mind there are many factors when it comes to Wi-Fi performance, and the results you’ve got with your setup may be completely different than the ones I’ve […]

trackback

[…] bear in mind there are many factors when it comes to Wi-Fi performance, and the results you’ve got with your setup may be completely different than the ones I’ve […]

trackback

[…] add the usual disclaimer about Wi-Fi: “Please bear in mind there are many factors when it comes to Wi-Fi performance, and the results you’ve got with your setup may be greatly different from the ones I’ve gotten […]

trackback

[…] The tablet transferred the file at 2.72 MB/s (21.76 Mbps) on average which puts it in the middle of the pack. It’s quite possible I should not really compare Wi-Fi performance of a tablet with the one of media player, since these are different form factors. Your environment, including your router firmware, may also greatly impact the relative Wi-Fi performance between devic…. […]

trackback

[…] diferencial é o que fará sua experiência ser boa ou terrível. O sítio CNX Software oferece uma tabela de comparação de velocidades wireless para vários Mini […]

trackback

[…] I’m using ES File Explorer to transfer a 278 MB file between a SAMBA share and the flash three times, and average the results to test Wi-Fi and Ethernet performance. Results for Beelink i68 are not catastrophic, but rather underwhelming, with the average transfer speed @ 2.2 MB/s, ranking the box as one of the least performing device for WiFi connection, at least with my setup. […]