Raspberry Pi 5 review – Part 2: Raspberry Pi OS Bookworm, benchmarks, power consumption, and more

A few days ago I finally went through the Raspberry Pi 5 kit I received last September going through the items and booting it with Raspberry Pi OS bookworm. I’ve now had time to perform more tests to check out the performance with benchmarks and test various features on the Raspberry Pi 5. So I’ll report my experience in the second part of the review and compare the Raspberry Pi 5 to the Raspberry Pi 4 and some other Arm Linux SBCs.

System information in Raspberry Pi OS Bookworm

Last time around, I installed the Raspberry Pi 5 in its official case, but for most of the testing, I decided to go back to the bare board fitted with its active cooler since it’s the best cooling option as we’ll see further in the review.

Raspberry Pi 5 Review Raspberry Pi OS Bookworm

Let’s first check some of the system information:


The Raspberry Pi 5 runs Debian 12 with Linux 6.1 as expected and the Broadcom BCM2712 processor (still shown as BCM2835 as in all RPi boards) does come with four Cortex-A76 cores.


inxi utility further confirms my board comes with 8GB RAM, the 2.4 GHz frequency advertised for the BCM2712 CPU, and lists the peripherals with two HDMI ports, Ethernet, WiFi, and Bluetooth, and we can also see Wayland and PipeWire as now used in Raspberry Pi OS as was announced during the release of the Bookworm version of the operating system. The microSD card capacity is reported correctly at around 32GB, and we can see 100MB of it is used for swap. There also appears to be a reference to the Raspberry Pi RP1 chip in the Network section, although it’s the same for the driver…

If anybody is interested I also saved the Raspberry Pi 5 Linux boot log.

Raspberry Pi 5 Benchmarks

Let’s start the Raspberry Pi 5 benchmarks with Thomas sbc-bench.sh script:


First, the good news is that there was no CPU throttling and the temperature never exceeded 66.1°C when using the active cooler in a room with an ambient temperature of around 28°C.

Let’s compare the memory bandwidth and 7-zip results against the Raspberry Pi 4 and other SBCs such as Khadas VIM4 (Amlogic A311D2), ODROID-N2+ (Amlogic S922X), Radxa Rock 5B (Rockchip RK3588), and others.

Raspberry Pi 5 memory bandwidth 7zip vs Rockchip RK3588 Amlogic A311D
Higher is better

The memory bandwidth of the Raspberry Pi 5 is much higher than the Raspberry Pi 4, but based on memcpy and memset results the Rockchip RK3588 platforms are still way ahead in that metric, and they also outperform the Raspberry Pi 5 in 7-zip benchmarks which benefit from a larger number of cores (Rockchip RK3588 comes with 4x Cortex-A76 cores, 4x Cortex-A55 cores). The Raspberry Pi 5’s 7-zip performance is about the same as the Khadas VIM4 and ODROID-N2+ SBCs, and about double the performance of the previous generation Raspberry Pi 4.

Raspberry Pi 5 AES 256 performance

The Broadcom BCM2712 is the first processor used in a Raspberry Pi board that comes with Armv8 Crypto extension and that shows in AES-256 benchmarks with the new Raspberry Pi 5 over 21 times faster than the Raspberry Pi 4.

Time to have a look a web browsing performance, especially since the Raspberry Pi OS Bookworm introduced an optimized version of Firefox besides the usual Chromium browser.

We’ll first use Speedometer 2.0 to check the performance in Chromium…

Raspberry Pi 5 Chromium Speedometer 2.0

… and in Firefox.

Raspberry Pi 5 Firefox Speedometer 2.0

Firefox is often significantly slower than Chromium in benchmarks, so Raspberry Pi Ltd and Mozilla have done a relatively good job optimizing Firefox for the Raspberry Pi 5 with Chromium achieving 63.5 runs per minute against 56.6 on Firefox. The chart below compares that performance against the Amlogic A311D2-based Khadas VIM4 (35.6 points), the Amlogic A311D-powered Khadas VIM3 (against 25.6 points), the Rockchip RK3588S-based Khadas Edge2 Pro, and a Raspberry Pi 4 overclocked at 2.0 GHz (21 points).

Raspberry Pi 5 vs Rockchip Amlogic SBCs Speedometer 2.0

Please note that web browsers are constantly evolving with performance optimizations (or bloat) getting added after each release, and we did not redo the tests on older platforms due to time constraints.

I also ran the glmark2 benchmark to test graphics performance on the Raspberry Pi 5.


920 points look to be on the low side, as a Rockchip RK3588 hardware such as the NanoPi R6S mini PC router achieved 4,525 points with glmark2-es2-wayland… [Update: I was unable to find glmark2-es2-wayland  yesterday, but it’s just an apt install:


The score is indeed different, and does not look as bad. But 2,036 points is still significantly lower than the 4,000-4,500 points achieved on Rockchip RK3588 hardware.

]

The WebGL Aquarium demo works fine with Chromium and Firefox, although the frame rate is significantly better with the Chromium browser.

WebGL Aquarium Chromium Raspberry Pi OS Bookworm
1000 fish, 48 fps – Chromium

 

WebGL Aquarium Firefox Raspberry Pi OS Bookworm
1000 fish, 35 fps – Firefox

For reference, in the NanoPi R6S review, I mentioned that “the demo renders smoothly with 1000 fish at 60 fps, and it’s still good with 5,000 fish at around 30 fps”, so the Raspberry Pi 5 is indeed not quite as performant as Rockchip RK3588/RK3588S system when it comes to graphics either.

So far, we can say the benchmarks show that Raspberry Pi 5 is a clear step up compared to the Raspberry Pi 4 with typically 2 to 3 times better performance, and even over 20 times for cryptographic workload (like AES, TLS, etc…), but it does not quite reach the performance of the popular Rockchip RK3588 CPU although it can get close for some specific workloads.

microSD storage and USB 3.0 benchmarks

I built iozone for the Raspberry Pi to run the storage benchmarks on both the provided 32GB Class A1 microSD card as part of the Raspberry Pi 5 kit and a USB 3.0 NVMe SSD drive.

Results for the microSD card:


SD card performance is supposed to be improved thanks to the RP1 chipset, but it’s hard to see with that specific microSD card. Reads are up to about 89MB/s and writes max out at 19MB/s. Random read and write speed is also important, and it looks decent which is probably why I didn’t notice any massive slowdowns due to I/Os during use. But note that (more expensive) competing boards with built-in 32GB or 64GB eMMC flash are usually much faster and more responsive.

I also tested the USB 3.0 bandwidth (5 Gbps) with an ORICO enclosure fitted with an Apacer NVMe SSD formatted with EXT-4.

Top USB 3.0 port:


Bottom USB 3.0 port:


In both cases, we got about 388MB/s sequential read speeds and 411MB/s write speeds, or about as expected for a 5 Gbps USB link. It’s unclear why writes are faster than reads as we disabled caching in the iozone command.

Gigabit Ethernet, WiFi, and Bluetooth

We’ll now use iperf3 to test gigabit Ethernet and WiFi 5 network performance. I’ll also test Bluetooth with my phone and a Bluetooth headset.

Here’s the Raspberry Pi 5’s gigabit Ethernet download speed using UP Xtreme 11 Edge mini PC‘s 2.5 GbE port on the other side of the connection.


Now for upload:


Both are great and around 940 is expected in either direction. Let’s now try a more demanding full-duplex (bi-directional) transfer:


Again excellent.

Let’s now test WiFi 5 (at 5 GHz) connected with a 433 Mbps link to Xiaomi Mi AX6000 router.


Download:

Upload:


The performance is fairly good with 224 Mbps uploads and 259 Mbps downloads, but if you want better network performance Ethernet should be used when possible. As a side note, high-end platforms with WiFi 6 can deliver over 1 Gbps transfer rates with that testbed.

Finally, I tested Bluetooth with my Android smartphone. The good news is that pairing worked flawlessly. The bad news is that Raspberry Pi OS does not know what to do with my phone with the error message:

Pairing successful – this device has no services which can be used with Raspberry Pi

Raspberry Pi OS Bluetooth Smartphone

So I can’t transfer files or do anything else for that matter.

Let’s try with a Bluetooth audio headset…

Raspberry Pi 5 Bluetooth Audio

It works! I could listen to the audio from a YouTube video, but the volume control is not working right. I can only mute the audio or turn it on at 100% at whatever position it is on the slider. However, if I use the volume buttons on my headset, then the volume slider is properly synchronized in Raspberry Pi OS… That means I can control the volume from my headset, but not from Raspberry Pi OS except for mute/unmute.

YouTube and 4K video playback

I then tested YouTube videos up to 1920×1080 resolution at 30 fps in both Chromium and Firefox. 4K (2160p) resolution was not an option despite selecting a 4K video.

RPi 5 YouTube Firefox
Firefox
RPi 5 YouTube Chromium
Chromium

The video played smoothly in both web browsers with only a few frames dropped according to the “Stats for Nerds” overlay window.

Let’s now try to play some local 4K H.265 videos as well since the Broadcom BCM2712 SoC is supposed to support H.265 video decoding. So I connected a hard drive with some 4K video samples and played them by clicking on the file which opened VLC video player:

  • Beauty_3840x2160_120fps_420_8bit_HEVC_MP4.mp4 (H.265, no audio) – OK
  • MHD_2013_2160p_ShowReel_R_9000f_24fps_RMN_QP23_10b.mkv (10-bit HEVC, 24 fps, no audio) – First frame only for the duration of the video
  • Fifa_WorldCup2014_Uruguay-Colombia_4K-x265.mp4 (4K, H.265, 60 fps) – Video and audio OK

While two of the video could play fine if I enter full-screen mode, I can see a thick black bar at the bottom of the video (but no such thing at the top), and changing the aspect ratio does not help.

4Kp60 HEVC video playback CPU usageCPU usage while playing a 4K H.265 video at 60 fps is rather low which should indicate hardware video decoding is indeed working. For comparison, If I switch to a 4K H.264 video at 30 fps, the CPU usage is higher as software video decoding is used instead.

Raspberry Pi 5 H.264 software video decodingIt should be the same for other video codecs, as I understand Broadcom BCM2712 only supports H.265 hardware video decoding, and all other codecs must be handled by software.

Raspberry Pi camera

I still have a Raspberry Pi camera module 3, but I had to skip testing because the camera connectors on the Raspberry Pi 5 are now smaller… It’s not such a big issue, as I understand it’s simply a matter of getting a $1 cable and you should be good to go with the new Raspberry Pi SBC and existing official camera modules.

Note that Broadcom BCM2712 does not support hardware video encoding, and it is now handled by software as well.

Thermal considerations

We’ve already seen the Raspberry Pi 5 offers a significant boost in performance compared to the Raspberry Pi 4, but we did so with a large heatsink and a PWM fan part of the “active cooler”. The fan is not particularly noisy, but some people may prefer to have a fanless system. Would that work with just the heatsink? What happens when we use the official Raspberry Pi 5 case? Let’s find out.

Note that usually perform testing in a room with 28°C ambient temperature which may impact the performance of the system. Just to show how ambient temperature may impact the CPU temperature I left the system run idly overnight (19:00 to about 10:00) just running sbc-bench.sh -m monitor temperature and rpi-monitor to draw the temperature chart.

overnight idle temperatureThe CPU temperature dropped from about 55°C to 50°C following the ambient temperature delta from about 26°C at 19:00 down to 21°C at 6:00 and going up from there.

Let’s check out the temperature chart starting from idle and running sbc-bench.sh script using the active cooler.

Raspberry Pi 5 Active Cooler Temperature Chart
Raspberry Pi 5 with active cooler

The idle temperature was about 46-47°C and went up to around 66°C during CPUminer. No throttling occurred and we are far from the 85°C limit, so the active cooler perfectly did its job.

The heatsink is quite large covering most of the board, so let’s disconnect the fan and see what happens:


Raspberry Pi 5 Temperature Fan Off

The idle temperature was quite higher at around 60°C, and we reached 85°C with both 7-zip and CPUminer, and throttling occurred with the CPU frequency dropping as low as 1,500 MHz from the usual 2,400 Mhz. That was only during short periods, so if your workload only requires bursts of performance, it should be possible to use the heatsink only. I’m also confident some will come with fanless cases for the Raspberry Pi 5.

Raspberry Pi also sent me the official case. So let’s remove the active cooler, stick the small heatsink from the kit on the Broadcom BCM2712 processor, and connect the fan…

Broadcom BCM2712 heatsink fan case

before installing the cover and reconnecting everything.

Raspberry Pi 5 case raspberry pi os bookworm

Time to run sbc-bench.sh again:


Raspberry Pi 5 temperature chart case fanThe good news that is CPU throttling did not occur. But the idle temperature is a bit higher at 56°C, and under load, it peaked at about 75°C. That also means the official case performs its cooling duty just fine, but the fan may be activated more often than with the active cooler because of the much smaller heatsink.

Now let’s turn off the system, disconnect the fan, and run the script with the Raspberry Pi 5 in its case without any active cooling.


Raspberry Pi 5 temperature chart case no fan

It does not look good at all. I waited for about 20 minutes before starting the benchmark, and the idle temperature was already around 67-68°C, but when we ran sbc-bench.sh the temperature quickly shot up to 85°C and even peaked at about 88°C.

The benchmark ended about 15:30 and I first thought there must be some background process keeping it at an elevated (85°C) temperature. But htop did not show anything…

Raspberry Pi 5 htop

sbc-bench.sh monitor mode also reported the high temperature and virtually zero CPU load:


It’s like the temperature sensor was stuck at around 85°C… and it would not come back down…

So I opened the case and reconnected the fan while the board was still running (probably not recommended) and the temperature dropped immediately…

Fan Broadcom BCM2712 CPU temperature

So if your plan was to use a tiny heatsink and put the Raspberry Pi 5 in an enclosure without a fan you can forget about it. That’s why Raspberry Pi provides an optional active cooler and the official case comes with an integrated fan, although it should perfectly be possible to create a fanless metal case for the board.

Power consumption

I measured Raspberry Pi 5’s power consumption with its active cooler using a wall power meter.

  • Power off – 1.7 Watts
  • Idle
    • 3.0 Watts (headless, WiFi only)
    • 3.6 Watts (Ethernet + WiFi, USB mouse & keyboard, HDMI connected)
  • “4K” YouTube Video in Firefox (full screen @ Full HD – avc1 (H.264) codec) – 5.5 to 6.2 Watts
  • “4K” YouTube Video in Chromium (full screen @ Full HD – avc1 (H.264) codec) – 5.7 to 6.8 Watts
  • Stress test on all 4 cores (stress -c 4) –  8.8 Watts

My Raspberry Pi kit comes with a USB PD power supply that supports 5.1V/5V or a little over 25W. The maximum in my test above is 8.8 Watts so that’s a lot of legroom when it comes to the power draw. So I tried to increase that by playing a 4K H.265 from a USB hard drive and run iozone on an external SSD while running stress -c 4 at the same time.

Raspberry Pi 5 Hard drive external USB

It did manage to peak at 16.8 Watts (and stabilize at 15.9 Watts), and so for that use case, a 5V/3V USB power supply as used with the Raspberry Pi 4 would not have been sufficient. For what it’s worth sbc-bench.sh does not report any drop in voltage under this specific stress test:


That makes me believe it should be possible to use a 5V/3A power adapter with the Raspberry Pi 5 for many use cases unless you are connecting USB peripherals that draw a lot of current like mass storage devices.  Raspberry Pi confirms that saying:

When using a standard 5V, 3A (15W) USB-C power adapter with Raspberry Pi 5, by default we must limit downstream USB current to 600mA to ensure that we have sufficient margin to support these workloads.

I’m running out of time to test this in detail, however.

Conclusion

The Raspberry Pi 5 SBC is a great upgrade to the Raspberry Pi 4 if you feel the earlier SBC is sluggish with two to three times the performance depending on the workload. The Broadcom BCM2721 is also the first “Raspberry Pi” processor with Armv8 crypto extension catching up with the competition and delivering a 20 times boost in performance for AES-256 against the Raspberry Pi. If you are familiar with the Raspberry Pi ecosystem and want something faster, the Raspberry Pi 5 is almost a no-brainer.

Having said that, there are some changes to the layout that make previous cases incompatible, the MIPI CSI and DSI connectors are smaller and users must purchase new flat cables, a new power adapter is potentially needed, there aren’t any official fanless solutions yet, and some features like H.264 hardware video decoding, or any sort of hardware video encoding are now missing since the BCM2712 can handle that in software. That’s more flexible but also consumes more power.

More advanced users that are mostly vendor-agnostic may be disappointed with the performance and features compared to platforms based on Rockchip RK3588 processor with a similar price point, support for 8K video output, 8K/4K AV1/VP9/H.264 hardware video decoding, hardware video encoding, an AI accelerator, and more. Raspberry Pi hardware still probably benefits from a larger community and possibly better software support although the current Raspberry Pi OS Bookworm has a bit more bugs than I expected such as Bluetooth audio volume issues or a thick black bar under full-screen videos in VLC.

I’d like to thank Raspberry Pi for sending a complete Raspberry Pi 5 kit for review and testing. You should be able to purchase the board and accessories from any local distributor for $80 (8GB RAM as reviewed here) and up.

Share this:
FacebookTwitterHacker NewsSlashdotRedditLinkedInPinterestFlipboardMeWeLineEmailShare

Support CNX Software! Donate via cryptocurrencies, become a Patron on Patreon, or purchase goods on Amazon or Aliexpress

43 Replies to “Raspberry Pi 5 review – Part 2: Raspberry Pi OS Bookworm, benchmarks, power consumption, and more”

  1. The idle power consumption looks very bad. The board at its powered off state consumes more power than similar SBCs in idle state is…. ridiculous. The 3W idle is even more than some x86 systems.

        1. Interesting what backward compatibility can do…

          Do they have private forums on Raspberry Pi now? Clicking on the last link to a forum thread returns the following error after login:

          “You are not authorized to read this forum.”

          1. The Pi5 seems both a bit rushed and also hobnailed by backward compatibility.
            Its interesting where Raspberry go as the Broadcom base is looking extremely tired.
            I wonder if the Pi5 might be a last in that line and a jump to ArmV9 and new silicon sources?

          2. There have long been private forums for distributors, resellers, and other special interest groups within their ecosystem.

        2. I assume the idle power consumption test was either performed with the ondemand or the conservative setting? (It was not mentioned which mode was used so I assume ‘performance’.
          I am very much prejudiced against the RPI5, but rating the power consumption using the ‘performance’ settings seems unfair.)

          It would be a second condition to also use the “power_of_on_halt=1” rule. but I assume it should not matter (when powered of you’d better cut the power completely if your aim is powersaving).
          I still feel this might be unfair since wifi might be using pcie lanes which could have been put to ‘powersave’ but that probably still is more than a general user could establish.

        3. There are allways many switches to try when switching from ‘performance’ to some powersave mode.
          Can I at least assume you did enable ‘ondemand’, ‘powersave’ or ‘conservative’ before publishing some outragious consumption?
          I hate to say I am very much prejudiced against the RPI5, but whne I lean on unreasonable colored reviews, these only tag me as anti-raspberry when I point out the RPI5 is not ideal.

    1. Idle power consumption >3W is bad 🙁 Odroid H3/H3+ with x86 Intel N5105 / N6005 10W have 1.2—1.5 W ⚡️ idle – I mean when running Debian 12 with kernel 6.2 or newer, with newest BIOS.

      My Odroid H3 has ~1.5 W idle with 2x RAM DDR4 modules (16GB + 32GB) + 1TB Samsung 980 Pro m.2 SSD. Power consumption was measured on DC side.

      And it’s completely fanless system, very powerful, very efficient, with great support and community on forum.odroid.com 🙂 
      Note: such low power consumption is achieved not with defaults (ASPM needs to be enabled in BIOS and some SW tweaks via powertop)

      1. I have powerful PC/home server with desktop 13th gen Intel i3-13100 (TDP 60W) with idle power consumption only 2—3 W :-O

        I enabled power-saving features in BIOS like C-states and ASPM.
        OS: Debian 12 with DietPi, kernel 6.1.0-13-amd64, keyboard and LCD unplugged.

        Power consumption measured on DC side (12V). It’s fanless build.

        idle: 2—3 W
        load: 50—60W

        [spoiler title=”see idle power consumption”] https://forum.level1techs.com/uploads/default/original/4X/8/6/5/86523c2520b4191e9a649a031bc813edbfe0bda0.gif [/spoiler]

    1. Yeah. And still no proper USB-C PD support. (although i much prefer a 12V screw terminal on SBCs)

      Also the omission of an av1 decoder seems painful for future desktop use, as all high volume 2023 devices have it. H265 support seems like a waste, as thats never going to achieve critical mass.

      1. > H265 support seems like a waste, as thats never going to achieve critical mass.

        Isn’t HEVC currently the standard for IPTV and as such SoCs designed for the STB market (like BroadCom 2712) only need a HW decoder for this single codec?

        1. I don’t think it is the case with Raspberry Pi 5. In this generation, the only HEVC codec is developed in-house by Raspberry Pi themselves according to
          this blog. I don’t even **think** the BCM2712 is designed for IPTV initially as the Raspberry Pi is the only user and with Raspberry Pi’s own IP blocks. The code choice is just a cost-down measure. They don’t want to pay the license from Broadcom for other codecs and they don’t want to put resources to implement other codecs either.

        2. AFAIK, those are all still using h264. Or rather the IPTV providers are still using it.

          H265 was too much of a licensing mess, which made everyone but the biggest of players, avoid it

      2. H.265 does get used. Lack of AV1 decode is annoying, dropping H.264 and lacking VP9 is bad altogether. LibreELEC attempted to excuse these, but it’s a power-hungry mess.

        Just use $50-150 x86 for desktop people. Same for TV, or some other ARM option.

        1. > Lack of AV1 decode is annoying, dropping H.264 and lacking VP9 is bad altogether.

          Do these codecs matter in the IPTV/STB business?

          Over a decade ago when (former) BroadCom employees started with RPi and used one of their VideoCore SoCs these chips were used in a variety of devices that dictated the SoC’s interfaces.

          But nowadays VideoCore is only used by BroadCom’s STB division any more and as such both interfaces and capabilities were adjusted. And Raspberry Pi Ltd. had to deal with this (developing their RP1 chip bringing back the original interfaces to whatever PCIe attached main SoC)

          1. It sort of begs the question as to why they wouldn’t move on to a general purpose SoC.

            People going on about how the RP1 is their most important design, then when you think about it, it’s a South Bridge at a time where everyone is going in the opposite direction

          2. There can be good reasons for why it happened while sticking to Broadcom. I’m not sure how much credence we can give to that given that RPi is as popular as ever and pushing millions of units. They should have enough leverage to get something customized for them. Also, Broadcom sells TV SoCs that support AV1, presumably H.264/VP9 (good luck finding out what exactly): cnx-software.com/2019/09/25/broadcom-bcm7218x-stb-soc-av1-hardware-decoding-wifi-6/

            But the point is that RPi is half-baked and makes less sense than ever before for use cases like desktop and TV.

      3. Eh? h.265/hevc has already reached critical mass. It’s effectively the default codec for UHD HDR streaming used by all the main OTT streaming platforms like Netflix, Prime, Disney+, Apple TV+ etc. and is supported by pretty much every Smart TV, Media Player (Apple TV, Amazon Fire TV, Google Chromecast, nVidia Shield TV, Roku etc.). Pretty much every phone and tablet that can play modern media in Dolby Vision etc. supports it. It’s also the standard codec for the most recent linear TV platforms (Germany and Netherlands are both using it with DVB-T2 as are other countries, and the US ATSC 3.0 standard uses it).

  2. > It did manage to peak at 16.8 Watts (and stabilize at 15.9 Watts)

    With Rasperry Pi Ltd.’s fixed cable PSU the input voltage reported by sbc-bench -m (using vcgencmd pmic_read_adc | grep EXT5V_V under the hood) never dropped below 5.13V (for reasons why a PSU with fixed cable can avoid the usual voltage drop see here).

    Would be interesting to repeat such a test with another USB PD PSU and any random USB-C cable in between.15W limit doesn’t matter, the voltage (drop) is the interesting bit when approaching the 3A area…

  3. Designing such an SBC with a 5 V / 5 A power supply is such a dumb idea. They don’t seem to have learned anything from the mistakes with their earlier boards, with all those voltage drop issues.
    With USB PD they could have easily used 9 V or even 15 V, which would avoid such high currents and at the same time make voltage drops due to cheap cables rather irrelevant.

    Overall, I find the Raspberry Pi 5 to be a very disappointing product.

    1. When I read “So, we decided to do something a little bit non-standard, which is what we often do in search of performance, and create a five-volt, five-amp profile for our power supply.” here, I was like “are you guys insane?!”, and I still haven’t fully recovered from that.

      1. Yeah, that’s crazy. What do they think people should do if they want to integrate a Pi 5 into some project where it isn’t possible to use their special snowflake power supply?

        Similar situation with the PCIe interface. They could have used a standard connector on the bottom side of the board, but no, they decided again to go with something proprietary, requiring an additional addon board, driving the cost up even more.

    2. It’s very nutty. 3A cables are already extremely thick. They’re basically doing this because they don’t want to spend the money on step down regulation.

      Unfortunately those costs are passed to the consumer because finding cables and PSUs that handle that voltage and current is quite hard.

      Even a lot of lab bench PSUs don’t go to 5A

  4. Generally, comparing glmark2 against glmark2-es2-wayland is not a good idea.
    Comparing glmark2 on one board against glmark2-es2-wayland on another board is even worse…
    Would it be possible to run glmark2-es2-wayland on Pi5 please?

    1. Sorry about that. I tried to find it yesterday, but no luck. It’s actually just an apt install… I must have been tired…

      I’ve updated the post with the results for glmark2-es2-wayland. The score is a little over 2,000 points.

  5. Lack of 4k Youtube video could be due to the reason Youtube 4k videos are encoded in VP9 or AV1 only?
    Since Pi5 not supporting hardware decoding of VP9 or AV1, and software decoding of 4k H.264 already takes more than 50% of the CPU power, it is definitely not able to support smooth 4k software decodings of VP9 & AV1, which are much more power demanding.

  6. Thanks for this review Jean-Luc. So in the end it’s not *that* bad, except if you expect low idle consumption or high performance. They followed their long tradition of low memory performance that cripples everything, resulting in a 7-zip performance that’s on par with 2-years old devices that did not require a fan…

    Thus in short it looks like this device remains an improvement for those who are only able to operate RPi products and that as a punishment they’ll get more noise and an increased power bill.

    For now I’ll pass. My 15 month-old pre-release Rock5B is significantly faster, fanless, cold to the touch, and not much more expensive. Ah and it has eMMC and M2 connectors on board and a more convenient form factor 🙂

    1. Yeah, Opi5 here and quite happy.

      I will give them credit for a few things, though. They finally use a core with the crypto extensions! About damn time. And, um,,,, uhhh, oh.. Yeah, I guess that’s about it. The USB-C is still messed up, the tiny video connectors is still a horrible choice, the processor is still super hot and inefficient, the memory interface isn’t as horribly slow as usual, they stripped all of the useful video encode/decode, etc. So much NIH.

    1. [ “Pricing for the Raspberry Pi 5 is still very attractive, costing only $5 more than the Raspberry Pi 4 in equivalent configurations with the 4GB model going for $60 and the 8GB model for $80. Sales should start by the end of October, and the Raspberry Pi 5 will remain in production until at least January 2035, or about 11-year are of guaranteed availability.”
      https://www.cnx-software.com/2023/09/28/raspberry-pi-5-sbc-broadcom-bcm2712-quad-core-cortex-a76-soc/

      one can add an USB wifi adapter (low prices ~$10-12), for this a ~$60-85 SBC]

  7. I tried a mild OC to 2.6 Ghz and it was stable but strangely slower than stock and maybe usuing SIMD with an OC has some internal power limit?
    pi@raspberrypi:~/whisper.cpp $ ./extra/bench-all.sh
    Usage: ./bench.sh [n_threads] [encoder-only]

    Running memcpy benchmark

    memcpy: 5.66 GB/s (1 thread)
    sum:  136902081526.000000

    Running ggml_mul_mat benchmark with 4 threads

     64 x  64: Q4_0   5.5 GFLOPS (128 runs) | Q4_1   5.5 GFLOPS (128 runs)
     64 x  64: Q5_0   1.8 GFLOPS (128 runs) | Q5_1   5.2 GFLOPS (128 runs) | Q8_0   1.9 GFLOPS (128 runs)
     64 x  64: F16   5.6 GFLOPS (128 runs) | F32   1.7 GFLOPS (128 runs)
     128 x 128: Q4_0  24.4 GFLOPS (128 runs) | Q4_1  11.5 GFLOPS (128 runs)
     128 x 128: Q5_0  21.1 GFLOPS (128 runs) | Q5_1  11.2 GFLOPS (128 runs) | Q8_0  26.1 GFLOPS (128 runs)
     128 x 128: F16   27.4 GFLOPS (128 runs) | F32   25.1 GFLOPS (128 runs)
     256 x 256: Q4_0  49.9 GFLOPS (128 runs) | Q4_1  50.4 GFLOPS (128 runs)
     256 x 256: Q5_0  41.5 GFLOPS (128 runs) | Q5_1  31.9 GFLOPS (128 runs) | Q8_0  59.6 GFLOPS (128 runs)
     256 x 256: F16   65.5 GFLOPS (128 runs) | F32   48.6 GFLOPS (128 runs)
     512 x 512: Q4_0  62.8 GFLOPS (128 runs) | Q4_1  61.3 GFLOPS (128 runs)
     512 x 512: Q5_0  50.3 GFLOPS (128 runs) | Q5_1  47.1 GFLOPS (128 runs) | Q8_0  77.5 GFLOPS (128 runs)
     512 x 512: F16   85.4 GFLOPS (128 runs) | F32   50.4 GFLOPS (128 runs)
    1024 x 1024: Q4_0  68.0 GFLOPS ( 32 runs) | Q4_1  69.6 GFLOPS ( 33 runs)
    1024 x 1024: Q5_0  54.0 GFLOPS ( 26 runs) | Q5_1  51.0 GFLOPS ( 24 runs) | Q8_0  85.7 GFLOPS ( 40 runs)
    1024 x 1024: F16   93.5 GFLOPS ( 44 runs) | F32   49.0 GFLOPS ( 23 runs)
    2048 x 2048: Q4_0  71.0 GFLOPS ( 5 runs) | Q4_1  72.9 GFLOPS ( 5 runs)
    2048 x 2048: Q5_0  56.0 GFLOPS ( 4 runs) | Q5_1  52.9 GFLOPS ( 4 runs) | Q8_0  87.9 GFLOPS ( 6 runs)
    2048 x 2048: F16   93.4 GFLOPS ( 6 runs) | F32   44.1 GFLOPS ( 3 runs)
    4096 x 4096: Q4_0  72.3 GFLOPS ( 3 runs) | Q4_1  74.6 GFLOPS ( 3 runs)
    4096 x 4096: Q5_0  56.1 GFLOPS ( 3 runs) | Q5_1  52.9 GFLOPS ( 3 runs) | Q8_0  88.6 GFLOPS ( 3 runs)
    4096 x 4096: F16   80.0 GFLOPS ( 3 runs) | F32   32.2 GFLOPS ( 3 runs)

    Running benchmark for all models
    This can take a while!

    |  CPU |   OS |      Config |    Model | Th |  Enc. |  Dec. |   PP | Commit |
    |  --- |  --- |       --- |     --- | --- |   --- |   --- |   --- |   --- |
    | <todo> | <todo> |       NEON |    tiny |  4 | 1056.65 |  7.01 | 152.03 | f96e1c5 |
    | <todo> | <todo> |       NEON |    base |  4 | 2495.73 |  12.62 | 359.57 | f96e1c5 |
    | <todo> | <todo> |       NEON |    small |  4 | 8638.57 |  35.89 | 1352.77 | f96e1c5 |
    | <todo> | <todo> |       NEON |   medium |  4 |   ms | 105.50 | 4635.39 | f96e1c5 |
    | <todo> | <todo> |       NEON |    large |  4 |   ms | 189.43 | 8513.07 | f96e1c5 |

    Now with over_voltage_delta=100000 arm_freq=2600

    pi@raspberrypi:~/whisper.cpp $ ./extra/bench-all.sh
    Usage: ./bench.sh [n_threads] [encoder-only]

    Running memcpy benchmark

    memcpy: 5.63 GB/s (1 thread)
    sum:  136902081526.000000

    Running ggml_mul_mat benchmark with 4 threads

     64 x  64: Q4_0   5.9 GFLOPS (128 runs) | Q4_1   5.8 GFLOPS (128 runs)
     64 x  64: Q5_0   5.0 GFLOPS (128 runs) | Q5_1   5.5 GFLOPS (128 runs) | Q8_0   5.5 GFLOPS (128 runs)
     64 x  64: F16   6.0 GFLOPS (128 runs) | F32   5.9 GFLOPS (128 runs)
     128 x 128: Q4_0  23.5 GFLOPS (128 runs) | Q4_1  25.3 GFLOPS (128 runs)
     128 x 128: Q5_0  12.5 GFLOPS (128 runs) | Q5_1  22.0 GFLOPS (128 runs) | Q8_0  28.5 GFLOPS (128 runs)
     128 x 128: F16   12.9 GFLOPS (128 runs) | F32   27.6 GFLOPS (128 runs)
     256 x 256: Q4_0  53.8 GFLOPS (128 runs) | Q4_1  54.3 GFLOPS (128 runs)
     256 x 256: Q5_0  44.7 GFLOPS (128 runs) | Q5_1  18.9 GFLOPS (128 runs) | Q8_0  64.8 GFLOPS (128 runs)
     256 x 256: F16   70.2 GFLOPS (128 runs) | F32   29.7 GFLOPS (128 runs)
     512 x 512: Q4_0  54.3 GFLOPS (128 runs) | Q4_1  41.7 GFLOPS (128 runs)
     512 x 512: Q5_0  34.0 GFLOPS (127 runs) | Q5_1  35.5 GFLOPS (128 runs) | Q8_0  57.3 GFLOPS (128 runs)
     512 x 512: F16   68.6 GFLOPS (128 runs) | F32   38.6 GFLOPS (128 runs)
    1024 x 1024: Q4_0  50.9 GFLOPS ( 24 runs) | Q4_1  50.3 GFLOPS ( 25 runs)
    1024 x 1024: Q5_0  40.3 GFLOPS ( 19 runs) | Q5_1  39.4 GFLOPS ( 19 runs) | Q8_0  63.7 GFLOPS ( 31 runs)
    1024 x 1024: F16   72.3 GFLOPS ( 34 runs) | F32   36.7 GFLOPS ( 18 runs)
    2048 x 2048: Q4_0  53.1 GFLOPS ( 4 runs) | Q4_1  55.6 GFLOPS ( 4 runs)
    2048 x 2048: Q5_0  42.7 GFLOPS ( 3 runs) | Q5_1  39.3 GFLOPS ( 3 runs) | Q8_0  66.9 GFLOPS ( 5 runs)
    2048 x 2048: F16   70.3 GFLOPS ( 5 runs) | F32   33.5 GFLOPS ( 3 runs)
    4096 x 4096: Q4_0  53.6 GFLOPS ( 3 runs) | Q4_1  55.0 GFLOPS ( 3 runs)
    4096 x 4096: Q5_0  41.5 GFLOPS ( 3 runs) | Q5_1  39.3 GFLOPS ( 3 runs) | Q8_0  65.2 GFLOPS ( 3 runs)
    4096 x 4096: F16   66.3 GFLOPS ( 3 runs) | F32   28.6 GFLOPS ( 3 runs)

    Running benchmark for all models
    This can take a while!

    |  CPU |   OS |      Config |    Model | Th |  Enc. |  Dec. |   PP | Commit |
    |  --- |  --- |       --- |     --- | --- |   --- |   --- |   --- |   --- |
    | <todo> | <todo> |       NEON |    tiny |  4 | 1304.46 |  7.55 | 207.36 | f96e1c5 |
    | <todo> | <todo> |       NEON |    base |  4 | 2827.34 |  13.10 | 470.81 | f96e1c5 |
    | <todo> | <todo> |       NEON |    small |  4 | 9890.36 |  39.70 | 1674.03 | f96e1c5 |
    | <todo> | <todo> |       NEON |   medium |  4 |   ms | 117.49 | 5718.21 | f96e1c5 |
    | <todo> | <todo> |       NEON |    large |  4 |   ms | 220.34 |   ms | f96e1c5 |
    Which I guess somone will get to the bottom of?

  8. I thought “better buy those better SBC’s”, but … what a prices! More than a x86 NUC with 8GB RAM and SSD and powersupply and housing (120 euro):

    Khadas VIM4 (Amlogic A311D2): €200,58
    Radxa Rock 5B (Rockchip RK3588): €198,28

    You must really love the IO-pin and hardware thinkering to spend your money on that.

    1. The£56.93 4gb Orange Pi 5 is likely a much better option and likely the best budget Rk3588s.
      Khadas always seem to carry a premium
      Orange Pi do do cheaper RK3588 boards but I prefer the single 2.5gbe of the Rock5b from OKdo £135.60 which for me is used as a x6 sata Nas/home server.

      You can get some very good deals on Mini Pcs and likely I would dodge some of the ultra cheap ones but you can get a good Intel N95.N100 for £150.

      If you just want a general purpose consumer desktop for approx £150 range then there are a few mini pcs and cpus to choose from.
      They are just not very good for maker or commercial purposes like Pi & SBC are often used.
      These approx 10 watt devices have a lot of horsepower and are extremely efficient and yeah Raspberry have made a bit of a fail in this respect.

Leave a Reply

Your email address will not be published. Required fields are marked *

Khadas VIM4 SBC
Khadas VIM4 SBC