Allwinner R329 Smart Speaker Processor Features Arm China’s AIPU (Artificial Intelligence Processing Unit)

Allwinner R328 is a dual-core Cortex-A7 processor with 64MB or 128MB built-in RAM designed for low-cost smart speakers that was introduced last year and found into smart speaker sold in mainland China.

According to a recent press release (in Chinese only), the company has now released a 64-bit update with Allwinner R329 dual-core Cortex-A53 processor equipped with dual HIFI4 DSP for audio post-processing and pre-processing, as well as Arm China’s AIPU (Artificial Intelligence Processing Unit) delivering up to 0.256 TOPS at very low power.

Allwinner R329

There’s no product page for Allwinner R329 yet, so I extracted some specifications from the press release:

  • CPU – Dual-core Cortex-A53 @ up to 1.5 GHz
  • DSP- Dual-core HIFI4 DSP @ 400 MHz
  • AI Accelerator – Arm China AIPU with 0.256 TOPS
  • Built-in DDR RAM
  • Audio
    • Embedded second-generation VAD hardware
    • 5x audio ADCs
    • 2x audio DACs with 100dB SNR
    • I2S and DMIC controller
    • 5-1-channel and 7.1 channel support
  • Integrated dual LDO

The company will also provide WIFI & BT chip and an Audio codec to provide a turnkey solution to its customers.  The company did not provider clear power consumption numbers but claimed a 2,500mAh battery can last one week in standby mode.

Arm China’s AIPU performance of 0.256 TOPS is said to represent 25 times the AI computing power of a single Cortex-A7 core clocked at 1.2GHz or a HIFI4 DSP clocked at 600MHz. Initially, I was confused as to why they would refer to AIPU as an “Arm China” design instead of simply an “Arm” design, and that’s because Arm China is a separate joint venture that was formed in 2018.

Allwinner R329’s dual-core HIFI4 DSP should also improve the audio quality via HiFi audio algorithms enabling ordinary smart speakers to match the sound quality of  HIFI speakers above 1,000 RMB (~$140 US).

Thanks to theguyuk for the tip.

Share this:

Support CNX Software! Donate via cryptocurrencies, become a Patron on Patreon, or purchase goods on Amazon or Aliexpress

ROCK Pi 4C Plus
Subscribe
Notify of
guest
The comment form collects your name, email and content to allow us keep track of the comments placed on the website. Please read and accept our website Terms and Privacy Policy to post a comment.
27 Comments
oldest
newest
Jon Smirl
3 years ago

I wonder if it has embedded DRAM?

Jon Smirl
3 years ago

The AI and audio hardware is similar in performance to Kendryte K210.

HIFI4 DSP is the Tensilica DSP. That DSP is used in Alexa enabled smartmics by Knowles. https://www.aisonic.com/ but Knowles has extended the instruction set a little (not sure if that matters much).

So is this AI hardware standard CNN? Can it run tensorflow models?

Price? Still around $3 like the last chip?

Jon Smirl
3 years ago

This same HiFI4 DSP is used in the iMX8. There are open source tools for it here:
https://thesofproject.github.io/latest/platforms/index.html?highlight=hifi4

NXP i.MX8/i.MX8X Xtensa HiFi4 1 @ 666MHz
NXP i.MX8M Xtensa HiFi4 1 @ 800MHz

I have not used these since I don’t have a board with a HiFi4 DSP. There are also a lot of third party libraries available for this DSP.

dgp
dgp
3 years ago

>The company will also provide WIFI & BT chip

Would that be the XR819? If so, good luck with that.

Jon Smirl
3 years ago

Ignore the Allwinner WIFI+BT and use an Ampak module. I would also ignore their codec chip.

dgp
dgp
3 years ago

Maybe skip the allwinner chip entirely. Putting some sort of NN inside an ARM soc seems to be in fashion now so I think better options will present themselves.

Jon Smirl
3 years ago

I suspect the only purpose of this NN is for improving the accuracy of hot word recognition. A standard CPU doesn’t do a great job of it (maybe 90%), the NN has potential to boost that to 97-98% accuracy.

PS – it is not that CPU can’t do it, it just can’t achieve 98% accuracy in near real-time.

dgp
dgp
3 years ago

>purpose of this NN is for improving the accuracy of hot word recognition

This does seem to be for that but I think we’ll see almost every chinese IP camera chip have NNs because of their love for surveillance. Modules like this are apparently already out in the wild – http://www.superic.com/soludetail-278.html

David Willmore
David Willmore
3 years ago

DGP, BGA package too much?

dgp
dgp
3 years ago

I guess this is about the XR819? It’s not BGA, it’s a QFN… but the drivers and firmware for it are horrible. Like the firmware crashes if the driver on the other end of the sdio bus looks at it wrong. There are some wi-socs based on it on taobao though so maybe it actually works for some people. (shrug gif here).

David Willmore
David Willmore
3 years ago

No, I meant the R329 in BGA. I wouldn’t wish the XR819 on anyone. There are so many better radio modules with drivers that actually work. *glares at OpiZero*

Jon Smirl
3 years ago

Previous tries (AllwinnerV3) at putting CPU + DRAM into a non-BGA package have had thermal problems. The BGA is better at heat transfer. That is why S3 (BGA) replaced V3.

dgp
dgp
3 years ago

>The BGA is better at heat transfer. That is why S3 (BGA) replaced V3.

If forget the name but I’m pretty sure AllWinner is selling the V3s as Rxxx something now in the same old QFP package.

Jon Smirl
3 years ago

V3S in QFP is limited to 1080P30, but the silicon can do 1080P60 and 4KP20. It is the same silicon, this is a thermal limitation. If you try doing 4KP20 the chip will go into thermal shutdown. The QFP V3 can do 4KP20 since it does not have the DRAM die inside generating extra heat. The S3 is in a better thermal package so it can do 4KP20 with the DRAM inside the package.

David Willmore
David Willmore
3 years ago

Then why not a QFP with a thermal pad in the center? I’ve soldered dozens of those in past years. There are solutions other than BGA.

Jon Smirl
3 years ago

It is easy to get PCB house to assemble now. For example this place will shop for your parts in Shenzhen marketplace, make PCB and assemble it, all for reasonable prices. elecrow. dot com Let them mess with BGAs. That’s what we do.

Some of our engineers will order a board with only the BGAs assembled on it. Then they hand solder the rest of the parts while simultaneously testing their design. Doing it that way makes it easier to find layout errors.

dgp
dgp
3 years ago

>Then why not a QFP with a thermal pad in the center?

V3s does have an exposed pad. I would have thought the bigger surface area and all the extra metal in the lead frame etc would give it room to dump the heat out.

Jon Smirl
3 years ago

For more detail you will have to get answers out of SoChip. I do know that the V3S and S3 do not use the same DRAM die. So part of this could potentially be a more power efficient DRAM die in the S3. All I know for sure is that the dies are not the same, they need different init code.

dgp
dgp
3 years ago

>No, I meant the R329 in BGA.

BGA is ok if you get someone else to assemble it/are using a PCB fab a bit better than the cheapest on pcbshopper.com. These less known Allwinner chips aren’t easy to get though. The H3 etc you can buy on taobao and alliexpress but getting something like the S3 was a pain.

theguyuk
theguyuk
3 years ago

Don’t forget Allwinner and also Rockchip SoC sell under other brands too ( not a clue if licenced or just sold off ).

Monkey king = a Rockchip and ZUIKI Z7213 = a Allwinner. Both were found in retro gaming consoles.

https://www.cnx-software.com/2017/12/03/sega-genesis-flashback-retro-game-console-is-powered-by-monkey-king-3-6-processor-runs-android/

Jay
3 years ago

I hope this gets some Arduino love.

Does anyone know of upcoming boards based on this R329? Not sure if this supports mic arrays.

Also, @Jean, is it possible to do an R329 vs. R328 comparison when you get more information?

Jon Smirl
3 years ago

You can have up to eight DMICs. I’d like to see a dev board too, but I don’t know any one building one.

Bubble Bobble
Bubble Bobble
3 years ago

Hi Jon, any news on the R329 ? I still can’t find datasheet or detailed information about AIPU. This chip looks amazing.

Jon Smirl
3 years ago

I am not sure if this chip ever shipped. It may have been a victim of COVID.

Khadas VIM4 SBC