0% found this document useful (1 vote)
137 views16 pages

Espressif AIoT Solutions Overview

Espressif Systems is a fabless semiconductor company established in 2008 that develops cutting-edge yet cost-effective microcontrollers (MCUs) achieving low-power wireless communication. Headquartered in Shanghai, China, Espressif has offices worldwide and provides millions of users with AIoT solutions for applications like facial recognition, voice interaction, mesh networking, and cloud connectivity using their ESP series of system on chips (SoCs) and open source development frameworks.

Uploaded by

Emre Bircan
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (1 vote)
137 views16 pages

Espressif AIoT Solutions Overview

Espressif Systems is a fabless semiconductor company established in 2008 that develops cutting-edge yet cost-effective microcontrollers (MCUs) achieving low-power wireless communication. Headquartered in Shanghai, China, Espressif has offices worldwide and provides millions of users with AIoT solutions for applications like facial recognition, voice interaction, mesh networking, and cloud connectivity using their ESP series of system on chips (SoCs) and open source development frameworks.

Uploaded by

Emre Bircan
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

Official Platform

[Link]

[Link]

[Link]/espressif

[Link] I [Link] I [Link]

Social Media
[Link]/EspressifSystem
ESPRESSIF
INNOVATING THE TECHNOLOGIES
[Link]/espressif

[Link]/company/espressif-systems

OF TOMORROW
[Link]/EspressifSystems

[Link]/espressif_systems_official

Espressif Systems [Link]


#304, Block 2, 690 Bibo Road, Pudong New Area, Shanghai, China 201203
Contents

About
About Espressif .......................................................................... 01
ESP RainMaker .......................................................................... 03
Global Ecosystem ...................................................................... 05

ESP Products
Software
ESP-IDF ............................................................................... 07
Hosted-Mode SDKs ............................................................ 07
Audio Development Framework ........................................... 08
IoT Cloud Connectors .......................................................... 08
AI and Machine Learning SDK ............................................. 08

Hardware
ESP Series of SoCs ............................................................. 09
ESP32-S3 ............................................................................ 10
ESP32-S2 ............................................................................ 11
ESP32-C3 ......................................................................... .. 12
ESP32 .................................................................................. 13
ESP8266 .............................................................................. 14

ESP Solutions
Audio Solutions ......................................................................... 15
Face Recognition ...................................................................... 18
ESP-HMI ................................................................................... 19
ESP-MESH ................................................................................ 20
Device Connectivity .................................................................. 21
ESP Insights .............................................................................. 23

Support
Espressif’s Customer Support .................................................. 24
About
About

About Espressif
Vision and Mission
A World-leading AIoT Platform Espressif is committed to providing open-source AIoT solutions to its
customers and developers, commercial and non-commercial alike, so that
Espressif Systems ([Link]) is a public, multinational, fabless, semiconductor company developers from all walks of life can use this technology to solve some of the
established in 2008. We have a passionate team of engineers and scientists from all over the world, most pressing problems of our times.
focused on developing cutting-edge, yet cost-effective, MCUs that achieve low-power, wireless
communication. Espressif is proud of its high-performance hardware, as well as its development
frameworks which are designed in-house from the ground up. Espressif provides millions of users
with a variety of secure AIoT solutions relating to facial recognition, voice interaction, mesh
networking, human interaction and Cloud connectivity, across the whole wide world.

1st
With the biggest share
Our products are We provide millions of
of the global Wi-Fi
distributed all over users with a variety of
A Complete-Solution Provider
MCU market (for four
the world. AIoT solutions.
years in a row).

ESP-MDF for mesh connectivity, Espressif offers a variety of


ESP-ADF for voice recognition, technical documents and
ent resources for free, including
Brno, and ESP-WHO for face pm Op
elo works datasheets, technical
v T en
Czech Republic detection and recognition.
De ame Re ec reference manuals, user
Fr so

-S ical s
guides, API references,

hn urce
ou
test reports, etc.

rce
OS
Shanghai / Suzhou
Wuxi / Hefei / Shenzhen,

O p erati n
China ESP-IDF integrates a Espressif provides

Syste m
real-time operating audio, face
system with drivers for recognition, HMI,

s
So AIo T
peripherals, network device-connectivity

io n
g
protocol stacks for Wi-Fi solutions, which are

lut
Pune, India
and Bluetooth, as well as widely used in the areas
Singapore various utility libraries and of smart home, industrial
development tools. control, consumer
Hard electronics, etc.
w a re
Campinas, Brazil

High-performance Wi-Fi + Bluetooth / Bluetooth LE + IEEE


802.15.4 + AI SoCs, Modules and DevKits, including the
ESP8266, ESP32, ESP32-S, ESP32-C and ESP32-H Series.
Espressif’s Worldwide Expansion

01 02
Share :: Connect :: Innovate Share :: Connect :: Innovate
A Complete AIoT Solution

About
About

ESP RainMaker ® ESP RainMaker Offer

ESP RainMaker ® provides a complete solution for building Voice Assistant Device SDK & Firmware Voice-assistant Integrations
Cloud Service Voice Assistant
AIoT products with a minimal amount of code. It covers all Production-ready, open-source Ready-made support for Alexa &
Espressif chips and modules, device firmware, phone apps, firmware for different product Google Assistant integration
Remote Control
voice-assistant integrations and Cloud backend. It enables categories is available to all customers, through smart-home skills and
customers to quickly build their own AIoT solutions based on ESP SoC
who can then build their own products, actions. Customers can also create
enterprise-grade Cloud computing, with a single-click using the ESP RainMaker device SDK. their own custom skills.
deployment.
Configuration
Local Control
ESP RainMaker
APP

Product
R&D Long development Own control? differentiation?
investment? cycle?
High operating expenses?
ESP

Talent acquisition & management?

ESP SoCs & Modules Device Management Open-Source Phone Apps


with Own Private Cloud
We provide customers with the most The app provides functions including
cost-effective, yet powerful, SoCs and Fleet Management, OTA User Management, Device Association,
Facing challenges with building your Using third-party platforms and Upgrades, Device Diagnostics, Scheduling, Device Sharing, Network
modules that suit different product needs.
own Cloud from scratch? suffering from their restrictions? ESP RainMaker works with all of Business Insights Configuration, Local and Remote
Espressif's modules and SoCs. Control, Grouping, etc. Customers can
also build their own apps.

Third-party Service Support

Google Assistant Apple HomeKit

Accelerate Your AIoT Business with Your Own Platform


Minimize your R&D investment and business Ensure your business upscaling runs in Progress quickly by shortening Alexa Matter
risks by using Espressif’s turnkey solution. a secure and stable environment. the development cycle.
Focus on product innovation and Gain independence by deploying your Frustration-Free Setup
differentiation with full customization. own Cloud.
Powered by ESP RainMaker

$
Turnkey Solution Pay-as-You-Grow Independence Innovation
Significantly simplifies Pay only when your Own devices and user Focus on fulfilling and developing
connected-device development business starts to grow. data in private Cloud. your marketing needs.
and maintenance.

ESP RainMaker: [Link]


Get Started: [Link]/docs/[Link]
03 04
Share :: Connect :: Innovate Share :: Connect :: Innovate
About

Global Ecosystem Hardware and Software


Innovating for Quality
Development Platforms Espressif is the first company to have successfully integrated an antenna switch, RF
balun, power amplifier, low-noise receive amplifier, filters, and power-management
ESP-IDF is Espressif’s open-source and field-proven platform that already powers modules for Wi-Fi applications in CMOS technology. As such, the entire solution
millions of connected devices. Espressif also contributes to open-source, real-time occupies a minimal Printed Circuit Board (PCB) area.
operating systems, such as NuttX and Zephyr, thus giving developers more choice
when creating their own applications.

Espressif’s products are also compatible with Arduino IDE, Amazon FreeRTOS,
NodeMCU, MicroPython, PlatformIO, and Mongoose OS.

Third-Party Cloud Platforms Small and Improved yield and Minimal manufacturing
Low cost
simple design high reliability and logistical complexity

Baidu Aliyun Amazon Joylink


Tencent AWS

Google Microsoft
Azure
</>

40+ Hardware Software


mainstream Cloud platforms support Espressif products

Unlocking the Potential of


Active Community Engagement
the AIoT Development
Espressif has already left an indelible mark on the IoT industry and maker communities
60 K+ 5th C 1.5 M+ worldwide, having built a modern software platform which is based on the communi-
ty-driven development of its powerful wireless MCUs. Espressif’s SDKs provide
toolchains, APIs, components and workflows for fast, secure and cost-effective applica-
60 K+ open-source, Internationally ranked 59th 1.5 M+ views for the most popular
Espressif-powered projects on GitHub for projects built videos of Espressif-powered
tion development, while Espressif’s SoCs are compatible with all the main operating
on GitHub with the C language projects on YouTube systems, such as Windows, Linux and Mac OS. This way, developers can easily use the
ESP32
Espressif SDK of their preference to build new AIoT applications, or migrate their existing
applications to the ESP hardware platform of their choice. As a result, Espressif SoCs
ESP8266

Book Google

have already powered millions of devices in the field, and are recognized as the driving
100+ books written about Espressif’s 31 M+ search results for ESP8266
force of innovation in the AIoT industry.
SoCs in 10+ languages and ESP32 on Google

05 06
Share :: Connect :: Innovate Share :: Connect :: Innovate
Product
Product

Espressif's Software Platform


Audio Development Framework
ESP-IDF ESP-ADF
This is an SDK for building audio applications with
ESP-IDF is Espressif’s official IoT Development Framework Espressif SoCs. This includes audio pipelining, a variety
for the ESP32, ESP32-S, ESP32-C and ESP32-H series of of codecs, containers, playlist parsers and higher-level
SoCs. It provides a self-sufficient SDK for any generic audio protocols.
application development on these platforms, using
programming languages such as C and C++. ESP-IDF </> ESP-ADF: [Link]/espressif/esp-adf
currently powers millions of devices in the field, and enables
building a variety of network-connected products, ranging
from simple light bulbs and toys to big appliances and
industrial devices.

ESP-IDF IoT Cloud Connectors


Network OTA Upgrade Manufacturing Common Networking Examples
Examples ESP RainMaker ®: [Link]/espressif/esp-rainmaker
Provisioning Library Utilities Protocols

POSIX and C++ AWS IoT: [Link]/espressif/esp-aws-iot


File
FileSystems Object
ObjectStorage POSIX and Network Security Crypto
Crypto Library
Library IDEPlugins
IDE Plugins
Support
C++ Google Cloud IoT Core: [Link]/espressif/esp-google-iot
Peripherals Power Wi-Fi & Bluetooth
Wi-Fi & BLE TCP/IP Stack
TCP/IP
Bluetooth/
BT/BLE Build
Build System
System Microsoft Azure IoT: [Link]/espressif/esp-azure
Drivers Management LE Mesh Networking
mesh Bluetooth LE Stack
Joylink IoT Cloud: [Link]/espressif/esp-joylink
Software
Software Bluetooth
RTOS
RTOS Kernel
Kernel SoCSupport
SoC Support Wi-Fi MAC
Wi-Fi Library
MAC BT Developer Tools Aliyun IoT Cloud: [Link]/espressif/esp-aliyun
Bootloader Controller
Tencent IoT Cloud: [Link]/espressif/esp-qcloud
Baidu IoT Core: [Link]/espressif/esp-baidu-iot
ESP-IDF: [Link]/espressif/esp-idf

Hosted-Mode SDKs
AI and Machine Learning SDK
ESP-AT ESP-Hosted
ESP32
ESP-DL
SDK based on an AT Native network interface SDK Host MCU
Series SoC
command set for the network for the network connectivity This is an SDK that implements an optimized kernel,
various models, model conversion tools and hardware
connectivity of host MCUs. of host MCUs.
acceleration implementation for Espressif SoCs.

ESP-AT: [Link]/espressif/esp-at ESP-DL: [Link]/espressif/esp-dl


ESP-Hosted: [Link]/espressif/esp-hosted

07 08
Share :: Connect :: Innovate Share :: Connect :: Innovate
S3

Product
Espressif’s Series of SoCs ESP32-S3
ESP32-

Espressif drives the development of AIoT solutions, with its complete A Wi-Fi and Bluetooth 5 (LE) MCU Designed for AIoT Applications
with Powerful AI Acceleration and Reliable Security Features
MCUs featuring integrated Wi-Fi and Bluetooth connectivity.

Features Core System Wireless MAC RF


® and Baseband 2.4 GHz Balun
Xtensa® Dual-core 32-bit + Switch

CPU & Memory


LX7 Microprocessor Wi-Fi
AI

Transmitter
Wi-Fi MAC

Receiver
Core ROM RAM GPIO

2.4 GHz

2.4 GHz
Connectivity

2.4 GHz
Baseband

Clock
Acceleration Xtensa ® 32-bit LX7 dual-core processor
Cache SRAM
Bluetooth LE
Link Controller
Bluetooth LE
with a five-stage pipeline that operates at JTAG ROM Baseband
RF Phase
Lock Loop

up to 240 MHz
Wi-Fi + Xtensa® LX7 Peripherals RTC
384 KB 512 KB 45 Yes 384 KB ROM, 512 KB SRAM, external RTC PMU
ESP32-S3 Bluetooth 5 (LE) 32-bit Dual Core SPI0/1 I2C GPIO RTC GPIO Memory
Quad SPI/Octal SPI/QPI/OPI 1GM flash SPI2/3 I2S UART
Touch
Sensor ULP Coprocessor
and 1GB RAM SDIO Host MCPWM RMT Temperature
Sensor Security
Pulse DIG ADC RTC ADC
TWAI® SHA RSA

Xtensa® LX7
Connectivity Counter
LCD
Controller
Camera
Controller

Wi-Fi 128 KB 320 KB 43 / GDMA Interface Interface RTC AES RNG

ESP32-S2 32-bit Single Core 2.4 GHz Wi-Fi 802.11 b/g/n with HT20 / HT40 USB OTG
USB Serial/
LED PWM
Watchdog
Timer HMAC
Digital
JTAG Signature
Bluetooth 5 (LE) with Long Range support General-purpose Timers System Watchdog Secure Flash
Timers Timers Boot Encryption
Wi-Fi and Bluetooth LE mesh support

Wi-Fi + RISC-V 32-bit ESP32-S3 Block Diagram


384 KB 400 KB 22 / Peripherals
ESP32-C3
Bluetooth 5 (LE) Single Core
45 programmable GPIOs: UART, SPI, I2 C, Highlights
I2 S, PWM, ADC, TWAI, 14 capacitive
Touch GPIOs, USB OTG v1.1
Wi-Fi + Xtensa® LX6 AI Acceleration
Bluetooth 4.2 32-bit 448 KB 520 KB 34 / Security
ESP32 (BR/EDR + LE) Additional support for vector instructions in the
Single/Dual Core
RSA-3072-based secure boot MCU, which accelerates neural network
AES-128/256-XTS-based flash encryption computing and signal.
Digital signature peripheral and the HMAC
Xtensa® L106 64 KB 160 KB 17 / Outstanding Speech-Recognition
Wi-Fi peripheral
ESP8266 32-bit Single Core Performance
“World Controller” peripheral that provides
two fully-isolated execution environments ESP32-S3 supports the single-chip offline speech
recognition solution, WakeNet, which is a
configurable Wake-Word Engine.
Applications
MultiNet: Offline-command engine that
can support up to 200 offline commands.
Smart home
Espressif's Audio Front-End Algorithms for
 Industrial automation
Acoustic Echo Cancellation (AEC), Blind Source
Human machine interface (HMI) Detection (BSS), and Noise Suppression (NS)
Touch sensing contribute to a great performance even in a noisy
Learn More Product Selector Contact Us Speech recognition environment.
[Link] [Link]/product-selector [Link]/sales Image recognition
Learn More: [Link]
Voice-controlled devices Product Selector: [Link]/product-selector
USB devices Contact Us: [Link]/sales

09 10
Share :: Connect :: Innovate Share :: Connect :: Innovate
S2 C3

Product
Product

ESP32- ESP32-S2 ESP32-C3


ESP32-
A Cost-Effective MCU with a RISC-V Single-Core CPU
A Secure and Powerful Wi-Fi MCU with Numerous I/O Capabilities
Wi-Fi and Bluetooth 5 (LE) Connectivity for Secure IoT Applications

Features Main CPU JTAG Wi-Fi RF


RF Receiver
Features Wireless MAC RF
ROM Core System
Wi-Fi and Baseband
Xtensa® MAC Clock 2.4 GHz Balun

Switch
+ Switch

Balun
32-bit LX7 Cache Generator RISC-V 32-bit
CPU & Memory Microprocessor
CPU & Memory Microprocessor Wi-Fi

Transmitter
Wi-Fi RF Wi-Fi MAC

Receiver
2.4 GHz

2.4 GHz
2.4 GHz
Baseband Baseband

Clock
SRAM Transmitter
Xtensa® 32-bit LX7 single-core processor 32-bit RISC-V single-core processor with a Cache SRAM
Bluetooth LE
Link Controller
Peripherals and RTC
that operates at up to 240 MHz Sensors
ULP RTC
four-stage pipeline that operates at up to JTAG ROM
Bluetooth LE
Baseband
RF Phase
PMU Lock Loop
Embedded Co-processor Memory
160 MHz
General
Flash/PSRAM Purpose Timers
128 KB ROM, 320 KB SRAM, 16 KB SRAM in SPI/LCD I2S/Camera Peripherals RTC
RTC, SPI/QSPI/OSPI supports multiple flash Interface
Interface/LCD
Interface 384 KB ROM, 400 KB SRAM, 8 KB SRAM SPI0/1 I2C GPIO RTC GPIO
RTC PMU
Memory
and external RAM chips GPIO I2C Cryptographic Hardware in RTC and external Quad SPI/QPI 16 MB SPI2
Acceleration I2S UART RTC Security
LED PWM UART flash Pulse
Watchdog
Timer
TWAI® RMT SHA RSA
Connectivity
Counter
Pulse Counter RMT SHA RSA
LCD DIG ADC Temperature
Connectivity GDMA Interface Controller Sensor
AES RNG

2.4 GHz Wi-Fi 802.11 b/g/n with HT20 / HT40 USB OTG DAC
AES RNG LED PWM
USB Serial/
JTAG
Camera Watchdog HMAC
Digital
Signature
Interface Timers
TWAI ADC 2.4 GHz Wi-Fi 802.11 b/g/n with HT20 / HT40 Secure Flash
General-purpose Timers System Timers Encryption
Boot
Peripherals Touch Sensor
Temperature
Sensor
HMAC
Digital
Signature Bluetooth 5 (LE) with Long Range support
Wi-Fi and Bluetooth LE mesh support
43 programmable GPIOs: UART, SPI, I 2C, ESP32-S2 Block Diagram ESP32-C3 Block Diagram
I 2S, ADC, DAC, TWAI, LED PWM, LCD
Peripherals
interface, camera interface, USB OTG, 14 Highlights
capacitive Touch GPIOs 22 programmable GPIOs: UART, SPI, I2C, Highlights
I2 S, PWM, ADC, TWAI, Full-speed USB
Security HMI Solution Serial/JTAG controller
With an LCD interface and 14 configurable capacitive RISC-V at the Core
RSA-3072-based secure boot Security
touch GPIOs, ESP32-S2 provides the optimal HMI ESP32-C3 integrates a 32-bit core RISC-V
AES-128/192/256-XTS-based flash encryption solution to touchscreen and touchpad-based devices. microcontroller with a maximum clock speed of
RSA-3072-based secure boot
Cryptographic accelerators for enhanced 160 MHz.
AES-128/256-XTS-based flash encryption
performance Unparalleled Security
Digital signature peripheral and the HMAC With 22 configurable GPIOs, 400 KB of internal RAM
Protected private key and device encryption
AES, SHA and RSA algorithms integrated into peripheral and low-power-mode support, it can facilitate many
preventing outsiders from software access
cryptographic accelerators. different use cases involving connected devices.
Hardware acceleration support for
Protection against physical fault injection
Additional hardware security features are provided by cryptographic algorithms The MCU comes in multiple variants with integrated
attacks
the RNG, HMAC and Digital Signature modules, along and external flash availability.
with flash encryption and secure boot signature
Applications verification features. Applications 2.4 GHz Wi-Fi + Bluetooth 5 (LE)
Low Power IEEE 802.11 b/g/n-compliant; Supports 20 MHz,
Human machine interface (HMI) 40 MHz bandwidth in 2.4 GHz band; 1T1R mode
ESP32-S2’s fine-grained clock gating, dynamic Smart home (Light-control system)
Cameras for video streaming with a data rate of up to 150 Mbps
voltage and frequency scaling, together with its Industrial automation
Generic low-power IoT sensor hubs adjustable power amplifier output power contribute Health care Bluetooth 5 (LE); Bluetooth mesh; Advertizing
Generic low-power IoT data loggers to an optimal trade-off between communication Consumer electronics extensions
Image recognition range, data rate and power consumption. Generic low-power IoT sensor hubs
Speech recognition Generic low-power IoT data loggers
Smart home Learn More: [Link] Learn More: [Link]
Product Selector: [Link]/product-selector Product Selector: [Link]/product-selector
Industrial automation Contact Us: [Link]/sales Contact Us: [Link]/sales

11 12
Share :: Connect :: Innovate Share :: Connect :: Innovate
32 8266

Product
Product

ESP32- ESP32 ESP8266


ESP
A Feature-Rich MCU with Integrated Wi-Fi and Bluetooth Connectivity
A Cost-Effective and Highly Integrated Wi-Fi MCU for IoT Applications
for a Wide Range of Applications

Features Embedded Flash


Bluetooth
Bluetooth RF Features MAC Interface
Link Receive
SPI Controller Baseband RF Analog UART
Receive Receive
Clock Registers

Switch

Balun
I2C Generator
CPU & Memory
GPIO
I2S Wi-Fi CPU & Memory

RF Balun

Digital Baseband
Wi-Fi MAC Baseband RF

Switch
I2C
Transmitter
Xtensa® 32-bit LX6 single-/dual-core SDIO CPU
I2S
processor that operates at up to 600 MIPS UART Xtensa® 32-bit L106 single-core processor
Cryptographic RF Analog SDIO
TWAI ®
Core and Memory
Hardware that operates at up to 160 MHz Transmit Transmit Sequencers
448 KB ROM, 520 KB SRAM, 16 KB SRAM ETH Acceleration
PWM
2 (or 1) x
Xtensa®
in RTC, QSPI supports multiple 32-bit LX6
Microprocessors SHA RSA 64 KB ROM, 160 KB SRAM, SPI/QSPI ADC
RMT Accelerator
flash/SRAM chips supports multiple flash/SRAM chips PLL VCO 1/2 PLL SPI
PWM
ROM SRAM AES RNG
Touch Sensor
Connectivity PMU Crystal Bias Circuits SRAM PMU Flash
DAC RTC
2.4 GHz Wi-Fi 802.11 b/g/n with HT20 / HT40 ADC
Connectivity
PMU ULP
Coprocessor
Recovery
Memory ESP8266 Block Diagram
Bluetooth 4.2 (BR/EDR + LE) Timers
2.4 GHz Wi-Fi 802.11 b/g/n with HT20
Wi-Fi and Bluetooth LE mesh support
ESP32 Block Diagram

Peripherals Peripherals Highlights


Highlights
34 programmable GPIOs: UART, SPI, I 2 C, 17 programmable GPIOs: UART, SPI, I 2 C,
I 2 S, ADC, DAC, TWAI, LED PWM, touch I 2 S, PWM, ADC, IR remote control
High Level of Integration
sensor, hall sensor High Level of Integration
ESP8266 integrates antenna switches, RF balun,
Security ESP32 is highly integrated with in-built antenna power amplifier, low-noise receive amplifier, filters
switches, RF balun, power amplifier, Applications and power management modules. The compact
Secure boot, flash encryption, cryptographic low-noise-receive amplifier, filters, and power design of ESP8266 minimizes the PCB size and
hardware acceleration management modules. requires only a few external circuitries.
Smart home
Low Power Master/Slave
Applications Industrial automation

ESP32 features all the state-of-the-art Smart plugs and lights ESP8266 can perform either as a standalone SoC
characteristics of low-power chips, including Wearable electronics or as slave to a host MCU. When ESP8266 hosts
Smart home fine-grained clock gating, multiple power modes, the application, it promptly boots up from the flash.
Industrial automation and dynamic power scaling. IP cameras
Also, it can be applied to any microcontroller
Wearable electronics Wi-Fi geolocation design as a Wi-Fi adaptor through the SPI/SDIO or
Retail & catering applications UART interfaces.
Wi-Fi position system beacons
Image recognition
Speech recognition
Mesh network

Learn More: [Link] Learn More: [Link]


Product Selector: [Link]/product-selector Product Selector: [Link]/product-selector
Contact Us: [Link]/sales Contact Us: [Link]/sales

13 14
Share :: Connect :: Innovate Share :: Connect :: Innovate
Solution

Solution
Audio Solutions Audio Solutions

ESP-AVS ESP Audio Front-End Algorithms


The ESP-Voice-Assistant SDK provides an implementation of Amazon's Alexa Voice Service, Google Voice
Espressif has created a set of audio front-end
Assistant and Google Dialogflow for the ESP32 microcontroller. This facilitates developers in running directly Playback
(AFE) algorithms that result in a solid voice-con- Reference
these voice-assistants on ESP32. The SDK will run on hardware boards that have a Microphone/Speaker
trolled performance even in noisy environments.
interfaced with the ESP32. Acoustic Echo
Customers can use these algorithms with Cancelation
Hardware: Espressif’s powerful ESP32 and ESP32-S3 SoCs, Blind Source
Separation
Noise
Suppression

The SDK supports the ESP32-Vaquita-DSPG and ESP32-LyraTD-DSPG development boards. The in order to build high-performance, yet low-cost,
AEC Filtered
Audio
ESP32-Vaquita-DSPG development board, together with Alexa Voice Service (AVS) for AWS IoT, products with a voice-user interface. Espressif's Acoustic Echo
Cancelation
Stream

provides a turnkey solution to easily creating Alexa built-in IoT devices, with voice enablement and AFE algorithms have been qualified by Amazon as BSS NS
AWS IoT Cloud connectivity. a “Software Audio Front-End” solution for Alexa AEC
Supports acoustic front-end including DSPG DBMD5P, Intel s1000 and Synaptics CX20921. built-in devices.
SDK: The SDK contains pre-built libraries for Amazon Alexa, Google Voice Assistant (GVA) and Google Outstanding Acoustic Performance: In most cases, the wake-up rate achieves 100%, and the speech
Dialogflow along with sources of utility components such as audio pipeline and connection manager. recognition rate is over 90% in low-SNR scenarios.

Resource Efficiency: Utilizing just 12-20% of CPU, and consuming around 460 KB of memory,
including 220 KB of internal memory and 240 KB of external memory.

Flexibility: Offering an easy and intuitive API. The distance between the two microphones can be
API
between 20-80 mm.
ESP AVS for AWS IoT
Espressif provides a certified solution for Alexa-built-in devices with the AVS for AWS IoT SDK protocol.
The ESP32-WROVER-E series of modules, in combination with an external DSP, provides the industry's most
cost-effective, yet feature-rich, solution. The availability of the device and its companion phone app SDKs
reduce development effort significantly.
ESP-Skainet
Espressif’s offline smart-voice assistant currently supports a configurable wake-word engine (WakeNet), and an
Voice Assistant Cloud
offline speech-recognition engine (MultiNet) with up to 200+ offline commands and acoustic algorithms.
Antenna ESP Voice Assistant Client

I2C/SPI VA Transport VA HAL Audio Player Alerts Mgr Tone Player


DSP Mic Array
Peripherals Audio SDK
ESP32-WROVER-E
Auth
Mgr
Hi Espressif, Voice Audio Processing Output
Codec

Button

Audio Pipeline Input Front End


DSP

turn on the light.


LED

(ESP32 + 16 MB Flash +
LEDs 8 MB PSRAM) Transport Streams Codecs Ringbuffer AEC
I2S Auido Codec
Speaker (HTTP/MQTT) Wake Word Engine
Speech Commands
Speech Synthesis Stereo
+ Smart PA Recognition
Buttons I2C AGC
ESP-IDF
MIC MultiNet_CN TTS_CN
NS WakeNet Light

Hardware Architecture SDK Architecture  VAD MultiNet_EN TTS_EN

Mic Array Air-


File
Processing Conditioning
Hardware: ESP32-Vaquita-DSPG provides a reference design for Alexa-builtin connected devices, along
with schematics, layout and BOM. ESP-IDF

SDK: Espressif’s AVS for AWS IoT SDK provides production-ready example applications that include full Released Developing

AVS for the AWS IoT SDK functionality, including music service support.

ESP AVS: [Link]/espressif/esp-va-sdk ESP AFE: [Link]/solutions/audio-solutions/esp-afe


ESP AVS for AWS IoT: [Link]/solutions/audio-solutions/esp-avs-for-aws-iot ESP-Skainet: [Link]/solutions/audio-solutions/esp-skainet/overview

15 16
Share :: Connect :: Innovate Share :: Connect :: Innovate
Solution

Solution
Audio Solutions Face Recognition

ESP32-S3-BOX AI Voice Development Kit ESP-WHO


ESP32-S3-BOX provides a platform for developing the control of smart devices with offline and online
voice assistants. It is ideal for developing AIoT applications with reconfigurable AI voice functions, such as ESP-WHO is a face detection and recognition Face Detection Face Recognition Image Utility

smart speakers, and IoT devices that achieve human-computer voice interaction directly. development framework based on ESP32. You
can use it with the ESP-EYE or the ESP-WROVER-KIT ESP-WHO ESP-FACE
development board. Then, by adding only a few
ESP-IDF
peripherals, such as cameras and screens, you can
easily create complete AIoT applications.
ESP-EYE ESP-WROVER-KIT

16:18

Hi 乐鑫 / Hi ESP

Security Cost-Effectiveness High Performance Expandability


Local memory 10 frames per second Object detection
Object tracking
Hand-gesture recognition

ESP-EYE
ESP-EYE is an ESP32-based development board
that integrates a digital microphone, an 8 MB
Voice Assistant Touch Screen Sensor
PSRAM and a 4 MB flash, while also providing an
Infrared Remote Smart Gateway
Control Control external 2-Megapixel camera. These features
make the board ideal for applications relating to
face detection, face recognition and speech
ESP32-S3-BOX combines a touch screen controller, various sensors, an infrared controller and a smart recognition. Besides, the board can also support
gateway. With all this functionality and its product-ready form factor, ESP32-S3-BOX will help you save image transmission over Wi-Fi and debugging
significant R&D expenses, and shorten the development cycle of your product. through a Micro USB port, which enables the
development of advanced AI solutions.

ESP32-S3-EYE is based on the ESP32-S3 SoC. It features a 2-Megapixel camera, an LCD display, and
Highlights a microphone, which are used for image recognition and audio processing. ESP32-S3-EYE offers plenty
of storage, with an 8 MB Octal PSRAM and a 8 MB flash.
Online and Offline Voice Assistant: ESP32-S3-BOX is equipped with Espressif's AI Voice Recognition
system, with which you can customize the command phrases for giving instructions.
ESP-EYE is an AWS-qualified development board. In addition to
HMI Touch Screen: 320 x 240 capacitive touch screen, Integrated LVGL in SDK qualified Espressif’s own ESP-IDF SDK, you can use FreeRTOS on ESP-EYE.
Smart Gateways: Thread Border Router, Zigbee gateway, Wi-Fi/Bluetooth gateway, Wi-Fi hotspot device This development board can also be used with FreeRTOS for simple
Extensible Pmod™ Interface: Providing two Pmod™-compatible headers (with 16 programmable Amazon FreeRTOS camera and audio capture use-cases. It provides out-of-the-box
connectivity with AWS-IoT and other AWS services.
GPIOs) that support interfacing with various peripherals for flexibly expanding the functions of the board.

ESP-WHO: [Link]/products/devkits/esp-eye/overview
ESP32-S3-BOX: [Link]/espressif/esp-box ESP-EYE: [Link]/espressif/esp-who/blob/master/docs/en/get-started/ESP-EYE_Getting_Started_Guide.md
ESP32-S3-EYE: [Link]/espressif/esp-who/blob/master/docs/en/get-started/ESP32-S3-EYE_Getting_Started_Guide.md

17 18
Share :: Connect :: Innovate Share :: Connect :: Innovate
Solution

Solution
ESP-HMI ESP-MESH
ESP-HMI is Espressif’s high-performance and low-cost solution for achieving a smart interaction
between users and AIoT devices. It has an innovative user-interface which enables data visualization,
touch or gesture control, voice recognition, image recognition and analysis, etc. ESP-WIFI-MESH
ESP32-S2 and ESP32-S3 can support high-performance HMI applications through optimized display
and improved external memory (SPIRAM). ESP-WIFI-MESH is an ad-hoc network based on a Wi-Fi
communication protocol that allows multiple devices (or AWS Aliyun

ESP32-S2 ESP32-S3 nodes), distributed over a large physical area, to get


ESP-MDF

ESP-LCD
interconnected under a single WLAN.
Basic Components ESP-NOW ESP-WIFI-MESH
ESP-MDF, or Espressif’s Mesh Development Framework,
ESP-IDF
A multimedia smart-control solution built around ESP32-S2-HMI-DevKit-1 and an LCD capacitive is a development framework for ESP-WIFI-MESH. Its
touch screen. With ESP-LCD, users can easily realize a hardware network, and achieve remote or function materializes network configuration, firmware ESP32-Mesh Kit ESP32-Sense Kit
smart-touch control, data visualization, music playback, recording, etc. upgrade, debugging, LAN control and various application
demos.

The 4.3-inch TFT-LCD supports up


to a 480 × 800 resolution
Easy Self-forming Network with No extra
Initial start-up time is less than 200 ms and secure setup and self-healing standard security gateways required

Supporting LVGL GUI development,


music playback, and recording

Ultra-low-power consumption

ESP32-S2 ESP32-S3

ESP-Touch
ESP-BLE-MESH
A smart-touch solution based on ESP32-S2-Touch-DevKit-1, which is a board for evaluating and
developing different button functions, linear sliders, two-dimensional touch panels, proximity
sensors, etc.
ESP-BLE-MESH is an open-source protocol stack based on Zephyr Bluetooth® mesh. It supports
14 ESP32-S2 and ESP32-S3 feature 14 capacitive almost all core features, client models, and server models specified in the Bluetooth mesh protocol,
GPIOs touch GPIOs currently making it one of the most full-featured, open-source, Bluetooth mesh protocol implemen-
tations.
Waterproof surface

APIs Unified and user-friendly APIs in the SIG


ESP32-S2 Touch Element library

Supports coexistence Supports large-scale


Ultra-low-power consumption Fully Industrial-grade Fast distribution Supports friend feature with Wi-Fi & BR/EDR networks, without
SIG-qualified security network and low-power feature & Bluetooth LE routing tables

ESP-WIFI-MESH: [Link]/products/sdks/esp-wifi-mesh/overview
ESP-HMI: [Link]/solutions/hmi/esp-hmi
ESP-BLE-MESH: [Link]/products/sdks/esp-idf/esp-ble-mesh

19 20
Share :: Connect :: Innovate Share :: Connect :: Innovate
Solution

Solution
Device Connectivity Device Connectivity

ACK Solution ESP AWS IoT ExpressLink Solution


ESP32-PICO-V3-ZERO, the Alexa Connect Kit (ACK) module with an Espressif chipset, and its related Espressif’s AWS IoT ExpressLink module (ESP32-C3-MINI-1-N4-A) is based on the ESP32-C3 Wi-Fi +
development kit ESP32-PICO-V3-ZERO-DevKit provide an easy way for customers to build Alexa-connected Bluetooth 5 (LE) SoC, which provides host MCUs with out-of-the-box, seamless, AWS IoT connectivity, while
devices without worrying about writing an Alexa Skill and managing Cloud services, phone applications or also implementing the AWS IoT ExpressLink specification.
complex device firmware. Espressif’s ACK Solution provides Alexa connectivity and support features, such as
Frustration-Free Setup and Amazon Dash Replenishment. ESP32-C3-MINI-1-N4-A has a simple serial interface through
which the host MCU gets connected to AWS IoT services,
Software
Software thus transforming any offline product into a Cloud-connected
product. Espressif’s AWS IoT ExpressLink Module handles
ESP32-PICO-V3-ZERO comes pre-programmed with the ACK module firmware. It is also
complex, yet undifferentiated, workload, such as authentica-
pre-provisioned with credentials for connecting to an ACK-managed Cloud service. The Host MCU AWS IoT ExpressLink
tion, device management, connectivity, messaging and OTA.
ACK module firmware is managed by Amazon and provides out-of-box features such as Peripherals UART
Thus, it relieves developers from developing and maintaining
Frustration-Free Setup, Alexa connectivity and Amazon Dash Replenishment.
complex firmware, while it provides end-to-end security and Your
Application
IoT
Library
Radio
Library
Hardware
Security
fleet management at scale.

Software Features
ACS Solution
Amazon Common Software (ACS) for Devices is Amazon’s optimized software that simplifies the integration of Module pre-provisioned Firmware pre-programmed Out-of-the-box connectivity MQTT publish-subscribe messaging
various Amazon Device SDKs in your connected products. Espressif’s ESP32 SoC is a qualified platform for
ACS, supporting it with a stable and production-ready Device Porting Kit (DPK). With the ESP32 DPK,
developers can implement the required API for accessing device hardware, as well as for operating system
Wi-Fi configurability OTA upgrades AT commands for accessing all features
APIs and connectivity features. Combining the ESP32 DPK implementation with the ACS middleware and the
Amazon Device SDKs provides a well-maintained and well-tested development platform for your application.
Hardware Features
Application
Espressif provides a comprehensive software package that includes Amazon Device SDKs
Espressif’s Alexa for AWS IoT (AFI) SDK, a Frustration-Free Setup Frustration Free Setup AWS IoT
PCB external antenna connector
ESP32-C3 (Single-core, 32-bit RISC-V) 2.4 GHz Wi-Fi + Bluetooth 5 (LE)
Device SDK, ACS middleware, Espressif’s DPK implementation, ACS Middleware
and an example application. ESP32-Vaquita-DSPG is a develop- ESP DPK Implementation
ment board that can be used as a hardware platform for running the Connectivity API OS API Hardware API
13.2 mm x 16.6 mm International Certifications Security features
application based on this software. ESP-IDF Components

ESP32 SoC

ESP32-C3-AWS-ExpressLink-DevKit
The ESP32-C3-AWS-ExpressLink-DevKit is a development board that hosts Espressif’s
AWS IoT ExpressLink module. It can be used with an external host MCU for easy
evaluation and prototyping. The pin layout of ESP32-C3-AWS-ExpressLink-DevKit is
e
dul
Mo
ACK
10:45 am

compatible with that of the Arduino Zero development board and, therefore, it can be
directly plugged into the Arduino Zero board, or be easily connected to other host
MCUs, such as the Raspberry Pi.

ACK: [Link]/solutions/device-connectivity/ack-solution ESP AWS IoT ExpressLink: [Link]/solutions/device-connectivity/esp-aws-iot-expresslink


ACS: [Link]/solutions/device-connectivity/acs-solution AWS IoT ExpressLink: [Link]/iot-expresslink

21 22
Share :: Connect :: Innovate Share :: Connect :: Innovate
Solution

ESP Insights

ESP Insights is a device observability framework that allows developers to remotely peek into their
firmware, and get information about the firmware execution. This information can then be used for
analysing any issues and getting a deeper understanding of any problematic areas. Such a data-collecting
observation should help organisations save valuable engineering resources, allowing them to speed up
firmware development and fix any issues within a short time.

ESP Insights

ESP Insights SDK ESP Insights Managed ESP Insights


Cloud Service Dashboard

+ +

Features
Observing critical logs and errors that the firmware has generated during its execution.
In case of a firmware crash, users can observe the register dump and the backtrace, in order to
understand the root cause of the failure.
Examining the device timeline to find out events of interest and their sequence.
Adding custom events to the timeline.
Observing firmware metrics that consist of common system parameters such as free heap, largest
free memory block etc.
Defining and viewing certain variables of interest.

ESP Insights: [Link]/espressif/esp-insights

23
Share :: Connect :: Innovate
Support

Support
Espressif’s Customer Support
Hardware Resources and
Espressif supports customers, all the way from design to Reviewing Services
certification and manufacturing. Reference designs and hardware
design guidelines
Free-of-charge schematic and
PCB reviewing
Open-Source Documentation Response in 1-3 working days

Datasheets, technical reference


manuals, user guides, API
references, and test reports are
accessible for free.
Official forums where user requests
and questions are answered by
Espressif engineers. Manufacturing
Pre-provisioned modules with
device certificates
Customized services such as flash
Open-Source Software programming, MAC address, etc.

ESP-IDF, ESP-ADF, ESP-MDF,


ESP-WHO and ESP-Skainet
development frameworks are
accessible for free.

ESP-IoT-Solution, which contains


device drivers and code frameworks
for IoT development, is available to
anyone.
On-Site Support
In certain cases, technical support
may be provided directly on
customer premises by Espressif’s
most qualified engineers.
RF Design Review
RF
and Assistance
PCBA proofing, RF designing, RF By choosing our products and services, you get to con-
matching, debugging, and RF testing
are provided to our customers. centrate on your design, and bring your product to life
quickly, efficiently and securely.

 Contact us: [Link]/sales

24 25
Share :: Connect :: Innovate Share :: Connect :: Innovate
©
Disclaimer and Copyright Notice
Information in this brochure, including URL references, is subject to change without notice.

All third-party information in this brochure is provided as is with no warranty to its authenticity and accuracy.

No warranty is provided for this brochure about its merchantability, non-infringement of any proprietary rights, fitness for
any particular purpose, nor does any warranty otherwise arises out of any proposal, specification or sample.

All liability, including liability for infringement of any proprietary rights, relating to use of information in this brochure is
disclaimed. No licenses express or implied, by estoppel or otherwise, to any intellectual property rights are granted herein.

The Wi-Fi Alliance Member logo is a trademark of the Wi-Fi Alliance. The Bluetooth logo is a registered trademark of
Bluetooth SIG.

All trade names, trademarks and registered trademarks mentioned in this document are property of their respective
owners, and are hereby acknowledged.

Copyright © 2021 Espressif Systems (Shanghai) Co., Ltd. All rights reserved.

You might also like