瑞薩電子 E-AI與工業(yè)自動化

?2021

Renesas

Electronics

Corporation.Allrights

reserved.瑞薩電子E-AI與工業(yè)自動化2021年6月23日徐征高級總監(jiān)，工業(yè)自動化事業(yè)部瑞薩電子中國瑞薩電子SOC產(chǎn)品的技術(shù)節(jié)點·瑞薩為工業(yè)自動化市場服務(wù)了40年;我們了解客戶端對質(zhì)量、可靠性、實時控制和工業(yè)網(wǎng)絡(luò)的要求;我們希望擴(kuò)大與中國客戶的關(guān)系，并積極提供更好的產(chǎn)品和技術(shù)1stGate

Array@3um

CMOS

process40YearsExperienceASIC

(G/A)Process3um

CMOSprocess40nmprocess1.5umCMOSprocess0.35umCMOSprocess1.0umCMOSprocessServing

100s

of

customers28nmprocessPage

2?2021

Renesas

Electronics

Corporation.Allrights

reserved.瑞薩電子為工業(yè)自動化推出嵌入式人工智能解決方案，眾所周知，工業(yè)設(shè)備對實時處理能力要求高，所以嵌入式人工智能（E-AI）解決方案成為絕大多數(shù)客戶的首選。利用嵌入式E-AI使現(xiàn)有設(shè)備能夠使用人工智能進(jìn)行推理執(zhí)行從而實現(xiàn)終端智能化，制造商們可以直接將E-AI技術(shù)集成到工廠設(shè)備中。RZ/A

SeriesRZ/T

SeriesRZ/N

SeriesDisplay

SystemsHuman

Machine

InterfaceComputer

Vision

embedded-AIRZ/G

SeriesHigh

PerformanceHigh

Reliability3D

GraphicsFHD

and

UHD

VideoVerified

Linux

PackageIndustrial

Network

GatewayMulti

ProtocolPrecision

Real-Time

Motor

andDrive

ControlIndustrial

Ethernet“Application”“Graphics”“Network”“Real

Time”Industrial

vision

systemSurveillance

cameraSecurity

gatePage

3?2021

Renesas

Electronics

Corporation.Allrights

reserved.RZ/V

Series“Embedded

AI”HMIPCServerPLCCNCPLCController

NetworkSensorSensorRemote

IOInverterRobotServoServoField

NetworkSensor

NetworkMaster

Network

DeviceSlave

Network

Device工業(yè)自動化應(yīng)用中的瑞薩ASSPPage

4?2021

Renesas

Electronics

Corporation.Allrights

reserved.E-AI時代正在到來Page

5?2021

Renesas

Electronics

Corporation.Allrights

reserved.OTOperatingTechnology操作技術(shù)ITInformationTechnology信息技術(shù)實時推測認(rèn)知解決方案終端處學(xué)習(xí)Page

6?2021

Renesas

Electronics

Corporation.Allrights

reserved.DRP技術(shù)釋放E-AI能力負(fù)責(zé)操作技術(shù)的嵌入式系統(tǒng)的現(xiàn)有優(yōu)勢實時感應(yīng)/控制安全/穩(wěn)定eAI:

Embedded

Artificial

Intelligence嵌入式人工智能DRP:Dynamically

Reconfigurable

Processor動態(tài)可配置處理器推出采用DRP技術(shù)的新微處理器已運用于工業(yè)應(yīng)用領(lǐng)域創(chuàng)新解決方案實現(xiàn)終端智能化基于DRP技術(shù)的E-AI解決方案，增強(qiáng)工業(yè)互聯(lián)網(wǎng)設(shè)備、引領(lǐng)新市場Training

datacollectionExchangeAI

modelE-AITranslatorObjectCodeDatasetML

Framework

Trained

ModelTrainingDownloadTarget

BoardCameraDRP

LibraryResize,

Crop,Binarize,

etc...“Cat”95%PCTarget

DeviceRenesasDeliverablesLearningPhaseInferencePhasePre-processing(DRP)Inference(DRP-AI)InferenceResult我們的“E-AI”概念：培訓(xùn)和開發(fā)流程Page

7?2021

Renesas

Electronics

Corporation.Allrights

reserved.處理能力[性能]編程能力[靈活性]HighLowH/W(硬連接邏輯)CPU(軟件)HighLowDRP

-

“Dynamically

Reconfigurable

Processor”動態(tài)可重配置處理器，可以用C語言編程DRP可兼顧計算性能和靈活性運行時可重配置硬件強(qiáng)大的新一代處理器以及DRPPage

8?2021

Renesas

Electronics

Corporation.Allrights

reserved.INPUTOUTPUTDNN

containsPage

9?2021

Renesas

Electronics

Corporation.Allrights

reserved.?Convolution

Layer?Pooling

Layer?Full

Connected

Layer?Activation

FunctionMultiple

Parallel

Processing

is

RequiredRenesas

Utilizes

DRP

as

AI

AcceleratorDRP，隨著快速變化而加速的神經(jīng)網(wǎng)絡(luò)動態(tài)可配置高性能低功耗可編程多應(yīng)用場景快速推論適用更多終端定制算法Page

10?2021

Renesas

Electronics

Corporation.Allrights

reserved.DRP讓E-AI變得更有意義優(yōu)勢特點DRP設(shè)備E-AI解決方案瑞薩電子的新技術(shù)助力E-AIPage

11?2021

Renesas

Electronics

Corporation.Allrights

reserved.iRobot

Create-2UART-cableRZ/A2MboardCamera

module基于RZ/A2M的“高速圖像識別”GR-PEACH基于RZ/A1H的“手寫識別”loadFixingscrewAccelerometer(3-Axis

type)MotorRX66TboardVibrationwaveformFrequencycomponent

of

waveformAIinferenceresultNormalI

inferenceArFeasiullutreprobabilityFrequencycomponent

of

waveformAIinferenceresultVibration

waveformXScrew

loosened

!I

inferenceArFeasiullutreprobabilityYZXYZAbnormal基于RX66T的“電機(jī)故障檢測”Page

12?2021

Renesas

Electronics

Corporation.Allrights

reserved.E-AI應(yīng)用案例（部分實例樣本）移動物體追蹤“移動物體追蹤”解決方案亮相2021慕尼黑上海電子展“e星球創(chuàng)新應(yīng)用科技園”。該方案采用具有DRP（動態(tài)可配置處理器）技術(shù)的瑞薩RZ/A2M微處理器（MPU）以及僅一臺攝像機(jī)進(jìn)行圖像采集，控制和視覺處理?？刂菩盘栻?qū)動機(jī)械臂的運動，以實現(xiàn)物體的識別、追蹤和精確抓取。與其他機(jī)器視覺和圖像識別解決方案相比，具有DRP和E-AI（嵌入式人工智能）的RZ/A2M具有更高的速度和更好的電源效率。從圖像獲取到AI推理僅需2.5毫秒（400MHz）即可完成，功耗低至0.6W（僅A2M）、2.3W（帶A2M控制板）。E-AI技術(shù)可以將AI模型移植到微控制器（MCU）中，脫離云端的干涉，在本地完成AI的推論，極大提升了推論效率和穩(wěn)定性。Page

13?2021

Renesas

Electronics

Corporation.Allrights

reserved.移動物體追蹤（視頻）Page

14?2021

Renesas

Electronics

Corporation.Allrights

reserved.高性能和穩(wěn)定的執(zhí)行時間·

DRP能夠?qū)⒃创a轉(zhuǎn)換為硬件處理→DRP在每幀都沒有抖動CPU:

141.9ms

~

142.3msDRP：10.4ms，無抖動Page

15?2021

Renesas

Electronics

Corporation.Allrights

reserved.E-AI

“INDUSTRIAL

AUTOMATION

AWARD”Sensor

SignalPage

16?2021

Renesas

Electronics

Corporation.Allrights

reserved.E-AI：CIIF工業(yè)自動化獎RZ/N：最具創(chuàng)新性物聯(lián)網(wǎng)硬件Page17

?2021RenesasElectronics

Corporation.

All

rightsreserved.Page

17聯(lián)盟會員Page

18?2021

Renesas

Electronics

Corporation.Allrights

reserved.深度學(xué)習(xí)框架訓(xùn)練好的AI模型整合e2

studio開發(fā)環(huán)境開源CaffeTensorFlow

TM推論E-AI

CheckerE-AI

TranslatorMCU/MPU