DSP Cores vs. Chips
DSP Cores vs. Chips
EECC722 - Shaaban
#1 lec # 8 Fall 2003 10-8-2003
Processor Applications
• General Purpose Processors (GPPs) - high performance.
Increasing
– Alpha’s, SPARC, MIPS ...
– Used for general purpose software
– Heavy weight OS - UNIX, Windows
Cost
– Workstations, PC’s, Clusters
• Embedded processors and processor cores
– ARM, 486SX, Hitachi SH7000, NEC V800...
– Often require Digital signal processing (DSP) support.
– Single program
– Lightweight, often realtime OS
volume
Increasing
– Cellular phones, consumer electronics .. (e.g. CD players)
• Microcontrollers
– Extremely cost sensitive
– Small word size - 8 bit common
– Highest volume processors by far
– Control systems, Automobiles, toasters, thermostats, ...
EECC722 - Shaaban
#2 lec # 8 Fall 2003 10-8-2003
$30B Processor Markets
32-bit
micro
$5.2B/17%
$1.2B/4% 32 bit DSP
DSP $10B/33%
16-bit $5.7B/19%
micro
8-bit $9.3B/31%
micro
EECC722 - Shaaban
#3 lec # 8 Fall 2003 10-8-2003
The Processor Design Space
Application specific
architectures
for performance Microprocessors
Embedded
processors
Performance
Performance is
everything
& Software
rules
Microcontrollers
Cost is everything
Cost
EECC722 - Shaaban
#4 lec # 8 Fall 2003 10-8-2003
Requirements of Embedded Processors
• Optimized for a single program - code often in on-chip ROM
or off chip EPROM
• Minimum code size (one of the motivations initially for Java)
• Performance obtained by optimizing datapath
• Low cost
– Lowest possible area
– Technology behind the leading edge
– High level of integration of peripherals (reduces system cost)
• Fast time to market
– Compatible architectures (e.g. ARM) allows reusable code
– Customizable cores (System-on-Chip, SoC).
• Low power if application requires portability
EECC722 - Shaaban
#5 lec # 8 Fall 2003 10-8-2003
Area of processor cores = Cost
EECC722 - Shaaban
#9 lec # 8 Fall 2003 10-8-2003
Evolution of GPPs and DSPs
• General Purpose Processors (GPPs) trace roots back to Eckert, Mauchly,
Von Neumann (ENIAC)
• DSP processors are microprocessors designed for efficient mathematical
manipulation of digital signals.
– DSP evolved from Analog Signal Processors (ASPs), using analog
hardware to transform physical signals (classical electrical
engineering)
– ASP to DSP because
• DSP insensitive to environment (e.g., same response in snow or desert if it
works at all)
• DSP performance identical even with variations in components; 2 analog
systems behavior varies even if built with same components with 1%
variation
• Different history and different applications led to different terms,
different metrics, some new inventions.
EECC722 - Shaaban
#10 lec # 8 Fall 2003 10-8-2003
DSP vs. General Purpose CPUs
• DSPs tend to run one program, not many programs.
– Hence OSes are much simpler, there is no virtual memory or
protection, ...
• DSPs usually run applications with hard real-time
constraints:
– You must account for anything that could happen in a time
slot
– All possible interrupts or exceptions must be accounted for
and their collective time be subtracted from the time interval.
– Therefore, exceptions are BAD.
• DSPs usually process infinite continuous data streams.
• The design of DSP architectures and ISAs driven by the
requirements of DSP algorithms.
EECC722 - Shaaban
#11 lec # 8 Fall 2003 10-8-2003
DSP vs. GPP
• The “MIPS/MFLOPS” of DSPs is speed of Multiply-Accumulate (MAC).
– MAC is common in DSP algorithms that involve computing a vector dot product, such as
digital filters, correlation, and Fourier transforms.
– DSP are judged by whether they can keep the multipliers busy 100% of the time and by how
many MACs are performed in each cycle.
• The "SPEC" of DSPs is 4 algorithms:
– Inifinite Impule Response (IIR) filters
– Finite Impule Response (FIR) filters
– FFT, and
– convolvers
• In DSPs, target algorithms are important:
– Binary compatibility not a mojor issue
• High-level Software is not (yet) very important in DSPs.
– People still write in assembly language for a product to minimize the die area for
ROM in the DSP chip.
EECC722 - Shaaban
#12 lec # 8 Fall 2003 10-8-2003
TYPES OF DSP PROCESSORS
• 32-BIT FLOATING POINT (5% of market):
– TI TMS320C3X, TMS320C67xx
– AT&T DSP32C
– ANALOG DEVICES ADSP21xxx
– Hitachi SH-4
• 16-BIT FIXED POINT (95% of market):
– TI TMS320C2X, TMS320C62xx
– Infineon TC1xxx (TriCore1)
– MOTOROLA DSP568xx, MSC810x
– ANALOG DEVICES ADSP21xx
– Agere Systems DSP16xxx, Starpro2000
– LSI Logic LSI140x (ZPS400)
– Hitachi SH3-DSP
– StarCore SC110, SC140
EECC722 - Shaaban
#13 lec # 8 Fall 2003 10-8-2003
DSP Cores vs. Chips
DSP are usually available as synthesizable cores or off-the-
shelf chips
• Synthesizable Cores:
– Map into chosen fabrication process
• Speed, power, and size vary
– Choice of peripherals, etc. (SoC)
– Requires extensive hardware development effort.
• Off-the-shelf chips:
– Highly optimized for speed, energy efficiency, and/or cost.
– Limited performance, integration options.
– Tools, 3rd-party support often more mature
EECC722 - Shaaban
#14 lec # 8 Fall 2003 10-8-2003
DSP ARCHITECTURE
Enabling Technologies
EECC722 - Shaaban
#15 lec # 8 Fall 2003 10-8-2003
Texas Instruments TMS320 Family
Multiple DSP P Generations
First Bit Size Clock Instruction MAC MOPS Device density (#
Sample speed Throughput execution of transistors)
(MHz) (ns)
Uniprocessor
Based
(Harvard
Architecture)
TMS32010 1982 16 integer 20 5 MIPS 400 5 58,000 (3)
Multiprocessor
Based
TMS320C80 1996 32 integer/flt. 2 GOPS MIMD
120 MFLOP
TMS320C62XX 1997 16 integer 1600 MIPS 5 20 GOPS VLIW
TMS310C67XX 1997 32 flt. pt. 5 1 GFLOP VLIW
EECC722 - Shaaban
#16 lec # 8 Fall 2003 10-8-2003
DSP Applications
• Digital audio applications • Industrial control
– MPEG Audio • Seismic exploration
– Portable audio • Networking:
• Digital cameras – Wireless
• Cellular telephones – Base station
• Wearable medical appliances – Cable modems
• Storage products: – ADSL
– disk drive servo control – VDSL
• Military applications:
– radar
– sonar
EECC722 - Shaaban
#17 lec # 8 Fall 2003 10-8-2003
DSP Applications
DSP Algorithm System Application
Digital cellular telephones, personal communications systems, digital cordless telephones,
Speech Coding
multimedia computers, secure communications.
Digital cellular telephones, personal communications systems, digital cordless telephones,
Speech Encryption
secure communications.
Advanced user interfaces, multimedia workstations, robotics, automotive applications,
Speech Recognition
cellular telephones, personal communications systems.
Speech Synthesis Advanced user interfaces, robotics
Speaker Identification Security, multimedia workstations, advanced user interfaces
Consumer audio, consumer video, digital audio broadcast, professional audio, multimedia
High-fidelity Audio
computers
Digital cellular telephones, personal communications systems, digital cordless telephones,
Modems digital audio broadcast, digital signaling on cable TV, multimedia computers, wireless
computing, navigation, data/fax
Noise cancellation Professional audio, advanced vehicular audio, industrial applications
Audio Equalization Consumer audio, professional audio, advanced vehicular audio, music
Ambient Acoustics Emulation Consumer audio, professional audio, advanced vehicular audio, music
Audio Mixing/Editing Professional audio, music, multimedia computers
Sound Synthesis Professional audio, music, multimedia computers, advanced user interfaces
Security, multimedia computers, advanced user interfaces, instrumentation, robotics,
Vision
navigation
Image Compression Digital photography, digital video, multimedia computers, videoconferencing
Image Compositing Multimedia computers, consumer video, advanced user interfaces, navigation
Beamforming Navigation, medical imaging, radar/sonar, signals intelligence
Echo cancellation Speakerphones, hands-free cellular telephones
Spectral Estimation Signals intelligence, radar/sonar, professional audio, music
EECC722 - Shaaban
#18 lec # 8 Fall 2003 10-8-2003
Another Look at DSP Applications
Increasing
• High-end
– Military applications
– Wireless Base Station - TMS320C6000
Cost
– Cable modem
– gateways
• Mid-end
– Industrial control
– Cellular phone - TMS320C540
– Fax/ voice server
volume
Increasing
• Low end
– Storage products - TMS320C27
– Digital camera - TMS320C5000
– Portable phones
– Wireless headsets
– Consumer audio
– Automobiles, toasters, thermostats, ...
EECC722 - Shaaban
#19 lec # 8 Fall 2003 10-8-2003
DSP range of applications
EECC722 - Shaaban
#20 lec # 8 Fall 2003 10-8-2003
CELLULAR TELEPHONE SYSTEM
123 CONTROLLER 415-555-1212
456
789
0
PHYSICAL RF
LAYER BASEBAND
CONVERTER MODEM
PROCESSING
EECC722 - Shaaban
#21 lec # 8 Fall 2003 10-8-2003
HW/SW/IC PARTITIONING
MICROCONTROLLER
123
456 CONTROLLER 415-555-1212
789
0
PHYSICAL
BASEBAND RF
LAYER
ASIC CONVERTER MODEM
PROCESSING
DSP
ANALOG IC
EECC722 - Shaaban
#22 lec # 8 Fall 2003 10-8-2003
Mapping Onto System-on-Chip (SoC)
phone keypad
S/P
book intfc
S/P
RAM
RAM µC
DMA speech
voice
quality
recognition
enhancment
ASIC DSP RPE-LTP
de-intl &
LOGIC CORE decoder speech decoder
demodulator
and Viterbi
synchronizer equalizer
EECC722 - Shaaban
#23 lec # 8 Fall 2003 10-8-2003
Example Wireless Phone Organization
C540
ARM7
EECC722 - Shaaban
#24 lec # 8 Fall 2003 10-8-2003
Multimedia I/O Architecture
Radio Embedded
Modem Processor
Sched ECC Interface
Pact
Low Power Bus
EECC722 - Shaaban
#25 lec # 8 Fall 2003 10-8-2003
Multimedia System-on-Chip (SoC)
E.g. Multimedia terminal electronics
Graphics Out
Uplink Radio Video I/O
Pen In
Coms
specific algorithms and I/O
Memory
DSP
EECC722 - Shaaban
#26 lec # 8 Fall 2003 10-8-2003
DSP Algorithm Format
EECC722 - Shaaban
#27 lec # 8 Fall 2003 10-8-2003
DSP Algorithm Notation
• Uses “flowchart” notation instead of equations
• Multiply is or
X
• Add is or
+
• Delay/Storage is or or
Delay z–1 D
EECC722 - Shaaban
#28 lec # 8 Fall 2003 10-8-2003
Typical DSP Algorithm:
Finite-Impulse Response (FIR) Filter
• Filters reduce signal noise and enhance image or signal quality by
removing unwanted frequencies.
• Finite Impulse Response (FIR) filters compute:
N 1
where
y (i ) h(k ) x(i k ) h(n) * x(n)
– 0
x is the inputksequence
– y is the output sequence
– h is the impulse response (filter coefficients)
– N is the number of taps (coefficients) in the filter
• Output sequence depends only on input sequence and impulse
response.
EECC722 - Shaaban
#29 lec # 8 Fall 2003 10-8-2003
Typical DSP Algorithm:
Finite-impulse Response (FIR) Filter
• N most recent samples in the delay line (Xi)
• New sample moves data down delay line
• “Tap” is a multiply-add
• Each tap (N taps total) nominally requires:
– Two data fetches
– Multiply
– Accumulate
– Memory write-back to update delay line
• Goal: at least 1 FIR Tap / DSP instruction cycle
EECC722 - Shaaban
#30 lec # 8 Fall 2003 10-8-2003
FINITE-IMPULSE RESPONSE (FIR) FILTER
X ....
Z 1 Z 1 Z 1
h0 h1 hN-2 hN-1
A Tap N 1
y (i ) h(k ) x(i k )
k 0
Goal: at least 1 FIR Tap / DSP instruction cycle
EECC722 - Shaaban
#31 lec # 8 Fall 2003 10-8-2003
Sample Computational Rates
for FIR Filtering
Signal type Frequency # taps Performance
1-D FIR has nop = 2N and a 2-D FIR has nop = 2N2.
EECC722 - Shaaban
#32 lec # 8 Fall 2003 10-8-2003
FIR filter on (simple)
General Purpose Processor
loop:
lw x0, 0(r0)
lw y0, 0(r1)
mul a, x0,y0
add y0,a,b
sw y0,(r2)
inc r0
inc r1
inc r2
dec ctr
tst ctr
jnz loop
• Problems: Bus / memory bandwidth bottleneck, control code
overhead
EECC722 - Shaaban
#33 lec # 8 Fall 2003 10-8-2003
Typical DSP Algorithm:
Infinite-Impulse Response (IIR) Filter
• Infinite Impulse Response (IIR) filters compute:
M 1 N 1
y (i ) a(k ) y(i k ) b(k ) x(i k )
k 1 k 0
• Output sequence depends on input sequence, previous
outputs, and impulse response.
• Both FIR and IIR filters
– Require dot product (multiply-accumulate) operations
– Use fixed coefficients
• Adaptive filters update their coefficients to minimize the
distance between the filter output and the desired signal.
EECC722 - Shaaban
#34 lec # 8 Fall 2003 10-8-2003
Typical DSP Algorithm:
Discrete Fourier Transform
• The Discrete Fourier Transform (DFT) allows for spectral
analysis in the frequency domain.
• It is computed as
N 1 2 j
y (k ) WN x(n)
nk
WN e N j 1
for k = 0, 1, … , N-1,
n 0 where
– x is the input sequence in the time domain
– y is an output sequence in the frequency domain
• The Inverse Discrete Fourier Transform is computed as
EECC722 - Shaaban
#35 lec # 8 Fall 2003 10-8-2003
Typical DSP Algorithm:
Discrete Cosine Transform (DCT)
• The Discrete Cosine Transform (DCT) is frequently used in
video compression (e.g., MPEG-2).
• The DCT and Inverse DCT (IDCT) are computed as:
N 1
(2n 1)k
y (k ) e(k ) cos[ ]x(n), for k 0, 1, ... N - 1
n 0 2N
2 N 1
(2n 1)k
x ( n)
N
e(k ) cos[ 2 N ] y(n), for k 0, 1, ... N - 1
k 0
EECC722 - Shaaban
#36 lec # 8 Fall 2003 10-8-2003
DSP BENCHMARKS
• DSPstone: University of Aachen, application benchmarks
– ADPCM TRANSCODER - CCITT G.721, REAL_UPDATE, COMPLEX_UPDATES
– DOT_PRODUCT, MATRIX_1X3, CONVOLUTION
– FIR, FIR2DIM, HR_ONE_BIQUAD
– LMS, FFT_INPUT_SCALED
EECC722 - Shaaban
#37 lec # 8 Fall 2003 10-8-2003
EECC722 - Shaaban
#38 lec # 8 Fall 2003 10-8-2003
Basic Architectural Features of DSPs
• Data path configured for DSP
– Fixed-point arithmetic
– MAC- Multiply-accumulate
• Multiple memory banks and buses -
– Harvard Architecture
– Multiple data memories
• Specialized addressing modes
– Bit-reversed addressing
– Circular buffers
• Specialized instruction set and execution control
– Zero-overhead loops
– Support for fast MAC
– Fast Interrupt Handling
• Specialized peripherals for DSP
EECC722 - Shaaban
#39 lec # 8 Fall 2003 10-8-2003
DSP Data Path: Arithmetic
• DSPs dealing with numbers representing real world
=> Want “reals”/ fractions
• DSPs dealing with numbers for addresses
=> Want integers
• Support “fixed point” as well as integers
S. -1 Š x < 1
radix
point
S .
radix
–2N–1 Š x < 2N–1
point
EECC722 - Shaaban
#40 lec # 8 Fall 2003 10-8-2003
DSP Data Path: Precision
• Word size affects precision of fixed point numbers
• DSPs have 16-bit, 20-bit, or 24-bit data words
• Floating Point DSPs cost 2X - 4X vs. fixed point, slower than
fixed point
• DSP programmers will scale values inside code
– SW Libraries
– Separate explicit exponent
• “Blocked Floating Point” single exponent for a group of
fractions
• Floating point support simplify development
EECC722 - Shaaban
#41 lec # 8 Fall 2003 10-8-2003
DSP Data Path: Overflow
• DSP are descended from analog :
– Modulo Arithmetic.
• Set to most positive (2N–1–1) or
most negative value(–2N–1) : “saturation”
• Many DSP algorithms were developed in this
model.
EECC722 - Shaaban
#42 lec # 8 Fall 2003 10-8-2003
DSP Data Path: Multiplier
EECC722 - Shaaban
#43 lec # 8 Fall 2003 10-8-2003
DSP Data Path: Accumulator
• Don’t want overflow or have to scale accumulator
• Option 1: accumalator wider than product:
“guard bits”
– Motorola DSP:
24b x 24b => 48b product, 56b Accumulator
• Option 2: shift right and round product before adder
Multiplier
Multiplier
Shift
ALU ALU
Accumulator G Accumulator
EECC722 - Shaaban
#44 lec # 8 Fall 2003 10-8-2003
DSP Data Path: Rounding
• Even with guard bits, will need to round when store accumulator into
memory
• 3 DSP standard options
• Truncation: chop results
=> biases results up
• Round to nearest:
< 1/2 round down, 1/2 round up (more positive)
=> smaller bias
• Convergent:
< 1/2 round down, > 1/2 round up (more positive), = 1/2 round to
make lsb a zero (+1 if 1, +0 if 0)
=> no bias
IEEE 754 calls this round to nearest even
EECC722 - Shaaban
#45 lec # 8 Fall 2003 10-8-2003
Data Path Comparison
DSP Processor General-Purpose Processor
EECC722 - Shaaban
#46 lec # 8 Fall 2003 10-8-2003
TI 320C54x DSP (1995) Functional Block Diagram
EECC722 - Shaaban
#47 lec # 8 Fall 2003 10-8-2003
First Commercial DSP (1982): Texas
Instruments TMS32010
Instruction
Memory
• 16-bit fixed-point arithmetic
Processor
• Introduced at 5Mhz (200ns)
Data
instruction cycle. Memory
• “Harvard architecture” Datapath:
– separate instruction, Mem
data memories T-Register
• Accumulator
• Specialized instruction set Multiplier
– Load and Accumulate P-Register
ALU
• Two-cycle (400 ns) Multiply-
Accumulate (MAC) time.
Accumulator
EECC722 - Shaaban
#48 lec # 8 Fall 2003 10-8-2003
First Generation DSP P
Texas Instruments TMS32010 - 1982
Features
EECC722 - Shaaban
#49 lec # 8 Fall 2003 10-8-2003
TMS32010 BLOCK DIAGRAM
EECC722 - Shaaban
#50 lec # 8 Fall 2003 10-8-2003
TMS32010 FIR Filter Code
EECC722 - Shaaban
#51 lec # 8 Fall 2003 10-8-2003
Micro-architectural impact - MAC
N1
h(m)x(n m)
element of finite-impulse
y(n) response filter computation
0 X Y
MPY
ADD/SUB
ACC REG
EECC722 - Shaaban
#52 lec # 8 Fall 2003 10-8-2003
Mapping of the filter onto a DSP execution unit
4 6
1 3 5
Xn X Yn 1 2
2
Y X
6
D
n-1
4
5 D
3
EECC722 - Shaaban
#53 lec # 8 Fall 2003 10-8-2003
MAC Eg. - 320C54x DSP Functional Block Diagram
EECC722 - Shaaban
#54 lec # 8 Fall 2003 10-8-2003
DSP Memory
• FIR Tap implies multiple memory accesses
• DSPs require multiple data ports
• Some DSPs have ad hoc techniques to reduce memory bandwdith
demand:
– Instruction repeat buffer: do 1 instruction 256 times
– Often disables interrupts, thereby increasing interrupt response time
• Some recent DSPs have instruction caches
– Even then may allow programmer to “lock in” instructions into cache
– Option to turn cache into fast program memory
• No DSPs have data caches.
• May have multiple data memories
EECC722 - Shaaban
#55 lec # 8 Fall 2003 10-8-2003
Conventional ``Von Neumann’’ memory
EECC722 - Shaaban
#56 lec # 8 Fall 2003 10-8-2003
HARVARD MEMORY ARCHITECTURE in DSP
PROGRAM
X MEMORY Y MEMORY
MEMORY
GLOBAL
P DATA
X DATA
Y DATA
EECC722 - Shaaban
#57 lec # 8 Fall 2003 10-8-2003
Memory Architecture Comparison
DSP Processor General-Purpose Processor
• Harvard architecture • Von Neumann architecture
• 2-4 memory accesses/cycle • Typically 1 access/cycle
• No caches-on-chip SRAM • Use caches
Program
Memory
Processo Processor Memory
r Data
Memory
EECC722 - Shaaban
#58 lec # 8 Fall 2003 10-8-2003
Eg. TMS320C3x MEMORY BLOCK DIAGRAM - Harvard
Architecture
EECC722 - Shaaban
#59 lec # 8 Fall 2003 10-8-2003
Eg. TI 320C62x/67x DSP (1997)
EECC722 - Shaaban
#60 lec # 8 Fall 2003 10-8-2003
DSP Addressing
• Have standard addressing modes: immediate,
displacement, register indirect
• Want to keep MAC datapath busy
• Assumption: any extra instructions imply clock cycles
of overhead in inner loop
=> complex addressing is good
=> don’t use datapath to calculate fancy address
• Autoincrement/Autodecrement register indirect
– lw r1,0(r2)+ => r1 <- M[r2]; r2<-r2+1
– Option to do it before addressing, positive or negative
EECC722 - Shaaban
#61 lec # 8 Fall 2003 10-8-2003
DSP Addressing: FFT
• FFTs start or end with data in bufferfly order
0 (000) => 0 (000)
1 (001) => 4 (100)
2 (010) => 2 (010)
3 (011) => 6 (110)
4 (100) => 1 (001)
5 (101) => 5 (101)
6 (110) => 3 (011)
7 (111) => 7 (111)
• What can do to avoid overhead of address checking instructions for FFT?
• Have an optional “bit reverse” address addressing mode for use with autoincrement
addressing
• Many DSPs have “bit reverse” addressing for radix-2 FFT
EECC722 - Shaaban
#62 lec # 8 Fall 2003 10-8-2003
BIT REVERSED ADDRESSING
000 x(0) F(0)
EECC722 - Shaaban
#64 lec # 8 Fall 2003 10-8-2003
CIRCULAR BUFFERS
EECC722 - Shaaban
#65 lec # 8 Fall 2003 10-8-2003
Addressing Comparison
DSP Processor General-Purpose Processor
• Dedicated address • Often, no separate address
generation units generation unit
• Specialized addressing • General-purpose addressing
modes; e.g.: modes
– Autoincrement
– Modulo (circular)
– Bit-reversed (for FFT)
• Good immediate data
support
EECC722 - Shaaban
#66 lec # 8 Fall 2003 10-8-2003
Address calculation unit for DSPs
EECC722 - Shaaban
#67 lec # 8 Fall 2003 10-8-2003
DSP Instructions and Execution
• May specify multiple operations in a single instruction
• Must support Multiply-Accumulate (MAC)
• Need parallel move support
• Usually have special loop support to reduce branch overhead
– Loop an instruction or sequence
– 0 value in register usually means loop maximum number of
times
– Must be sure if calculate loop count that 0 does not mean 0
• May have saturating shift left arithmetic
• May have conditional execution to reduce branches
EECC722 - Shaaban
#68 lec # 8 Fall 2003 10-8-2003
ADSP 2100: ZERO-OVERHEAD LOOP
EECC722 - Shaaban
#69 lec # 8 Fall 2003 10-8-2003
Instruction Set Comparison
DSP Processor General-Purpose Processor
EECC722 - Shaaban
#70 lec # 8 Fall 2003 10-8-2003
Specialized Peripherals for DSPs
• Synchronous serial ports
• Host ports
• Parallel ports Instruction
Memory
• Timers
DSP
Core • Bit I/O ports
• On-chip DMA
Serial Ports
• On-chip A/D, D/A A/D Converter Data
EECC722 - Shaaban
#71 lec # 8 Fall 2003 10-8-2003
Specialized DSP peripherals
EECC722 - Shaaban
#72 lec # 8 Fall 2003 10-8-2003
TI TMS320C203/LC203 BLOCK DIAGRAM
DSP Core Approach - 1995
EECC722 - Shaaban
#73 lec # 8 Fall 2003 10-8-2003
Summary of Architectural Features of DSPs
• Data path configured for DSP
– Fixed-point arithmetic
– MAC- Multiply-accumulate
• Multiple memory banks and buses -
– Harvard Architecture
– Multiple data memories
• Specialized addressing modes
– Bit-reversed addressing
– Circular buffers
• Specialized instruction set and execution control
– Zero-overhead loops
– Support for MAC
• Specialized peripherals for DSP
EECC722 - Shaaban
#74 lec # 8 Fall 2003 10-8-2003
DSP Software Development Considerations
• Different from general-purpose software development:
– Resource-hungry, complex algorithms.
– Specialized and/or complex processor architectures.
– Severe cost/storage limitations.
– Hard real-time constraints.
– Optimization is essential.
– Increased testing challenges.
• Essential tools:
– Assembler, linker.
– Instruction set simulator.
– HLL Code generation: C compiler.
– Debugging and profiling tools.
• Increasingly important:
– Software libraries.
– Real-time operating systems.
EECC722 - Shaaban
#75 lec # 8 Fall 2003 10-8-2003
Classification of Current DSP Architectures
EECC722 - Shaaban
#76 lec # 8 Fall 2003 10-8-2003
A Conventional DSP:
TI TMSC54xx
• 16-bit fixed-point DSP.
• Issues one 16-bit instruction/cycle
• Modified Harvard memory architecture
• Peripherals typical of conventional DSPs:
– 2-3 synch. Serial ports, parallel port
– Bit I/O, Timer, DMA
• Inexpensive (100 MHz ~$5 qty 10K).
• Low power (60 mW @ 1.8V, 100 MHz).
EECC722 - Shaaban
#77 lec # 8 Fall 2003 10-8-2003
A Current Conventional DSP:
TI TMSC54xx
EECC722 - Shaaban
#78 lec # 8 Fall 2003 10-8-2003
An Enhanced Conventional DSP:
TI TMSC55xx
• The TMS320C55xx is based on Texas Instruments' earlier TMS320C54xx
family, but adds significant enhancements to the architecture and instruction
set, including:
– Two instructions/cycle
• Instructions are scheduled for parallel execution by the assembly programmer or
compiler.
– Two MAC units.
• Complex, compound instructions:
– Assembly source code compatible with C54xx
– Mixed-width instructions: 8 to 48 bits.
– 200 MHz @ 1.5 V, ~130 mW , $17 qty 10k
• Poor compiler target.
EECC722 - Shaaban
#79 lec # 8 Fall 2003 10-8-2003
An Enhanced Conventional DSP:
TI TMSC55xx
EECC722 - Shaaban
#80 lec # 8 Fall 2003 10-8-2003
16-bit Fixed-Point VLIW DSP:
TI TMS320C6201 Revision 2 (1997)
The TMS320C62xx is the
Program Cache / Program Memory
32-bit address, 256-Bit data512K Bits RAM
first fixed-point DSP
processor from Texas Pwr C6201 CPU Megamodule
Dwn Program Fetch
Instruments that is based Instruction Dispatch
Control
Host Registers
Port
on a VLIW-like architecture Interface
Instruction Decode
Control
Data Path 1 Data Path 2
which allows it to execute up 4-DMA A Register File B Register File
Logic
Test
to eight 32-bit RISC-like Emulation
L1 S1 M1 D1 D2 M2 S2 L2
Ext. Interrupts
instructions per clock cycle.
Memory
Interface
2 Timers
2 Multi-
Data Memory channel
buffered
32-Bit address, 8-, 16-, 32-Bit data serial ports
(T1/E1)
512K Bits RAM
EECC722 - Shaaban
#81 lec # 8 Fall 2003 10-8-2003
C6201 Internal Memory Architecture
• Separate Internal Program and Data Spaces
• Program
– 16K 32-bit instructions (2K Fetch Packets)
– 256-bit Fetch Width
– Configurable as either
• Direct Mapped Cache, Memory Mapped Program Memory
• Data
– 32K x 16
– Single Ported Accessible by Both CPU Data Buses
– 4 x 8K 16-bit Banks
• 2 Possible Simultaneous Memory Accesses (4 Banks)
• 4-Way Interleave, Banks and Interleave Minimize Access Conflicts
EECC722 - Shaaban
#82 lec # 8 Fall 2003 10-8-2003
C62x Datapaths
Registers A0 - A15 Registers B0 - B15
1X 2X
S1 S2 D DL SL SL DL D S S D S S D S S S S D S S D S S D DL SL SL DL D S2 S1
1 2 1 2 1 2 2 1 2 1 2 1
L1 S1 M1 D1 D2 M2 S2 L2
DDATA_I1 DDATA_I2
(load data) (load data)
Cross Paths
40-bit Write Paths (8 MSBs)
40-bit Read Paths/Store Paths
EECC722 - Shaaban
#83 lec # 8 Fall 2003 10-8-2003
C62x Functional Units
• L-Unit (L1, L2)
– 40-bit Integer ALU, Comparisons
– Bit Counting, Normalization
EECC722 - Shaaban
#84 lec # 8 Fall 2003 10-8-2003
C62x Instruction Packing
Instruction Packing Advanced VLIW
Example 1
• Fetch Packet
A B C D E F G H – CPU fetches 8 instructions/cycle
• Execute Packet
A – CPU executes 1 to 8 instructions/cycle
B – Fetch packets can contain multiple execute packets
F G H
EECC722 - Shaaban
#85 lec # 8 Fall 2003 10-8-2003
C62x Pipeline Operation
Pipeline Phases
Fetch Decode Execute
PG PS PW PR DP DC E1 E2 E3 E4 E5
• Single-Cycle Throughput
• Decode
• Operate in Lock Step
– DP Instruction Dispatch
• Fetch – DC Instruction Decode
– PG Program Address Generate • Execute
– PS Program Address Send – E1 - E5 Execute 1 through Execute 5
– PW Program Access Ready Wait
– PR Program Fetch Packet Receive
PG PS PW PR DP DC E1 E2 E3 E4 E5
Execute Packet 2 PG PS PW PR DP DC E1 E2 E3 E4 E5
Execute Packet 3 PG PS PW PR DP DC E1 E2 E3 E4 E5
Execute Packet 4 PG PS PW PR DP DC E1 E2 E3 E4 E5
Execute Packet 5 PG PS PW PR DP DC E1 E2 E3 E4 E5
Execute Packet 6 PG PS PW PR DP DC E1 E2 E3 E4 E5
Execute Packet 7 PG PS PW PR DP DC E1 E2 E3 E4 E5
EECC722 - Shaaban
#86 lec # 8 Fall 2003 10-8-2003
C62x Pipeline Operation
Delay Slots
• Delay Slots: number of extra cycles until result is:
– written to register file
– available for use by a subsequent instructions
– Multi-cycle NOP instruction can fill delay slots while minimizing
code size impact
EECC722 - Shaaban
#87 lec # 8 Fall 2003 10-8-2003
C6000 Instruction Set Features
Conditional Instructions
EECC722 - Shaaban
#88 lec # 8 Fall 2003 10-8-2003
C6000 Instruction Set Addressing
Features
• Load-Store Architecture
• Two Addressing Units (D1, D2)
• Orthogonal
– Any Register can be used for Addressing or Indexing
• Signed/Unsigned Byte, Half-Word, Word, Double-
Word Addressable
– Indexes are Scaled by Type
• Register or 5-Bit Unsigned Constant Index
EECC722 - Shaaban
#89 lec # 8 Fall 2003 10-8-2003
C6000 Instruction Set Addressing
Features
• Indirect Addressing Modes
– Pre-Increment *++R[index]
– Post-Increment *R++[index]
– Pre-Decrement *--R[index]
– Post-Decrement *R--[index]
– Positive Offset *+R[index]
– Negative Offset *-R[index]
• 15-bit Positive/Negative Constant Offset from Either B14 or
B15
• Circular Addressing
– Fast and Low Cost: Power of 2 Sizes and Alignment
– Up to 8 Different Pointers/Buffers, Up to 2 Different Buffer Sizes
• Dual Endian Support
EECC722 - Shaaban
#90 lec # 8 Fall 2003 10-8-2003
EECC722 - Shaaban
#91 lec # 8 Fall 2003 10-8-2003
EECC722 - Shaaban
#92 lec # 8 Fall 2003 10-8-2003
TI TMS320C64xx
• Announced in February 2000, the TMS320C64xx is an extension of
Texas Instruments' earlier TMS320C62xx architecture.
• The TMS320C64xx has 64 32-bit general-purpose registers, twice as
many as the TMS320C62xx.
• The TMS320C64xx instruction set is a superset of that used in the
TMS320C62xx, and, among other enhancements, adds significant
SIMD processing capabilities:
– 8-bit operations for image/video processing.
• 600 MHz clock speed, but:
– 11-stage pipeline with long latencies
– Dynamic caches.
• $100 qty 10k.
• The only DSP family with compatible fixed and floating-point versions.
EECC722 - Shaaban
#93 lec # 8 Fall 2003 10-8-2003
Superscalar DSP:
LSI Logic ZSP400
• A 4-way superscalar dynamically scheduled 16-bit fixed-
point DSP core.
• 16-bit RISC-like instructions
• Separate on-chip caches for instructions and data
• Two MAC units, two ALU/shifter units
– Limited SIMD support.
– MACS can be combined for 32-bit operations.
• Disadvantage:
– Dynamic behavior complicates DSP software development:
• Ensuring real-time behavior
• Optimizing code.
EECC722 - Shaaban
#94 lec # 8 Fall 2003 10-8-2003
EECC722 - Shaaban
#95 lec # 8 Fall 2003 10-8-2003
Computing Engine Choices
• General Purpose Processors (GPPs): Intended for general purpose computing
(desktops, servers, clusters..) General Purpose ISAs (RISC or CISC)
• Application-Specific Processors (ASPs): Processors with ISAs and architectural
features tailored towards specific application domains
– E.g Digital Signal Processors (DSPs), Network Processors (NPs), Media Processors, Graphics
Processing Units (GPUs), Vector Processors??? ...
Special Purpose ISAs
• Co-Processors: A hardware (hardwired) implementation of specific algorithms with
limited programming interface (augment GPPs or ASPs)
• Configurable Hardware:
– Field Programmable Gate Arrays (FPGAs)
– Configurable array of simple processing elements
• Application Specific Integrated Circuits (ASICs): A custom VLSI hardware solution
for a specific computational task
• The choice of one or more depends on a number of factors including:
- Type and complexity of computational algorithm
(general purpose vs. Specialized)
- Desired level of flexibility and programmability
- Performance requirements
- Desired level of computational efficiency
(e.g Computations per watt or computations per chip area)
- Power requirements - Real-time constraints
- Development time and cost - System cost
EECC722 - Shaaban
#96 lec # 8 Fall 2006 10-16-2006
Computing Engine Choices
e.g Digital Signal Processors (DSPs),
Programmability / Flexibility
Configurable Hardware
Selection Factors:
-Type and complexity of computational algorithm
(general purpose vs. Specialized) Co-Processors
- Desired level of flexibility and programmability Application Specific
- Performance requirements Integrated Circuits
- Desired level of computational efficiency (ASICs)
- Power requirements - Real-time constraints
- Development time and cost - System cost
EECC722 - Shaaban
#97 lec # 8 Fall 2006 10-16-2006
Why Application-Specific Processors (ASPs)?
EECC722 - Shaaban
#99 lec # 8 Fall 2006 10-16-2006
Main Processor Types/Applications
• General Purpose Computing & General Purpose Processors (GPPs) –
Cost/Complexity
– High performance: In general, faster is always better.
– RISC or CISC: Intel P4, IBM Power4, SPARC, PowerPC, MIPS ...
– Used for general purpose software
– End-user programmable
Increasing
– Real-time performance may not be fully predictable (due to dynamic arch. features)
– Heavy weight, multi-tasking OS - Windows, UNIX
– Normally, low cost and power not a requirement (changing)
– Servers, Workstations, Desktops (PC’s), Notebooks, Clusters …
• Embedded Processing: Embedded processors and processor cores
– Cost, power code-size and real-time requirements and constraints
– Once real-time constraints are met, a faster processor may not be better
– e.g: Intel XScale, ARM, 486SX, Hitachi SH7000, NEC V800...
– Often require Digital signal processing (DSP) support or other
application-specific support (e.g network, media processing)
– Single or few specialized programs – known at system design time
– Not end-user programmable
– Real-time performance must be fully predictable (avoid dynamic arch. features)
– Lightweight, often realtime OS or no OS
volume
Increasing
– Examples: Cellular phones, consumer electronics .. …
• Microcontrollers
– Extremely code size/cost/power sensitive
– Single program
– Small word size - 8 bit common
– Usually no OS
– Highest volume processors by far
– Examples: Control systems, Automobiles, industrial control, thermostats, ...
Specialized applications
Low power/cost constraints Performance is
everything
& Software rules
Microcontrollers
Cost is everything
Chip Area, Power Processor Cost
complexity
EECC722 - Shaaban
#101 lec # 8 Fall 2006 10-16-2006
Requirements of Embedded Processors
• Usually must meet strict real-time constraints:
– Real-time performance must be fully predictable:
• Avoid dynamic processor architectural features that make real-time performance
harder to predict ( e.g cache, dynamic scheduling, hardware speculation …)
– Once real-time constraints are met, a faster processor is not desirable (overkill)
due to increased cost/power requirements.
• Optimized for a single (or few) program (s) - code often in on-chip ROM or on/off
chip EPROM/flash memory.
• Minimum code size (one of the motivations initially for Java)
• Performance obtained by optimizing datapath
• Low cost
– Lowest possible area
• High computational efficiency: Computation per unit area
– VLSI implementation technology usually behind the leading edge
– High level of integration of peripherals (System-on-Chip -SoC- approach reduces system
cost/power)
• Fast time to market
– Compatible architectures (e.g. ARM family) allows reusable code
– Customizable cores (System-on-Chip, SoC).
• Low power if application requires portability
EECC722 - Shaaban
#102 lec # 8 Fall 2006 10-16-2006
Embedded Processors
Area of processor cores = Cost
(and Power requirements)
• If a majority of the chip is the program stored in ROM, then minimizing code size is a critical issue
• Common embedded processor ISA features to minimize code size:
– Variable length instruction encoding common:
• e.g. the Piranha has 3 sized instructions - basic 2 byte, and 2 byte plus 16 or 32 bit immediate
– Complex/specialized instructions
– Complex addressing modes
EECC722 - Shaaban
#105 lec # 8 Fall 2006 10-16-2006
Embedded Systems vs. General Purpose Computing
Embedded General Purpose Computing Systems
Systems
(and embedded processors) (and processors GPPs)
Run a single or few specialized applications Used for general purpose software :
often known at system design time Intended to run a fully general set of applications
that may not be known at design time
May require application-specific capability No application-specific capability required
(e.g DSP)
Not end-user programmable End-user programmable
Minimum code size is highly desirable Minimizing code size is not an issue
Lightweight, often real-time OS or no OS Heavy weight, multi-tasking OS - Windows, UNIX
Low power and cost constraints/requirements Higher power and cost constraints/requirements
Usually must meet strict real-time constraints In general, no real-time constraints
–(e.g. real-time sampling rate)
Real-time performance must be fully Real-time performance may not be fully predictable
predictable: (due to dynamic processor architectural features):
•Avoid dynamic processor architectural features •Superscalar: dynamic scheduling, hardware
that make real-time performance harder to speculation, branch prediction, cache.
predict
Once real-time constraints are met, a faster Faster (higher-performance) is always better
processor is not desirable (overkill) due to
increased cost/power requirements.
EECC722 - Shaaban
#106 lec # 8 Fall 2006 10-16-2006
Evolution of GPPs and DSPs
• General Purpose Processors (GPPs) trace roots back to Eckert, Mauchly, Von
Neumann (ENIAC) + EDSAC
• Digital Signal Processors (DSPs) are microprocessors designed for efficient
mathematical manipulation of digital signals utilizing digital signal processing
algorithms.
– DSPs usually process infinite continuous sampled data streams (signals)
while meeting real-time and power constraints.
– DSPs evolved from Analog Signal Processors (ASPs) that utilize analog
hardware to transform physical signals (classical electrical engineering)
– ASP to DSP because:
• DSP insensitive to environment (e.g., same response in snow or desert if it
works at all)
• DSP performance identical even with variations in components; 2 analog
systems behavior varies even if built with same components with 1% variation
• Different history and different applications requirements led to different
terms, different metrics, architectures, some new inventions.
EECC722 - Shaaban
#107 lec # 8 Fall 2006 10-16-2006
DSP vs. General Purpose CPUs
• DSPs tend to run one (or few) program(s), not many programs.
– Hence OSes (if any) are much simpler, there is no virtual memory or protection, ...
• DSPs usually run applications with hard real-time constraints:
– DSP must meet application signal sampling rate computational requirements:
• A faster DSP is overkill (higher DSP cost, power..)
– You must account for anything that could happen in a time slot (DSP algorithm
inner-loop, data sampling rate)
– All possible interrupts or exceptions must be accounted for and their collective
time be subtracted from the time interval.
• Therefore, exceptions are BAD.
• DSPs usually process infinite continuous data streams:
– Requires high memory bandwidth (with predictable latency, e.g no data cache) for
streaming real-time data samples and predictable processing time on the data
samples
• The design of DSP ISAs and processor architectures is driven by the
requirements of DSP algorithms.
– Thus DSPs are application-specific processors
EECC722 - Shaaban
#108 lec # 8 Fall 2006 10-16-2006
DSP vs. GPP
• The “MIPS/MFLOPS” of DSPs is speed of Multiply-Accumulate (MAC).
– MAC is common
i.e Maininperformance
DSP algorithms thatofinvolve
measure DSPs iscomputing
MAC speeda vector dot product, such as
digital filters, correlation, and Fourier transforms.
Why?
– DSP are judged by whether they can keep the multipliers busy 100% of the time and by how
many MACs are performed in each cycle.
• The "SPEC" of DSPs is 4 algorithms:
– Inifinite Impule Response (IIR) filters
– Finite Impule Response (FIR) filters
– FFT, and
– convolvers
• In DSPs, target algorithms are important:
– Binary compatibility not a major issue
• High-level Software is not as important in DSPs as in GPPs.
– People still write in assembly language for a product to minimize the die area for
ROM in the DSP chip.
Note: While this is still mostly true, however, programming for DSPs in high
level languages (HLLs) has been gaining more acceptance due to the
development of more efficient HLL DSP compilers in recent years. EECC722 - Shaaban
#109 lec # 8 Fall 2006 10-16-2006
Types of DSP Processors
According to type of Arithmetic/operand Size Supported
EECC722 - Shaaban
#110 lec # 8 Fall 2006 10-16-2006
DSP Cores vs. Chips
DSP are usually available as synthesizable cores or off-the-
shelf packaged chips
• Synthesizable Cores:
– Map into chosen fabrication process
• Speed, power, and size vary
– Choice of peripherals, etc. (SoC) SOC = System On Chip
– Requires extensive hardware development effort.
Resulting in more development time and cost
EECC722 - Shaaban
#111 lec # 8 Fall 2006 10-16-2006
DSP ARCHITECTURE
Enabling Technologies
EECC722 - Shaaban
#112 lec # 8 Fall 2006 10-16-2006
Texas Instruments TMS320 Family
Multiple DSP P Generations
First Bit Size Clock Instruction MAC MOPS Device density (#
Sample speed Throughput execution of transistors)
(MHz) (ns)
Uniprocessor
Based
(Harvard
Architecture)
1 TMS32010 1982 16 integer 20 5 MIPS 400 5 58,000 (3)
2 TMS320C25 1985 16 integer 40 10 MIPS 100 20 160,000 (2)
TMS320C30 1988 32 flt.pt. 33 17 MIPS 60 33 695,000 (1)
3 TMS320C50 1991 16 integer 57 29 MIPS 35 60 1,000,000 (0.5)
TMS320C2XXX 1995 16 integer 40 MIPS 25 80
Multiprocessor (VLIW)
Based
TMS320C80 1996 32 integer/flt. 2 GOPS MIMD
120 MFLOP
4 TMS320C62XX 1997 16 integer 1600 MIPS 5 20 GOPS VLIW
TMS310C67XX 1997 32 flt. pt. 5 1 GFLOP VLIW
EECC722 - Shaaban
#114 lec # 8 Fall 2006 10-16-2006
DSP Algorithms & Applications
DSP Algorithm System Application
Digital cellular telephones, personal communications systems, digital cordless telephones,
Speech Coding
multimedia computers, secure communications.
Digital cellular telephones, personal communications systems, digital cordless telephones,
Speech Encryption
secure communications.
Advanced user interfaces, multimedia workstations, robotics, automotive applications,
Speech Recognition
cellular telephones, personal communications systems.
Speech Synthesis Advanced user interfaces, robotics
Speaker Identification Security, multimedia workstations, advanced user interfaces
Consumer audio, consumer video, digital audio broadcast, professional audio, multimedia
High-fidelity Audio
computers
Digital cellular telephones, personal communications systems, digital cordless telephones,
Modems digital audio broadcast, digital signaling on cable TV, multimedia computers, wireless
computing, navigation, data/fax
Noise cancellation Professional audio, advanced vehicular audio, industrial applications
Audio Equalization Consumer audio, professional audio, advanced vehicular audio, music
Ambient Acoustics Emulation Consumer audio, professional audio, advanced vehicular audio, music
Audio Mixing/Editing Professional audio, music, multimedia computers
Sound Synthesis Professional audio, music, multimedia computers, advanced user interfaces
Security, multimedia computers, advanced user interfaces, instrumentation, robotics,
Vision
navigation
Image Compression Digital photography, digital video, multimedia computers, videoconferencing
Image Compositing Multimedia computers, consumer video, advanced user interfaces, navigation
Beamforming Navigation, medical imaging, radar/sonar, signals intelligence
Echo cancellation Speakerphones, hands-free cellular telephones
Spectral Estimation Signals intelligence, radar/sonar, professional audio, music
EECC722 - Shaaban
#115 lec # 8 Fall 2006 10-16-2006
Another Look at DSP Applications
• High-end:
Increasing
– Military applications (e.g. radar/sonar)
– Wireless Base Station - TMS320C6000
Cost
– Cable modem
– Gateways
• Mid-range:
– Industrial control
– Cellular phone - TMS320C540
– Fax/ voice server
• Low end:
volume
Increasing
– Storage products - TMS320C27 (hard drive controllers)
– Digital camera - TMS320C5000
– Portable phones
– Wireless headsets
– Consumer audio
– Automobiles, thermostats, ...
EECC722 - Shaaban
#116 lec # 8 Fall 2006 10-16-2006
DSP range of applications
& Possible Target DSPs
EECC722 - Shaaban
#117 lec # 8 Fall 2006 10-16-2006
Cellular Phone System
123 CONTROLLER 415-555-1212
456
789
0
PHYSICAL RF
LAYER BASEBAND
CONVERTER MODEM
PROCESSING
DSP
ANALOG IC
Example DSP Application EECC722 - Shaaban
#119 lec # 8 Fall 2006 10-16-2006
Mapping Onto System-on-Chip (SoC)
(Cellular Phone)
phone keypad
S/P
book intfc
S/P
RAM
RAM µC
DMA speech
voice
quality
recognition
enhancment
ASIC DSP RPE-LTP
de-intl &
LOGIC CORE decoder speech decoder
demodulator
and Viterbi
synchronizer equalizer
C540
(DSP)
ARM7
(µC)
Coms
specific algorithms and I/O
Memory
DSP
EECC722 - Shaaban
#123 lec # 8 Fall 2006 10-16-2006
DSP Algorithm Notation
• Uses “flowchart” notation instead of equations
• Multiply is or
X
• Add is or
+
• Delay/Storage is or or
Delay z–1 D
EECC722 - Shaaban
#124 lec # 8 Fall 2006 10-16-2006
Typical DSP Algorithm:
Finite-Impulse Response (FIR) Filter
• Filters reduce signal noise and enhance image or signal quality by
removing unwanted frequencies.
• Finite Impulse Response (FIR) filters compute:
N 1
where
y (i ) h(k ) x(i k ) h(n) * x(n)
– 0
x is the inputksequence
– y is the output sequence
– h is the impulse response (filter coefficients)
– N is the number of taps (coefficients) in the filter
• Output sequence depends only on input sequence and impulse
response.
EECC722 - Shaaban
#125 lec # 8 Fall 2006 10-16-2006
Typical DSP Algorithms:
Finite-impulse Response (FIR) Filter
• N most recent samples in the delay line (Xi)
• New sample moves data down delay line
• Filter “Tap” is a multiply-add
(Multiply And Accumulate, MAC)
• Each tap (N taps total) nominally requires:
EECC722 - Shaaban
#126 lec # 8 Fall 2006 10-16-2006
FINITE-IMPULSE RESPONSE (FIR) FILTER
Delay (accumulator register)
X ....
Z 1 Z 1 Z 1
h0 h1 hN-2 hN-1
A Filter Tap N 1
One FIR Filter Tap
y (i ) h(k ) x(i k )
k 0 i.e. Vector dot product
1-D FIR has nop = 2N and a 2-D FIR has nop = 2N2. OP = Operation
EECC722 - Shaaban
#129 lec # 8 Fall 2006 10-16-2006
Typical DSP Algorithms:
Infinite-Impulse Response (IIR) Filter
• Infinite Impulse Response (IIR) filters compute:
M 1 N 1
y (i ) a(k ) y(i k ) b(k ) x(i k )
k 1 k 0
• Output sequence depends on input sequence, previous
outputs, and impulse response.
• Both FIR and IIR filters
i.e Filter coefficients: a(k), b(k)
– Require vector dot product (multiply-accumulate) operations
– Use fixed coefficients
MAC
• Adaptive filters update their coefficients to minimize the
distance between the filter output and the desired signal.
EECC722 - Shaaban
#130 lec # 8 Fall 2006 10-16-2006
Typical DSP Algorithms:
Discrete Fourier Transform (DFT)
• The Discrete Fourier Transform (DFT) allows for spectral
analysis in the frequency domain.
• It is computed as
N 1 2 j
y (k ) WN x(n)
nk
WN e N j 1
for k = 0, 1, … , N-1,
n 0 where
– x is the input sequence in the time domain
– y is an output sequence in the frequency domain
• The Inverse Discrete Fourier Transform is computed as
EECC722 - Shaaban
#131 lec # 8 Fall 2006 10-16-2006
Typical DSP Algorithms:
Discrete Cosine Transform (DCT)
• The Discrete Cosine Transform (DCT) is frequently used
in image & video compression (e.g. JPEG, MPEG-2).
• The DCT and Inverse DCT (IDCT) are computed as:
N 1
(2n 1)k
y (k ) e(k ) cos[ ]x(n), for k 0, 1, ... N - 1
n 0 2N
2 N 1
(2n 1)k
x ( n)
N
e(k ) cos[ 2 N ] y(n), for k 0, 1, ... N - 1
k 0
EECC722 - Shaaban
#132 lec # 8 Fall 2006 10-16-2006
DSP BENCHMARKS
• DSPstone: University of Aachen, application benchmarks
– ADPCM TRANSCODER - CCITT G.721, REAL_UPDATE, COMPLEX_UPDATES
– DOT_PRODUCT, MATRIX_1X3, CONVOLUTION
– FIR, FIR2DIM, HR_ONE_BIQUAD
– LMS, FFT_INPUT_SCALED
3rd
Generation
2nd
Generation > 800x
Faster than
first generation
1st
Generation
EECC722 - Shaaban
#134 lec # 8 Fall 2006 10-16-2006
Basic ISA/Architectural Features of DSPs
• Data path configured for DSP algorithms
– Fixed-point arithmetic (most DSPs) DSP ISA Feature
• Modulo arithmetic (saturation to handle overflow)
– MAC- Multiply-accumulate unit(s)
DSP Architectural Features
– Hardware rounding support
DSP Architectural Feature
• Multiple memory banks and buses -
Usually with no data cache
– Harvard Architecture for predictable fast data sample
streaming
– Multiple data memories
DSP ISA Feature • Specialized addressing modes DSP Architectural Feature
S .
radix
–2N–1 Š x < 2N–1
point
Usually 16-bit
EECC722 - Shaaban
#136 lec # 8 Fall 2006 10-16-2006
DSP ISA Features
EECC722 - Shaaban
#137 lec # 8 Fall 2006 10-16-2006
DSP ISA Feature
Due to physical
nature of signals
Saturation –2N–1
EECC722 - Shaaban
#138 lec # 8 Fall 2006 10-16-2006
DSP Architectural Features
EECC722 - Shaaban
#139 lec # 8 Fall 2006 10-16-2006
DSP Data Path: Accumulator
• Don’t want overflow or have to scale accumulator
• Option 1: accumalator wider than product:
“guard bits”
– Motorola DSP:
24b x 24b => 48b product, 56b Accumulator
• Option 2: shift right and round product before adder
}
Multiplier
Multiplier
Shift MAC
Unit
ALU ALU
Accumulator G Accumulator
EECC722 - Shaaban
#140 lec # 8 Fall 2006 10-16-2006
DSP Data Path: Rounding Modes
• Even with guard bits, will need to round when storing accumulator
into memory
• 3 DSP standard options (supported in hardware)
• Truncation: chop results
=> biases results up
• Round to nearest:
< 1/2 round down, 1/2 round up (more positive)
=> smaller bias
• Convergent:
< 1/2 round down, > 1/2 round up (more positive), = 1/2 round to
make lsb a zero (+1 if 1, +0 if 0)
=> no bias
IEEE 754 calls this round to nearest even
EECC722 - Shaaban
#141 lec # 8 Fall 2006 10-16-2006
Data Path Comparison
DSP Processor General-Purpose Processor
EECC722 - Shaaban
#142 lec # 8 Fall 2006 10-16-2006
TI 320C54x DSP (1995) Functional Block Diagram
Multiple memory
banks and buses
MAC
Unit
EECC722 - Shaaban
#144 lec # 8 Fall 2006 10-16-2006
First Generation DSP P
Texas Instruments TMS32010 - 1982
Features
EECC722 - Shaaban
#145 lec # 8 Fall 2006 10-16-2006
First Generation DSP P TI TMS32010
Block Diagram
Program Memory
(ROM/EPROM)
MAC
Unit
EECC722 - Shaaban
#146 lec # 8 Fall 2006 10-16-2006
TMS32010 FIR Filter Code
EECC722 - Shaaban
#147 lec # 8 Fall 2006 10-16-2006
DSP Architectural Features
DSP Memory
• FIR Tap implies multiple memory accesses
• DSPs require multiple data ports
• Some DSPs have ad hoc techniques to reduce memory bandwdith
demand:
– Instruction repeat buffer: do 1 instruction 256 times
– Often disables interrupts, thereby increasing interrupt response time
• Some recent DSPs have instruction caches
– Even then may allow programmer to “lock in” instructions into cache
– Option to turn cache into fast program memory
• Usually DSPs have no data caches.
• May have multiple data memories
For better
real-time
performance
predictability
e.g one for signal data samples and one for filter coefficients
EECC722 - Shaaban
#148 lec # 8 Fall 2006 10-16-2006
Conventional ``Von Neumann’’ memory
EECC722 - Shaaban
#149 lec # 8 Fall 2006 10-16-2006
HARVARD MEMORY ARCHITECTURE in DSP
e.g one for signal data samples and one for filter coefficients
PROGRAM
X MEMORY Y MEMORY
MEMORY
GLOBAL
P DATA
X DATA
Y DATA
Multiple memory
banks and buses
EECC722 - Shaaban
#150 lec # 8 Fall 2006 10-16-2006
Memory Architecture Comparison
DSP Processor General-Purpose Processor
• Harvard architecture • Von Neumann architecture
• 2-4 memory accesses/cycle • Typically 1 access/cycle
• No caches: on-chip SRAM • Use caches
For real-time performance Makes real-time performance
predictability harder to predict
Program
Memory
Processor Processor Memory
Data
Memory
EECC722 - Shaaban
#151 lec # 8 Fall 2006 10-16-2006
TI TMS320C3x MEMORY BLOCK DIAGRAM - Harvard
Architecture
Instruction Data Data Program
Cache
Multiple memory
Multiple memory
banks and buses
banks and buses
EECC722 - Shaaban
#152 lec # 8 Fall 2006 10-16-2006
TI 320C62x/67x DSP (1997) – (Fourth Generation DSP)
EECC722 - Shaaban
#153 lec # 8 Fall 2006 10-16-2006
DSP ISA Features
DSP Addressing Modes
• Have standard addressing modes: immediate, displacement, register indirect
• Want to keep MAC datapath busy
• Assumption: any extra instructions imply clock cycles of overhead in inner
loop
=> complex addressing is good
• Autoincrement/Autodecrement register indirect
– lw r1,0(r2)+ => r1 <- M[r2]; r2<-r2+1 To match data access patterns in DSP algorithms
And reduced number of instructions (code size)
– Option to do it before addressing, positive or negative
• “bit reverse” address addressing mode.
• “modulo” or “circular” addressing
=> don’t use normal datapath to calculate fancy addressing modes:
– Use dedicated address generation units
EECC722 - Shaaban
#154 lec # 8 Fall 2006 10-16-2006
DSP ISA Features
DSP Addressing: FFT
• FFTs start or end with data in bufferfly order
0 (000) => 0 (000)
1 (001) => 4 (100)
2 (010) => 2 (010)
3 (011) => 6 (110)
4 (100) => 1 (001) Bit Reversed
5 (101) => 5 (101) Addressing
6 (110) => 3 (011)
7 (111) => 7 (111)
EECC722 - Shaaban
#155 lec # 8 Fall 2006 10-16-2006
DSP ISA Features
Bit Reversed Addressing
000 x(0) F(0)
EECC722 - Shaaban
#157 lec # 8 Fall 2006 10-16-2006
DSP ISA Features
Why? • Increment
Allows for cycling through:
• delay elements (signal samples)
• Filter coefficients in data memory
EECC722 - Shaaban
#158 lec # 8 Fall 2006 10-16-2006
DSP Architectural Features
• Dedicated address
generation units
• Supports modulo and bit
reversal arithmetic
• Often duplicated to calculate
multiple addresses per cycle
EECC722 - Shaaban
#159 lec # 8 Fall 2006 10-16-2006
Addressing Comparison
DSP Processor General-Purpose Processor
• Dedicated address • Often, no separate address
generation units generation units
• Specialized addressing • General-purpose addressing
DSP ISA Feature
modes; e.g.: modes GPP ISA Feature
– Autoincrement
– Modulo (circular)
– Bit-reversed (for FFT)
• Good immediate data
support
EECC722 - Shaaban
#160 lec # 8 Fall 2006 10-16-2006
DSP ISA Features
DSP Instructions and Execution
• May specify multiple operations in a single instruction
– e.g. A compound instruction may perform: To reduce number of instructions
and reduce code size
multiply + add + load + modify address register
• Must support Multiply-Accumulate (MAC)
• Need parallel move support
• Usually have special loop support to reduce branch overhead
– Loop an instruction or sequence
– 0 value in register usually means loop maximum number of times
– Must be sure if calculate loop count that 0 does not mean 0
• May have saturating shift left arithmetic
• May have conditional execution to reduce branches
Repeat
• General-purpose
instructions Less complex
• Typically only one
• Zero or reduced overhead loops. operation per instruction
• Timers
DSP
Core • Bit I/O ports
• On-chip DMA
Serial Ports
• On-chip A/D, D/A A/D Converter Data
EECC722 - Shaaban
#164 lec # 8 Fall 2006 10-16-2006
TI TMS320C203/LC203 Block Diagram
DSP Core Approach - 1995
Integrated
DSP Peripherals
EECC722 - Shaaban
#165 lec # 8 Fall 2006 10-16-2006
Summary of Architectural Features of DSPs
• Data path configured for DSP
– Fixed-point arithmetic Most common 95% of all DSPs
– Fast MAC- Multiply-accumulate
• Multiple memory banks and buses - •Avoiding dynamic processor
architectural features that make real-
– Harvard Architecture time performance harder to predict (e.g
– Multiple data memories dynamic scheduling, hardware
speculation, branch prediction, cache).
– Dedicated address generation units
Why?
• Specialized addressing modes To achieve predictable real-time
– Bit-reversed addressing performance
– Circular buffers
• Specialized instruction set and execution control
– Zero-overhead loops
– Support for MAC
• Specialized peripherals for DSP (SoC)
EECC722 - Shaaban
(or algorithm driven, DSP algorithms in this case) #166 lec # 8 Fall 2006 10-16-2006
DSP Software Development Considerations
• Different from general-purpose software development:
– Resource-hungry, complex algorithms.
– Specialized and/or complex processor architectures.
– Severe cost/storage limitations.
– Hard real-time constraints.
– Optimization is essential. Program in DSP Assembly
– Increased testing challenges.
• Essential tools:
– Assembler, linker.
– Instruction set simulator. HLL/tools becoming
– HLL Code generation: C compiler. more mature/
– Debugging and profiling tools. gaining popularity
• Increasingly important:
– DSP Software libraries.
– Real-time operating systems.
EECC722 - Shaaban
#167 lec # 8 Fall 2006 10-16-2006
Classification of Current DSP Architectures
• Modern Conventional DSPs:
– Similar to the original DSPs of the early 1980s
Second
– Single instruction/cycle. Example: TI TMS320C54x
Generation
Lower – Complex instructions/Not compiler friendly
Cost/
Power
• Enhanced
UsuallyConventional
one MAC unit DSPs:
– Add parallel execution units: SIMD operation
– Complex, compound instructions. Third
– Example: TI TMS320C55x Generation
– Not compiler friendly
• Multiple-Issue DSPs:
Example: TI TMS320C62xx, TMS320C64xx Fourth
Usually more than one MAC unit
– VLIW
Generation
• Simpler (RISC-like, fixed-width) instructions than conventional DSPs, more instructions and
instruction bandwidth needed,
• More compiler friendly - Higher cost/power
Higher • SIMD instructions support added to recent DSPs of this class
Cost/
Power – Superscalar, Example: LSI Logic ZPS400, ZPS500
Performance
EECC722 - Shaaban
DSPs from all these three generations are still available today
#168 lec # 8 Fall 2006 10-16-2006
A Conventional DSP: Second
TI TMSC54xx Generation DSP
EECC722 - Shaaban
#169 lec # 8 Fall 2006 10-16-2006
A Current Conventional DSP:
TI TMSC54xx Second
Generation DSP
One
MAC
Unit
EECC722 - Shaaban
#170 lec # 8 Fall 2006 10-16-2006
An Enhanced Conventional DSP:
TI TMSC55xx Third
Generation DSP
• The TMS320C55xx is based on Texas Instruments' earlier TMS320C54xx
family, but adds significant enhancements to the architecture and
instruction set, including:
– Two instructions/cycle
(limited
• Instructions are scheduled for parallel VLIW?)
execution by the assembly programmer or
compiler.
– Two MAC units.
• Complex, compound instructions:
– Assembly source code compatible with C54xx
– Mixed-width instructions: 8 to 48 bits.
– 200 MHz @ 1.5 V, ~130 mW , $17 qty 10k
• Poor compiler target.
EECC722 - Shaaban
#171 lec # 8 Fall 2006 10-16-2006
An Enhanced Conventional DSP:
TI TMSC55xx Third
Generation DSP
2 MAC
Units
EECC722 - Shaaban
#172 lec # 8 Fall 2006 10-16-2006
Multiple-Issue DSPs 16-bit Fixed-Point VLIW DSP:
TI TMS320C6201 Revision 2 (1997)
(1997
The TMS320C62xx is the
first fixed-point DSP Program Cache / Program Memory
processor from Texas 32-bit address, 256-Bit data512K Bits RAM
Instruments that is based
on a VLIW-like architecture Pwr C6201 CPU Megamodule
EECC722 - Shaaban
#174 lec # 8 Fall 2006 10-16-2006
Fourth
Generation DSP TI TMS320C62xx Datapaths
Registers A0 - A15 Registers B0 - B15
1X 2X
S1 S2 D DL SL SL DL D S S D S S D S S S S D S S D S S D DL SL SL DL D S2 S1
1 2 1 2 1 2 2 1 2 1 2 1
L1 S1 M1 D1 D2 M2 S2 L2
DDATA_I1 DDATA_I2
(load data) (load data)
Cross Paths
40-bit Write Paths (8 MSBs)
40-bit Read Paths/Store Paths
EECC722 - Shaaban
#175 lec # 8 Fall 2006 10-16-2006
TI TMS320C62xx Functional Units
• L-Unit (L1, L2)
– 40-bit Integer ALU, Comparisons
– Bit Counting, Normalization
(Statically Scheduled)
EECC722 - Shaaban
#176 lec # 8 Fall 2006 10-16-2006
TI TMS320C62xx Instruction Packing
Instruction Packing Advanced 8-way VLIW
Example 1
• Fetch Packet
A B C D E F G H – CPU fetches 8 instructions/cycle
• Execute Packet
A – CPU executes 1 to 8 instructions/cycle
B – Fetch packets can contain multiple execute packets
F G H
(Statically Scheduled VLIW)
EECC722 - Shaaban
#177 lec # 8 Fall 2006 10-16-2006
TI TMS320C62xx Pipeline Operation
Pipeline Phases
Fetch Decode Execute
PG PS PW PR DP DC E1 E2 E3 E4 E5
• Single-Cycle Throughput
• Decode
• Operate in Lock Step
– DP Instruction Dispatch
• Fetch – DC Instruction Decode
– PG Program Address Generate • Execute
– PS Program Address Send – E1 - E5 Execute 1 through Execute 5
– PW Program Access Ready Wait
– PR Program Fetch Packet Receive
PG PS PW PR DP DC E1 E2 E3 E4 E5
Execute Packet 2 PG PS PW PR DP DC E1 E2 E3 E4 E5
Execute Packet 3 PG PS PW PR DP DC E1 E2 E3 E4 E5
Execute Packet 4 PG PS PW PR DP DC E1 E2 E3 E4 E5
Execute Packet 5 PG PS PW PR DP DC E1 E2 E3 E4 E5
Execute Packet 6 PG PS PW PR DP DC E1 E2 E3 E4 E5
Execute Packet 7 PG PS PW PR DP DC E1 E2 E3 E4 E5
EECC722 - Shaaban
#178 lec # 8 Fall 2006 10-16-2006
C62x Pipeline Operation
Delay Slots
• Delay Slots: number of extra cycles until result is:
– written to register file
– available for use by a subsequent instructions
– Multi-cycle NOP instruction can fill delay slots while minimizing
code size impact
EECC722 - Shaaban
#180 lec # 8 Fall 2006 10-16-2006
C6000 Instruction Set Addressing
Features
• Load-Store Architecture
• Two Addressing Units (D1, D2)
• Orthogonal
– Any Register can be used for Addressing or Indexing
• Signed/Unsigned Byte, Half-Word, Word, Double-
Word Addressable
– Indexes are Scaled by Type
• Register or 5-Bit Unsigned Constant Index
EECC722 - Shaaban
#181 lec # 8 Fall 2006 10-16-2006
C6000 Instruction Set Addressing
Features
• Indirect Addressing Modes
– Pre-Increment *++R[index]
– Post-Increment *R++[index]
– Pre-Decrement *--R[index]
– Post-Decrement *R--[index]
– Positive Offset *+R[index]
– Negative Offset *-R[index]
• 15-bit Positive/Negative Constant Offset from Either B14 or B15
• Circular Addressing
– Fast and Low Cost: Power of 2 Sizes and Alignment
– Up to 8 Different Pointers/Buffers, Up to 2 Different Buffer Sizes
• Bit-reversal Addressing
• Dual Endian Support
EECC722 - Shaaban
#182 lec # 8 Fall 2006 10-16-2006
FIR Filter On TMS320C54xx vs. TMS320C62xx
2nd Gen Conventional DSP 4th Gen VLIW DSP
EECC722 - Shaaban
#183 lec # 8 Fall 2006 10-16-2006
TI TMS320C64xx
• Announced in February 2000, the TMS320C64xx is an extension of
Texas Instruments' earlier TMS320C62xx architecture.
• The TMS320C64xx has 64 32-bit general-purpose registers, twice as
many as the TMS320C62xx.
• The TMS320C64xx instruction set is a superset of that used in the
TMS320C62xx, and, among other enhancements, adds significant
SIMD/media processing capabilities:
– 8-bit operations for image/video processing.
Media Processing
• Introduced
SIMD at 600 MHz clock speed (1 GHz now), but:
– 11-stage pipeline with long latencies
– Dynamic caches.
• $100 qty 10k.
• The only DSP family with compatible fixed and floating-point versions.
EECC722 - Shaaban
#184 lec # 8 Fall 2006 10-16-2006
C64xx (also C62xx and C67xx) VLIW have higher memory use
due to simpler (RISC-like, fixed-width) instructions than conventional DSPs,
more instructions and instruction bandwidth needed,
Also VLIW but with variable-length instruction encoding (less memory use than C64xx)
(16-32 bits)
EECC722 - Shaaban
#185 lec # 8 Fall 2006 10-16-2006
Computational
(XScale)
EECC722 - Shaaban
#186 lec # 8 Fall 2006 10-16-2006
Multiple-Issue 4th Generation DSPs
EECC722 - Shaaban
#187 lec # 8 Fall 2006 10-16-2006
EECC722 - Shaaban
#188 lec # 8 Fall 2006 10-16-2006
TI not actively improving their flagship
FP DSP (fixed-point more important!)
EECC722 - Shaaban
#189 lec # 8 Fall 2006 10-16-2006