An Overview of

Data Communication in LabVIEW

Elijah Kerry – LabVIEW Product Manager
Certified LabVIEW Architect (CLA)
Data Communication Options in LabVIEW
1. TCP and UDP 12. Local Variables
2. Network Streams 13. Programmatic Front Panel
3. Shared Variables Interface
4. DMAs 14. Target-scoped FIFOs
5. Web Services 15. Notifier
6. Peer-to-Peer Streaming 16. Simple TCP/IP Messaging
7. Queues (STM)
8. Dynamic Events 17. AMC
9. Functional Global Variables 18. HTTP
10. RT FIFOs 19. FTP
11. Datasocket 20. Global variables
… just to name a few …
2
Communication is Important
Windows Real-Time FPGA

3
Agenda
• Introduction of Data Communication
• Define Communication Types
• Identify Scope of Communication
 Inter-process
 Inter-target
• Next Steps

ni.com/largeapps

4
Demonstration
The pitfalls of local variables

5
Common Pitfalls of Data Communication
Race conditions- two requests made to the same shared resource
Deadlock- two or more depended processes are waiting for each
other to release the same resource
Data loss- gaps or discontinuities when transferring data
Performance degradation- poor processing speed due to
dependencies on shared resources
Buffer overflows- writing to a buffer faster than it is read from the
buffer
Stale data- reading the same data point more than once

6
The Dining Philosophers

7
Communication Types
• Message/Command “Get me a soda!”

• Update/Monitor “The current time is…”

• Stream/Buffer “…the day the music died…”

• Variable/Tag “Set Point = 72F”

8
Message/Command
• Commander (Host) and Worker (Target) Systems
• Must be lossless* (can be buffered)
• Minimal latency
• Typically processed one at a time
• Reads are destructive
• Example: stop button, alarm, error

*some commands may need to pre-empt other commands based on priority

9
Update/Monitor
• Periodic transfer of latest value
• Often used for HMIs or GUIs
• N Targets: 1 Host
• Can be lossy
• Non-buffered

Example: monitoring current engine temperature

10
Stream/Buffer
• Continuous transfer, but not deterministic
• High throughput
• No data loss, buffered
• 1 Target: 1 Host; Unidirectional

Example: High speed acquisition on target, sent to

host PC for data logging

11
Variable/Tag
• Set Points and PID Constants
• Initial configuration data
• Can be updated during run-time
• Only latest value is of interest
• 1 Host: N Targets

Example: reading/writing the set-point of a thermostat,

.ini configuration files

12
Choosing Transfer Types
Message Update Stream Variable (Tag)
Examples • Exec Action • Heartbeat • Waveform • Setpoint
• Error • Movie • Image
Fundamental • Buffering • Nonhistorical • Buffering • Nonhistorical
Features • Blocking • Blocking • Blocking
(Timeout) (Timeout) (Timeout)
• Single-Read
Optional • Ack • Broadcast • Multi-layer • Dynamic Lookup
Features Buffering • Group Mgmt
• Latching
Performance • Low-Latency • Low-Latency • High- • Low-Latency
Throughput • High-Count
Configuration • N Targets: 1 Host • N Targets:1 • 1 Target:1 Host • N Targets: 1 Host
Host • Unidirectional

13
Scope of Communication
Inter-process: the exchange
of data takes place within a
single application context

Inter-target: communication
between multiple physical
targets, often over a network
layer

14
Defining Inter-process Communication
• Communication on same PC or Target
ACQ
• Communicate between parallel
processes or loops
• Offload data logging or processing to LOG
another CPU/Core/Thread within same
VI/executable
• Loops can vary in processing priority
High
• Used to communicate synchronously
and asynchronously
Med Low

15
Inter-process Communication Options
Shared Variables
Update GUI loop with latest value

Queues
Stream continuous data between loops
on a non-deterministic target

Dynamic Events
Register Dynamic Events to execute
sections of code

Functional Global Variables (FGV)

Use a non-reentrant subVI to protect
critical data

RT FIFOs
Stream continuous data between time
critical loops on a single RT target

16
Basic Actions
• Set the value of the shift register

INITIALIZE

INITIALIZE

17
Basic Actions
• Get the value currently stored in the shift register

GET

GET

18
Action Engine
• Perform an operation upon stored value and save
result
• You can also output the new value

ACTION

ACTION

19
How It Works
1. Functional Global Variable is a Non-Reentrant SubVI
2. Actions can be performed upon data
3. Enumerator selects action
4. Stores result in uninitialized shift register
5. Loop only executes once

20
Demonstration
Introduction to Functional Global Variables

21
Benefits: Comparison

Functional Global Variables Global and Local Variables

• Prevent race conditions • Can cause race conditions
• No copies of data • Create copies of data in memory
• Can behave like action engines • Cannot perform actions on data
• Can handle error wires • Cannot handle error wires
• Take time to make • Drag and drop

22
Understanding Dataflow in LabVIEW
Clump 0 Clump 1 Clump 0

Clump 2

24
Doing Everything in One Loop Can Cause Problems
While Loop

Acquire Analyze Log Present

10ms 50ms 250ms 20ms

• One cycle takes at least 330 ms

• If the acquisition is reading from a buffer, it may fill up
• User interface can only be updated every 330 ms

25
Doing Everything in One Loop Can Cause Problems
While Loop

Log
250ms
Acquire Analyze
10ms 50ms Present
20ms

• One cycle still takes at least 310 ms

• If the acquisition is reading from a buffer, it may fill up
• User interface can only be updated every 310 ms

26
 While Loop
Inter-Process Communication:
Acquire
ensures tasks run asynchronously and
efficiently 10ms
While Loop

How? Analyze
• Loops are running independently 50ms

• User interface can be updated every While Loop

20 ms Log
• Acquisition runs every 10ms, helping 250ms
to not overflow the buffer While Loop

• All while loops run entirely parallel of Present

each other 20ms

27
Producer Consumer
Best Practices
1. One consumer per queue Thread 1
2. Keep at least one reference to a
named queue available at any time
3. Consumers can be their own
producers
4. Do not use variables Thread 2

Considerations
1. How do you stop all loops? Thread 3
2. What data should the queue send?

28
LabVIEW FIFOs
• Queues
• RT FIFOs
• Network Streams
• DMAs
• User Events

In general, FIFOs are good if you need lossless communication

that preserves historical information

29
 Queues
Adding Elements to the Queue

Select the data type the queue will hold

Reference to existing queue in memory

Dequeueing Elements

Dequeue will wait for data or time-out (defaults to -1)

30
Demonstration
Introduction to LabVIEW Queues

31
The Anatomy of Dynamic Events
VI Gets Run
on Event Dynamic Events Terminal

Defines
Data Type

Multiple Loops Can

Register for Same Event
Data Sent

32
Using User Events

LabVIEW API for Managing User Events

Register User Events with Listeners

33
Choosing Transfer Types for Inter-process
Message Update Stream Variable (Tag)
Windows • Queue • SE Queue • Queue • Local/Global
• Shared • Notifier • Shared Variable
Variable • Shared Variable • SE Queue
(Blocking, Variable (Blocking, • FGV
Buffered) (Blocking) Buffered) • Shared
Variable
• DVR
RT • Same as • Same as • Same as • Same as
Windows Windows Windows Windows
• RT FIFO • SE RT FIFO • RT FIFO
FPGA • FIFO (2009) • SE FIFO • FIFO • Local/Global
(2009) Variable
• FGV

34
RT FIFOs vs. Queues
• Queues can handle string, variant, and other variable size
data types, while RT FIFOs can not
• RT FIFOs are pre-determined in size, queues can grow as
elements are added to them
• Queues use blocking calls when reading/writing to a shared
resource, RT FIFOs do not
• RT FIFOs do not handle errors, but can produce and
propagate them

Key Takeaway:
RT FIFOs are more deterministic for the above reasons
35
What is Determinism?

Determinism: An application (or critical piece of an

application) that runs on a hard real-time operating
system is referred to as deterministic if its timing can
be guaranteed within a certain margin of error.
36
LabVIEW Real-Time Hardware Targets

LabVIEW Real-Time

CompactRIO PXI Desktop or Industrial PC Vision Systems Single-Board RIO

37
 RT FIFOs
Write Data to the RT FIFO

Select the data type the RT FIFO will hold

Reference to existing RT FIFO in memory

Read Data from the RT FIFO

Read/Write wait for data or time-out (defaults to 0)

Write can overwrite data on a timeout condition

38
Demonstration
Inter-process Communication Using RT FIFOs

39
Defining Inter-target Communication
• PC, RT, FPGA, Mobile Device
• Offload data logging and data
processing to another target
• Multi-target/device application
• Network based

40
Common Network Transfer Policies
“Latest Value” or “Network Publishing”
• Making the current value of a data item available on the
network to one or many clients
• Examples
– I/O variables publishing to an HMI for monitoring
– Logging temperature values on a remote PC
• Values persist until over written by a new value
• Lossy – client only cares about the latest value

1-1 1-N
 Latest Value Communication
Ease of Supported 3rd Party
API Type Performance
Use Configurations APIs?
• Measurement
Shared
LabVIEW Feature 1:1, 1:N, N:1 Studio
Variable* • CVI
Ref. Arch.
CCC (CVT) 1:1 Yes (TCP/IP)
Publishes the CVT
UDP
LabVIEW Prim. 1:1, 1:N, N:1 Yes

*Network buffering should be disabled

Using Shared Variables Effectively
Programming Best Practices:
• Initialize shared variables
• Serialize shared variable execution
• Avoid reading stale shared variable data

43
Common Network Transfer Policies
“Streaming”
• Sending a lossless stream of information
• Examples
– Offloading waveform data from cRIO to remote PC for intensive processing
– Sending waveform data over the network for remote storage
• Values don’t persist (reads are destructive)
• Lossless – client must receive all of the data
• High-throughput required (latency not important)

1-1
 Streaming Lossless Data
Ease of Supported 3rd Party
API Type Performance
Use Configurations APIs?
Network Streams LabVIEW
1:1 Not this year
NEW! Feature
STM
Ref. Arch. 1:1 Yes (TCP/IP)

What about the shared variable with buffering enabled?

NO!
 Pitfalls of Streaming with Variables
• Lack of flow control can
Machine 1 Machine 2
result in data loss
Server Client Readers
• Data may be lost if the
TCP/IP connection is 1 6
5 2 7
3 4 41 52 63 74
dropped
Client Writers

• Data loss does not result 5 2

1 6 3
7 4
in an error, only a
warning
 Network Streams NEW!
Machine A

Machine B
 Network Streams in Action

Machine 1 Machine 2
Writer Endpoint Reader Endpoint

9 8
3 7
2 6
5 1
4 5 9
4 8
3 7
2 6
5 1
4 5 4 5
3 4
2 3
1

Acknowledge
Flow Control (2)
(3)
(2)

Use Streams!
Demonstration
Inter-target Communication Using Network Streams

49
Common Network Transfer Policies
“Command” or “Message”
• Requesting an action from a worker
• Examples
– Requesting an autonomous vehicle to move to a given position
– Telling a process controller to begin its recipe
• Values don’t persist (reads are destructive)
• Lossless – client must receive every command
• Low latency – deliver the command as fast as possible

1-1 N-1 1-N

 Network Command Mechanisms
Ease of Supported 3rd Party
API Type Performance
Use Configurations APIs?
Network
LabVIEW Feature 1:1 No
Streams
• Measurement
Shared
LabVIEW Feature 1:1, 1:N, N:1 Studio
Variable • CVI
AMC
Ref. Arch. 1:N Yes (UDP)

Web Standard
Web Services 1:1, 1:N, N:1 Yes
(New VIs in 2010)
Network Streams
Writing Elements to the Stream

Select the data type the

Reference to reader URL queue will hold

Reading Elements from Stream

Read will wait for data or

time-out (defaults to -1)
52
Network Streams
• Lossless transfer, even in connection loss*
• Can be tuned for high-throughput (streaming)
or low-latency (messaging)
• Unidirectional, P2P, LabVIEW only
• Not deterministic

Acquire/Control Log Data/Process

53
DMA (Direct Memory Access)

• Use for Host to Target

Communication (ie: RT to
FPGA)
• Available for newer FPGAs
• Useful for transferring chunks
of data
• High latency

58
Demonstration
Introduction to Direct Memory Access

59
 Target to Host Transfer – Continuous
Total Samples to Read = ???
Read Size = 4
RT Buffer Size = ~5x Read Size

Data element

DMA
Engine

FPGA FIFO RT Buffer

60
Continuous Transfer - Buffer Overflow
Total Samples to Read = ???
Read Size = 4
RT Buffer Size = ~5x Read Size

Data element

DMA
Engine

FPGA FIFO RT Data Buffer

61
LabVIEW Web Services
Application Architecture:
Request
LabVIEW LabVIEW
Client
Application Web Service Response

Sending Requests via URL:

Physical Location of Server

Name of Web Service
Mapping to a VI
Terminal Inputs (Optional)

62
Web Services in LabVIEW
Web Server Windows and Real-Time
Custom web clients
No runtime engine needed
Standard http protocol
Firewall friendly

Any Client Thin Client

63
Demonstration
Basic Web Services

64
ni.com/uibuilder

65
Demonstration
Thin-Client Web Interfaces

66
Early Access Release Details
• Anyone can evaluate for free
 Fully functional except for ‘Build and Deploy’
 License for ‘Build and Deploy’ is $1,499 per user
 License is sold as one-year software lease

• Not part of Developer Suite or Partner Lease

67
Inter-Target Communication Options
TCP/IP and UDP
Define low-level communication protocols
to optimize throughput and latency

Shared Variables
Access latest value for a network
published variable

Network Streams
Point to Point streaming in LabVIEW with high
throughput and minimal coding

Web UI Builder
Create a thin client to communicate with
a LabVIEW Web Service

DMAs
Direct memory access between to different components
of a system

68
 NI Certifications Align with Training
Developer Senior Developer Software Architect
/ Project Manager

Managing
LabVIEW LabVIEW LabVIEW LabVIEW Advanced Software
Core 1 Core 2 Core 3 OOP Architecture Engineering
in LabVIEW

Certified LabVIEW Associate Certified LabVIEW Developer Certified LabVIEW Architect

Developer Exam Exam Exam

"Certification is an absolute must for anyone serious about calling himself a

LabVIEW expert... At our organization, we require that every LabVIEW developer
be on a professional path to become a Certified LabVIEW Architect."
- President, JKI Software, Inc.
Download Examples and Slides

ni.com/largeapps
Software Engineering Tools
Development Practices
LargeApp Community