Case Study

On

Tensorflow Framework

Submitted By :

Swati Shekokar,
Vedant Chimote, Takshak Ramteke,
Trisha Rotke, Tushar Wath,
Urveesh Sayane, Utkarsh Hajare

Under the Guidance of

Mr. Nisarg Gandhewar

Department of Computer Science & Engineering

S. B. Jain Institute of Technology Management and
Research, Nagpur-441501
2021-2022
INDEX

1
Introduction
……………………...03

History
……………………….04

TensorFlow
……………………….05

Tensor Processing Unit

……………………….06

Edge TPUs
……………………….08

TensorFlow Lite
……………………….10

Tensorflow 2.0

..……………………..11
Application

………………………12

2
Introduction

TensorFlow is an end-to-end open source platform for machine learning

currently in it’s 2nd version . It has a comprehensive, flexible ecosystem of
tools, libraries, and community resources that lets researchers push the
state-of-the-art in ML and developers easily build and deploy ML-powered
applications. Tensorflow is a symbolic math library based on dataflow and
differentiable programming. It is used for both research and production at
Google.
TensorFlow was originally developed by researchers and engineers working
on the Google Brain team within Google's Machine Intelligence Research
organization to conduct machine learning and deep neural networks
research. The system is general enough to be applicable in a wide variety of
other domains, as well.
TensorFlow provides stable Python, C++ and JavaScript APIs, as well as non-
guaranteed backward compatible API for other languages.

3
History

TensorFlow is an open source project but as we’re discussing the history of

TensorFlow. It is essential That we point out that the project was not always
called TensorFlow it was called DistBelief :

Starting in 2011, Google Brain built DistBelief as a proprietary machine

learning system based on deep learning neural networks. Its use grew
rapidly across diverse Alphabet companies in both research and commercial
applications. Google assigned multiple computer scientists, including Jeff
Dean, to simplify and refactor the codebase of DistBelief into a faster, more
robust application-grade library, which became TensorFlow. In 2009, the
team, led by Geoffrey Hinton, had implemented generalized
backpropagation and other improvements which allowed generation of
neural networks with substantially higher accuracy, for instance a 25%
reduction in errors in speech recognition.

4
Tensorflow

TensorFlow is Google Brain's second-generation system. Version 1.0.0 was

released on February 11, 2017. While the reference implementation runs on
single devices, TensorFlow can run on multiple CPUs and GPUs (with
optional CUDA and SYCL extensions for general-purpose computing on
graphics processing units). TensorFlow is available on 64-bit Linux, macOS,
Windows, and mobile computing platforms including Android and iOS.
Its flexible architecture allows for the easy deployment of computation
across a variety of platforms (CPUs, GPUs, TPUs), and from desktops to
clusters of servers to mobile and edge devices.
TensorFlow computations are expressed as stateful dataflow graphs. The
name TensorFlow derives from the operations that such neural networks
perform on multidimensional data arrays, which are referred to as tensors.
During the Google I/O Conference in June 2016, Jeff Dean stated that 1,500
repositories on GitHub mentioned TensorFlow, of which only 5 were from
Google.
In December 2017, developers from Google, Cisco, RedHat, CoreOS, and
CaiCloud introduced Kubeflow at a conference. Kubeflow allows operation
and deployment of TensorFlow on Kubernetes.
In March 2018, Google announced [Link] version 1.0 for machine
learning in JavaScript.
In Jan 2019, Google announced TensorFlow 2.0. It became officially available
in Sep 2019.

5
Tensor Processing Unit

Tensor Processing Unit (TPU) is an AI accelerator application-specific

integrated circuit (ASIC) developed by Google specifically for neural network
machine learning, particularly using Google's own TensorFlow. Google began
using TPUs internally in 2015, and in 2018 made them available for third
party use, both as part of its cloud infrastructure and by offering a smaller
version of the chip for sale.
The chip has been specifically designed for Google's TensorFlow framework,
a symbolic math library which is used for machine learning applications such
as neural networks. However, as of 2017 Google still used CPUs and GPUs
for other types of machine learning. Other AI accelerator designs are
appearing from other vendors also and are aimed at embedded and robotics
markets.
Google's TPUs are proprietary. Some models are commercially available, and
on February 12, 2018, The New York Times reported that Google "would
allow other companies to buy access to those chips through its cloud-
computing service. Google has said that they were used in the AlphaGo
versus Lee Sedol series of man-machine Go games, as well as in the

6
AlphaZero system, which produced Chess, Shogi and Go playing programs
from the game rules alone and went on to beat the leading programs in
those games. Google has also used TPUs for Google Street View text
processing and was able to find all the text in the Street View database in
less than five days. In Google Photos, an individual TPU can process over 100
million photos a day. It is also used in RankBrain which Google uses to
provide search results.
Compared to a graphics processing unit, it is designed for a high volume of
low precision computation (e.g. as little as 8-bit precision) with more
input/output operations per joule, and lacks hardware for
rasterisation/texture mapping. The TPU ASICs are mounted in a heatsink
assembly, which can fit in a hard drive slot within a data center rack,
according to Norman Jouppi. Different types of processors are suited for
different types of machine learning models, TPUs are well suited for CNNs
while GPUs have benefits for some fully-connected neural networks, and
CPUs can have advantages for RNNs.
Google provides third parties access to TPUs through its Cloud TPU service
as part of the Google Cloud Platform and through its notebook-based
services Kaggle and Colaboratory.

7
Edge TPU

In July 2018, Google announced the Edge TPU. The Edge TPU is Google's
purpose-built ASIC chip designed to run machine learning (ML) models for
edge computing, meaning it is much smaller and consumes far less power
compared to the TPUs hosted in Google datacenters (also known as Cloud
TPUs). In January 2019, Google made the Edge TPU available to developers
with a line of products under the Coral brand. The Edge TPU is capable of 4
trillion operations per second while using 2W.
The product offerings include a single board computer (SBC), a system on
module (SoM), a USB accessory, a mini PCI-e card, and an M.2 card. The SBC
Coral Dev Board and Coral SoM both run Mendel Linux OS – a derivative of
Debian. The USB, PCI-e, and M.2 products function as add-ons to existing
computer systems, and support Debian-based Linux systems on x86-64 and
ARM64 hosts (including Raspberry Pi).
The machine learning runtime used to execute models on the Edge TPU is
based on TensorFlow Lite. The Edge TPU is only capable of accelerating
forward-pass operations, which means it's primarily useful for performing
inferences (although it is possible to perform lightweight transfer learning

8
on the Edge TPU). The Edge TPU also only supports 8-bit math, meaning that
for a network to be compatible with the Edge TPU, it needs to either be
trained using the TensorFlow quantization-aware training technique, or
since late 2019 it's also possible to use post-training quantization.
On November 12, 2019, Asus announced a pair of single-board computers
(SBCs) featuring the Edge TPU. The Asus Tinker Edge T and Tinker Edge R
Board designed for IoT and edge AI. The SBCs officially support Android and
Debian operating systems. ASUS has also demonstrated a mini PC called
Asus PN60T featuring the Edge TPU.
On January 2, 2020, Google announced the Coral Accelerator Module and
Coral Dev Board Mini, to be demonstrated at CES 2020 later the same
month. The Coral Accelerator Module is a multi-chip module featuring the
Edge TPU, PCIe and USB interfaces for easier integration. The Coral Dev
Board Mini is a smaller SBC featuring the Coral Accelerator Module and
MediaTek 8167s SoC

9
TensorFlow Lite

TensorFlow Lite is an open-source, product ready, cross-platform deep

learning framework that converts a pre-trained model in TensorFlow to a
special format that can be optimized for speed or storage.
These special format models can be deployed on edge devices like mobiles
using Android or iOS or Linux based embedded devices like Raspberry Pi or
Microcontrollers to make the inference at the Edge.
E.g :
You are trying to deploy your deep learning model in an area where they
don’t have a good network connection but still need the deep learning
model to give an excellent performance.

10
TensorFlow 2.0

TensorFlow's market share among research papers was

declining to the advantage the TensorFlow Team
announced a release of a new major version of the library
in September 2019. TensorFlow 2.0 introduced many
changes, the most significant being TensorFlow eager,
which changed the automatic differentiation scheme from
the static computational graph, to the "Define-by-Run"
scheme originally made popular . Other major changes
included removal of old libraries, cross-compatibility
between trained models on different versions of
TensorFlow, and significant improvements to the
performance on GPU.

11
Applications

Medical
GE Healthcare used TensorFlow to increase the speed
and accuracy of MRIs in identifying specific body parts.
[68]
Google used TensorFlow to create DermAssist, a free
mobile application that allows users to take pictures of
their skin and identify potential health complications.
[69]
Sinovation Ventures used TensorFlow to identify and
classify eye diseases from optical coherence
tomography (OCT) scans.[69]
Social media
Twitter implemented TensorFlow to rank tweets by
importance for a given user, and changed their platform to
show tweets in order of this ranking.[70] Previously, tweets
were simply shown in reverse chronological order.[70] The
photo sharing app VSCO used TensorFlow to help
suggest custom filters for photos.[69]
Search Engine
Google officially released RankBrain on October 26, 2015,
backed by TensorFlow.[71]

12
Education
InSpace, a virtual learning platform, used TensorFlow to
filter out toxic chat messages in classrooms.[72] Liulishuo,
an online English learning platform, utilized TensorFlow to
create an adaptive curriculum for each student.
[73]
TensorFlow was used to accurately assess a student’s
current abilities, and also helped decide the best future
content to show based on those capabilities.[73]
Retail
The e-commerce platform Carousell used TensorFlow to
provide personalized recommendations for customers.
[69]
The cosmetics company ModiFace used TensorFlow to
create an augmented reality experience for customers to
test various shades of make-up on their face.

13
References

[Link]. Retrieved November 10, 2015.

Video clip by Google about TensorFlow 2015 at minute 0:15/2:17

Metz, Cade (November 9, 2015). "Google Just Open Sourced TensorFlow, Its Artificial
Intelligence Engine". Wired. Retrieved November 10, 2015.

Dean, Jeff; Monga, Rajat; et al. (November 9, 2015). "TensorFlow: Large-scale machine
learning on heterogeneous systems" (PDF). [Link]. Google Research. Retrieved
November 10, 2015.

Perez, Sarah (November 9, 2015). "Google Open-Sources The Machine Learning Tech
Behind Google Photos Search, Smart Reply And More". TechCrunch. Retrieved
November 11, 2015.

Oremus, Will (November 9, 2015). "What Is TensorFlow, and Why Is Google So Excited
About It?". Slate. Retrieved November 11, 2015.

Ward-Bailey, Jeff (November 25, 2015). "Google chairman: We're making 'real progress'
on artificial intelligence". CSMonitor. Retrieved November 25, 2015.

"A MATLAB wrapper for TensorFlow Core". November 3, 2019. Retrieved February 13,
2020.

Byrne, Michael (November 11, 2015). "Google Offers Up Its Entire Machine Learning
Library as Open-Source Software". Vice. Retrieved November 11, 2015.

Moroney, Laurence (October 1, 2020). AI and Machine Learning for Coders (1st ed.).
O'Reilly Media.

14