Scribd
Upload
87 views14 pages

Personal Companion: Guide - Ms. Nishi Gupta

MARS Personal Companion is a project by NISHI GUPTA's group that includes PRAVEEN PANDEY, ABHISHEK GOEL, JASNEEK KAUR UPPAL, and ABHEET GERA. The project uses technologies like Flutter, Google Speech, OpenCV, and Flask to develop a mobile app and web interface to control a Raspberry Pi-powered robot. Key features of MARS include chatbot capabilities, camera controls, photo taking, live video streaming, and facial and scene recognition using AWS Rekognition. The robot can be controlled through a mobile or web app to move, tilt its camera, and perform other actions.

Uploaded by

StenZiL Pandey
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
87 views14 pages

Personal Companion: Guide - Ms. Nishi Gupta

MARS Personal Companion is a project by NISHI GUPTA's group that includes PRAVEEN PANDEY, ABHISHEK GOEL, JASNEEK KAUR UPPAL, and ABHEET GERA. The project uses technologies like Flutter, Google Speech, OpenCV, and Flask to develop a mobile app and web interface to control a Raspberry Pi-powered robot. Key features of MARS include chatbot capabilities, camera controls, photo taking, live video streaming, and facial and scene recognition using AWS Rekognition. The robot can be controlled through a mobile or web app to move, tilt its camera, and perform other actions.

Uploaded by

StenZiL Pandey
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 14

MArS Personal Companion

GUIDE - Ms. NISHI GUPTA GROUP MEMBERS - PRAVEEN PANDEY


ABHISHEK GOEL
JASNEEK KAUR UPPAL
ABHEET GERA
PRESENTATION CONTENT

1 2 3 4
FEATURES INCLUDED CONTROLLING TECHNOLOGIES USED FLUTTER
MECHANISM

5 6 7 8 9
FLASK CHATBOT REKOGNITION DEMONSTRATION GREETINGS
1 2 3 4 5
Chatbot Object &
Wanderer Personal Home
Scene
Assistant Gaurd
Rekognition

FEATURES INCLUDED
Combination of RuleBased and Intelligence based actions
FLUTTER
It is used to develop cross platform
mobile applications.

TECHNOLOGIES GOOGLE SPEECH


The Google Cloud Speech-to-Text
USED helps interaction with MARS using
voice control.
Mars is expected to be more like a
human. It will be enriched by OPENCV
providing various features which will For dealing with the camera and
help it reacting like humans.
frames captured every second

FLASK
It is a web application framework
used to develop web applications
with python.
HARDWARE
RASPBERRY PI
SERVO MOTOR
The main computer of MARS is the RPI which
Servo motor is used to rotate the parts by 180
helps to perform several operations
degree

MOTOR BOARD CAMERA


Motor board is used to reverse the current and Device used to get the live stream of the
move the robot in opposite directions with the surroundings which can be helpful for
same dc motor surveliiance systems and helps to get a photo
clicked.
01
ONLINE MODE

The robot is functional over the

internet serving all the requests and

advance features using AWS. Ex:

Scene Recognition, Amazon Lex.

02
OFFLINE MODE

It can also work in an offline mode in

the local network. (BASIC). Text chat

with Mars , Camera and movement

Control.
CONTROLLING
MECHANISM
WEB
MOBILE
APP
APP

MARS can be controlled by an MARS is also being provided with


app which is built using flutter services which are API based so
which is cross platform and it can also be controlled through
provides fast and simple Web.
development.
Mobile application development framework.
Used to develop applications for Android and iOS.

Application Features:
Movement of the MARS
Pan tilt motion of camera
Click a Photograph
Live streaming of Camera Footage
Micro web framework written in Python.
Created server for handling routes.

Routes :
"/up" and "/down" handles the pan tilt motion
"/aage" and "/peeche" handles movement of the
MARS
"/chol" is for scene rekognition using aws
ROBOT MOVEMENT (ALL DIRECTION)

CAMERA MOVEMENT (PAN/TILT)

VIDEO FOOTAGE

PICTURE
RESTFUL APIs
HOSTED ON
TALLBACK GATEWAY
SERVER
FUNCTIONAL

CHATBOT

GOOD STORAGE
01 CAN TAKE NOTES 04
GENERAL OF INFOTAINMENT
INFORMATIONAL
CAN ADD
02 AUDIO & TEXT 05
REMINDERS

03 GOOD AT GOSSIPS FREAKY 06


Rekognition The BOT needs to identify people using the
camera by making use of facial recognition
FOR SECURITY AND IDENTIFYING
algorithms. OpenCV and FRL will be used.

Take video stream from camera Frame


Steps: by Frame in a continious loop

Check the database if the person is known


and react. If unknown send alert or regsiter if
introduced by known.

FLR: Facial recognition Libraries


CAMERA'S FRAME
Actions with every the frame captured every second

2.1
Send for live
Stream
3
Rekognising the
1 4 5
Scene and
Capture Frame Decision Making Action
people in it.

2.2
Send to AWS for
Rekognition
OFFICIAL PROJECT MAIL

[email protected]
CSE FINAL YEAR

Reach Out
FOR SUGGESTIONS OR INQUIRIES

You might also like