Scribd
Upload
9 views4 pages

CSV To JSON Script &process

Uploaded by

roopal.rewatkar
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
9 views4 pages

CSV To JSON Script &process

Uploaded by

roopal.rewatkar
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

UPLOADING THE JSON IN FOLDER FOR STAT CALCULATION

CSV TO JASON

You will be given a csv file like this. Open that with excel

Copy only Processing ID from that and paste in the new text file.

Open with excel


1) Create a text file named as “[Link]” file in the destination folder , here we have
Roopal/ara-experiment ( GPU 21)
Now paste only processing ID in that text file
Save it.

Now make shell script as [Link]

#!/bin/bash

while read images; do

aws s3 cp s3://cgi-transporter-prod/poc-gc/outputs/$[Link]
/home/cgiuser/Roopal/ara-experiment/new_ara-json/$[Link]

done <"/home/cgiuser/Roopal/ara-experiment/[Link]"

Save the script

1) Check the region and path bucket name and source path always.
2) Destination path can be vary.
3) Rest all is same

Run the script with sudo command.

This process is to convert the csv file to jsons!!

This are the json from where we calculate the processing /queue time and overall time by
running the script ( per model script -surbhi mam)

You might also like