Tested the iPhone online demo on Windows 10, it's working.

Install the conda environment as detailed here:

conda create -n splatam python=3.10
conda activate splatam
conda install -c "nvidia/label/cuda-11.6.0" cuda-toolkit
conda install pytorch==1.12.1 torchvision==0.13.1 torchaudio==0.12.1 cudatoolkit=11.6 -c pytorch -c conda-forge
pip install -r requirements.txt

Add conda to Git Bash as detailed here:
a. Go to the folder: Anaconda/etc/profile.d/
b. Run echo ". ${PWD}/conda.sh" >> ~/.bashrc
In Git Bash, activate the splatam (conda) environment:

Nirmal@LAPTOP-HEKCV3H4 MINGW64 ~
$ conda activate splatam
(splatam)

Change current directory to SplaTAM folder:

Nirmal@LAPTOP-HEKCV3H4 MINGW64 ~
$ cd "C:\Users\Nirmal\Documents\SplaTAM"
(splatam)

Connect your iPhone and laptop to the same network. (I used a WiFi hotspot from my laptop to connect the iPhone, since connecting both devices to a WiFi network didn't work for me.)
Run the iPhone online demo script:

Nirmal@LAPTOP-HEKCV3H4 MINGW64 ~/Documents/SplaTAM (main)
$ python scripts/iphone_demo.py --config configs/iphone/online_demo.py

On the iPhone, open/restart the NeRF Capture app. It should show 1 Connection(s), if connection is established to the laptop. Click Send to capture and send a frame. (Need to capture 10 frames.)

Git Bash log

Waiting for frames...
1/10 frames received
Tracking Result Time Step: 0: 100%|##########| 1/1 [00:00<00:00,  1.67it/s, Time-Step: 0 | Rel Pose Error: 0.0 | Pose Error: 1.490116e-08 | ATE RMSE=0.0]

Selected Keyframes at Frame 0: [0]
Mapping Time Step: 0: 100%|##########| 60/60 [00:02<00:00, 24.70it/s]
Mapping Result Time Step: 0: 100%|##########| 1/1 [00:00<00:00, 46.54it/s, Time-Step: 0 | Frame 0 | PSNR: 21.96987 | Depth RMSE: 0.02397114 | L1=0.02397114]
2/10 frames received
Tracking Time Step: 1: 100%|##########| 60/60 [00:01<00:00, 34.14it/s]

Selected Keyframes at Frame 1: [0, 1]
Mapping Time Step: 1: 100%|##########| 60/60 [00:02<00:00, 24.40it/s]
3/10 frames received
Tracking Time Step: 2: 100%|##########| 60/60 [00:01<00:00, 35.06it/s]

Selected Keyframes at Frame 2: [0, 1, 2]
Mapping Time Step: 2: 100%|##########| 60/60 [00:02<00:00, 22.20it/s]
4/10 frames received
Tracking Time Step: 3: 100%|##########| 60/60 [00:02<00:00, 27.32it/s]

Selected Keyframes at Frame 3: [0, 1, 3]
Mapping Time Step: 3: 100%|##########| 60/60 [00:02<00:00, 21.30it/s]
5/10 frames received
Tracking Time Step: 4: 100%|##########| 60/60 [00:02<00:00, 25.19it/s]

Selected Keyframes at Frame 4: [1, 0, 3, 4]
Mapping Time Step: 4: 100%|##########| 60/60 [00:02<00:00, 21.24it/s]
6/10 frames received
Tracking Time Step: 5: 100%|##########| 60/60 [00:02<00:00, 22.44it/s]

Selected Keyframes at Frame 5: [0, 1, 3, 5]
Mapping Time Step: 5: 100%|##########| 60/60 [00:02<00:00, 20.46it/s]
7/10 frames received
Tracking Time Step: 6: 100%|##########| 60/60 [00:02<00:00, 23.56it/s]

Selected Keyframes at Frame 6: [1, 0, 3, 5, 6]
Mapping Time Step: 6: 100%|##########| 60/60 [00:02<00:00, 20.36it/s]
8/10 frames received
Tracking Time Step: 7: 100%|##########| 60/60 [00:02<00:00, 21.45it/s]

Selected Keyframes at Frame 7: [3, 1, 0, 5, 7]
Mapping Time Step: 7: 100%|##########| 60/60 [00:02<00:00, 20.26it/s]
9/10 frames received
Tracking Time Step: 8: 100%|##########| 60/60 [00:02<00:00, 22.64it/s]

Selected Keyframes at Frame 8: [3, 0, 1, 5, 7, 8]
Mapping Time Step: 8: 100%|##########| 60/60 [00:02<00:00, 20.06it/s]
10/10 frames received
Tracking Time Step: 9: 100%|##########| 60/60 [00:02<00:00, 23.27it/s]

Selected Keyframes at Frame 9: [5, 0, 1, 3, 7, 8, 9]
Mapping Time Step: 9: 100%|##########| 60/60 [00:03<00:00, 18.10it/s]

Average Tracking/Iteration Time: 39.425446369029856 ms
Average Tracking/Frame Time: 2.129827785491943 s
Average Mapping/Iteration Time: 47.29628523190816 ms
Average Mapping/Frame Time: 2.838191199302673 s
Saving parameters to: ././experiments/iPhone_Captures/splatam_demo\SplaTAM_iPhone
Saved SplaTAM Splat to:  ././experiments/iPhone_Captures/splatam_demo\SplaTAM_iPhone
(splatam)

After capturing 10 frames, visualize the result by running:

Nirmal@LAPTOP-HEKCV3H4 MINGW64 ~/Documents/SplaTAM (main)
$ python viz_scripts/final_recon.py configs/iphone/online_demo.py

Windows Support #9

Description

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions