Implemented a GAN loss to generate residual images to augment urban driving scenes with 2 primary goals: photo realism and maximum confusion/anarchy for the pedestrian detection CNN. In essence, this project aimed to fool and attack a state-of-the-art detector. The effects of using the synthetic data for alternate training were also investigated. We find that state-of-the-art systems are not naturally robust to such attacks in that the miss-rate error will quadruple (4x) unless the network is trained directly on the real and synthetic image data.

Built a proof-of-concept project for generating synthetic pedestrians. The project uses the MakeHuman tool to generate synthetic 3D pedestrian models with highly variable pose, shape, race, hair, clothing, etc. In addition to synthetic, we further use a simple cut-and-paste method based on pixel-level segmentation masks to generate real people. Finally, we place synthetic or real pedestrians onto arbitrary background images. We learn depth cues to place pedestrians at proper scales on the sidewalk or road regions only.

Multipi is a simple collision-based game built in the Unity engine. It was inspired by an imaginary operation in mathematics that I call multipiecation. The only objective of the game is to throw pies at other pies. When pies collide they multiply in size or quantity depending on the circumstance. A man is in game creeps around eating pies, eventually multiplying himself. Score is kept in terms of pi and pie. Sadly the game is no longer supported in the chrome web player, but if you want to try it feel free to email and I can send over an old executable.

This project was inspired by my friends and my desire to be Jedis. The project simulates up to two 3D Lightsabers from the user's webcam feed in real-time. The tool has in-built calibration to work with generic props/objects. It is a simple idea based around 2D detection of spheres and RGB thresholding. It was written in OpenCV and uses OpenGL to draw 3D Lightsabers ontop of the users webcam. We implemented random flickering and motion blur to give a simple glowing lightsaber effect. Code is released here.

I've been fascinated by illusions for a long time, or anything which can confuse our minds. Here are a few particularly fun optical illusions generated and rendered by a computer. All of the illusions are drawn by hand using primitive OpenGL methods in C++, and programmed many ages ago for a graphics course while getting my bachelor degree. Although I am much more interested in why such renderings confuse the human brain, the project is still fun to look at. The relatively simple source code is released, and still available here.