board2board



This winter break, Andrew (my brother) and I worked on board2board, a collaborative drawing web app that uses a computer's webcam for object detection. We were inspired to create this after realizing that at least on our Macs, it was annoying to draw on the trackpad or having to switch back and forth to our iPads. Why not draw in the air instead?

Features include using the space bar to toggle between drawing/not drawing...

...pressing the "c" key to clear everything... 

 ...multiple users collaborating in the same session (hover over avatars to see full usernames)...


...and being able to choose between detecting green or blue drawing objects. For example, in the gif below, using a green marker is much more accurate. We added this feature after finding that object detection accuracy heavily depends on where the user is. If there's a lot of other blue, then a blue marker wouldn't be as easily tracked.
 

Check out my brother's blog post for more details, including tools used, challenges, and future work!