Julia Ma
Bits
Machine Visionary

My sister, Elisha, wanted to learn how to use machine-vision APIs, and my husband, Eyal, loves puns. So we thought, why not make machines *have* vision? What would a machine imagine for the future?

We hacked together a demo where, given an image URL, the machine returns a motivational-poster-like image with a quote. The machine vision algorithm is applied to the image to extract descriptor words. The machine then harvests Wikiquotes from famous "visionaries" and replaces the words with corresponding parts-of-speech words that were extracted.

This was for SF Science Hack Day 2016. Source code.

Friendly Earthquakes

For SF Science Hack Day 2013, Eyal Shahar, Paul Sawaya, and I created Friendly Earthquakes. We used Facebook's Friend API and USGS's live earthquake feed to match recent earthquake locations to your Facebook friends that are near these earthquakes. This provides a notification system for you about friends that might be at risk.

Sound familiar?? Well Facebook launched Safety Check in 2014, which does a better job of this idea :P

Tools we used: USGS earthquake API, Facebook Friend API, Flask, MongoDB, Github. The source code lives here.

Songalogue

For Boston Music Hack Day 2011, Eyal and I used the Musixmatch API to pull lyrics from songs, creating a song-dialogue. The user would seed the Songalogue and receive two songs that would essentially talk to each other. We wanted all the Songalogues to be Youtube videos, but the hack didn't get that far. The picture is from our hack presentation.

Weatherbud

Weatherbud was built in collaboration with Eyal Shahar at the MIT Media Lab IOIO hackathon. It displays the weather in a tactile, informative, and fun way. Built around an Android phone and a IOIO board, it polls wunderground.com's API for the weather conditions in a location selected through the app.

The information is conveyed through a fabric flower lit by an RGB LED, whose color is determined by the temperature. A fan blowing air on the flower shows the wind speed. Finally, the platform on which the flower is placed rotates in accordance with the direction of the wind.

Video

T+V

Time lapse of an installation that uses crowd-sourcing to actively build a tangible visualization of attendee demographics. A world map covered by transparent LEGO baseplates stands at a conference, and bowls of colored transparent LEGO bricks sit nearby. Each person places a green brick on where they grew up, a red brick on where they currently live, and a blue brick on where they dream to live someday. This creates a 3-dimensional visualization. A light shines through the back-side, allowing the viewer to immediately see where the hot-spots are as those areas are more dense with bricks.

tv.media.mit.edu

Video

My collaborator Andy Bardagjy also describes this project on his website.

Subdivision of Surfaces

One of the challenges in 3D modeling is creating aesthetically appealing surfaces using a systematic method. Subdivision of surfaces is a popular way to create smooth-looking surfaces from a mesh surface. Subdivision is a recursive process that takes a coarse shape and refines it to produce a more detailed and visually attractive shape. Many subdivision methods exist, so I developed an algorithm to blend various methods together in an attempt to give greater control to the user.

More images

Subdividing a cube using the Catmull-Clark method.

Subdividing a cube using linear division.

Subdivision using a blend of these methods.

Synaesthetic music visualizer

The synaesthetic music visualizer maps each note, regardless of octave, to a specific color. Thus if you were to play a scale, the colors would cycle every octave in the same order. By using tri-color LEDs, I was able to create a whole spectrum of colors with just one component.

More images

Fully packaged

Circuitry

Circuitry

Schematic of the filters

Schematic of the LEDs

Board layout

Block diagram

Prototype of 2 of the filters

Electronic bubble level

The electronic bubble level works just like a non-digital bubble level. The light indicates the incline of the surface.

More images

Circuitry

Schematic

Board layout

Green LED lights up when flat

Yellow LED lights up when slightly tilted

Red LED lights up when fully tilted

Radio transceiver

This superheterodyne transceiver functions in the ham radio frequency ranges. When an antenna and speaker are plugged in, you can hear the Morse code transmitted by amateur radio operators from all around the country. The Radio Frequency (RF) gain knob acts as an attenuator at the input to keep the radio from overloading. The Receiver-Incremental Tuning (RIT) knob allows you to offset the receive frequency from the transmit frequency. The Variable Frequency Oscillator (VFO) knob tunes the radio.

The block diagrams and schematics can be found in "The Electronics of Radio" by David Rutledge.

More images

Radio transceiver with speaker

Circuitry

Top view

Front view

Back view

Infrared transmitter/receiver

The infrared transmitter/receiver pair is designed to allow signals (sound waves) to travel across a distance without wires. Using this device, you can wirelessly listen to music being played up to 10 feet away.

More images

Transmitter (left) and receiver

Receiver circuitry

Receiver packaging

Transmitter circuitry

Transmitter packaging

MP3 Jukebox

The MP3 Jukebox is a microprocessor-based system that is capable of playing MP3 files stored on an IDE hard drive. A ROM chip is now in the place of where the debugger used to be. The keypad is used to control the player and can play/pause/fast-forward/rewind the player. The system state and song names are shown on the display.

The underside of the board shows all the connections I created by wirewrapping the pins, color-coded for clarity. I love the way this looks.

The debugger plugged into the serial port on the target board. It was used to control and program the MP3 player while it was being built.

More images

Circuitry, top view

Circuitry, bottom view

Debugger

Block diagram

Board layout

Schematic

RoboCrane

This RoboCrane project for EE/CS51 at Caltech taught me about microprocessors. The system allowed an operator to program a robotic crane via a keypad and display or a serial device.

More images

Robocrane circuitry

Block diagram

Schematic

Continuity tester

The continuity tester was the first circuit I built. It would emit a noise if the circuit connection was solid. I've used this in almost every circuit class and even external projects.

More images

Schematic