serious interaction at a distance
A three-minute film exploring the recursive nature of memory and stories, avatar embodiment as storytellers, and the role of storytelling in culture – while tracing the thread that runs through each of us from time immemorial. (silent version used forRead more…
The impact of artificial intelligence on human lives is pervasive but not always apparent. In their work, Ulm collaborates with AI to explore the influence of both human and artificial processes of learning systems and environments on the physical andRead more…
The impact of artificial intelligence on human lives is pervasive but not always apparent. In Decoherence, Ulm collaborates with AI to explore the influence of both human and artificial processes of learning systems and environments. Which biases are seeded intoRead more…
In this trio of work, I continue to investigate the delicate veil between physical and virtual realities and the increasing influence of artificial intelligence [particularly machine learning algorithms] on the human experience in ways that tend to remain invisible dueRead more…
My studio is exploring the use of TikTok to launch game titles much as it has been proven effective for music and streaming projects. Furthermore, our gorilla campaign is still taking advantage of the push for multiplayer games and theRead more…
https://smfa.tufts.edu/calendar/mystic-show-opening I was asked to be part of this juried exhibition in Cambridge, MA at the Porter Gallery, and the theme really fits. I am showing a slightly modified version of “Gamer Saints” designed to be a bit more siteRead more…
My piece, “Case 01011: The Uncanny,” is an interactive narrative explored through physical and digital space, http://sprinklerfactory.com/events/spooky-interaction-at-a-distance/ I have curated a faculty show at the Sprinkler Factory in Worcester, MA to showcase our interactive works from the year, where this pieceRead more…
That game you play with your arms sticking out from around someone else’s body, and you act as their arms but cannot see. It is not necessary to mount the leap motion or other sensor (gesture/hand detection) on the front ofRead more…
Amanda Theinert mentioned creating AR responses to her (and others’) tattoos. I always enjoy making AR responsive art, and I enjoy practicing my own tattooing art. So . . . Her idea is wonderful, but I would like to play with tattooed skin,Read more…
Suffolk Gallery “The Mirror Revealed: Stories Told” curated by Deborah Davidson The six artists in the exhibit answer the following questions in myriad ways through their work. Why do we need stories as a species? How do these stories inRead more…
#talesfromtheveil and #talesthroughtheveil “The human species thinks in metaphors and learns through stories.” –Mary Catherine Bateson The land before you holds tales untold. Whose story will you tell? Which paths traversed? What motivations revealed? Where and when in this enigmaticRead more…
Why we choose to interact and how, is something that changes with context, culture, and core [personal]. When and where you find the piece, what is happening around it and with it, and finally, who you are and how youRead more…
I have been approached by the Associate Program Director for the School of Physical Therapy at MCPHS and have begun collaborations with a small team of graduate students researching the development of interactive media enhanced physical therapy for upper-body burn patients having one-on-one outpatient meetings withRead more…
The image in a secluded voting booth/box area, dark. The image is dark. On a vertical screen. Traditional frame. You look at it. It moves a bit. Maybe occasionally your eye gaze trace is shown — random. The image hasRead more…
I gathered a team comprised of seven Becker faculty, staff, and alums for the Neuroscience VR Jam that occurred in NYC as a unique precursor to the Games for Change conference. We applied and received a coveted spot in the eventRead more…
Gamer Saints The three Game Gods, the trifecta, represented in Her saintly forms for human perception, provide altars for supplication by worthy and desperate disciples. Perform the ritual, immerse yourself in their dedication chants, and receive Her divine blessing, ohRead more…
Ordination Cross the liminal space and enter into another realm for an entirely private exchange. Within this intimate space, the avatar will engage with you to offer up a tale of wonder, a commentary on her experience — one whichRead more…
The braille bracelet — use capacitive touch instead of buttons, duh. So like the same slider mechanisms I used on the original bracelet would be tied into touch sensor material and so you could still use my sliders, but theyRead more…
Light sensor so if you are trying to activate by yourself/too close and no one on other side, it growls at you! There are 3 of these, each getting more complicated for the person who activates. 1st one is justRead more…
Portal Cross the liminal space and enter into another realm. You must be brave and adorn yourself with the Portal headdress in this private space, shielded from the physical reality you have just left behind. What will be revealed toRead more…
Put the contact points far away so that you must hold hands [or be very creative] in order to see/activate the visual and auditory aspect of the work — with music, you can dance while you enjoy.While lying down? While inRead more…
In an elevator or a restroom stall. You must to stay to interact. Isolated or even singular. The work plays on a screen in front of you while you are in the stall or elevator. You would have to stay toRead more…
Little ‘stations’ around the house of little scenes on pedestals but they are designed to look like islands and they communicate through the internet of things IoT, so you can have the lights on them go through day/night cycles, soundRead more…
Fencing swords and fencing helmets but repurpose the swords’ electronics for something to trigger and put hmd into the helmets, like hololens or maybe VR with camera on where it shows room bounds because that could be a very interestingRead more…
Two Truths and a Lie [no longer on exhibit] This piece incorporates an avatar who relates a tale based on a given prompt such as, “When I was very young . . . “ There are a series of suchRead more…
Agas mask on a small base. wounded human, past warrior, future warrior, android, gimp, alien It will move to follow sounds and cock its head side to side It may rock back and forth to any extended play of music,Read more…
HoloBowl The touch-required Holobowl consists of an electronic singing bowl which wirelessly activates a holographic animation to be played within a multi-material helmet worn at a distance. The interaction requires two or more people to reveal the entirety of the experience, as oneRead more…
Aimona Phase one is a mobile, dynamic education distributed through Google Play and iOS App Store: an application modeled after the Tinder dating app to gather a corpus of data regarding human preferences in fine arts utilizing the open domainRead more…
The idea of ‘zooming in’ from this really remote blackness on a tiny light? But as you get closer and closer, it takes a while? You get there, like using a microscope, but when you finally get there, there isRead more…
VR mobile headset while a passenger in the car, bus, train, (self-driving soon) — meditation and take advantage of the MOVEMENT as passenger. Maybe the game would contextualize the physical world sounds and/or movement in a new way by providingRead more…
I see this dark black cabinet that has connected cables/lines that would allow you to move an object in free-range x,y across the floor of the cabinet. The cabinet floor has lcd screens [iphones/tablets] and the thing you are movingRead more…
OctoTale This piece consists of an eight ‘armed’ apparatus, and at the end of each arm there is a hand written postcard with keys, dentata, and bloodied fingerprints — each signed with a traditionally female name. Touching of the cardsRead more…
XR seance table [2 player version]. There would be VR/AR headsets and the 3d rudder under a table so that you could interact together by pushing on it without know what it was. Disguised as tables of old? Can you workRead more…
Entangled Do you hear what I hear? The answer is almost always no. This piece centers on the use of two paris of wireless headphones for a ‘couple’ (even if just for this experience) to utilize. Through this coupled, invisibleRead more…
What if you had to view a piece of art only if you were hungry? Had fasted? Were satiated? Like getting an MRI or going on a ride. We know we make odd decisions when we are hungry. When weRead more…
Ferrofluid sculpt with Interactive Base or Wall of Ferro-Pixels What if I have the fluid in an ‘outside’ container, like an oil and vinegar combo cruet. I was thinking maybe also just a bunch of tiny glass containers filled onlyRead more…
You have a guiding hand (choreographed) in the VR setup and you put your hand where it is and ‘trace’ with them. Of course you can’t see what you are drawing, but in reality your hand is also moving andRead more…
Where is the “pea” 3 cup game created by incorporating 3d printing of cups and interactivity, and small oled screens with eyes on top of each ‘cup’. Color detection sensor or distance sensor, so that the cup knows what’s underneath it, evenRead more…
On a plinth, black bendy light attached, black box on top, top of box is glass with black painted vignette [on inside so cant be wiped off?], and one side of box is removed and has black material which hasRead more…
I think often of how to ‘blend’ the small screen that would hold eyes or other features or whole face and the the paper that would be the rest of her. Is there need for plexi in front of allRead more…
Portal — as The Experience I initially exhibited Portal in a different physical embodiment and with an exterior level entitled Cosmic Waves. The Experience consisted of a sound-proof, all black, 5 foot enclosure with an interior stool. Cosmic Waves accompaniedRead more…
INGA: Intelligent Networked Grave Archive — Black box to hold the hologram displays. The idea of artist retrospectives and then public and private persona [that woman outed as a lesbian and andy warhol’s hospital coat pockets], authority, authored, control, authenticity,Read more…
For anyone who cares, as in you’ve been searching and working for over an hour trying to find someone else with the same issue because the issue seems to make no sense, I am recording this here: So you have aRead more…
Target Outcome: Demonstrable improvement of Working Memory and evidence of transfer Target Audience: children ages 6-10 Genre: Action-Puzzle Art Examples: Ulm Fun Factor: Collecting, customizing, sharing, being immersed in a singular appealing fantasy world Motivation for Play/Re-Play: Completionist categories, abilityRead more…
An app that let’s you create an event and then your group of friends, or open to public, gets to select a date for when it will happen. Can make it public or private You get an email and notificationRead more…
AR game where you/other players label walls and objects etc with fiducial markers to indicate type of material it is and then there is an item inside that material which you can see with x-ray vision only. The AR viewing playerRead more…
I made a proof of concept of this in Unity with the Leap, and it was actually fun moving my hands around and making platforms for my little character. Platformer — side view. A 3rd person character is moving along theRead more…
Flower arranging and bonsai creation combined [also succulent-like]. You build your own adorable BULBOUS plant with your hands You plant your seed — fast growing You trim and clip with your fingers like scissors You ‘paint’ the color on forRead more…
I was approached by an NEF Education Foundation board member to develop an app or web game for the national annual Block Kids engineering competition in which grade school children create non-organic structures with building blocks. An app could be extremely effectiveRead more…
The City of Worcester invited key community organizations to participate in this juried exhibition held in celebration of the American’s with Disabilities Act’s [ADA] 25th anniversary. Paul Cotnoir accepted the challenge, and the game department was very excited at theRead more…
You are in a dark world. You have a window / alcove you can peer into. In the window, there are disembodied hands that form a sign and show an image that this sign represents [how to show the imageRead more…
Alessandra LaTour, Becker College Veterinary faculty, on behalf of the School of Animal Studies Veterinary Technician National Exam (VTNE) Committee, asked me to lead the development of a prototype, “Vet Tech Sensei”. LaTour designed and authored a large database ofRead more…
A VR multiplayer [but set number], ambient horror game in which there is a space filled with dread to explore and escape. The players can move around, perform simple trigger interaction to read or inspect items, and turn on or off theirRead more…
While the project is purely entertainment based, my goals for it reflect my personal ideals as a developer; ones which are not as common in the current market as I would hope. They include: to create a game that willRead more…
A game where you take a photo that fits into a one third boxed area of a single photo and then pass it on to two other people [one then the other] who take a photo for another section, until it is complete.Read more…
October 2011 Two Person Chat Room Game Scenarios: Simple: If accepted, the two players are brought to a “scene selection” screen, from which the users can decide where their chat should take place thus providing a narrative for theirRead more…
I am particularly interested in promoting STEM areas to women, not only because programming is a passion of mine — one that I have found to be a rather lonely field for women — but also because we see soRead more…
I was approached by Gail Randall of the Greater Worcester Community Foundation to be the guest speaker at one of their monthly executive board meeting to discuss interactive media and games as resources for nonprofits. I gave a presentation toRead more…
A game where you ‘plan’ your moves ahead of time, enact them ahead of time. Finally, after the sequence is set, they will play out and you can see if you were successful. For example, you would move, jump, push in thatRead more…
In class and studio, I approach each lesson as a dialogue, open for discussion and informed debate. This is then followed by conclusions drawn through hands-on projects, much like any other science relying on hypotheses and experiments, which adds toRead more…
Our department’s success relies on faculty ensuring that our course offerings and the experiences of our students reflect the ever evolving nature of game development. One way that we are able to bridge the gap between our students’ academic experienceRead more…
2 Player, VR, Kinect or Neuron or Ximmersion Non-verbal communication for international/global studies or perhaps social interaction training [possibly helpful skill for those with Autism]. A more entertainment based concept is to consider how do the two players cooperate through a challengeRead more…
For this VR experience input is very important. We keep looking at wireless mice, game controllers, Myo armbands, the Kinect, Perception Neuron, and the Leap for interaction. Theinert and I saw and reviewed some other new wireless input devices. TheRead more…
A VR 3D scavenger hunt like an I Spy game book: Player has a list of items to find. Player explores a 3D sphere of 3D items. Player turns head and body around to see the entire world of objects — canRead more…
Introduction While mobile connectivity and the web have dramatically increased connections across a global society, there remain a number of opportunities to tap into virtual space as a way to bring about informed dialogue and present unique perspectives. One very compellingRead more…
So I was the first to review the Zizzle Zounds on Amazon — I just found the product one day at a store [it had just been released like a month before] and then bought a second copy online. ThisRead more…
Printed, after headpiece modification, at Shapeways. The mystic guards my living room now.
A was thinking for a possible installation piece, maybe something like being put into the world of one of the citizens of Pompeii during the eruption of Mount Vesuvius. It would be VR. I thought it would be interesting to exploreRead more…
I was invited to be part of a grant project initiated by Dr. French of the Becker College Veterinary School and Dr. Julie Ellis of Tufts School of Veterinary Medicine. Dr. Ellis was researching grant opportunities to develop an improvedRead more…
VRMS* for the Higgins Armory would be useful since it was shut down and the building is not being used while the collection it housed is now with the Worcester Art Museum. I would love to allow the public not only accessRead more…
A little ninja whose power is to be stinky. He doesnt throw ninja stars or use a sword. He just uses his power to make a less than pleasant smell. He’s sneaky and stealthy like a ninja . . .Read more…
Emma: Rift Ride I received the Oculus Rift DK1 and decided to enter their first contest, so over the course of 2 and a half weeks I designed, programmed, integrated, and did the visual assets for Emma. David Gates recordedRead more…
The Becker College Interactive Media Library will consist of a collection of respected and relevant interactive media titles representing the historic timeline of the development of the field from around the world. It will also include certain hardware and onlineRead more…
Physical [and app] Card game based on the back to back chair drawing game I do for my parties: Two players from the group sit back to back so they cannot see each other. One is the Drawer, the otherRead more…
The idea would be to create, “write,” poetry such as a haiku through motion. It could be a short series of musical elements instead — might work better at first. After you “perform” your piece, others would be able toRead more…
There are small projectors, pocket sized, for your mobile phone — like a projector for my iPhone. It could be very interesting to have that do a real-time projection of your phone’s camera capture, so that I could film myselfRead more…
You review a series of recorded messages, not knowing the context. As they progress you realize they are kind of a distress signal. The young girl in them was going through the war. But you are now trying to see whatRead more…
An interactive piece based on experiencing some element of living with atypical bodies to get through everyday tasks. For instance, buy a subway ticket in NYC: without vision, without being able to hear/speak, while being of small stature, while being unable to use your armsRead more…
VR and Kinect experience but focused on lack of motion — a form of meditation, but as you are able to stay still, the scene around you changes, exposing tranquility to you? Deer could come out, birds make noise, floraRead more…
An art piece. Initially conceived with two digital images — ie two frames and I think the could be next to each other but possibly on two separate walls. No written instructions provided to the viewers/users. But the space itselfRead more…
I was approached by the CEO of a New England music group for local bands to create an online game to promote the sight, their mission, and general participation. We wanted a game that centered on music obviously, but alsoRead more…
Digital tanagrams but synchronous — head to head. You can see the other player’s progress so they can help or hurt you — do you take the time to watch what they are doing and copy? Does seeing them makeRead more…
Race for the Ballot was a MassImpact project requested by Tim Loew to promote an interest in local politics through gaming. Two students and myself designed a web based casual game filled with puns to encourage education about the candidates and createRead more…
I think they are trying to do this with Pinterest now — I’ve been trying out the map section. Anyway, I’ve been to a million locations, say to an antique store, and I’ve wanted to remember it, but just addingRead more…
This idea is for a grade school classroom. A ‘story’ is being told on the table in the classroom, but elements of the story are filled in by the students. They can add and control their own elements of theRead more…
Stella Richard, Professor of Veterinary Science, asked me to create an interactive element for her dissertation on chromatophores. My particular task was to focus on the migration of various chromatophores in a fish’s dermis during periods of perceived color changeRead more…
The idea of a facial recognition system that read the smile or frown of the viewer and edits the projected portrait subject’s expression accordingly. You could then determine if a smiling person changed expression after seeing an opposite expression, orRead more…
A piece, perhaps a vase, something traditional, white porcelain. Allow for the viewer to trigger a projection so that the vase appears to have varying, different prints on it. The trigger could be proximity or location, or it could beRead more…
I’ve had this idea for a long long time. The user can get instant good karma [yes I know] by hitting a button to donate — $1, $5, $10, $100 You can instantly share this donation through social media andRead more…
In order to make our presence at PAX stand out, I designed and developed a casual, mobile game marketed to the PAX audience as a time filler while waiting in lines. The game used features of the iOS to makeRead more…
So I was playing with materials and cloth simulation the other day and I thought it would be cool to form something simple like a skirt and drape it on a scanned model of myself — it was cool. NowRead more…
I developed a fully interactive space and published a game title specifically for the event — IDA. The space was an interactive gallery of student work with puzzle elements which required various levels of participation. Parts of the gallery wereRead more…
The gaming model is centered on an approach that has goals, resources, and challenges for the audience during their experience. This approach is successful in part because it provides immersion and offers one solution for the goal of lifelong learning.Read more…
A little mobile app where you try to match alignment. timed. you see the right setup and then you have to mimmic it within the right time. You get scored based on how close you are within the boundaries/range. WhileRead more…
A door that looks invisible when you first see it, but as you approach or stand in front of it, a shadowing form appears, moves. The reality is, that form is created by another user in another part of theRead more…
trace game: but off the screen. the trace game is fun, but if the object is not fully seen, if you have to trace and that moves you off the screen, so that the final image is larger than theRead more…
I lead a team of three to create a game that reinforces the lessons of school bus safety for elementary students. The game is installed on a base-level PC which is housed in a unique mobile safety unit. This unit isRead more…
Many moons ago I approached Old Sturbridge Village to see if the Interactive Media department could provide more game content for them. They had a very cool section of their site for children with information and a few games, soRead more…
Taddug Media specializes in changing the world by encouraging positive interactions. By harnessing the power of interactive media we help _you_ help others. Bring your message to a broader audience Help others truly empathize with your cause Meaningfully educate aboutRead more…
PAX East is the largest game convention held on the East coast, and one of the largest in the nation. Each year hundreds of top name vendors and tens of thousands of excited gamers attend this event to see theRead more…
I volunteered to help develop a lunar simulator game for this NASA summer camp. I worked with Paul Jeffrey who introduced me to the Torque 3D game engine for the project, and we then divided the game into two missions: landingRead more…
“I keep a pocket full of theorems, sprinkling them on various situations, and seeing which ones fill in the cracks like walnut dust. I’ve accumulated them across so many (p)ages, but pairing them with the names this world has givenRead more…