Interactive Visualizations “To Go”

This TED video has been blowing my mind for a few days. There’s currently a lot of focus on touch-screen technology as the next standard in interaction with gadgets — everything from Microsoft’s Surface to personal electronic like the iPhone.

The SixthSense device developed by the MIT Fluid Interfaces Lab and Pranav Mistry turns the touchscreen on its head: It is a wearable projector with an attached camera/sensor that interprets natural hand gestures as commands. In other words, with the wave of a hand you can capture images, or perform any number of increasingly complex processes.

The uses for the SixthSense device are demonstrated in the video below, all of which take advantage of the device’s access to online information for tasks like scanning products at the grocery store based on personal preferences — like, red flashing lights when you pick up a frozen Banquet dinner with enough sodium and nitrates to kill a Kodiak bear. Extended abilities include projecting multimedia (like videos) on a normal newspaper, since the device not only reacts to gestures, but can also scan and adapt to whatever the user might have in front of him/her at the time.

Best of all, of course, is the fact that SixthSense can work with *any* surface, since it travels with the user. The implications are huge, as you can tell from the euphoric applause from the TED audience members (any Microsoft employees in attendance might have been in the fetal position, not sure). The only drawback is the bulkiness of the device itself, though the fact that the components themselves are already so affordable would likely make reduction in size and into an attractive retail product much easier.

In many environments the latter would already be largely irrelevant. As I watched the video of the device in action, I could already picture it in use in some far-flung military base, or in use by an Amazon.com employee doing inventory in some cavernous warehouse.

Sometimes the best ideas are just a re-arrangement of existing technology, what the SixthSense team seems to have nailed down is the fact that focusing on people’s existing behavior and molding a design to fit their needs is the key, rather than expecting them to adapt to an elaborate and counter-intuitive device.

164 Total TweetBacks: (Tweet this post)
  • en: @bloodandmilk I know..I have no point of view or argument. Just interest. 07/09/09 11:32am
  • en: oh man ! so irritated ryt now.... m sitting here in d admission block, calling ppl to confirm if dey ll join d colg or not !!!! 07/09/09 11:32am
  • en: @officialtila girl u tryna get high cholesterol or gain 10 pounds? 07/09/09 11:32am
  • en: I wonder which will happen first: SuIn realize Hwal-Haru option or Hwal see SuIn may fall for HTY seriously... 07/09/09 08:41am
  • en: Ok-i must b the only one who stays up late ... Or am I the opnly one in PST? Watching that ballroom movie w banderas and the inner city kids 07/09/09 08:41am
  • en: @ladyrayriz Yeah, It probably is bipolarity...check with a doctor or psychiatrist or something... 07/09/09 08:40am
  • en: ... or an average film... or a bad film.... or a film with good effects that seemed to have no plot or direction. 07/09/09 08:40am
  • en: Would we really make certain we left this life better people if we knew there was no time? Or would we run around in hedonistic frenzy? 07/09/09 08:40am
  • en: WOW!!! was that surprising or what??? And I thought nothing escaped me! 07/09/09 08:40am
  • en: @Emily_Is_Fly Do you like bread or something? 07/09/09 08:40am
  • en: @cloudberryman IMO it feels like you (or owner of info) is using scare tactics to sell webinar. "HUGE SECURITY HOLE" info should be free. 07/08/09 07:43pm
  • en: i like to go to new york i so happy for that or los angeles i dont now 07/08/09 07:43pm
  • en: Ok, I still have the old version of iTunes, is the new one really so bad or do you think it's ok to upgrade? Or does it screw everything up? 07/08/09 07:43pm
  • en: @jeyyounit11 Damn Boy dont for get to relax and enjoy your summer or don't work to hard lol 07/08/09 07:43pm
  • en: @ShaneHxC Silence or I'll get you with my al-you-min-ee-um gun! 07/08/09 07:43pm
  • en: @jusbot maybe in 1974 in a dark room, less a hundred pounds and a chin or three, but still, I'll take any compliment i can get 07/08/09 07:43pm
  • en: Glad the sun & some exercise was all I needed for a pick me up, not a cup of sugar or caffeine. 07/08/09 07:43pm
  • en: My wit is missing today. Also, I'm hungry but lack the inspiration to get up and make something. Or even have a good idea of what to make 07/08/09 07:43pm
  • en: @Khleo_t So is u is or is u aint gon follow me? damn tht sounded real ghetto. 07/08/09 07:43pm
  • en: 1 in 6 people on Earth is starving or undernourished. Tell President Obama to fight hunger at the G8 summit! http://s7y.us/vnb 07/08/09 07:43pm
  • en: woman on masterchef: I don't eat cabbage or venison. presenter: how will you know when those are done? woman: I don't know. I ain't eatin it 07/08/09 07:43pm
  • en: RT @futurepaul I don't want to sensationalize or anything, but my guess is that Google Chrome OS will probably solve world hunger. 07/08/09 07:43pm
  • en: @treespotter strange to Indonesian or live in Indonesia maybe. But I guess Indonesia is in fact not that important... 07/08/09 07:43pm
  • en: @ricklondon I have Awesome "Spirit Photo" i took Yesterday of Michael Jackson !!! How or WHO should i send it to or a website honoring MJ? 07/08/09 07:43pm
  • en: Is it just me or is Beautiful, Dirty, Rich the only Lady Gaga song that a) makes sense, b) any good?! 07/08/09 07:43pm
  • en: can u twitter on the ipod touch or what ever? 07/08/09 07:43pm
  • en: @westonwhitney @Amostyle or do something really powerful and threatening to cancer - like get a bumper sticker! 07/08/09 07:43pm
  • en: @SuFiGirl35 that's great !! How long before toy know what or if you've won the lawsuit ? 07/08/09 07:43pm
  • en: @iarebox Is this the list those you are going to use the cats on? or is this leprechaun material? xD Creepy owns!! 07/08/09 07:43pm
  • en: Attn span of today's "yoots" = 140 characters or 2.7 seconds. #okiesmart 07/08/09 07:43pm
  • en: #dontyouhate When People Act Like There Are Rumors About Them Or Put It Out There Themself Just To Get Attention 07/08/09 07:43pm
  • en: About to do some website stuff that will either be amazingly successful, or totally crash all our sites. Pray for me. 07/08/09 07:43pm
  • en: Grab your spouse & canine pals, and come to our P.A.Ws event July 23rd - the 26th! $25.00 a ticket. Come one day or all days! 07/08/09 07:43pm
  • en: decided to go to western australia on my hols next year anyone any tips on best places to go or must do's x :) 07/08/09 07:43pm
  • en: @1223StAr erthng is great thanks for asking..and i knw hw tht be staying out the scene 4 a bit!! whn u stepping bck out or u nt 07/08/09 07:43pm
  • en: @crookhaven hey if you still have that invite and don't want it, or don't have a friend that does i'll take it 07/08/09 07:43pm
  • en: "You're not allowed to make movies or take pictures in this area, Sir"... OK, OK, you won't have anymore twitpics for a while. 07/08/09 07:43pm
  • en: Tonight's schedule: Home, run run run, dinner, relax. Or something like that. 07/08/09 07:43pm
  • en: It's all fun & games until someone loses an eye. Just lost an eye! Received parental FB friend request. Confirm or Ignore? 07/08/09 07:43pm
  • en: I dunno if I wana come home because I'm bored or i've done it all before or I dunno 07/08/09 07:43pm
  • en: 30k biked tonight in 60 mins. Not 1 set of traffic lights or junction. Just fantastic. 07/08/09 07:43pm
  • en: @Ryan_James14 you found money or misplaced the money? 07/08/09 07:43pm
  • en: @jusscallmedOm lol Idnt think you wanna know..but if u open up the wrong door or turn a corner too quick; u mite juss find out 07/08/09 07:43pm
  • en: July Transfer Info Session for Fall 2009 on Fri July 17. RSVP & get info @ http://tinyurl.com/d4xluh or call 630-637-5800. 07/08/09 07:43pm
  • en: My husband wants to know who tweeple think is or was the best 'dunker' in NBA ever? 07/08/09 07:43pm
  • en: #truthbetold I want u to get out as soon as we're done. I dont want to cuddle, or talk sensitive nigga. 07/08/09 07:43pm
  • en: @OfficiallyDanie it's a desktop twitter app, so my twitter is always up, don't have to log off or on 07/08/09 07:43pm
  • en: @donniewahlberg i gave up fightin 4 u when i was 14! i dont have 2 now...i dont care if ppl like it or not that i'm a nk fan!! 07/08/09 07:43pm
  • en: @OhBriBri But its somebody always not liking you for you or always trying to change you! 07/08/09 07:43pm
  • en: @njoysiscaretti i`m getting there around 4 or 430 07/08/09 07:43pm
  • en: @sarahburgess71 good thing amos isnt there, or that other kid :) you might be tempted! 07/08/09 07:43pm
  • en: @ipiphanist yeah i saw that. wasn't sure how much weight to put on 'hate'. as if its 4 a time or til ur death....(not enuff charct at atime) 07/08/09 07:43pm
  • en: You just plugged a device into the audio jack! (Love the exclamation point... are Realtek's audio drivers enthusiastic, or what?) 07/08/09 07:43pm
  • en: taylor or martin? and why? thanks! haha :) 07/08/09 07:43pm
  • en: listening to 50CENT "GET RICH OR DIE TRYING" HIS BEST ALBUM I MUST SAY 07/08/09 07:43pm
  • en: Gamestop is having a $20 sale. Might stop by after work. Anyone play Blue Dragon, Ninja Gaiden 2, or Dead RIsing? Also still debating Spore. 07/08/09 07:43pm
  • en: gr8 run! Feeling better! ive so many things on my mind! Any yoga or pilates studio in lag? ths dvd aint doing much! I need an hour of yoga! 07/08/09 07:43pm
  • en: @Lugash Depressed is very much the wrong word actually. Maybe 'sad' or 'morose' would be more accurate. 07/08/09 07:43pm
  • en: "Our attitudes control our lives -- attitudes are a secret power working 24 hours a day for good or bad." We MUST harness and control th ... 07/08/09 07:43pm
  • en: @Pretty5lyBoi there was nuttin at express?!?! thas strange! Either white button down or a hot white tee w/ silver graphics?? Hmm i dunno! 07/08/09 07:43pm
  • en: @lesfollmar why KC? KS side or MO? my in-laws are there. 07/08/09 07:43pm
  • en: @sarah_honda I miss you.Or maybe I just miss Hawaii? But really we got a pool and a guest room. Bring ur ass to LA. WTF? 07/08/09 07:43pm
  • en: is crying! I really hope that is fake. If Oli Sykes died, I will seriously die a little on the inside. Or a lot. 07/08/09 07:43pm
  • en: @Artdream But what happened? I didn't block or unfollow you. I just thought you unfollowed me. 8( 07/08/09 07:43pm
  • en: "stay away from me stay away from my sister or I'll have you fired" I can go on all day, lol 07/08/09 07:43pm
  • en: @KulpreetSingh it is outside of allentown north of philadelphia, few airports to choose from , Allentown, Newark, NJ, or Philadelphia 07/08/09 07:43pm
  • en: ANYWAY, i'm going to do some cleaning so text me when things start happening. Or if people think about things happening 07/08/09 07:43pm
  • en: @big_tex_uk i don't know, is like a migraine but no headache, and is not normal migraine, or right date for migraine 07/08/09 07:43pm
  • en: @poetrynews love Angelou's poetry but MJ just creeps me out dead or alive 07/08/09 07:35pm
  • en: HEY UTAH - TEXT us your FREE ads... we will help you sell anything under $300 & 15 words or less! Magic Nickel Ads 9797546 07/08/09 07:35pm
  • en: @Jennamae03 Thank you ma'am...now give that Bentley back or at least pull over while texting! lol! 07/08/09 07:35pm
  • en: Voting for SourceForge Community Choice Awards. http://ow.ly/gNYx - I think Keepass or XAMPP have my vote for best project. but it's hard. 07/08/09 07:35pm
  • en: listening to one of my favorite Micheal Jackson songs! Black or White! RIP!!! #BSB 07/08/09 07:35pm
  • en: cardio circuits or combined circuits training? 07/08/09 07:35pm
  • en: RT @mikeklonsky: Blame people or the system? It was Duncan vs. Darling-Hammond at last weekend's NEA Conference http://tinyurl.com/kjjscv 07/08/09 07:35pm
  • en: The revolution will not be televised or funded and sure as hell won't be in the Stranger 07/08/09 07:35pm
  • en: go to my site at phoenixathletictraining.vpweb.com or leepromations.com 07/08/09 07:35pm
  • en: RT @indigo777: people first look into tools and only then decide if they should switch to #agile or not. oh my. this should be vice versa! 07/08/09 07:35pm
  • en: RT @Branwen6277: @30SECONDSTOMARS oh wait I know: delete button? amiright? | the escape button or ctrl alt delete 07/08/09 07:35pm
  • en: @kinkyadvice i know! isn't it bad enough we had to WAIT! and personally, I have to wait longer to hear or see 'em? they can't be mean! 07/08/09 07:35pm
  • en: @30SECONDSTOMARS weapon. when you defend yourself always there's a second person that doesnt get what it wants or needs. 07/08/09 07:35pm
  • en: why the celebrities do not tell their fans? they are afraid or what?.... 07/08/09 07:35pm
  • en: Eek, just realized that it's Greinke Day! Understandable or pathetic that I'd rather watch him pitch on TV than go to Fenway as planned? 07/08/09 07:35pm
  • en: add me to myspace, www.myspace.com/seabass111 or myyearbook, www.myyearbook.com/talecia or yahoo, babygirl202wastalecia 07/08/09 07:35pm
  • en: Find out how your client, or your client's customers, get their news in order to remain relevant, @skydiver. #okieSMart 07/08/09 07:35pm
  • WOOT!: for the last time until Hawaii or is Alaska next? 07/08/09 07:35pm
  • en: Black or Green puma bag?!? 07/08/09 07:35pm
  • en: about 2 go get mytat dont know wat sould i get my old area code or my mom name 07/08/09 07:35pm
  • en: @WendiMooreAgncy do you find that clients in general are now comfortable with digital versions, or are many still looking for print? 07/08/09 07:35pm
  • en: @MissAponte fashion square... u wanna meet me there? Or scoop u? 07/08/09 07:35pm
  • en: @wasatchwoman what about Cabelas for the oudoors people or try this place http://tiny.cc/plnCJ Not sure what you're looking for. 07/08/09 07:35pm
  • en: @benltohmpson are we still having a meeting? at 4:00 or 5:00? 07/08/09 07:35pm
  • en: Got a minor surgery on my left foot today. The needles hurt like crap. Can't walk. Or wear shoes. I feel about as alive as a doorknob. 07/08/09 07:35pm
  • en: @iMikePayne yea when they keep running past your table. I could see if they were little like 2 or 3 but these boys had to be about 5 & 8 07/08/09 07:35pm
  • en: @ludajuice I Still say F*** A Quickie! Gotta get mine> Aggressive or not, A Quickie wont do! If the Pussy is his, then he no better!! 07/08/09 07:35pm
  • en: @ItsBrookeRyan I like Bonnie and Clyde, they were ride or die 07/08/09 07:35pm
  • en: studying deviant behaviors, phobias like Ceraunophobia, Ablutophobia, and disorders such as all-or-nothing thinking, and yes... OCD. 07/08/09 07:35pm
  • en: BarackO: For those hoping that I "stay in Africa" during my visit: if there's no Chicago-style pizza or a White House over there, forget it! 07/08/09 07:35pm
  • en: I was watching TV "Maury Show - Man or Woman?" Omg! The dudes look 100% like girls!! how can that be?!! man~ guys shld be afraid~ v afraid 07/08/09 07:35pm
  • en: @Susana1995 What Grade is he in? Or going to be in? 07/08/09 07:35pm
  • en: What car is better a 81' Nissan 280zx 2+2 or a 89' Porshe 930??? 07/08/09 07:35pm
  • en: RT @KimSherrell RT @designmeme: Beware links w/phrase "select country Canada". Spammers or gov agents hunting protestors #iranelection 07/08/09 07:35pm
  • en: @bradnoble Wow, and with zero emails or IMs to me. I'm proud of ya, buddy! 07/08/09 07:35pm
  • en: Ashford coupon extended - Get $50 off any purchase of $750 or more. Now valid through 7/31/09. Use coupon JUNEFT - http://tinyurl.com/ntzy7j 07/08/09 07:35pm
  • en: 50 Greatest Movie Trailers: The Experts Speak: A week or so ago, the "50 Greatest Movie Trailers" list made the .. http://tinyurl.com/nyj958 07/08/09 07:35pm
  • en: @steveplunkett Yeah, maybe 1 or 2 things. Thankfully I have smart, patient friends that put up with questions. 07/08/09 07:35pm
  • en: @DirtyWhoreleb cheesy? is it an easy cheese...like a American cheese? or a develop a taste for kind of cheese...like goat cheese? 07/08/09 07:35pm
  • en: Tankv?rt f?r de regniga dagarna. Is this a Feature or a Company? - http://ri.ms/ghay 07/08/09 07:35pm
  • no: ah sux..best buds now or wut ha. 07/08/09 07:35pm
  • en: @therealpinkyxxx Either next Tuesday or the Tuesday after that. What's a good email for you? 07/08/09 07:35pm
  • en: @nottjmiller about to go cruisin down the street in my 6-4.. u can wax my impalla or ill give you an autograph #gangstabehavia 07/08/09 07:35pm
  • en: CampingStation.com took my money and never sent item or check... #campingstation.com #sucks http://tinyurl.com/lw74wy 07/08/09 07:35pm
  • en: goin 2 do sumthin funn like get taco bell. or play with my sis BRITTANY an she is awsum an stuff o an shes gettn a burito:) 07/08/09 07:35pm
  • en: Tying to using Google Tasks or Todo more, but there is something so rewarding about writing a list on paper and scratching off things. 07/08/09 07:35pm
  • en: @WickedGirls are you Dominant, submissive or a switch? How do you like it in the bedroom? Who is the top? Tell me your Fantasy! 07/08/09 07:35pm
  • en: A room filled with people so quiet you can hear them breathe OR a room filled with people so loud you can't hear yourself think. Pick one. 07/08/09 07:35pm
  • en: @wendy_dance Feast or famine? 07/08/09 07:35pm
  • en: @Dani70023 im like, ok whatever! lol. i went to get my tickets for harry potter and gonna make either chili or enchilada casserole. yum! 07/08/09 07:35pm
  • en: @_ErikaJean_ Never to many pictures on blog or tweets.. 07/08/09 07:35pm
  • en: @Samantha_Blue thankyou dear, we should definitely do tea or dinner soon.. <3<3 07/08/09 07:35pm
  • : or call 778-995-1102 07/08/09 07:35pm
  • en: still doesn't get the power or attraction of Twitter. Any thoughts? 07/08/09 07:35pm
  • en: Corbis.com Get $50 Apple? gift card when you spend $350 on Rights Managed or Royalty-Free photography or Royalty-Free discs. Use code SUMMER 07/08/09 07:35pm
  • en: ugh. not sure what 2 do: sleep or eat. maybe i better eat real quick b4 i fall asleep and all choice is taken from me. 07/08/09 07:35pm
  • en: @mktoon it came and nothing happened. I was expecting like a flash of light Lost style or something. Maybe tonight at 7/8/09 10:11:12pm? 07/08/09 07:35pm
  • en: ok, so i need 2 advils, the work day to end, and a nice cocktail or 2; but i may not want to do the advils and cocktails at the same time. 07/08/09 07:35pm
  • en: @ElvisT Toronto got Hedo, didn't they? Maverick's = Mess. Better fix interior defense and rebounding, or never win 07/08/09 07:35pm
  • en: or maybe not. i don't know. my head hurts. 07/08/09 07:35pm
  • en: @BaGzDaBoSS i'm late. who was voting? male or females? 07/08/09 07:35pm
  • en: Aarg, Fuckme or something. imma right my ass off i think. or something else.. dunnooooooooo 07/08/09 07:35pm
  • en: I am not feeling good in either a physical or mental capacity. 07/08/09 07:35pm
  • en: @CBCebulski You guys are pretty hardcore over there aren't you? "Finish today by four or you will die!!" 07/08/09 07:35pm
  • en: I am looking for my old friend Asad, and I think he should write me on facebook. Or call me. 07/08/09 07:35pm
  • en: @matthaze The direct approach is better. Hurt feelings will get better, but if they don't call, you just wonder WTF? (or assume they died) 07/08/09 07:35pm
  • en: But in dummy terms, 68 is when a nigga eats p*ssy and the woman doesn't return the favor or vice versa! 07/08/09 05:40am
  • en: People who are in need of demolition and hauling jobs, projects, or even some cleaning job please visit our website www.4cornersdemo.com TY 07/08/09 05:40am
  • en: @oliver816 morning ... should I bother asking if it's home made or shop bought ? ... 07/08/09 05:40am
  • en: Either or: Louboutins or Brian Atwood? Unwanted lip or chin hair? Bangles or a ring? Black or white nail polish? Missionary or doggy style? 07/07/09 01:51am
  • en: So boring job -_-;; i want fun time or something 07/07/09 01:51am
  • en: @onegoodpenguin I gotta assume some sort of bar incident? Or, I set it on the bathroom counter for music sometimes. Who knows.. 07/07/09 01:51am
  • en: @thurmanator2 illegal or outer space? 07/07/09 01:51am
  • en: @iameevents is that a good thing or a bad thing? 07/07/09 01:51am
  • : chases always in Texas or California? 07/06/09 06:40pm
  • en: I think I might go to vegas or san fran??? Maybe out of the country if I get this passport in time 07/06/09 06:40pm
  • en: @BeckaKnight222 I believe you can do more than 4 people with ichat. You just need a MBP or faster to host it 07/06/09 06:40pm
  • en: @THE_MO_WILLIAMS if ariza decides to skip out houston nd joins the cavs do u think he will come out the bench or start?? 07/06/09 06:40pm
  • en: @jaketapper ok, I dont think that was clear at all. So it was the press core's fault or it was the russians fault? 07/06/09 06:40pm
  • en: Can't decide if goob still has fleas, he's itchy cuz of bath, or just spreading his smell like usual... Why can't he speak english 07/06/09 06:40pm
  • en: Just realized I don't have my wallet or keys. Have my blackberry. Guess I'm walking to my meeting. Should be an interesting after that. Hmmm 07/06/09 06:40pm
  • en: chicago state or the university of minnesota? i have til the end of august to decide 07/06/09 06:40pm
  • en: @rhiannosaurus Ohhhhhh, ok. See, I have no sense of humor or it is overdeveloped so I need help with these things. 07/06/09 06:40pm
  • en: will follow do or die policy from now on.. 07/06/09 06:40pm
  • en: @debbierosenbaum Can heal, or hurt, particularly when you block someone out of the blue... 07/06/09 06:40pm
  • en: Revive your old Mac G3, G4, or G5 with LinuxGhacks Technology NewsThe Mac in question was an old G3 800 Mhz iBook. With OS X the laptop f.. 07/06/09 06:40pm
  • en: @cnotemuziq some people just got sweaty hands, man! u cant hate on that, dude might have just quit smoking or something 07/06/09 06:40pm
  • en: @noahatthedisco they better be happy, or i'll kill them all >:/ 07/06/09 06:40pm
  • en: Agreed ?2k price fixed price for fledgling business website; now the vampire wants ?3k extra for branding. I'll .. his forehead, or maybe... 07/06/09 06:40pm
  • en: @honeybearbee if it is just a joke or something, well. they'd be better off actually breaking up, I think. they will have lost a LOT of fans 07/06/09 06:40pm
  • en: RT @TheSCICoach: "Do your own thing; sing your own song; dance in the rain or whatever it is you feel will give you joy." -JSP 07/06/09 06:40pm
  • en: @TokyoBunnie NICE! I won't be going this year. =( It was either go or invest in a new piece to produce. I chose the latter. 07/06/09 06:40pm
  • en: @oldandmoldy he is out of the house from 9 til 3 or so I don't get out of work until 4:30, so the kids are to stay in the house until Iget 07/06/09 06:40pm
  • en: My thought is you post to "Where's Smokey" via a twitter hashtag, or by clicking a big button on an iphone app that sends along the GPS data 07/06/09 06:40pm
  • en: RT: @planetpit I Do this 4 Yall, therefore I'm leaving this up 2 u 2 decide: Do u want to see ME on Premios Juventud or Jimmy Kimmel ? 07/06/09 06:40pm
  • en: There needs to be some sort of statistic for professionals that measures % of time spent at conferences. Office-to-Road-Ratio or something. 07/06/09 06:40pm

Tags:

Leave a Reply