The author’s introduction:
I, myself am pranav|mistry. ‘zombie’ is my nick name. My father Kirti Mistry is an architect & a technocrat. My loving mummy Nayana cares us all. I have two sisters, ‘Sweta’ & ‘Jigna’. I have a nephew named ‘Jini’. I love my family a lot. I have lots of friends, too. My family is big. I have 5 ‘masis’ & 3 ‘mamas’ & 5 ‘kakas’ & 2 ‘fois’ & … &… & …meet them all and my friends in my photo gallery.
I come from Palanpur, a small town of northern Gujarat, India. I graduated as Masters of Design from IIT Bombay and Masters of Media Arts and Sciences from MIT Media Lab. I completed my bachelors degree in Computer Science and Engineering. Before joining Media Lab, I worked with Microsoft as a UX Researcher. At present, I am a PhD student and Researcher at MIT Media Lab. Thinking is what I love the most, and fortunately my work is to come up with new innovative ideas.
如果您有雅兴,也可以看看My introduction
‘SixthSense’ is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information.
We’ve evolved over millions of years to sense the world around us. When we encounter something, someone or some place, we use our five natural senses to perceive information about it; that information helps us make decisions and chose the right actions to take. But arguably the most useful information that can help us make the right decision is not naturally perceivable with our five senses, namely the data, information and knowledge that mankind has accumulated about everything and which is increasingly all available online. Although the miniaturization of computing devices allows us to carry computers in our pockets, keeping us continually connected to the digital world, there is no link between our digital devices and our interactions with the physical world. Information is confined traditionally on paper or digitally on a screen. SixthSense bridges this gap, bringing intangible, digital information out into the tangible world, and allowing us to interact with this information via natural hand gestures. ‘SixthSense’ frees information from its confines by seamlessly integrating it with reality, and thus making the entire world your computer.
The SixthSense prototype is comprised of a pocket projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks user’s hand gestures and physical objects using computer-vision based techniques. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducials) at the tip of the user’s fingers using simple computer-vision techniques. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces. The maximum number of tracked fingers is only constrained by the number of unique fiducials, thus SixthSense also supports multi-touch and multi-user interaction.
The SixthSense prototype implements several applications that demonstrate the usefulness, viability and flexibility of the system. The map application lets the user navigate a map displayed on a nearby surface using hand gestures, similar to gestures supported by Multi-Touch based systems, letting the user zoom in, zoom out or pan using intuitive hand movements. The drawing application lets the user draw on any surface by tracking the fingertip movements of the user’s index finger. SixthSense also recognizes user’s freehand gestures (postures). For example, the SixthSense system implements a gestural camera that takes photos of the scene the user is looking at by detecting the ‘framing’ gesture. The user can stop by any surface or wall and flick through the photos he/she has taken. SixthSense also lets the user draw icons or symbols in the air using the movement of the index finger and recognizes those symbols as interaction instructions. For example, drawing a magnifying glass symbol takes the user to the map application or drawing an ‘@’ symbol lets the user check his mail. The SixthSense system also augments physical objects the user is interacting with by projecting more information about these objects projected on them. For example, a newspaper can show live video news or dynamic information can be provided on a regular piece of paper. The gesture of drawing a circle on the user’s wrist projects an analog watch.
The current prototype system costs approximate $350 to build.(More than $350 ,I have calculated this.)
The author’s personal website :http://www.pranavmistry.com/
一些感慨:
1.这是一个电脑界面早期的digitizer 的提升应用, 主要还是电脑跟现实的资料data structure如何建立, 他所谓的第六感其实就是一个新式的手机 本身只是一个 input和 output界面 主要运算还是透过终端的主机, 每个人都必须配备独立的终端高速主机 还有大频宽稳定的通信品质问题 软件硬件的故障排除问题等等。任何一个环节出现问题 都将造成错误,距离实现还是很大的距离, 本以为什么伟大的发明呢 这不算什么伟大发明 忽悠外行的可以 对行家来说这只算是系统整合应用。
2.这种技术科幻电影里面表现过,他的团队将这个技术转化为商品还需很长时间,首先,人们需要有一个机械脖子,不然这种操作能使很多人得颈椎病。第二是精度还要加强,精度加强要很长的路走。第三,是电源要充足,众所周知,投影仪是最耗电和功率相当大的机器。不知道夏天用会不会出现过热烧毁机器。第四,科技总是朝着商品化的脚步走下去的,但是最终还是服务于人,造福于人的。总结:这种技术不实用,和IBM开发的语音操作系统一样,都想通过简单的操作,控制复杂的数据。还有很长的路要走。
3.在台上他说了10分钟,而这项科技他已经研究了8年,而且还要不断地研究下去……
欢迎访问我的网站:www.qiyajun.com 查看最新内容
欢迎分享此日志,也让国内的大学生透过此,看到国内国外的差距,并从中获得灵感,得到大的提升!
如果大家有兴趣,可以看看我的其他文章:
Jacob
2010年5月21日21:24:26












感觉不方便插入评论
admin 回复:
五月 22nd, 2010 at 23:14
谢谢你的建议。我会更加努力
This is really a Fine,widespread Impression Write-up.Quite helpful to 1 who is just finding the resouces about this component.It will Unquestionably assist
admin 回复:
十二月 8th, 2010 at 12:32
It’s my pleasure that you love it .
My blog may concern about this more often.
有源码吗?
admin 回复:
十二月 26th, 2010 at 19:39
必然是没有的……
我看了也热血沸腾啊……
他还说要开源。。都那么久了。
admin 回复:
十二月 27th, 2010 at 12:07
美国政府不会同意的&
oh,no。害我白开心一场。
admin 回复:
十二月 29th, 2010 at 09:10
寒假我在到国外论坛上找一找,如果有消息,我发你。