{"id":215,"date":"2004-11-11T13:24:16","date_gmt":"2004-11-11T13:24:16","guid":{"rendered":"https:\/\/www.docbug.com\/blog\/archives\/215"},"modified":"2004-11-11T13:24:16","modified_gmt":"2004-11-11T13:24:16","slug":"augcog","status":"publish","type":"post","link":"https:\/\/www.docbug.com\/blog\/archives\/215","title":{"rendered":"AugCog"},"content":{"rendered":"<p>One of the most exciting talks for me was the joint ISWC\/ISMAR keynote by <a href=\"http:\/\/www.darpa.mil\/ipto\/personnel\/schmorrow.htm\">Dr. Dylan Schmorrow<\/a>, one of the program managers for DARPA. The program managers are the guys who decide what research projects DARPA should fund \u2014 the best-known PM was probably JCR Licklider, who funded the <em>Intelligence Augmentation<\/em> research that led to the invention of the Internet, the mouse, the first(?) hypertext system, etc. The current program Dylan talked about was <a href=\"http:\/\/www.darpa.mil\/ipto\/programs\/augcog\/\">Augmented Cognition<\/a>, which I&#8217;m now convinced could become the biggest breakthrough in wearable computing yet.<\/p>\n<p>Intelligence Augmentation tried to support human mental tasks, especially engineering tasks, by interacting with a computer through models of the data you&#8217;re working with \u2014 that was really the start of the shift from the mainframe batch-processing model to the interactive computer model. AugCog is about supporting <em>cognitive<\/em>-level tasks like attention, memory, learning, comprehension, visualization abilities and basic decision making by directly measuring a person&#8217;s mental state. The latest technology to come out of this effort is a sensor about the size of your hand with several near-infrared LEDs on it in the shape of a daisy, with a light sensor in the center. The human skull is transparent to near-IR (that&#8217;s how you get rid of all the heat your brain produces), so when it&#8217;s placed on the scalp you can detect back-scatter from the surface of the brain. By doing signal processing on the returned light you can detect blood-flow and thus brain activity, up to about 5cm deep (basically the cortex). They&#8217;ve already got some promising data on detecting understanding \u2014 one of the things DARPA is especially interested in is being able to tell a soldier &#8220;Do this, then that, then the other thing&#8230; got that?&#8221; And even if he says &#8220;Yup&#8221; his helmet can say &#8220;no, he didn&#8217;t really get it&#8230;.&#8221; Outside of military apps (and getting a little pie-in-the-sky), sometime down the road I can imagine using this kind of data to build interfaces that adapt to your cognitive load in near real-time, adjusting information displayed and output modalities to suit. In the more near-term, these devices are starting to be sold commercially and cost on the order of thousands of dollars, not tens or hundreds of thousands. That means a lot more brain-imaging science can be performed by a lot more diverse groups.<\/p>\n<p>For more info check out <a href=\"http:\/\/www.augmentedcognition.org\/\">www.augmentedcognition.org<\/a>, or go to the <a href=\"http:\/\/www.augmentedcognition.org\/\">Augmented Cognition conference<\/a> being held as a part of <a href=\"http:\/\/www.hci-international.org\/thematic-areas_description.asp?ID=9\">HCI-International<\/a> in Las Vegas July 22-27, 2005.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>One of the most exciting talks for me was the joint ISWC\/ISMAR keynote by <a href=\"http:\/\/www.darpa.mil\/ipto\/personnel\/schmorrow.htm\">Dr. Dylan Schmorrow<\/a>, one of the program managers for DARPA. The program managers are the guys who decide what research projects DARPA should fund \u2014 the best-known PM was probably JCR Licklider, who funded the <em>Intelligence Augmentation<\/em> research that led to the invention of the Internet, the mouse, the first(?) hypertext system, etc. The current program Dylan talked about was <a href=\"http:\/\/www.darpa.mil\/ipto\/programs\/augcog\/\">Augmented Cognition<\/a>, which I&#8217;m now convinced could become the biggest breakthrough in wearable computing yet.<\/p>\n<p>Intelligence Augmentation tried to support human mental tasks, especially engineering tasks, by interacting with a computer through models of the data you&#8217;re working with \u2014 that was really the start of the shift from the mainframe batch-processing model to the interactive computer model. AugCog is about supporting <em>cognitive<\/em>-level tasks like attention, memory, learning, comprehension, visualization abilities and basic decision making by directly measuring a person&#8217;s mental state. The latest technology to come out of this effort is a sensor about the size of your hand with several near-infrared LEDs on it in the shape of a daisy, with a light sensor in the center. The human skull is transparent to near-IR (that&#8217;s how you get rid of all the heat your brain produces), so when it&#8217;s placed on the scalp you can detect back-scatter from the surface of the brain. By doing signal processing on the returned light you can detect blood-flow and thus brain activity, up to about 5cm deep (basically the cortex). They&#8217;ve already got some promising data on detecting understanding \u2014 one of the things DARPA is especially interested in is being able to tell a soldier &#8220;Do this, then that, then the other thing&#8230; got that?&#8221; And even if he says &#8220;Yup&#8221; his helmet can say &#8220;no, he didn&#8217;t really get it&#8230;.&#8221; Outside of military apps (and getting a little pie-in-the-sky), sometime down the road I can imagine using this kind of data to build interfaces that adapt to your cognitive load in near real-time, adjusting information displayed and output modalities to suit. In the more near-term, these devices are starting to be sold commercially and cost on the order of thousands of dollars, not tens or hundreds of thousands. That means a lot more brain-imaging science can be performed by a lot more diverse groups.<\/p>\n<p>For more info check out <a href=\"http:\/\/www.augmentedcognition.org\/\">www.augmentedcognition.org<\/a>, or go to the <a href=\"http:\/\/www.augmentedcognition.org\/\">Augmented Cognition conference<\/a> being held as a part of <a href=\"http:\/\/www.hci-international.org\/thematic-areas_description.asp?ID=9\">HCI-International<\/a> in Las Vegas July 22-27, 2005.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[14],"tags":[],"class_list":["post-215","post","type-post","status-publish","format-standard","hentry","category-wearable-computing"],"_links":{"self":[{"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/posts\/215","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/comments?post=215"}],"version-history":[{"count":0,"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/posts\/215\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/media?parent=215"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/categories?post=215"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/tags?post=215"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}