nih-gov/www.nih.gov/node/237346
2025-02-26 13:17:41 -05:00

589 lines
48 KiB
Text
Raw Permalink Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

<!DOCTYPE html>
<html class="no-js" lang="en" dir="ltr" prefix="content: http://purl.org/rss/1.0/modules/content/ dc: http://purl.org/dc/terms/ foaf: http://xmlns.com/foaf/0.1/ rdfs: http://www.w3.org/2000/01/rdf-schema# sioc: http://rdfs.org/sioc/ns# sioct: http://rdfs.org/sioc/types# skos: http://www.w3.org/2004/02/skos/core# xsd: http://www.w3.org/2001/XMLSchema#">
<head>
<title>System turns imagined handwriting into text | National Institutes of Health (NIH)</title>
<meta charset="utf-8" />
<script type="text/javascript">
//<![CDATA[
var usasearch_config = { siteHandle:"nih" };
var script = document.createElement("script");
script.type = "text/javascript";
script.src = "//search.usa.gov/javascripts/remote.loader.js";
document.getElementsByTagName("head")[0].appendChild(script);
//]]>
</script><link rel="shortcut icon" href="https://www.nih.gov/favicon.ico" type="image/vnd.microsoft.icon" />
<meta name="google-site-verification" content="rjIoO4vW0AYgltSYvxM1L_CzGIkq28kHf9gHIASKx8s" />
<link rel="profile" href="http://www.w3.org/1999/xhtml/vocab" />
<meta http-equiv="cleartype" content="on" />
<link rel="apple-touch-icon" href="https://www.nih.gov/sites/all/themes/nih/apple-touch-icon.png" />
<meta name="description" content="Researchers developed a system for people with paralysis that quickly translates brain signals for handwriting into text." />
<meta name="keywords" content="brain-to-text, paralysis, brain-computer interface, BCI, communication, handwriting, intracortical, motor cortex, spinal cord injury, neural representations, BrainGate, BRAIN Initiative, Brain Research Through Advancing Innovative Neurotechnologies®, Francis Willett, Krishna Shenoy, John Ngai, Nature" />
<meta name="robots" content="follow, index" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
<meta name="generator" content="Drupal 7 (http://drupal.org)" />
<link rel="canonical" href="https://www.nih.gov/news-events/nih-research-matters/system-uses-imagined-handwriting-turn-thoughts-into-text" />
<link rel="shortlink" href="https://www.nih.gov/node/237346" />
<meta http-equiv="content-language" content="EN" />
<meta property="og:site_name" content="National Institutes of Health (NIH)" />
<meta property="og:type" content="article" />
<meta property="og:title" content="System turns imagined handwriting into text" />
<meta property="og:url" content="https://www.nih.gov/news-events/nih-research-matters/system-uses-imagined-handwriting-turn-thoughts-into-text" />
<meta property="og:description" content="Researchers developed a system for people with paralysis that quickly translates brain signals for handwriting into text." />
<meta property="og:updated_time" content="2021-05-25T11:44:02-04:00" />
<meta property="og:image" content="https://www.nih.gov/sites/default/files/news-events/research-matters/2021/20210512-brain.jpg" />
<meta property="og:image:url" content="https://www.nih.gov/sites/default/files/news-events/research-matters/2021/20210512-brain.jpg" />
<meta name="twitter:card" content="summary" />
<meta name="twitter:title" content="System turns imagined handwriting into text" />
<meta name="twitter:url" content="https://www.nih.gov/news-events/nih-research-matters/system-uses-imagined-handwriting-turn-thoughts-into-text" />
<meta name="twitter:description" content="Researchers developed a system for people with paralysis that quickly translates brain signals for handwriting into text." />
<meta name="twitter:image" content="https://www.nih.gov/sites/default/files/news-events/research-matters/2021/20210512-brain.jpg" />
<meta property="article:published_time" content="2021-05-17T13:35:18-04:00" />
<meta property="article:modified_time" content="2021-05-25T11:44:02-04:00" />
<meta name="owner" content="OD" />
<meta name="published_date" content="2021-05-17T13:35:18-04:00" />
<meta name="last_revision" content="2021-05-25T11:44:02-04:00" />
<link type="text/css" rel="stylesheet" href="https://www.nih.gov/sites/default/files/css/css_PfvPCWanzn7FjDwZqwAHhPoOxYKwkQP-RZSK1pFFG0s.css" media="all" />
<link type="text/css" rel="stylesheet" href="https://www.nih.gov/sites/default/files/css/css__mIWP9gcStq74isjZVoAAsiih8VXwJoN75Nyw_BXrj0.css" media="screen" />
<style media="print">#sb-container{position:relative;}#sb-overlay{display:none;}#sb-wrapper{position:relative;top:0;left:0;}#sb-loading{display:none;}
</style>
<link type="text/css" rel="stylesheet" href="https://www.nih.gov/sites/default/files/css/css_jENQOQqZCRFGZK__DTefxYiXR2RUf03k1ugj3_Vg7vk.css" media="all" />
<link type="text/css" rel="stylesheet" href="//cdn.jsdelivr.net/qtip2/3.0.3/jquery.qtip.min.css" media="all" />
<link type="text/css" rel="stylesheet" href="https://www.nih.gov/sites/default/files/css/css_3yt-b0M1HNJsvKsXwYjh5TEtX2lJGAvJvtmVAfORYZs.css" media="all" />
<link type="text/css" rel="stylesheet" href="//fonts.googleapis.com/css?family=Droid+Sans:700,regular|Droid+Serif:italic,regular&amp;subset=latin" media="all" />
<link type="text/css" rel="stylesheet" href="https://www.nih.gov/sites/default/files/css/css_E4VlyxyL3JMcT6dslWLGb0uQdoI2bh_Xj0N65V-bcWo.css" media="all" />
<link type="text/css" rel="stylesheet" href="https://www.nih.gov/sites/default/files/css/css_5rDMv37-JxnNA70cRr_1jlAjVs56DCb8EN4XB2QLl0c.css" media="all" />
<!--[if lte IE 8]>
<link type="text/css" rel="stylesheet" href="https://www.nih.gov/sites/default/files/css/css_aLJB_yHt22A_mQek4IRDNsur5tEkCpqLe72j_w6QHQ0.css" media="all" />
<![endif]-->
<link type="text/css" rel="stylesheet" href="https://www.nih.gov/sites/default/files/css/css_KviiBystpJcQq4MplcQZvCFxnu9V763f5bPq_AKh4xM.css" media="all" />
<script src="https://www.nih.gov/sites/default/files/js/js_mQAv54bz2JVXcwS5QWlz0fVY9Os67zeu9bgNqtlVLPY.js"></script>
<script src="//code.jquery.com/jquery-2.2.4.min.js"></script>
<script>window.jQuery || document.write("<script src='/sites/all/modules/contrib/jquery_update/replace/jquery/2.2/jquery.min.js'>\x3C/script>")</script>
<script>jQuery.migrateMute=true;jQuery.migrateTrace=false;</script>
<script src="//code.jquery.com/jquery-migrate-1.4.1.min.js"></script>
<script>window.jQuery && window.jQuery.migrateWarnings || document.write("<script src='/sites/all/modules/contrib/jquery_update/replace/jquery-migrate/1.4.1/jquery-migrate.min.js'>\x3C/script>")</script>
<script src="https://www.nih.gov/sites/default/files/js/js_9sGTPBGcOGZjLiSLGrYEnuUf8VdvLmL_DEZNNNbnHXk.js"></script>
<script src="https://www.nih.gov/sites/default/files/js/js_hNnF7a_sbk6nZ2-mOamHzalYND7HBHDLRInsaU93HDk.js"></script>
<script>document.createElement( "picture" );</script>
<script src="https://www.nih.gov/sites/default/files/js/js_gHk2gWJ_Qw_jU2qRiUmSl7d8oly1Cx7lQFrqcp3RXcI.js"></script>
<script src="//cdn.jsdelivr.net/qtip2/3.0.3/jquery.qtip.min.js"></script>
<script defer="defer" src="//script.crazyegg.com/pages/scripts/0011/2616.js"></script>
<script src="https://www.nih.gov/sites/default/files/js/js_3s0l7MQ3oYmGkNAypyzCJq3a0wT85XX_P1SLgnph5K4.js"></script>
<script>
Shadowbox.path = "/sites/all/libraries/shadowbox/";
</script>
<script>jQuery.extend(Drupal.settings, {"basePath":"\/","pathPrefix":"","setHasJsCookie":0,"instances":"{\u0022default\u0022:{\u0022content\u0022:{\u0022text\u0022:\u0022\u0022},\u0022style\u0022:{\u0022tip\u0022:false,\u0022classes\u0022:\u0022\u0022},\u0022position\u0022:{\u0022at\u0022:\u0022bottom right\u0022,\u0022adjust\u0022:{\u0022method\u0022:\u0022\u0022},\u0022my\u0022:\u0022top left\u0022,\u0022viewport\u0022:false},\u0022show\u0022:{\u0022event\u0022:\u0022mouseenter \u0022},\u0022hide\u0022:{\u0022event\u0022:\u0022mouseleave \u0022}}}","qtipDebug":"{\u0022leaveElement\u0022:0}","shadowbox":{"animate":true,"animateFade":true,"animSequence":"wh","auto_enable_all_images":1,"auto_gallery":1,"autoplayMovies":true,"continuous":false,"counterLimit":10,"counterType":"default","displayCounter":true,"displayNav":true,"enableKeys":true,"fadeDuration":0.34999999999999998,"handleOversize":"resize","handleUnsupported":"link","initialHeight":160,"initialWidth":320,"language":"en","modal":false,"overlayColor":"#000","overlayOpacity":0.80000000000000004,"resizeDuration":0.55000000000000004,"showMovieControls":true,"slideshowDelay":0,"viewportPadding":20,"useSizzle":false},"picture":{"mappings":[["Sidebar media mappings","sidebar_media_mappings"],["Floated media mappings","floated_media_mappings"],["Not Set","not_set"]],"label":"Image size (required)"},"extlink":{"extTarget":"_blank","extClass":"ext","extLabel":"(link is external)","extImgClass":0,"extIconPlacement":0,"extSubdomains":1,"extExclude":"(.\\.nih\\.gov.)|(.\\.cancer\\.gov.)|(.\\.genome\\.gov.)|(.\\.drugabuse\\.gov.)|(locatorplus\\.gov.)|(.\\.govdelivery\\.com.)|(.\\.hatchbuck\\.com.)|(nihseniorhealth\\.gov.)|(clinicaltrials\\.gov.)|(search\\.usa\\.gov\\\/search\\?affiliate\\=hip.)|(search\\.gov\\\/search\\?affiliate\\=hip.)|(drugabuse\\.gov.)|(medlineplus\\.gov.)|(collegedrinkingprevention\\.gov.)|(smokefree\\.gov.)|(arpa-h\\.gov.)|(nih\\.sharepoint\\.com)","extInclude":"(.\\.pagefreezer\\.com.)","extCssExclude":".media, .emergency-message, .slideshow-main, .bean-home-slideshow-2l-block","extCssExplicit":"","extAlert":"_blank","extAlertText":"You are leaving the NIH website.\r\n\r\nThis external link provides additional information that is consistent with the intended purpose of this site. NIH cannot attest to the accuracy of a non-federal site.\r\n\r\nLinking to a non-federal site does not constitute an endorsement by NIH or any of its employees of the sponsors or the information and products presented on the site. You will be subject to the destination site\u2019s privacy policy when you follow the link.","mailtoClass":"mailto","mailtoLabel":"(link sends e-mail)","extUseFontAwesome":0}});</script>
<script type="application/javascript" id="uws-snippet">
// Verint Unified WebSDK Integration Snippet v2.3
//
// Instructions: please embed this snippet directly into every page of your website template.
// For optimal performance, this should be embedded directly into the template, not referenced as
// an external file.
//
// DO NOT MODIFY BELOW THIS LINE *****************************************
(function () {
var cookies = document.cookie.split("; ").reduce(function (o, i) { var p = i.split("="); o[p[0]] = p[1]; return o; }, {});
var containerValue = cookies.uws_container_override && JSON.parse(decodeURIComponent(cookies.uws_container_override));
var config = {
moduleHost: "ucm-us.verint-cdn.com",
configHost: "ucm-us.verint-cdn.com",
siteKey: "nih-gov",
container: containerValue || "live",
loadTime: Date.now()
};
var readyCallbacks = []; window.uwsReady = function (callback) { readyCallbacks.push(callback); };
var sdkPath = "//" + [config.moduleHost, "files/sites", config.siteKey, config.container, "sdk.js"].join("/");
var script = document.createElement("script"); script.src = sdkPath; script.async = true; script.type = "module";
script.addEventListener("load", function () { window.unifiedSDK.start(config, readyCallbacks); });
document.head.appendChild(script);
})();
// DO NOT MODIFY ABOVE THIS LINE *****************************************
</script>
</head>
<body class="html not-front not-logged-in page-node page-node- page-node-237346 node-type-nih-research-matters section navigation-nih-research-matters section-news-events">
<a href="#main-content" class="element-invisible element-focusable">Skip to main content</a>
<noscript aria-hidden="true"><iframe src="https://www.googletagmanager.com/ns.html?id=GTM-5CBCNW2" height="0" width="0" style="display:none;visibility:hidden"></iframe></noscript>
<div class="l-page has-one-sidebar has-sidebar-second">
<div class="l-page-content">
<header class="l-header" role="banner">
<div class="l-ribbon-wrapper">
<ul class="l-ribbon">
<li><span class="ribbon-hhs"></span><a href="https://www.hhs.gov">U.S. Department of Health &amp; Human Services</a><span class="ribbon-right"></span></li>
</ul>
</div> <div class="l-banner-wrapper">
<div class="l-banner">
<div class="l-branding">
<a class="nih-logo icon-nih-logo" href="/" title="National Institutes of Health (NIH) - Turning Discovery into Health" rel="home"><img src="/sites/all/themes/nih/images/nih-logo-color.png" width="390" height="60" alt="National Institutes of Health (NIH) - Turning Discovery into Health" /></a>
</div>
<!-- DigitalGov Search -->
<form accept-charset="UTF-8" action="https://search.nih.gov/search" id="search" class="search-form site-search" method="get">
<div style="margin:0;padding:0;display:inline"><input name="utf8" type="hidden" value="&#x2713;" /></div>
<input id="affiliate" name="affiliate" type="hidden" value="nih" />
<label for="query" class="hide">Search the NIH Website</label>
<input autocomplete="on" class="usagov-search-autocomplete form-field form-field-site-search" id="query" name="query" type="text" placeholder="Search NIH" /><input type="submit" name="commit" value="Search" class="form-button form-button-site-search" />
</form>
<ul class="banner-utilities">
<li><a href="/virtual-tour">Virtual Tour</a></li>
<li><a href="https://ned.nih.gov/">Staff Directory</a></li>
<li><a href="https://salud.nih.gov">En Espa&ntilde;ol</a></li>
</ul>
</div>
</div>
</header>
<div class="l-navigation-wrapper">
<!-- ****************** SITE MENU ****************** -->
<h2 class="element-invisible">Site Menu</h2>
<nav class="l-menu-wrapper">
<ul class="l-menu">
<!-- ********* HOME TAB (Mobile view only) ********* -->
<li class="tab-wrapper tab-wrapper-home">
<div class="tab home"><a href="/"><span>Home</span></a></div>
</li>
<!-- ********* HEALTH INFO TAB ********* -->
<li class="tab-wrapper tab-wrapper-healthinfo tab-wrapper-left">
<div class="tab"><a href="/health-information"><span>Health Information</span></a></div>
<div class="megamenu">
<div class="megamenu-col megamenu-leftcol">
<ul class="sub-menu">
<li><a href="https://www.hhs.gov/programs/social-services/health-care-facilities/index.html">Health Care Providers & Facilities</a></li>
<li><a href="/health-information/health-info-lines">Health Info Lines</a></li>
<li><a href="https://www.healthcare.gov">HealthCare.gov</a></li>
<li><a href="/research-training/science-education">Science Education Resources</a></li>
<li><a href="/health-information/nih-clinical-research-trials-you">NIH Clinical Research Trials and You</a></li>
<li><a href="/institutes-nih/nih-office-director/office-communications-public-liaison/clear-communication/talking-your-doctor">Talking to Your Doctor</a></li>
<!--<li><a href="/institutes-nih/nih-office-director/office-communications-public-liaison/clear-communication/clear-health-nih" title="">Clear Health AZ</a></li>-->
</ul>
<p class="more-wrapper"><a class="button gold" href="/health-information" title="More Health Information">More &raquo;</a></p>
</div>
<div class="megamenu-col megamenu-rightcol">
<form id="hipsearch" accept-charset="UTF-8" action="https://search.nih.gov/search" method="get" class="search-form">
<p class="subhead"><label for="query2">Search Health Topics</label></p>
<div class="input-wrapper">
<div style="margin:0;padding:0;display:inline"><input name="utf8" type="hidden" value="&#x2713;" /></div>
<input id="affiliate" name="affiliate" type="hidden" value="hip" />
<input type="hidden" name="dc" value="940" />
<input autocomplete="on" maxlength="50" class="usagov-search-autocomplete form-field form-field-search" id="query2" name="query" type="text" />
<input name="commit" type="submit" value="Go" id="searchbutton" class="form-button" />
</div>
</form>
<p class="subhead">Quick Links</p>
<ul class="sub-menu">
<li><a class="minibadge minibadge-medlineplus" href="https://medlineplus.gov/"><span class="minibadge-text">MedlinePlus Health Info</span></a></li>
<li><a class="minibadge minibadge-newsinhealth" href="https://newsinhealth.nih.gov/"><span class="minibadge-text">NIH News in Health</span></a></li>
<li><a class="minibadge minibadge-wellnesstoolkits" href="/health-information/your-healthiest-self-wellness-toolkits"><span class="minibadge-text">Wellness Toolkits</span></a></li>
</ul>
</div>
</div>
</li>
<!-- ********* GRANTS TAB ********* -->
<li class="tab-wrapper tab-wrapper-grants tab-wrapper-left">
<div class="tab"><a href="/grants-funding"><span>Grants & Funding</span></a></div>
<div class="megamenu">
<div class="megamenu-col megamenu-leftcol">
<ul>
<li><a href="https://grants.nih.gov">Grants Home Page</a></li>
<li><a href="https://grants.nih.gov/funding/index.htm">Find Funding</a></li>
<li><a href="https://grants.nih.gov/grants/how-to-apply-application-guide/due-dates-and-submission-policies/due-dates.htm">Due Dates</a></li>
<li><a href="https://grants.nih.gov/grants/how-to-apply-application-guide.html">How to Apply</a></li>
<li><a href="https://grants.nih.gov/grants/about_grants.htm">About Grants</a></li>
<li><a href="https://grants.nih.gov/policy/index.htm">Policy &amp; Compliance</a></li>
<li><a href="https://nexus.od.nih.gov/all/">Grants News/Blog</a></li>
<li><a href="https://grants.nih.gov/funding/contracts.htm">Contracts</a></li>
<li><a href="https://www.lrp.nih.gov/">Loan Repayment</a></li>
</ul>
<p class="more-wrapper"><a class="button gold" href="/grants-funding" title="More Grants &amp; Funding Information">More &raquo;</a></p>
</div>
<div class="megamenu-col megamenu-rightcol">
<p class="subhead">Quick Links</p>
<ul>
<li><a class="minibadge minibadge-report" href="https://report.nih.gov/"><span class="minibadge-text">RePORT</span></a></li>
<li><a class="minibadge minibadge-era" href="https://commons.era.nih.gov/commons/"><span class="minibadge-text">eRA Commons</span></a></li>
<li><a class="minibadge minibadge-commonfund" href="https://commonfund.nih.gov/"><span class="minibadge-text">NIH Common Fund</span></a></li>
</ul>
</div>
</div>
</li>
<!-- ********* NEWS TAB ********* -->
<li class="tab-wrapper tab-wrapper-news tab-wrapper-left">
<div class="tab"><a href="/news-events"><span>News &amp; Events</span></a></div>
<div class="megamenu">
<div class="megamenu-col megamenu-leftcol">
<ul>
<li><a href="/news-events/news-releases">News Releases</a></li>
<li><a href="/news-events/digital-media-kits">Digital Media Kits</a></li>
<li><a href="/news-events/media-resources">Media Resources</a></li>
<li><a href="/news-events/media-contacts">Media Contacts</a></li>
<li><a href="/news-events/images-b-roll">Images and B-roll</a></li>
<li><a href="/news-events/events">Events</a></li>
<li><a href="/news-events/social-media-outreach">Social Media</a></li>
</ul>
<p class="more-wrapper"><a class="button gold" href="/news-events" title="More News &amp; Events">More &raquo;</a></p>
</div>
<div class="megamenu-col megamenu-rightcol">
<p class="subhead">Quick Links</p>
<ul>
<li><a class="minibadge minibadge-newsinhealth" href="https://newsinhealth.nih.gov/"><span class="minibadge-text">NIH News in Health</span></a></li>
<li><a class="minibadge minibadge-researchmatters" href="/news-events/nih-research-matters"><span class="minibadge-text">NIH Research Matters</span></a></li>
<li><a class="minibadge minibadge-nihrecord" href="https://nihrecord.nih.gov/"><span class="minibadge-text">NIH Record</span></a></li>
</ul>
</div>
</div>
</li>
<!-- ********* RESEARCH TAB ********* -->
<li class="tab-wrapper tab-wrapper-research tab-wrapper-right">
<div class="tab"><a href="/research-training"><span>Research &amp; Training</span></a></div>
<div class="megamenu">
<div class="megamenu-col megamenu-leftcol">
<ul>
<li><a href="/research-training/medical-research-initiatives">Medical Research Initiatives</a></li>
<li><a href="/research-training/science-highlights">Science Highlights</a></li>
<li><a href="/research-training/science-education">Science Education</a></li>
<li><a href="/research-training/research-nih-labs-clinics">Research in NIH Labs &amp; Clinics</a></li>
<li><a href="/research-training/training-opportunities">Training Opportunities</a></li>
<li><a href="/research-training/library-resources">Library Resources</a></li>
<li><a href="/research-training/research-resources">Research Resources</a></li>
<li><a href="/research-training/clinical-research-resources">Clinical Research Resources</a></li>
<li><a href="/research-training/safety-regulation-guidance">Safety, Regulation and Guidance</a></li>
</ul>
<p class="more-wrapper"><a class="button gold" href="/research-training" title="More Research &amp; Training">More &raquo;</a></p>
</div>
<div class="megamenu-col megamenu-rightcol">
<p class="subhead">Quick Links</p>
<ul>
<li><a class="minibadge minibadge-pubmed" href="https://pubmed.ncbi.nlm.nih.gov"><span class="minibadge-text">PubMed</span></a></li>
<li><a class="minibadge minibadge-stemcell" href="https://stemcells.nih.gov"><span class="minibadge-text">Stem Cell Information</span></a></li>
<li><a class="minibadge minibadge-oppnet" href="https://oppnet.nih.gov"><span class="minibadge-text">OppNet</span></a></li>
<li><a class="minibadge minibadge-nidb" href="https://intramural.nih.gov"><span class="minibadge-text">NIDB</span></a></li>
<li><a class="minibadge minibadge-nihblueprint" href="https://neuroscienceblueprint.nih.gov"><span class="minibadge-text">NIH Blueprint for Neuroscience Research</span></a></li>
</ul>
</div>
</div>
</li>
<!-- ********* INSTITUTES TAB ********* -->
<li class="tab-wrapper tab-wrapper-institutes tab-wrapper-right">
<div class="tab"><a href="/institutes-nih"><span>Institutes at NIH</span></a></div>
<div class="megamenu">
<div class="megamenu-col megamenu-leftcol">
<ul>
<li><a href="/institutes-nih/list-institutes-centers">List of Institutes and Centers</a></li>
<li><a href="/institutes-nih/nih-office-director">NIH Office of the Director</a></li>
<li><a href="/institutes-nih/directors-nih-institutes-centers">Directors of NIH Institutes and Centers</a></li>
<li><a href="/institutes-nih/nih-institute-center-contact-information">NIH Institute and Center Contact Information</a></li>
</ul>
<p class="more-wrapper"><a class="button gold" href="/institutes-nih" title="More About the Institutes at NIH">More &raquo;</a></p>
</div>
<div class="megamenu-col megamenu-rightcol">
<p class="subhead">Quick Links</p>
<ul class="ic-acronymn-list">
<li><a href="https://www.cancer.gov" title="National Cancer Institute">NCI</a></li>
<li><a href="https://nei.nih.gov" title="National Eye Institute">NEI</a></li>
<li><a href="https://www.nhlbi.nih.gov" title="National Heart, Lung, and Blood Institute">NHLBI</a></li>
<li><a href="https://www.genome.gov" title="National Human Genome Research Institute">NHGRI</a></li>
<li><a href="https://www.nia.nih.gov" title="National Institute on Aging">NIA</a></li>
<li><a href="https://www.niaaa.nih.gov" title="National Institute on Alcohol Abuse and Alcoholism">NIAAA</a></li>
<li><a href="https://www.niaid.nih.gov" title="National Institute of Allergy and Infectious Diseases">NIAID</a></li>
<li><a href="https://www.niams.nih.gov" title="National Institute of Arthritis and Musculoskeletal and Skin Diseases">NIAMS</a></li>
<li><a href="https://www.nibib.nih.gov" title="National Institute of Biomedical Imaging and Bioengineering">NIBIB</a></li>
<li><a href="https://www.nichd.nih.gov" title="Eunice Kennedy Shriver National Institute of Child Health and Human Development">NICHD</a></li>
<li><a href="https://www.nidcd.nih.gov" title="National Institute on Deafness and Other Communication Disorders">NIDCD</a></li>
<li><a href="https://www.nidcr.nih.gov" title="National Institute of Dental and Craniofacial Research">NIDCR</a></li>
<li><a href="https://www.niddk.nih.gov" title="National Institute of Diabetes and Digestive and Kidney Diseases">NIDDK</a></li>
<li><a href="https://nida.nih.gov" title="National Institute on Drug Abuse">NIDA</a></li>
<li><a href="https://www.niehs.nih.gov" title="National Institute of Environmental Health Sciences">NIEHS</a></li>
<li><a href="https://www.nigms.nih.gov" title="National Institute of General Medical Sciences">NIGMS</a></li>
<li><a href="https://www.nimh.nih.gov" title="National Institute of Mental Health">NIMH</a></li>
<li><a href="https://www.nimhd.nih.gov" title="National Institute on Minority Health and Health Disparities">NIMHD</a></li>
<li><a href="https://www.ninds.nih.gov" title="National Institute of Neurological Disorders and Stroke">NINDS</a></li>
<li><a href="https://www.ninr.nih.gov" title="National Institute of Nursing Research">NINR</a></li>
<li><a href="https://www.nlm.nih.gov" title="National Library of Medicine">NLM</a></li>
<li><a href="https://www.cc.nih.gov" title="NIH Clinical Center">CC</a></li>
<li><a href="https://www.cit.nih.gov" title="Center for Information Technology">CIT</a></li>
<li><a href="https://www.csr.nih.gov" title="Center for Scientific Review">CSR</a></li>
<li><a href="https://www.fic.nih.gov" title="Fogarty International Center">FIC</a></li>
<li><a href="https://ncats.nih.gov" title="National Center for Advancing Translational Sciences">NCATS</a></li>
<li><a href="https://nccih.nih.gov" title="National Center for Complementary and Integrative Health">NCCIH</a></li>
</ul>
</div>
</div>
</li>
<!-- ********* ABOUT TAB ********* -->
<li class="tab-wrapper tab-wrapper-about tab-wrapper-right">
<div class="tab"><a href="/about-nih"><span>About NIH</span></a></div>
<div class="megamenu">
<div class="megamenu-col megamenu-leftcol">
<ul>
<li><a href="/about-nih/who-we-are">Who We Are</a></li>
<li><a href="/about-nih/what-we-do">What We Do</a></li>
<li><a href="https://hr.nih.gov/jobs">Jobs at NIH</a></li>
<li><a href="/about-nih/visitor-information">Visitor Information</a></li>
<li><a href="/about-nih/frequently-asked-questions">Frequently Asked Questions</a></li>
<li><a href="/about-nih/contact-us">Contact Us</a></li>
<!--<li><a href="/about-nih/explore-nih">Explore NIH</a></li>-->
</ul>
<p class="more-wrapper"><a class="button gold" href="/about-nih" title="More About NIH">More &raquo;</a></p>
</div>
<div class="megamenu-col megamenu-rightcol">
<p class="subhead">Quick Links</p>
<ul>
<li><a href="/about-nih/who-we-are/nih-director">The NIH Director</a></li>
<li><a href="/virtual-tour">Take the Virtual Tour</a></li>
<li><a href="/about-nih/what-we-do/nih-turning-discovery-into-health">NIH&hellip;Turning Discovery Into Health<sup>&reg;</sup></a></li>
<li><a href="/about-nih/what-we-do/impact-nih-research">Impact of NIH Research</a></li>
<li><a href="/about-nih/what-we-do/science-health-public-trust">Science, Health, and Public Trust</a></li>
</ul>
</div>
</div>
</li>
</ul>
<div class="tab-bkgnd"></div><!-- For pixel rounding issue -->
</nav>
<!-- ****************** END SITE MENU ****************** -->
</div>
<div class="l-main-wrapper">
<div class="l-main" id="page-content">
<h2 class="element-invisible">You are here</h2><div class="breadcrumb"><a href="/">Home</a> » <a href="/news-events">News &amp; Events</a> » <a href="/news-events/nih-research-matters">NIH Research Matters</a></div> <div class="l-region l-region--section-header">
<div id="block-block-101" class="block block--block sectionheader block--block-101" id="block-block-101" class="block block--block sectionheader block--block-101">
<div class="content" class="block__content">
<h2><a href="/news-events/nih-research-matters">NIH Research Matters</a></h2> </div>
</div>
</div>
<div class="l-content-wrapper">
<div class="l-content" role="main">
<a id="main-content"></a>
<div about="/news-events/nih-research-matters/system-uses-imagined-handwriting-turn-thoughts-into-text" typeof="sioc:Item foaf:Document" class="ds-1col node node--nih-research-matters view-mode-full node--full node--nih-research-matters--full clearfix">
<p class="publishdate"><span property="dc:date" datatype="xsd:dateTime" content="2021-05-18T00:00:00-04:00" class="date-display-single">May 18, 2021</span></p><div class='syndicate'><h1>System turns imagined handwriting into text</h1><div class="callout callout-with-border"><h3>At a Glance</h3>
<ul>
<li>Researchers developed a system for people with paralysis that quickly translates brain signals for handwriting into text.</li>
<li>The technology could help restore the ability of people with spinal cord injuries and certain neurological disorders to communicate.</li>
</ul></div><div class="media-float-right"><div class="ds-1col file file-image file-image-jpeg view-mode-floated_media clearfix">
<picture title="Cartoon of man thinking about writing a sentence while electrodes implanted into his brain send a signal that appears as words on a computer screen">
<!--[if IE 9]><video style="display: none;"><![endif]-->
<source srcset="https://www.nih.gov/sites/default/files/styles/floated_media_breakpoint-large/public/news-events/research-matters/2021/20210512-brain.jpg?itok=a-GjvWNv&amp;timestamp=1621272863 1x" media="screen and (min-width: 960px)" />
<source srcset="https://www.nih.gov/sites/default/files/styles/floated_media_breakpoint-medium/public/news-events/research-matters/2021/20210512-brain.jpg?itok=eMucLOtH&amp;timestamp=1621272863 1x" media="screen and (min-width: 800px)" />
<source srcset="https://www.nih.gov/sites/default/files/styles/floated_media_breakpoint-medium-small/public/news-events/research-matters/2021/20210512-brain.jpg?itok=csnk2bPU&amp;timestamp=1621272863 1x" media="screen and (min-width: 600px)" />
<source srcset="https://www.nih.gov/sites/default/files/styles/floated_media_breakpoint-small/public/news-events/research-matters/2021/20210512-brain.jpg?itok=Grq25eRr&amp;timestamp=1621272863 1x" media="screen and (min-width: 480px)" />
<source srcset="https://www.nih.gov/sites/default/files/styles/floated_media_breakpoint-tiny/public/news-events/research-matters/2021/20210512-brain.jpg?itok=td40PdMb&amp;timestamp=1621272863 1x" media="screen and (min-width: 0)" />
<!--[if IE 9]></video><![endif]-->
<img src="https://www.nih.gov/sites/default/files/styles/floated_media_breakpoint-medium/public/news-events/research-matters/2021/20210512-brain.jpg?itok=eMucLOtH&amp;timestamp=1621272863" alt="Cartoon of man thinking about writing a sentence while electrodes implanted into his brain send a signal that appears as words on a computer screen" title="Cartoon of man thinking about writing a sentence while electrodes implanted into his brain send a signal that appears as words on a computer screen" />
</picture><span class="caption">Two implanted electrode arrays record the brain activity produced when thinking about writing letters. This information is collected and processed in real-time by a computer, which converts that data into words on a screen. </span><span class="credit">Shenoy lab &amp; Erika Woodrum (artist)</span></div>
</div><p>Advances in technology allow people who have lost the ability to move or speak to communicate again. Brain-computer interfaces, or BCIs, enable direct communication between the brain and an external computer. BCIs decode neural activity and translate it into commands to accomplish the users goal. Using BCI technology, people who are paralyzed can control a robotic arm or type with a computer cursor through brain activity.</p>
<p>However, point-and-click typing using BCIs can be a slow process, making it inefficient to use. Researchers are looking for new approaches to speed BCI communication. Focusing on the brain signals used for rapid, fine movements like handwriting might speed the process. A team led by Dr. Francis Willett and Dr. Krishna Shenoy of Stanford developed a BCI that decodes thoughts of handwriting movements and translates them into text in real time. They assessed the speed and accuracy of the system with a person who was paralyzed from a spinal cord injury.</p>
<p>The study was funded in part by NIHs BRAIN Initiative, National Institute of Neurological Disorders and Stroke (NINDS) and National Institute on Deafness and Other Communication Disorders (NIDCD). Findings were published in <em>Nature</em> on May 12, 2021.</p>
<div class="media-float-right">
<div><a href="https://www.youtube.com/embed/pcApwQxbagg?autoplay=1" rel="shadowbox; width=640; height=360" title="Video of how a brain computer interface turns mental handwriting into text on a screen"><img alt="Video of how a brain computer interface turns mental handwriting into text on a screen" height="427" src="https://www.nih.gov/sites/default/files/styles/video_sidebar/public/media-youtube/pcApwQxbagg.jpg?itok=36I1hWNu" title="Video of how a brain computer interface turns mental handwriting into text on a screen" typeof="Image" width="640" /></a>
<p class="caption">Researchers decoded the neural signals associated with writing letters, then displayed typed versions of those letters in real time. They hope their invention could one day help people with paralysis communicate.</p>
</div>
</div>
<p>Researchers asked the participant to attempt to write as if his hand was not paralyzed. He was told to imagine he was holding a pen on a piece of ruled paper. He then pictured copying individual letters displayed on the screen, as well as symbols for spaces and stops.</p>
<p>Electrodes implanted in the brain recorded signals from the participants motor cortex, the region of the brain that controls fine movement. Even after a person is paralyzed from a spinal cord injury, their motor cortex still works and produces neural signals for the intended movement. The electrodes recorded brain activity from approximately 200 individual neurons that responded collectively to the “writing” of each character. </p>
<p>These brain signals were then used to train a machine-learning computer algorithm to identify the neural patterns representing individual letters. After a series of training sessions, the system allowed the participant to form new sentences, with the computer displaying letters in real time.</p>
<p>The handwriting BCI system is a marked improvement over existing BCIs that move a cursor to “type” words on a screen. Using the new system, the participant was able to compose sentences and communicate with others at a speed of about 90 characters per minute with 94% accuracy. This speed is comparable to someone of a similar age typing on a smartphone. In contrast, “point-and-click” interfaces have only achieved about 40 characters per minute.</p>
<p>“Attempting to write each letter produces a unique pattern of activity in the brain, making it easier for the computer to identify what is being written with much greater accuracy and speed,” Willett explains.</p>
<p>“This study represents an important milestone in the development of BCIs and machine learning technologies that are unraveling how the human brain controls processes as complex as communication,” says Dr. John Ngai, director of the NIH BRAIN Initiative. “This knowledge is providing a critical foundation for improving the lives of others with neurological injuries and disorders.”</p>
<p>While preliminary, this technology could help those who have lost the ability to write and speak. The clinical trial, called <a href="https://www.clinicaltrials.gov/ct2/show/NCT00912041">BrainGate2</a>, continues to test this and other BCI technologies.</p></div><h2 class="label-above">Related Links</h2><ul class="spaced print-urls"><li><a href="https://www.nih.gov/news-events/nih-research-matters/scientists-create-speech-using-brain-signals" target="_top">Scientists Create Speech Using Brain Signals</a></li><li><a href="https://www.nih.gov/news-events/nih-research-matters/spinal-cord-stimulation-improves-hand-grip-after-cervical-spinal-injury" target="_top">Spinal Cord Stimulation Improves Hand Grip After Cervical Spinal Injury</a></li><li><a href="https://www.nih.gov/news-events/nih-research-matters/spinal-cord-stimulation-helps-paralyzed-people-move-hands" target="_top">Spinal Cord Stimulation Helps Paralyzed People Move Hands</a></li><li><a href="https://www.nih.gov/news-events/nih-research-matters/spinal-cord-injury-repair-requires-scars" target="_top">Spinal Cord Injury Repair Requires Scars</a></li><li><a href="https://www.nih.gov/news-events/nih-research-matters/paralyzed-men-gain-movement-without-surgery" target="_top">Paralyzed Men Gain Movement Without Surgery</a></li><li><a href="https://www.nih.gov/news-events/nih-research-matters/thought-control-gives-paralyzed-people-helping-hand" target="_top">Thought-Control Gives Paralyzed People Helping Hand</a></li><li><a href="https://www.nih.gov/news-events/nih-research-matters/device-restores-movement-paralyzed-limbs" target="_top">Device Restores Movement to Paralyzed Limbs</a></li><li><a href="https://www.nih.gov/news-events/nih-research-matters/controlling-computers-your-mind" target="_top">Controlling Computers with Your Mind</a></li><li><a href="https://braininitiative.nih.gov/" target="_top">NIH BRAIN Initiative</a></li></ul><p class="footnote"><strong class="label-inline">References:&nbsp;</strong><a href="https://pubmed.ncbi.nlm.nih.gov/33981047/">High-performance brain-to-text communication via handwriting.</a> Willett FR, Avansino DT, Hochberg LR, Henderson JM, Shenoy KV. <em>Nature</em>. 2021. May;593(7858):249-254. doi: 10.1038/s41586-021-03506-2. Epub 2021 May 12. PMID: 33981047.</p><p class="footnote"><strong class="label-inline">Funding:&nbsp;</strong>NIHs BRAIN Initiative, National Institute of Neurological Disorders and Stroke (NINDS), and National Institute on Deafness and Other Communication Disorders (NIDCD); Howard Hughes Medical Institute; US Department of Veterans Affairs; L. and P. Garlick; S. and B. Reeves; Stanford University; Simons Foundation.</p>
</div>
<div class="lastupdated">
</div> </div>
<aside class="l-region l-region--sidebar-second masonry-container">
<div id="block-ds-extras-in-this-edition" class="block block--ds-extras box block--ds-extras-in-this-edition" id="block-ds-extras-in-this-edition" class="block block--ds-extras box block--ds-extras-in-this-edition">
<h3 class="block__title">In this Edition</h3>
<div class="content" class="block__content">
<div class="view view-nih-rm-in-this-edition view-id-nih_rm_in_this_edition view-display-id-default view-dom-id-bea861f2722ff852b1d52760b065a6ef">
<div class="view-content">
<div>
<p><a href="/news-events/nih-research-matters/system-uses-imagined-handwriting-turn-thoughts-into-text" class="active">System turns imagined handwriting into text</a></p> </div>
<div>
<p><a href="/news-events/nih-research-matters/nanoparticle-vaccine-against-various-coronaviruses">Nanoparticle vaccine against various coronaviruses</a></p> </div>
<div>
<p><a href="/news-events/nih-research-matters/delivering-rna-therapies-brain-tumors">Delivering RNA therapies to brain tumors</a></p> </div>
</div>
</div> </div>
</div>
<div id="block-bean-research-matters-search" class="block block--bean box block--bean-research-matters-search" id="block-bean-research-matters-search" class="block block--bean box block--bean-research-matters-search">
<h3 class="block__title">Search NIH Research Matters</h3>
<div class="content" class="block__content">
<div about="/block/research-matters---search" class="ds-1col entity entity-bean bean-research-matters-block view-mode-default clearfix">
<!-- DigitalGov Search -->
<form id="directorsearch" accept-charset="UTF-8" action="https://search.nih.gov/search/docs" method="get" class="search-form">
<div class="input-wrapper">
<div style="margin:0;padding:0;display:inline"><input name="utf8" type="hidden" value="✓" /></div>
<input id="affiliate" name="affiliate" type="hidden" value="nih" />
<input type="hidden" name="dc" value="678" />
<label for="query2" class="hide">Search NIH Research Matters' stories</label>
<input autocomplete="off" class="usagov-search-autocomplete form-field form-field-search" id="query2" name="query" type="text" />
<input name="commit" type="submit" value="Go" id="searchbutton" class="form-button" />
</div>
</form>
</div>
</div>
</div>
<div id="block-bean-research-matters-contact-us" class="block block--bean box block--bean-research-matters-contact-us" id="block-bean-research-matters-contact-us" class="block block--bean box block--bean-research-matters-contact-us">
<h3 class="block__title">Connect with Us</h3>
<div class="content" class="block__content">
<div about="/block/research-matters---contact-us" class="ds-1col entity entity-bean bean-research-matters-block view-mode-default clearfix">
<p><a class="button-link" href="https://service.govdelivery.com/accounts/USNIH/subscriber/new?topic_id=USNIH_48" onclick="window.open(this.href,'popup','width=725,height=500,left=25,top=25,location=no,resizable=yes,scrollbars=yes,status=yes');return false;">Subscribe to get NIH Research Matters by email</a></p>
<ul class="icon-list">
<li><a class="icon-link rss-monochrome" href="/nih-research-matters/feed.xml"><span class="icon"></span>RSS feed</a></li>
<li><a class="icon-link facebook-monochrome" href="https://www.facebook.com/ResearchMatters"><span class="icon"></span>Facebook</a></li>
<li><a class="icon-link email-monochrome" href="mailto:nihresearchmatters@od.nih.gov"><span class="icon"></span>Email us</a></li>
</ul>
<p><strong>Mailing Address:</strong><br />
NIH Research Matters<br />
Bldg. 31, Rm. 5B52, MSC 2094<br />
Bethesda, MD 20892-2094</p></div>
</div>
</div>
<div id="block-bean-research-matters-popular-stori" class="block block--bean box block--bean-research-matters-popular-stori" id="block-bean-research-matters-popular-stori" class="block block--bean box block--bean-research-matters-popular-stori">
<h3 class="block__title">Popular Stories</h3>
<div class="content" class="block__content">
<div about="/block/research-matters---popular-stori" class="ds-1col entity entity-bean bean-research-matters-block view-mode-default clearfix">
<p><a href="https://www.nih.gov/news-events/nih-research-matters/research-context-can-we-slow-aging">Research in Context: Can we slow aging?</a></p>
<p><a href="https://www.nih.gov/news-events/nih-research-matters/brain-changes-observed-during-pregnancy">Brain changes observed during pregnancy</a></p>
<p><a href="https://www.nih.gov/news-events/nih-research-matters/research-context-detecting-cancer">Research in Context: Detecting cancer</a></p>
<p><a href="https://www.nih.gov/news-events/nih-research-matters/risk-future-burden-dementia-united-states">Risk and future burden of dementia in the United States </a></p>
<p><a href="https://www.nih.gov/news-events/nih-research-matters/complete-wiring-map-adult-fruit-fly-brain">Complete wiring map of an adult fruit fly brain</a></p>
</div>
</div>
</div>
<div id="block-bean-research-matters-about" class="block block--bean box block--bean-research-matters-about" id="block-bean-research-matters-about" class="block block--bean box block--bean-research-matters-about">
<h3 class="block__title">About NIH Research Matters</h3>
<div class="content" class="block__content">
<div about="/block/research-matters---about" class="ds-1col entity entity-bean bean-research-matters-block view-mode-default clearfix">
<p><strong>Editor:</strong> Harrison Wein, Ph.D.</p>
<p><strong>Assistant Editors:</strong> Vicki Contie and Brian Doctrow, Ph.D.</p>
<p><strong><em>NIH Research Matters </em></strong>is a weekly update of NIH research highlights reviewed by NIHs experts. It's published by the <a href="/institutes-nih/nih-office-director/office-communications-public-liaison">Office of Communications and Public Liaison</a> in the <a href="/institutes-nih/nih-office-director">NIH Office of the Director</a>.</p>
<p>ISSN 2375-9593</p>
</div>
</div>
</div>
</aside>
</div>
<div class="l-connect-wrapper">
<div class="l-connect">
<h2 class="element-invisible">Connect with Us</h2>
<ul>
<li><a class="contactus-monochrome" href="/about-nih/contact-us"><span class="icon"></span>Contact Us</a></li>
<li><a class="twitter-monochrome" href="https://twitter.com/NIH"><span class="icon"></span>X</a></li>
<li><a class="facebook-monochrome" href="https://www.facebook.com/nih.gov"><span class="icon"></span>Facebook</a></li>
<li><a class="instagram-monochrome" href="https://www.instagram.com/nihgov/"><span class="icon"></span>Instagram</a></li>
<li><a class="youtube-monochrome" href="https://www.youtube.com/user/nihod"><span class="icon"></span>YouTube</a></li>
<li><a class="flickr-monochrome" href="https://www.flickr.com/photos/nihgov/"><span class="icon"></span>Flickr</a></li>
<li><a class="social-monochrome" href="/news-events/social-media-outreach"><span class="icon"></span>More Social Media from NIH</a></li>
</ul>
</div>
</div>
</div>
</div>
<div class="l-footer-wrapper">
<footer class="l-footer" role="contentinfo">
<h2 class="element-invisible">Footer</h2>
<ul>
<li><a href="/">NIH Home</a></li>
<li><a href="/virtual-tour">Virtual Tour</a></li>
<li><a href="https://salud.nih.gov">En Español</a></li>
<li><a href="/about-nih/visitor-information">Visitor Information</a></li>
<li><a href="/about-nih/frequently-asked-questions">Frequently Asked Questions</a></li>
<li><a href="/privacy-policy">Privacy Policy</a></li>
<li><a href="/disclaimers">Disclaimers</a></li>
<li><a href="/accessibility">Accessibility</a></li>
<li><a href="/nih-website-archives">NIH Website Archives</a></li>
</ul>
<ul>
<li><a href="/nondiscrimination-notice">Nondiscrimination Notice</a></li>
<li><a href="/institutes-nih/nih-office-director/office-communications-public-liaison/freedom-information-act-office">Freedom of Information Act</a></li>
<li><a href="https://www.edi.nih.gov/no-fear-act">No Fear Act</a></li>
<li><a href="https://www.hhs.gov/vulnerability-disclosure-policy/index.html">HHS Vulnerability Disclosure</a></li>
<li><a href="https://oig.hhs.gov">Office of Inspector General</a></li>
<li><a class="lastTab" href="https://www.usa.gov/">USA.gov</a></li>
</ul>
<p>NIH&hellip;Turning Discovery Into Health<sup>&reg;</sup></p>
<p>National Institutes of Health, 9000 Rockville Pike, Bethesda, Maryland 20892</p>
<p><a href="https://www.hhs.gov">U.S. Department of Health and Human Services</a></p>
</footer>
</div>
<div class="back-to-top"><a href="#"><span class="icon-arrow-up"></span><span class="text">Back to Top</span></a></div>
</div>
</div>
<script src="https://www.nih.gov/sites/default/files/js/js_7Ukqb3ierdBEL0eowfOKzTkNu-Le97OPm-UqTS5NENU.js"></script>
<script src="https://www.nih.gov/sites/default/files/js/js_E9yUYWK8EMydR0HMIp2PahVxPAClXyH0Cnh782A15UM.js"></script>
</body>
</html>