{"id":15972,"date":"2016-03-28T15:40:07","date_gmt":"2016-03-28T14:40:07","guid":{"rendered":"http:\/\/www.ch.imperial.ac.uk\/rzepa\/blog\/?p=15972"},"modified":"2016-04-05T08:44:52","modified_gmt":"2016-04-05T07:44:52","slug":"does-combining-molecules-with-augmented-reality-have-a-future","status":"publish","type":"post","link":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=15972","title":{"rendered":"Does combining molecules with augmented reality have a future?"},"content":{"rendered":"
\n

\n\tAugmented reality, a superset if you like of virtual reality (VR), has really been hitting the headlines<\/a> recently. Like 3D TV, its been a long time coming! Since ~1994 or earlier, there have been explorations of how molecular models can be transferred from actual reality to virtual reality using conventional computers (as opposed to highly specialised ones). It was around then that a combination of software (Rasmol) and hardware (Silicon Graphics, and then soon after standard personal computers with standard graphics cards) became capable of such manipulations. VRML (virtual reality modelling language) also proved something of a false start‡<\/sup> So have things changed?\n<\/p>\n

\n\tMany of the posts on this blog have some element of such VR in the form of the Jmol or JSmol software (the natural successor to Rasmol) that allows a 2D projection of a 3D model to be manipulated in "real-time", allowing the geometrical features to be inspected<\/a> and even animations of reactions. Google cardboard<\/a> is a (minor?) variation on the VR theme, allowing a 3D object to be viewed through a simple cardboard headset containing a mounted phone, but controlled by head movements acting on the accelerometers in the phone rather than a mouse or trackpad. But the full-blown experience is something else, and watching this TED video<\/a> really brought it home to me. The virtual object, such as say a molecule, is superimposed upon one's view of the real world (AR) and this object can now be controlled with hands as well as eyes. Again, this is not new; so-called haptic control of virtual objects has been around for a decade or more, in which you can e.g. probe how "hard" an object is using a haptic or hands-on device such as a joystick. All of this quickly convinces one that the secret of successful use of VR and now AR to augment chemistry is going to be the software!\n<\/p>\n

\n\tWe now need inspired programmers to create the Rasmol\/Jmol of augmented reality. But beyond mere software, chemistry with AR needs to be placed into the appropriate environment or context. One might presume this will include the stereoscopic video inputs from other AR headsets (the research team, the collaborators, etc) but what else? The pages of a blog? Or a journal article? Could indeed one recast the journal article itself into an AR scene, with the various components floating in space, with molecules conjured out of a table (or a synthetic procedure) to float in full 3D glory to be played with by the participants? I rather suspect this might be quite a few steps too many for most!  Think how little ~22 years of the Web (and perhaps ~36 years of the Internet itself) has actually changed the construction (I do not mean the delivery) of the average scientific article. Even now, tables in which molecules can be treated interactively are extremely rare<\/a>. Most of this is because authoring tools such as Microsoft Word have not yet made the production of such documents viable. So perhaps the augmented-reality scientific or chemical article may not be quite around the corner. Perhaps the AR hype will end in the same way that 3D TV appears to have. But unless we experiment, we will never know the answer. So if any reader of this blog knows of interesting work in chemistry AR<\/strong>,<\/span> do drop me a line.\n<\/p>\n

\n

\n\t‡<\/sup> Virtual Reality Modelling Language (VRML) in Chemistry, O. Casher, C. Leach, C. S. Page and H. S. Rzepa, Chem. in Brit.<\/cite>, 1998, 34<\/b>(9), 26. But VRML has made a come-back as the language of choice for 3D printing!\n<\/p>\n

\n\t \n<\/div>\n\n<\/div> ","protected":false},"excerpt":{"rendered":"

Augmented reality, a superset if you like of virtual reality (VR), has really been hitting the headlines recently. Like 3D TV, its been a long time coming! Since ~1994 or earlier, there have been explorations of how molecular models can be transferred from actual reality to virtual reality using conventional computers (as opposed to highly specialised ones). It […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"activitypub_content_warning":"","activitypub_content_visibility":"","activitypub_max_image_attachments":5,"activitypub_interaction_policy_quote":"anyone","activitypub_status":"","footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[2,1],"tags":[1719,1722,1724,1725,1723,1721,6,1718,1717,1280,1720],"ppma_author":[2661],"class_list":["post-15972","post","type-post","status-publish","format-standard","hentry","category-chemical-it","category-general","tag-augmented-reality","tag-chemical-article","tag-company-microsoft","tag-company-silicon-graph","tag-for3d-printing","tag-google-cardboard","tag-jmol","tag-rasmol","tag-user-interface-techniques","tag-virtual-reality","tag-vrml"],"yoast_head":"\nDoes combining molecules with augmented reality have a future? - Henry Rzepa's Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=15972\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Does combining molecules with augmented reality have a future? - Henry Rzepa's Blog\" \/>\n<meta property=\"og:description\" content=\"Augmented reality, a superset if you like of virtual reality (VR), has really been hitting the headlines recently. Like 3D TV, its been a long time coming! Since ~1994 or earlier, there have been explorations of how molecular models can be transferred from actual reality to virtual reality using conventional computers (as opposed to highly specialised ones). It […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=15972\" \/>\n<meta property=\"og:site_name\" content=\"Henry Rzepa's Blog\" \/>\n<meta property=\"article:published_time\" content=\"2016-03-28T14:40:07+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2016-04-05T07:44:52+00:00\" \/>\n<meta name=\"author\" content=\"Henry Rzepa\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Henry Rzepa\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Does combining molecules with augmented reality have a future? - Henry Rzepa's Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=15972","og_locale":"en_GB","og_type":"article","og_title":"Does combining molecules with augmented reality have a future? - Henry Rzepa's Blog","og_description":"Augmented reality, a superset if you like of virtual reality (VR), has really been hitting the headlines recently. Like 3D TV, its been a long time coming! Since ~1994 or earlier, there have been explorations of how molecular models can be transferred from actual reality to virtual reality using conventional computers (as opposed to highly specialised ones). It […]","og_url":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=15972","og_site_name":"Henry Rzepa's Blog","article_published_time":"2016-03-28T14:40:07+00:00","article_modified_time":"2016-04-05T07:44:52+00:00","author":"Henry Rzepa","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Henry Rzepa","Estimated reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=15972#article","isPartOf":{"@id":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=15972"},"author":{"name":"Henry Rzepa","@id":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/#\/schema\/person\/2b40f7b9c872a4dc1547e040a11b6281"},"headline":"Does combining molecules with augmented reality have a future?","datePublished":"2016-03-28T14:40:07+00:00","dateModified":"2016-04-05T07:44:52+00:00","mainEntityOfPage":{"@id":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=15972"},"wordCount":634,"commentCount":0,"keywords":["Augmented reality","chemical article","Company: Microsoft","Company: Silicon Graph","for 3D printing","Google Cardboard","jmol","RasMol","User interface techniques","Virtual reality","VRML"],"articleSection":["Chemical IT","General"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=15972#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=15972","url":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=15972","name":"Does combining molecules with augmented reality have a future? - Henry Rzepa's Blog","isPartOf":{"@id":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/#website"},"datePublished":"2016-03-28T14:40:07+00:00","dateModified":"2016-04-05T07:44:52+00:00","author":{"@id":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/#\/schema\/person\/2b40f7b9c872a4dc1547e040a11b6281"},"breadcrumb":{"@id":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=15972#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=15972"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=15972#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog"},{"@type":"ListItem","position":2,"name":"Does combining molecules with augmented reality have a future?"}]},{"@type":"WebSite","@id":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/#website","url":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/","name":"Henry Rzepa's Blog","description":"Chemistry with a twist","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Person","@id":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/#\/schema\/person\/2b40f7b9c872a4dc1547e040a11b6281","name":"Henry Rzepa","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/secure.gravatar.com\/avatar\/897b6740f7f599bca7942cdf7d7914af5988937ae0e3869ab09aebb87f26a731?s=96&d=blank&r=g370be3a7397865e4fd161aefeb0a5a85","url":"https:\/\/secure.gravatar.com\/avatar\/897b6740f7f599bca7942cdf7d7914af5988937ae0e3869ab09aebb87f26a731?s=96&d=blank&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/897b6740f7f599bca7942cdf7d7914af5988937ae0e3869ab09aebb87f26a731?s=96&d=blank&r=g","caption":"Henry Rzepa"},"description":"Henry Rzepa is Emeritus Professor of Computational Chemistry at Imperial College London.","sameAs":["https:\/\/orcid.org\/0000-0002-8635-8390"],"url":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?author=1"}]}},"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/pDef7-49C","jetpack-related-posts":[{"id":13019,"url":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=13019","url_meta":{"origin":15972,"position":0},"title":"Blasts from the past. A personal Web presence: 1993-1996.","author":"Henry Rzepa","date":"November 1, 2014","format":false,"excerpt":"Egon Willighagen recently gave a presentation at the RSC entitled \"The Web - what is the issue\" where he laments how little uptake of web technologies as a \"channel\u00a0for communication of scientific knowledge and data\"\u00a0there is in chemistry after twenty years or more. It caused me to ponder what we\u2026","rel":"","context":"In "Chemical IT"","block_context":{"text":"Chemical IT","link":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?cat=2"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":26767,"url":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=26767","url_meta":{"origin":15972,"position":1},"title":"3D Molecular model visualisation: 3 Million atoms +","author":"Henry Rzepa","date":"January 27, 2024","format":false,"excerpt":"In the late 1980s, as I recollected here the equipment needed for real time molecular visualisation as it became known as was still expensive, requiring custom systems such as Evans and Sutherland PS390 workstations. One major breakthrough in making such techniques generally available on less specialised equipment was achieved by\u2026","rel":"","context":"With 1 comment","block_context":{"text":"With 1 comment","link":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=26767#comments"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.ch.ic.ac.uk\/rzepa\/blog\/wp-content\/uploads\/2024\/01\/8glv-150x150.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.ch.ic.ac.uk\/rzepa\/blog\/wp-content\/uploads\/2024\/01\/8glv-150x150.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/www.ch.ic.ac.uk\/rzepa\/blog\/wp-content\/uploads\/2024\/01\/8glv-150x150.jpg?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/www.ch.ic.ac.uk\/rzepa\/blog\/wp-content\/uploads\/2024\/01\/8glv-150x150.jpg?resize=700%2C400&ssl=1 2x"},"classes":[]},{"id":16710,"url":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=16710","url_meta":{"origin":15972,"position":2},"title":"Journal innovations – the next step is augmented reality?","author":"Henry Rzepa","date":"August 17, 2016","format":false,"excerpt":"In the previous post, I noted that a chemistry publisher is about to repeat an earlier experiment in serving pre-prints of journal articles. It would be fair to suggest that following the first great period of journal innovation, the boom in rapid publication \"camera-ready\" articles in the 1960s, the next\u2026","rel":"","context":"In "General"","block_context":{"text":"General","link":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?cat=1"},"img":{"alt_text":"AR-markers","src":"https:\/\/i0.wp.com\/www.ch.ic.ac.uk\/rzepa\/blog\/wp-content\/uploads\/2016\/08\/AR-markers-1024x685.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":12958,"url":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=12958","url_meta":{"origin":15972,"position":3},"title":"Electronic notebooks: a peek into the future?","author":"Henry Rzepa","date":"September 16, 2014","format":false,"excerpt":"ELNs (electronic laboratory notebooks) have been around for a long time in chemistry, largely of course due to the needs of the pharmaceutical industries. We did our first extensive evaluation probably at least 15 years ago, and nowadays there are many on the commercial market, with a few more coming\u2026","rel":"","context":"In "Chemical IT"","block_context":{"text":"Chemical IT","link":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?cat=2"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":17939,"url":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=17939","url_meta":{"origin":15972,"position":4},"title":"MOLinsight: A web portal for the processing of molecular structures by blind students.","author":"Henry Rzepa","date":"March 31, 2017","format":false,"excerpt":"Occasionally one comes across a web site that manages to combine being\u00a0unusual, interesting and also useful. Thus\u00a0www.molinsight.net\u00a0is I think a unique chemistry resource for blind and visually impaired students. If you think perhaps that it might be a little too specialised to be useful for you, go visit it first.\u2026","rel":"","context":"In "Interesting chemistry"","block_context":{"text":"Interesting chemistry","link":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?cat=4"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":11022,"url":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?p=11022","url_meta":{"origin":15972,"position":5},"title":"Full-colour 3D printing of molecular models and orbitals (wavefunctions).","author":"Henry Rzepa","date":"August 18, 2013","format":false,"excerpt":"We have been experimenting with full-colour 3D printing of molecular objects. I thought I might here share some of our observations. Firstly, I list the software used: Crystal structures as sources of ball&stick models (e.g. the CCDC database).Gaussian style cube files for sources of wavefunctions.There are plenty of other sources\u2026","rel":"","context":"In "Interesting chemistry"","block_context":{"text":"Interesting chemistry","link":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/?cat=4"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"jetpack_likes_enabled":false,"authors":[{"term_id":2661,"user_id":1,"is_guest":0,"slug":"admin","display_name":"Henry Rzepa","avatar_url":"https:\/\/secure.gravatar.com\/avatar\/897b6740f7f599bca7942cdf7d7914af5988937ae0e3869ab09aebb87f26a731?s=96&d=blank&r=g","0":null,"1":"","2":"","3":"","4":"","5":"","6":"","7":"","8":""}],"_links":{"self":[{"href":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/index.php?rest_route=\/wp\/v2\/posts\/15972","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=15972"}],"version-history":[{"count":16,"href":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/index.php?rest_route=\/wp\/v2\/posts\/15972\/revisions"}],"predecessor-version":[{"id":15988,"href":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/index.php?rest_route=\/wp\/v2\/posts\/15972\/revisions\/15988"}],"wp:attachment":[{"href":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=15972"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=15972"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=15972"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.ch.ic.ac.uk\/rzepa\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fppma_author&post=15972"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}