{"id":416036,"date":"2017-12-12T09:21:37","date_gmt":"2017-12-12T13:21:37","guid":{"rendered":"https:\/\/spaceweekly.com\/?guid=3bdcdfe563c65e84d2db86a28d1fa259"},"modified":"2017-12-12T09:21:37","modified_gmt":"2017-12-12T13:21:37","slug":"distributing-control-of-deep-learning-training-delivers-10x-performance-improvement-2","status":"publish","type":"post","link":"https:\/\/spaceweekly.com\/?p=416036","title":{"rendered":"Distributing control of deep learning training delivers 10x performance improvement"},"content":{"rendered":"<p>My IBM Research AI team and I recently completed the first formal theoretical study of the convergence rate and communications complexity associated with a decentralized distributed approach in a deep learning training setting. The empirical evidence proves that in specific configurations, a decentralized approach can result in a 10x performance boost over a centralized approach without additional complexity. A paper describing our work has been accepted for oral presentation at the NIPS 2017 Conference, one of the 40 out of 3240 submissions selected for this.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>My IBM Research AI team and I recently completed the first formal theoretical study of the convergence rate and communications complexity associated with a decentralized distributed approach in a deep learning training setting. The empirical evidence p&#8230;<\/p>\n","protected":false},"author":0,"featured_media":615444,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[],"tags":[],"class_list":["post-416036","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry"],"_links":{"self":[{"href":"https:\/\/spaceweekly.com\/index.php?rest_route=\/wp\/v2\/posts\/416036","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/spaceweekly.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/spaceweekly.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/spaceweekly.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=416036"}],"version-history":[{"count":1,"href":"https:\/\/spaceweekly.com\/index.php?rest_route=\/wp\/v2\/posts\/416036\/revisions"}],"predecessor-version":[{"id":416037,"href":"https:\/\/spaceweekly.com\/index.php?rest_route=\/wp\/v2\/posts\/416036\/revisions\/416037"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/spaceweekly.com\/index.php?rest_route=\/wp\/v2\/media\/615444"}],"wp:attachment":[{"href":"https:\/\/spaceweekly.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=416036"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/spaceweekly.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=416036"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/spaceweekly.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=416036"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}