打造自己的深度學習計算環境

本文告訴您如何在有限預算內,從硬體採購、組裝、作業系統選擇、軟體安裝與設定,自行打造與NVIDIA DIGITS DEVBOX相當的深度學習計算環境。

Read More

Simple example codes for parallelizing neural network

Abstract

If you are doing deep learning, one of the most challenging tasks in recent years is to make it run faster. A very common choice is to compute gradient descent in parallel on the distributed systems using either data parallelism or model parallelism. This article is meant to demonstrate ways to implement basic parallelism concepts from scratch using a simple model. It will also show how these parallelism techniques really improve the performance of training a neural network. If you are looking for more materials about the parallelism techniques, I recommend two easy-to-understand articles written by Tim Dettmers [1][2].

Read More

深度學習(Deep Learning)自學素材推薦

網路上關於深度學習的資料實在太多了,這裡列出的只是我個人讀過覺得相當不錯的資源,看不夠的話請右轉 Google 搜尋「Deep Learning」,絕對能滿足絕大部分的需求。如果有好的文章卻被漏掉了,也非常歡迎留言推薦,一定儘快補上。

Read More