Hacker Newsnew | past | comments | ask | show | jobs | submit | iamtrask's commentslogin

many people seem to discount this thread because "Karpathy is one of the most successful PhD students in his field"

perhaps instead of discounting his experience... it would be better to take his advice


Per your last comment, I'm thinking about changing this blog series to be a "blog" version of academic papers... starting with this one.

https://iamtrask.github.io/2016/02/25/deepminds-neural-stack...


I love your blog, keep up the good work.


Thank you!


I think that's a great idea. At this point in time, there is so much stuff going on the CS/AI/ML domain that translating research papers into something people can read without incalculable suffering might be as important and valuable as research itself. After all, many of those papers concern things that almost anyone with access to a computer can actually implement and use.

PS: Bonus points for anything that diverges from the current mainstream (like SVMs or boosting).


This paper is extraordinary! How has it been 9 hours with only one point?


pure democracy via capitalism... interesting. Are the masses smarter than the 1% is generous?


Precisely! I highly encourage checking out the slide-deck for a graphical representation.

For every node in every other layer, I colocate the edge on the same machine. In this way, when a group of, say, 10 nodes in layer 1 are each sending a weighted message to a single node in layer 2... they can pre-combine their messages (weighted sum) and send only that value over the network. This happens for every node in the second layer, reducing network i/o (this is the first optimization).


This also might help... here are some slides graphically showing how the distribution works. http://prezi.com/hdctecihctdr/?utm_campaign=share&utm_medium...


i apologize for the verbosity and thickness. Happy to answer questions though. :)


benchmarks like that coming soon :)


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: