《icml2016-YoshuaBengio-tutorial_Representation learning-refs》.pdf

Representation Learning Yoshua Bengio Department of computer science and operations research, U. Montreal June 26th, 2012 ICML’2012 Tutorial , References Bengio, S., Weston, J., and Grangier, D. (2010). Label embedding trees for large multi-class tasks. In NIPS’2010 . Bengio, Y. (2009). Learning deep architectures for AI. Foundations and Trends in Machine Learning, 2(1), 1–127. Also published as a book. Now Publishers, 2009. Bengio, Y. (2012). Practical recommendations for gradient-based training of deep architectures. Technical report, arXiv:1206.5533. Bengio, Y. and Delalleau, O. (2011). On the expressive power of deep archi- tectures. In Proceedings of the 22nd International Conference on Algorithmic ´ Learning Theory. Eds. Jyrki Kivinen, Csaba Szepesvari, Esko Ukkonen, and Thomas Zeugmann. Bengio, Y., Simard, P., and Frasconi, P. (1994). Learning long-term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks, 5(2), 157–166. Bengio, Y., Delalleau, O., and Le Roux, N. (2006). The curse of highly variable ¨ functions for local kernel machines. In Y. Weiss, B. Scholkopf, and J. Platt, ed- itors, Advances in Neural Information Processing Systems 18 (NIPS’05) , pages 107–114. MIT Press, Cambridge, MA. 1 Bengio, Y., Lamblin, P., Popovici, D., and Larochelle, H. (2007). Greedy layer- ¨ wise training of deep networks. In B. Scholkopf, J. Platt, and T. Hoffman, edi- tors, Advances in Neural Information Processing Systems 19 (NIPS’06) , pages 153–160. MIT Press. Bengio, Y.,