http://www-math.umd.edu/research/seminars.html http://www-math.umd.edu/research/seminars.html Fri, 01 Sep 2017 12:00:00 EDT Where: Kirwan Hall 1311
Speaker: Organizational Meeting () -

]]> http://www-math.umd.edu/research/seminars.html Fri, 08 Sep 2017 12:00:00 EDT Where: Kirwan Hall 1311
Speaker: Ilya Kavalerov (UMD) -
Abstract: In this talk, I give an overview of the concepts and applications of deep neural networks. As the title suggests, this talk is introductory and requires no prior knowledge of the subject. Everyone is invited to attend!
]]> http://www-math.umd.edu/research/seminars.html Fri, 15 Sep 2017 12:00:00 EDT Where: Kirwan Hall 3206
Speaker: Shujie Kang (UMD) -
Abstract: This is a continuation of last week's talk. I introduce convolutional neural networks.
]]> http://www-math.umd.edu/research/seminars.html Fri, 29 Sep 2017 12:00:00 EDT Where: Kirwan Hall 3206
Speaker: Shujie Kang (UMD) -
Abstract: I introduce commonly used algorithms to train a convolutional neural network.
]]> http://www-math.umd.edu/research/seminars.html Fri, 06 Oct 2017 12:00:00 EDT Where: Kirwan Hall 3206
Speaker: Eric Oden (UMD) -
Abstract: I build up on Shujie's talk by taking a closer look at the ADAM optimizer she mentioned towards the end of her talk.
]]> http://www-math.umd.edu/research/seminars.html Fri, 13 Oct 2017 12:00:00 EDT Where: Kirwan Hall 3206
Speaker: Cheng Jie (UMD) -
Abstract: I give an overview of the mathematical framework of Reinforcement learning: Markov Decision Process. I will introduce basic policy optimization algorithms used to train the reinforcement learning model. Specifically, the talk will explore Trust Region Policy Optimization, a recently developed algorithm, widely used in Training Deep Reinforcement Learning.
]]> http://www-math.umd.edu/research/seminars.html Fri, 20 Oct 2017 12:00:00 EDT Where: Kirwan Hall 3206
Speaker: Nathaniel Monsoon (UMD) -

]]> http://www-math.umd.edu/research/seminars.html Fri, 27 Oct 2017 12:00:00 EDT Where: Kirwan Hall 3206
Speaker: Andrew Lauziere (UMD) -
Abstract: I will present the paper Efficient BackProp by Yann LeCun et al.
]]> http://www-math.umd.edu/research/seminars.html Fri, 10 Nov 2017 12:00:00 EST Where: Kirwan Hall 3206
Speaker: Roozbeh Yousefzadeh (UMD (CS)) -
Abstract: I will present two recent papers on batch training of neural networks. The first paper (Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour) focuses on the size of mini-batches and the optimization difficulties that arise in distributed training. The second paper (Train longer, generalize better: closing the generalization gap in large batch training of neural networks) proposes an algorithm called "Ghost Batch Normalization".
]]> http://www-math.umd.edu/research/seminars.html Fri, 17 Nov 2017 12:00:00 EST Where: Kirwan Hall 3206
Speaker: Daniel Mourad (UMD) -

]]> http://www-math.umd.edu/research/seminars.html Fri, 01 Dec 2017 12:00:00 EST Where: Kirwan Hall 3206
Speaker: Tom Goldstein (UMD/CS) - https://www.cs.umd.edu/~tomg/
Abstract: We'll discuss two recent advanced in deep learning: adversarial neural networks, and quantized nets. Adversarial nets is a recent method for building generative models that requires the solution of complex saddle-point problems. We develop a simple prediction methods for stabilizing the training of saddle-point problems. Then, we'll discuss quantized networks, which use low-precision weights to compress and accelerate neural networks. We discuss the theory of quantized networks, and when/why they are trainable.
]]> http://www-math.umd.edu/research/seminars.html Fri, 08 Dec 2017 12:00:00 EST Where: Kirwan Hall 3206
Speaker: Wojtek Czaja (UMD (math)) -

]]> http://www-math.umd.edu/research/seminars.html Wed, 07 Feb 2018 10:00:00 EST Where: Kirwan Hall 3206
Speaker: Brandon Alexander (UMD) -

]]> http://www-math.umd.edu/research/seminars.html Thu, 22 Feb 2018 10:00:00 EST Where: Kirwan Hall 3206
Speaker: Liam Fowl (UMD) -

]]> http://www-math.umd.edu/research/seminars.html Thu, 01 Mar 2018 10:00:00 EST Where: Kirwan Hall 3206
Speaker: Zeyad Emam (UMD) -
Abstract: I will present the paper Training Neural Networks Without Gradients: A Scalable ADMM Approach by Prof Goldstein et al.
]]> http://www-math.umd.edu/research/seminars.html Thu, 08 Mar 2018 10:00:00 EST Where: Kirwan Hall 3206
Speaker: Addison Bohannon (UMD) -
Abstract: I will present the paper Spectral Networks and Locally Connected Networks on Graphs by Bruna et al.
]]> http://www-math.umd.edu/research/seminars.html Thu, 15 Mar 2018 10:00:00 EDT Where: Kirwan Hall 3206
Speaker: Matthew Guay (NIH/NIBIB) -
Abstract: I will present on the paper named in the title, which has the abstract:

We introduce a general-purpose conditioning method for neu-
ral networks called FiLM: Feature-wise Linear Modulation.
FiLM layers influence neural network computation via a sim-
ple, feature-wise affine transformation based on conditioning
information. We show that FiLM layers are highly effective
for visual reasoning — answering image-related questions
which require a multi-step, high-level process — a task which
has proven difficult for standard deep learning methods that
do not explicitly model reasoning. Specifically, we show on
visual reasoning tasks that FiLM layers 1) halve state-of-the-
art error for the CLEVR benchmark, 2) modulate features in
a coherent manner, 3) are robust to ablations and architectural
modifications, and 4) generalize well to challenging, new data
from few examples or even zero-shot.
]]> http://www-math.umd.edu/research/seminars.html Thu, 29 Mar 2018 10:00:00 EDT Where: Kirwan Hall 3206
Speaker: Ilya Kavarelov (UMD (ECE)) -

]]> http://www-math.umd.edu/research/seminars.html Thu, 05 Apr 2018 10:00:00 EDT Where: CHM 0115
Speaker: Cheng Tang (GWU) - https://sites.google.com/site/chengtanggwu/
Abstract: A recurring pattern in many areas of machine learning is the empirical success of a handful of "heuristics", i.e., any simple learning procedure favored by practitioners. Many of these heuristic techniques lack formal theoretical justification. For unsupervised learning, Lloyd's k-means algorithm, while provably exponentially slow in the worst-case, remains popular for clustering problems arising from different applications. For supervised learning, random forest is another example of a winning heuristic with many variants and applications. But the most prominent example is perhaps the blossoming field of deep learning, which is almost entirely composed of heuristics; the practical success of a deep learning algorithm usually relies on an experienced user skillfully and creatively combining heuristics. In this talk, I will discuss some of my thesis work in advancing the theoretical understanding of some of the most widely-used machine learning heuristics.


]]> http://www-math.umd.edu/research/seminars.html Thu, 12 Apr 2018 10:00:00 EDT Where: Kirwan Hall 3206
Speaker: Thomas Goldstein (UMD (UMIACS)) - https://www.cs.umd.edu/~tomg/
Abstract: This talk investigates the structure of neural network loss functions. Using a range of visualization methods, we explore the non-convex and convex structures present in loss functions, and how neural network architecture impacts these structures. I'll also discuss the implications this has on neural optimization, and present situations where bad actors can exploit neural loss functions to manipulate the behavior of classifiers.
]]> http://www-math.umd.edu/research/seminars.html Thu, 19 Apr 2018 10:00:00 EDT Where: Kirwan Hall 3206
Speaker: James Yorke (UMD ) - http://www.chaos.umd.edu/~yorke/

]]> http://www-math.umd.edu/research/seminars.html Thu, 03 May 2018 10:00:00 EDT Where: Kirwan Hall 3206
Speaker: Wojtek Czaja (UMD (MATH)) -
Abstract: I will present the paper Accelerated Gradient Descent Escapes Saddle Points Faster than Gradient Descent by Chi Jin, Praneeth Netrapalli, and Michael I. Jordan
]]>