image

Hi!

I’m a researcher at OpenAI, generally interested in training really large neural networks. I completed my PhD in physics at Princeton, studying brain-inspired learning algorithms.

email: k3luther@gmail.com


Research

image Sensitivity of sparse codes to image distortions
Kyle Luther, H. Sebastian Seung
Neural Computation, 2022

We identify and explain the following behavior: the representations generated by popular sparse coding amplify input pixel distortions.


image Kernel similarity matching with Hebbian neural networks
Kyle Luther, H. Sebastian Seung
Neurips, 2022

We derive a network with online Hebbian learning rules capable of performing kernel similarity matching.


image Learning and segmenting dense voxel embeddings for 3D neuron reconstruction
Kisuk Lee, Ran Lu, Kyle Luther, H. Sebastian Seung
IEEE Transactions on Medical Imaging, 2021

We use convolutional networks to assign an embedding vector to every voxel (3D pixel). These embedding vectors which are then used to segment 3D volumetric microscopy images.


image Reexamining the principle of mean-variance preservation for neural network initialization
Kyle Luther, H. Sebastian Seung
Physical Review Research, 2020

We prove that in a wide ReLU network the variance of individual neurons decays to zero with depth, even when networks are initialized with the popular Kaiming initialization.


image Unsupervised learning by a softened correlation game: duality and convergence
Kyle Luther, Runzhe Yang, H. Sebastian Seung
The Fifty-Third Asilomar Conference on Signals, Systems & Computers, 2019

We analyze convergence and duality guarantees in a recently proposed model of cortical learning which pits excitatory and inhibitory neurons against each other in a two player zero-sum game.


image Learning metric graphs for neuron segmentation in electron microscopy images
Kyle Luther, H. Sebastian Seung
IEEE 16th International Symposium on Biomedical Imaging, 2019

We use convolutional networks to assign an embedding vector to every pixel in 2D micrscopy images of brain tissue. These embedding vectors are then used to segment every neuron.

image Serial section electron tomography at scale
Unpublished research

Large scale serial section microscopy currently faces two major challenges. One, the sections are too thin: at 40nm thick, the sections tend to crack, fold and generally fall apart. Two: the sections are too thick: neurites are occasionally smaller than 40nm and higher resolution is needed to trace them through adjacent sections. Can we solve both problems with serial section tomography to allow physically thicker but virtually thinner sections?
Built with Jekyll