My NIPS 2015 highlights
I attended NIPS (Neural Information Processing Systems) last week, one of the big annual machine intelligence conferences. About 3,700 attendees were sustained from 9am to midnight on a diet of maths, statistics, computing and neuroscience. Every day for a week. It was somewhat overwhelming.
here)… and here are my miscellaneous thoughts.
Favourite presented paper
Advances in Neural Information Processing Systems (NIPS), 2015.
This was fun. The video below shows the results of training a recurrent neural net to be able to automatically synthesise complex movements, such as swimming or flying. The applications are in robotics, biomechanics and graphics (automate animation in films or interactive games).
From http://www.eecs.berkeley.edu/~igor.mordatch/policy/video.mov
We were also treated to a video of a humanoid robot leaning and reaching, in a remarkably natural way, which I think is associated with this, more recent, paper:
Preprint, 2016
There was no sensor input of contact forces included yet, which is needed for locomotion, so that will be the focus of new work.
Favourite invited talk
Diagnosis and Therapy of Psychiatric Disorders Based on Brain Dynamics
A fascinating survey of experiments testing the premise that psychiatric diseases are disorders of brain dynamics, and may be treated with non-invasive techniques and machine learning to restore the brain back to a healthy state.
It seems incredible, but apparently it is possible to control/change cognitive functions without human conscious awareness and these changes are relatively long-lasting. Such techniques can be used to treat e.g. depression, PTSD and chronic pain.
With great power comes great responsibility…
Best session
This symposium was absolutely excellent. It explored General AI and the brain and how the two fields might (continue to) learn from one another.
There may be other ways to build intelligence. But the number of solutions may be vanishingly small compared to the size of search space. So it might be most efficient to reengineer the brain — something we know works.
Demis Hassabis, Google DeepMind
The symposium concluded with a panel session which debated what skills were required to enter / contribute to the space. The panel agreed that one must have a very solid maths and coding base to build on, must develop expertise, but that one also would need to encompass neuroscience, psychology and biology. And that this would all have to be learnt whilst young (meaning postgrad is too late), because it’s too hard to learn later. So there you have it. Broad, deep, and best accomplished young. Most dispiriting for this 36 year old!
Other
- I added about 20 new companies to a list I’m keeping of machine intelligence startups. That’s 20 that were not just new to me (I added about 50 overall), but new, new. Hardly a website between them, and no Crunchbase or similar profiles. Launched to coincide with NIPS.
- sponsors were financial companies, Uber targeted NIPS attendees hoping to get a taxi, and there was guerrilla recruitment via conference noticeboard.
- In a conference that was largely a hymn to the GPU (despite constraints of memory and cost), it was noteworthy when a result was presented that didn’t use one/several:
- Scanning the audience every day there was a sea of MacBooks, I’d guess 95%. I’ve no axe to grind, just thought it was quite interesting that the preference among attendees seemed so pronounced.
Overall
ImageNet Classification with Deep Convolutional Neural Networks” at the same conference.
Quantum Machine Learning workshop attracted such a big crowd. Is this where the next breakthrough is going to come from?
“Deep Learning is brute force learning, but it is not intelligent learning”
Vladimir Vapnik, Facebook