Optimisation methods for (deep) neural networks

A machine learning algorithm can be viewed as a mapping between inputs and outputs, with the scope of optimising and tuning the parameters that describe it so that the performance is improved. The loss function (or cost function) that results and has to be optimised is non-convex in the case of artificial neural networks (which includes deep learning as well) and has multiple minima. Finding the global minimum of such a function is not a simple task as it is an NP-complete problem. The project will investigate existing optimisation methods as well as development of new ones for finding the local minima, the saddle points (of index one) and the global minima of the loss function characterising non-trivial deep neural networks. The focus will be on pupulation-based methods such as variants of genetic algorithms, differential evolution, etc.

How to apply

If you are interested in applying for the above PhD topic please follow the steps below:

Contact the supervisor by email or phone to discuss your interest and find out if you would be suitable. Supervisor details can be found on this topic page. The supervisor will guide you in developing the topic-specific research proposal, which will form part of your application.
Click on the 'Apply here' button on this page and you will be taken to the relevant PhD course page, where you can apply using an online application.
Complete the online application indicating your selected supervisor and include the research proposal for the topic you have selected.

Good luck!

This is a self funded topic

Brunel offers a number of funding options to research students that help cover the cost of their tuition fees, contribute to living expenses or both. See more information here: https://www.brunel.ac.uk/research/Research-degrees/Research-degree-funding. The UK Government is also offering Doctoral Student Loans for eligible students, and there is some funding available through the Research Councils. Many of our international students benefit from funding provided by their governments or employers. Brunel alumni enjoy tuition fee discounts of 15%.