Use this URL to cite or link to this record in EThOS: https://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.790882
Title: Equivariance for deep learning and retinal imaging
Author: Worrall, Daniel Ernest
ISNI:       0000 0004 8499 8743
Awarding Body: UCL (University College London)
Current Institution: University College London (University of London)
Date of Award: 2019
Availability of Full Text:
Access from EThOS:
Full text unavailable from EThOS. Please try the link below.
Access from Institution:
Abstract:
Analysing and generalizing from small datasets is still a difficult challenge. However, the de facto model in computer vision, the convolutional neural network (CNN), is known to be data hungry and poorly interpretable. We investigate a new design principle called equivariance, which we demonstrate can both improve data efficiency and interpretability in CNNs. Intermediate layers of an equivariant CNN preserve information about local and global transformations of the input image. Moreover, we build specific equivariances into a CNN, such that they need not be learned from data. As a result, less data is needed, improving the network generalization. In this thesis, we explore three techniques to demonstrate the usefulness of equivariance. We start by considering equivariance to 3D right-angle rotations in the context of voxelized data. We show that this improves classification performance on the ModelNet10 dataset, among non-ensembled models. We then introduce Harmonic Networks, which are equivariant to continuous rotations in 2D. These exploit the fact that the Fourier transform naturally disentangles transformation and magnitude information. To the best of our knowledge, this is the first CNN architecture exhibiting equivariance to a continuous transformation. Lastly we consider learning equivariance from data, to model equivariances, which may not be tractably designed into a network. To validate our work, we harness a real-world case study by applying some of our developments to the difficult challenge of Retinopathy of Prematurity (ROP) detection. ROP is a sight-threatening disease, affecting 60% of premature babies below 32 weeks post-menstrual age and 1500g in weight. ROP is difficult to detect, its symptomatology is not fully understood, and doctors all over the world are increasingly burdened with screening, as the number of at-risk neonates sharply increases. To the best of our knowledge, we are the first to develop a deep learning solution to ROP detection.
Supervisor: Not available Sponsor: Not available
Qualification Name: Thesis (Ph.D.) Qualification Level: Doctoral
EThOS ID: uk.bl.ethos.790882  DOI: Not available
Share: