Sign In
 
 
 
New ItemNew Item

Full name

Claudio Gallicchio 

Title

Reservoir Models for Structured Data 

Start Time

15:15 

Location

Gerace 

Abstract

Many real world problems involve organization of data in a structured form, such as sequences, trees or graphs. Traditional neural networks are suitable for dealing with unstructured data of a fixed size.Recurrent neural networks (RNNs) and recursive neural networks (RecNNs) have been proposed to extend the applicability of neural network models to structured domains. In particular this seminar is focused on Echo State Networks (ESNs) and, more in general, with Reservoir Computing (RC), a new paradigm for designing RNNs in a very efficient way. We show how contractivity of the state transition function is a key feature of ESNs and how this relates to the Markovian bias of RNN models. We propose four main architectural features that might have a positive influence on ESNs, namely input variability, multiple time scale dynamics, interconections among neurons and regressing a high dimensional feature space. Our investigation is conducted through a study of the predictive performance on several benchmark problems and a PCA analysis of the reservoir state space.
A particularly interesting variant, the phi-ESN which resulted from our study, is presented. The future work will mainly consist in extending our considerations and investigations to trees and graphs domains.

Keywords

reservoir computing, echo state networks, neural networks for structured domains 

Supervisor(s)

Alessio Micheli 

Notes

 

Session

Attachments
phdgallicchio09.pdf    
Created at 8/14/2009 6:52 PM  by  
Last modified at 9/7/2009 5:22 PM  by Cristian Dittamo