english only
EPFL > STI > IMT > LASA > Teaching > Student Projects
LASA MENU
Home
Research
Publications
Teaching
People
Arriving to LASA
Videos / Photos
Press & News

GitHub Repository
Older Source Codes
The Blog
Intranet

Prospective Students
TEACHING INDEX
Teaching
Student Projects
Former Projects
Robot Contests

Student Projects propositions for 2014 Autumn

If you are interested in one of the below projects, Semester Projects or Master Projects, please contact the first person of reference indicated in each description either by telephone, or by email, or by visiting us directly to the LASA offices. If you are looking for a project for 2015 Spring, please click here.


Semester Projects

   
   

Learning robot optimal trajectories online using Inverse Reinforcement Learning

Inverse Reinforcement Learning (IRL) is a field of learning the desired objectives, values or rewards by observing the behavior of a system. In this particular scenario, the goal is to learn on-line the optimal motion parameters of a robot arm, in order to achieve a successful obstacle avoidance.

In this project, the user directs the robot motion with a joystick, while the brain activity is monitored. It is shown that an erroneous or unexpected behavior during a task could result in the expression of error-related potentials (ErrP) in the brain activity. The aim of this project is the use of ErrPs and/or the feedback from the joystick for predicting on-line the optimal robot trajectories for obstacle avoidance.

The student will study the problem of online prediction of whether a trajectory generated by a given set of parameters will be acceptable to the user, aiming to find a robust classifier that achieves this and converges quickly with a small number of samples. S/he will implement a real-time IRL approach to a Kuka LWR robot arm and gain in-hand experience in machine learning and robotic control

Project: Semester Project
Period: 11.07.2018 - 31.10.2018
Section(s): EL MA ME MT MX
Type: 30% theory, 10% software, 50% implementation
Knowledge(s): Machine learning, Robotics, C++/Python
Subject(s): Robot teleoperation, Inverse Reinforcement Learning
Responsible(s): Iason Batzianoulis
 
   
   
   

Robot teleoperation- Combining muscular activity with gaze

An important part of neuroprosthetic control is to decode user’s motion intention. This intention is then converted into appropriate movements for the prosthetic or assistive devices. When controlling prosthetic hand-arm systems, one can use eye movements as a natural way to determine the object the user intends to grasp. Eye movements give only the direction in which the object of interest may be located but not the exact location.

In this project we will examine potentials improvements in localization of the object by fusing gaze detection with monitoring of muscular activity (EMG) of the arm. An estimation of the target position in 2D space would come from the gaze, while EMG could be used to train two machine learning algorithms for regressions to predict the hand position in the x- and y-directions. A combination of these two systems is not trivial due to noise introduced by random eye movements, head motion and the non-stationary nature of the EMG signals.

The student will gain experience in state-of-art computer vision methods as well as machine learning regression methods applied on noisy biomedical signals. The goal of the project is a teleoperation system using machine learning methods, where a user would control remotely a robotic arm and hand.

Project: Semester Project
Period: 11.07.2018 - 31.10.2018
Section(s): EL MA ME MT MX
Type: 40% theory, 10% software, 50% implementation
Knowledge(s): Machine learning, Robotics, C++/Python
Subject(s): Rehabilitation robotics, Multisensory robotic system
Responsible(s): Iason Batzianoulis
   

Master Projects

   
   

Robot teleoperation- Combining muscular activity with gaze

An important part of neuroprosthetic control is to decode user’s motion intention. This intention is then converted into appropriate movements for the prosthetic or assistive devices. When controlling prosthetic hand-arm systems, one can use eye movements as a natural way to determine the object the user intends to grasp. Eye movements give only the direction in which the object of interest may be located but not the exact location.

In this project we will examine potentials improvements in localization of the object by fusing gaze detection with monitoring of muscular activity (EMG) of the arm. An estimation of the target position in 2D space would come from the gaze, while EMG could be used to train two machine learning algorithms for regressions to predict the hand position in the x- and y-directions. A combination of these two systems is not trivial due to noise introduced by random eye movements, head motion and the non-stationary nature of the EMG signals.

The student will gain experience in state-of-art computer vision methods as well as machine learning regression methods applied on noisy biomedical signals. The goal of the project is a teleoperation system using machine learning methods, where a user would control remotely a robotic arm and hand.

Project: Master Project at EPFL
Period: 15.07.2018 - 31.10.2018
Section(s): CH EL GC ME MT MX
Type: 50% theory, 50% implementation
Knowledge(s): Machine learning, Matlab, Robotics, C++/Python
Subject(s): Rehabilitation robotics, Multisensory robotic system
Responsible(s): Iason Batzianoulis, Aude Billard
   
   
   

Learning robot optimal trajectories online using Inverse Reinforcement Learning

Inverse Reinforcement Learning (IRL) is a field of learning the desired objectives, values or rewards by observing the behavior of a system. In this particular scenario, the goal is to learn on-line the optimal motion parameters of a robot arm, in order to achieve a successful obstacle avoidance.

In this project, the user directs the robot motion with a joystick, while the brain activity is monitored. It is shown that an erroneous or unexpected behavior during a task could result in the expression of error-related potentials (ErrP) in the brain activity. The aim of this project is the use of ErrPs and/or the feedback from the joystick for predicting on-line the optimal robot trajectories for obstacle avoidance.

The student will study the problem of online prediction of whether a trajectory generated by a given set of parameters will be acceptable to the user, aiming to find a robust classifier that achieves this and converges quickly with a small number of samples. S/he will implement a real-time IRL approach to a Kuka LWR robot arm and gain in-hand experience in machine learning and robotic control.

Project: Master Project at EPFL
Period: 15.07.2018 - 31.10.2018
Section(s): EL MA ME MT MX
Type: 50% theory, 50% implementation
Knowledge(s): Machine learning, Robotics, C++/Python
Subject(s): Robot teleoperation, Inverse Reinforcement Learning
Responsible(s): Iason Batzianoulis, Aude Billard
   
   
   

Sparse Solutions for Large-Scale Regression Problems

The curse of dimensionality is one of the main challenges in 'Big Data' problems. Unless the learning algorithm has an explicitly imposed sparsity constraint, model complexity will undoubtedly increase with respect to the number of samples. Typical sparse solutions for regression focus on problems where the number of samples "M" is less than the input "P", i.e. "M P", specifically, datasets with > 100,000 samples and where a sparse solution is needed for efficient prediction. Two kernel-based methods exist that are formulated to tackle such problems: 1) Relevance Vector Machines, a Bayesian formulation of Support Vector Machines that applies the Bayesian ‘Automatic Relevance Determination’ (ARD) methodology to linear kernel models. 2) Sparse Gaussian Process with Pseudo-Inputs, whose covariance is parameterized by the locations of "M" pseudo-input points, which we learn by a gradient based optimization (analogous to 'relevant vectors'). Nevertheless, both of these algorithms do not scale to data >100k training samples due to their optimization during training. Based on the literature of 1) and 2), the student should extend one of these algorithms to be capable of handling larger datasets, either by a) reformulating the optimization problem, such that it becomes feasible or b) tackle it with a divide-and-conquer approach and partition the large dataset into smaller sub-sets where 1) or 2) can be learned and merging/appropriate aggregation schemes must be introduced. The proposed approach will then be validated on interesting real-world dataset with M > 100k. The solution shall be implemented in Matlab/Python/C++ (the students choice).

[1] Michael Tipping. Relevance vector machine, October 14 2003. US Patent 6,633,857
[2] E. Snelson and Z. Ghahramani , "Sparse Gaussian Processes using Pseudo-inputs", NIPS 2006.

Project: Master Project at EPFL
Period: 01.09.2017 - 01.09.2018
Section(s): EL IN MA ME MT MX PH
Type: 80% Theory, 20% Software
Knowledge(s): Background in Machine Learning, Linear Algebra and Convex Optimization is required.
Subject(s): Machine Learning, Optimization
Responsible(s): Nadia Figueroa
   
   
   

Towards Incremental Learning: Merging SVMs from independent sample sets

With the increase in data available online and ever-changing applications, incremental and online machine learning algorithms that can adapt, learn and un-learn will become essential in the near future. Support Vector Machines (SVM) are undoubtedly one of the most powerful machine learning algorithms to date, however, due to the nature of the posed optimization problem (batch learning), they fall short when applied to incremental/adaptive problems. In this work, we are interested in finding a suitable solution for the problem of "incomplete datasets" or "complementary datasets" for a classification problem. Assume we are given a dataset at a specific point in time and we must learn a model to start predicting immediately. Then, we are suddenly given a new set of samples which belong to the same dataset. The question now is: What do we do with this new data? Do we re-learn the entire model with all the data-points? What if the samples are contradictory? Can we learn a new decision function from the new samples and merge them to the old model, without hindering performance on classification? Can we incrementally update the old model with our new samples? What if we suddenly realize that some samples were labeled erroneously and we would like to 'un-learn' them? These are the [sub-set of] questions that the student should try to answer. Seldom work in SVM literature is capable of handling these issues. The few works that can, are categorized into 1) "active/online methods" where training points are fed one-by-one and the SVM is learned sequentially [1] and 2) "ensemble methods" where a dataset is 'partitioned' into N-sets where N-SVMs are learned and basic aggregation schemes are applied to generate a final machine [2]. These approaches, however, are mostly suitable for handling large datasets and focus primarily on improving training time (i.e. efficient learning). By leveraging ideas from 1), 2) and online convex optimization [3], the student must propose an efficient and adaptable SVM learning scheme capable of solving all [or a sub-set] of the issues imposed by the proposed incremental learning problem. The solution shall be implemented in Matlab/Python/C++ (the students choice).

[1] Antoine Bordes, Seyda Ertekin, Jason Weston and Léon Bottou: Fast Kernel Classifiers with Online and Active Learning, Journal of Machine Learning Research, 6:1579-1619, September 2005.
[2] M. Claesen, F. De Smet, J. Suykens, and B. De Moor, "EnsembleSVM: A library for ensemble learning using support vector machines", Journal of Machine Learning Research, vol. 15, pp. 141–145, 2014.
[3] Introduction to Online Convex Optimization. Graduate text in machine learning and optimization. Elad Hazan. http://ocobook.cs.princeton.edu/

Project: Master Project at EPFL
Period: 01.09.2017 - 01.09.2018
Section(s): EL IN MA ME MT MX PH
Type: 80% Theory, 20% Software
Knowledge(s): Background in Machine Learning, Linear Algebra and Convex Optimization is required.
Subject(s): Machine Learning, Optimization
Responsible(s): Nadia Figueroa
   



Last update: 09/28/2014