Imperial College London

DrPetarKormushev

Faculty of EngineeringDyson School of Design Engineering

Lecturer
 
 
 
//

Contact

 

+44 (0)20 7594 9235p.kormushev Website

 
 
//

Location

 

25 Exhibition Road, 3rd floor, Dyson BuildingDyson BuildingSouth Kensington Campus

//

Summary

 

Publications

Publication Type
Year
to

101 results found

Kormushev P, Dong F, Hirota K, 2009, Probability redistribution using time hopping for reinforcement learning

Conference paper

Kormushev P, 2009, Time Hopping Technique for Reinforcement Learning and its Application to Robot Control

Thesis dissertation

Kormushev P, Nomoto K, Dong F, Hirota Ket al., 2008, Time manipulation technique for speeding up reinforcement learning in simulations, Cybernetics and Information Technologies, Vol: 8, Pages: 12-24, ISSN: 1311-9702

A technique for speeding up reinforcement learning algorithms by usingtime manipulation is proposed. It is applicable to failure-avoidance controlproblems running in a computer simulation. Turning the time of the simulationbackwards on failure events is shown to speed up the learning by 260% andimprove the state space exploration by 12% on the cart-pole balancing task,compared to the conventional Q-learning and Actor-Critic algorithms.

Journal article

Yamazaki Y, Dong F, Masuda Y, Uehara Y, Kormushev P, Vu HA, Le PQ, Hirota Ket al., 2007, Fuzzy inference based mentality estimation for eye robot agent

Conference paper

Yamazaki Y, Dong F, Masuda Y, Uehara Y, Kormushev P, Vu HA, Le PQ, Hirota Ket al., 2007, Intent expression using eye robot for mascot robot system

Conference paper

Agre G, Kormushev P, Dilov I, 2006, INFRAWEBS Axiom Editor - A graphical ontology-driven tool for creating complex logical expressions, International Journal of Information Theories and Applications, Vol: 13, Pages: 169-178

Journal article

Kormushev P, 2006, Visual approach for data mining on medical information databases using Fastmap algorithm

Thesis dissertation

Agre G, Kormushev P, Dilov I, 2006, INFRAWEBS Axiom Editor User’s Guide, Institute of Information Technologies, Bulgarian Academy of Sciences

Other

Kormushev P, 2005, Design, development and implementation of a tool for construction of declarative functional descriptions of semantic web services based on WSMO methodology

Thesis dissertation

Agre G, Kormushev P, Dilov I, 2005, INFRAWEBS Capability Editor - A graphical ontology-driven tool for creating capabilities of Semantic Web Services, Pages: 228-228

Conference paper

Chappell D, Wang K, Kormushev P, Asynchronous Real-Time Optimization of Footstep Placement and Timing in Bipedal Walking Robots

Online footstep planning is essential for bipedal walking robots to be ableto walk in the presence of disturbances. Until recently this has been achievedby only optimizing the placement of the footstep, keeping the duration of thestep constant. In this paper we introduce a footstep planner capable ofoptimizing footstep placement and timing in real-time by asynchronouslycombining two optimizers, which we refer to as asynchronous real-timeoptimization (ARTO). The first optimizer which runs at approximately 25 Hz,utilizes a fourth-order Runge-Kutta (RK4) method to accurately approximate thedynamics of the linear inverted pendulum (LIP) model for bipedal walking, thenuses non-linear optimization to find optimal footsteps and duration at a lowerfrequency. The second optimizer that runs at approximately 250 Hz, usesanalytical gradients derived from the full dynamics of the LIP model andconstraint penalty terms to perform gradient descent, which finds approximatelyoptimal footstep placement and timing at a higher frequency. By combining thetwo optimizers asynchronously, ARTO has the benefits of fast reactions todisturbances from the gradient descent optimizer, accurate solutions that avoidlocal optima from the RK4 optimizer, and increases the probability that afeasible solution will be found from the two optimizers. Experimentally, weshow that ARTO is able to recover from considerably larger pushes and producesfeasible solutions to larger reference velocity changes than a standardfootstep location optimizer, and outperforms using just the RK4 optimizeralone.

Journal article

This data is extracted from the Web of Science and reproduced under a licence from Thomson Reuters. You may not copy or re-distribute this data in whole or in part without the written consent of the Science business of Thomson Reuters.

Request URL: http://wlsprd.imperial.ac.uk:80/respub/WEB-INF/jsp/search-html.jsp Request URI: /respub/WEB-INF/jsp/search-html.jsp Query String: id=00873100&limit=30&person=true&page=4&respub-action=search.html