Dutia, Dharini. "Multi-Robot Task Allocation and Scheduling with Spatio-Temporal and Energy Constraints." (2019). [PDF]
Heramb Nemlekar, Dharini Dutia, Zhi Li, “Object Transfer Point Estimation for Fluent Human-Robot Handovers”, In submission to In 2019 IEEE International Conference on Robotics and Automation (ICRA). [PDF]
Heramb Nemlekar, Dharini Dutia and Zhi Li, “Prompt Human to Robot Handovers by Estimation of Object Transfer Point based on Human Partner’s Motion”, IROS 2018 Workshop on Human-Robot Cooperation and Collaboration in Manipulation: Advancements and Challenges, Madrid, Spain, October 2018. [PDF]
Autonomy in multi-robot systems is bounded by coordination among its agents. Coordination implies simultaneous task decomposition, task allocation, team formation, task scheduling and routing; collectively termed as task planning. In many real-world applications of multi-robot systems such as commercial cleaning, delivery systems, warehousing and inventory management: spatial & temporal constraints, variable execution time, and energy limitations need to be integrated into the planning module. Spatial constraints comprise of the location of the tasks, their reachability, and the structure of the environment; temporal constraints express task completion deadlines. There has been significant research in multi-robot task allocation involving spatio-temporal constraints. However, limited attention has been paid to combine them with team formation and non-instantaneous task execution time. We achieve team formation by including quota constraints which ensure to schedule the number of robots required to perform the task. We introduce and integrate task activation (time) windows with the team effort of multiple robots in performing tasks for a given duration. Additionally, while visiting tasks in space, energy budget affects the robots operation time. We map energy depletion as a function of time to ensure long-term operation by periodically visiting recharging stations. Research on task planning approaches which combines all these conditions is still lacking.
In this thesis, we propose two variants of Team Orienteering Problem with task activation windows and limited energy budget to formulate the simultaneous task allocation and scheduling as an optimization problem. A complete mixed integer linear programming (MILP) formulation for both variants is presented in this work, implemented using Gurobi Optimizer and analyzed for scalability. This work compares the different objectives of the formulation like maximizing the number of tasks visited, minimizing the total distance travelled, and/or maximizing the reward, to suit various applications. Finally, analysis of optimal solutions discover trends in task selection based on the travel cost, task completion rewards, robot’s energy level, and the time left to task inactivation.
Handing over objects is the foundation of many human-robot interactions and collaboration tasks. In the scenario where a human is handing over an object to the robot, the human chooses where the object needs to be transferred. The robot needs to accurately predict this point of transfer to reach out proactively, instead of waiting for the final position to be presented. This work presents an efficient method for predicting the Object Transfer Point (OTP), which synthesizes (1) an offline OTP calculated based on human preferences observed in a human-robot motion study with (2) a dynamic OTP predicted based on the observed human motion. Our proposed OTP predictor is implemented on a humanoid nursing robot and experimentally validated in human-robot handover tasks. Compared to only using static or dynamic OTP estimators, it has better accuracy at the earlier phase of handover (less than 45\%) and can render fluent handovers with response time (about 3.1 secs) close to natural human receiver's response. In addition, the OTP prediction accuracy is maintained across the robot's visible workspace.
In an autonomous driving system, path planning is a critical component as it is responsible for complex maneuvers and safe operation. It provides the ability to adapt in different environments by accommodating both non-holonomic vehicle motion constraints and obstacle avoidance constraints, efficiently. However, current planning methods do not provide algorithmically complete solutions. This work devised and verified an alternative method for local motion planning of an autonomous vehicle using NURBS to generate a feasible trajectory in Python. Representing trajectories using NURBS curves is the best alternative as they are computationally stable, continuous, derivable and highly flexible.
A Non-Intrusive communication system with a JAVA based Graphical User Interface which uses eye blinks, detected by Image Processing algorithms in Python with OpenCV libraries installed on Raspberry Pi2, to control electrical appliances, sending an SMS and writing text using an onscreen keyboard. (Bachelor’s thesis)