Description of the workshop
This workshop provides a comprehensive, hands-on experience in designing deep
reinforcement learning (RL)–based control strategies for robot locomotion using
MATLAB® and Simulink®. Participants begin by creating a Deep Deterministic Policy Gradient (DDPG) RL agent, including the design of actor and critic deep neural networks, configuration of network hyperparameters, and specification of agent-level options. Next, participants construct the RL environment by defining observations, actions, and reward signals that govern the agent–environment interaction. The agent is then trained using customizable training options, and its performance is evaluated through closed-loop simulations within the environment. In the final step, participants compare the performance of the trained DDPG agent with that of a Twin Delayed Deep Deterministic Policy Gradient (TD3) agent in achieving the robot locomotion control objective.
Profile of the Instructor(s)

Ms. Sragdhara is an online content developer at MathWorks focused on developing Simulink-based learning content. She holds a PhD degree in Control Systems. Her research areas include robust control, multirate control, cooperative control of multi-agent systems, decentralized control, and control of cyber-physical systems. She has published papers in international journals and conferences in the domain of her research. She is also an AI enthusiast and is currently exploring the applications of machine learning and deep learning in the areas of signal and image processing, and developing course content.

Ms. Shanthi is an experienced educator and online content developer at MathWorks, specializing in MATLAB for advanced signal processing and AI applications. With a master’s degree in Signal Processing, she brings deep technical expertise in Digital Signal Processing (DSP), Image Processing, Adaptive Filtering, Wireless Communication Systems, and the application of Neural Networks to signal and image data. Her scholarly contributions include publications in international journals on topics such as Video Compression Standards and their implementation in MATLAB, and Background Subtraction Techniques in Image Processing. She is skilled in algorithm development for signal enhancement, noise reduction, feature engineering, and real-time data analysis, with a strong command of MATLAB toolboxes for signal, image, and communication processing. At MathWorks, she creates engaging, practical online courses that help learners apply MATLAB to solve real-world signal processing and AI challenges.
Intended audience
Engineering students, researchers, and industry professionals working on
robotics, control systems, and AI-based control.
Eligibility
UG or PG engineering students, researchers, and industry professionals working on robotics, control systems, and AI-based control.
Prerequisites - Basic MATLAB and Simulink knowledge.
Certification Criteria
Attending the workshop is mandatory for certification.
Reviews
There are no reviews yet.