Educational Robot with Robotic Arm-LSE550A

Key Feature Introduction (Fully Open Source)

 

1.RTAB-Map 3D VSLAM & LiDAR Integration

    Supports RTAB-Map pure vision mapping and LiDAR-vision fusion mapping. Fully compatible with ROS 1 and ROS 2 for versatile 3D environment reconstruction.

 

 

 

 

2.Classic 2D LiDAR Mapping & Navigation

    ROS 2: Supports Gmapping, Cartographer, and slam_toolbox.

    ROS 1: Supports Gmapping, Hector, Karto, and Cartographer.

    Navigation: Features autonomous point-to-point navigation, multi-point waypoints, and dynamic obstacle avoidance.

 

 

 

3.ORB-SLAM2 Visual Mapping

    Features the open-source ORB-SLAM2 framework for real-time camera pose

    estimation and sparse 3D reconstruction. Provides real-scale metric information when used in RGB-D mode.

 

 

 

4.ROS QT Graphical User Interface(GUI)

    Deployed with a dedicated QT-based GUI for "one-click" ROS activation. Provides

    intuitive real-time feedback on robot velocity, battery status, and system health.

 

 

 

 

5.YOLO Object Detection

    ROS 1: Powered by YOLO.v3 for general object, traffic sign, and gesture recognition.

    ROS 2: Powered by YOLO.v8 and YOLOv11 for state-of-the-art object detection and custom model training support.

 

 

 

6.3D Reconstruction for Real-World Autonomous Driving

    Upgrade with an optional multi-line LiDAR to unlock outdoor 3D mapping and environment reconstruction, bringing your development platform incredibly close to full-scale autonomous vehicles.

 

•     Autonomous Driving Feature: Automated Parking

    Combines our proprietary algorithms with deep learning models to achieve fully autonomous parking and garage docking—bringing an essential industry- level autonomous driving feature to your desktop.

 

 

•     Autonomous Driving Feature: Lane Keeping Assist

 

     Employs core computer vision algorithms to detect lanes and maintain vehicle centering, replicating the foundational safety features found in modern smart vehicles.

 

 

•     Autonomous Driving Feature: Intelligent Steering Decisions

     Driven by a fusion of proprietary control algorithms and deep learning-based lane and traffic sign recognition, enabling the robot to make complex, real-time navigational decisions.

 

 

•     YOLO Traffic Sign Recognition

     Includes a step-by-step guide to help you train your own deep learning model library. Implement essential autonomous driving behaviors using a standard RGB camera module.

 

 

7.Depth-Based Visual Following

    Utilizes depth cameras to calculate target distance and bearing for smooth, real-time robot following.

 

 

 

8.KCF Target Tracking

    Employs Kernelized Correlation Filters (KCF) via the depth camera to identify and track objects with fixed visual features.

 

 

9.AR Tag Recognition & Following

    Detects and tracks the 6-DOF pose of AR Tags, allowing for tag-following behaviors and expanded tag-based localization.

 

 

 

10.RRT Autonomous Exploration

     Enables fully autonomous mapping using the RRT algorithm. The robot explores, maps, saves the data, and returns to the starting point without human intervention.

 

 

 

11.Web-Based Camera Monitoring

     Remotely view the robot's live camera feed through any PC browser for quick deployment of remote surveillance tasks.

 

 

 

12.RGB Camera Line Following

     Enables the robot to follow ground lines via RGB vision. Integrated with LiDAR to ensure automatic obstacle avoidance during line-following missions.

 

 

 

13.LiDAR-Based Following

     Scans the environment for nearby obstacles and intelligently selects the nearest target for the robot to follow.

 

 

 

14.LiDAR Angle Masking

     Optimized via SDK to allow custom angle shielding/masking for all supported LiDAR models.

 

 

 

15.Sound Source Localization

     Uses a microphone array to achieve sound source localization with 1° precision. This technology facilitates advanced noise reduction and voice-driven navigation.

 

 

 

16.Voice-Activated Summoning

     Call the robot to your location from anywhere. It identifies the user's direction via the mic array and determines distance using LiDAR.

 

 

 

17.Voice-Controlled Navigation

     Semantic analysis of voice commands allows the robot to navigate to any predefined point on the saved map.

 

 

 

18.TTS (Text-to-Speech) Interaction

     Enables full human-machine interaction through TTS technology, with support for expanded iFLYTEK online voice dialogue features.

 

 

 

19.TEB & DWA Path Planning

     Includes detailed video tutorials and Python-based "mini-games" to help users learn navigation path planning from the ground up.

 

 

 

20.DWB / MPPI / RPP Controllers

     Provides three ready-to-use controller plugins (DWB, MPPI, and RPP) tailored for different scenarios and various robot footprints.

 

 

 

21.ROS TensorFlow Object Detection

     Leverages the power of TensorFlow within the ROS environment to enable both common object classification and handwritten digit recognition.

 

 

 

22.Chassis Kinematics Analysis

     Provides comprehensive kinematics analysis for various chassis types: Ackermann, Differential, Tracked, Mecanum, Omnidirectional, and 4WD.

 

 

 

23.Path Recording & Playback

     Record manual trajectories and reproduce them autonomously using the Nav2 navigation framework.

 

 

 

24.Comprehensive URDF Models

     Includes high-fidelity URDF models that accurately match the physical robot's dimensions and properties.

 

 

 

25.ROS Mobile APP for Navigation

     A dedicated app for controlling the ROS environment, supporting motion control, mapping, and navigation tasks.

 

 

 

26.Hardware Tuning & Parameter APP

     Supports Android and iOS. Features real-time parameter tuning, gravity-sensing control, and waveform visualization.

 

 

 

27.Wireless Code Flashing (Bluetooth)

     Standard Bluetooth module allows for remote debugging and "second-level" code flashing via the dedicated host computer, simplifying secondary development.

 

 

 

28.Optional 4G/5G Remote Modules

     Supports optional 4G/5G modules for long-range video transmission and remote control over cellular networks.

 

 

29. Adaptive Flexible Gripper

     Features a 2-finger adaptive soft gripper engineered to seamlessly grasp and handle objects of almost any shape, geometry, or fragility.

 

 

 

30.Color Block Sorting

     Comes standard with out-of-the-box color sorting routines. This hands-on application ensures a faster learning curve for mastering robotic arm manipulation.

 

 

 

31.Precision Color Tracking

     Utilizes an advanced color recognition tracking and sorting methodology to drastically optimize workflow and sorting efficiency.

 

 

32.Real-Time Face Tracking

     Integrated facial recognition and tracking technology allows the system to lock onto targets instantly and maintain precise, real-time tracking.

 

  

33.Dynamic Gesture Recognition

     Capable of identifying both static hand signs and dynamic gestures, displaying recognition results instantly on the user interface.