AIoT-Based Drum Transcription Robot using Convolutional Neural Networks

• URL: http://arxiv.org/abs/2308.15061v1
• Date: Tue, 29 Aug 2023 06:50:04 GMT
• Title: AIoT-Based Drum Transcription Robot using Convolutional Neural Networks
• Abstract summary: We propose a drum robot that can automatically complete music transcription in real-time. This drum robot system consists of a cloud node for data storage, edge nodes for real-time computing, and data-oriented execution application nodes. In order to analyze drumming music and realize drum transcription, we propose a light-weight convolutional neural network model.
• Score: 33.91127704833719
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: With the development of information technology, robot technology has made great progress in various fields. These new technologies enable robots to be used in industry, agriculture, education and other aspects. In this paper, we propose a drum robot that can automatically complete music transcription in real-time, which is based on AIoT and fog computing technology. Specifically, this drum robot system consists of a cloud node for data storage, edge nodes for real-time computing, and data-oriented execution application nodes. In order to analyze drumming music and realize drum transcription, we further propose a light-weight convolutional neural network model to classify drums, which can be more effectively deployed in terminal devices for fast edge calculations. The experimental results show that the proposed system can achieve more competitive performance and enjoy a variety of smart applications and services.

Related papers

• Dexterous grasp data augmentation based on grasp synthesis with fingertip workspace cloud and contact-aware sampling [12.284578987285188]
  We propose a teleoperation-based framework to collect a small set of grasp pose demonstrations.<n>Based on the demonstrated grasp poses, we propose AutoWS, which automatically generates structured workspace clouds of robotic fingertips.<n>Our framework enables real-time grasp generation for hands with arbitrary structures and produces human-like grasps when combined with demonstrations.
  arXiv  Detail & Related papers  (2026-03-17T14:51:35Z)
• RobotSeg: A Model and Dataset for Segmenting Robots in Image and Video [56.9581053843815]
  We introduce RobotSeg, a foundation model for robot segmentation in image and video.<n>It addresses the lack of adaptation to articulated robots, reliance on manual prompts, and the need for per-frame training mask annotations.<n>It achieves state-of-the-art performance on both images and videos.
  arXiv  Detail & Related papers  (2025-11-28T07:51:02Z)
• One For All: LLM-based Heterogeneous Mission Planning in Precision Agriculture [2.9440788521375585]
  We present a natural language (NL) robotic mission planner that enables non-specialists to control heterogeneous robots.<n>Our architecture seamlessly translates human language into intermediate descriptions that can be executed by different robotic platforms.<n>This work represents a significant step toward making robotic automation in precision agriculture more accessible to non-technical users.
  arXiv  Detail & Related papers  (2025-06-11T18:45:44Z)
• RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twins (early version) [25.298789781487084]
  This paper introduces RoboTwin, a novel benchmark dataset combining real-world teleoperated data with synthetic data from digital twins. We present a innovative approach to creating digital twins using AI-generated content, transforming 2D images into detailed 3D models. Our key contributions are: 1) the RoboTwin benchmark dataset, 2) an efficient real-to-simulation pipeline, and 3) the use of language models for automatic expert-level data generation.
  arXiv  Detail & Related papers  (2024-09-04T17:59:52Z)
• RoboScript: Code Generation for Free-Form Manipulation Tasks across Real and Simulation [77.41969287400977]
  This paper presents textbfRobotScript, a platform for a deployable robot manipulation pipeline powered by code generation. We also present a benchmark for a code generation benchmark for robot manipulation tasks in free-form natural language. We demonstrate the adaptability of our code generation framework across multiple robot embodiments, including the Franka and UR5 robot arms.
  arXiv  Detail & Related papers  (2024-02-22T15:12:00Z)
• RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulation [68.70755196744533]
  RoboGen is a generative robotic agent that automatically learns diverse robotic skills at scale via generative simulation. Our work attempts to extract the extensive and versatile knowledge embedded in large-scale models and transfer them to the field of robotics.
  arXiv  Detail & Related papers  (2023-11-02T17:59:21Z)
• Fully Spiking Neural Network for Legged Robots [6.974746966671198]
  Spiking Neural Network (SNN) for legged robots shows exceptional performance in simulated terrains. SNNs provide natural advantages in inference speed and energy consumption. This study presents a highly efficient SNN for legged robots that can be seamless integrated into other learning models.
  arXiv  Detail & Related papers  (2023-10-08T05:48:30Z)
• Improving Drumming Robot Via Attention Transformer Network [2.5064819128982556]
  We introduce an improving drumming robot that can automatically complete music transcription based on the popular vision transformer network based on the attention mechanism. Massive experimental results demonstrate that the improving algorithm can help the drumming robot promote drum classification performance.
  arXiv  Detail & Related papers  (2023-10-04T03:55:43Z)
• A toolbox for neuromorphic sensing in robotics [4.157415305926584]
  We introduce a ROS (Robot Operating System) toolbox to encode and decode input signals coming from any type of sensor available on a robot. This initiative is meant to stimulate and facilitate robotic integration of neuromorphic AI.
  arXiv  Detail & Related papers  (2021-03-03T23:22:05Z)
• Task-relevant Representation Learning for Networked Robotic Perception [74.0215744125845]
  This paper presents an algorithm to learn task-relevant representations of sensory data that are co-designed with a pre-trained robotic perception model's ultimate objective. Our algorithm aggressively compresses robotic sensory data by up to 11x more than competing methods.
  arXiv  Detail & Related papers  (2020-11-06T07:39:08Z)
• A Survey of FPGA-Based Robotic Computing [14.678669738217552]
  High computation and data complexity of robotic algorithms pose great challenges to its applications. With specialized designed hardware logic and algorithm kernels, FPGA-based accelerators can surpass CPU and GPU in performance and energy efficiency. An analysis of software and hardware optimization techniques and main technical issues is presented, along with some commercial and space applications.
  arXiv  Detail & Related papers  (2020-09-13T16:22:08Z)
• Integrated Benchmarking and Design for Reproducible and Accessible Evaluation of Robotic Agents [61.36681529571202]
  We describe a new concept for reproducible robotics research that integrates development and benchmarking. One of the central components of this setup is the Duckietown Autolab, a standardized setup that is itself relatively low-cost and reproducible. We validate the system by analyzing the repeatability of experiments conducted using the infrastructure and show that there is low variance across different robot hardware and across different remote labs.
  arXiv  Detail & Related papers  (2020-09-09T15:31:29Z)
• Populations of Spiking Neurons for Reservoir Computing: Closed Loop Control of a Compliant Quadruped [64.64924554743982]
  We present a framework for implementing central pattern generators with spiking neural networks to obtain closed loop robot control. We demonstrate the learning of predefined gait patterns, speed control and gait transition on a simulated model of a compliant quadrupedal robot.
  arXiv  Detail & Related papers  (2020-04-09T14:32:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.