Road Scene Graph: A Semantic Graph-Based Scene Representation Dataset
for Intelligent Vehicles
- URL: http://arxiv.org/abs/2011.13588v1
- Date: Fri, 27 Nov 2020 07:33:11 GMT
- Title: Road Scene Graph: A Semantic Graph-Based Scene Representation Dataset
for Intelligent Vehicles
- Authors: Yafu Tian, Alexander Carballo, Ruifeng Li and Kazuya Takeda
- Abstract summary: We propose road scene graph,a special scene-graph for intelligent vehicles.
It provides not only object proposals but also their pair-wise relationships.
By organizing them in a topological graph, these data are explainable, fully-connected, and could be easily processed by GCNs.
- Score: 72.04891523115535
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Rich semantic information extraction plays a vital role on next-generation
intelligent vehicles. Currently there is great amount of research focusing on
fundamental applications such as 6D pose detection, road scene semantic
segmentation, etc. And this provides us a great opportunity to think about how
shall these data be organized and exploited.
In this paper we propose road scene graph,a special scene-graph for
intelligent vehicles. Different to classical data representation, this graph
provides not only object proposals but also their pair-wise relationships. By
organizing them in a topological graph, these data are explainable,
fully-connected, and could be easily processed by GCNs (Graph Convolutional
Networks). Here we apply scene graph on roads using our Road Scene Graph
dataset, including the basic graph prediction model. This work also includes
experimental evaluations using the proposed model.
Related papers
- nuScenes Knowledge Graph -- A comprehensive semantic representation of
traffic scenes for trajectory prediction [6.23221362105447]
Trajectory prediction in traffic scenes involves accurately forecasting the behaviour of surrounding vehicles.
It is crucial to consider contextual information, including the driving path of vehicles, road topology, lane dividers, and traffic rules.
This paper presents an approach that utilizes knowledge graphs to model the diverse entities and their semantic connections within traffic scenes.
arXiv Detail & Related papers (2023-12-15T10:40:34Z) - AutoGraph: Predicting Lane Graphs from Traffic Observations [35.73868803802196]
We propose to use the motion patterns of traffic participants as lane graph annotations.
Based on the location of these tracklets, we predict the successor lane graph from an initial position.
In a subsequent stage, we show how the individual successor predictions can be aggregated into a consistent lane graph.
arXiv Detail & Related papers (2023-06-27T12:11:22Z) - RSG-Net: Towards Rich Sematic Relationship Prediction for Intelligent
Vehicle in Complex Environments [72.04891523115535]
We propose RSG-Net (Road Scene Graph Net): a graph convolutional network designed to predict potential semantic relationships from object proposals.
The experimental results indicate that this network, trained on Road Scene Graph dataset, could efficiently predict potential semantic relationships among objects around the ego-vehicle.
arXiv Detail & Related papers (2022-07-16T12:40:17Z) - Neural Graph Matching for Pre-training Graph Neural Networks [72.32801428070749]
Graph neural networks (GNNs) have been shown powerful capacity at modeling structural data.
We present a novel Graph Matching based GNN Pre-Training framework, called GMPT.
The proposed method can be applied to fully self-supervised pre-training and coarse-grained supervised pre-training.
arXiv Detail & Related papers (2022-03-03T09:53:53Z) - roadscene2vec: A Tool for Extracting and Embedding Road Scene-Graphs [3.9482018271405073]
roadscene2vec is an open-source tool for extracting and embedding road scene-graphs.
The goal of roadscene2vec is to enable research into applications and capabilities of road scene-graphs.
arXiv Detail & Related papers (2021-09-02T19:21:18Z) - Lane Graph Estimation for Scene Understanding in Urban Driving [34.82775302794312]
We propose a novel approach for lane geometry estimation from bird's-eye-view images.
We train a graph estimation model on multimodal bird's-eye-view data processed from the popular NuScenes dataset.
Our model shows promising performance for most evaluated urban scenes and can serve as a step towards automated generation of HD lane annotations for autonomous driving.
arXiv Detail & Related papers (2021-05-01T08:38:18Z) - Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructions [94.17683799712397]
We focus on scene graphs, a data structure that organizes the entities of a scene in a graph.
We propose a learned method that regresses a scene graph from the point cloud of a scene.
We show the application of our method in a domain-agnostic retrieval task, where graphs serve as an intermediate representation for 3D-3D and 2D-3D matching.
arXiv Detail & Related papers (2020-04-08T12:25:25Z) - GPS-Net: Graph Property Sensing Network for Scene Graph Generation [91.60326359082408]
Scene graph generation (SGG) aims to detect objects in an image along with their pairwise relationships.
GPS-Net fully explores three properties for SGG: edge direction information, the difference in priority between nodes, and the long-tailed distribution of relationships.
GPS-Net achieves state-of-the-art performance on three popular databases: VG, OI, and VRD by significant gains under various settings and metrics.
arXiv Detail & Related papers (2020-03-29T07:22:31Z) - Deep Learning for Learning Graph Representations [58.649784596090385]
Mining graph data has become a popular research topic in computer science.
The huge amount of network data has posed great challenges for efficient analysis.
This motivates the advent of graph representation which maps the graph into a low-dimension vector space.
arXiv Detail & Related papers (2020-01-02T02:13:28Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.