SimSiam Naming Game: A Unified Approach for Representation Learning and Emergent Communication

• URL: http://arxiv.org/abs/2410.21803v1
• Date: Tue, 29 Oct 2024 07:16:20 GMT
• Title: SimSiam Naming Game: A Unified Approach for Representation Learning and Emergent Communication
• Abstract summary: We propose SimSiam+VAE, a unified approach for representation learning and emergent communication. SimSiam+VAE integrates a variational autoencoder into the predictor of the SimSiam network to enhance representation learning and capture uncertainty. We extend this model into a communication framework called the SimSiam Naming Game (SSNG)
• Score: 6.712251433139411
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Emergent communication, driven by generative models, enables agents to develop a shared language for describing their individual views of the same objects through interactions. Meanwhile, self-supervised learning (SSL), particularly SimSiam, uses discriminative representation learning to make representations of augmented views of the same data point closer in the representation space. Building on the prior work of VI-SimSiam, which incorporates a generative and Bayesian perspective into the SimSiam framework via variational inference (VI) interpretation, we propose SimSiam+VAE, a unified approach for both representation learning and emergent communication. SimSiam+VAE integrates a variational autoencoder (VAE) into the predictor of the SimSiam network to enhance representation learning and capture uncertainty. Experimental results show that SimSiam+VAE outperforms both SimSiam and VI-SimSiam. We further extend this model into a communication framework called the SimSiam Naming Game (SSNG), which applies the generative and Bayesian approach based on VI to develop internal representations and emergent language, while utilizing the discriminative process of SimSiam to facilitate mutual understanding between agents. In experiments with established models, despite the dynamic alternation of agent roles during interactions, SSNG demonstrates comparable performance to the referential game and slightly outperforms the Metropolis-Hastings naming game.

Related papers

• SIMA 2: A Generalist Embodied Agent for Virtual Worlds [87.15489342016714]
  We introduce SIMA 2, a generalist embodied agent that understands and acts in a wide variety of 3D virtual worlds.<n>Built upon a Gemini foundation model, SIMA 2 represents a significant step toward active, goal-directed interaction.
  arXiv  Detail & Related papers  (2025-12-04T13:46:11Z)
• Dyna-Mind: Learning to Simulate from Experience for Better AI Agents [62.21219817256246]
  We argue that current AI agents need ''vicarious trial and error'' - the capacity to mentally simulate alternative futures before acting.<n>We introduce Dyna-Mind, a two-stage training framework that explicitly teaches (V)LM agents to integrate such simulation into their reasoning.
  arXiv  Detail & Related papers  (2025-10-10T17:30:18Z)
• GATSim: Urban Mobility Simulation with Generative Agents [12.893057419094932]
  We introduce GATSim, a novel framework to simulate urban mobility using generative agents with rich, human-like behaviors.<n>Unlike conventional approaches, GATSim agents are characterized by diverse socioeconomic profiles, individual lifestyles, and evolving preferences shaped through psychologically informed memory systems.<n>We implement a prototype system and conduct systematic validation, demonstrating that generative agents produce believable and coherent travel behaviors.
  arXiv  Detail & Related papers  (2025-06-29T15:52:16Z)
• YuLan-OneSim: Towards the Next Generation of Social Simulator with Large Language Models [50.86336063222539]
  We introduce a novel social simulator called YuLan-OneSim.<n>Users can simply describe and refine their simulation scenarios through natural language interactions with our simulator.<n>We implement 50 default simulation scenarios spanning 8 domains, including economics, sociology, politics, psychology, organization, demographics, law, and communication.
  arXiv  Detail & Related papers  (2025-05-12T14:05:17Z)
• MOSAIC: Modeling Social AI for Content Dissemination and Regulation in Multi-Agent Simulations [17.780541196299954]
  We present a novel, open-source social network simulation framework, MOSAIC, where generative language agents predict user behaviors such as liking, sharing, and flagging content. This simulation combines LLM agents with a directed social graph to analyze emergent deception behaviors and gain a better understanding of how users determine the veracity of online social content.
  arXiv  Detail & Related papers  (2025-04-10T15:06:54Z)
• Unseen from Seen: Rewriting Observation-Instruction Using Foundation Models for Augmenting Vision-Language Navigation [67.31811007549489]
  We propose a Rewriting-driven AugMentation (RAM) paradigm for Vision-Language Navigation (VLN) Benefiting from our rewriting mechanism, new observation-instruction can be obtained in both simulator-free and labor-saving manners to promote generalization. Experiments on both the discrete environments (R2R, REVERIE, and R4R) and continuous environments (R2R-CE) show the superior performance and impressive generalization ability of our method.
  arXiv  Detail & Related papers  (2025-03-23T13:18:17Z)
• VicSim: Enhancing Victim Simulation with Emotional and Linguistic Fidelity [5.103173705069556]
  We introduce VicSim, a novel model that addresses three key dimensions of user simulation: informational faithfulness, emotional dynamics, and language style. Our adversarial training approach teaches the discriminator to recognize grammar and emotional cues as reliable indicators of synthetic content.
  arXiv  Detail & Related papers  (2025-01-06T17:01:45Z)
• SimMAT: Exploring Transferability from Vision Foundation Models to Any Image Modality [136.82569085134554]
  Foundation models like ChatGPT and Sora that are trained on a huge scale of data have made a revolutionary social impact. It is extremely challenging for sensors in many different fields to collect similar scales of natural images to train strong foundation models. This work presents a simple and effective framework SimMAT to study an open problem: the transferability from vision foundation models trained on natural RGB images to other image modalities of different physical properties.
  arXiv  Detail & Related papers  (2024-09-12T14:38:21Z)
• A Probabilistic Model Behind Self-Supervised Learning [53.64989127914936]
  In self-supervised learning (SSL), representations are learned via an auxiliary task without annotated labels. We present a generative latent variable model for self-supervised learning. We show that several families of discriminative SSL, including contrastive methods, induce a comparable distribution over representations.
  arXiv  Detail & Related papers  (2024-02-02T13:31:17Z)
• Symbol emergence as interpersonal cross-situational learning: the emergence of lexical knowledge with combinatoriality [5.350057408744861]
  We present a computational model for a symbol emergence system in cognitive and developmental robotics. Our proposed model facilitates the emergence of lexical knowledge with Metropolisity by performing category formation. Our results indicate that the lexical knowledge developed using our proposed model exhibits performance for novel situations.
  arXiv  Detail & Related papers  (2023-06-27T23:55:33Z)
• Towards More Realistic Generation of Information-Seeking Conversations [28.00273990499349]
  We first introduce a strong simulator for information-symmetric conversation, SimSeek-sym, where questioner and answerer share all knowledge. We propose SimSeek-asym that assumes information asymmetry between two agents, which encourages the questioner to seek new information from an inaccessible document. In our experiments, we demonstrate that SimSeek-asym successfully generates information-seeking conversations for two downstream tasks, CQA and conversational search.
  arXiv  Detail & Related papers  (2022-05-25T09:33:00Z)
• SimAN: Exploring Self-Supervised Representation Learning of Scene Text via Similarity-Aware Normalization [66.35116147275568]
  Self-supervised representation learning has drawn considerable attention from the scene text recognition community. We tackle the issue by formulating the representation learning scheme in a generative manner. We propose a Similarity-Aware Normalization (SimAN) module to identify the different patterns and align the corresponding styles from the guiding patch.
  arXiv  Detail & Related papers  (2022-03-20T08:43:10Z)
• VIRT: Improving Representation-based Models for Text Matching through Virtual Interaction [50.986371459817256]
  We propose a novel textitVirtual InteRacTion mechanism, termed as VIRT, to enable full and deep interaction modeling in representation-based models. VIRT asks representation-based encoders to conduct virtual interactions to mimic the behaviors as interaction-based models do.
  arXiv  Detail & Related papers  (2021-12-08T09:49:28Z)
• Learning to Improve Representations by Communicating About Perspectives [0.0]
  We present aminimal architecture comprised of a population of autoencoders. We show that our proposed architectureallows the emergence of aligned representations. Results demonstrate how communication from subjective perspec-tives can lead to the acquisition of more abstract representations in multi-agent systems.
  arXiv  Detail & Related papers  (2021-09-20T09:30:13Z)
• TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviors [74.67698916175614]
  We propose TrafficSim, a multi-agent behavior model for realistic traffic simulation. In particular, we leverage an implicit latent variable model to parameterize a joint actor policy. We show TrafficSim generates significantly more realistic and diverse traffic scenarios as compared to a diverse set of baselines.
  arXiv  Detail & Related papers  (2021-01-17T00:29:30Z)
• Point Cloud Based Reinforcement Learning for Sim-to-Real and Partial Observability in Visual Navigation [62.22058066456076]
  Reinforcement Learning (RL) represents powerful tools to solve complex robotic tasks. RL does not work directly in the real-world, which is known as the sim-to-real transfer problem. We propose a method that learns on an observation space constructed by point clouds and environment randomization.
  arXiv  Detail & Related papers  (2020-07-27T17:46:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.