SocialX: A Modular Platform for Multi-Source Big Data Research in Indonesia

• URL: http://arxiv.org/abs/2603.26253v1
• Date: Fri, 27 Mar 2026 10:22:34 GMT
• Title: SocialX: A Modular Platform for Multi-Source Big Data Research in Indonesia
• Abstract summary: SocialX is a modular platform for big data research in Indonesia.<n>It integrates heterogeneous data collection, language-aware preprocessing, and pluggable analysis into a unified, source-agnostic pipeline.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Big data research in Indonesia is constrained by a fundamental fragmentation: relevant data is scattered across social media, news portals, e-commerce platforms, review sites, and academic databases, each with different formats, access methods, and noise characteristics. Researchers must independently build collection pipelines, clean heterogeneous data, and assemble separate analysis tools, a process that often overshadows the research itself. We present SocialX, a modular platform for multi-source big data research that integrates heterogeneous data collection, language-aware preprocessing, and pluggable analysis into a unified, source-agnostic pipeline. The platform separates concerns into three independent layers (collection, preprocessing, and analysis) connected by a lightweight job-coordination mechanism. This modularity allows each layer to grow independently: new data sources, preprocessing methods, or analysis tools can be added without modifying the existing pipeline. We describe the design principles that enable this extensibility, detail the preprocessing methodology that addresses challenges specific to Indonesian text across registers, and demonstrate the platform's utility through a walkthrough of a typical research workflow. SocialX is publicly accessible as a web-based platform at https://www.socialx.id.

Related papers

• Data Pyramid for Embodied Manipulation [135.16063649795234]
  Embodied agents require data that couple observations with physical states and actions.<n>We organize the embodied data ecosystem as a "pyramid" spanning five complementary sources.
  arXiv  Detail & Related papers  (2026-07-27T17:59:58Z)
• Social Media Data Toolkit: Standardization and Anonymization of Social Network Datasets [5.06428614449742]
  The Social Media Data Toolkit (projectname) is a Python framework designed for the standardization, anonymization, and enrichment of social network datasets.<n>projectname unifies diverse data structures into a generic schema comprising Communities, Accounts, Posts, Actions, and Entities.<n>The framework features an anonymization module to secure Personally Identifiable Information (PII) and an extendable enrichment layer that integrates Large Language Models (LLMs) and network analysis tools.
  arXiv  Detail & Related papers  (2026-04-30T10:56:49Z)
• Advances and Frontiers of LLM-based Issue Resolution in Software Engineering: A Comprehensive Survey [59.3507264893654]
  Issue resolution is a complex Software Engineering task integral to real-world development.<n> benchmarks like SWE-bench revealed this task as profoundly difficult for large language models.<n>This paper presents a systematic survey of this emerging domain.
  arXiv  Detail & Related papers  (2026-01-15T18:55:03Z)
• DataParasite Enables Scalable and Repurposable Online Data Curation [0.9543667840503739]
  DataParasite is a modular pipeline for scalable online data collection.<n>It decomposes curation tasks into independent, entity-level searches.<n>It achieves high accuracy while reducing data-collection costs by an order of magnitude relative to manual curation.
  arXiv  Detail & Related papers  (2026-01-05T22:04:16Z)
• MARSAD: A Multi-Functional Tool for Real-Time Social Media Analysis [7.268812063067803]
  MARSAD is a multifunctional natural language processing (NLP) platform designed for real-time social media monitoring and analysis.<n>It enables researchers and non-technical users alike to examine both live and archived social media content.<n>It produces detailed visualizations and reports across various dimensions, including sentiment analysis, emotion analysis, propaganda detection, fact-checking, and hate speech detection.
  arXiv  Detail & Related papers  (2025-12-01T07:31:37Z)
• CoDA: Agentic Systems for Collaborative Data Visualization [57.270599188947294]
  Deep research has revolutionized data analysis, yet data scientists still devote substantial time to manually crafting visualizations.<n>Existing approaches, including simple single- or multi-agent systems, often oversimplify the task.<n>We introduce CoDA, a multi-agent system that employs specialized LLM agents for metadata analysis, task planning, code generation, and self-reflection.
  arXiv  Detail & Related papers  (2025-10-03T17:30:16Z)
• Towards High-Fidelity Synthetic Multi-platform Social Media Datasets via Large Language Models [0.0]
  Social media datasets are essential for research on a variety of topics, such as disinformation, influence operations, hate speech detection, or influencer marketing practices.<n>Access to social media datasets is often constrained due to costs and platform restrictions.<n>This paper explores the potential of large language models to create lexically and semantically relevant social media datasets across multiple platforms.
  arXiv  Detail & Related papers  (2025-05-02T18:56:01Z)
• Data-Juicer 2.0: Cloud-Scale Adaptive Data Processing for and with Foundation Models [83.65386456026441]
  Data-Juicer 2.0 is a data processing system backed by 100+ data processing operators spanning text, image, video, and audio modalities.<n>It supports more critical tasks including data analysis, synthesis, annotation, and foundation model post-training.<n>The system is publicly available and has been widely adopted in diverse research fields and real-world products such as Alibaba Cloud PAI.
  arXiv  Detail & Related papers  (2024-12-23T08:29:57Z)
• Leveraging GPT for the Generation of Multi-Platform Social Media Datasets for Research [0.0]
  Social media datasets are essential for research on disinformation, influence operations, social sensing, hate speech detection, cyberbullying, and other significant topics. Access to these datasets is often restricted due to costs and platform regulations. This paper explores the potential of large language models to create lexically and semantically relevant social media datasets across multiple platforms.
  arXiv  Detail & Related papers  (2024-07-11T09:12:39Z)
• An Integrated Data Processing Framework for Pretraining Foundation Models [57.47845148721817]
  Researchers and practitioners often have to manually curate datasets from difference sources. We propose a data processing framework that integrates a Processing Module and an Analyzing Module. The proposed framework is easy to use and highly flexible.
  arXiv  Detail & Related papers  (2024-02-26T07:22:51Z)
• GAIA Search: Hugging Face and Pyserini Interoperability for NLP Training Data Exploration [97.68234051078997]
  We discuss how Pyserini can be integrated with the Hugging Face ecosystem of open-source AI libraries and artifacts. We include a Jupyter Notebook-based walk through the core interoperability features, available on GitHub. We present GAIA Search - a search engine built following previously laid out principles, giving access to four popular large-scale text collections.
  arXiv  Detail & Related papers  (2023-06-02T12:09:59Z)
• Analytical Engines With Context-Rich Processing: Towards Efficient Next-Generation Analytics [12.317930859033149]
  We envision an analytical engine co-optimized with components that enable context-rich analysis. We aim for a holistic pipeline cost- and rule-based optimization across relational and model-based operators.
  arXiv  Detail & Related papers  (2022-12-14T21:46:33Z)
• SOLIS -- The MLOps journey from data acquisition to actionable insights [62.997667081978825]
  In this paper we present a unified deployment pipeline and freedom-to-operate approach that supports all requirements while using basic cross-platform tensor framework and script language engines. This approach however does not supply the needed procedures and pipelines for the actual deployment of machine learning capabilities in real production grade systems.
  arXiv  Detail & Related papers  (2021-12-22T14:45:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.