Crowd Sensing and Living Lab Outdoor Experimentation Made Easy
- URL: http://arxiv.org/abs/2107.04117v4
- Date: Fri, 15 Oct 2021 10:06:33 GMT
- Title: Crowd Sensing and Living Lab Outdoor Experimentation Made Easy
- Authors: Evangelos Pournaras, Atif Nabi Ghulam, Renato Kunz, Regula H\"anggli
- Abstract summary: This article introduces Smart Agora, a novel open-source software platform for rigorous systematic outdoor experimentation.
Without writing a single line of code, highly complex experimental scenarios are visually designed and automatically deployed to smart phones.
- Score: 2.5234156040689237
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Living lab outdoor experimentation using pervasive computing provides new
opportunities: higher realism, external validity and socio-spatio-temporal
observations in large scale. However, experimentation `in the wild' is complex
and costly. Noise, biases, privacy concerns, compliance with standards of
ethical review boards, remote moderation, control of experimental conditions
and equipment perplex the collection of high-quality data for causal inference.
This article introduces Smart Agora, a novel open-source software platform for
rigorous systematic outdoor experimentation. Without writing a single line of
code, highly complex experimental scenarios are visually designed and
automatically deployed to smart phones. Novel geolocated survey and sensor data
are collected subject of participants verifying desired experimental
conditions, for instance, their localization at certain urban spots. This new
approach drastically improves the quality and purposefulness of crowd sensing,
tailored to conditions that confirm/reject hypotheses. The features that
support this innovative functionality and the broad spectrum of its
applicability are demonstrated.
Related papers
- Adaptive Experimentation When You Can't Experiment [55.86593195947978]
This paper introduces the emphconfounded pure exploration transductive linear bandit (textttCPET-LB) problem.
Online services can employ a properly randomized encouragement that incentivizes users toward a specific treatment.
arXiv Detail & Related papers (2024-06-15T20:54:48Z) - DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agents [49.74065769505137]
We introduce DISCOVERYWORLD, the first virtual environment for developing and benchmarking an agent's ability to perform complete cycles of novel scientific discovery.
It includes 120 different challenge tasks spanning eight topics each with three levels of difficulty and several parametric variations.
We find that strong baseline agents, that perform well in prior published environments, struggle on most DISCOVERYWORLD tasks.
arXiv Detail & Related papers (2024-06-10T20:08:44Z) - MLXP: A Framework for Conducting Replicable Experiments in Python [63.37350735954699]
We propose MLXP, an open-source, simple, and lightweight experiment management tool based on Python.
It streamlines the experimental process with minimal overhead while ensuring a high level of practitioner overhead.
arXiv Detail & Related papers (2024-02-21T14:22:20Z) - ExPT: Synthetic Pretraining for Few-Shot Experimental Design [33.5918976228562]
Experiment Pretrained Transformers (ExPT) is a foundation model for few-shot experimental design.
ExPT employs a novel combination of synthetic pretraining with in-context learning.
We evaluate ExPT on few-shot experimental design in challenging domains.
arXiv Detail & Related papers (2023-10-30T19:25:43Z) - Intervention Generalization: A View from Factor Graph Models [7.117681268784223]
We take a close look at how to warrant a leap from past experiments to novel conditions based on minimal assumptions about the factorization of the distribution of the manipulated system.
A postulated $textitinterventional factor model$ (IFM) may not always be informative, but it conveniently abstracts away a need for explicitly modeling unmeasured confounding and feedback mechanisms.
arXiv Detail & Related papers (2023-06-06T21:44:23Z) - GFlowNets for AI-Driven Scientific Discovery [74.27219800878304]
We present a new probabilistic machine learning framework called GFlowNets.
GFlowNets can be applied in the modeling, hypotheses generation and experimental design stages of the experimental science loop.
We argue that GFlowNets can become a valuable tool for AI-driven scientific discovery.
arXiv Detail & Related papers (2023-02-01T17:29:43Z) - Adapting to Online Label Shift with Provable Guarantees [137.89382409682233]
We formulate and investigate the problem of online label shift.
The non-stationarity and lack of supervision make the problem challenging to be tackled.
Our algorithms enjoy optimal dynamic regret, indicating that performance is competitive with a clairvoyant nature.
arXiv Detail & Related papers (2022-07-05T15:43:14Z) - Active Exploration via Experiment Design in Markov Chains [86.41407938210193]
A key challenge in science and engineering is to design experiments to learn about some unknown quantity of interest.
We propose an algorithm that efficiently selects policies whose measurement allocation converges to the optimal one.
In addition to our theoretical analysis, we showcase our framework on applications in ecological surveillance and pharmacology.
arXiv Detail & Related papers (2022-06-29T00:04:40Z) - SIERRA: A Modular Framework for Research Automation [5.220940151628734]
We present SIERRA, a novel framework for accelerating research developments and improving results.
SIERRA makes it easy to quickly specify the independent variable(s) for an experiment, generate experimental inputs, automatically run the experiment, and process the results to generate deliverables such as graphs and videos.
It employs a deeply modular approach that allows easy customization and extension of automation for the needs of individual researchers.
arXiv Detail & Related papers (2022-03-03T23:45:46Z) - Experiments as Code: A Concept for Reproducible, Auditable, Debuggable,
Reusable, & Scalable Experiments [7.557948558412152]
A common concern in experimental research is the auditability and of experiments.
We propose the "Experiments as Code" paradigm, where the whole experiment is not only documented but additionally the automation code is provided.
arXiv Detail & Related papers (2022-02-24T12:15:00Z) - Towards Futuristic Autonomous Experimentation--A Surprise-Reacting
Sequential Experiment Policy [3.326548149772318]
An autonomous experimentation platform in manufacturing is supposedly capable of conducting a sequential search for suitable manufacturing conditions for advanced materials.
We argue that such capability is much needed for futuristic autonomous experimentation platforms.
arXiv Detail & Related papers (2021-12-01T16:14:49Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.