SmartCS: Enabling the Creation of ML-Powered Computer Vision Mobile Apps for Citizen Science Applications without Coding

• URL: http://arxiv.org/abs/2405.14323v1
• Date: Thu, 23 May 2024 08:54:50 GMT
• Title: SmartCS: Enabling the Creation of ML-Powered Computer Vision Mobile Apps for Citizen Science Applications without Coding
• Authors: Fahim Hasan Khan, Akila de Silva, Gregory Dusek, James Davis, Alex Pang,
• Abstract summary: Machine learning-aided apps provide on-field guidance to citizen scientists on data collection tasks. These apps rely on server-side ML support, and therefore need a reliable internet connection. We present a platform that democratizes citizen science by making it accessible to a much broader audience of both researchers and participants.
• Score: 3.3010662002273023
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: It is undeniable that citizen science contributes to the advancement of various fields of study. There are now software tools that facilitate the development of citizen science apps. However, apps developed with these tools rely on individual human skills to correctly collect useful data. Machine learning (ML)-aided apps provide on-field guidance to citizen scientists on data collection tasks. However, these apps rely on server-side ML support, and therefore need a reliable internet connection. Furthermore, the development of citizen science apps with ML support requires a significant investment of time and money. For some projects, this barrier may preclude the use of citizen science effectively. We present a platform that democratizes citizen science by making it accessible to a much broader audience of both researchers and participants. The SmartCS platform allows one to create citizen science apps with ML support quickly and without coding skills. Apps developed using SmartCS have client-side ML support, making them usable in the field, even when there is no internet connection. The client-side ML helps educate users to better recognize the subjects, thereby enabling high-quality data collection. We present several citizen science apps created using SmartCS, some of which were conceived and created by high school students.

Related papers

• DSBench: How Far Are Data Science Agents to Becoming Data Science Experts? [58.330879414174476]
  We introduce DSBench, a benchmark designed to evaluate data science agents with realistic tasks. This benchmark includes 466 data analysis tasks and 74 data modeling tasks, sourced from Eloquence and Kaggle competitions. Our evaluation of state-of-the-art LLMs, LVLMs, and agents shows that they struggle with most tasks, with the best agent solving only 34.12% of data analysis tasks and achieving a 34.74% Relative Performance Gap (RPG)
  arXiv  Detail & Related papers  (2024-09-12T02:08:00Z)
• OpenHands: An Open Platform for AI Software Developers as Generalist Agents [109.8507367518992]
  We introduce OpenHands, a platform for the development of AI agents that interact with the world in similar ways to a human developer. We describe how the platform allows for the implementation of new agents, safe interaction with sandboxed environments for code execution, and incorporation of evaluation benchmarks.
  arXiv  Detail & Related papers  (2024-07-23T17:50:43Z)
• SciGLM: Training Scientific Language Models with Self-Reflective Instruction Annotation and Tuning [60.14510984576027]
  SciGLM is a suite of scientific language models able to conduct college-level scientific reasoning. We apply a self-reflective instruction annotation framework to generate step-by-step reasoning for unlabelled scientific questions. We fine-tuned the ChatGLM family of language models with SciInstruct, enhancing their scientific and mathematical reasoning capabilities.
  arXiv  Detail & Related papers  (2024-01-15T20:22:21Z)
• Lessons Learned from a Citizen Science Project for Natural Language Processing [53.48988266271858]
  Citizen Science is an alternative to crowdsourcing that is relatively unexplored in the context of NLP. We conduct an exploratory study into engaging different groups of volunteers in Citizen Science for NLP by re-annotating parts of a pre-existing crowdsourced dataset. Our results show that this can yield high-quality annotations and attract motivated volunteers, but also requires considering factors such as scalability, participation over time, and legal and ethical issues.
  arXiv  Detail & Related papers  (2023-04-25T14:08:53Z)
• Low-cost Efficient Wireless Intelligent Sensor (LEWIS) for Engineering, Research, and Education [72.2614468437919]
  The vision of smart cities equipped with sensors informing decisions has not been realized to date. Civil engineers lack of knowledge in sensor technology. The electrical components and computer knowledge associated with sensors are still a challenge for civil engineers.
  arXiv  Detail & Related papers  (2023-03-23T21:49:26Z)
• Authoring Platform for Mobile Citizen Science Apps with Client-side ML [0.0]
  A significant portion of citizen science projects depends on visual data, where photos or videos of different subjects are needed. In this article, we introduce an authoring platform for easily creating mobile apps for citizen science projects. The apps created with our platform can help participants recognize the correct data and increase the efficiency of the data collection process.
  arXiv  Detail & Related papers  (2022-12-11T05:10:23Z)
• FastML Science Benchmarks: Accelerating Real-Time Scientific Edge Machine Learning [6.281437279822099]
  We present an initial set of scientific machine learning benchmarks, covering a variety of ML and embedded system techniques. These benchmarks can guide the design of future edge ML hardware for scientific applications capable of meeting the nanosecond and microsecond level latency requirements.
  arXiv  Detail & Related papers  (2022-07-16T14:30:15Z)
• Enabling Automated Machine Learning for Model-Driven AI Engineering [60.09869520679979]
  We propose a novel approach to enable Model-Driven Software Engineering and Model-Driven AI Engineering. In particular, we support Automated ML, thus assisting software engineers without deep AI knowledge in developing AI-intensive systems.
  arXiv  Detail & Related papers  (2022-03-06T10:12:56Z)
• AppBuddy: Learning to Accomplish Tasks in Mobile Apps via Reinforcement Learning [19.990946219992992]
  We introduce an RL-based framework for learning to accomplish tasks in mobile apps. RL agents are provided with states derived from the underlying representation of on-screen elements. We develop a platform which addresses several engineering challenges to enable an effective RL training environment.
  arXiv  Detail & Related papers  (2021-05-31T23:02:38Z)
• The FeatureCloud AI Store for Federated Learning in Biomedicine and Beyond [0.7517525791460022]
  Privacy-preserving methods, such as Federated Learning (FL), allow for training ML models without sharing sensitive data. We present the FeatureCloud AI Store for FL as an all-in-one platform for biomedical research and other applications.
  arXiv  Detail & Related papers  (2021-05-12T15:31:46Z)
• The Right Tools for the Job: The Case for Spatial Science Tool-Building [0.0]
  This paper presents the 8th annual Transactions in GIS plenary address at the American Association of Geographers annual meeting in Washington, DC. It discusses the motivation, experience, and outcomes of developing OSMnx, a tool intended to help address this. The paper concludes with paths forward, emphasizing open-source software and reusable computational data science.
  arXiv  Detail & Related papers  (2020-08-12T20:15:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.