SnapMode: An Intelligent and Distributed Large-Scale Fashion Image Retrieval Platform Based On Big Data and Deep Generative Adversarial Network Technologies

• URL: http://arxiv.org/abs/2204.03998v1
• Date: Fri, 8 Apr 2022 11:08:03 GMT
• Title: SnapMode: An Intelligent and Distributed Large-Scale Fashion Image Retrieval Platform Based On Big Data and Deep Generative Adversarial Network Technologies
• Authors: Narges Norouzi, Reza Azmi, Sara Saberi Tehrani Moghadam, Maral Zarvani
• Abstract summary: It is nearly impossible for humans to manually catch up with the ongoing evolution and the continuously variable content in this domain. This paper first proposes a scalable focused Web engine based on the distributed computing platforms to extract and process fashion data on e-commerce websites. For the real-life implementation of the proposed solution, a Web-based application is developed on Apache Storm, Kafka, Solr, and Milvus platforms to create a fashion search engine called SnapMode.
• Score: 2.280980014008583
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Fashion is now among the largest industries worldwide, for it represents human history and helps tell the worlds story. As a result of the Fourth Industrial Revolution, the Internet has become an increasingly important source of fashion information. However, with a growing number of web pages and social data, it is nearly impossible for humans to manually catch up with the ongoing evolution and the continuously variable content in this domain. The proper management and exploitation of big data can pave the way for the substantial growth of the global economy as well as citizen satisfaction. Therefore, computer scientists have found it challenging to handle e-commerce fashion websites by using big data and machine learning technologies. This paper first proposes a scalable focused Web Crawler engine based on the distributed computing platforms to extract and process fashion data on e-commerce websites. The role of the proposed platform is then described in developing a disentangled feature extraction method by employing deep convolutional generative adversarial networks (DCGANs) for content-based image indexing and retrieval. Finally, the state-of-the-art solutions are compared, and the results of the proposed approach are analyzed on a standard dataset. For the real-life implementation of the proposed solution, a Web-based application is developed on Apache Storm, Kafka, Solr, and Milvus platforms to create a fashion search engine called SnapMode.

Related papers

• MS MARCO Web Search: a Large-scale Information-rich Web Dataset with Millions of Real Click Labels [95.48844474720798]
  We introduce MS MARCO Web Search, the first large-scale information-rich web dataset. This dataset mimics real-world web document and query distribution. MS MARCO Web Search offers a retrieval benchmark with three web retrieval challenge tasks.
  arXiv  Detail & Related papers  (2024-05-13T07:46:44Z)
• A Survey of Blockchain, Artificial Intelligence, and Edge Computing for Web 3.0 [22.941260278688933]
  Web 3.0 is the third generation of the World Wide Web. Web 3.0 is moving towards a more open, decentralized, intelligent, and interconnected network. Data breaches have raised awareness of online privacy and security of personal data.
  arXiv  Detail & Related papers  (2023-11-22T22:55:38Z)
• State of the Art on Diffusion Models for Visual Computing [191.6168813012954]
  This report introduces the basic mathematical concepts of diffusion models, implementation details and design choices of the popular Stable Diffusion model. We also give a comprehensive overview of the rapidly growing literature on diffusion-based generation and editing. We discuss available datasets, metrics, open challenges, and social implications.
  arXiv  Detail & Related papers  (2023-10-11T05:32:29Z)
• Web 3.0: The Future of Internet [53.234101208024335]
  Web 3.0 is a decentralized Web architecture that is more intelligent and safer than before. Web 3.0 is capable of addressing web data ownership according to distributed technology. It will optimize the internet world from the perspectives of economy, culture, and technology.
  arXiv  Detail & Related papers  (2023-03-23T15:37:42Z)
• Big Data Meets Metaverse: A Survey [58.83882109159864]
  The Metaverse is an emerging technology in the future. It has a combination of big data, AI (artificial intelligence), VR (Virtual Reality), AR (Augmented Reality), MR (mixed reality)
  arXiv  Detail & Related papers  (2022-10-28T17:22:20Z)
• A Crawler Architecture for Harvesting the Clear, Social, and Dark Web for IoT-Related Cyber-Threat Intelligence [1.1661238776379117]
  The clear, social, and dark web have lately been identified as rich sources of valuable cyber-security information. We present a novel crawling architecture for transparently harvesting data from security websites in the clear web, security forums in the social web, and hacker forums/marketplaces in the dark web.
  arXiv  Detail & Related papers  (2021-09-14T19:26:08Z)
• From Symbols to Embeddings: A Tale of Two Representations in Computational Social Science [77.5409807529667]
  The study of Computational Social Science (CSS) is data-driven and significantly benefits from the availability of online user-generated contents and social networks. To explore the answer, we give a thorough review of data representations in CSS for both text and network. We present the applications of the above representations based on the investigation of more than 400 research articles from 6 top venues involved with CSS.
  arXiv  Detail & Related papers  (2021-06-27T11:04:44Z)
• A Large Visual, Qualitative and Quantitative Dataset of Web Pages [4.5002924206836]
  We have created a large dataset of 49,438 Web pages. It consists of visual, textual and numerical data types, includes all countries worldwide, and considers a broad range of topics.
  arXiv  Detail & Related papers  (2021-05-15T01:31:25Z)
• Personalized Fashion Recommendation from Personal Social Media Data: An Item-to-Set Metric Learning Approach [71.63618051547144]
  We study the problem of personalized fashion recommendation from social media data. We present an item-to-set metric learning framework that learns to compute the similarity between a set of historical fashion items of a user to a new fashion item. To validate the effectiveness of our approach, we collect a real-world social media dataset.
  arXiv  Detail & Related papers  (2020-05-25T23:24:24Z)
• Knowledge Discovery from Social Media using Big Data provided Sentiment Analysis (SoMABiT) [2.218042861844671]
  This paper presents and discusses the technological and scientific focus of the SoMABiT as a social media analysis platform using big data technology. The use of MapReduce and developing a distributed algorithm towards an integrated platform that can scale for any data volume and provide a social media-driven knowledge is the main novelty of the proposed concept.
  arXiv  Detail & Related papers  (2020-01-16T18:53:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.