A Unified Framework for Generic, Query-Focused, Privacy Preserving and
Update Summarization using Submodular Information Measures
- URL: http://arxiv.org/abs/2010.05631v1
- Date: Mon, 12 Oct 2020 12:03:03 GMT
- Title: A Unified Framework for Generic, Query-Focused, Privacy Preserving and
Update Summarization using Submodular Information Measures
- Authors: Vishal Kaushal, Suraj Kothawade, Ganesh Ramakrishnan, Jeff Bilmes,
Himanshu Asnani, Rishabh Iyer
- Abstract summary: We study submodular information measures as a rich framework for generic, query-focused, privacy sensitive, and update summarization tasks.
We first show that several previous query-focused and update summarization techniques have, unknowingly, used various instantiations of the aforesaid submodular information measures.
We empirically verify our findings on both a synthetic dataset and an existing real-world image collection dataset.
- Score: 15.520331683061633
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We study submodular information measures as a rich framework for generic,
query-focused, privacy sensitive, and update summarization tasks. While past
work generally treats these problems differently ({\em e.g.}, different models
are often used for generic and query-focused summarization), the submodular
information measures allow us to study each of these problems via a unified
approach. We first show that several previous query-focused and update
summarization techniques have, unknowingly, used various instantiations of the
aforesaid submodular information measures, providing evidence for the benefit
and naturalness of these models. We then carefully study and demonstrate the
modelling capabilities of the proposed functions in different settings and
empirically verify our findings on both a synthetic dataset and an existing
real-world image collection dataset (that has been extended by adding concept
annotations to each image making it suitable for this task) and will be
publicly released. We employ a max-margin framework to learn a mixture model
built using the proposed instantiations of submodular information measures and
demonstrate the effectiveness of our approach. While our experiments are in the
context of image summarization, our framework is generic and can be easily
extended to other summarization settings (e.g., videos or documents).
Related papers
- Realistic Evaluation of Model Merging for Compositional Generalization [45.68423348264746]
We evaluate the relative merits of different merging methods by evaluating them in a shared experimental setting.
Specifically, our setting focuses on using merging for compositional generalization of capabilities in image classification, image generation, and natural language processing.
We measure the computational costs of different merging methods as well as how they perform when scaling the number of models being merged.
arXiv Detail & Related papers (2024-09-26T21:44:20Z) - Discovering Common Information in Multi-view Data [35.37807004353416]
We introduce an innovative and mathematically rigorous definition for computing common information from multi-view data.
We develop a novel supervised multi-view learning framework to capture both common and unique information.
arXiv Detail & Related papers (2024-06-21T10:47:06Z) - Self-Supervised Representation Learning with Meta Comprehensive
Regularization [11.387994024747842]
We introduce a module called CompMod with Meta Comprehensive Regularization (MCR), embedded into existing self-supervised frameworks.
We update our proposed model through a bi-level optimization mechanism, enabling it to capture comprehensive features.
We provide theoretical support for our proposed method from information theory and causal counterfactual perspective.
arXiv Detail & Related papers (2024-03-03T15:53:48Z) - Modeling Entities as Semantic Points for Visual Information Extraction
in the Wild [55.91783742370978]
We propose an alternative approach to precisely and robustly extract key information from document images.
We explicitly model entities as semantic points, i.e., center points of entities are enriched with semantic information describing the attributes and relationships of different entities.
The proposed method can achieve significantly enhanced performance on entity labeling and linking, compared with previous state-of-the-art models.
arXiv Detail & Related papers (2023-03-23T08:21:16Z) - GLUECons: A Generic Benchmark for Learning Under Constraints [102.78051169725455]
In this work, we create a benchmark that is a collection of nine tasks in the domains of natural language processing and computer vision.
We model external knowledge as constraints, specify the sources of the constraints for each task, and implement various models that use these constraints.
arXiv Detail & Related papers (2023-02-16T16:45:36Z) - Named Entity and Relation Extraction with Multi-Modal Retrieval [51.660650522630526]
Multi-modal named entity recognition (NER) and relation extraction (RE) aim to leverage relevant image information to improve the performance of NER and RE.
We propose a novel Multi-modal Retrieval based framework (MoRe)
MoRe contains a text retrieval module and an image-based retrieval module, which retrieve related knowledge of the input text and image in the knowledge corpus respectively.
arXiv Detail & Related papers (2022-12-03T13:11:32Z) - Relational Action Bases: Formalization, Effective Safety Verification,
and Invariants (Extended Version) [67.99023219822564]
We introduce the general framework of relational action bases (RABs)
RABs generalize existing models by lifting both restrictions.
We demonstrate the effectiveness of this approach on a benchmark of data-aware business processes.
arXiv Detail & Related papers (2022-08-12T17:03:50Z) - An Ample Approach to Data and Modeling [1.0152838128195467]
We describe a framework for modeling how models can be built that integrates concepts and methods from a wide range of fields.
The reference M* meta model framework is presented, which relies critically in associating whole datasets and respective models in terms of a strict equivalence relation.
Several considerations about how the developed framework can provide insights about data clustering, complexity, collaborative research, deep learning, and creativity are then presented.
arXiv Detail & Related papers (2021-10-05T01:26:09Z) - SupMMD: A Sentence Importance Model for Extractive Summarization using
Maximum Mean Discrepancy [92.5683788430012]
SupMMD is a novel technique for generic and update summarization based on the maximum discrepancy from kernel two-sample testing.
We show the efficacy of SupMMD in both generic and update summarization tasks by meeting or exceeding the current state-of-the-art on the DUC-2004 and TAC-2009 datasets.
arXiv Detail & Related papers (2020-10-06T09:26:55Z) - Dynamic Feature Integration for Simultaneous Detection of Salient
Object, Edge and Skeleton [108.01007935498104]
In this paper, we solve three low-level pixel-wise vision problems, including salient object segmentation, edge detection, and skeleton extraction.
We first show some similarities shared by these tasks and then demonstrate how they can be leveraged for developing a unified framework.
arXiv Detail & Related papers (2020-04-18T11:10:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.