A Byte Sequence is Worth an Image: CNN for File Fragment Classification Using Bit Shift and n-Gram Embeddings

• URL: http://arxiv.org/abs/2304.06983v1
• Date: Fri, 14 Apr 2023 08:06:52 GMT
• Title: A Byte Sequence is Worth an Image: CNN for File Fragment Classification Using Bit Shift and n-Gram Embeddings
• Authors: Wenyang Liu, Yi Wang, Kejun Wu, Kim-Hui Yap and Lap-Pui Chau
• Abstract summary: File fragment classification (FFC) on small chunks of memory is essential in memory forensics and Internet security. Existing methods mainly treat file fragments as 1d byte signals and utilize the captured inter-byte features for classification. We propose Byte2Image, a novel data augmentation technique, to introduce the neglected intra-byte information into file fragments and re-treat them as 2d gray-scale images.
• Score: 21.14735408046021
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: File fragment classification (FFC) on small chunks of memory is essential in memory forensics and Internet security. Existing methods mainly treat file fragments as 1d byte signals and utilize the captured inter-byte features for classification, while the bit information within bytes, i.e., intra-byte information, is seldom considered. This is inherently inapt for classifying variable-length coding files whose symbols are represented as the variable number of bits. Conversely, we propose Byte2Image, a novel data augmentation technique, to introduce the neglected intra-byte information into file fragments and re-treat them as 2d gray-scale images, which allows us to capture both inter-byte and intra-byte correlations simultaneously through powerful convolutional neural networks (CNNs). Specifically, to convert file fragments to 2d images, we employ a sliding byte window to expose the neglected intra-byte information and stack their n-gram features row by row. We further propose a byte sequence \& image fusion network as a classifier, which can jointly model the raw 1d byte sequence and the converted 2d image to perform FFC. Experiments on FFT-75 dataset validate that our proposed method can achieve notable accuracy improvements over state-of-the-art methods in nearly all scenarios. The code will be released at https://github.com/wenyang001/Byte2Image.

Related papers

• Language-Oriented Semantic Latent Representation for Image Transmission [38.62941652189033]
  New paradigm of semantic communication (SC) focuses on delivering meanings behind bits. Recent advances in data-to-text models facilitate language-oriented SC. We propose a novel SC framework that communicates both text and a compressed image embedding.
  arXiv  Detail & Related papers  (2024-05-16T10:41:31Z)
• UniGS: Unified Representation for Image Generation and Segmentation [105.08152635402858]
  We use a colormap to represent entity-level masks, addressing the challenge of varying entity numbers. Two novel modules, including the location-aware color palette and progressive dichotomy module, are proposed to support our mask representation.
  arXiv  Detail & Related papers  (2023-12-04T15:59:27Z)
• Bytes Are All You Need: Transformers Operating Directly On File Bytes [55.81123238702553]
  We investigate modality-independent representation learning by performing classification on file bytes, without the need for decoding files at inference time. Our model, ByteFormer, improves ImageNet Top-1 classification accuracy by $5%$. We demonstrate that the same ByteFormer architecture can perform audio classification without modifications or modality-specific preprocessing.
  arXiv  Detail & Related papers  (2023-05-31T23:18:21Z)
• EC-SfM: Efficient Covisibility-based Structure-from-Motion for Both Sequential and Unordered Images [24.6736600856999]
  This paper presents an efficient covisibility-based incremental SfM for unordered Internet images. We propose a unified framework to efficiently reconstruct sequential images, unordered images, and the mixture of these two. The proposed method is three times faster than the state of the art on feature matching, and an order of magnitude faster on reconstruction without sacrificing the accuracy.
  arXiv  Detail & Related papers  (2023-02-21T09:18:57Z)
• Two-Stream Networks for Object Segmentation in Videos [83.1383102535413]
  We present a Two-Stream Network (TSN) to segment the seen pixels based on their pixellevel memory retrieval. A holistic understanding of the instance is obtained with dynamic segmentation heads conditioned on the features of the target instance. The compact instance stream effectively improves the segmentation accuracy of the unseen pixels, while fusing two streams with the adaptive routing map leads to an overall performance boost.
  arXiv  Detail & Related papers  (2022-08-08T10:22:42Z)
• Transform and Bitstream Domain Image Classification [2.4366811507669124]
  This paper proposes two such methods as a proof of concept. The first classifies within the JPEG image transform domain (i.e. DCT transform data); the second classifies the JPEG compressed binary bitstream directly. Top-1 accuracy of approximately 70% and 60% were achieved when classifying the Caltech C101 database.
  arXiv  Detail & Related papers  (2021-10-13T14:18:58Z)
• byteSteady: Fast Classification Using Byte-Level n-Gram Embeddings [77.6701264226519]
  We introduce byteSteady, a fast model for classification using byte-level n-gram embeddings. A straightforward application of byteSteady is text classification. We also apply byteSteady to one type of non-language data -- DNA sequences for gene classification.
  arXiv  Detail & Related papers  (2021-06-24T20:14:48Z)
• Memory-guided Unsupervised Image-to-image Translation [54.1903150849536]
  We present an unsupervised framework for instance-level image-to-image translation. We show that our model outperforms recent instance-level methods.
  arXiv  Detail & Related papers  (2021-04-12T03:02:51Z)
• Two-stage generative adversarial networks for document image binarization with color noise and background removal [7.639067237772286]
  We propose a two-stage color document image enhancement and binarization method using generative adversarial neural networks. In the first stage, four color-independent adversarial networks are trained to extract color foreground information from an input image. In the second stage, two independent adversarial networks with global and local features are trained for image binarization of documents of variable size.
  arXiv  Detail & Related papers  (2020-10-20T07:51:50Z)
• FeatMatch: Feature-Based Augmentation for Semi-Supervised Learning [64.32306537419498]
  We propose a novel learned feature-based refinement and augmentation method that produces a varied set of complex transformations. These transformations also use information from both within-class and across-class representations that we extract through clustering. We demonstrate that our method is comparable to current state of art for smaller datasets while being able to scale up to larger datasets.
  arXiv  Detail & Related papers  (2020-07-16T17:55:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.