Skip to main content
eScholarship
Open Access Publications from the University of California

Scholarly Works (10 results)

  • Thesis
  • Peer Reviewed
UCLA Electronic Theses and Dissertations (2015)

We present several graph-based algorithms for image processing and classification of high- dimensional data. The first (semi-supervised) method uses a graph adaptation of the classical numerical Merriman-Bence-Osher (MBO) scheme, and can be extended to the multiclass case via the Gibbs simplex. We show examples of the application of the algorithm in the areas of image inpainting (both binary and grayscale), image segmentation and classification on benchmark data sets. We have also applied this algorithm to the problem of object detection using hyperspectral video sequences as a data set. In addition, a second related model is introduced. It uses a diffuse interface model based on the Ginzburg-Landau functional, related to total variation compressed sensing and image processing. A multiclass extension is introduced using the Gibbs simplex, with the functional’s double-well potential modified to handle the multiclass case. The version minimizes the functional using a convex splitting numerical scheme. In our computations, we make use of fast numerical solvers for finding the eigenvectors and eigenvalues of the graph Laplacian, and take advantage of the sparsity of the matrix. Experiments on benchmark data sets show that our models produce results that are comparable with or outperform the state-of-the-art algorithms. The second (semi-supervised) method develops a global minimization framework for binary classification of high-dimensional data. It combines recent convex optimization methods for image processing with recent graph based variational models for data segmentation. Two convex splitting algorithms are proposed, where graph-based PDE techniques are used to solve some of the subproblems. It is shown that global minimizers can be guaranteed for semi-supervised segmentation with two regions. If constraints on the volume of the regions are incorporated, global minimizers cannot be guaranteed, but can often be obtained in practice and otherwise be closely approximated. We perform a thorough comparison to recent MBO (Merriman-Bence-Osher) and phase field methods, and show the advantage of the proposed algorithms. Lastly, we present the current work (unsupervised method) related to normalized cuts. The method uses a clever alternative to the normalized cut to solve the binary classification problem. In particular, we work with the Ginzburg-Landau functional. In addition, we use a generalized graphical framework, so several different graph Laplacians are tested and their results are compared.

    Cover page: Variational and PDE-based methods for big data analysis, classification and image processing using graphs
    • Article
    • Peer Reviewed
    UCLA Previously Published Works (2018)
      Cover page: A semi-supervised heat kernel pagerank MBO algorithm for data classification
      • Article
      • Peer Reviewed
      UCLA Previously Published Works (2014)
      © 2014 IEEE. We consider the challenge of detection of chemical plumes in hyperspectral image data. Segmentation of gas is difficult due to the diffusive nature of the cloud. The use of hyperspectral imagery provides non-visual data for this problem, allowing for the utilization of a richer array of sensing information. In this paper, we present a method to track and classify objects in hyperspectral videos. The method involves the application of a new algorithm recently developed for high dimensional data. It is made efficient by the application of spectral methods and the Nyström extension to calculate the eigenvalues/eigenvectors of the graph Laplacian. Results are shown on plume detection in LWIR standoff detection.
        • Article
        • Peer Reviewed
        UCLA Previously Published Works (2013)
        In this paper we present a computationally efficient algorithm utilizing a fully or seminonlocal graph Laplacian for solving a wide range of learning problems in binary data classification and image processing. In their recent work [Multiscale Model. Simul., 10 (2012), pp. 1090--1118], Bertozzi and Flenner introduced a graph-based diffuse interface model utilizing the Ginzburg--Landau functional for solving problems in data classification. Here, we propose an adaptation of the classic numerical Merriman--Bence--Osher (MBO) scheme for minimizing graph-based diffuse interface functionals, like those originally proposed by Bertozzi and Flenner. We also make use of fast numerical solvers for finding eigenvalues and eigenvectors of the graph Laplacian. Various computational examples are presented to demonstrate the performance of our algorithm, which is successful on images with texture and repetitive structure due to its nonlocal nature. The results show that our method is multiple times more efficient than other well-known nonlocal models. © 2013 Society for Industrial and Applied Mathematics.
          Cover page: An MBO Scheme on Graphs for Classification and Image Processing
          • Article
          • Peer Reviewed
          UCLA Previously Published Works (2014)
            Cover page: Global Binary Optimization on Graphs for Classification of High Dimensional Data
            • Article
            • Peer Reviewed
            UCLA Previously Published Works (2017)
            Hyperspectral imagery is a challenging modality due to the dimension of the pixels which can range from hundreds to over a thousand frequencies depending on the sensor. Most methods in the literature reduce the dimension of the data using a method such as principal component analysis, however this procedure can lose information. More recently methods have been developed to address classification of large datasets in high dimensions. This paper presents two classes of graph-based classification methods for hyperspectral imagery. Using the full dimensionality of the data, we consider a similarity graph based on pairwise comparisons of pixels. The graph is segmented using a pseudospectral algorithm for graph clustering that requires information about the eigenfunctions of the graph Laplacian but does not require computation of the full graph. We develop a parallel version of the Nyström extension method to randomly sample the graph to construct a low rank approximation of the graph Laplacian. With at most a few hundred eigenfunctions, we can implement the clustering method designed to solve a variational problem for a graph-cut-based semi-supervised or unsupervised classification problem. We implement OpenMP directive-based parallelism in our algorithms and show performance improvement and strong, almost ideal, scaling behavior. The method can handle very large datasets including a video sequence with over a million pixels, and the problem of segmenting a data set into a pre-determined number of classes.
              • Article
              • Peer Reviewed
              UCLA Previously Published Works (2017)
                Cover page: Modified Cheeger and ratio cut methods using the Ginzburg–Landau functional for classification of high-dimensional data
                • Article
                • Peer Reviewed
                UCLA Previously Published Works (2015)
                © 2015 Springer Science+Business Media New York This work develops a global minimization framework for segmentation of high-dimensional data into two classes. It combines recent convex optimization methods from imaging with recent graph- based variational models for data segmentation. Two convex splitting algorithms are proposed, where graph-based PDE techniques are used to solve some of the subproblems. It is shown that global minimizers can be guaranteed for semi-supervised segmentation with two regions. If constraints on the volume of the regions are incorporated, global minimizers cannot be guaranteed, but can often be obtained in practice and otherwise be closely approximated. Experiments on benchmark data sets show that our models produce segmentation results that are comparable with or outperform the state-of-the-art algorithms. In particular, we perform a thorough comparison to recent MBO (Merriman–Bence–Osher, AMS-Selected Lectures in Mathematics Series: Computational Crystal Growers Workshop, 1992) and phase field methods, and show the advantage of the algorithms proposed in this paper.
                  Cover page: Global Binary Optimization on Graphs for Classification of High-Dimensional Data
                  • Article
                  • Peer Reviewed
                  UCLA Previously Published Works (2014)
                  We present two graph-based algorithms for multiclass segmentation of high-dimensional data on graphs. The algorithms use a diffuse interface model based on the Ginzburg-Landau functional, related to total variation and graph cuts. A multiclass extension is introduced using the Gibbs simplex, with the functional's double-well potential modified to handle the multiclass case. The first algorithm minimizes the functional using a convex splitting numerical scheme. The second algorithm uses a graph adaptation of the classical numerical Merriman-Bence-Osher (MBO) scheme, which alternates between diffusion and thresholding. We demonstrate the performance of both algorithms experimentally on synthetic data, image labeling, and several benchmark data sets such as MNIST, COIL and WebKB. We also make use of fast numerical solvers for finding the eigenvectors and eigenvalues of the graph Laplacian, and take advantage of the sparsity of the matrix. Experiments indicate that the results are competitive with or better than the current state-of-the-art in multiclass graph-based segmentation algorithms for high-dimensional data.
                    Cover page: Multiclass Data Segmentation Using Diffuse Interface Methods on Graphs
                    • Article
                    • Peer Reviewed
                    UCLA Previously Published Works (2014)
                    We present two graph-based algorithms for multiclass segmentation of high-dimensional data, motivated by the binary diffuse interface model. One algorithm generalizes Ginzburg-Landau (GL) functional minimization on graphs to the Gibbs simplex. The other algorithm uses a reduction of GL minimization, based on the Merriman-Bence-Osher scheme for motion by mean curvature. These yield accurate and efficient algorithms for semi-supervised learning. Our algorithms outperform existing methods, including supervised learning approaches, on the benchmark datasets that we used. We refer to Garcia-Cardona (2014) for a more detailed illustration of the methods, as well as different experimental examples. © 2014 Elsevier Ltd. All rights reserved.
                      Cover page: Diffuse interface methods for multiclass segmentation of high-dimensional data
                      Top