English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT

Released

Report

Generalized Nonnegative Matrix Approximations using Bregman Divergences

MPS-Authors
There are no MPG-Authors in the publication available
External Resource
Fulltext (public)
There are no public fulltexts stored in PuRe
Supplementary Material (public)
There is no public supplementary material available
Citation

Dhillon, I., & Sra, S.(2005). Generalized Nonnegative Matrix Approximations using Bregman Divergences (TR-06-27). Austin, TX, USA: Department of Computer Sciences: University of Texas.


Cite as: http://hdl.handle.net/11858/00-001M-0000-0013-D567-3
Abstract
Nonnegative matrix approximation (NNMA) is a recent technique for dimensionality reduction anddata analysis that yields a parts based, sparse nonnegativerepresentation of the nonnegative input data. Dueto these advantages, NNMA has found a wide variety of applications, including text analysis, documentclustering, face/image recognition, language modeling, speech processing and many others. Despite thesenumerous applications, the algorithmic development for computing the NNMA factors has been relativelydeficient. This paper makes algorithmic progress by modeling andsolving(using multiplicative updates)new generalized NNMA problems that minimize Bregman divergences between the input matrix and itslow-rank approximation. The multiplicative update formulae in the pioneering work by Lee and Seung [20]arise as a special case of our algorithms. In addition, the paper shows how to use penalty functions forincorporating constraints other than nonnegativity into the problem. Further, some interesting extensions tothe use of “link” functions for modeling non-linear relationships are also discussed.