Brett W. Bader

Brett W. Bader

Address

Brett W. Bader

Senior Member of Technical Staff

Data Analysis and Informatics Department

Sandia National Laboratories

P.O. Box 5800

Albuquerque, NM 87185-1318

Phone:     505-845-0514
Fax:       505-845-7442
Email:     bwbader@sandia.gov
WWW:       http://www.sandia.gov/~bwbader/

Professional Background

I started at Sandia National Laboratories in 2003 after earning a Ph.D. from the University of Colorado at Boulder under the guidance of Bobby Schnabel. I was awarded the John von Neumann postdoctoral research fellowship at Sandia in 2003, which funded my research in a variety of areas, including algorithms for nonlinear equations that incorporate higher-order tensors, multilinear algebra techniques applied to informatics, and reduced order modeling aimed at online optimal control. In 2005, I was promoted to Senior Member of Technical Staff. More on my background... See full CV...

Research Interests

Overall theme: Computational methods from the areas of multilinear algebra, machine learning, and optimization and their application to informatics, data mining, and engineering problems.

Tensor (or multiway array) decompositions
PARAFAC, Tucker, DEDICOM, orthogonal decompositions, higher-order SVD (HOSVD)
Informatics and machine learning

Text analysis
Multilingual document clustering, cross-language information retrieval, higher-order variants of latent semantic analysis (LSA), sentiment analysis, part of speech tagging
Social network analysis
Community finding, semantic graphs, pattern detection, time graphs, collaborative filtering
Anomaly and pattern detection
Heterogenous data, temporal data
Image analysis
Hyperspectral and multispectral image analysis, remote sensing

Iterative methods for large-scale problems:

Nonlinear equations
Newton's method, tensor methods, quasi-Newton methods
Linear systems
Krylov subspace methods for linear systems, GMRES
Optimization
Unconstrained and constrained minimization, PDE-constrained optimization, limited-memory quasi-Newton methods (e.g., BFGS)
Reduced-order modeling
Proper orthogonal decomposition (POD), Krylov subspace techniques, optimization and optimal control

Computational biology
Protein structure prediction
Software engineering
Object-oriented software framework development, configuration management tools

Current and Recent Projects

Networks Grand Challenge

Data mining using tensor decompositions

MATLAB Tensor Toolbox

Data mining reading group (Sandia link only)

Reduced-order modeling for real-time optimal control

NOX: an object-oriented nonlinear solvers package

Trilinos: solver framework

Selected Publications

See the complete list of abstracts

An information-theoretic, vector-space-model approach to cross-language information retrieval, Peter A. Chew, Brett W. Bader, Stephen Helmreich, Ahmed Abdelali, and Stephen J. Verzi, Natural Language Engineering, 17(1):37-70, 2011.
Tensor decompositions and applications, Tamara G. Kolda and Brett W. Bader, SIAM Review 51(3):455-500, Sep. 2009.
Scenario detection using nonnegative tensor factorization, Brett Bader, Andrey Puretskiy, and Michael Berry, invited paper to The 13th Iberoamerican Congress on Pattern Recognition (CIARP) 2008.
Enhancing multilingual latent semantic analysis with term alignment information, Brett Bader and Peter Chew, in The 22nd International Conference on Computational Linguistics (COLING) 2008.
Latent morpho-semantic analysis: multilingual information retrieval with character n-grams and mutual information, Peter Chew, Brett Bader, and Amed Abdelali, in The 22nd International Conference on Computational Linguistics (COLING) 2008.
The Knowledge of Good and Evil: Multilingual Ideology Classification with PARAFAC2 and Machine Learning, Peter Chew, Philip Kegelmeyer, Brett Bader, and Ahmed Abdelali, in The 9th International Conference on Intelligent Text Processing and Computational Linguistics (CICLing) 2008, also published in J. Language Forum, 2008.
Efficient MATLAB computations with sparse and factored tensors, Brett W. Bader and Tamara G. Kolda, SIAM J. Scientific Computing, 30(1):205-231, December 2007.
Temporal analysis of semantic graphs using ASALSAN, Brett W. Bader, Richard A. Harshman, and Tamara G. Kolda, In ICDM 2007: Proceedings of the 7th IEEE International Conference on Data Mining, October 2007.
Discussion tracking in Enron email using PARAFAC, Brett W. Bader, Michael W. Berry, and Murray Browne, In Text Mining 2007, Workshop at the SIAM International Conference on Data Mining, April 2007.
Cross-language information retrieval using PARAFAC2, Peter A. Chew, Brett W. Bader, Tamara G. Kolda, and Ahmed Abdelali, In KDD 2007: Proceedings of the 13th ACM SIGKDD International Conference on Data Mining, August 2007.
Temporal analysis of social networks using three-way DEDICOM, Brett W. Bader, Richard A. Harshman, and Tamara G. Kolda, Technical report SAND2006-2161, April 2006.
The TOPHITS model for higher-order web link analysis, Tamara G. Kolda and Brett W. Bader, In proceedings of Workshop on Link Analysis, Counterterrorism and Security, 2006.
Higher-order web link analysis using multilinear algebra, Tamara G. Kolda, Brett W. Bader, and Joseph P. Kenny, In ICDM 2005: Proceedings of the 5th IEEE International Conference on Data Mining, November 2005.
On the performance of tensor methods for solving ill-conditioned problems, Brett W. Bader and Robert B. Schnabel, SIAM J. Scientific Computing, 2007.
Tensor-Krylov methods for solving large-scale systems of nonlinear equations, Brett W. Bader, SIAM J. Numerical Analysis, 2005.
MATLAB Tensor Classes for Fast Algorithm Prototyping, Brett W. Bader and Tamara G. Kolda, Technical Report SAND2004-5187, October 2004.
A Preliminary Report on the Development of MATLAB Tensor Classes for Fast Algorithm Prototyping, Brett W. Bader and Tamara G. Kolda, Technical Report SAND 2004-3487, July 2004.
An Optimization approach to the problem of protein structure prediction, Elizabeth Eskow, Brett Bader, Richard Byrd, Silvia Crivelli, Teresa Head-Gordon, Vincent Lamberti and Robert Schnabel, Mathematical Programming, 101(3):497-514, 2004.
Curvilinear linesearch for tensor methods, Brett W. Bader and Robert B. Schnabel, SIAM J. Scientific Computing (Copper Mountain special issue), 25(2):604-622, 2003.
Fluid mechanics, cell distribution, and environment in CellCube bioreactors, John G. Aunins, Brett Bader, Anthony Caola, Janet Griffiths, Maayan Katz, Peter Licari, Kripa Ram, Colette S. Ranucci, and Weichang Zhou, Biotechnology Progress, 19(1):2-8, 2003.
A Physical approach to protein structure prediction, Silvia Crivelli, Elizabeth Eskow, Brett Bader, Vincent Lamberti, Richard Byrd, Robert Schnabel, and Teresa Head-Gordon, Biophysical J., 82:36-49, 2002.
Lysophosphatidylcholine and arachidonic acid are required in the cytotoxic response of human natural killer cells to tumor target cells, Margaret M. Whalen, Rashmi N. Doshi, Brett W. Bader, and Arthur D. Bankhurst, Cellular Physiology and Biochemistry, 9(6):297-309, 1999.

Selected Presentations

See my complete list of presentations

Algebraic Techniques for Multilingual Document Clustering, Invited seminar at Google, Mountain View, CA, January 25, 2011 and LLNL, Livermore, CA, January 26, 2011. (Video of presentation at Google)
Algebraic Techniques for Multilingual Document Clustering, Keynote talk at Text Mining 2009, Workshop at the SIAM International Conference on Data Mining, Reno, NV, May 2, 2009.
Unusual Tensor Decompositions for Informatics Applications, Invited talk at NSF workshop: Future Directions in Tensor-based Computation and Modeling, Arlington, VA, February 20-21, 2009.
Analysis of Latent Relationships in Semantic Graphs using DEDICOM, Invited talk at the Workshop on Algorithms for Modern Massive Data Sets, 2006
A Tensor Method for Solving Large-Scale Systems of Nonlinear Equations, Contributed talk at SIAM Annual Meeting 2004
A Comparison of Iterative Tensor Methods for Solving Large Systems of Nonlinear Equations, Contributed talk at Copper Mountain Conference on Iterative Methods 2004
Tensor-Krylov methods for solving large-scale systems of nonlinear equations, Contributed talk at CASC Workshop 2003

Conference Schedule

SIAM International Conference on Data Mining, Mesa, AZ, April 28-30, 2011.
SIAM Annual Meeting, Pittsburgh, PA, July 12-16, 2010.
AIM Workshop: Computational optimization for tensor decompositions, American Institute of Mathematics, Palo Alto, CA, March 29-April 2, 2010.
SIAM Conference on Parallel Processing for Scientific Computing, Seattle, WA, February 24-26, 2010.
SIAM Annual Meeting, Denver, CO, July 6-10, 2009.
Three-way Methods in Chemistry and Psychology (TRICAP 2009), Spain, June 14-19, 2009.
North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL HLT) 2009 conference, Boulder, CO, May 31-June 5, 2009.
Text Mining 2009, Workshop at the SIAM International Conference on Data Mining, Reno, NV, May 2, 2009.
NSF workshop: Future Directions in Tensor-based Computation and Modeling, Arlington, VA, February 20-21, 2009.
COLING 2008: The 22nd International Conference on Computational Linguistics, Manchester, UK, August 18-22, 2008.
SIAM Annual Meeting, San Diego, CA, July 7-11, 2008.
28th Annual CNLS Conference: Information Science and Technology, Santa Fe, NM, May 12-16, 2008.
ICDM 2007: IEEE International Conference on Data Mining, Omaha, Nebraska, October 28-31, 2007.
ICIAM 2007: 6th International Congress on Industrial and Applied Mathematics, Zurich, Switzerland, July 16-20, 2007.
SIAM International Conference on Data Mining, Minneapolis, MN, April 26-28, 2007.
MMDS 2006. Workshop on Algorithms for Modern Massive Data Sets, Stanford University and Yahoo! Research, June 21-24, 2006.
Three-way Methods in Chemistry and Psychology (TRICAP 2006), Chania, Crete, Greece, June 4-9, 2006.

Educational and Professional Background

My college education started at MIT, where I earned a B.S. and M.S in Chemical Engineering. After graduation, I started at the Dow Chemical Company where I worked on an on-line, real-time computational model of an ethylene plant for optimizing economic performance. That work inspired my interest in numerical methods and precipitated my return to graduate school. I enrolled in the Ph.D. program of the Department of Computer Science at the University of Colorado at Boulder. I initially worked for Richard Byrd and Bobby Schnabel on a project involving large-scale, global optimization of protein conformations - the so-called "protein folding" problem. Our research aimed at deriving the native protein structure by finding the global minimizer of physics-based computational model of the protein (i.e., a potential energy function). My Ph.D. thesis topic concerned the development of three "tensor-Krylov" methods for solving large-scale systems of nonlinear equations. These methods are based on including limited second-order information via a rank-1 tensor and perform well on ill-conditioned and singular problems. I earned my Ph.D. in 2003 under the guidance of Bobby Schnabel. Thereafter, I joined the staff of Sandia National Laboratories, where I was awarded the John von Neumann postdoctoral research fellowship. My research at Sandia has covered a variety of areas that stem from my interest in algorithms and higher-order methods. In September of 2005, I was promoted to Senior Member of Technical Staff in the Applied Computational Methods department. With subsequent internal reorganizations, I am currently in the department of Data Analysis and Informatics.