Stochastic Optimization for Large scale Machine Learning 1st edition by Vinod Kumar Chauhan 9781000505610 1000505618

Stochastic Optimization for Large scale Machine Learning 1st edition by Vinod Kumar Chauhan – Ebook PDF Instant Download/Delivery.9781000505610, 1000505618
Full download Stochastic Optimization for Large scale Machine Learning 1st edition  after payment

Product details:

ISBN 10: 1000505618
ISBN 13: 9781000505610
Author: Vinod Kumar Chauhan

Advancements in the technology and availability of data sources have led to the `Big Data’ era. Working with large data offers the potential to uncover more fine-grained patterns and take timely and accurate decisions, but it also creates a lot of challenges such as slow training and scalability of machine learning models. One of the major challenges in machine learning is to develop efficient and scalable learning algorithms, i.e., optimization techniques to solve large scale learning problems. Stochastic Optimization for Large-scale Machine Learning identifies different areas of improvement and recent research directions to tackle the challenge. Developed optimisation techniques are also explored to improve machine learning algorithms based on data access and on first and second order optimisation methods. Key Features: Bridges machine learning and Optimisation. Bridges theory and practice in machine learning. Identifies key research areas and recent research directions to solve large-scale machine learning problems. Develops optimisation techniques to improve machine learning algorithms for big data problems. The book will be a valuable reference to practitioners and researchers as well as students in the field of machine learning.

Stochastic Optimization for Large scale Machine Learning 1st Table of contents:

CHAPTER 1 ◾ Introduction
1.1 Large-Scale Machine Learning
1.2 Optimization Problems
1.3 Linear Classification
1.3.1 Support Vector Machine (SVM)
1.3.2 Logistic Regression
1.3.3 First and Second Order Methods
1.3.3.1 First Order Methods
1.3.3.2 Second Order Methods
1.4 Stochastic Approximation Approach
1.5 Coordinate Descent Approach
1.6 Datasets
1.7 Organization of Book

CHAPTER 2 ◾ Optimization Problem, Solvers, Challenges and Research Directions
2.1 Introduction
2.1.1 Contributions
2.2 Literature
2.3 Problem Formulations
2.3.1 Hard Margin SVM (1992)
2.3.2 Soft Margin SVM (1995)
2.3.3 One-versus-Rest (1998)
2.3.4 One-versus-One (1999)
2.3.5 Least Squares SVM (1999)
2.3.6 ν-SVM (2000)
2.3.7 Smooth SVM (2001)
2.3.8 Proximal SVM (2001)
2.3.9 Crammer Singer SVM (2002)
2.3.10 Eν-SVM (2003)
2.3.11 Twin SVM (2007)
2.3.12 Capped lp-norm SVM (2017)
2.4 Problem Solvers
2.4.1 Exact Line Search Method
2.4.2 Backtracking Line Search
2.4.3 Constant Step Size
2.4.4 Lipschitz and Strong Convexity Constants
2.4.5 Trust Region Method
2.4.6 Gradient Descent Method
2.4.7 Newton Method
2.4.8 Gauss-Newton Method
2.4.9 Levenberg-Marquardt Method
2.4.10 Quasi-Newton Method
2.4.11 Subgradient Method
2.4.12 Conjugate Gradient Method
2.4.13 Truncated Newton Method
2.4.14 Proximal Gradient Method
2.4.15 Recent Algorithms
2.5 Comparative Study
2.5.1 Results from Literature
2.5.2 Results from Experimental Study
2.5.2.1 Experimental Setup and Implementation Details
2.5.2.2 Results and Discussions
2.6 Current Challenges and Research Directions
2.6.1 Big Data Challenge
2.6.2 Areas of Improvement
2.6.2.1 Problem Formulations
2.6.2.2 Problem Solvers
2.6.2.3 Problem Solving Strategies/Approaches
2.6.2.4 Platforms/Frameworks
2.6.3 Research Directions
2.6.3.1 Stochastic Approximation Algorithms
2.6.3.2 Coordinate Descent Algorithms
2.6.3.3 Proximal Algorithms
2.6.3.4 Parallel/Distributed Algorithms
2.6.3.5 Hybrid Algorithms
2.7 Conclusion

SECTION II: FIRST ORDER METHODS

CHAPTER 3 ◾ Mini-batch and Block-coordinate Approach
3.1 Introduction
3.1.1 Motivation
3.1.2 Batch Block Optimization Framework (BBOF)
3.1.3 Brief Literature Review
3.1.4 Contributions
3.2 Stochastic Average Adjusted Gradient (SAAG) Methods
3.3 Analysis
3.4 Numerical Experiments
3.4.1 Experimental Setup
3.4.2 Convergence against Epochs
3.4.3 Convergence against Time
3.5 Conclusion and Future Scope

CHAPTER 4 ◾ Variance Reduction Methods
4.1 Introduction
4.1.1 Optimization Problem
4.1.2 Solution Techniques for Optimization Problem
4.1.3 Contributions
4.2 Notations and Related Work
4.2.1 Notations
4.2.2 Related Work
4.3 SAAG-I, II and Proximal Extensions
4.4 SAAG-III and IV Algorithms
4.5 Analysis
4.6 Experimental Results
4.6.1 Experimental Setup
4.6.2 Results with Smooth Problem
4.6.3 Results with Non-smooth Problem
4.6.4 Mini-batch Block-coordinate vs Mini-batch Setting
4.6.5 Results with SVM
4.7 Conclusion

CHAPTER 5 ◾ Learning and Data Access
5.1 Introduction
5.1.1 Optimization Problem
5.1.2 Literature Review
5.1.3 Contributions
5.2 Systematic Sampling
5.2.1 Definitions
5.2.2 Learning Using Systematic Sampling
5.3 Analysis
5.4 Experiments
5.4.1 Experimental Setup
5.4.2 Implementation Details
5.4.3 Results
5.5 Conclusion

SECTION III: SECOND ORDER METHODS

CHAPTER 6 ◾ Mini-batch Block-coordinate Newton Method
6.1 Introduction
6.1.1 Contributions
6.2 MBN
6.3 Experiments
6.3.1 Experimental Setup
6.3.2 Comparative Study
6.4 Conclusion

CHAPTER 7 ◾ Stochastic Trust Region Inexact Newton Method
7.1 Introduction
7.1.1 Optimization Problem
7.1.2 Solution Techniques
7.1.3 Contributions
7.2 Literature Review
7.3 Trust Region Inexact Newton Method
7.3.1 Inexact Newton Method
7.3.2 Trust Region Inexact Newton Method
7.4 STRON
7.4.1 Complexity
7.4.2 Analysis
7.5 Experimental Results
7.5.1 Experimental Setup
7.5.2 Comparative Study
7.5.3 Results with SVM
7.6 Extensions
7.6.1 PCG Subproblem Solver
7.6.2 Stochastic Variance Reduced Trust Region Inexact Newton Method
7.7 Conclusion

SECTION IV: CONCLUSION

CHAPTER 8 ◾ Conclusion and Future Scope
8.1 Future Scope

People also search for Stochastic Optimization for Large scale Machine Learning 1st :

full stochastic vs slow stochastic
    
what is stochastic optimization
    
stochastic optimization for large-scale optimal transport
    
stochastic optimization machine learning