首页>
外国专利>
Scalable and efficient distributed auto-tuning of machine learning and deep learning models
Scalable and efficient distributed auto-tuning of machine learning and deep learning models
展开▼
机译:可扩展高效的机器学习和深度学习模型的分布式自动调整
展开▼
页面导航
摘要
著录项
相似文献
摘要
Herein are techniques for automatic tuning of hyperparameters of machine learning algorithms. System throughput is maximized by horizontally scaling and asynchronously dispatching the configuration, training, and testing of an algorithm. In an embodiment, a computer stores a best cost achieved by executing a target model based on best values of the target algorithm's hyperparameters. The best values and their cost are updated by epochs that asynchronously execute. Each epoch has asynchronous costing tasks that explore a distinct hyperparameter. Each costing task has a sample of exploratory values that differs from the best values along the distinct hyperparameter. The asynchronous costing tasks of a same epoch have different values for the distinct hyperparameter, which accomplishes an exploration. In an embodiment, an excessive update of best values or best cost creates a major epoch for exploration in a subspace that is more or less unrelated to other epochs, thereby avoiding local optima.
展开▼