首页> 外文会议>International conference on very large data bases >NoDB in Action: Adaptive Query Processing on Raw Data
【24h】

NoDB in Action: Adaptive Query Processing on Raw Data

机译:NODB在Action:原始数据的自适应查询处理

获取原文

摘要

As data collections become larger and larger, users are faced with increasing bottlenecks in their data analysis. More data means more time to prepare the data, to load the data into the database and to execute the desired queries. Many applications already avoid using traditional database systems, e.g., scientific data analysis and social networks, due to their complexity and the increased data-to-query time, i.e. the time between getting the data and retrieving its first useful results. For many applications data collections keep growing fast, even on a daily basis, and this data deluge will only increase in the future, where it is expected to have much more data than what we can move or store, let alone analyze. In this demonstration, we will showcase a new philosophy for designing database systems called NoDB. NoDB aims at minimizing the data-to-query time, most prominently by removing the need to load data before launching queries. We will present our prototype implementation, PostgresRaw, built on top of PostgreSQL, which allows for efficient query execution over raw data files with zero initialization overhead. We will visually demonstrate how PostgresRaw incrementally and adaptively touches, parses, caches and indexes raw data files autonomously and exclusively as a side-effect of user queries.
机译:随着数据收集变得更大,更大,用户面临数据分析中的瓶颈增加。更多数据意味着更多的时间准备数据,将数据加载到数据库中并执行所需的查询。许多应用程序已经避免使用传统的数据库系统,例如科学数据分析和社交网络,由于它们的复杂性和增加的数据到查询时间,即获取数据和检索其第一个有用结果之间的时间。对于许多应用程序,数据收集甚至每天都会快速增长,而且此数据迅速只会在未来增加,预计将更多地具有比我们可以移动或存储的数据更多,更不用说。在这次演示中,我们将展示一个新的设计用于设计名为NODB的数据库系统。 NODB旨在最大限度地减少数据到查询时间,最显着的是通过删除在启动查询之前删除数据来加载数据。我们将在PostgreSQL之上提出我们的Prodotype实施,后者,它构建在PostgreSQL之上,这允许通过具有零初始化开销的原始数据文件进行高效的查询执行。我们将在视觉上展示后期牵引和自动触摸,解析,缓存和索引原始数据文件的自主数据文件是如何自主且专门的作为用户查询的副作用。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号