Meta Store

This section describes the openLooKeng meta store. Meta store is used to store metadata. Meta store supports to store metadata in the RDBMS or HDFS.

Configuring Meta Store

Create the meta store property file etc/hetu-metastore.properties first.

RDBMS Storage

Add the following contents in hetu-metastore.properties:

hetu.metastore.type=jdbc
hetu.metastore.db.url=jdbc:mysql://....
hetu.metastore.db.user=root
hetu.metastore.db.password=123456
hetu.metastore.cache.type=local

The above properties are described below:

  • hetu.metastore.type:The type of meta store, set jdbc to use RDBMS storage.
  • hetu.metastore.db.url:URL of RDBMS to connect to.
  • hetu.metastore.db.user :User name of RDBMS to connect to.
  • hetu.metastore.db.password :Password of RDBMS to connect to.
  • hetu.metastore.cache.type : Select the cache model, where local is the local cache and global is the distributed cache.

HDFS Storage

Add the following contents in hetu-metastore.properties:

hetu.metastore.type=hetufilesystem
hetu.metastore.hetufilesystem.profile-name=hdfs-config-metastore
hetu.metastore.hetufilesystem.path=/etc/openlookeng/metastore

The above properties are described below:

  • hetu.metastore.type:The type of meta store, set hetufilesystem to use HDFS storage.
  • hetu.metastore.hetufilesystem.profile-name:The profile name of file system.
  • hetu.metastore.hetufilesystem.path:The path of metastore storage in the file system.

Meta Store Cache

openLooKeng can be configured to enable metadata caching. After the metadata caching is enabled, metadata will be cached in the memory to improve access efficiency for the next access.

Add the following contents in hetu-metastore.properties:

hetu.metastore.cache.size=10000
hetu.metastore.cache.ttl=4h     

The above properties are described below:

  • hetu.metastore.cache.size:Set the max metastore cache size, default value 10000.
  • hetu.metastore.cache.ttl:Set ttl for metastore cache, default value 0 (metadata caching is disabled).

有奖捉虫

“有虫”文档片段

0/500

存在的问题

文档存在风险与错误

● 拼写,格式,无效链接等错误;

● 技术原理、功能、规格等描述和软件不一致,存在错误;

● 原理图、架构图等存在错误;

● 版本号不匹配:文档版本或内容描述和实际软件不一致;

● 对重要数据或系统存在风险的操作,缺少安全提示;

● 排版不美观,影响阅读;

内容描述不清晰

● 描述存在歧义;

● 图形、表格、文字等晦涩难懂;

● 逻辑不清晰,该分类、分项、分步骤的没有给出;

内容获取有困难

● 很难通过搜索引擎,openLooKeng官网,相关博客找到所需内容;

示例代码有错误

● 命令、命令参数等错误;

● 命令无法执行或无法完成对应功能;

内容有缺失

● 关键步骤错误或缺失,无法指导用户完成任务,比如安装、配置、部署等;

● 逻辑不清晰,该分类、分项、分步骤的没有给出

● 图形、表格、文字等晦涩难懂

● 缺少必要的前提条件、注意事项等;

● 描述存在歧义

0/500

您对文档的总体满意度

非常不满意
非常满意

请问是什么原因让您参与到这个问题中

您的邮箱

创Issue赢奖品
根据您的反馈,会自动生成issue模板。您只需点击按钮,创建issue即可。
有奖捉虫