-
Evolution
Evolution Iceberg supports in-place table evolution . You can evolve a table schema just like SQL — even in nested structures — or change partition layout when data volume chang... -
Deployment
Gobblin Execution Modes Overview One important feature of Gobblin is that it can be run on different platforms. Currently, Gobblin can run in standalone mode (which runs on a sing... -
变量管理
背景介绍 创建变量 在Flink SQL中引用变量 在Flink JAR作业的args中引用变量 背景介绍 在实际生产环境中，Flink作业一般很复杂，会依赖多个外部组件，例如，从Kafka中消费数据时要从HBase或Redis中去获取相关数据，然后将关联好的数据写入到外部组件，这样的情况下会导致如下问题： Flink作业想要关联这些组件，需... -
Hive
Hive Connector Integration Dependencies Configurations Hive Connector Operations The Kyuubi Hive Connector is a datasource for both reading and writing Hive table, It is imple... -
Memory Requirements
The Ambari host should have at least 1 GB RAM, with 500 MB free. To check available memory on any host, run: free - m If you plan to install the Ambari Metrics Service (AMS... -
Hive Distcp
Introduction Configure Hive Distcp Job Source and target metastores Database and tables to copy Target path computation Conflicting table and partitions treatment Deregisterin... -
任务定义
批量任务定义 实时任务定义 批量任务定义 批量任务定义允许您在基于任务级别而不是在工作流中操作修改任务。再此之前，我们已经有了工作流级别的任务编辑器，你可以在工作流定义 单击特定的工作流，然后编辑任务的定义。当您想编辑特定的任务定义但不记得它属于哪个工作流时，这是令人沮丧的。所以我们决定在 任务 菜单下添加 任务定义 视图。 在该视图中，... -
Writing ORC Data
Introduction Hive SerDe Integration Writing to an ORC File Data Flow Extending Gobblin’s SerDe Integration Introduction Gobblin is capable of writing data to ORC files by le... -
orm DTD/XSD
JDO defines XML MetaData in jdo files as well as orm files. As always with XML, the metadata must match the defined DTD/XSD for that file type. This section describes the conten... -
Install, Start and Test
Next Step The progress of the install displays on the screen. Ambari installs, starts, and runs a simple test on each component. Overall status of the process displays in progres...
