-
检查 DNS 和 NSCD
系统中的所有主机都必须配置正向和反向 DNS。 如果您无法以这种方式配置 DNS，则应编辑集群中每台主机上的 /etc/hosts 文件，以包含每台主机的 IP 地址和完全限定域名。以下说明作为概述提供，涵盖通用 Linux 主机的基本网络设置。不同版本和风格的 Linux 需要的命令和过程可能略有不同。请参阅您环境中部署的操作系统的文档。 Hadoop... -
Flink DDL
DDL commands CREATE Catalog Hive catalog This creates an Iceberg catalog named hive_catalog that can be configured using 'catalog-type'='hive' , which loads tables from Hive m... -
Home
Over the years, LinkedIn’s data infrastructure team built custom solutions for ingesting diverse data entities into our Hadoop eco-system. At one point, we were running 15 t... -
Queries
Spark Queries To use Iceberg in Spark, first configure Spark catalogs . Iceberg uses Apache Spark’s DataSourceV2 API for data source and catalog implementations. Querying with S... -
Alibaba Cloud
Aliyun OSS configs Aliyun OSS Credentials Aliyun OSS Libs In this page, we explain how to get your Hudi spark job to store into Aliyun OSS. Aliyun OSS configs There are two c... -
Parquet HDFS
Description Usage Example Pipeline Configuration Configuration Developer Notes Description An extension to FsDataWriter that writes in Parquet format in the form of either... -
Google Cloud
GCS Configs GCS Credentials GCS Libs For Hudi storage on GCS, regional buckets provide an DFS API with strong consistency. GCS Configs There are two configurations required ... -
JDBC
Iceberg JDBC Integration JDBC Catalog Iceberg supports using a table in a relational database to manage Iceberg tables through JDBC. The database that JDBC connects to must suppo... -
Tencent Cloud
Tencent Cloud COS configs Tencent Cloud COS Credentials Tencent Cloud COS Libs In this page, we explain how to get your Hudi spark job to store into Tencent Cloud COS. Tencen... -
Baidu Cloud
Baidu BOS configs Baidu BOS Credentials Baidu bos Libs In this page, we explain how to get your Hudi job to store into Baidu BOS. Baidu BOS configs There are two configuratio...
