-
FtpFile
Description Key features Options host [string] port [int] user [string] password [string] path [string] connection_mode [string] custom_filename [boolean] file_name_expres... -
Maintenance
Recommended Maintenance Expire Snapshots Remove old metadata files Delete orphan files Optional Maintenance Compact data files Rewrite manifests Maintenance operations req... -
SftpFile
Description Key features Options host [string] port [int] username [string] password [string] path [string] custom_filename [boolean] file_name_expression [string] filenam... -
SQL Functions
String Functions ASCII CHAR_LENGTH / LENGTH OCTET_LENGTH CONCAT CONCAT_WS HEXTORAW LOWER / LCASE UPPER / UCASE LEFT RIGHT LOCATE / INSTR / POSITION LPAD RPAD LTRIM RT... -
Writes
Writing with SQL INSERT INTO MERGE INTO MERGE INTO syntax INSERT OVERWRITE Overwrite behavior Dynamic overwrite Static overwrite DELETE FROM UPDATE Writing to Branc... -
S3Redshift
Description Key features Options jdbc_url jdbc_user jdbc_password execute_sql path [string] bucket [string] access_key [string] access_secret [string] hadoop_s3_propertie... -
Config File Encryption And Decryption
Introduction How to use How to implement user-defined encryption and decryption Introduction In most production environments, sensitive configuration items such as passwords a... -
SQL Lineage Support
Introduction Example Lineage specific identification SQL type support Query Command Building Build with Apache Maven Build against Different Apache Spark Versions Test with... -
Hive
Description Key features Options table_name [string] metastore_uri [string] hdfs_site_path [string] hive_site_path [string] hive.hadoop.conf [map] hive.hadoop.conf-path [str... -
SQL DML
Spark SQL Insert Into Insert Overwrite Update Merge Into Delete From Data Skipping and Indexing Flink SQL Insert Into Update Delete From Setting Writer/Reader Configs F...
