-
Using Spark
Hudi Streamer Options Using hudi-utilities bundle jars Concurrency Control Checkpointing Transformers SQL Query Transformer SQL File Transformer Flattening Transformer Chai... -
Programming Paradigm
Architecture Programming paradigm DataStream Flink Sql TableEnvironment StreamTableEnvironment RunTime Context StreamingContext TableContext StreamTableContext Life Cycle... -
Detectors
Standard detectors OverridingMethodsMustInvokeSuperDetector FindRoughConstants SynchronizeAndNullCheckField InitializeNonnullFieldsInConstructor BooleanReturnNull OptionalRetu... -
Kyuubi v.s. Spark Thrift JDBC/ODBC Server (STS)
Introductions Barriers to common Spark job usage High Barrier Insecurity Compatibility Bootstrap latency Limitations of Spark ThriftServer Driver Bottleneck Resource isolati... -
Storage
Does Hudi support cloud storage/object stores? What is the difference between copy-on-write (COW) vs merge-on-read (MOR) table types? How do I migrate my data to Hudi? How to co... -
Basic Configurations
Hudi Table Config Hudi Table Basic Configs Spark Datasource Configs Read Options Write Options Flink Sql Configs Flink Options Write Client Configs Common Configurations Me... -
Running SpotBugs
Quick Start Executing SpotBugs Direct invocation of SpotBugs Choosing the User Interface Java Virtual Machine (JVM) arguments Invocation of SpotBugs using a wrapper script Wrap... -
3. Integration with Hive Metastore
Integration with Hive Metastore Requirements Default Behavior Related Configurations Remote Metastore Database Remote Metastore Server Activate Configurations Via kyuubi-defau... -
Docker Demo
A Demo using Docker containers Prerequisites Setting up Docker Cluster Build Hudi Bringing up Demo Cluster Demo Step 1 : Publish the first batch to Kafka Step 2: Incrementall... -
Spark Quick Start
Setup Spark 3 Support Matrix Spark Shell/SQL Setup project Create Table Insert data Query data Update data Merging Data Delete data Time Travel Query Incremental query ...
