Over the years, LinkedIn’s data infrastructure team built custom solutions for ingesting diverse data entities into our Hadoop eco-system. At one point, we were running 15 t...
Description Options include_kinds [array] exclude_kinds [array] common options [string] Examples FilterRowKind transform plugin Description Filter the data by RowKind ...
Custom Catalog It’s possible to read an iceberg table either from an hdfs path or from a hive table. It’s also possible to use a custom metastore in place of hive. The steps to do...
Introduction to EventMesh Features Introduction to EventMesh Apache EventMesh is a fully serverless platform used to build distributed event-driven applications. ...
Partitioning What is partitioning? Partitioning is a way to make queries faster by grouping similar rows together when writing. For example, queries for log entries from a logs ...