Paimon表如何提高读取性能?

提问者:帅平 问题分类:大数据
Paimon表如何提高读取性能?
1 个回答
缝完心脏、一个人活
缝完心脏、一个人活
1、配置full-compaction.delta-commits,这样在写入数据的时候会定期full compaction.
2、配置scan.mode=compacted-full,这样读取数据的时候会选择完全压缩的快照,读取性能良好。
配置上面两个值的案例是:
CREATE TABLE IF NOT EXISTS `user` ( `id` BIGINT, `name` STRING, `area` STRING, PRIMARY KEY ( area, id ) NOT ENFORCED ) PARTITIONED BY ( area ) WITH (
		'bucket' = '3',
		'bucket-key' = 'id',
		'file.format' = 'parquet',
		'merge-engine' = 'deduplicate',
		'changelog-producer' = 'full-compaction',
		'full-compaction.delta-commits' = '30',
	  'scan.mode' = 'compacted-full' 
	);
发布于:2年前 (2023-09-06) IP属地:四川省
我来回答