Engine Kernel Version

Baixar

Modo Foco

Tamanho da Fonte

Última atualização: 2026-05-15 15:50:52

DLC offers different kernel versions for various application scenarios, and has made extensive optimizations in features and performance for the kernel. An overview of the kernel versions is as follows.
For scenarios mainly involving interactive queries, we recommend using the Presto Engine, the SparkSQL Engine, and the latest kernel versions.
For scenarios primarily using batch jobs, we recommend using the Spark Job Engine and the Spark 3.2 Kernel Version.
Note:
The Presto engine has been deprecated and is only available for existing users.
 Engine types
Kernel Version
Description
Presto
SuperSQL-P 1.0
Based on the native Presto 0.242 version, it supports dynamic loading of data sources, Dymanic Filter enhancement, Iceberg V2 table, INSERT OVERWRITE of non-partitioned tables, and Hive UDF execution.
SparkSQL
SuperSQL-S 1.0
It is implemented based on the original Spark3.2 version and supports Iceberg 1.1.0, Hudi 0.12.0 and adaptive Shuffle Manager on this basis.
﻿
SuperSQL-S 3.5
It is implemented based on the native Spark3.5 version, and supports Iceberg 1.5.0 and adaptive Shuffle Manager on this basis.
The current beta version is backward compatible with various SQL and data governance tasks of SuperSQL-S 1.0, providing a performance improvement of more than 33% over the S1.0 version.
SparkBatch
Spark 3.5
It is implemented based on the native Spark3.5 version, and supports Iceberg 1.5.0, Python3 and adaptive Shuffle Manager on this basis.
The current beta version is backward compatible with various SQL, jar, pyspark and data governance tasks of Spark 3.2, with a performance improvement of more than 33% over Spark 3.2.
﻿
Spark 3.2
It is implemented based on the original Spark3.2 version, which supports Iceberg 1.1.0, Hudi 0.12.0, Python3, and adaptive Shuffle Manager.
﻿
Spark 2.4
It is implemented based on the native Spark2.4 version, and supports Iceberg 0.13.1, Python2 and Python3 on this basis.
﻿

Ajuda e Suporte

Esta página foi útil?

Você também pode entrar em contato com a Equipe de vendas ou Enviar um tíquete em caso de ajuda.

comentários

tencent cloud

Data Lake Compute

Engine Kernel Version

Ajuda e Suporte

Engine types	Kernel Version	Description
Presto	SuperSQL-P 1.0	Based on the native Presto 0.242 version, it supports dynamic loading of data sources, Dymanic Filter enhancement, Iceberg V2 table, INSERT OVERWRITE of non-partitioned tables, and Hive UDF execution.
SparkSQL	SuperSQL-S 1.0	It is implemented based on the original Spark3.2 version and supports Iceberg 1.1.0, Hudi 0.12.0 and adaptive Shuffle Manager on this basis.
SparkSQL		SuperSQL-S 3.5	It is implemented based on the native Spark3.5 version, and supports Iceberg 1.5.0 and adaptive Shuffle Manager on this basis. The current beta version is backward compatible with various SQL and data governance tasks of SuperSQL-S 1.0, providing a performance improvement of more than 33% over the S1.0 version.
SparkBatch	Spark 3.5	It is implemented based on the native Spark3.5 version, and supports Iceberg 1.5.0, Python3 and adaptive Shuffle Manager on this basis. The current beta version is backward compatible with various SQL, jar, pyspark and data governance tasks of Spark 3.2, with a performance improvement of more than 33% over Spark 3.2.
		Spark 3.2	It is implemented based on the original Spark3.2 version, which supports Iceberg 1.1.0, Hudi 0.12.0, Python3, and adaptive Shuffle Manager.
		Spark 2.4	It is implemented based on the native Spark2.4 version, and supports Iceberg 0.13.1, Python2 and Python3 on this basis.