tencent cloud

Elastic MapReduce

DocumentaçãoElastic MapReduceEMR Development GuideSpark Development GuideSpark Integration with Kafka

Spark Integration with Kafka

PDF
Modo Foco
Tamanho da Fonte
Última atualização: 2025-01-03 14:50:17

Dependencies

Starting from v2.3, Spark no longer supports Kafka 0.8.2. As Spark 2.4.3 and later are integrated into EMR in the production environment, you need to integrate Kafka 0.10.0 and later.

How to view

1. Enter the version number in the following URL and open it:
https://spark.apache.org/docs/{spark.version}/streaming-kafka-integration.html
Replace {spark.version} with the actual Spark version. For example, to view the dependencies of v3.2.2, the URL should be as follows:
https://spark.apache.org/docs/3.2.2/streaming-kafka-integration.html
2. Click the appropriate link to view detailed integration instructions.

Anterior: Practices on Dynamic Scheduling of Spark ResourcesPróximo: Spark Dependencies in Each EMR Version

Ajuda e Suporte

Esta página foi útil?

comentários