Update | Description | Release Date | Documentation |
Data Exploration | New Data Exploration Feature | 2026-07-10 | |
Security Group | Clusters support binding to security groups. | 2026-07-10 |
Update | Description | Release Date | Documentation |
Permission Policy Optimization | Add permission policy | 2026-06-19 | |
Custom Credentials | Variable assignment supports custom credentials. | 2026-06-19 |
Update | Description | Release Date | Documentation |
Multi-catalog support | A single job supports using multiple catalogs. | 2026-05-14 | |
Setats UI access policy | Configure the access policy for Setats UI. | 2026-05-14 | |
UDF functions | Improvements to built-in UDF functions | 2026-05-14 | - |
Adjustment of the default Flink version | The default version for new clusters is adjusted to Flink1.16. | 2026-05-14 | - |
Update | Description | Release Date | Documentation |
Variable optimization | Supports variable substitution in global SQL. | 2026-04-17 | |
Kafka Connector optimization | Kafka Connector supports header message filtering. | 2026-04-17 | |
Redis optimization | The Redis Connector supports reading Hash data structures such as hget. | 2026-04-17 | |
TDSQL-MySQL optimization | TDSQL-MySQL supports op_type. | 2026-04-17 |
Update | Description | Release Date | Documentation |
Stream Lake Engine Setats | Launch of the Stream Lake Engine Setats service | 2026-03-26 |
Update | Description | Release Date | Documentation |
Status Overview Optimization | The status overview page has been adjusted for the background, layout, operator chain, recovery button, and more. | 2026-02-28 | - |
Support for Paimon Catalog | Added support for Paimon Catalog management | 2026-02-28 | |
Support for Paimon Connector | Added support for the data lake Paimon Connector | 2026-02-28 | |
English Version of the Operation Interface | The China site now supports an English version of the operation interface. | 2026-02-28 | - |
Support for Multiple JDK Versions | Flink 1.16 version supports JDK 11. | 2026-02-28 | - |
Job Ops Optimization | The job Ops page has added metrics, supporting records per second in and records per second out. | 2026-02-28 | - |
Update | Description | Release Date | Documentation |
Configuration Management Added | Supports defining default values for job parameters at the space dimension. | 2025-12-22 | |
Job Status Overview Added | Display information such as job status, number of restarts, and runtime. Display the operator DAG graph, and you can expand it to view operator details. | 2025-12-22 | |
Function Management Added | Unified management of user-defined functions (UDF) | 2025-12-22 |
Update | Description | Release Date | Documentation |
Modified default retention policy for job snapshots. | Changed the default policy to RETAIN_ON_SUCCESS. | 2025-09-16 | |
Support for five-level domain names | Compute clusters support five-level domain names. | 2025-09-16 | |
Optimized dependency management | Supports batch deletion of multiple versions of dependency files. | 2025-09-16 | |
Optimized the ES connector | Supports specifying the shard routing field: routing-key. | 2025-09-16 | |
Variable optimization | Variable compatibility is optimized to support referencing variables without the need to additionally fill in the default value mode. | 2025-09-16 |
Update | Description | Release Date | Documentation |
Optimized cluster creation | Subnets are automatically associated with the correct AZ during cluster creation. | 2025-07-21 | |
Job Management Optimization | The logic for modifying job parameters is optimized, allowing parameters to be modified even when there is a syntax error. | 2025-07-21 | |
MySQL Catalog Support Optimization | MySQL Catalog supports Projection Push Down. | 2025-07-21 | - |
Optimized the DLC Connector | Pyflink supports connecting to DLC tables. | 2025-07-21 | |
Optimized the HBase Connector | The HBase Connector supports the 'sink.ignore-null-value' parameter. | 2025-07-21 |
Update | Description | Release Date | Documentation |
Session Cluster Debugging Optimization | Session cluster debugging needs to support enabling Kerberos. | 2025-06-12 | |
Job Management Optimization | After a new version of a job is created, a new version reminder is added upon startup. For example, if there are three versions and the online version is V2, clicking Start prompts that the online version runs by default, while the current latest version is V3. The job creation process is optimized. You can create a job normally even when the selected cluster resources are full. | 2025-06-12 | |
Support for Flink 1.20 version. | Support for Flink 1.20 version in jobs. | 2025-06-12 |
Update | Description | Release Date | Documentation |
Optimizations related to MongoDB | Supports upsert when data is written to TencentDB for MongoDB via real-time CDC | 2025-04-28 | |
Optimized the Hive connector | Support for Hive connector 3.1.3 in Flink versions 1.13-1.18. | 2025-04-28 | |
Supported code search feature. | Supports searching via code, such as table names, fields, and keywords, facilitating the discovery of potentially related processing logic among numerous jobs and simplifying job lookup. | 2025-04-28 | |
Optimized the job deletion process | Adds a secondary confirmation step to the job deletion process to prevent accidental deletion by users. | 2025-04-28 | |
Optimized the job management experience | Optimize the error prompt when a draft is published. Not only should the SQL job bar be highlighted in red, but a pop-up prompt should also appear. The Task Development Boundary page supports a horizontal scrollbar. Optimize the experience when editing a job name. Optimize the error message displayed when a task fails to start due to improper resource configuration. | 2025-04-28 |
Update | Description | Release Date | Documentation |
Add Operator traffic monitoring. | Monitor traffic at each Operator stage. | 2025-03-10 |
Update | Description | Release Date | Documentation |
Optimized job parameter configuration | Job parameters can be modified directly in the current edition without creating a new one. | 2025-02-07 | |
Optimized variable management | Variable management supports including multiple variables within a single line of code. | 2025-02-07 | |
StarRocks version upgrade | The StarRocks connector version was upgraded to 1.2.9. | 2025-02-07 |
Update | Description | Release Date | Documentation |
Added support for the OceanBase connector | Oceanus adds support for OceanBase as a sink table and dimension table. | 2025-01-22 | |
Optimization of monitoring metrics | Monitoring metrics support the comprehensive lag indicator for all partitions of a Kafka topic. | 2025-01-22 | |
Support for MySQL catalog | Added support for MySQL catalog management. | 2025-01-22 | - |
New Connector Management Module | A new connector management module has been added, allowing users to view and manage built-in connectors as well as custom connectors. | 2025-01-22 | |
Optimized the COS connector | Support for writing to COS from Flink 1.16 | 2025-01-22 | |
Resource Configuration Optimization | The fixed CU limit in resource configuration has been removed, allowing custom configuration of resource ratios. | 2025-01-22 | |
Connectivity Test Feature Optimization | The connectivity test feature supports up to 100 characters. | 2025-01-22 |
Update | Description | Release Date | Documentation |
Dump file feature optimization | After a Dump file is created, its path in COS is displayed. | 2024-12-12 | - |
Job Management Optimization | A job name supports up to 100 Chinese characters. | 2024-12-12 | |
Job Tuning Optimization | Oceanus jobs now support the flexible auto tuning feature. | 2024-12-12 | |
Flink UI Feature Optimization | The Flink UI feature supports domain name access. | 2024-12-12 | - |
Resource Authorization by Tag Feature Optimization | CAM supports resource authorization by Tag. | 2024-12-12 | - |
Unstable Job Exception Alert | An unstable job exception alert is added to the Job Management list and the Ops Management list. When an abnormal event occurs for a job's currently running instance within a day, a marker is added to the job status. | 2024-12-12 | - |
Event Display Optimization | The display length of abnormal event logs is increased. | 2024-12-12 | |
Iceberg/DLC Connector Performance Enhancement | Supports creating implicit partitions based on configuration parameters when Oceanus jobs write to Iceberg tables, eliminating the need for pre-creation of tables and accelerating query speed. | 2024-12-12 | |
DLC Connector Feature and Usability Enhancement | It supports automatically creating implicit partitions based on configuration parameters when Oceanus jobs write to DLC for automatic table creation, eliminating the need for pre-creation and accelerating query speed. The DLC Connector has CHDFS dependencies built in, eliminating the need for additional downloads and simplifying parameter configuration. | 2024-12-12 | |
New Support for Paimon Connector | The Paimon connector supports version 0.9. | 2024-12-12 | - |
ETL Feature Deprecation | Oceanus no longer supports ETL jobs. Existing users of ETL jobs can continue to use them, but the ETL job feature will not be further developed. It is recommended to switch to using SQL or JAR jobs. | 2024-12-12 | - |
Update | Description | Release Date | Documentation |
Optimized HBase Issues | Optimization of the issue where HBase timestamp nanoseconds cause HBase TTL invalidation | 2024-10-14 | |
Optimized variable management | Variables can be modified, and historical variable values can be viewed, enhancing variable management capabilities. | 2024-10-14 | |
Ops Management Enhancement | Ops management supports the list export feature, which can be used for local job analysis. | 2024-10-14 | - |
Update | Description | Release Date | Documentation |
Optimizations related to MongoDB | It supports a single client process listening to multiple tables. It supports filtering change records for source table fields that are not defined in Flink DDL statements. | 2024-9-1 | |
Kafka performance optimization | Optimize data skew performance issues in scenarios where the Source has multiple Kafka partitions. | 2024-9-1 | |
Support for real-time reading of HBase | Support for real-time reading of HBase | 2024-9-1 | |
Support for VS Code operations and shortcuts in SQL development. | VS Code shortcuts can be used during SQL code development. | 2024-9-1 | |
Support for configuration files in SQL jobs. | SQL jobs support uploading configuration files, such as SASL_SSL authentication files, during use. | 2024-9-1 |
Update | Description | Release Date | Documentation |
Optimized DLC default parameters and configurations | Optimizes the parameters and configurations required for using DLC, reduces unnecessary repetitive operations, and facilitates user usage. | 2024-8-8 | |
Debugging Feature Optimization | Supports downloading debug results for local viewing. | 2024-8-8 | |
Optimized batch operations | Adds a snapshot option to the batch stop and batch start features, supporting snapshot creation upon stopping and selection of the latest snapshot for startup. | 2024-8-8 |
Update | Description | Release Date | Documentation |
Optimized variable management | Adds system variables (such as JOB_ID, CLUSTER_ID, space ID, and so on) to the variable feature. | 2024-7-26 | |
Performance optimization | Optimizes the startup and shutdown time of Oceanus jobs under 0.25cu. | 2024-7-26 | - |
Kafka startup mode selection support. | Oceanus supports modifying the Kafka startup mode through the page, and Kafka job startup supports startup modes such as earliest-offset, latest-offset, and timestamp. | 2024-7-26 | |
Optimized Kafka issues | Fixes the null pointer exception issue in Flink Upsert Kafka. | 2024-7-26 |
Update | Description | Release Date | Documentation |
Support PrivateDNS Resolution Data Source. | Integrates with the PrivateDNS product to reduce user configuration effort and prevent task failures and subsequent impact on online data caused by unsynchronized changes to DNS domain-to-IP address mappings on the Ops side. | 2024-06-27 | |
Ops Management Module Optimization | Optimizes the display order of jobs in Ops management, supports global sorting, and automatically filters out stopped jobs. | 2024-06-27 | - |
Event Management Optimization | Optimizes event management alarms and supports configuring alarms for more events on the event bus. | 2024-06-27 | |
Page Display Optimization | Optimizes cluster details: uses ES for log collection and fixes icon positions. Optimizes job details: fixes the issue where overly long job names cause conflicts with the positions of operation icons. | 2024-06-27 | - |
Update | Description | Release Date | Documentation |
Tuning Feature Enhancement | JAR jobs support the tuning feature, which includes automatic tuning and custom tuning. | 2024-04-21 | |
Enhanced the database/table feature | Table management supports DDL editing. Created DDLs can be edited, and modifying parameters and WITH parameters is supported. | 2024-04-21 | |
Ops Management Module Enhancement | The Ops management module now supports displaying the TaskManager CPU utilization and TaskManager heap memory utilization for jobs. | 2024-04-21 | - |
Update | Description | Release Date | Documentation |
Add Job Description Field to Jobs. | Adds a job description field for quick viewing and understanding of job purposes. | 2024-03-31 | |
Optimized job monitoring and alarm information | Enriches alarm information, currently supporting job name, responsible person, job ID, alarm object, alarm policy, alarm content, and other details. Obtains key alarm information to quickly go to the troubleshooting phase, simplifying Ops troubleshooting. | 2024-03-31 | |
Optimized Doris | Optimizes the Doris import label mode to avoid repeated errors in import tasks. | 2024-03-31 | - |
Optimized MongoDB CDC | Optimizes MongoDB CDC and adds support for the Delete filter operation feature. | 2024-03-31 | |
Redis optimization | Adds support for simultaneous operations when multiple hash keys exist in an hmset scenario. | 2024-03-31 |
Update | Description | Release Date | Documentation |
Support Job Migration Across Different Workspaces | Optimizes the job copy creation feature, supports workspace selection, allows copying jobs to other workspaces, and enables job migration across multiple workspaces and clusters. | 2024-02-29 | |
Optimized TaskManager Log Output | Optimizes the TaskManager log output, allows generating and viewing Dump files for specified TaskManagers. | 2024-02-29 | - |
SQL Server syntax check optimization | Fixes the SQL Server explain issue / select issue. | 2024-02-29 |
Update | Description | Release Date | Documentation |
Log collection supports ES serverless | Log collection supports ES serverless. On the cluster details page, you can set the ES Serverless Index bound to the cluster for collecting and searching job run logs. You can also use ES Serverless as the run log collection method, which also enables real-time log search. | 2024-01-08 | |
Role users with CAM support | Supports CAM role users in configuring role permissions, adding members, and more. | 2024-01-08 | - |
New compression formats | Flink supports compression in formats such as lz4, extending the compression methods available for writing to data lakes. | 2024-01-08 | - |
Log reuse capability in FlinkSQL CDC mode | Log reuse capability in FlinkSQL CDC mode | 2024-01-08 | - |
Update | Description | Release Date | Documentation |
Optimized CLS log search | CLS logs support querying from a specified start position, and CLS log query accuracy is optimized. | 2023-11-24 | |
Optimized checkpoint management | Checkpoint snapshots support lifecycle management. You can configure the retention policy for Checkpoint snapshots in the job parameters. Savepoint snapshots can be deleted. You can delete them from the job snapshots. | 2023-11-24 | |
Optimized log output | Optimize TaskManager log output to facilitate the quick location of error log information. DEBUG-level logs exclude BaradReporter-related reporting logs by default. | 2023-11-24 | |
Optimized association between instances and versions | Pages such as logs and snapshots display the edition corresponding to the instance, facilitating quick location of the job code version. | 2023-11-24 | - |
Event Management Optimization | Job event management is optimized, with more comprehensive information prompts, complete error stack logs, and clear error-reporting TMs, facilitating problem location. | 2023-11-24 | |
Flink CDC v2.4 supports PostgreSQL database as a Source. | Flink CDC v2.4 supports PostgreSQL database as a Source. | 2023-11-24 | |
Redis optimization | Added support for Redis write caching and asynchronous features. | 2023-11-24 | |
Upgraded the Hudi Connector version | Upgraded the Hudi Connector version. | 2023-11-24 |
Update | Description | Release Date | Documentation |
Optimized job startup | Kafka jobs support consumption by time. Users can directly specify recovery by selecting a time when starting a job. | 2023-10-01 | - |
Variable feature optimization | Configuration table variables support batch configuration of variable values. Users can use the batch configuration feature to configure the same variable values (commonly used ones such as IP addresses) with one click, reducing the time spent on repetitive configuration. Optimize the table variable substitution reminder. When a user clicks for syntax check or to publish a draft, the system validates whether table variable substitutions have been submitted. If unsubmitted table variable substitutions are detected, a secondary confirmation pop-up appears. | 2023-10-10 | |
Batch job startup optimization | Optimized the issue of slow batch job startup. | 2023-10-10 | - |
Kudu-related optimizations | Writing to Kudu supports Kerberos. | 2023-10-10 | |
Optimized MySQL-cdc Jar package | The MySQL-cdc Jar package supports the registration of customer-defined converters. | 2023-10-10 | |
Binlog-related optimizations | Optimize resource consumption during schema deserialization to state when a single job subscribes to multiple MySQL database binlogs. It supports subscribing to multiple binlogs within a single task, enabling CPU sharing and reducing usage costs. | 2023-10-10 | - |
Added Pulsar monitoring metrics | Added monitoring metrics for the Pulsar Connector | 2023-10-10 | - |
Oracle CDC Connector support | Added support for Oracle CDC Connector | 2023-10-10 | |
Update | Description | Release Date | Documentation |
Optimization of the database sync feature | The full-database synchronization feature supports tinyint(1). Full-database synchronization supports variable substitution. | 2023-09-01 | - |
Update | Description | Release Date | Documentation |
Canal Protobuf Feature Optimization | Support for multiple versions of the Canal Protobuf feature | 2023-08-17 | - |
Session Debugging Feature Optimization | Support for Flink-1.16 version cluster jobs in Session debugging. | 2023-08-17 | |
Support for Fine-Grained Resource Configuration at the Operator Level. | Supports resource configuration at the operator level, generates operator logic diagrams, sets multiple SLOTs, and individually adjusts parallelism, CPU, memory, State TTL, and other parameters for operators. | 2023-08-17 | |
Logger Sink Released | Logger Sink is a custom Logger sample provided by Tencent Cloud Oceanus. It can write the final result data to the log files of TaskManager. Subsequently, the output of these logs can be viewed through the Flink UI or the log panel of the console. Logger Sink is built into the Oceanus platform. | 2023-08-17 | |
SQL Parsing Segmentation Optimization | Optimized SQL parsing segmentation, conducted practical tests using sampled data, achieving performance 2.5 times that before optimization. | 2023-08-17 | - |
ClusterMaster Optimization | Improves the speed of command obtaining and distribution by ClusterMaster in large-scale scheduling scenarios. | 2023-08-17 | - |
Optimized Log Level Configuration | Supports setting log levels individually by specified class names. | 2023-08-17 | |
SQL Editor Optimization | SQL code supports auto-save. | 2023-08-17 | - |
Update | Description | Release Date | Documentation |
Added support for tdsql-mysql dimension tables | Added support for the tdsql-mysql dimension table feature | 2023-07-06 | |
Optimized job latency metrics | Added Kafka connector latency metrics for Flink 1.14/1.16 version jobs | 2023-07-06 | - |
Optimized variable management | In variable management, the variable value length limit has been increased to 300 characters to accommodate more complex variables. | 2023-07-06 |
Update | Description | Release Date | Documentation |
Optimized MySQL-CDC | When the custom merge group for MySQL-CDC connection reuse is optimized, ensure that the order of each partitioning remains consistent. Fix the infinite loop caused by overflow during BIGINT Chunk partitioning in the MySQL-CDC open-source version. Optimize the MySQL-CDC table addition process. Optimize the last split in MySQL-CDC. | 2023-06-07 | |
Permission tool | Allows users to authorize metadata-accelerated COS buckets and Cloud CHDFS via the permission tool. | 2023-06-07 | |
Tag configuration support for jobs. | Allows jobs to be bound to Tags. Enables configuring monitoring alarms via Tags, making the process more flexible and convenient. | 2023-06-07 | |
Optimized event alarms | Adds the task name and its folder path information when monitoring data is reported to the event bus, making problem troubleshooting more convenient and direct. | 2023-06-07 |
Update | Description | Release Date | Documentation |
Support for Session Cluster Debugging Feature | Supports simulating job runs, checking output results in real time, verifying business logic correctness, improving development efficiency, and reducing data quality risks using the job debugging feature (Flink 1.13). | 2023-05-15 |
Update | Description | Release Date | Documentation |
Enhanced Flink UI security control | Flink UI supports access allowlist configuration. | 2023-04-17 | |
Optimized the ClickHouse connector | Optimization is made to alleviate this issue: Joining of multiple streams causes many data changes. As a result, the data sink has much pressure on ClickHouse. | 2023-04-17 | |
Optimized job log level configurations | Users can configure the log level of jobs in batches. | 2023-04-17 | |
Optimized database connection via JDBC | The error in splicing Oracle JDBC statements using composite primary keys is fixed. | 2023-04-17 | |
Optimized capabilities related to monitoring metrics | The system supports display and alarm configuration for Kafka job latency metrics. | 2023-04-17 | |
Optimized FileSystem | The system supports compression formats such as Snappy for sinking data in Raw format to FileSystem. | 2023-04-17 |
Update | Description | Release Date | Documentation |
Optimized dependency management | The logic for deleting dependencies and dependency versions is optimized. | 2023-03-17 | |
The Iceberg connector of the new version is supported. | The Iceberg connector of the new version is supported. | 2023-03-17 | |
Optimized the job startup message | Before a user starts a job, the system will check whether there are sufficient subnet IPs for the configured parallelism. If no, it will prompt the user. | 2023-03-17 | |
Supported SQL version comparison. | Users can compare SQL code and configurations of different versions of a SQL job. | 2023-03-03 | |
Optimized the Redis connector | The Redis connector improves the lookup performance of the Redis dimension table. In scenarios where empty query results are frequent, the performance is improved multiple times. The Redis connector is supported for SQL jobs on Flink 1.14. | 2023-03-03 | |
Supported the StarRocks connector | The StarRocks Connector is newly supported. It is implemented based on the open-source starrocks-connector-for-apache-flink v1.2.4 and supports reading from and writing to StarRocks through Flink (Flink 1.13 | 1.14). | 2023-03-03 | |
Optimized MySQL CDC | The system ignores the data changes of non-DDL fields in MySQL CDC. | 2023-03-03 | |
Supported the MongoDB CDC of the new version | The MongoDB CDC of the new version is supported. | 2023-03-03 | |
Optimized cluster purchase | A user other than a super admin can click to purchase a cluster. | 2023-03-03 | - |
Added display of abnormal jobs and idle cluster CUs | Cluster overview is added to the job management module, which displays the statistics of the clusters associated with this workspace, including total number of clusters, total number of CUs, and number of idle CUs. The total number of jobs with metric alarms and that of jobs with events are added to the job overview section, and support clicking for quick filtering. | 2023-03-03 | |
Optimized the database/table reference feature | Users can edit DDL instead of creating a new one. They can edit WITH parameters (except connector). A change record button is added to the View DDL page for users to view the DDL change records, which facilitates tracking. | 2023-03-03 |
Update | Description | Release Date | Documentation |
Optimized batch job deletion | The logic of displaying jobs for batch deletion is optimized so that folders containing only jobs that cannot be deleted will no longer be selected by default. | 2023-02-09 | |
Added the SQL Server CDC connector | The SQL Server CDC connector is added. SQL Server CDC can only be used a source so as to read full data or incremental data from the SQL Server database. (Flink 1.14) | 2023-02-09 | |
Supported Doris catalog | The catalog feature of Cloud Data Warehouse for Apache Doris is introduced to avoid manual registration of Doris tables, improving job development efficiency and ensuring correct schema mapping. | 2023-02-09 | - |
Supported transactions by Doris (data sink) | The system supports end-to-end Exactly-Once for writing to Doris. | 2023-02-09 | - |
Upgraded the hadoop-shaded package | The flink-hadoop-shaded package has compatibility issues due to a low version (2.7.5) and is upgraded to the latest version 2.8.3. | 2023-02-09 | - |
Upgraded the KonaJDK version | The KonaJDK version is upgraded to avoid deadlocks. | 2023-02-09 | - |
Optimized MySQL CDC | The issue that the MySQL CDC string key data is not evenly distributed is fixed so that string primary key chunks are evenly distributed and jobs no longer encounter OOM. MySQL CDC connection merge supports the Kudu data sink. The Kudu connector is refactored with the new Flink Sink API. The TDSQL GTID issue that caused job failures is fixed. | 2023-02-09 | |
Optimized Ingress | The rules of deleting and adding Ingress are optimized. | 2023-02-09 | - |
Optimized event alarms | The system allows users to configure alarms for "job stopped" events after being redirected to EventBridge. | 2023-02-09 | |
Optimized job copy creation | After a user creates a copy of a job, the copy can carry a savepoint for fast job migration and restoration. | 2023-02-09 | |
Optimized variable management | A variable name now supports 100 characters. | 2023-02-09 | |
Supported auto scaling of jobs as scheduled | Users can set the start and stop time, object, and scaling proportion for auto tuning. | 2023-02-09 | |
Optimized checkpoint management | The latest five checkpoints are retained for a job by default. Users can configure the number of checkpoints to retain in advanced parameters. | 2023-02-09 |
Update | Description | Release Date | Documentation |
Optimized the JDBC (data sink) | Users can configure parameters to determine whether to ignore the Delete operation. | 2023-01-16 | |
Optimized the support for Cloud Data Warehouse for PostgreSQL | Cloud Data Warehouse for PostgreSQL (flink-connector-cdw-postgre) v2.0 is supported. | 2023-01-16 | |
Optimized the Kafka connector | The incorrect database/table subscription issue is fixed for the Kafka connector. | 2023-01-16 | |
Optimized the COS connector | The COS connector META-INF Shade error is fixed, and Flink 1.14 SQL jobs can use the COS connector. | 2023-01-16 | |
Fixed TopN operator issues | This issue is fixed: An error may occur due to status mismatch when TopN operators of Flink encounter functions such as now(). | 2023-01-16 | - |
Update | Description | Release Date | Documentation |
Optimized MySQL CDC monitoring metrics | The following monitoring metrics are added: CurrentFetchEventtimeLag, CurrentEmitEventtimeLag, taskmanager_job_task_backpressuredtimemspersecond, and taskmanager_job_task_dataskewcoefficient. | 2022-12-16 | |
Supported automatic table creation in Hive by database sync SQL | Database sync SQL supports automatic creation of missing tables in Hive. | 2022-12-16 | - |
Supported extraction of metadata fields in database sync | In database sync, metadata fields such as the database name, table name, and timestamp can be extracted. | 2022-12-16 | - |
Supported more data types for ClickHouse | ClickHouse supports Map, Array, and Row data types. | 2022-12-16 | |
Supported Data Lake Compute (DLC) | The system supports writing to native tables managed in DLC. (Flink 1.14) | 2022-12-16 | |
Supported TDMQ for Pulsar | The Pulsar SQL connector allows users to query data in Pulsar topics or write data to Pulsar using simple SQL queries or Flink Table API. (Flink 1.13|1.14) | 2022-12-16 | |
Optimized metadata fields supported by MySQL CDC | MySQL CDC supports access of metadata fields such as Pos, File, and Gtid. | 2022-12-16 | |
Optimized chunk division by MySQL CDC composite primary key | Users can select a column as the division key in an MySQL CDC composite primary key scenario. | 2022-12-16 | |
Supported a dynamic key in ZADD by the Redis connector | The Redis connector allows a dynamic field to be used as the key in ZADD mode. | 2022-12-16 | |
Optimized the FileSystem connector | The FileSystem connector supports the compress algorithm. | 2022-12-16 |
Update | Description | Release Date | Documentation |
Optimized the MySQL CDC performance | The performance for reading incremental data from MySQL CDC is optimized. | 2022-09-16 | MySQL CDC Database |
Upgraded the COS connector version | The COS connector version is upgraded. | 2022-09-16 | |
Custom role permissions are supported. | Custom role permissions are supported. | 2022-09-05 | |
Optimized Doris performance | The Doris write performance is optimized. | 2022-09-05 | - |
Supported Kafka source merge and database sync | The system supports Kafka source merge and database sync (a single topic and multiple schemas). | 2022-09-05 | |
Supported custom job log levels | Users can customize the log level when configuring running log collection for a job. Users can customize the log level when querying job logs. | 2022-09-05 |
フィードバック