Scenarios
Data processing details show the basic information and execution details of this task.
Operation Steps
Viewing Task Execution Details
2. In the left sidebar, click Data Processing to enter the data processing page.
3. Click the ID/name of the processing task whose details need to be viewed, and enter the detail page of this processing task.
4. Select the Execution Details tab to view the execution details of data processing tasks by time period.
Processed data statistics
Including log input lines, output lines, failed rows, and discarded rows. Discarded rows refer to log rows processed using log_keep/log_drop functions.
Target log topic written rows statistics
You can click the search button in the upper-right corner, enter a keyword to search for a specific target log topic and view it. You can click in the top-right corner, add failed rows to monitoring alarms. For detailed information, see Configure Alarm Policy.
Processing task latency
You can click in the top-right corner, add processing latency to monitoring alarms. For detailed information, see Configure Alarm Policy.
Processing failure analysis
Process failure analysis analyzes the data of process failure by showing error functions, statements, raw logs, etc.
For example, normally the raw log is {"content": "{\\"sub_field1\\":1,\\"sub_field2\\":\\"2\\"}"}, so ext_json("content") can run correctly. When content is an empty character, parsing failure occurs.
|
Raw Log | {"content": ""} |
Error Message | - |
Error Cause | parse failed |
Line count where the error statement is located | 1 |
error function | ext_json() |
Viewing Basic Information of Task
2. In the left sidebar, click Data Processing to enter the data processing page.
3. Click the ID/name of the processing task whose details need to be viewed, and enter the detail page of this processing task.
4. Select the Basic Info tab to view the basic configuration of the processing task, source log topic, target log topic, and processing grammar.
5. If your target log topic type is Dynamic Log Topic, you can view the create record of the Dynamic Log Topic and its related logs.