TDengine 3.4.1.0 Release Notes

Features

1. feat: mcp server for TDengine TSDB
2. feat: support external window query with time range explicitly specified by subquery, suitable for complex analysis scenarios such as cross-event correlation, window reuse and hierarchical filtering
3. feat: support uncorrelated scalar subquery
4. feat: add support for the ANY/SOME/ALL/EXISTS/NOT EXISTS operators
5. feat: support batch modification of child table tag values
6. feat: stream adds support for scheduled calculation by natural week, month, quarter, and year dimensions
7. feat: add the timeout notification function for stream when no new data is written to source child tables/virtual child tables
8. feat: subscription function adds support for metadata changes of virtual tables
9. feat: data subscription supports token-based login
10. feat: add identity authentication functions
11. feat: add support for CAST and SUBSTR functions on BLOB type
12. feat: support the lag, lead, fill_forward function
13. feat: the fill clause of interval and interp supports surrounding time ranges
14. feat: support scalar subqueries without the FROM clause
15. feat: support non-correlated subqueries in IN operator
16. feat: taosd adds support for the data repair mode
17. feat: TDgpt adds support for the multivariate anomaly detection feature
18. feat: taosX add task owner privileges
19. feat: taosX support system & object level privileges
20. feat: taosX new data-in pSpace
21. feat: OPC-UA connection test support failover
22. feat: kafka transformer support filter to split messages to multiple schemas
23. feat: KingHistorian dataset auto update
24. feat: KingHistorian support non-stop migration when end timestamp set empty
25. feat: go websocket subscription support token auth
26. feat: Go REST connector support TOKEN auth
27. feat: rust subscription support token auth
28. feat: c websocket subscription support token auth
29. feat: taosdump now support decimal data type
30. feat: taosdump now support BLOB data type
31. feat: taosgen support windows
32. feat: taosgen support setting log options in config file
33. feat: taosKeeper add endpoint for exporting all metrics
34. feat: Explorer support token response in login
35. feat: explorer support totp auth
36. feat: explorer support bearer token auth
37. feat: support multiple brokers in MQTT task

Enhancements

1. enh: taosX now works on Windows
2. enh: add support for TDgpt functionality on the Windows platform
3. enh: add support for stream functionality on the Windows platform
4. enh: improve the query performance of aggregate queries with GROUP BY on virtual super tables
5. enh: optimize the query performance of interval, session, event windows for virtual super tables
6. enh: optimize query performance when virtual tables reference many columns of physical tables
7. enh: optimize the query performance of state windows for virtual super tables
8. enh: push down the time filter conditions of non-correlated subqueries to improve the batch query performance of virtual tables
9. enh: return clear error information when virtual table creation fails, such as type matching failure of a specific column
10. enh: add reference verification capabilities between virtual tables and source tables, including reference relationship storage, source table change verification, reference relationship query and virtual table availability verification functions
11. enh: improve the performance of last_row queries
12. enh: support dynamic adjustment of LRU shard count to improve the execution performance of Last queries
13. enh: RESTORE DNODE command supports specifying VGROUP ID
14. enh: Improve the subscription speed in the scenario of interleaved writing
15. enh: add support for the IN operator in subqueries of stream
16. enh: add support for ANY/SOME/ALL/EXISTS/NOT EXISTS operators in stream
17. enh: add support for subqueries in stream computing scenarios
18. enh: add support for child table addition/deletion, child table tag value modification, and column mapping relationship adjustment to the trigger mechanism of virtual super tables in stream
19. enh: stream supports multi-group batch computation
20. enh: support batch deletion of stream computing
21. enh: add NODELAY_CREATE_SUBTABLE option for stream to create result tables in advance when no data is written
22. enh: Improve the performance when subqueries are used as primary key filter conditions
23. enh: optimize the fill(prev/next/near/linear) filling syntax of the interp function to support filling with non-NULL values before/after the target position
24. enh: join/window join supports operations based on selection function result sets
25. enh: display query execution progress for the SHOW QUERIES statement
26. enh: upgrade the explain analyze function, fix the deviation in operator execution time statistics, add various operator indicators, improve result readability
27. enh: optimize the reporting logic of slow logs to improve the accuracy and timeliness of reporting
28. enh: provide clearer error messages for SQL statements
29. enh: correct comparison results of NULL values in the IN operator
30. enh: add security protection capabilities against SQL injection
31. enh: add protection capabilities against Denial of Service (DoS) attacks
32. enh: add protection capabilities against overflow attacks
33. enh: add the capability of forced overwriting after sensitive data deletion
34. enh: add support for the configuration parameter AuditSaveInSelf; when enabled, audit information is recorded without going through taoskeeper
35. enh: add support for the enableGrantLegacySyntax parameter; when set to 1, the authorization syntax of v3.4 is compatible with v3.3
36. enh: remove the forceReadConfig parameter
37. enh: optimize the timer logic after system time changes
38. enh: when the password is incorrect in the subscription scenario, return the same "Authentication failure" error message as that of taos connection
39. enh: support modifying the PASSWORD_LIFE_TIME, PASSWORD_REUSE_TIME, PASSWORD_REUSE_MAX, and ALLOW_TOKEN_NUM attributes of the ROOT user, and set the minimum password validity period to 1 day by default
40. enh: add the configuration item enableAdvancedSecurity (default value is 0), which disables the password expiration, strong password and password rotation policy when set to 0 (this behavior is consistent with v3.3)
41. enh: prohibit connection between Community Edition and Enterprise Edition
42. enh: TDgpt server uses Gunicorn instead of uWSGI as the service driver
43. enh: taos shell supports logging in via token
44. enh: taosdump add support for stmt2
45. enh: auto review session in explorer
46. enh: Explorer License page refinement
47. enh: improve explorer ui for data-in tasks and transform
48. enh: explorer can enable CAPTCHA on login
49. enh: Explorer auto scale json parser input
50. enh: Explorer activation input auto scale
51. enh: C/Rust websocket connector security enhancement
52. enh: JDBC doc recommend use varcharAsString=true for taos-ws
53. enh: OPC custom tag support special chars replacing
54. enh: taosX backup can still create backup checkpoints when offset retrieval/checking fails

Fixes

1. fix: taosX breakpoint db lock race condition issue with multiple csv
2. fix: kafka data-in use full list json instead of json items
3. fix: automatically trim spaces around sub table name in transform page
4. fix: long parser error misleads root cause
5. fix: OPCDA dataset collection possibly interrupt
6. fix: XNODE replication task can't start
7. fix: unable to select target database in tsdb import task dialog
8. fix: opcda retrieves empty data points
9. fix: TDinsight taosX panel task info error
10. fix: task not restored in other xnodes when one stopped
11. fix: taosX sync error with varbinary/blob datatype
12. fix: SHOW XNODE TASKS should be ordered by id
13. fix: vgroups information is not included when taosdump restores the database
14. fix: the SQL statement content queried from the system table ins_streams is incomplete
15. fix: "Invalid value in client" error is triggered when querying virtual super tables
16. fix: the query reports a "Planner slot key not found" error when querying the timestamp and data column of a virtual child table if the data column does not reference the source table
17. fix: unexpected task status for query migration tasks
18. fix: the filter conditions for Agg aggregation results in stream do not take effect
19. fix: taosd crashes when a virtual table executes an aggregation query with the partition by tag clause
20. fix: query exception caused by inconsistent column types between virtual child table and mapped source table (usually due to adding or deleting columns with the same name)
21. fix: crash when querying with parameter binding on virtual tables
22. fix: the occasional crash issue when querying virtual super tables
23. fix: stream computing sliding(0s) incorrectly returns success
24. fix: potential crash when the SAMPLE function processes data exceeding the int32 range
25. fix: the IF EXISTS option does not take effect when using DROP TSMA
26. fix: no results returned when explain parses subqueries
27. fix: stream fails to calculate historical data when using FILL_HISTORY
28. fix: schema and tag synchronization issue when the stream result table already exists
29. fix: taosd crashes when executing a Last query to read BLOB type data
30. fix: taosc and taosd crashes when the trim function is called in an expression or function
31. fix: data is still output when the result set of queries containing JOIN operations is empty in stream
32. fix: query result is incorrect when a constant is used as the start time filter condition in a stream query statement
33. fix: incorrect logic for releasing temporary files in the stream leads to continuous increase of disk space during runtime
34. fix: the potential crash issue triggered when two statements with aggregate queries are combined via UNION ALL
35. fix: incorrect query result issue of session window on virtual super tables
36. fix: the potential crash issue when interval operator read SMA data instead of raw data
37. fix: taosd crash issue when comparing two tag columns with index usage
38. fix: incorrect configuration of the dynamic modification range for ssEnabled
39. fix: the default value of the SS_CHUNKPAGES parameter does not take effect
40. fix: the "Operation not supported" error is thrown when the compact operation is executed during data upload in the shared storage scenario
41. fix: the "Permission denied or target object not exist" error is reported when executing drop table if exists db.not_exist_table even though the user has the table drop permission
42. fix: when a user with sysinfo0 permission views fields without access rights, the behavior is consistent with version v3.3.8, where an error is thrown instead of returning a NULL value
43. fix: taosd CPU usage remains high due to rapid generation of a large number of logs after enabling all log debug switches
44. fix: resolve the issue of failed rawdata data subscription
45. fix: the extremely low-probability crash issue that occurs when subscriptions and stream computing are used simultaneously with high concurrency
46. fix: some vnodes stop consuming when subscriptions return no data for a prolonged period
47. fix: the dmp file generation mechanism on Windows platform
48. fix: the ROOT user reports insufficient permissions when performing some operations after upgrading from v3.3.8 to v3.4.0.0-1 and then to 3.4.0.2 and later versions
49. fix: PyTorch inference runtime execution fails due to missing gcc-related components in the TDgpt Docker image
50. fix: the logic for limiting display to the first 100 rows fails in taos shell when a subquery contains the LIMIT clause
51. fix: Explorer preview table unexpected when parsing error
52. fix: explorer extraction rules cause error when removed
53. fix: subscription empty cause user permission error in explorer
54. fix: data-in filter cause parameter lost in explorer
55. fix: password with special chars causes ws request error
56. fix: Explorer changing xor_allowed_duration_secs in toml not work
57. fix: explorer support relative-path in reverse-proxy
58. fix: replication task causes bad request error
59. fix: explorer sql injection vulnerability
60. fix: taosKeeper/taosAdapter security enhancement