Skip to main content

pSpace

ENTERPRISE FEATURE

The features or components discussed in this document are available in TDengine TSDB-Enterprise only. TDengine TSDB-OSS does not include these features or components.

This section describes how to create data migration/data synchronization tasks through the Explorer UI to migrate/synchronize data from pSpace to the current TDengine TSDB cluster.

Feature Overview​

TDengine TSDB can efficiently read data from pSpace and write it to TDengine TSDB for historical data migration or real-time data synchronization.

Procedure​

Add a Data Source​

  1. In a web browser, open TDengine TSDB Explorer. This interface is located on port 6060 on the hostname or IP address running TDengine TSDB.
  2. In the main menu on the left, click Data In and then click Add Task.
  3. In the Name field, enter a unique name for the data ingestion task.
  4. From the Type drop-down list, select pSpace.
  5. (Optional) If this data ingestion task requires an agent, select the agent from the Agent drop-down list. You can also click Create New Agent to create the agent now.

    For more information, see Install taosX-Agent.

  6. From the Target DB drop-down list, select the database in which you want to store data ingested by this task. You can also click Create Database to create the database now.

Configure Connection and Authentication Information​

In the Connection Configuration section, fill in Server Address and Server Port.

In the Authentication section, fill in Username and Password.

Click Connectivity Check to verify whether the data source is available.

pspace-en-03.png

Configure Data Points​

Select Data Points​

In Data Points, configure the following items:

  1. Root Node (root): The root node to start traversal from. Enter the LongName of the root node. For example: \Beijing\Chaoyang\Wangjing means traversal starts from \Beijing\Chaoyang\Wangjing and proceeds downward. By default, traversal starts from the root node.
  2. Data Point Name (point_name_pattern): Supports filtering by the LongName of data points. For example: \Beijing\Chaoyang\Wangjing\temperature-* means all data points under \Beijing\Chaoyang\Wangjing whose names start with "temperature-".
  3. Super Table Name (super_table_expression): Specifies the super table name for writing data points. Supports the {type} placeholder. Example: pspace_{type}.
  4. Table Name (child_table_expression): Specifies the subtable name for writing data points. Supports the {point_id} placeholder. Example: t_{point_id}.
  5. Timestamp Column (table_primary_key): Selects the source of the primary timestamp in the target table. Available values are original_ts, request_ts, and received_ts.
  6. Timestamp Column Name (table_primary_key_alias): Specifies the timestamp column name in the target table. Default is ts.
  7. Value Column Name (value_col): Specifies the column name for collected values in the target table. Default is val.
  8. Value Transform (value_transform): Applies an expression transform to values before writing. Example: (val-32)/1.8.
  9. Quality Column Name (quality_col): Specifies the data quality column name in the target table. Default is quality.
  10. Custom Tags (custom_tags): Configures tag mappings written to subtables. Supports static values and dynamic extraction from point attributes (for example, {LongName}).

After configuring Root Node and Data Point Name, click View Data Point List to view matching data points, then continue configuring the remaining mapping rules.

pspace-en-04.png

Upload CSV Configuration File​

In Upload CSV Configuration File, click Download Data Points, select the required Root Node and Data Point Name, and a CSV configuration file will be generated and downloaded locally. Modify the generated CSV file as needed and upload it again.

pspace-en-05.png

Configure Collection​

In the Collection Configuration section, fill in collection-related parameters.

pSpace supports three collection modes: Historical Query, Real-time Subscription, and Query Sync.

  • Historical Query: Batch query historical data within a time range. The task ends after the query completes.
  • Real-time Subscription: Subscribes to real-time changes of data points and keeps running until canceled.
  • Query Sync: Completes historical data migration first, then continuously polls new data at a fixed interval.

Historical Query​

Select Historical Query mode and configure: Start Time, End Time, and Query Window.

pspace-en-06.png

Real-time Subscription​

Select Real-time Subscription mode. No additional parameters are required.

Query Sync​

Select Query Sync mode and configure: Start Time, Query Window, Out-of-order Tolerance, and Query Interval.

pspace-en-07.png

Configure Advanced Options​

In the Advanced Options section, configure other parameters as needed.

Complete Creation​

Click Submit to complete task creation. After submitting, return to the Data In page to view the task status.