检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Uploading a File from a Notebook Instance to OBS or Download a File from OBS to a Notebook Instance in ModelArts In a notebook instance, you can call the ModelArts SDK to exchange data with OBS for uploading a file to OBS or downloading a file from OBS to the notebook instance.
From OBS If the source link of a job is an OBS link, configure the source job parameters based on Table 1. Advanced attributes are optional and not displayed by default. You can click Show Advanced Attributes to display them.
For example, the content is as follows: /052101/DAY20211110.data /052101/DAY20211111.data Yes OBS Link of entries files This parameter is available only when Entries Files is set to Yes. You can select the OBS link where the list file is located.
Enabling Log Dump to OBS for a DataArts DataService Cluster Function This API is used to enable the logs of a DataArts DataService cluster to be dumped to OBS. Calling Method For details, see Calling APIs.
OBS Link Parameters When connecting CDM to the destination OBS bucket, you need to add the read and write permissions to the destination OBS bucket, and file authentication is not required.
To OBS If the destination link of a job is an OBS link, that is, data is to be imported to OBS, configure the destination job parameters based on Table 1. Advanced attributes are optional and not displayed by default. You can click Show Advanced Attributes to display them.
To OBS Files (even in a large volume) can be batch migrated to OBS in CSV, CarbonData, or binary format.
The file name must comply with the OBS file path naming rules. Parent Topic: Destination Job Parameters
OBS Manager Constraints This function depends on OBS. Function The OBS Manager node is used to move or copy files from an OBS bucket to a specified directory. Parameters Table 1, Table 2, and Table 3 describe the parameters of the OBS Managernode node.
Figure 3 Entering a valid OBS file path Enter an OBS file path instead of a folder path. Otherwise, the upload fails. Method 2: Open OBS File Browser, select an OBS file path, and click Upload.
Using CDM to Upload Data to OBS Uploading Inventory Data Uploading Incremental Data Parent topic: Simplified Migration of Trade Data to the Cloud and Analysis
Figure 3 Selecting a connector type Select Object Storage Service (OBS) and click Next to configure parameters for the OBS link. Name: Enter a custom link name, for example, obslink. OBS Server and Port: Enter the actual OBS address information.
Figure 2 Selecting a connector type Select Object Storage Service (OBS) and click Next to configure parameters for the OBS link. Name: Enter a custom link name, for example, obslink. OBS Server and Port: Enter the actual OBS address information.
Figure 3 Selecting a connector type Select Object Storage Service (OBS) and click Next to configure parameters for the OBS link. Name: Enter a custom link name, for example, obslink. OBS Server and Port: Enter the actual OBS address information.
Delete OBS Constraints This function depends on OBS. Functions The Delete OBS node is used to delete a bucket or directory on OBS. Parameters Table 1 and Table 2 describe the parameters of the Delete OBS node.
In a notebook instance, you can call the ModelArts SDK to exchange data with OBS for uploading a file to OBS or downloading a file from OBS to the notebook instance.
OBS Path Yes Path to the OBS bucket or directory. To create a bucket, enter //OBS bucket name. The OBS bucket name must be unique To create an OBS directory, select the path to the OBS directory to be created, and enter the /Directory name following the path.
Choose OBS Bucket. Select an OBS bucket. Figure 1 Configuring an OBS bucket Click Save. Parent topic: Configuring Resources
Link to OBS Description By creating an OBS link, you can extract files from or load files to Object Storage Service (OBS). Files in CSV, JSON, and binary format are supported. Sample Link The following is the message body of a sample link.
OBS Endpoint: Enter the domain name or IP address of OBS, for example, obs.myhuaweicloud.com. Port: Enter the port number of OBS, for example, 443. OBS Bucket Type: Select a value from the drop-down list box as required.
