检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Incorrect OBS Path on ModelArts Symptom When an OBS bucket path is used in ModelArts, a message indicating that the created OBS bucket cannot be found or message "ModelArts.2791: Invalid OBS path" is reported.
Error Occurred When Pandas Reads Data from an OBS File If MoXing Is Used to Adapt to an OBS Path Symptom If MoXing is used to adapt to an OBS path, an error occurs when pandas of a later version reads data from an OBS file. 1. 'can't decode byte xxx in position xxx' 2.
Obtaining the Notebook Instances with OBS Storage Mounted Function This API is used to obtain the notebook instances with OBS storage mounted.
String Status of OBS storage to be mounted.
/test/ obs://your-bucket/copy-data/ # Download OBS file to local path ma-cli obs-copy obs://your-bucket/copy-data/test.zip ./test.zip # Download OBS directory to local path ma-cli obs-copy obs://your-bucket/copy-data/ .
OBS Operation Issues Failed to Read Files Error Message Is Displayed Repeatedly When a TensorFlow-1.8 Job Is Connected to OBS TensorFlow Stops Writing TensorBoard to OBS When the Size of Written Data Reaches 5 GB Error "Unable to connect to endpoint" Error Occurs When a Model Is Saved
The operations are as follows: Uploading a File to OBS Uploading a Folder to OBS Downloading a File from OBS Downloading a Folder from OBS Parent topic: OBS Management
OBS Management Overview of OBS Management Transferring Files (Recommended) Uploading a File to OBS Uploading a Folder to OBS Downloading a File from OBS Downloading a Folder from OBS
The system will automatically create the folder in /data/ of the notebook container to mount the OBS file system. Select the folder for storing the OBS parallel file system and click OK.
Unmounting OBS Storage from a Notebook Instance Function This API is used to unmount OBS storage from a notebook instance. After OBS storage is unmounted, OBS objects remain unchanged but cannot be operated in the notebook container.
Introduction to Importing Data from OBS Import Modes You can import data from OBS through an OBS path or a manifest file. OBS path: indicates that the dataset to be imported has been stored in an OBS path. In this case, select an OBS path that you can access.
Figure 3 Entering a valid OBS file path Enter an OBS file path instead of a folder path. Otherwise, the upload fails. Method 2: Open OBS File Browser, select an OBS file path, and click Upload.
A table dataset can import data from sources such as OBS, GaussDB(DWS), DLI, and MRS. To import data from an OBS directory, you must have the read permission on the OBS directory. The OBS buckets and ModelArts must be in the same region.
For details, see Creating an OBS Bucket for ModelArts to Store Data The OBS bucket and ModelArts are in the same region and you can operate the bucket. Importing File Data from an OBS Path The parameters on the GUI for data import vary according to the dataset type.
Does ModelArts Use the OBS API to Access OBS Files over an Intranet or the Internet? In the same region, ModelArts uses the OBS API to access files stored in OBS over an intranet and does not consume public network traffic.
A table dataset can import data from sources such as OBS and MRS. To import data from an OBS directory, you must have the read permission on the OBS directory. The OBS buckets and ModelArts must be in the same region.
Procedure Log in to OBS Console and click Create Bucket in the upper right corner of the page to create an OBS bucket. For example, create an OBS bucket named c-flowers. The created OBS bucket and ModelArts are in the same region.
How Do I Upload Data to OBS? Before using ModelArts to develop AI models, data needs to be uploaded to an OBS bucket. You can log in to the OBS console to create an OBS bucket, create a folder in it, and upload data.
Importing Data from an OBS Path Prerequisites A dataset is available. The data to be imported is stored in OBS. The manifest file is stored in OBS. The OBS bucket and ModelArts are in the same region and you can operate the bucket.
How Do I Upload a File from a Notebook Instance to OBS or Download a File from OBS to a Notebook Instance?
