检测到您已登录华为云国际站账号,为了您更好的体验,建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Figure 3 Example Copying Data to OBS On the Notebook JupyterLab page, copy the yolov8_train_ascend.zip file to an OBS bucket.
Prerequisites The data used for training has been uploaded to an OBS directory. At least one empty folder has been created in OBS for storing the training output. OBS buckets are not encrypted. ModelArts does not support encrypted OBS buckets.
The value must be a specific directory in an OBS bucket rather than the root directory of an OBS bucket. If type is set to obsfs, the parameter value must be a valid bucket name of the OBS parallel file system. (CCE does not support subdirectory mounting.)
MapReduce Service (MRS) MRS Administrator GaussDB(DWS) DWS Administrator Cloud Trace Service (CTS) CTS Administrator ModelArts ModelArts CommonOperations ModelArts Dependency Access Development environment notebook/Image management/Elastic node server OBS OBS Administrator Cloud
The path can be either a local or OBS path.
Data path Select the training data from your OBS bucket. On the right of the Data path text box, click Select. In the dialog box that is displayed, select an OBS folder for storing data.
Exporting Data ModelArts training management allows you to create training jobs using ModelArts datasets or files in an OBS directory. If you create a training job using an OBS directory, export the prepared data to OBS. Export data to OBS.
Model Management Failed to Create a Model Suspended Account or Insufficient Permission to Import Models Failed to Build an Image or Import a File During Model Creation Failed to Obtain the Directory Structure in the Target Image When Creating a Model Through OBS Failed to Obtain Certain
Enums: dataset: The data input is a dataset. obs: The data input is an OBS path. remote_constraint Array of remote_constraint objects Data input constraint Table 18 InputDataInfo Parameter Type Description dataset dataset object Dataset as the data input. obs obs object OBS in which
Training code can use the IP address of the ib0 NIC to accelerate network communications. dls-downloader.py OBS download script. The utils.sh script depends on this script.
FAQ Abnormal User xxx does not have OBS permission obs:object:PutObjectAcl. The IAM user does not have the obs:object:PutObjectAcl permission on OBS. Add the agency permission for the IAM user. FAQ Abnormal Creating the image timed out. The timeout duration is xxx minutes.
For example, if you upload data via OBS Browser+, enable MD5 verification, as shown in Figure 1. When dynamic loading is enabled and the local persistent storage of the node is used, OBS Browser+ checks data consistency during data upload.
FAQs Abnormal User xxx does not have OBS permission obs:object:PutObjectAcl. The IAM user does not have the obs:object:PutObjectAcl permission on OBS. Add the agency permission for the IAM user. FAQs Abnormal Creating the image timed out. The timeout duration is xxx minutes.
Importing a Meta Model from OBS: If you use a mainstream framework to develop and train a model locally, you can upload the model to an OBS bucket based on the model package specifications, import the model from OBS to ModelArts, and use the model for service deployment.
Enums: dataset: The data input is a dataset. obs: The data input is an OBS path. remote_constraint Array of remote_constraint objects Data input constraint Table 19 InputDataInfo Parameter Type Description dataset dataset object Dataset as the data input. obs obs object OBS in which
Enter an existing OBS directory that starts with obs://. The file name can be custom.
Viewing Training Logs in OBS When you submit a training job, the system automatically creates a folder with the same name as the training job in the configured OBS path to store the model, logs, and code outputted after training is complete.
upload Upload local file or OBS object to DLI resources.
Symptom: After the labeled data is uploaded to OBS and synchronized, the data is displayed as unlabeled. Possible causes: Automatic encryption is enabled in the OBS bucket. Solution: Create an OBS bucket and upload data again, or disable bucket encryption and upload data again.
Code Directory OBS path to the code directory of the training job. You can click Edit Code on the right to edit the training script code in OBS Online Editor. OBS Online Editor is not available for a training job in the Pending, Creating, or Running status.