检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
For example, to use OBS, search for OBS and select OBS OperateAccess. ModelArts training jobs use OBS to forward data. Therefore, the permissions for using OBS are necessary. For permissions of more cloud services, such as SWR, see Table 1.
Data Upload or Download How Do I Upload a File from a Notebook Instance to OBS or Download a File from OBS to a Notebook Instance? How Do I Upload Local Files to a Notebook Instance? How Do I Import Large Files to a Notebook Instance? Where Will the Data Be Uploaded to?
General Issues Incorrect OBS Path on ModelArts Why Error: 403 Forbidden Is Displayed When I Perform Operations on OBS?
object:GetObjectAcl obs:object:PutObjectAcl obs:object:PutObject obs:object:GetObject obs:object:DeleteObject obs:object:ModifyObjectMetaData √ √ Modifying a training job PUT /v2/{project_id}/training-jobs/{training_job_id} modelarts:trainJob:update N/A √ √ Deleting a training job
Preset images Preset image used by a training job Code Directory OBS path to the code directory of a training job You can click Edit Code on the right to edit the training script code in OBS Online Editor.
for heterogeneous jobs Table 28 remote Parameter Type Description obs obs object OBS in which data input and output are stored Table 29 obs Parameter Type Description obs_url String OBS URL of the dataset for a training job, for example, /usr/data/ Table 30 outputs Parameter Type
for heterogeneous jobs Table 28 remote Parameter Type Description obs obs object OBS in which data input and output are stored Table 29 obs Parameter Type Description obs_url String OBS URL of the dataset for a training job, for example, /usr/data/ Table 30 outputs Parameter Type
The permissions to use ModelArts depend on OBS authorization. Therefore, you need to grant OBS system permissions to users. For details, see OBS Permissions. For the system policies of other services, see System Permissions.
N/A N/A Storage resource Object Storage Service (OBS) OBS is used to store the input and output data of training and inference. For details, see Object Storage Service Pricing Details. CAUTION: OBS resources for storing data are continuously billed.
object:PutObject obs:object:GetObject obs:object:GetObjectVersion obs:bucket:HeadBucket obs:object:DeleteObject obs:object:GetObject obs:bucket:CreateBucket obs:bucket:ListBucket modelarts:trainJob:list modelarts:trainJob:update modelarts:trainJobVersion:delete modelarts:pool:list
Symptom: After the labeled data is uploaded to OBS and synchronized, the data is displayed as unlabeled. Possible causes: Automatic encryption is enabled in the OBS bucket. Solution: Create an OBS bucket and upload data again, or disable bucket encryption and upload data again.
You can also specify an OBS path, for example, obs://Bucket name/Package name. Local files are also supported. To specify multiple parameters, use --jars jar1 --jars jar2.
Solution Log in to the OBS console using the primary account and grant access permissions for the OBS bucket to the IAM user. For details about the operation, see Granting an IAM User the Specified Permissions for a Bucket.
Error 404 If this error is reported when an IAM user creates an instance, the IAM user does not have the permission to access the OBS bucket. Solution Log in to the OBS console using the tenant account and grant access permissions for the OBS bucket to the IAM user.
You have created OBS buckets and folders for storing data. In addition, the OBS buckets and ModelArts are in the same region. You have uploaded data to be used to OBS. Procedure Log in to the ModelArts management console.
bucket:ListAllMybuckets", "obs:bucket:HeadBucket", "obs:bucket:ListBucket", "obs:bucket:GetBucketLocation", "obs:object:GetObject", "obs:object:GetObjectVersion", "obs:object:PutObject
Log in to the OBS console using the current account, and search for the OBS buckets, folders, and files in the path to check whether the code directory exists.
Take OBS path obs://obs-bucket/training-test/demo-code as an example. The content in the OBS path will be automatically downloaded to ${MA_JOB_DIR}/demo-code in the training container, and demo-code (customizable) is the last-level directory of the OBS path.
Symptom: After the labeled data is uploaded to OBS and synchronized, the data is displayed as unlabeled. Possible causes: Automatic encryption is enabled in the OBS bucket. Solution: Create an OBS bucket and upload data again, or disable bucket encryption and upload data again.
ModelArts mox.file provides a set of APIs for accessing OBS more conveniently, allowing users to operate OBS files by simulating a series of APIs for operating the local file system. For details, see Using MoXing Commands in a Notebook Instance.
