检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Step 3 Configuring Agent-based ModelArts Access Authorization After assigning IAM permissions, configure ModelArts access authorization for IAM users on the ModelArts page so that ModelArts can access dependent services such as OBS, SWR, and IEF.
You are advised not to use the OBS APIs of TensorFlow, MXNet, and PyTorch to directly read data from OBS. If the file is small, you can save data on OBS as a .tar package.
Creating a ModelArts Agency Function This API is used to create an agency so that ModelArts can access dependent services such as OBS, SWR, and IEF.
If the data is larger than 500 MB, upload it to OBS, and then download it to the notebook instance. Figure 1 Uploading data to a notebook Instance through OBS Upload data to OBS. For details, see Uploading an Object.
To use these datasets in a notebook instance, download them from OBS to the notebook instance. For details, see How Do I Upload a File from a Notebook Instance to OBS or Download a File from OBS to a Notebook Instance? Parent topic: Others
After it goes offline, you can use the templates for AI engine and model configurations by choosing OBS, setting AI Engine to Custom, and importing your custom AI engine.
Locally labeled data can be imported from an OBS directory or the manifest file. After the import, you can label the data again or modify the labels in ModelArts Data Management. For details about how to import data from an OBS directory or manifest file, see Import Operation.
AK/SK-based Authentication: Available for OBS Management, Data Management, Training Management (New Version), Training Management (Old Version), Model Management, and Service Management.
Introduction to Model Package Specifications When creating an AI application, make sure that any meta model imported from OBS complies with specifications. The model package specifications are used when you import one model.
In the cloud environment, after the model file is downloaded from OBS to /home/mind/model, the file owner will be changed to ma-user.
In the cloud environment, after the model file is downloaded from OBS to /home/mind/model, the file owner will be changed to ma-user.
Download data from OBS to notebook B. For details about how to upload and download files, see How Do I Upload a File from a Notebook Instance to OBS or Download a File from OBS to a Notebook Instance? Parent topic: Data Upload or Download
Possible Causes If the model is imported from OBS or a training job, the total size of the base image, model files, code, data files, and downloaded software packages exceeds the limit.
OBS obs:bucket:ListAllMybuckets obs:bucket:HeadBucket obs:bucket:ListBucket obs:bucket:GetBucketLocation obs:object:GetObject obs:object:GetObjectVersion obs:object:PutObject obs:object:DeleteObject obs:object:DeleteObjectVersion obs:object:ListMultipartUploadParts obs:object:AbortMultipartUpload
Model Package Structure When creating a model, make sure that any meta model imported from OBS complies with specifications. The model package specifications apply when you import one model. For multiple models, such as multiple files, use custom images instead.
Possible Causes When a meta model is imported from OBS, the service base image is used. However, the base image does not provide the SO data on which CV2 depends. Therefore, ModelArts does not support the import of CV2 model packages from OBS.
Failed to Obtain Certain Logs on the ModelArts Log Query Page Symptom I used a base image to import models through OBS and wrote some inference code for implementing the inference logic. After an error occurred, I attempted to use the fault logs to locate the fault.
Data may be stored in OBS or EVS, depending on which kind of storage you have configured for your Notebook instances: OBS After you click upload, the data is directly uploaded to the target OBS path specified when the notebook instance was created.
You can use OBS APIs or SDKs to download the models. For details, see Downloading an Object . Parent topic: API/SDK
Examples of Custom Scripts To create a model in ModelArts by importing a model file from OBS, the model file package needs to comply with the ModelArts model package specifications.
