检测到您已登录华为云国际站账号,为了您更好的体验,建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Dynamically Mounting an OBS Parallel File System Overview A parallel file system is an optimized high-performance file system provided by Object Storage Service (OBS). For details, see About Parallel File System. Dynamic OBS mounting uses a mounting tool to convert the object storage
ma-cli image Commands for Building Images The ma-cli image command can be used to obtain registered images, obtain or load image creation templates, create images using Dockerfiles, obtain or clear image creation caches, register or deregister images, and debug whether images can
Sample Code for Common Operations Data Reads and Writes Read an OBS file. For example, if you read the obs://bucket_name/obs_file.txt file, the content is returned as strings. 1 2 import moxing as mox file_str = mox.file.read('obs://bucket_name/obs_file.txt') You can also open the
Retrying, Stopping, or Running a Workflow Phase Retrying, Stopping, or Proceeding a Workflow Phase Retrying a phase If executing a single phase failed, you can click Retry to re-execute the current phase without restarting the workflow. Before the retry, you can modify configurations
Creating a Dataset Phase Description This phase integrates capabilities of the ModelArts dataset module, allowing you to create datasets of the new version. This phase is used to centrally manage existing data by creating datasets. It is usually followed by a dataset import phase
Configuring Text Analysis You can enable text and speech analysis by setting the analysis interaction type, analysis percentage, and agents to be analyzed. To enable text and speech analysis, you must set the analysis type (text, speech, or both) on the Text Analysis Configuration
Configuring Custom Indicators Indicators generated based on custom filter criteria and calculation logic can be used for indicator statistics display. Procedure Sign in to the AICC as a tenant administrator and choose Configuration Center > Quality Management > Analysis Field Define
Managing Indicator Categories Sign in to the AICC as a tenant administrator and choose Speech Text Analysis > Indicator Category Management. Figure 1 Indicator Category Management page Click Search. All indicator categories of the tenant are queried by default. You can query the indicator
Uploading Data to OBS and Preloading the Data to SFS Turbo Uploading Data to OBS An OBS bucket has been created by referring to Creating a Bucket. obsutil has been installed by referring to Downloading and Installing obsutil. Visit the ImageNet official website at http://image-net.org
Configuring the SFS Turbo Data Eviction Policy After an OBS bucket is added as the storage backend of an SFS Turbo HPC file system, you are advised to configure a cold data eviction duration. Once configured, SFS Turbo will automatically delete files that have not been accessed within
Figure 9 Directory for saving images Parent topic: Using FunctionGraph to Deploy Stable Diffusion for AI Drawing
Using a custom image to create AI applications If you have developed a model using an AI engine that is not supported by ModelArts, to use this model to create AI applications, do as follows: Create a custom image, import the image to ModelArts, and use it to create AI applications
The default value is basic. basic: A base Spark image provided by DLI is used. custom: A custom Spark image is used. ai: An AI image provided by DLI is used. --queue String No Queue name. Set this parameter to the name of a created DLI queue.
Applications of Custom Images During the development and runtime of AI services, complex environment dependencies need to be debugged for containerization. In the best practices of AI development in ModelArts, container images are used to provide fixed runtime environments.
Huawei Cloud AI Service AI Model Migration Service, Per Model and Huawei Cloud AI Service Application Migration Service, Per Application Binding Huawei Cloud AI Service Migration Adaptation Service, Standard Edition.
Huawei HiLens is an AI application development and runtime management platform featuring device-cloud synergy.
In AI development, ModelArts is also committed to improving the AI development experience and lowering the development threshold.
Configuring Auto Data Export from SFS Turbo to OBS After auto export is configured, checkpoint files periodically written to the SFS Turbo file system during training will be automatically exported to the OBS bucket for long-term storage. The asynchronous auto export does not interrupt
Starting, Stopping, or Deleting a Notebook Instance Starting or Stopping an Instance Stop the notebook instances that are not needed. You can also restart a stopped instance. Log in to the ModelArts console. In the navigation pane on the left, choose Development Workspace > Notebook
Sample Code for Advanced MoXing Usage If you are familiar with common operations, the MoXing Framework API document, and common Python code, you can refer to this section to use advanced MoXing Framework functions. Closing a File After File Reading Is Completed When you read an OBS