检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
检测到您已登录华为云国际站账号，为了您更好的体验，建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
OBS Source Table Function The file system connector can be used to read single files or entire directories into a single table. When using a directory as the source path, there is no defined order of ingestion for the files inside the directory.
Unmounting OBS Storage from a Notebook Instance Function This API is used to unmount OBS storage from a notebook instance. After OBS storage is unmounted, OBS objects remain unchanged but cannot be operated in the notebook container.
A table dataset can import data from sources such as OBS and MRS. To import data from an OBS directory, you must have the read permission on the OBS directory. The OBS buckets and ModelArts must be in the same region.
Figure 3 Entering a valid OBS file path Enter an OBS file path instead of a folder path. Otherwise, the upload fails. Method 2: Open OBS File Browser, select an OBS file path, and click Upload.
How Do I Fix Incorrect Data in an OBS Foreign Table Caused by Newline Characters in OBS File Fields? Symptom When an OBS foreign table is created, a field in the specified OBS file contains a carriage return line feed (CRLF) character. As a result, the data is incorrect.
OBS path format: obs://OBS parallel file system name/XXX hadoop fs -ls "obs://obs-example/job/hadoop-mapreduce-examples-3.1.2.jarobs-example/job/hadoop-mapreduce-examples-3.1.2.jar" To delete files on OBS using hadoop fs commands, run hadoop fs -rm -skipTrash.
Why Does Agency Creation for OBS Fail When an OBS Private Bucket Is Used as the Origin Server? Possible causes: Your IAM agency quota has been used up. On the Quotas page of the IAM console, check whether the agency quota has been used up.
The system will automatically create the folder in /data/ of the notebook container to mount the OBS file system. Select the folder for storing the OBS parallel file system and click OK.
Will I Be Charged for Reading Images from OBS? If the OBS bucket and the API server of the invoked service are in the same region, reading images from the OBS bucket does not consume traffic or incur fees.
Connecting OBS to a Hive Cluster Configure related items (including AK, SK, endpoint, and impl) in file core-site.xml in the Hive cluster. Restart the Hive cluster and then the client. Parent Topic: Connecting Big Data Platforms to OBS
Will I Be Charged for Reading Images from OBS? If the OBS bucket and the API server of the invoked service are in the same region, reading images from the OBS bucket does not consume traffic or incur fees.
Using PFS with OBS APIs Compatibility Between OBS APIs and PFS
Parent Topic: Connecting Big Data Platforms to OBS
How Do I Upload Data to OBS? Before using ModelArts to develop AI models, data needs to be uploaded to an OBS bucket. You can log in to the OBS console to create an OBS bucket, create a folder in it, and upload data.
How Are Snapshots Stored in OBS? You can choose Full storage or Instant storage when configuring a snapshot template. Instant storage: Only the latest snapshot is saved.
Required actions are missing from the configuration: Some permissions required by OBS Console or OBS Browser+ for other actions are often ignored.
OBS Data Source Connection Failed Cause Analysis The possible causes are as follows: The data source address is not set to the endpoint address. The AK/SK and bucket name are incorrect. Solution Change the data source address to the endpoint address.
OBS Data Source Connection Failed Cause Analysis The possible causes are as follows: The data source address is not set to the endpoint address. The AK/SK and bucket name are incorrect. Solution Change the data source address to the endpoint address.
Spark on OBS Performance Tuning Scenario In the scenario where a small number of requests are frequently sent from Spark on OBS to OBS, you can disable OBS monitoring to improve performance. Configuration Modify the configuration in the core-site.xml file on the Spark client.
OBS can log bucket access requests for further request analysis or log audit. Logs occupy the OBS storage that incurs costs, so OBS does not collect bucket access logs by default. OBS creates log files and uploads them to a specified bucket.
