检测到您已登录华为云国际站账号,为了您更好的体验,建议您访问国际站服务网站 https://www.huaweicloud.com/intl/zh-cn
不再显示此消息
Why Are the Column Values Incorrect When the CSV File on the Source OBS Is Parsed to the Relational Database? This occurs during task configuration if the sequence of filling in metadata of the source OBS is different from that of the columns in the CSV file.
OBS The OBS connector provides massive, secure, highly reliable, and low-cost object-based cloud storage capabilities via Huawei Cloud Object Storage Service (OBS). Creating an OBS Connection Log in to the new ROMA Connect console.
By default, FDI obtains files from OBS based on the timestamp in descending order. The file uploaded at the latest time is parsed first, and the file uploaded at the earliest time is parsed last.
OBS Data Source Connection Failed Cause Analysis The possible causes are as follows: The data source address is not set to the endpoint address. The AK/SK and bucket name are incorrect. Solution Change the data source address to the endpoint address.
OBS Data Source Connection Failed Cause Analysis The possible causes are as follows: The data source address is not set to the endpoint address. The AK/SK and bucket name are incorrect. Solution Change the data source address to the endpoint address.
Huawei Cloud Services FunctionGraph SMS SMN OBS DSC CodeArts Artifact CodeArts Build CodeArts Check CodeArts Deploy CodeArts Req CodeArts Pipeline CodeArts Repo CodeArts TestPlan CodeArts IDE Online CodeArts PerfTest Parent topic: Connectors
Huawei Cloud OBS objects only. Example: obs://hwbucket/hwinfo/hw.png, where obs:// is OBS, hwbucket is the bucket name, and hwinfo/hw.png is the full path name of the object. mark_len Length of the watermark to extract. Range: 0–32.
Connecting to an OBS Data Source Overview ROMA Connect can use the OBS database as a data source for data integration tasks. Before using the OBS data source, you need to connect it to ROMA Connect.
Will Collected Data Be Updated After a File Is Parsed from OBS to the RDS Database? Why Are the Column Values Incorrect When the CSV File on the Source OBS Is Parsed to the Relational Database?
Object Storage Service (OBS) OBS is an object-based cloud storage service that provides massive, secure, highly reliable, and cost-effective data storage capabilities for users to store data of any type and size.
OBS Back to Overview If Integration Mode is set to Scheduled, OBS can be selected as the destination data source. Table 9 OBS destination information Parameter Description Object Type Select the type of the data file to be written to the OBS data source.
In this application, the OBS data serves as the source of data mapping, while MySQL is the destination. Use the OpenAPI to call the OBS connector to list bucket objects as the import file of the source data source.
Before configuring the abnormal data storage, connect to the OBS data source. For details, see Connecting to an OBS Data Source.
Currently, URLs for temporarily authorized access and anonymously and publicly authorized access to audio files stored on OBS are supported. For details about how to set the OBS access permission, see Configuring the Access Permission of OBS.
Data Sources Data Source Connection Failed MRS Hive Data Source Connection Failed FTP Data Source Connection Failed OBS Data Source Connection Failed Kafka Data Source Connection Failed
Data Sources Data Source Connection Failed MRS Hive Data Source Connection Failed FTP Data Source Connection Failed OBS Data Source Connection Failed Kafka Data Source Connection Failed
Procedure Before configuring fault information storage, ensure that you have connected the OBS data source to ROMA Connect. For details, see Connecting to an OBS Data Source. On the Create Task page, configure parameters for fault information storage.
OBS (OBS remote address, which is used by the OBS data source) MONGODB (addresses of the host of the MongoDB data source type, in the format of IP address:Port number, and separated by commas (,)) REDIS (addresses of the host of the Redis data source type, in the format of IP address
The value can be: HTTP/HTTPS URLs on the public network Huawei Cloud OBS URLs. To use OBS data, authorization is required, including service authorization, temporary authorization, and anonymous public authorization. For details, see Configuring the Access Permission of OBS.
Source Connecting to a MySQL Data Source Connecting to a MongoDB Data Source Connecting to an MQS Data Source Connecting to an MRS Hive Data Source Connecting to an MRS HDFS Data Source Connecting to an MRS HBase Data Source Connecting to an MRS Kafka Data Source Connecting to an OBS