Load from Google Cloud Storage (GCS)

If you store your data in Google Cloud Storage (GCS), TigerGraph Cloud provides seamless integration for data ingestion. You can directly load data from your GCS into your graph databases, eliminating the need for manual data transfers. This simplifies the process of importing large datasets and enables you to leverage the scalability and durability of Google Cloud Storage for your graph analysis.

1) Select Source

Once you’ve selected Google Cloud Storage, you will be asked to configure the GCS data source.

  1. Click on Screenshot 2024 04 17 at 9.36.58 PM to add a new GCS data source.

    gcs empty data source

  2. You will need to provide your GCS service account key by providing the service account file in JSON format.

    gcs data source details

  3. Once you have those configured, you can add one or multiple GCS URI within the same GCS account.

  4. Click Next to process the file(s).

    The current data loading tool only supports CSV,TSV and JSON files. Other formats will be available in later releases.

2) Configure File

This step lets you configure the source file details.

  1. The data loading tool will automatically detect the .csv separators and line breaks. The parser automatically splits each line into a series of tokens.

    config file

    If the parsing is not correct, click on the Screenshot 2024 04 17 at 5.54.17 PM button to configure a different option for the delimiter, such as eol, or quote and header.

    Screenshot 2024 04 17 at 5.54.50 PM

    The enclosing character is used to mark the boundaries of a token, overriding the delimiter character.

    For example, if your delimiter is a comma, but you have commas in some strings, then you can define single or double quotes as the enclosing character to mark the endpoints of your string tokens.

    It is not necessary for every token to have enclosing characters. The parser uses enclosing characters when it encounters them.

    You can edit the header line of the parsing result to give each column a more intuitive name, since you will be referring to these names when loading data to the graph. The header name is ignored during data loading.

  2. Once you are satisfied with the file settings, click Next to proceed.

3) Configure Map

If you are loading data into a brand new graph, you will be prompted to let our engine generate a schema and mapping for you. Or you can start from scratch. For more details of schema design please refer to Design Schema.

  1. Select Generate the schema only or Generate the schema and data mapping.

    Screenshot 2024 04 17 at 5.55.35 PM

    The schema generation feature is still a preview feature. The correctness and efficiency of the resulting graph schema and mapping could vary.

  2. In the Source column, you can choose the specific column from the data source that you want to map with the attribute.

    config mapping 1

  3. Use the + button to create a new attribute of the target vertex or edge.

    config mapping 2

  4. Click the Token Function button to configure token functions for the selected source. For more details of configuring token functions, please refer to Token Function.

  5. Click the Quick Map button to quickly map the data source headers to the existing schema attributes.

    quick map

    1. The Map all to target button aligns existing attribute names with the corresponding data source headers, it won’t introduce new attributes.

    2. The Map all from source button not only aligns existing attribute names with the corresponding dat asource headers, but also introduces new attributes based on unmatched data source headers.

    3. The following list shows the mapping status of each attribute, you can manually adjust the mapping by checking the box next to the attribute name.

  6. Click Next to proceed.

4) Confirm

This step will let you confirm the changes made to the schema and the data mapping you created to load the data.

  1. Simply review the Schema to be changed and Data to be loaded lists.

    confirm

    Please be aware that some schema changes will result in unintentional deletion of the data. Please carefully review the warning message before confirming the loading.

  2. Click on the Confirm button to run the loading jobs and monitor their Status.

    Screenshot 2024 04 17 at 5.59.16 PM

Next Steps

Next, learn how to use Design Schema, GSQL Editor and Explore Graph in TigerGraph Cloud 4.

Or return to the Overview page for a different topic.