Uploading Data to JupyterLab

Step 1: Uploading Files to OBS

Use the OBS API to upload large files because OBS Console has restrictions on the file size and quantity.

Step 2: Downloading Files from OBS to Notebook Instances

A notebook instance can be mounted to OBS or EVS as the storage location. The operation method varies depending on the instance types.

• Downloading files to notebook instances with EVS attached
  • Use the following MoXing API to synchronize files from OBS to notebook instances.
    Read an OBS file. For example, if you read the obs://bucket_name/obs_file.txt file, the content is returned as strings.

    1 2	import moxing as mox file_str = mox.file.read('obs://bucket_name/obs_file.txt')

    You can also open the file object and read data from it. Both methods are equivalent.

    1 2 3

    import moxing as mox with mox.file.File('obs://bucket_name/obs_file.txt', 'r') as f: file_str = f.read()

  • Use the OBS API in the ModelArts SDK to download data from OBS to notebook instances.
    

    If the size of a single file exceeds 5 GB, the file cannot be uploaded in this mode. Use the MoXing API to upload large files.

    Sample code:

    1 2 3

    from modelarts.session import Session session = Session() session.download_data(bucket_path="/bucket-name/dir1/sdk.txt", path="/home/user/sdk/obs.txt")

• Downloading files to notebook instances using OBS for data storage

  Upload files to the OBS path specified during notebook instance creation and synchronize the files from OBS to the notebook instances using Sync OBS.

Step 3: (Optional) Decompressing Files

If a file is uploaded to Notebook as a compressed package, you can decompress the package in Notebook Terminal.

unzip xxx.zip # Directly decompress the package in the path where the package is stored.

For more details, search for the decompression command in mainstream search engines.