Files
doc-exports/docs/mrs/umn/en-us_topic_0000001442653993.html
Yang, Tong b7a42db732 MRS UMN 320-lts.1 version
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2023-08-13 18:25:47 +00:00

3.4 KiB

How Do I Access Spark in a Cluster with Kerberos Authentication Enabled?

  1. Log in to the master node in the cluster as user root.
  2. Run the following command to configure environment variables:

    source /opt/client/bigdata_env

  3. If the Kerberos authentication is enabled for the current cluster, run the following command to authenticate the user.

    kinit MRS cluster user

    Example:

    If the development user is a machine-machine user, run kinit -kt user.keytab sparkuser.

    If the development user is a human-machine user, run kinit sparkuser.

  4. Run the following command to connect to Spark Beeline:

    spark-beeline

  5. Run commands on Spark Beeline. For example, create the table test in the obs://mrs-word001/table/ directory.

    create table test(id int) location 'obs://mrs-word001/table/';

  6. Run the following command to query all tables. If table test is displayed in the command output, OBS access is successful.

    show tables;

  7. Press Ctrl+C to exit Spark Beeline.