The script development function provides the following capabilities:
- Provides an online script editor for developing and debugging SQL, Python, and Shell scripts.
- Supports script import and export.
- Allows use of variables and functions.
- Provides editing locks for collaborative development.
- Supports script version management and generation of saved and submitted versions.
If you save a script multiple times within a minute, only one version is recorded. If the intermediate data is important, you can click Save new version to save and add a version.
- Allows you to right-click a script to quickly copy the script name and to quickly close an opened script tab page.
- Provides a link in the execution results of MRS Spark SQL and MRS Hive SQL scripts that use a connection of the MRS API type. Through this link, you can switch to MRS Yarn to view execution logs.
- Allows you to filter submitted and unsubmitted scripts. Unsubmitted scripts are marked in red.
- Displays script parameters in a dialog box. Parameter values can be changed, but parameter names cannot. You can click Test Parameters to view (but not modify) the parameters referenced by the script and the environment variables configured in the environment. Parameters in the SQL statement can be sorted by name.
- Supports configuration of the SQL editor style. Move the cursor to
and click Style Configuration to configure the editor, icon display, annotation templates, and shortcut keys that can be used in the SQL script editor. - Allows you to view SQL query results in a table or list. You can click Style Configuration and set SQL Query Result Display Mode on the Configure Editor tab page.
- Allows you to go to the release page from the script development page in enterprise mode. Click Release to go to the task release page.
- Allows you to view tables of Hive SQL, DLI SQL, RDS SQL, Impala SQL, and DWS SQL scripts. You can expand a table name to view the column names, field types, and descriptions in the table.
- You can filter out the latest scripts by owner or update time.
- Fine-grained permission control is available for script development. You can configure permission control policies for the script directories in DataArts Factory.
The following figure shows the process of script development.
Figure 1 Script development process
- Create a script of the corresponding type. For details, see Creating a Script.
- Develop the script: Develop, debug, and execute the script online. For details, see Developing Scripts.
- Submit a version and unlock the script: After performing this step, the script can be scheduled by jobs and modified by other developers. For details, see Submitting a Version.
- (Optional) Manage the script: After the script development is complete, you can manage the script as required. For details, see (Optional) Managing Scripts.
- Release the script. This step is required in enterprise mode. For details, see Releasing a Script Task.