cli/acceptance/bundle/integration_whl/custom_params/output.txt at f6a83319038367a1a246f23d8e434a7881b6d0e2 · databricks/cli · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57

>>> cat databricks.yml
bundle:
  name: wheel-task

workspace:
  root_path: "~/.bundle/[UNIQUE_NAME]"

include:
  - empty.yml

resources:
  jobs:
    some_other_job:
      name: "[${bundle.target}] Test Wheel Job [UNIQUE_NAME]"
      tasks:
        - task_key: TestTask
          new_cluster:
            num_workers: 1
            spark_version: 13.3.x-snapshot-scala2.12
            node_type_id: [NODE_TYPE_ID]
            data_security_mode: USER_ISOLATION
            instance_pool_id: [TEST_INSTANCE_POOL_ID]
          python_wheel_task:
            package_name: my_test_code
            entry_point: run
            parameters:
              - "one"
              - "two"
          libraries:
          - whl: ./dist/*.whl

>>> [CLI] bundle deploy
Building python_artifact...
Uploading dist/my_test_code-0.0.1-py3-none-any.whl...
Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/[UNIQUE_NAME]/files...
Deploying resources...
Updating deployment state...
Deployment complete!

>>> [CLI] bundle run some_other_job --python-params param1,param2
Run URL: [DATABRICKS_URL]/?o=[NUMID]#job/[SOME_OTHER_JOB_ID]/run/[NUMID]

[TIMESTAMP] "[default] Test Wheel Job [UNIQUE_NAME]" RUNNING
[TIMESTAMP] "[default] Test Wheel Job [UNIQUE_NAME]" TERMINATED SUCCESS
Hello from my func
Got arguments:
['my_test_code', 'param1', 'param2']

>>> [CLI] bundle destroy --auto-approve
The following resources will be deleted:
  delete resources.jobs.some_other_job

All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/[UNIQUE_NAME]

Deleting files...
Destroy complete!