Skip to content

[PECO-1125]Add staging ingestion tests to PySql (Cloned from PECO-840)#234

Closed
nithinkdb wants to merge 1 commit into
databricks:mainfrom
nithinkdb:PECO-1125
Closed

[PECO-1125]Add staging ingestion tests to PySql (Cloned from PECO-840)#234
nithinkdb wants to merge 1 commit into
databricks:mainfrom
nithinkdb:PECO-1125

Conversation

@nithinkdb

@nithinkdb nithinkdb commented Sep 29, 2023

Copy link
Copy Markdown
Contributor

We need to add a suite of e2e tests for UC Volume ingestion.

Prior to this change, the test would pass for _any_ failure. This was
an oversight when writing the tests originally.

Signed-off-by: Jesse Whitehouse <jesse.whitehouse@databricks.com>

(2/8) Copy staging_ingestion_tests.py as a base for uc volume tests

Signed-off-by: Jesse Whitehouse <jesse.whitehouse@databricks.com>

(3/8) Rename mixin and wire in new tests to be discovered by pytest

Signed-off-by: Jesse Whitehouse <jesse.whitehouse@databricks.com>

(4/8) Remove staging_ingestion_user env var check

Signed-off-by: Jesse Whitehouse <jesse.whitehouse@databricks.com>

(5/8) Check for catalog and schema env vars

Signed-off-by: Jesse Whitehouse <jesse.whitehouse@databricks.com>

(6/8) I ran a CREATE VOLUME statement which succeeded on our test infra

Signed-off-by: Jesse Whitehouse <jesse.whitehouse@databricks.com>

(7/8) Rename all test methods

Signed-off-by: Jesse Whitehouse <jesse.whitehouse@databricks.com>

(8/8) Replace all staging paths with Volumes paths

Signed-off-by: Jesse Whitehouse <jesse.whitehouse@databricks.com>
@nithinkdb nithinkdb changed the title Add staging ingestion tests to PySql [PECO-1125]Add staging ingestion tests to PySql (Cloned from PECO-840) Sep 29, 2023
@susodapop

Copy link
Copy Markdown
Contributor

Tests are already written for this. Closing and will reopen with the latest changes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants