unit test issues with postgres after upgrading to 2.0 and then downgrading to 1.10.14

[meltedhead]

I'm still getting a failure with some tests that were previously working. This is linked ot my previous post which has been resolved for most of my tests. Postgres operator tests won't run.

linked to previous post #13204

[[](/Users/user1/.pyenv/versions/3.6.10/bin/python` "/Users/user1/Library/Application Support/JetBrains/Toolbox/apps/PyCharm-P/ch-0/203.5981.165/PyCharm.app/Contents/plugins/python/helpers/pycharm/_jb_pytest_runner.py" --path /Users/user1/Workspaces/bitbucket/comp/dags-airflow/tests/operators/modelling/language/test_injest_test_description_operator.py
Testing started at 11:13 ...
Launching pytest with arguments /Users/user1/Workspaces/bitbucket/comp/dags-airflow/tests/operators/modelling/language/test_injest_test_description_operator.py in /Users/user1/Workspaces/bitbucket/comp/dags-airflow/tests/operators/modelling/language

============================= test session starts ==============================
platform darwin -- Python 3.6.10, pytest-5.3.0, py-1.9.0, pluggy-0.13.1 -- /Users/user1/.pyenv/versions/3.6.10/bin/python
cachedir: .pytest_cache
rootdir: /Users/user1/Workspaces/bitbucket/comp/dags-airflow/tests/operators/modelling/language
plugins: mock-3.4.0, instafail-0.4.2, requests-mock-1.8.0, postgresql-2.5.2, timeouts-1.2.1, flaky-3.7.0, tornasync-0.6.0.post2, airflow-0.0.3, celery-4.4.7, jupyter-server-1.0.7, docker-tools-1.0.0, cov-2.10.1
setup timeout: 0.0s, execution timeout: 0.0s, teardown timeout: 0.0s
collecting ... collected 3 items

test_injest_test_description_operator.py::TestInjestTestDescriptionOperator::testTmpFileCreation FAILED [ 33%]
test_injest_test_description_operator.py:44 (TestInjestTestDescriptionOperator.testTmpFileCreation)
self = <sqlalchemy.engine.base.Connection object at 0x1276e3470>
dialect = <sqlalchemy.dialects.sqlite.pysqlite.SQLiteDialect_pysqlite object at 0x10f572518>
constructor = <bound method DefaultExecutionContext._init_compiled of <class 'sqlalchemy.dialects.sqlite.base.SQLiteExecutionContext'>>
statement = 'SELECT connection.password AS connection_password, connection.extra AS connection_extra, connection.id AS connection_...ypted, connection.is_extra_encrypted AS connection_is_extra_encrypted \nFROM connection \nWHERE connection.conn_id = ?'
parameters = ('postgres_default',)
args = (<sqlalchemy.dialects.sqlite.base.SQLiteCompiler object at 0x1276e3390>, [immutabledict({})])
conn = <sqlalchemy.pool.base._ConnectionFairy object at 0x1276e3128>
context = <sqlalchemy.dialects.sqlite.base.SQLiteExecutionContext object at 0x1276e3d30>

    def _execute_context(
        self, dialect, constructor, statement, parameters, *args
    ):
        """Create an :class:`.ExecutionContext` and execute, returning
        a :class:`_engine.ResultProxy`.
    
        """
    
        try:
            try:
                conn = self.__connection
            except AttributeError:
                # escape "except AttributeError" before revalidating
                # to prevent misleading stacktraces in Py3K
                conn = None
            if conn is None:
                conn = self._revalidate_connection()
    
            context = constructor(dialect, self, conn, *args)
        except BaseException as e:
            self._handle_dbapi_exception(
                e, util.text_type(statement), parameters, None, None
            )
    
        if context.compiled:
            context.pre_exec()
    
        cursor, statement, parameters = (
            context.cursor,
            context.statement,
            context.parameters,
        )
    
        if not context.executemany:
            parameters = parameters[0]
    
        if self._has_events or self.engine._has_events:
            for fn in self.dispatch.before_cursor_execute:
                statement, parameters = fn(
                    self,
                    cursor,
                    statement,
                    parameters,
                    context,
                    context.executemany,
                )
    
        if self._echo:
            self.engine.logger.info(statement)
            if not self.engine.hide_parameters:
                self.engine.logger.info(
                    "%r",
                    sql_util._repr_params(
                        parameters, batches=10, ismulti=context.executemany
                    ),
                )
            else:
                self.engine.logger.info(
                    "[SQL parameters hidden due to hide_parameters=True]"
                )
    
        evt_handled = False
        try:
            if context.executemany:
                if self.dialect._has_events:
                    for fn in self.dialect.dispatch.do_executemany:
                        if fn(cursor, statement, parameters, context):
                            evt_handled = True
                            break
                if not evt_handled:
                    self.dialect.do_executemany(
                        cursor, statement, parameters, context
                    )
            elif not parameters and context.no_parameters:
                if self.dialect._has_events:
                    for fn in self.dialect.dispatch.do_execute_no_params:
                        if fn(cursor, statement, context):
                            evt_handled = True
                            break
                if not evt_handled:
                    self.dialect.do_execute_no_params(
                        cursor, statement, context
                    )
            else:
                if self.dialect._has_events:
                    for fn in self.dialect.dispatch.do_execute:
                        if fn(cursor, statement, parameters, context):
                            evt_handled = True
                            break
                if not evt_handled:
                    self.dialect.do_execute(
>                       cursor, statement, parameters, context
                    )

/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/engine/base.py:1277: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <sqlalchemy.dialects.sqlite.pysqlite.SQLiteDialect_pysqlite object at 0x10f572518>
cursor = <sqlite3.Cursor object at 0x1276f3110>
statement = 'SELECT connection.password AS connection_password, connection.extra AS connection_extra, connection.id AS connection_...ypted, connection.is_extra_encrypted AS connection_is_extra_encrypted \nFROM connection \nWHERE connection.conn_id = ?'
parameters = ('postgres_default',)
context = <sqlalchemy.dialects.sqlite.base.SQLiteExecutionContext object at 0x1276e3d30>

    def do_execute(self, cursor, statement, parameters, context=None):
>       cursor.execute(statement, parameters)
E       sqlite3.OperationalError: no such table: connection

/Users/user1/.pyenv/versions/3.6.10/lib/python3.6/site-packages/sqlalchemy/engine/default.py:593: OperationalError

The above exception was the direct cause of the following exception:

self = <tests.operators.modelling.language.test_injest_test_description_operator.TestInjestTestDescriptionOperator testMethod=testTmpFileCreation>

    def testTmpFileCreation(self):
>       self.target.execute(None)

test_injest_test_description_operator.py:46: ](url)

[potiuk]

You likely have to remove and recreate an existing sqlite database. Airlfow stores SQlite databases in ${AIRFLOW_HOME} or ${HOME}/airflow if AIRFLOW_HOME is not defined. when running tests. Simply wipe that directory out before running tests. That should help.

This is an sqlite test that is failing not postgres one:

    def do_execute(self, cursor, statement, parameters, context=None):
>       cursor.execute(statement, parameters)
E       sqlite3.OperationalError: no such table: connection