Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SnowflakeOperator expiring Token #1342

Open
jonathanleek opened this issue Oct 17, 2023 · 0 comments
Open

SnowflakeOperator expiring Token #1342

jonathanleek opened this issue Oct 17, 2023 · 0 comments
Assignees
Labels
bug Something isn't working stale

Comments

@jonathanleek
Copy link

Describe the bug
In Airflow 2.7.1, it appears that the SnowflakeOperator is not renewing it's token when deferred, causing the task to fail to resume.

To Reproduce
Steps to reproduce the behavior:
Defer a Snowflake Sensor for an extended period of time.

Expected behavior
Token should renew, similar to how the AWSBaseHook does (#1292)

Screenshots
[2023-09-26T13:10:00.446+0000] {snowflake.py:219} INFO - Task deferred [2023-09-26T13:10:00.453+0000] {taskinstance.py:1524} INFO - Pausing task as DEFERRED. dag_id=*****, task_id=*******, execution_date=20230925T080000, start_date=20230926T130958

When it resumed 5 minutes later it failed
[2023-09-26T13:15:29.054+0000] {taskinstance.py:1935} ERROR - Task failed with exception Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 1608, in resume_execution return execute_callable(context) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/astronomer/providers/snowflake/operators/snowflake.py", line 242, in execute_complete msg = f"sfquid: {event['query_id']}, {event['type']}: {event['message']}" ~~~~~^^^^^^^^^^^^ KeyError: 'query_id'

Desktop (please complete the following information):
Astro Runtime 9.1.0

@jonathanleek jonathanleek added the bug Something isn't working label Oct 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working stale
Projects
None yet
Development

No branches or pull requests

2 participants