Add Airflow SmartSuggest [Don't merge] #1508
Closed
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Airflow SmartSuggest is an intelligent assistant designed to enhance the Apache Airflow experience by providing smart suggestions for anomalies detection for DAGs, tasks and airflow resources like workers, schedulers, triggerers alerting users for cost and performance optimizations. Airflow SmartSuggest also helps to analyze DAG code and logs providing recommendations around best DAG writing practices and error resolution directly on Airflow UI. It uses Ask-Astro APIs and statistical methods for the analysis. This tool aims to integrate directly into the Airflow UI, offering real-time alerts for anomalies, DAG code optimizations, error resolution, cluster profilings and metrics suggestions. Itl also includes security features to detect and alert users about sensitive information inadvertently included in their DAG code.
This is the page for anomaly detection:
This is the page for Airflow SmartSuggest code analysis:
This is the page for Airflow SmartSuggest log analysis:
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named
{pr_number}.significant.rst
or{issue_number}.significant.rst
, in newsfragments.