Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create an equivalent of pandas LoadOptions for writing #1941

Open
9 tasks
ianbuss opened this issue May 25, 2023 · 0 comments
Open
9 tasks

Create an equivalent of pandas LoadOptions for writing #1941

ianbuss opened this issue May 25, 2023 · 0 comments
Labels
feature New feature or request

Comments

@ianbuss
Copy link
Contributor

ianbuss commented May 25, 2023

Please describe the feature you'd like to see
The serialization methods on Pandas DFs accept quite a few kwargs which we're not currently exposing. One example is the index=True|False parameter which allows us to drop the DF index when writing to file.

Describe the solution you'd like
I'd like to see an equivalent, or something similar to, the https://astro-sdk-python.readthedocs.io/en/stable/autoapi/astro/dataframes/load_options/index.html called save_options or export_options which allows for fine tuning Pandas DF exports.

Acceptance Criteria

  • All checks and tests in the CI should pass
  • Unit tests (90% code coverage or more, once available)
  • Integration tests (if the feature relates to a new database or external service)
  • Example DAG
  • Docstrings in reStructuredText for each of methods, classes, functions and module-level attributes (including Example DAG on how it should be used)
  • Exception handling in case of errors
  • Logging (are we exposing useful information to the user? e.g. source and destination)
  • Improve the documentation (README, Sphinx, and any other relevant)
  • How to use Guide for the feature (example)
@ianbuss ianbuss added the feature New feature or request label May 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant