Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add capability to download Full OBIS Export of presence records? #94

Open
MathewBiddle opened this issue Sep 14, 2022 · 1 comment
Open
Labels
discussion needed open discussion. your input is needed! enhancement

Comments

@MathewBiddle
Copy link
Collaborator

OBIS provides a full export of presence records [1] in both csv [2] and parquet [3]. Would it be feasible to add something to pyobis that goes out and efficiently grabs the whole export?

I'm sure folks smarter than me know of ways to parallelize the call or do something fancy with the available services to download in a reasonable time frame.

[1] - https://obis.org/data/access/
[2] - https://obis-datasets.ams3.digitaloceanspaces.com/exports/obis_20220710.csv.zip
[3] - https://obis-datasets.ams3.digitaloceanspaces.com/exports/obis_20220710.parquet

Could also be a waste of time for this package.

@7yl4r
Copy link
Collaborator

7yl4r commented Sep 15, 2022

cough cough bittorrent cough. 🤐

@7yl4r 7yl4r added enhancement discussion needed open discussion. your input is needed! labels Sep 20, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
discussion needed open discussion. your input is needed! enhancement
Projects
None yet
Development

No branches or pull requests

2 participants