Skip to content

Latest commit

 

History

History
173 lines (110 loc) · 5.57 KB

CHANGELOG.md

File metadata and controls

173 lines (110 loc) · 5.57 KB
Raw

Changelog

All notable changes to this project will be documented in this file.

v0.17.0 -- 2024-08-04

Highlights

  • add support for zstd (zstandard) compression
  • allow setting ONEIO_ACCEPT_INVALID_CERTS=true to disable SSL checking
  • revised custom HTTP request function oneio::get_http_reader to allow specifying custom request::blocking::Client for any request customizations to allow specifying custom request::blocking::Client for any request customizations.

Breaking changes

  1. rename oneio::get_remote_reader to oneio::get_http_reader
  2. rename get_remote_ftp_raw to get_ftp_reader_raw
  3. change signatures of oneio::download, oneio::download_with_retry, oneio::get_http_reader's optional HashMap parameter for headers to optional reqwest::blocking::Client.

v0.16.8 -- 2024-05-22

Highlights

  • s3_url_parse allow parsing different protocols like r2:// or b2://
    • previously, if the URL did not start with s3:// it would return an error

v0.16.7 -- 2024-03-26

Highlights

  • make compressions mod always enabled and allow making all compression algorithms optional
    • to enable all compression algorithms, use oneio = { version = "0.16", default-features = false, features = ["compressions"] }
    • to enable specific compression algorithms, use oneio = { version = "0.16", default-features = false, features = ["gz", "bz", "lz", "xz"] }

v0.16.6 -- 2024-03-26

Highlights

  • make digest feature optional and disabled by default

v0.16.5 -- 2024-03-20

Highlights

  • add CONTENT_LENGTH=0 to headers to address some queries where the server request Content-Length field

v0.16.4 -- 2024-03-20

Hot fix

  • add http2 and charset feature flags to reqwest
    • the feature flags for reqwest has changed a lot between 0.11 and 0.12 and the http2 and charset features are necessary now

v0.16.3 -- 2024-03-20

  • switch flate2 to rust-backend default feature as the zlib-ng feature requires cmake to build and offers no performance improvement over the rust-backend feature
  • update reqwest to version 0.12

v0.16.2 -- 2024-02-23

Highlights

  • switching to flate2 with zlib-ng as the compression library for handling gzip files
    • zlib-ng is a drop-in replacement for zlib with better performance

v0.16.1 -- 2024-02-10

Highlights

  • add oneio::exists(path: &str) function to check if a local or remote file exists.
    • currently support local file, http(s) remote and s3 remote files checking

Example usages

assert!(!oneio::exists("https://spaces.bgpkit.org/oneio/test_data_NOT_EXIST.json").unwrap());
assert!(oneio::exists("https://spaces.bgpkit.org/oneio/test_data.json").unwrap());

v0.16.0 - 2024-01-29

Breaking changes

  • switch to rustls as the default TLS backend
  • clean up the feature flags
    • removed no-cache and vendored-openssl flags
    • removed openssl optional dependency
    • add digest feature flag to allow calculating SHA256 digest of a file, enabled by default

Library changes

  • add oneio::download_with_retry function to allow retrying download
  • add oneio::get_sha256_digest function to the library to calculate SHA256 digest of a file

CLI changes

  • add oneio digest FILE command to calculate file SHA256 digest

v0.15.10 - 2024-01-26

Hot fix

  • fixed issue where oneio s3 list BUCKET PREFIX command not showing files match the prefix unless they are on the same directory as the prefix
  • fixed issue where running oneio without argument causing program to panic

v0.15.9 - 2024-01-26

Highlights

  • add support for installing via cargo binstall
  • s3_list now accepts a new forth parameter, dirs boolean flag, to allow returning only the matching directories
  • add oneio s3 list and oneio s3 upload commands to the CLI

Breaking changes

The signature of s3_list function is now changed to:

pub fn s3_list(
    bucket: &str,
    prefix: &str,
    delimiter: Option<String>,
    dirs: bool,
) -> Result<Vec<String>, OneIoError> {}

This includes changes of:

  1. delimiter changed from Option<&str> to Option<String>
  2. new dirs boolean flag to allow returning only matching directories in the specified prefix
    • the delimiter is also automatically forced to Some("/".to_string()) if dirs is specified and delimiter is specified as None.

Misc

  • "cargo publish" process is now automated with GitHub actions
  • test process now makes sure s3 modules' doc-tests must compile

v0.15.8 - 2023-12-18

Highlights

  • Added vendored-openssl flag to enable GitHub actions builds for different systems.
  • Automatically builds CLI binary for macOS (Universal), and linux (arm and amd64) during GitHub release

v0.15.8-beta.1 - 2023-12-16

Highlights

  • GitHub actions uses vendored openssl instead of system openssl.

v0.15.7 - 2023-12-16

Highlights

  • Module Refactoring: A dedicated module has been created for remote and utils. (ec80e0236170f13e9eec2450eeaa8334e255a1ee)
  • Improvements in Caching Control: The HTTP caching is now controllable and disabled for CLI requests. (69de57c5f9a7003edecde2fe6641c438abe233a5)
  • Improved Error Handling: We have improved error handling in line reads. The application no longer attempts to read further if a line read fails, preventing any stalls. (fd1352fa2cb701e3fb336a4b6f99014d76d64788)

v0.15.6 - 2023-12-16

Added

  • support getting oneio reader directly by supplying an S3 URL: #31