Skip to content

v0.11.3

Compare
Choose a tag to compare
@wjsi wjsi released this 10 Mar 11:15
· 51 commits to master since this release
6a51282

Features

  • Add new command line tool pyodps-pack to pack third-party libraries, recommended as standard packing mechanism
  • (Experimental) Add preliminary support for custom DataFrame functions with Python 3.8 / 3.9 / 3.10
  • Supports DataFrame column join methods
  • Support configuring instance settings via connection strings with SQLAlchemy
  • (Experimental) Supports external volume
  • Supports run_sql_interactive_with_fallback interface in pyodps
  • Supports get_max_partition for tables
  • Implements stream read and write of resources
  • Supports iterationg table partitions with logical conditions

Enhancements

  • Supports quota name when creating tunnels
  • Allow apply UDFs to use __getitem__
  • Reset table object when alter table is called
  • Allow persisting DataFrames with table objects
  • Support compression with LZ4 and zstd for tunnels
  • Remove dependencies of deprecated distutils package
  • Rename last_modified_time with last_data_modified_time for clarity
  • Refine error display and arrow format when fetching data with multiprocessing

Bug fixes

  • Fix downloading with multiprocessing under Windows
  • Fix negative timestamp issue under Windows
  • Fix multiple issues on Github
  • Resolve coded json when parsing
  • Add retry when encountering MetaTransactionFailed
  • Fix parsing RFC822 date when loading ODPS meta
  • Fix schema error when calling to_pandas() with columns specified
  • Fix handling NaNs with fillna
  • Fix compiling SQL scalars with different integer types

Compatibility Issues

  • As new Schema object level is introduced, it is now discouraged to use schema for table schemas and warnings will be produced. Try using table_schema instead when you code with the new version.
  • Attributes like creation_time now uses local time instead of UTC time for consistency with other datetime attributes by default. Switch to old behavior by setting options.use_legacy_parsedate = True.
  • Attribute last_modified_time on tables and partitions now renamed into last_data_modified_time for clarity. Warnings might be produced with old attribute names.