Skip to content

merge dev for release 0.9.6#190

Merged
davebulaval merged 222 commits intomainfrom
dev
Mar 31, 2023
Merged

merge dev for release 0.9.6#190
davebulaval merged 222 commits intomainfrom
dev

Conversation

@davebulaval
Copy link
Copy Markdown
Collaborator

  • Add Python 3.11.
  • Add pre-processor when parsing addresses.
  • Add pin_memory=True when using a CUDA device to increase performance as suggested
    by Torch documentation.
  • Add torch.no_grad() context manager in __call__() to increase performance.
  • Reduce memory swap between CPU and GPU by instantiating Tensor directly on the GPU device.
  • Improve some Warnings clarity (i.e. category and message).
  • Bug-fix MacOS multiprocessing. It was impossible to use in multiprocess since we were not testing whether torch
    multiprocess was set properly. Now, we set it properly and raise a warning instead of an error.
  • Drop Python 3.7 support since newer Python versions are faster
    and Torch 2.0 does not support Python 3.7.
  • Improve error handling with wrong checkpoint loading in AddressParser retrain_path use.
  • Add torch.compile integration to improve performance (Torch 1.x still supported) with mode="reduce-overhead" as
    suggested in the documentation. It
    increases the performance by about 1/100.

dependabot bot and others added 29 commits February 1, 2023 20:14
Bumps [docker/build-push-action](https://github.com/docker/build-push-action) from 3.2.0 to 4.0.0.
- [Release notes](https://github.com/docker/build-push-action/releases)
- [Commits](docker/build-push-action@c56af95...3b5e802)

---
updated-dependencies:
- dependency-name: docker/build-push-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: David Beauchemin <[email protected]>
* Bump black from 22.12.0 to 23.1.0

Bumps [black](https://github.com/psf/black) from 22.12.0 to 23.1.0.
- [Release notes](https://github.com/psf/black/releases)
- [Changelog](https://github.com/psf/black/blob/main/CHANGES.md)
- [Commits](psf/black@22.12.0...23.1.0)

---
updated-dependencies:
- dependency-name: black
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>

* bump pyproject.toml

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: David Beauchemin <[email protected]>
* Bump pylint from 2.15.10 to 2.16.2

Bumps [pylint](https://github.com/PyCQA/pylint) from 2.15.10 to 2.16.2.
- [Release notes](https://github.com/PyCQA/pylint/releases)
- [Commits](pylint-dev/pylint@v2.15.10...v2.16.2)

---
updated-dependencies:
- dependency-name: pylint
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Bump actions/checkout from 2 to 3 (#181)

Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 3.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](actions/checkout@v2...v3)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* fix warnings and new error

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: davebulaval <[email protected]>
* Bump pylint from 2.15.10 to 2.16.2

Bumps [pylint](https://github.com/PyCQA/pylint) from 2.15.10 to 2.16.2.
- [Release notes](https://github.com/PyCQA/pylint/releases)
- [Commits](pylint-dev/pylint@v2.15.10...v2.16.2)

---
updated-dependencies:
- dependency-name: pylint
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* fix warnings and new error

* add python 3.11

* add doc in script to run tests

* remove 3.10 and 3.11 tests for Windows since pip install fail

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* add missing with_hyphen_split argument in __call__

* reworked DataCleaning into a more flexible approach

* fix tests, improve doc and add more pre-processors
* minor improvements to doc, code and tests

* add multithreads tests in worker and fixed missing .to removal

* improve contributing and changelog
* improve error handling

* improve error handling with retrain model and test a test case with new error raise if no metadata

* fix tests and improve new fix with a better getter

* fix error message and improve tests

* fix pylint

* fix skipif to allow runner to run tests and fix call to prepare pretrained in locality of test to allow runner to run tests

* add fake ckpt creation in not integration tests

* fix setup class related to pre trained init

* fix setupclass error in some tests
* merge lengths as vector to lengths as list

* fix tests

* fix tests

* fix tests

* fix tests

* fix tests

* minor doc corrections

* fix pylint

* fix doc
@davebulaval davebulaval merged commit fdf1a8e into main Mar 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants