* Use and configure license-maven-plugin (org.honton.chas) * First setup of distribution verification integration test * Use Java 17 for compilation, updates of test dependencies, update license validation config * Update comment on CacioTest annotation * Cleanup * Add generating fat jars for WhiteRabbit and RabbitInAHat; lock hsqldb version for Java 1.8 * Enforce Java 1.8 for distributed dependencies * Update main.yml Project now requires Java 17 to build. Should still produce java 8 (1.8) compatible artifacts though. * Bump org.apache.avro:avro from 1.11.2 to 1.11.3 in /rabbit-core Bumps org.apache.avro:avro from 1.11.2 to 1.11.3. --- updated-dependencies: - dependency-name: org.apache.avro:avro dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Use jdk8 classifier for hsqldb 2.7.x * Exclude older version of hsqldb * Fix image crop when using stem table * Update stem table image * Decrease size of table panel when using stem table. Without this change, the table panel height is always higher than needed (when using stem table), because the stem table is counted as one of the items in the components list. It is however shown separately at the top, which is already accounted for by the stem table margin. * Add snowflake support (#37) * Refactor RichConnection into separate classes, and add an abstraction for the JDBC connection. Implement a Snowflake connection with this abstraction * Add unit tests for SnowflakeConnector * Added Snowflake support for SourceDataScan; added minimal test for it; some refactorings to move database responsibility to rabbit-core/databases * Move more database details to rabbit-core/databases * Clearer name for method * Ignore snowflake.env * Create PostgreSQL container in the TestContainers way * Refactored Snowflake tests + a bit of documentation * Fix Snowflake test for Java 17, and make it into an automated integration test instead of a unit test * Remove duplicate postgresql test * Make TestContainers based database tests into automated integration tests * Suppress some warnings when generating fat jars * Let autimatic integration tests fail when docker is not available * Allow explicit skipping of Snowflake integration tests * Added tests for Snowflake, delimited text files * Switch to fully verifying the scan results against a reference version (v0.10.7) * Working integration test for Snowflake, and some refactorings * Some proper logging, small code improvements and cleanup * Remove unused interface * Added tests, some changes to support testing * Make automated test work reliably (way too many changes, sorry) * Rudimentary support for Snowflake authenticator parameter (untested) * review xmlbeans dependencies, remove conflict * extend integration test for distribution * Restructuring database configuration. Work in process, but unit and integration tests all OK * Restructuring database configuration 2/x. Still work in process, but unit and integration tests all OK * Restructuring database configuration 3/x. Still work in process, but unit and integration tests all OK * Restructuring database configuration 4/x. Still work in process, but unit and integration tests all OK * Restructuring database configuration 5/x. Still work in process, but unit and integration tests all OK * Restructuring database configuration 6/x. Still work in process, but unit and integration tests all OK * Restructuring database configuration 7/x. Still work in process, but unit and integration tests all OK * Intermezzo: get rid of the package naming error (upper case R in whiteRabbit) * Intermezzo: code cleanup * Snowflake is now working from the GUI. And many small refactorings, like logging instead of printing to stout/err * Refactor DbType into an enum, get rid of DBChoice * Move DbType and DbSettings classes into configuration subpackage * Avoid using a manually destructured DbSettings object when creating a RochConnection object * Code cleanup, remove unneeded Snowflake references * Refactoring, code cleanup * More refactoring, code cleanup * More refactoring, code cleanup and documentation * Make sure that order of databases in pick list in GUI is the same as before, and enforce completeness of that list in a test * Add/update copyright headers * Add line to verify that a tooltip is shown for a DBConnectionInterface implementing class * Test distribution for Snowflake JDBC issue with Java 17 * cleanup of build files * Add verification that all JDBC drivers are in the distributed package * Add/improve error reporting for Snowflake * Disable screenshottaker in GuiTestExtension, hoping that that is what blocks the build on github. Fingers crossed * Better(?) naming for database interface and implementing class * Use our own GUITestExtension class --------- Co-authored-by: Jan Blom <janblom@thehyve.nl> * Add mysql test (#38) * Fixed a bug in the comparison for sort; let comparison report report all differences before failing * Allow the user to specify the port for a MySQL server * Add tests for a MySQL source database * Add sas test (#39) * Add automated regression tests for SAS files * Fix problems with comparisons of test results to references * create bypass for value mismatch that only shows up in github actions so far * create bypass for value mismatch that only shows up in github actions so far, 2nd * Pom updates to enable building on MacOS * Prepare release (#40) * Add warehouse/database handling to StorageHandler class * Show stdout/stderr from distribution verification when there are errors * Pom updates to enable building on MacOS * Update dependencies as far as possible without code changes * Update README.md --------- Co-authored-by: Jan Blom <janblom@thehyve.nl> * Update whiterabbit/src/main/java/org/ohdsi/whiterabbit/WhiteRabbitMain.java The sample size should start disabled, as the calculateNumericStats checkbox is unchecked by default. Co-authored-by: Maxim Moinat <maximmoinat@gmail.com> * Fixes from windows (#41) * Fix problems blocking verification on Windows * Avoid using bind mounts for TestContainers, copy files instead * Remove file copy (was for debugging purposes) * Oracle Tests: use the actual TestContainer hostname/ip address instead of localhost * Remove debug print statement and stale imports * Remove commented code --------- Co-authored-by: Jan Blom <janblom@thehyve.nl> * Use The Hyve fork of the caciocavello project (#42) * Use The Hyve fork of the caciocavello project (Swing virtual graphics environment for testing) until the parent project has been fixed for JDK 18+ * Use updated cacio-tta version, should run fine when headless * For developemnt, JDK versions 17-21 are supported * Update docs (#44) * Update documentation for Snowflake * Add Snowflake.ini example file * Add password field in Snowflake example * Bump org.apache.commons:commons-compress in /rabbit-core (#47) Bumps org.apache.commons:commons-compress from 1.25.0 to 1.26.0. --- updated-dependencies: - dependency-name: org.apache.commons:commons-compress dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump org.postgresql:postgresql from 42.7.1 to 42.7.2 in /rabbit-core (#46) Bumps [org.postgresql:postgresql](https://github.com/pgjdbc/pgjdbc) from 42.7.1 to 42.7.2. - [Release notes](https://github.com/pgjdbc/pgjdbc/releases) - [Changelog](https://github.com/pgjdbc/pgjdbc/blob/master/CHANGELOG.md) - [Commits](https://github.com/pgjdbc/pgjdbc/commits) --- updated-dependencies: - dependency-name: org.postgresql:postgresql dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Turn on mvn verify in github (#45) * Turn on mvn verify in github * Disable Oracle integration tests in Github workflow as they tend to generate a timeout * Fix typo * Avoid starting containers for Snowflake when configuration is not present * Switch cacio back to parent project (#48) * Use cacio-tta 1.18 instead of patched fork * Remove license exception for The Hyve fork of cacio-tta * Remove bigquery jars (#49) * Initial setup for BigQuery integration test (WIP) * Initial setup for BigQuery integration test (WIP) * Removed BigQuery JDBC jars, added test to confirm it missing, and the way to make it work * Make Teradata JDNC dependency a normal maven repo dependency. Include a basic tester, and remove lib directory * Rename Teradata test, it only tests getting tablenames, does not perform a scan * Add basic connection test for MS Sql Server * Round up removing BigQuery and Teradata (licences do not allow redistribution). Better feedback to user, added to documentation * Test multiple platforms for runs-on Since the documentation won't let me find out if it is possible. * Revert to only ubuntu-latest * added an additional option to hide specific tables, currently only match case is implemented * Changed functionality of the hide tables, now uses JTables and supports Regex * Refactored MaskListDialog.java to extend JDialog * Refactored functionality to retain mappings even if the source table is hidden and added a test for hiding tables * Added support for parsing dates of YMD, DMY and MDY formats with different separators. * Removed unused imports * fix Word generator * removed fraction unique from scanReport * updated scanReports to not include the Fraction unique column * Added a sentence about required fields to documentation * Re-enabled the unit tests for RabbitInAHat; merged the 'hide tables' test into the existing test for RabbitInAHat * Remove SNAPHOT from whiterabbit dependency * Bump org.apache.avro:avro from 1.11.3 to 1.11.4 in /rabbit-core (#58) Bumps org.apache.avro:avro from 1.11.3 to 1.11.4. --- updated-dependencies: - dependency-name: org.apache.avro:avro dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * All versions now in parent pom (dependencyManagement section), all mi… (#60) * All versions now in parent pom (dependencyManagement section), all minor upgrades done, mvn verify passes including snowflake * Add log4j-api, hoping to fix build problems in CI * Force protobuf dependency to 3.25.5 * Add BSD-3_Clause to accepted licenses * Added manual config for dependency-check, with optional suppression(s), currently jackson-databind * Add documentation on checking vulnerabilities and allowed licences * Clarified vulnerabilities checking * Added infon checking dependency versions * Add unit test for isDate() * Ran docs/runmarkdown.R; added generated html files * Add databricks support (#62) * Fix postgres tests: use newer version of TestContainer for postgres * First steps with Databricks. No configuration yet, so clearly a W.I.P. * Add configuration handling to DatabricksHandler * Working integration test based on ini file (command line usage of WhiteRabbit) * Exclude old log4j dependency * Use catalog and schema in table specification. Integration test for command line now ok. * Add browser flow for Databricks authentication * Add GUI based scan test for Databricks * Rename 2 base classes (now both abstract) to clarify their intent * Add some documentation here and there * Move Databricks tests from the maven phase to the phase * Add a remark about manyally testing browser flow authentication * Scripts, data and additional documentation for the Databriks test data * Attempt to fix build on github * Test if latest version of maven-resources-plugin also works * Add ini file example for Databricks * Ignore python version file * Databricks: add LIMIT x to TABLESAMPLE statement; ignore commented column names * Documentation for Databricks * Dependency updates * Disable distribution verification (almost obsolte anyway as we will move to Java 17 as the minimum version * [Snyk] Security upgrade org.apache.commons:commons-compress from 1.26.0 to 1.28.0 (#438) (#63) * fix: rabbit-core/pom.xml to reduce vulnerabilities The following vulnerabilities are fixed with an upgrade: - https://snyk.io/vuln/SNYK-JAVA-ORGAPACHECOMMONS-10734078 * Resolve dependencies on old version of commons-io --------- Co-authored-by: snyk-bot <snyk-bot@snyk.io> --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: Jan Blom <janblom@thehyve.nl> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Spayralbe <stefan@thehyve.nl> Co-authored-by: Maxim Moinat <maximmoinat@gmail.com> Co-authored-by: EIjo <eljo@live.nl> Co-authored-by: Guus Wilmink <guus.wilmink@gmail.com> Co-authored-by: Eljo <33732080+EIjo@users.noreply.github.com> Co-authored-by: Guus Wilmink <143344142+guuswilmink@users.noreply.github.com> Co-authored-by: snyk-bot <snyk-bot@snyk.io>

[Suggested Feature] Make backspace delete arrows #63

Description

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions