Skip to content

Conversation

@regisd
Copy link
Member

@regisd regisd commented Nov 23, 2019

Test that reproduces #536 (cannot process files of 2GB).

This test is based on a custom reader that generates content of any size.

The input is generated by a custom Reader.
…er that repeats the given content, to reduce iterations when we read a large amount of data.
@regisd regisd requested a review from lsf37 as a code owner November 23, 2019 23:19
@regisd regisd self-assigned this Nov 23, 2019
@regisd regisd merged commit c68b94c into jflex-de:master Nov 24, 2019
@regisd regisd deleted the large_input_2gb branch November 24, 2019 10:00
@regisd regisd mentioned this pull request Nov 24, 2019
@regisd regisd added the testing Adding tests or test infrastructure. label Nov 24, 2019
regisd added a commit that referenced this pull request Nov 26, 2019
* Replace `yychar` by long in skeletons (default & nested)

* Update example for long yyChar
  * Also, add some positivity assertion in `example/simple/Yytoken` to give some defensive programming as an example.

* Update manual and READMe

* Update test added in #603 .
   * Improve doc of RepeatContentReader
   * Improve RepeatContentReader
      Don't prepare a large buffer if we read only a few characters.

* Also update testcase/example/simple for long `yychar`.

* Delete testcase/simple which is just redundant with the example.
regisd pushed a commit that referenced this pull request Nov 26, 2019
Author: Régis Décamps <[email protected]>
Date:   Wed Nov 27 00:02:51 2019 +0100

    Make `yychar` long (#605)

    * Replace `yychar` by long in skeletons (default & nested)

    * Update example for long yyChar
      * Also, add some positivity assertion in `example/simple/Yytoken` to give some defensive programming as an example.

    * Update manual and READMe

    * Update test added in #603 .
       * Improve doc of RepeatContentReader
       * Improve RepeatContentReader
          Don't prepare a large buffer if we read only a few characters.

    * Also update testcase/example/simple for long `yychar`.

    * Delete testcase/simple which is just redundant with the example.

Updated from target/jflex-parent-1.8.0-SNAPSHOT-sources.jar
regisd added a commit to regisd/jflex that referenced this pull request Dec 3, 2019
Introduce a fakeRead() that changes `yychar` so that we can fakely jump to yychar just before Integer.MAX_VALUE and make the test run in a snap.

Follow-up of jflex-de#603 and jflex-de#605
regisd added a commit that referenced this pull request Dec 3, 2019
)

* Make LargeInputTest run much faster by faking the scanner position

Introduce a fakeRead() that changes `yychar` so that we can fakely jump to yychar just before Integer.MAX_VALUE and make the test run in a snap.

Follow-up of #603 and #605
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

testing Adding tests or test infrastructure.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant