Skip to content

Crash with huge txt file #1212

@SilvioGrosso

Description

@SilvioGrosso

Hello everyone,

These days I have been testing Db Browser for sqlite :-)
Windows 7 (64 bit) with yesterday's daily build (3.10.99).

Today, I have tried to import a huge txt file downloaded from here (332 mb):
http://download.geonames.org/export/dump/allCountries.zip

When you unzip this file you get the AllCountries.txt file , which is around 1,4 gb !!!
It contains 19 columns (UTF-8 encoding; tabs as separator; no header as first column).
You get more information about this table, named "geoname", here (bottom of the page):
http://download.geonames.org/export/dump/

To make it short, Db browser for Sqlite always stops working when It reaches around 11% for this importing.
Worst of all, when you click "cancell" to kill the process the software always crashes.
To make matters even worse, when I try to reopen my database it is no longer available !
It looks like it has been changed in "read-only" mode.

Here is my Dropbox video recorded to show this crash (Windows 7 - 64 bit):
https://www.dropbox.com/s/2rq2dj7merbvgkm/CRASH_IMPORTING_TXT_FILE.mp4?dl=0

To always reproduce this crash on Windows 7 (64 bit) you need to:

  • Create a new database (e.g. Prova.db) ;
  • Click on File > Import from CSV file ;
  • Select the AllCountries.txt file (19 columns - fields are selected) ;
  • Click on Ok to start the process ;
  • The importing usually stops when it reaches 10-11% ;
  • When you click on "Cancell" BrowserSqlite 3.10.99 always crashes ;
  • When you try to Open again your Database (Prova.db) it is readonly .

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions