Bulk Image Downloader v3.0 User's Guide
Bulk Image Downloader v3.0 User's Guide
Table of Contents
Bulk Image Downloader v3.0 User's Guide.................................................1
1. What is Bulk Image Downloader?.....................................................................................4
2. Bulk Image Downloader Applications.................................................................................4
Bulk Image Downloader (BID)........................................................................................4
BID Queue Manager......................................................................................................4
BID Link Explorer..........................................................................................................4
3. Web Browser Integration.................................................................................................5
BID FireFox Extension.....................................................................................................5
BID Google Chrome Extension.........................................................................................5
Browser Right Click Context Menu Items...........................................................................5
“Open current page with BID” .....................................................................................5
“Enqueue current page with BID”.................................................................................5
“Open current page with BID Link Explorer”...................................................................5
“Open link target with BID” (when right clicking on a link)...............................................5
“Enqueue link target with BID” (when right clicking on a link)..........................................5
BID Drop Box................................................................................................................6
4. Downloading a web gallery with BID.................................................................................7
Scanning Multi Page Galleries..........................................................................................8
Multi Page Loading using URL “Range Specifiers”............................................................9
Generate Image File Lists with “Range Specifiers” (Fusker Links)......................................9
Advanced “Range Specifiers”......................................................................................10
Detailed and Thumbnailed Views....................................................................................11
Image Type Filters........................................................................................................12
Thumbnailed Images................................................................................................12
Embedded Images...................................................................................................12
Append to existing links................................................................................................12
Download Options.........................................................................................................13
Download to folder...................................................................................................13
Save to web page title subfolder.....................................................................................13
Generate Filenames..................................................................................................13
Duplicate File Handing...............................................................................................13
Previewing Images.......................................................................................................13
Downloading Images.....................................................................................................14
Selecting Images to Download.......................................................................................14
Cancel/Pause Download.................................................................................................16
Close when download complete......................................................................................16
5. Other BID functions......................................................................................................17
Load From File.............................................................................................................17
Save Batch..................................................................................................................17
Add to Queue...............................................................................................................18
Export Gallery..............................................................................................................18
6. BID Configuration.........................................................................................................20
Proxy Settings..............................................................................................................20
Number of retries for invalid/partially downloaded images.................................................21
Number of retries for invalid page downloads...................................................................21
Resume Downloads.......................................................................................................21
Load Frames................................................................................................................21
Close BID after “Add to Queue”......................................................................................21
Make download folder names unique (when using page title as folder name).......................21
Max Download Threads.................................................................................................21
Read Timeout...............................................................................................................21
Download multiple forum pages.....................................................................................21
Generate Filenames......................................................................................................21
Integrate with Internet Explorer (adds BID to right click context menu)..............................22
Integrate with Opera (adds BID to right click context menu)..............................................22
If not launched from a browser context menu, load cookies from........................................22
Language selection.......................................................................................................22
Click to check for newer version.....................................................................................22
Automatically check for updates.....................................................................................22
View Log File................................................................................................................22
Delete Log File.............................................................................................................22
Enable Logging.............................................................................................................22
7. BID Advanced Configuration...........................................................................................23
Images.......................................................................................................................23
Non thumbnailed image types....................................................................................23
Delete images smaller than........................................................................................23
Flickr preferred image size.........................................................................................23
Video..........................................................................................................................24
Browser Integration......................................................................................................25
General.......................................................................................................................26
Cache Control..........................................................................................................26
Prompt to save batch on exit......................................................................................26
Cancel download if free disk space below.....................................................................26
Save gallery URL shortcut in download folder...............................................................26
Disable Unicode characters in file and folder names......................................................26
Disable “Close when download complete” when downloading selected images..................27
Ignore List, Include List, Redirect Links and JavaScript Sites..............................................28
Regular Expressions......................................................................................................28
Simplified Regular Expressions.......................................................................................29
Ignore List...................................................................................................................29
Include List..................................................................................................................29
Redirect Links..............................................................................................................30
JavaScript Sites............................................................................................................30
Folders........................................................................................................................31
8. BID Queue Manager......................................................................................................32
Enabling/Disabling the Queue........................................................................................33
Adding URLs................................................................................................................33
Adding Batch Files........................................................................................................34
Reordering the Queue...................................................................................................34
Default Download Options.............................................................................................35
Save Queue.................................................................................................................35
Load Queue.................................................................................................................35
Append to existing links................................................................................................35
Current Download Job...................................................................................................35
Show Job.................................................................................................................36
Hide Job..................................................................................................................36
Cancel Job...............................................................................................................36
Start with Windows.......................................................................................................36
Start Minimized............................................................................................................36
Show Drop Box............................................................................................................36
Stay on Top.................................................................................................................36
Retry Jobs...................................................................................................................37
9. BID Link Explorer..........................................................................................................38
Append to Existing Links................................................................................................39
Delete links from list after sending to queue manager.......................................................39
Selecting Links.............................................................................................................39
Send to BID Queue Manager..........................................................................................41
BID is the main image downloading tool. It scans web pages for thumbnailed and embedded images
and presents the results to the user. Users can browse through the images found and preview
selected full sized images before deciding which to download.
Multiple instances of BID can be active at a time, each working on a different web page or gallery.
The BID Queue Manager is used to maintain a list of web gallery or web page links to be
downloaded. While active, it will automatically launch it's own instance of BID (running in a special
automatic mode) to download images from the first gallery in the list. As soon as BID completes the
download, the gallery link is removed from the list and the next gallery in the queue is started. The
BID Queue Manager can be left to download huge lists of web galleries without any human
intervention.
The BID Link Explorer is designed to process web pages that contain links to multiple web galleries
(web gallery “index” pages). It extracts all links from the selected web page and displays them on
screen. The user can then select the appropriate gallery links and send them all to the BID Queue
Manager for later downloading. Each link can also be opened in a separate instance of BID if
required.
Bulk Image Downloader v3.0 User's Guide Page 5
Right click on the page and select “Open current page with BID”
BID will start and automatically scan the web page for images. After a few seconds it will display a
list of images:
Bulk Image Downloader v3.0 User's Guide Page 8
BID scans the selected web page and displays the image links found
Notice that the web page URL has been filled in and scanned automatically.
To use BID without browser integration, simply start it up and type the gallery URL into the “URL of
image/video gallery page” field (or copy and paste it from your browser). After entering the URL
press the Scan button or simply press Enter to have BID scan for images.
Press the Scan button or press Enter to scan a new URL for images
pages that BID will load this way is controlled by the “max pages” configuration setting (default
value 20, see Configuration).
To make BID generate such a list you would use the following URL:
http://example.com/pics/pic[001-999].jpg
These types of link are sometimes referred to as “fuskers”. Note that images added this way are
classified as “embedded”. You will need to set the image type filter (see Image Type Filters in the
next section) to “embedded images only” or “all images” for them to appear on the file list.
More than one range specifier can be used in the URL, e.g.:
http://example.com/gallery[1-10]/pic[01-15].jpg
Bulk Image Downloader v3.0 User's Guide Page 10
http://site.com/album6/pics6_001.jpg
http://site.com/album6/pics6_002.jpg
..
http://site.com/album6/pics6_100.jpg
etc.
Bulk Image Downloader v3.0 User's Guide Page 11
Thumbnailed Images
A “thumbnailed” image is a small image that links to a full sized image on another web page. The
'thumbnailed image' icon will appear next to each image of this type. BID will download the
linked FULL SIZED image when downloading images of this type.
Embedded Images
An “embedded” image is any image that appears on the web page. The embedded image icon will
appear next to each image of this type. BID will download the image displayed on the page when
downloading images of this type.
Click on the image filter buttons to display only the image types you wish to download.
If the “Append to existing links” option is enabled, images found while scanning will be added to the
existing list. This enables you to combine multiple galleries into one batch before downloading
Download Options
Download to folder
Select the folder that the images should be saved to. Right click on the folder name or click on the
“...” button to display and select the last 10 recently used folders.
Click on the “Explorer” button (to the left of the “...”) to quickly open the currently selected
download folder with Windows Explorer.
Generate Filenames
If enabled, BID will construct filenames for each image when it is saved. If not enabled, BID will use
the original filename.
There are 2 types of filename generation:
Numbered Custom Prefix (<###>_001, <###>_002, ...)
Images will be saved as <prefix>_001, <prefix>_002 using the filename prefix specified.
E.g. if the prefix is “Cars”, then the image files will be saved as “Cars_001.jpg”,
“Cars_002.jpg”, etc.
Numbered Filenames (001_<###>, 002_<###>, ...)
Each filename will be prefixed by a number when saving. The original filename is kept but the
number is simply prepended to it. This can be used to ensure that your images stay in the
right sequence while still keeping the original filenames.
Previewing Images
Double click on an image in the detailed view to display the thumbnail. Double click on thumbnailed
images to download and display the full sized image.
Bulk Image Downloader v3.0 User's Guide Page 14
Downloading Images
To begin downloading the images in the list click on the “Download Files Now” button or press F9. To
download just the selected images hold down the Shift key while clicking the button or press
Shift+F9 (see “Selecting Images to Download” below).
Right click on the image list for more image selection methods
The “Select/Unselect matching files” functions allow you to select multiple images using regular
expressions.
Bulk Image Downloader v3.0 User's Guide Page 16
Cancel/Pause Download
Save Batch
Click on the “Save Batch” button (or press Ctrl+S) to save the current image list and current
download settings to a local file. These files can be loaded back into BID by using the “Load From
File” function.
Add to Queue
Clicking on the “Add to Queue” button (or pressing Ctrl+Q) will automatically save the current batch
and pass this newly saved batch file on to the BID Queue Manager, where it will be queued for later
downloading. Depending on the configuration setting, BID may close immediately after this.
Export Gallery
This function exports the current image list as a simple html and “bulletin board code” (bb code)
gallery that can be copied and pasted into web pages or web forums.
6. BID Configuration
Click on the “Configuration” tab to display the current BID configuration. Save any changes by
clicking on the “Save Changes” button. Undo any changes by clicking on the “Cancel Changes”
button.
Proxy Settings
This controls whether or not BID will make use of a proxy server to connect to the internet.
Autodetect Proxy
BID will obtain proxy information (if any) from Internet Explorer.
No Proxy
Force proxy off
Use this proxy
Enter the address, port and user authentication details required by your proxy server. BID
currently only supports HTTP proxies
Bulk Image Downloader v3.0 User's Guide Page 21
Resume Downloads
If enabled BID will attempt to resume an image download from the point at which there was an
error.
Load Frames
If enabled BID will load every frame contained within a web page.
Make download folder names unique (when using page title as folder name)
If enabled, BID will append a number to the page title to make it unique if a folder with that name
already exists.
Read Timeout
Controls the number of seconds BID will wait for a web server to respond before aborting the
connection.
Generate Filenames
This setting controls the behaviour of the BID “Generate Filenames” option.
Autodetect
BID will automatically enable the option if it detects images hosted on known sites that
scramble their filenames.
Always
BID will always enable the “Generate Filenames” option when loading a gallery.
Never
BID will always disable the “Generate Filenames” option when loading a gallery.
Bulk Image Downloader v3.0 User's Guide Page 22
Integrate with Internet Explorer (adds BID to right click context menu)
Controls whether BID menu items are added to Internet Explorer's right click context menu.
Language selection
Enable Logging
Controls whether or not BID logs batch download results to a log file.
Bulk Image Downloader v3.0 User's Guide Page 23
Images
Video
Browser Integration
General
Cache Control
BID caches files automatically when downloading – this allows for broken downloads to be resumed
from the point of failure and has other performance benefits. The cache can be configured to be
cleared on exit or kept for a specified number of days. Click on the “Clear Cache and Temp Files
Now” button to delete all cached files immediately.
Regular Expressions
The Ignore List, Include List and Redirect Links are lists of “regular expressions”, one per line.
A regular expression is a specially formatted text string used for pattern matching.
The following characters have special meanings when used in regular expressions and must be
prefixed by a backslash (\) if you wish to use them as literals in your regular expression.
[, \, ^, $, ., |, ?, *, +, (, ), /
^ = start of line
Bulk Image Downloader v3.0 User's Guide Page 29
$ = end of line
. = match any character
\x = use literal character x
For a detailed explanation of regular expressions please visit
http://wikipedia.org/wiki/Regular_expression
Some examples:
The regular expression test matches any link containing the word “test”, such as
“http://website.com/test123/index.htm” or http://example.com/images/test_image.jpg
The regular expression _th\.jpeg$ matches any link that ends with “_th.jpeg”, such as
“http://myimagesite.com/thumbs/hotcar_th.jpeg” or “http://anothersite.com/thumbpic_th.jpeg”.
Notice the use of the backslash to indicate a literal dot, and the dollar sign indicating the end of the
line.
Ignore List
The Ignore list is used by BID to filter out links that may be misidentified as thumbnailed image
links, or full sized images. After downloading a page, BID will automatically try to match all the links
found against this list of regular expressions. Any matching links are discarded.
This can be useful if you find that BID keeps incorrectly identifying a particular type of link (such as
a banner advert) as an image, or if BID keeps downloading the wrong full sized image from a web
page. Simply add a regular expression that matches the unwanted links and BID will ignore it.
Include List
If BID finds no images when scanning a web gallery page you can force it detect the images by
adding regular expressions that match the full sized image links.
Suppose all the full sized image links look like this:
http://trickywebsite.com/pics/largesize/<random nunber>/
To force BID to detect these as valid full sized image links you would add the following regular
expression to the “Include list”:
Bulk Image Downloader v3.0 User's Guide Page 30
<trickywebsite.com/pics/largesize/>
This would match any link that contains “trickywebsite.com/pics/largesize”.
Some full sized image pages only display “medium sized” images and have links to pages containing
larger or original sized images. To force BID to follow such links add a regular expression matching
this link to the include list prefixed with an asterisk (*). This also works for cases where BID does
not find the the correct full sized image on the page.
For example, suppose our “full page” link contains a link to the original sized image that looks like:
http://example.com/images/fullsized/(imagename).jpg
We would add the following line to the include list:
*<example.com/images/fullsized/>
Some web sites use non standard methods to generate thumbnails. To help find these thumbnails on
a web page add a matching regular expressions prefixed by 2 asterisks (**). For example:
**<thumbnailgenerator.php?id=>
Redirect Links
Many web galleries link the thumbnailed images to redirection “services” that display pop up adverts
before redirecting to the full sized image page. BID automatically tries to resolve these redirected
links when it finds them so that it can download directly from the original image page.
A nice by product of this redirection resolution is that you can then use the “Export Gallery” function
to export a clean, redirection free gallery that can be pasted into forums or web pages.
If you come across a gallery that is redirected through a redirection service that BID is unaware of,
simply add a matching regular expression to this list.
For example, suppose all gallery thumbnail links look like this:
http://newultracashimagebucks.org/<random number>
To force BID to resolve these links you would add the line
<newultracashimagebucks.org>
to the list.
JavaScript Sites
Some web sites generate their content dynamically using JavaScript. This may prevent BID from
detecting any images when scanning gallery pages of such sites. To force BID to process the
JavaScript for such sites add regular expressions that match the web site domain to this list. Note
that doing this can greatly slow down page loading and processing.
If the expression matches a full sized image page, downloading can be sped up by prefixing the
expression with a single asterisk (*).
Some web sites use unusual scripting methods that require special handling. Prefix the regular
expression with “1:” to indicate to BID that special handling is required.
As a general rule, if BID cannot download from a JavaScript site that you've added to the list, try
prefixing the regular expression with a “1:” and try again.
Bulk Image Downloader v3.0 User's Guide Page 31
Folders
Adding URLs
Enter the URL or URLs into the “URL of image/video gallery page” edit box. You may enter more
than one URL at a time, each on a new line. Click on the “Add URL to Queue” button to add them to
the list.
Add the current page to the Queue Manager list via your browser's right click menu
Right clicking on a link will add the “Enqueue link target with BID” option to the menu.
Save Queue
Click on this button to save the current queue to a local file.
Load Queue
Click on this button to load a previously saved queue.
Show Job
Click on this button to show the BID instance running this job. By default the instance of BID
running the queue manager jobs is hidden.
Hide Job
Click on this button to hide the BID instance again.
Cancel Job
Clicking on this button will cancel the BID instance immediately. If the Queue Manager is active the
next download job will be started. Any images that failed to download in the cancelled batch will be
automatically saved as a “Retry” batch which will appear in the “Retry Jobs” tab, where it can be
requeued or deleted.
Start Minimized
If enabled, the Queue Manager will immediately minimize itself to the system tray when starting up.
Stay on Top
If enabled the Queue Manager window will remain on top of other windows. This makes it easy to
drag URLs, links and files directly into the Queue Manager window without having to use the drop
box.
Bulk Image Downloader v3.0 User's Guide Page 37
Retry Jobs
BID will automatically save images that failed to download as new batches that can be retried at a
later time. These jobs can be requeued or deleted from the “Retry Jobs” tab.
Double click on a job to requeue it. Click on “Delete All” to delete all the retry jobs, or “Re-Queue
All” to requeue them all.
Bulk Image Downloader v3.0 User's Guide Page 38
Launch BID Link Explorer from your browser's right click menu
The BID Link Explorer will start and after a few seconds it will display all the links found on the page.
Bulk Image Downloader v3.0 User's Guide Page 39
BID Link Explorer has scanned all the links on the page
To use BID Link Explorer without browser integration, simply start it up and type the gallery URL into
the “URL of page containing GALLERY links” field (or copy and paste it from your browser). After
entering the URL press the Scan button or simply press Enter to have it scan for links.
Selecting Links
To select a single link simply click on it. To select a range of links click on the first link, then hold the
Shift key and click on the last link. To select multiple links hold down the Ctrl key and click on each
link.
Double click on a link to send it directly to the Queue Manager.
Right click on the list for more selection options, including selection by regular expression.
Bulk Image Downloader v3.0 User's Guide Page 40
Various selection options are available from the right click menu
Bulk Image Downloader v3.0 User's Guide Page 41
Filter