Web Content Extractor Documentation

Command Line Options

It is possible to perform Web Content Extractor commands from the command line.

Syntax:

WCExtractor.exe ["project_filename"] [-key]

project_filename - the name of the project file to open (*.wcepr).

Key Command
-dr Delete all results
-dt Delete all URLs
-rt Reset all URLs
-rft Reset failed URLs
-ret Reset empty URLs
-atu="url" Add new URL, url - website address.
-at="filename" Add new URLs from a file, filename - name of the txt file that contains URLs separated by newlines.
-gt="filename" Generate new URLs using script (jscript or vbscript), filename - name of the script file that contains 'Main' function.
-proxy-server="proxyAddress" Set proxy address. Use the following syntax for the proxy address: <ip_address>:<port> where <ip_address> is the Ip address of the proxy server, and <port> is the port number that is assigned to the proxy server.
-proxy-list="filename" Set proxy addresses from file, filename - name of the txt file that contains proxy addresses separated by newlines. Use the following syntax for the proxy address: <ip_address>:<port> where <ip_address> is the Ip address of the proxy server, and <port> is the port number that is assigned to the proxy server.
-s Start project
-rs After the project is completed, reset failed URLs and restart project
-ddr Delete duplicate records
-fr Filter results. The program will filter results, using the results filter, which was the last to be used in the project. If the results filter has never been used, then this function is not available.
-fr="column_name{Criteria}value{Condition}
[;column_name{Criteria}value{Condition}]"
Filter results, criteria: 0 - contains, 1 - does not contain, 2 - equals, 3 - does not equal, 4 - begins with, 5 - does not begin with, 6 - ends with, 7 - does not end with, 8 - is larger than, 9 - is less than;
condition: 0 - AND, 1 - OR
-qe Complete quick export. The program will export data, using the export configuration, which was the last to be executed in the project. If the project data has never been exported, then this function is not available.
-qe="filename" Complete quick export, filename - name of the new output file. The program will export data, using the export configuration, which was the last to be executed in the project. If the project data has never been exported, then this function is not available.
-ep="filename" Export project properties into a file, filename - name of the output file (json).
-eft="filename" Export failed URLs, filename - name of the output file (html or txt).
-emt="filename" Export empty URLs, filename - name of the output file (html or txt).
-edt="filename" Export no-data URLs, filename - name of the output file (html or txt).
-elt="filename" Export non-downloaded URLs, filename - name of the output file (html or txt).
-ip="filename" Import project properties from a file, filename - name of the project properties file (json).
-ips="filename" Import program settings from a file, filename - name of the program settings file (json).
-ibs="filename" Import browser settings from a file, filename - name of the browser settings file (json).
-iss="filename" Import scraper settings from a file, filename - name of the scraper settings file (json).
-ics="filename" Import captcha settings from a file, filename - name of the captcha settings file (json).
-ies="filename" Import export settings from a file, filename - name of the export settings file (json).
-ist="filename" Import starting URLs from a file, filename - name of the txt file that contains URLs separated by newlines.
-istu="url" Import a starting URL, url - website address.
-sa="filename" Save as the project to a new file, filename - name of the new project file (wcepr).
-ex Exit when all URLs are downloaded.
-min Run the program in the minimized state.
-browser-view The program hides the scraper URLs and the results views.

Examples

To launch the program, then open the="myproject.wcepr" project file, delete all previous results, reset all URLs, start the extraction process, export data and close the program, you should use the following command:

"C:\Program Files (x86)\Web Content Extractor\WCExtractor.exe"="C:\Users\User1\Documents\Web Content Extractor Projects\myproject.wcepr" -dr -rt -s -qe -ex

To launch the program, then open the="myproject.wcepr" project file, delete all previous URLs, add new URLs from="urls.txt" file, start the extraction process, export data and close the program, you should use the following command:

"C:\Program Files (x86)\Web Content Extractor\WCExtractor.exe"="C:\Users\User1\Documents\Web Content Extractor Projects\myproject.wcepr" -dt -at="C:\Users\User1\Documents\Web Content Extractor Projects\urls.txt" -s -qe -ex

Note: The program will export data, using the export configuration, which was the last to be executed in the project. If the project has never been exported, then this function is not available.