http_request_randomizer.requests.parsers package

Submodules

http_request_randomizer.requests.parsers.FreeProxyParser module

class http_request_randomizer.requests.parsers.FreeProxyParser.FreeProxyParser(id, web_url, timeout=None)

Bases: http_request_randomizer.requests.parsers.UrlParser.UrlParser

create_proxy_object(dataset)
parse_proxyList()

http_request_randomizer.requests.parsers.PremProxyParser module

class http_request_randomizer.requests.parsers.PremProxyParser.PremProxyParser(id, web_url, timeout=None)

Bases: http_request_randomizer.requests.parsers.UrlParser.UrlParser

create_proxy_object(row, port)
get_pagination_set()
init_js_unpacker()
parse_proxyList()

http_request_randomizer.requests.parsers.ProxyForEuParser module

class http_request_randomizer.requests.parsers.ProxyForEuParser.ProxyForEuParser(id, web_url, bandwidth=None, timeout=None)

Bases: http_request_randomizer.requests.parsers.UrlParser.UrlParser

create_proxy_object(dataset)
parse_proxyList()

http_request_randomizer.requests.parsers.RebroWeeblyParser module

class http_request_randomizer.requests.parsers.RebroWeeblyParser.RebroWeeblyParser(id, web_url, timeout=None)

Bases: http_request_randomizer.requests.parsers.UrlParser.UrlParser

create_proxy_object(address, country, anonymity)
parse_proxyList(use_top15k=False)

http_request_randomizer.requests.parsers.SslProxyParser module

class http_request_randomizer.requests.parsers.SslProxyParser.SslProxyParser(id, web_url, timeout=None)

Bases: http_request_randomizer.requests.parsers.UrlParser.UrlParser

create_proxy_object(dataset)
parse_proxyList()

http_request_randomizer.requests.parsers.UrlParser module

class http_request_randomizer.requests.parsers.UrlParser.UrlParser(id, web_url, bandwidth_KBs=None, timeout=None)

Bases: object

An abstract class representing any URL containing Proxy information To add an extra Proxy URL just implement this class and provide a ‘url specific’ parse_proxyList method

Attributes:
param id

A unique provider identifier

param web_url

A provider url (hhtp)

param bandwidthKBs

minimum bandwidth in KBs (to avoid straggling proxies when having the extra info from proxy provider)

get_id()
get_min_bandwidth()
get_url()
parse_proxyList()
static valid_ip(address)

Return True if the the given IP is a valid IPv4 address

Parameters

address (string) – ip address

Return type

bool

static valid_ip_port(address)

Return True if the the given Port is a valid IPv4 port

Parameters

address (string) – ip address

Return type

bool

static valid_port(port)

Module contents