Google Web Scraper API - URL
Google parsing endpoint
http://scrape.infatica.io/serp
Google Web Scraper API google_url
allows to receive immediate result using our Residential Proxy
Scraping Google search costs 20 credits per page (without additional parameters).
'api_key': 'API_KEY'
, where API_KEY is your Infatica API key
Query Parameters
Name | Description | Example | Options |
---|---|---|---|
url (string, required) | Destination url to retrieve (url-encoded) | {"url":"https://www.google.com/search?q=news"} | default=null |
api_key (string, required) | Web Scraper API key | {"api_key":"0de32912321"} | default=null |
source (string, required) | Data source | {"source":"google_url"} | google_url |
country_code (str, optional) | Proxy country code (geolocation) | {"country_code":"fr"} | default=null, options - us, gb, de, fr, cn, jp. View all codes |
language (str, optional) | Language code in SERP (language) | {"language":"en-US"} | default=en-US, options - en-US, en-CA, es-ES, fr-CA. View all codes |
google_url
- return data of the URL in HTML ("html":"")
Only "pages"
is paid parameter. Each page with results costs 20 credits.
Returns
Status code | Description | Example |
---|---|---|
200 (Success) | Request successful. Returns HTML code of the page | {"html":[]} |
401 (Unauthorized) | API key is missing or wrong | {'error':'API key is missing or wrong'} |
422 (Unprocessable Entity) | Error in query parameters | {'error':'Wrong query'} |
504 (Timeout) | Site returned timeout after 3 attempts to reach it | {'error':'Timeout'} |
Country codes
If you want to define the geolocation for your request, you may set the country_code
(string) parameter with one country code at the creation of the request.
Country codes can be found in the collapsible table below:
All country codes (click here to expand)
Code | Country name | Code | Country name | Code | Country name |
---|---|---|---|---|---|
ad | Andorra | gl | Greenland | no | Norway |
ae | United Arab Emirates | gm | Gambia | np | Nepal |
af | Afghanistan | gn | Guinea | nr | Nauru |
ag | Antigua and Barbuda | gp | Guadeloupe | nu | Niue |
ai | Anguilla | gq | Equatorial Guinea | nz | New Zealand |
al | Albania | gr | Greece | om | Oman |
am | Armenia | gs | South Georgia and the South Sandwich Islands | pa | Panama |
ao | Angola | gt | Guatemala | pe | Peru |
aq | Antarctica | gu | Guam | pf | French Polynesia |
ar | Argentina | gw | Guinea-Bissau | pg | Papua New Guinea |
as | American Samoa | gy | Guyana | ph | Philippines |
at | Austria | hk | Hong Kong | pk | Pakistan |
au | Australia | hm | Heard Island and McDonald Islands | pl | Poland |
aw | Aruba | hn | Honduras | pm | Saint Pierre and Miquelon |
ax | Åland Islands | hr | Croatia | pn | Pitcairn |
az | Azerbaijan | ht | Haiti | pr | Puerto Rico |
ba | Bosnia and Herzegovina | hu | Hungary | ps | Palestine, State of |
bb | Barbados | id | Indonesia | pt | Portugal |
bd | Bangladesh | ie | Ireland | pw | Palau |
be | Belgium | il | Israel | py | Paraguay |
bf | Burkina Faso | im | Isle of Man | qa | Qatar |
bg | Bulgaria | in | India | re | Réunion |
bh | Bahrain | io | British Indian Ocean Territory | ro | Romania |
bi | Burundi | iq | Iraq | rs | Serbia |
bj | Benin | ir | Iran (Islamic Republic of) | ru | Russian Federation |
bl | Saint Barthélemy | is | Iceland | rw | Rwanda |
bm | Bermuda | it | Italy | sa | Saudi Arabia |
bn | Brunei Darussalam | je | Jersey | sb | Solomon Islands |
bo | Bolivia (Plurinational State of) | jm | Jamaica | sc | Seychelles |
bq | Bonaire, Sint Eustatius and Saba | jo | Jordan | sd | Sudan |
br | Brazil | jp | Japan | se | Sweden |
bs | Bahamas | ke | Kenya | sg | Singapore |
bt | Bhutan | kg | Kyrgyzstan | sh | Saint Helena, Ascension and Tristan da Cunha |
bv | Bouvet Island | kh | Cambodia | si | Slovenia |
bw | Botswana | ki | Kiribati | sj | Svalbard and Jan Mayen |
by | Belarus | km | Comoros | sk | Slovakia |
bz | Belize | kn | Saint Kitts and Nevis | sl | Sierra Leone |
ca | Canada | kp | Korea (Democratic People's Republic of) | sm | San Marino |
cc | Cocos (Keeling) Islands | kr | Korea, Republic of | sn | Senegal |
cd | Congo, Democratic Republic of the | kw | Kuwait | so | Somalia |
cf | Central African Republic | ky | Cayman Islands | sr | Suriname |
cg | Congo | kz | Kazakhstan | ss | South Sudan |
ch | Switzerland | la | Lao People's Democratic Republic | st | Sao Tome and Principe |
ci | Côte d'Ivoire | lb | Lebanon | sv | El Salvador |
ck | Cook Islands | lc | Saint Lucia | sx | Sint Maarten (Dutch part) |
cl | Chile | li | Liechtenstein | sy | Syrian Arab Republic |
cm | Cameroon | lk | Sri Lanka | sz | Eswatini |
cn | China | lr | Liberia | tc | Turks and Caicos Islands |
co | Colombia | ls | Lesotho | td | Chad |
cr | Costa Rica | lt | Lithuania | tf | French Southern Territories |
cu | Cuba | lu | Luxembourg | tg | Togo |
cv | Cabo Verde | lv | Latvia | th | Thailand |
cw | Curaçao | ly | Libya | tj | Tajikistan |
cx | Christmas Island | ma | Morocco | tk | Tokelau |
cy | Cyprus | mc | Monaco | tl | Timor-Leste |
cz | Czechia | md | Moldova, Republic of | tm | Turkmenistan |
de | Germany | me | Montenegro | tn | Tunisia |
dj | Djibouti | mf | Saint Martin (French part) | to | Tonga |
dk | Denmark | mg | Madagascar | tr | Türkiye |
dm | Dominica | mh | Marshall Islands | tt | Trinidad and Tobago |
do | Dominican Republic | mk | North Macedonia | tv | Tuvalu |
dz | Algeria | ml | Mali | tw | Taiwan, Province of China |
ec | Ecuador | mm | Myanmar | tz | Tanzania, United Republic of |
ee | Estonia | mn | Mongolia | ua | Ukraine |
eg | Egypt | mo | Macao | ug | Uganda |
eh | Western Sahara | mp | Northern Mariana Islands | um | United States Minor Outlying Islands |
er | Eritrea | mq | Martinique | us | United States of America |
es | Spain | mr | Mauritania | uy | Uruguay |
et | Ethiopia | ms | Montserrat | uz | Uzbekistan |
fi | Finland | mt | Malta | va | Holy See |
fj | Fiji | mu | Mauritius | vc | Saint Vincent and the Grenadines |
fk | Falkland Islands (Malvinas) | mv | Maldives | ve | Venezuela (Bolivarian Republic of) |
fm | Micronesia (Federated States of) | mw | Malawi | vg | Virgin Islands (British) |
fo | Faroe Islands | mx | Mexico | vi | Virgin Islands (U.S.) |
fr | France | my | Malaysia | vn | Viet Nam |
ga | Gabon | mz | Mozambique | vu | Vanuatu |
gb | United Kingdom of Great Britain and Northern Ireland | na | Namibia | wf | Wallis and Futuna |
gd | Grenada | nc | New Caledonia | ws | Samoa |
ge | Georgia | ne | Niger | ye | Yemen |
gf | French Guiana | nf | Norfolk Island | yt | Mayotte |
gg | Guernsey | ng | Nigeria | za | South Africa |
gh | Ghana | ni | Nicaragua | zm | Zambia |
gi | Gibraltar | nl | Netherlands | zw | Zimbabwe |
Language codes
If you want to define the language in your request, you may set the language
(string) parameter with one language tag at the creation of the request.
Language codes can be found in the collapsible table below:
All language codes/tags (click here to expand)
Language Tag | Language | Region | Description |
---|---|---|---|
ar-SA | Arabic | Saudi Arabia | Arabic (Saudi Arabia) |
bn-BD | Bangla | Bangladesh | Bangla (Bangladesh) |
bn-IN | Bangla | India | Bangla (India) |
cs-CZ | Czech | Czech Republic | Czech (Czech Republic) |
da-DK | Danish | Denmark | Danish (Denmark) |
de-AT | German | Austria | Austrian German |
de-CH | German | Switzerland | "Swiss" German |
de-DE | German | Germany | Standard German (as spoken in Germany) |
el-GR | Greek | Greece | Modern Greek |
en-AU | English | Australia | Australian English |
en-CA | English | Canada | Canadian English |
en-GB | English | United Kingdom | British English |
en-IE | English | Ireland | Irish English |
en-IN | English | India | Indian English |
en-NZ | English | New Zealand | New Zealand English |
en-US | English | United States | US English |
en-ZA | English | South Africa | English (South Africa) |
es-AR | Spanish | Argentina | Argentine Spanish |
es-CL | Spanish | Chile | Chilean Spanish |
es-CO | Spanish | Columbia | Colombian Spanish |
es-ES | Spanish | Spain | Castilian Spanish (as spoken in Central-Northern Spain) |
es-MX | Spanish | Mexico | Mexican Spanish |
es-US | Spanish | United States | American Spanish |
fi-FI | Finnish | Finland | Finnish (Finland) |
fr-BE | French | Belgium | Belgian French |
fr-CA | French | Canada | Canadian French |
fr-CH | French | Switzerland | "Swiss" French |
fr-FR | French | France | Standard French (especially in France) |
he-IL | Hebrew | Israel | Hebrew (Israel) |
hi-IN | Hindi | India | Hindi (India) |
hu-HU | Hungarian | Hungary | Hungarian (Hungary) |
id-ID | Indonesian | Indonesia | Indonesian (Indonesia) |
it-CH | Italian | Switzerland | "Swiss" Italian |
it-IT | Italian | Italy | Standard Italian (as spoken in Italy) |
ja-JP | Japanese | Japan | Japanese (Japan) |
ko-KR | Korean | Republic of Korea | Korean (Republic of Korea) |
nl-BE | Dutch | Belgium | Belgian Dutch |
nl-NL | Dutch | The Netherlands | Standard Dutch (as spoken in The Netherlands) |
no-NO | Norwegian | Norway | Norwegian (Norway) |
pl-PL | Polish | Poland | Polish (Poland) |
pt-BR | Portugese | Brazil | Brazilian Portuguese |
pt-PT | Portugese | Portugal | European Portuguese (as written and spoken in Portugal) |
ro-RO | Romanian | Romania | Romanian (Romania) |
ru-RU | Russian | Russian Federation | Russian (Russian Federation) |
sk-SK | Slovak | Slovakia | Slovak (Slovakia) |
sv-SE | Swedish | Sweden | Swedish (Sweden) |
ta-IN | Tamil | India | Indian Tamil |
ta-LK | Tamil | Sri Lanka | Sri Lankan Tamil |
th-TH | Thai | Thailand | Thai (Thailand) |
tr-TR | Turkish | Turkey | Turkish (Turkey) |
zh-CN | Chinese | China | Mainland China, simplified characters |
zh-HK | Chinese | Hond Kong | Hong Kong, traditional characters |
zh-TW | Chinese | Taiwan | Taiwan, traditional characters |
Code examples
Curl
curl -X POST "http://scrape.infatica.io/serp" -d '{"api_key": "API_KEY", "source": "google_url", "url": "https://www.google.com/search?q=news"}'
Or with optional parameters:
curl -X POST "http://scrape.infatica.io/serp" -d '{
"api_key": "API_KEY",
"source": "google_url",
"url": "https://www.google.co.uk/search?q=news",
#country_code parameter is optional
"country_code" : "gb",
# language parameter is optional
"language" : "en-US"
}'
Python
import requests
import json
req = requests.post('http://scrape.infatica.io/serp', data = json.dumps({
'api_key': 'API_KEY',
'source': 'google_url',
'url': 'https://www.google.co.uk/search?q=news',
'country_code': 'gb', # country_code parameter is optional
'language' : 'en-US' # language parameter is optional
}))
content = json.loads(req.content)
print(content)
Javascript / NodeJS
const axios = require('axios')
const options = {
method: 'POST',
responseType: 'json',
data: {
api_key: 'API_KEY',
source: 'google_url',
url : 'https://www.google.co.uk/search?q=news',
country_code: 'gb', // country_code parameter is optional
language: 'en-US' // country_code parameter is optional
},
url: 'http://scrape.infatica.io/serp'
}
axios(options)
.then((result) => {
console.log(result)
})
.catch((err) => {
console.error(err)
})
Examples & success response
CURL 'google_url'
curl -X POST "http://scrape.infatica.io/serp" -d '{"api_key": "API_KEY", "source": "google_url", "url": "https://www.google.com/search?q=news"}'
` Example of success response:
You can receive code from the URL.
{
"source": "google_url",
"url": "https://www.google.com/search?q=news",
"pages": 1,
"language": "en-US",
"country_code": "us",
"created_at": "2023-08-04T09:28:58.520585",
"processed_at": "2023-08-04T09:28:59.747528",
"time_spent": 1226,
"credits_used": 20,
"html":"<!doctype html><html>{the code of the page}</html>"
}