Web scraping

A collection of resources dedicated to web scraping: How to do it effectively and better understand possible limitations. Also covers web crawling.

Smarter Investing With Web Scraping: Collect Financial Data
Proxies and business
Smarter Investing With Web Scraping: Collect Financial Data

Data is at the cornerstone of financial markets: It informs better decisions for professional day traders and hobbyists alike. In this article, we'll explore how to collect this data for smarter investments.

Honeypots: What Are They? Avoiding Them in Data Gathering
Proxies and business
Honeypots: What Are They? Avoiding Them in Data Gathering

Honeypots may pose a serious threat to your data collection capabilities: They can detect web crawlers and block them. In this article, we're exploring how they work and how to avoid them.

How to Get a Random IP Address with IP Generator
How to
How to Get a Random IP Address with IP Generator

Randomized IP addresses can work wonders for your data collection pipeline. In this article, we'll explore several tools that can help you do that.

How to scrape images from a website
Web scraping
How to scrape images from a website

Visual data is as important as textual data — let's try scraping it! In this article, we'll use Python and BeautifulSoup to create a web scraping script.

Introduction to cURL: A Light and Powerful Web Scraping Tool
How to
Introduction to cURL: A Light and Powerful Web Scraping Tool

cURL is an essential building block of the web scraping pipeline. In this article, we're diving deep into how this utility works — and how to combine it with proxies to improve data collection.

Responsible Web Scraping: An Ethical Way of Data Collection
How to
Responsible Web Scraping: An Ethical Way of Data Collection

Web scraping is a powerful technology — but it may sometimes prove quite overwhelming. In this article, we're outlining the guidelines for a more responsible data gathering pipeline.

Data-Driven Marketing 101: Why Data Is Crucial for Marketers
Proxies and business
Data-Driven Marketing 101: Why Data Is Crucial for Marketers

Effective marketing relies on data: The more data you have, the better your marketing strategy will play out. In this article, we'll explore how MarTech can help you.

IP Addresses: How They Work & Importance in Web Scraping
Proxies and business
IP Addresses: How They Work & Importance in Web Scraping

IP addresses form the backbone of the web's infrastructure. In this article, we're diving deep into how they operate — and how they influence web scraping.

All about Bots: Definition, Use Cases, and Bot Types
Proxies and business
All about Bots: Definition, Use Cases, and Bot Types

When executed correctly, bots can add immense value to your business — but you need to understand the technology behind them. This article will help you.

Proxies for Twitter: Use Cases and Advice on How to Use Them Effectively
Web scraping
Proxies for Twitter: Use Cases and Advice on How to Use Them Effectively

Twitter is a powerful marketing tool — and proxies enable even more functionality. Let's see how Twitter proxies can be used effectively for marketing purposes.

Web Crawling vs. Web Scraping: Understanding the Difference
Web scraping
Web Crawling vs. Web Scraping: Understanding the Difference

Web crawling and web scraping are staples of every data-centered business. In this article, we're analyzing the difference between these two activities.

Get In Touch
Have a question about Infatica? Get in touch with our experts to learn how we can help.