Article & News Scraper

Are you feeling overwhelmed by the sheer volume of news and articles from all over the globe? Are you searching for a way to gather them all into one cohesive file? Look no further! With our cutting-edge Articles and News Scraper, you can effortlessly extract news and articles from various links and pages with just a single click.

Say goodbye to manual searching and tedious data gathering. Our Articles and News Scraper streamlines the process, saving you time and effort while providing you with comprehensive news and articles in one convenient file.

Easy to use and Free to try

A few mouse clicks and copy/paste is all that it takes!

* to use you will need to sign up for a  FREE TRIAL account

Steps to use:

Step 1: Click on "Use for Free"

Step 2: Activate the Pre-Defined Extractor by clicking the "Activate button"

Step 3: Enter your starter URLs

Enter a List of search URLs to start the web scraping. It must be a Tripadvisor Restaurants search URL.

Step 4: Click "Run now" 

Using this extractor, you can get:

• url
• source url
• title
• publish date
• authors
• favicon
• description
• language
• canonical link
• tags
• image url
• text
• timestamp

Valid Starter Links:

You can generate links from any News page, whether a specific page or the main page.

Obtaining the Starter Link:

You can begin by searching any news page from your search engine. Open the news page you would like to scrape, you can input that page's url as the starter link on your scraper.

Cost

When you use Article and News Extractor pre-defined web scraper, the cost will be 15 credits per row which equals to $1 for 66 rows.

The output file can be exported as csv, xml, xlsx, json formats.

Below is a screenshot of what data fields we will be web scraping from our Article & News Scraper.

You will get your data in following structure in different formats:

{
  "url":"https://www.france24.com/en/tv-shows/focus/20240401-on-board-a-french-warship-protecting-red-sea-vessels-from-houthi-attacks",
  "source_url":"https://www.france24.com",
  "title":"On board a French warship protecting Red Sea vessels from Houthi attacks",
  "publish_date":"2024-04-01 00:00:00",
  "authors":["Bastien Renouil","Olivia Bizot"],
  "favicon":"/favicon.ico",
  "description":"Since the conflict between Israel and Hamas broke out last October, Yemen's Houthi rebels have been carrying out attacks against commercial vessels in the Red Sea, in what they say is a campaign of solidarity…",
  "lang":"en",
  "canonical_link":"https://www.france24.com/en/tv-shows/focus/20240401-on-board-a-french-warship-protecting-red-sea-vessels-from-houthi-attacks",
  "tags":["Israel","Gaza Strip","Red Sea","Australia","Netherlands","Germany","India","Canada","Israel-Hamas war","French military","Houthi rebels","Ukraine","United Kingdom","South Africa","Hamas","USA","Italy","Russia"],
  "image":"https://s.france24.com/media/display/cbf48170-ede7-11ee-aa57-005056a90284/w:1280/p:16x9/EN%20NW%20OOV-ECRAN%20FOCUS%20HOUTHI%20ATTACKS%20RED%20SEA%20%20-BAIN%20Lauren-.jpg",
  "text":"On board a French warship protecting Red Sea vessels from Houthi attacks\n\n06:19 FOCUS © FRANCE 24\n\nSince the conflict between Israel and Hamas broke out last October, Yemen's Houthi rebels have been carrying out attacks against commercial vessels in the Red Sea, in what they say is a campaign of solidarity with Palestinians during Israel's war in Gaza. The Houthis' missiles and drones are spreading terror along a particularly busy shipping route. The French and US navies, as well as an EU naval mission, are deployed in the area to protect commercial navigation. The French navy agreed to take FRANCE 24 reporters Bastien Renouil and Olivia Bizot on board one of its frigates to witness the operations behind the scenes.",
  "timestamp":"2024-04-05T09:55:24Z"
}

What does the output data look like?

*** Data below was extracted on Apr 23, 2024 @09:20