Metadata Scraper
Overview
Retrieve metadata from any website, including the title, description, favicons, and images. This tool provides a detailed overview of key elements that define a website's structure and appearance, allowing users to analyze and utilize this information effectively for various purposes.
How to Use
- Log in to your ScrapeHero Cloud account.
- Navigate to the Metadata Scraper App in the Scrapehero App store.
- Click on "Create New Project".
- Provide one or more website URLs that you need the metadata from. For Example: Scrapehero website
- Specify the number of the data records you want to gather from the project run.
- Click "Gather Data" to begin the data extraction process.
- Once complete, download your data in your preferred format (CSV, JSON, or Excel) or connect any of the available integration to get seemless access to the scraped data.
Data Schema
The Metadata Scraper App provides the following data fields:
| Field Name | Description | Data Type |
|---|---|---|
| url | input url provided by the user | TextField() |
| title | title of thw page | TextField() |
| meta | metadata obtained from input url |
Sample Data Record
Here's an example of a typical data record returned by this scraper:
This scraper uses 10 data credit per data record. Learn more about data credits.
{
"meta": {
"article:modified_time": "2018-01-18T10:07:46+00:00",
"charset": "utf-8",
"description": "Fully managed enterprise-grade web scraping service provider based in the USA. We take care of web crawling, data extraction, automated quality checks and deliver usable structured data. Awesome customer service. Customers include Fortune 50 to startups and everyone in between.",
"generator": "Elementor 3.23.4; features: additional_custom_breakpoints, e_lazyload; settings: css_print_method-external, google_font-enabled, font_display-auto",
"msapplication-TileImage": "https://www.scrapehero.com/wp/wp-content/uploads/2017/12/cropped-logo-800-270x270.png",
"og:description": "Fully managed enterprise-grade web scraping service provider based in the USA. We take care of web crawling, data extraction, automated quality checks and deliver usable structured data. Awesome customer service. Customers include Fortune 50 to startups and everyone in between.",
"og:image": "https://www.scrapehero.com/wp/wp-content/uploads/2017/12/logo-800.png",
"og:image:height": "800",
"og:image:type": "image/png",
"og:image:width": "800",
"og:locale": "en_US",
"og:site_name": "ScrapeHero",
"og:title": "Home",
"og:type": "website",
"og:url": "https://www.scrapehero.com/",
"p:domain_verify": "7e11069eb3d45567d4584af3284ee303",
"robots": "index, follow, max-image-preview:large, max-snippet:-1, max-video-preview:-1",
"twitter:card": "summary_large_image",
"twitter:site": "@scrapehero"
},
"title": "Home",
"url": "https://www.scrapehero.com/"
}
Features
- Comprehensive Metadata Analysis.
- Real-time scraping of up-to-date information.
- Works with websites across various domains and platforms, ensuring broad applicability.
- Data export in multiple formats (CSV, JSON, Excel).
Learn More: _For detailed information on using the Metadata Scraper and its different use cases, read our guide: How to Scrape Metadata
Support
If you encounter any issues or have questions, please contact our support team at cloud-support@scrapehero.com or browse our help center at https://app.scrapehero.com/docs/.