Magic

Every kind of page Magic recognizes

Magic fills in the usual fields for 24 kinds of pages in one click. Pick a kind to see its fields, what each one holds, an example value, and when to choose it.

How Magic works

  1. 1Open List Extract for a list of items, or Detail Extract for one item per page, and press the wand button.
  2. 2Choose Auto to let ScrapePass detect the kind, or pick a kind yourself when you know it. Picking the kind gives you its exact fields.
  3. 3Magic reads each field from the page’s structured data first (schema.org JSON-LD and microdata), then from usual tags, class names and page metadata. In a list, a field is kept when at least 30% of the items have a value for it.
  4. 4Check the result, then make it yours: rename, remove or reorder fields, change a field’s type, or click any element on the page to add a custom field.

Kinds of pages

Product

Choose it when you want prices, brands and ratings from a shop, as a list of products or from each product page.

Typical pages: Online shops, marketplaces, category and search result pages, product pages.

For a page of customer reviews of one product, pick Review.

FieldWhat it holdsExample
nametextThe name, as shown on the page.Trailhead 40L Hiking Backpack
pricepriceThe price as a number, without the currency sign.129.99
currencytextCurrency code of the price, such as USD or EUR.USD
imageimageFull address of the main image.https://shop.example.com/img/trailhead-40l.jpg
descriptiontextThe description, as written on the page.Lightweight 40-litre pack with a rain cover and hip-belt pockets.
brandtextBrand or maker.Ridgeline
skutextThe seller’s product code (SKU).RL-TH40-GRN
ratingnumberAverage rating, as a number (usually out of 5).4.7
review_countnumberHow many reviews or ratings the average is based on.312
availabilitytextStock status: the page’s value (such as InStock) or the text shown.InStock
urlurlFull address of the item’s own page.https://shop.example.com/products/trailhead-40l
Recognizes schema.org types: Product, ProductGroup, IndividualProduct
Coupon / deal →

Which kind should I choose?

Start with Auto. If it picks the wrong kind, or misses fields you need, choose the kind from this table.

KindChoose it whenMain fields
ProductYou want prices, brands and ratings from a shop, as a list of products or from each product page.Name, price, brand, image, rating
Coupon / dealYou collect discount codes and deals with their expiry dates.Title, code, discount, store, expiry
VehicleYou compare cars or motorbikes for sale by price, year and mileage.Title, price, make, model, year, mileage
SoftwareYou research apps, plugins or SaaS tools with their ratings and pricing.Name, rating, category, pricing, vendor
BookYou need ISBNs, authors, publishers and prices of books or audiobooks.Title, author, ISBN, publisher, pages, price, rating
BusinessYou build a lead list of local businesses with phone numbers, addresses and websites.Name, rating, phone, address, website
Hotel / restaurantYou compare hotels, restaurants or attractions by rating, price range and amenities.Name, rating, price, address, amenities
Hotel roomYou compare the rooms of a hotel or rental: price per night, beds, guests and cancellation.Room type, price per night, beds, guests, amenities
PropertyYou track homes or apartments for sale or rent by price, beds, baths and area.Address, price, beds, baths, area
EventYou list events with their dates, venues and ticket links.Name, dates, venue, address, tickets
JobYou collect job openings with company, location, salary and the apply link.Title, company, location, salary, apply
Person / profileYou gather public profiles: names, titles, organizations and links.Name, headline, organization, location, bio, links
CourseYou compare courses by provider, price, duration and level.Title, provider, instructor, price, duration, level
ArticleYou archive or analyze articles: title, author, date and full text.Title, author, date, text, image
DiscussionYou collect forum threads or social posts with their replies and comments.Title, author, date, post, comments
Q&A / FAQYou need questions with their answers, votes and the accepted answer.Question, answers, accepted answer, votes, tags
ReviewYou analyze reviews: rating, text, pros and cons, author and date.Rating, title, text, author, date, item reviewed
Paper / documentYou collect research papers or reports with authors, DOI, abstract and PDF link.Title, authors, date, abstract, DOI, PDF link
RecipeYou save recipes with times, servings, ingredients and steps.Name, times, servings, ingredients, steps, calories
ImageYou collect photos with their titles, captions, authors and licenses.Image, title, caption, author, date
VideoYou list videos with their duration, channel, date and views.Video, title, thumbnail, duration, views
Movie / TV showYou compare movies or TV shows by year, genre, cast and rating.Title, year, genre, director, cast, runtime, rating
Music / podcastYou catalog tracks, albums or podcast episodes with artists and durations.Title, artist or host, album or show, duration, date
Crypto / stockYou track prices of cryptocurrencies or stocks with change, market cap and volume.Name, symbol, price, change, market cap
Map locationsThe page shows results as pins on a map (List Extract only).name, address, latitude, longitude, link

Good to know

What if a field is empty?

Pages don’t always show every field. Magic only fills what the page contains. If a value is on the page but Magic missed it, click the element to add it as a field.

Can I combine Magic with my own fields?

Yes. Magic is a starting point. Add, rename, remove and reorder fields afterwards, and save the setup as a recipe to run it again in one click.

Are the examples real?

No. They are made-up values that show the format you get, after each field’s type is applied. See field types for how values are cleaned.

See it in practice in the use cases, or compare ScrapePass with other web scrapers.

Try Magic on your own pages

Running extractions is free. Verify your email for 5 free days of unlimited exports.

Add to Chrome